Sep 07 13:36:53.264020 ip-10-0-141-124 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Sep 07 13:36:53.264030 ip-10-0-141-124 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Sep 07 13:36:53.264038 ip-10-0-141-124 systemd[1]: kubelet.service: Failed with result 'resources'. Sep 07 13:36:53.264257 ip-10-0-141-124 systemd[1]: Failed to start Kubernetes Kubelet. Sep 07 13:37:03.367930 ip-10-0-141-124 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Sep 07 13:37:03.367949 ip-10-0-141-124 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot b664370ff37343b4a9a0132f6400a4ac -- Sep 07 13:38:48.378065 ip-10-0-141-124 systemd[1]: Starting Kubernetes Kubelet... Sep 07 13:38:48.824168 ip-10-0-141-124 kubenswrapper[2575]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 07 13:38:48.824168 ip-10-0-141-124 kubenswrapper[2575]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 07 13:38:48.824168 ip-10-0-141-124 kubenswrapper[2575]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 07 13:38:48.824168 ip-10-0-141-124 kubenswrapper[2575]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 07 13:38:48.824168 ip-10-0-141-124 kubenswrapper[2575]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 07 13:38:48.826128 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.826041 2575 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 07 13:38:48.831390 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.831228 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 07 13:38:48.831390 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.831386 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 07 13:38:48.831390 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.831390 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 07 13:38:48.831390 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.831393 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 07 13:38:48.831390 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.831397 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 07 13:38:48.831583 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.831401 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 07 13:38:48.831583 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.831404 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 07 13:38:48.831583 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.831407 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 07 13:38:48.831583 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.831410 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 07 13:38:48.831583 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.831412 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 07 13:38:48.831583 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.831415 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 07 13:38:48.831583 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.831418 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 07 13:38:48.831583 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.831420 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 07 13:38:48.831583 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.831423 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 07 13:38:48.831583 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.831425 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 07 13:38:48.831583 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.831428 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 07 13:38:48.831583 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.831431 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 07 13:38:48.831583 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.831434 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 07 13:38:48.831583 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.831437 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 07 13:38:48.831583 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.831439 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 07 13:38:48.831583 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.831442 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 07 13:38:48.831583 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.831444 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 07 13:38:48.831583 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.831447 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 07 13:38:48.831583 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.831450 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 07 13:38:48.831583 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.831452 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 07 13:38:48.832072 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.831455 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 07 13:38:48.832072 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.831457 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 07 13:38:48.832072 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.831460 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 07 13:38:48.832072 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.831462 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 07 13:38:48.832072 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.831468 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 07 13:38:48.832072 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.831472 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 07 13:38:48.832072 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.831476 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 07 13:38:48.832072 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.831479 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 07 13:38:48.832072 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.831482 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 07 13:38:48.832072 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.831485 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 07 13:38:48.832072 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.831488 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 07 13:38:48.832072 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.831491 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 07 13:38:48.832072 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.831494 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 07 13:38:48.832072 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.831498 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 07 13:38:48.832072 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.831501 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 07 13:38:48.832072 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.831504 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 07 13:38:48.832072 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.831507 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 07 13:38:48.832072 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.831510 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 07 13:38:48.832072 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.831513 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 07 13:38:48.832072 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.831516 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 07 13:38:48.832577 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.831519 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 07 13:38:48.832577 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.831521 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 07 13:38:48.832577 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.831524 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 07 13:38:48.832577 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.831527 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 07 13:38:48.832577 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.831529 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 07 13:38:48.832577 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.831532 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 07 13:38:48.832577 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.831534 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 07 13:38:48.832577 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.831537 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 07 13:38:48.832577 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.831540 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 07 13:38:48.832577 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.831542 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 07 13:38:48.832577 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.831544 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 07 13:38:48.832577 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.831547 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 07 13:38:48.832577 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.831551 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 07 13:38:48.832577 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.831554 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 07 13:38:48.832577 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.831556 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 07 13:38:48.832577 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.831559 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 07 13:38:48.832577 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.831562 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 07 13:38:48.832577 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.831566 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 07 13:38:48.832577 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.831569 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 07 13:38:48.833072 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.831572 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 07 13:38:48.833072 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.831576 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 07 13:38:48.833072 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.831578 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 07 13:38:48.833072 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.831581 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 07 13:38:48.833072 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.831583 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 07 13:38:48.833072 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.831586 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 07 13:38:48.833072 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.831591 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 07 13:38:48.833072 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.831594 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 07 13:38:48.833072 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.831597 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 07 13:38:48.833072 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.831600 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 07 13:38:48.833072 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.831602 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 07 13:38:48.833072 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.831605 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 07 13:38:48.833072 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.831608 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 07 13:38:48.833072 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.831610 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 07 13:38:48.833072 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.831613 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 07 13:38:48.833072 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.831615 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 07 13:38:48.833072 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.831618 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 07 13:38:48.833072 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.831621 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 07 13:38:48.833072 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.831623 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 07 13:38:48.833564 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.831627 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 07 13:38:48.833564 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.831629 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 07 13:38:48.833564 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.831632 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 07 13:38:48.833564 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.831636 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 07 13:38:48.833564 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.831641 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 07 13:38:48.833564 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.831644 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 07 13:38:48.833564 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.831647 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 07 13:38:48.833564 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.831650 2575 feature_gate.go:328] unrecognized feature gate: Example2 Sep 07 13:38:48.833564 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.831653 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 07 13:38:48.833564 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.831655 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 07 13:38:48.833564 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.831658 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 07 13:38:48.833564 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.831661 2575 feature_gate.go:328] unrecognized feature gate: Example Sep 07 13:38:48.833564 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.831663 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 07 13:38:48.833564 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.831666 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 07 13:38:48.833564 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.831668 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 07 13:38:48.833564 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.831671 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 07 13:38:48.833564 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.832372 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 07 13:38:48.833564 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.832380 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 07 13:38:48.833564 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.832384 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 07 13:38:48.834042 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.832387 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 07 13:38:48.834042 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.832390 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 07 13:38:48.834042 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.832393 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 07 13:38:48.834042 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.832396 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 07 13:38:48.834042 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.832399 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 07 13:38:48.834042 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.832401 2575 feature_gate.go:328] unrecognized feature gate: Example Sep 07 13:38:48.834042 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.832404 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 07 13:38:48.834042 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.832406 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 07 13:38:48.834042 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.832409 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 07 13:38:48.834042 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.832412 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 07 13:38:48.834042 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.832414 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 07 13:38:48.834042 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.832417 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 07 13:38:48.834042 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.832421 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 07 13:38:48.834042 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.832424 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 07 13:38:48.834042 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.832428 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 07 13:38:48.834042 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.832430 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 07 13:38:48.834042 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.832433 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 07 13:38:48.834042 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.832435 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 07 13:38:48.834042 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.832438 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 07 13:38:48.834042 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.832440 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 07 13:38:48.834530 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.832443 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 07 13:38:48.834530 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.832445 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 07 13:38:48.834530 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.832450 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 07 13:38:48.834530 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.832453 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 07 13:38:48.834530 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.832456 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 07 13:38:48.834530 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.832459 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 07 13:38:48.834530 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.832462 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 07 13:38:48.834530 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.832465 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 07 13:38:48.834530 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.832467 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 07 13:38:48.834530 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.832470 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 07 13:38:48.834530 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.832472 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 07 13:38:48.834530 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.832474 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 07 13:38:48.834530 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.832477 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 07 13:38:48.834530 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.832480 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 07 13:38:48.834530 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.832483 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 07 13:38:48.834530 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.832486 2575 feature_gate.go:328] unrecognized feature gate: Example2 Sep 07 13:38:48.834530 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.832488 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 07 13:38:48.834530 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.832491 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 07 13:38:48.834530 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.832493 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 07 13:38:48.835009 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.832496 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 07 13:38:48.835009 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.832499 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 07 13:38:48.835009 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.832501 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 07 13:38:48.835009 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.832504 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 07 13:38:48.835009 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.832507 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 07 13:38:48.835009 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.832509 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 07 13:38:48.835009 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.832511 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 07 13:38:48.835009 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.832514 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 07 13:38:48.835009 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.832516 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 07 13:38:48.835009 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.832519 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 07 13:38:48.835009 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.832521 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 07 13:38:48.835009 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.832523 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 07 13:38:48.835009 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.832526 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 07 13:38:48.835009 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.832528 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 07 13:38:48.835009 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.832540 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 07 13:38:48.835009 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.832543 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 07 13:38:48.835009 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.832545 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 07 13:38:48.835009 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.832548 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 07 13:38:48.835009 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.832550 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 07 13:38:48.835009 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.832554 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 07 13:38:48.835496 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.832556 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 07 13:38:48.835496 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.832559 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 07 13:38:48.835496 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.832562 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 07 13:38:48.835496 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.832564 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 07 13:38:48.835496 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.832567 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 07 13:38:48.835496 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.832570 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 07 13:38:48.835496 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.832573 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 07 13:38:48.835496 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.832576 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 07 13:38:48.835496 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.832578 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 07 13:38:48.835496 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.832581 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 07 13:38:48.835496 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.832584 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 07 13:38:48.835496 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.832586 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 07 13:38:48.835496 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.832589 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 07 13:38:48.835496 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.832592 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 07 13:38:48.835496 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.832594 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 07 13:38:48.835496 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.832597 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 07 13:38:48.835496 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.832599 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 07 13:38:48.835496 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.832602 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 07 13:38:48.835496 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.832605 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 07 13:38:48.835496 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.832607 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 07 13:38:48.835993 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.832609 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 07 13:38:48.835993 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.832613 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 07 13:38:48.835993 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.832616 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 07 13:38:48.835993 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.832618 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 07 13:38:48.835993 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.832620 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 07 13:38:48.835993 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.832623 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 07 13:38:48.835993 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.832625 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 07 13:38:48.835993 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.832632 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 07 13:38:48.835993 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.832634 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 07 13:38:48.835993 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.832637 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 07 13:38:48.835993 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.832639 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 07 13:38:48.835993 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.832641 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 07 13:38:48.835993 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.832644 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 07 13:38:48.835993 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.832646 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 07 13:38:48.835993 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.832649 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 07 13:38:48.835993 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.832651 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 07 13:38:48.835993 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.832654 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 07 13:38:48.835993 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.834263 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 07 13:38:48.835993 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.834270 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 07 13:38:48.836457 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.834275 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 07 13:38:48.836457 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.834279 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 07 13:38:48.836457 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.834282 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 07 13:38:48.836457 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.834285 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 07 13:38:48.836457 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.834287 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 07 13:38:48.836457 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.834290 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 07 13:38:48.836457 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.834292 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 07 13:38:48.836457 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.834295 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 07 13:38:48.836457 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.834297 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 07 13:38:48.836457 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.834300 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 07 13:38:48.836457 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.834302 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 07 13:38:48.836457 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.834305 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 07 13:38:48.836457 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.834307 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 07 13:38:48.836457 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.834309 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 07 13:38:48.836457 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.834312 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 07 13:38:48.836457 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.834315 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 07 13:38:48.836457 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.834318 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 07 13:38:48.836457 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.834320 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 07 13:38:48.836457 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.834322 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 07 13:38:48.836945 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.834325 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 07 13:38:48.836945 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.834328 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 07 13:38:48.836945 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.834330 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 07 13:38:48.836945 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.834333 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 07 13:38:48.836945 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.834335 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 07 13:38:48.836945 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.834337 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 07 13:38:48.836945 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.834340 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 07 13:38:48.836945 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.834343 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 07 13:38:48.836945 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.834345 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 07 13:38:48.836945 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.834348 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 07 13:38:48.836945 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.834350 2575 feature_gate.go:328] unrecognized feature gate: Example2 Sep 07 13:38:48.836945 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.834353 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 07 13:38:48.836945 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.834356 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 07 13:38:48.836945 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.834359 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 07 13:38:48.836945 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.834361 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 07 13:38:48.836945 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.834364 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 07 13:38:48.836945 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.834366 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 07 13:38:48.836945 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.834368 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 07 13:38:48.836945 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.834371 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 07 13:38:48.836945 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.834373 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 07 13:38:48.837437 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.834375 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 07 13:38:48.837437 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.834378 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 07 13:38:48.837437 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.834380 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 07 13:38:48.837437 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.834382 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 07 13:38:48.837437 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.834385 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 07 13:38:48.837437 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.834387 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 07 13:38:48.837437 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.834390 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 07 13:38:48.837437 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.834393 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 07 13:38:48.837437 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.834396 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 07 13:38:48.837437 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.834398 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 07 13:38:48.837437 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.834400 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 07 13:38:48.837437 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.834403 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 07 13:38:48.837437 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.834405 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 07 13:38:48.837437 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.834408 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 07 13:38:48.837437 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.834410 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 07 13:38:48.837437 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.834413 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 07 13:38:48.837437 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.834415 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 07 13:38:48.837437 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.834418 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 07 13:38:48.837437 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.834420 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 07 13:38:48.837437 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.834422 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 07 13:38:48.837924 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.834425 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 07 13:38:48.837924 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.834427 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 07 13:38:48.837924 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.834429 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 07 13:38:48.837924 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.834432 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 07 13:38:48.837924 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.834434 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 07 13:38:48.837924 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.834437 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 07 13:38:48.837924 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.834439 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 07 13:38:48.837924 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.834441 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 07 13:38:48.837924 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.834444 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 07 13:38:48.837924 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.834446 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 07 13:38:48.837924 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.834449 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 07 13:38:48.837924 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.834451 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 07 13:38:48.837924 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.834455 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 07 13:38:48.837924 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.834458 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 07 13:38:48.837924 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.834461 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 07 13:38:48.837924 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.834464 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 07 13:38:48.837924 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.834466 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 07 13:38:48.837924 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.834469 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 07 13:38:48.837924 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.834472 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 07 13:38:48.838404 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.834475 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 07 13:38:48.838404 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.834478 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 07 13:38:48.838404 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.834481 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 07 13:38:48.838404 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.834484 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 07 13:38:48.838404 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.834487 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 07 13:38:48.838404 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.834489 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 07 13:38:48.838404 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.834493 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 07 13:38:48.838404 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.834495 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 07 13:38:48.838404 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.834498 2575 feature_gate.go:328] unrecognized feature gate: Example Sep 07 13:38:48.838404 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.834500 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 07 13:38:48.838404 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.834503 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 07 13:38:48.838404 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.834505 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 07 13:38:48.838404 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.834508 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 07 13:38:48.838404 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.834510 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 07 13:38:48.838404 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.834513 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 07 13:38:48.838404 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.834515 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 07 13:38:48.838404 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.834518 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 07 13:38:48.838404 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.834521 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 07 13:38:48.838404 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.834523 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 07 13:38:48.838404 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.834596 2575 flags.go:64] FLAG: --address="0.0.0.0" Sep 07 13:38:48.838991 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.834626 2575 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 07 13:38:48.838991 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.834631 2575 flags.go:64] FLAG: --anonymous-auth="true" Sep 07 13:38:48.838991 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.834636 2575 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 07 13:38:48.838991 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.834639 2575 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 07 13:38:48.838991 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.834642 2575 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 07 13:38:48.838991 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.834646 2575 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 07 13:38:48.838991 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.834650 2575 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 07 13:38:48.838991 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.834653 2575 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 07 13:38:48.838991 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.834655 2575 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 07 13:38:48.838991 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.834658 2575 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 07 13:38:48.838991 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.834662 2575 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 07 13:38:48.838991 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.834665 2575 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 07 13:38:48.838991 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.834667 2575 flags.go:64] FLAG: --cgroup-root="" Sep 07 13:38:48.838991 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.834670 2575 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 07 13:38:48.838991 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.834673 2575 flags.go:64] FLAG: --client-ca-file="" Sep 07 13:38:48.838991 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.834676 2575 flags.go:64] FLAG: --cloud-provider="external" Sep 07 13:38:48.838991 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.834679 2575 flags.go:64] FLAG: --cluster-dns="[]" Sep 07 13:38:48.838991 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.834683 2575 flags.go:64] FLAG: --cluster-domain="" Sep 07 13:38:48.838991 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.834686 2575 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 07 13:38:48.838991 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.834689 2575 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 07 13:38:48.838991 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.834692 2575 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 07 13:38:48.838991 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.834695 2575 flags.go:64] FLAG: --container-log-max-files="5" Sep 07 13:38:48.838991 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.834699 2575 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 07 13:38:48.838991 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.834702 2575 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 07 13:38:48.839563 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.834704 2575 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 07 13:38:48.839563 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.834707 2575 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 07 13:38:48.839563 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.834710 2575 flags.go:64] FLAG: --contention-profiling="false" Sep 07 13:38:48.839563 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.834713 2575 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 07 13:38:48.839563 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.834718 2575 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 07 13:38:48.839563 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.834721 2575 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 07 13:38:48.839563 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.834723 2575 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 07 13:38:48.839563 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.834729 2575 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 07 13:38:48.839563 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.834732 2575 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 07 13:38:48.839563 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.834735 2575 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 07 13:38:48.839563 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.834738 2575 flags.go:64] FLAG: --enable-load-reader="false" Sep 07 13:38:48.839563 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.834741 2575 flags.go:64] FLAG: --enable-server="true" Sep 07 13:38:48.839563 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.834743 2575 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 07 13:38:48.839563 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.834747 2575 flags.go:64] FLAG: --event-burst="100" Sep 07 13:38:48.839563 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.834750 2575 flags.go:64] FLAG: --event-qps="50" Sep 07 13:38:48.839563 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.834753 2575 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 07 13:38:48.839563 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.834756 2575 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 07 13:38:48.839563 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.834759 2575 flags.go:64] FLAG: --eviction-hard="" Sep 07 13:38:48.839563 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.834762 2575 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 07 13:38:48.839563 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.834765 2575 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 07 13:38:48.839563 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.834768 2575 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 07 13:38:48.839563 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.834771 2575 flags.go:64] FLAG: --eviction-soft="" Sep 07 13:38:48.839563 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.834774 2575 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 07 13:38:48.839563 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.834776 2575 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 07 13:38:48.839563 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.834793 2575 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 07 13:38:48.840207 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.834797 2575 flags.go:64] FLAG: --experimental-mounter-path="" Sep 07 13:38:48.840207 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.834801 2575 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 07 13:38:48.840207 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.834804 2575 flags.go:64] FLAG: --fail-swap-on="true" Sep 07 13:38:48.840207 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.834806 2575 flags.go:64] FLAG: --feature-gates="" Sep 07 13:38:48.840207 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.834810 2575 flags.go:64] FLAG: --file-check-frequency="20s" Sep 07 13:38:48.840207 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.834813 2575 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 07 13:38:48.840207 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.834816 2575 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 07 13:38:48.840207 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.834819 2575 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 07 13:38:48.840207 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.834822 2575 flags.go:64] FLAG: --healthz-port="10248" Sep 07 13:38:48.840207 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.834825 2575 flags.go:64] FLAG: --help="false" Sep 07 13:38:48.840207 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.834827 2575 flags.go:64] FLAG: --hostname-override="ip-10-0-141-124.ec2.internal" Sep 07 13:38:48.840207 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.834832 2575 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 07 13:38:48.840207 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.834835 2575 flags.go:64] FLAG: --http-check-frequency="20s" Sep 07 13:38:48.840207 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.834837 2575 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 07 13:38:48.840207 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.834841 2575 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 07 13:38:48.840207 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.834844 2575 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 07 13:38:48.840207 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.834847 2575 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 07 13:38:48.840207 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.834850 2575 flags.go:64] FLAG: --image-service-endpoint="" Sep 07 13:38:48.840207 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.834852 2575 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 07 13:38:48.840207 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.834855 2575 flags.go:64] FLAG: --kube-api-burst="100" Sep 07 13:38:48.840207 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.834858 2575 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 07 13:38:48.840207 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.834861 2575 flags.go:64] FLAG: --kube-api-qps="50" Sep 07 13:38:48.840207 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.834863 2575 flags.go:64] FLAG: --kube-reserved="" Sep 07 13:38:48.840207 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.834866 2575 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 07 13:38:48.840818 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.834869 2575 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 07 13:38:48.840818 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.834872 2575 flags.go:64] FLAG: --kubelet-cgroups="" Sep 07 13:38:48.840818 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.834874 2575 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 07 13:38:48.840818 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.834877 2575 flags.go:64] FLAG: --lock-file="" Sep 07 13:38:48.840818 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.834879 2575 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 07 13:38:48.840818 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.834882 2575 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 07 13:38:48.840818 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.834885 2575 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 07 13:38:48.840818 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.834890 2575 flags.go:64] FLAG: --log-json-split-stream="false" Sep 07 13:38:48.840818 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.834893 2575 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 07 13:38:48.840818 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.834897 2575 flags.go:64] FLAG: --log-text-split-stream="false" Sep 07 13:38:48.840818 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.834900 2575 flags.go:64] FLAG: --logging-format="text" Sep 07 13:38:48.840818 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.834903 2575 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 07 13:38:48.840818 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.834906 2575 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 07 13:38:48.840818 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.834908 2575 flags.go:64] FLAG: --manifest-url="" Sep 07 13:38:48.840818 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.834911 2575 flags.go:64] FLAG: --manifest-url-header="" Sep 07 13:38:48.840818 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.834916 2575 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 07 13:38:48.840818 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.834918 2575 flags.go:64] FLAG: --max-open-files="1000000" Sep 07 13:38:48.840818 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.834922 2575 flags.go:64] FLAG: --max-pods="110" Sep 07 13:38:48.840818 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.834925 2575 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 07 13:38:48.840818 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.834930 2575 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 07 13:38:48.840818 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.834933 2575 flags.go:64] FLAG: --memory-manager-policy="None" Sep 07 13:38:48.840818 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.834936 2575 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 07 13:38:48.840818 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.834939 2575 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 07 13:38:48.840818 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.834941 2575 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 07 13:38:48.840818 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.834944 2575 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 07 13:38:48.841425 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.834952 2575 flags.go:64] FLAG: --node-status-max-images="50" Sep 07 13:38:48.841425 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.834955 2575 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 07 13:38:48.841425 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.834958 2575 flags.go:64] FLAG: --oom-score-adj="-999" Sep 07 13:38:48.841425 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.834961 2575 flags.go:64] FLAG: --pod-cidr="" Sep 07 13:38:48.841425 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.834963 2575 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1" Sep 07 13:38:48.841425 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.834968 2575 flags.go:64] FLAG: --pod-manifest-path="" Sep 07 13:38:48.841425 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.834971 2575 flags.go:64] FLAG: --pod-max-pids="-1" Sep 07 13:38:48.841425 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.834974 2575 flags.go:64] FLAG: --pods-per-core="0" Sep 07 13:38:48.841425 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.834977 2575 flags.go:64] FLAG: --port="10250" Sep 07 13:38:48.841425 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.834980 2575 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 07 13:38:48.841425 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.834982 2575 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-01d9d9a151ed0563b" Sep 07 13:38:48.841425 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.834986 2575 flags.go:64] FLAG: --qos-reserved="" Sep 07 13:38:48.841425 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.834989 2575 flags.go:64] FLAG: --read-only-port="10255" Sep 07 13:38:48.841425 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.834992 2575 flags.go:64] FLAG: --register-node="true" Sep 07 13:38:48.841425 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.834994 2575 flags.go:64] FLAG: --register-with-taints="" Sep 07 13:38:48.841425 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.834997 2575 flags.go:64] FLAG: --registry-burst="10" Sep 07 13:38:48.841425 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.835001 2575 flags.go:64] FLAG: --registry-qps="5" Sep 07 13:38:48.841425 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.835005 2575 flags.go:64] FLAG: --reserved-cpus="" Sep 07 13:38:48.841425 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.835007 2575 flags.go:64] FLAG: --reserved-memory="" Sep 07 13:38:48.841425 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.835011 2575 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 07 13:38:48.841425 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.835014 2575 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 07 13:38:48.841425 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.835017 2575 flags.go:64] FLAG: --rotate-certificates="false" Sep 07 13:38:48.841425 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.835020 2575 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 07 13:38:48.841425 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.835023 2575 flags.go:64] FLAG: --runonce="false" Sep 07 13:38:48.841425 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.835025 2575 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 07 13:38:48.842140 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.835028 2575 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 07 13:38:48.842140 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.835033 2575 flags.go:64] FLAG: --seccomp-default="false" Sep 07 13:38:48.842140 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.835035 2575 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 07 13:38:48.842140 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.835038 2575 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 07 13:38:48.842140 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.835041 2575 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 07 13:38:48.842140 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.835044 2575 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 07 13:38:48.842140 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.835047 2575 flags.go:64] FLAG: --storage-driver-password="root" Sep 07 13:38:48.842140 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.835050 2575 flags.go:64] FLAG: --storage-driver-secure="false" Sep 07 13:38:48.842140 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.835053 2575 flags.go:64] FLAG: --storage-driver-table="stats" Sep 07 13:38:48.842140 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.835055 2575 flags.go:64] FLAG: --storage-driver-user="root" Sep 07 13:38:48.842140 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.835058 2575 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 07 13:38:48.842140 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.835060 2575 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 07 13:38:48.842140 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.835063 2575 flags.go:64] FLAG: --system-cgroups="" Sep 07 13:38:48.842140 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.835066 2575 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 07 13:38:48.842140 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.835071 2575 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 07 13:38:48.842140 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.835073 2575 flags.go:64] FLAG: --tls-cert-file="" Sep 07 13:38:48.842140 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.835076 2575 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 07 13:38:48.842140 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.835080 2575 flags.go:64] FLAG: --tls-min-version="" Sep 07 13:38:48.842140 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.835082 2575 flags.go:64] FLAG: --tls-private-key-file="" Sep 07 13:38:48.842140 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.835085 2575 flags.go:64] FLAG: --topology-manager-policy="none" Sep 07 13:38:48.842140 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.835087 2575 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 07 13:38:48.842140 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.835090 2575 flags.go:64] FLAG: --topology-manager-scope="container" Sep 07 13:38:48.842140 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.835092 2575 flags.go:64] FLAG: --v="2" Sep 07 13:38:48.842140 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.835096 2575 flags.go:64] FLAG: --version="false" Sep 07 13:38:48.842140 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.835101 2575 flags.go:64] FLAG: --vmodule="" Sep 07 13:38:48.842748 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.835105 2575 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 07 13:38:48.842748 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.835108 2575 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 07 13:38:48.842748 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.835216 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 07 13:38:48.842748 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.835219 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 07 13:38:48.842748 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.835222 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 07 13:38:48.842748 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.835225 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 07 13:38:48.842748 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.835227 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 07 13:38:48.842748 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.835230 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 07 13:38:48.842748 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.835234 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 07 13:38:48.842748 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.835237 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 07 13:38:48.842748 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.835239 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 07 13:38:48.842748 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.835242 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 07 13:38:48.842748 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.835244 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 07 13:38:48.842748 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.835247 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 07 13:38:48.842748 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.835249 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 07 13:38:48.842748 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.835252 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 07 13:38:48.842748 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.835254 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 07 13:38:48.842748 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.835256 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 07 13:38:48.842748 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.835259 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 07 13:38:48.842748 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.835261 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 07 13:38:48.843244 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.835264 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 07 13:38:48.843244 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.835266 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 07 13:38:48.843244 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.835269 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 07 13:38:48.843244 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.835271 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 07 13:38:48.843244 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.835274 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 07 13:38:48.843244 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.835276 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 07 13:38:48.843244 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.835278 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 07 13:38:48.843244 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.835281 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 07 13:38:48.843244 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.835283 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 07 13:38:48.843244 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.835286 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 07 13:38:48.843244 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.835288 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 07 13:38:48.843244 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.835292 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 07 13:38:48.843244 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.835295 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 07 13:38:48.843244 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.835297 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 07 13:38:48.843244 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.835300 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 07 13:38:48.843244 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.835302 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 07 13:38:48.843244 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.835305 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 07 13:38:48.843244 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.835309 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 07 13:38:48.843244 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.835312 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 07 13:38:48.843720 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.835316 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 07 13:38:48.843720 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.835320 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 07 13:38:48.843720 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.835322 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 07 13:38:48.843720 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.835325 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 07 13:38:48.843720 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.835327 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 07 13:38:48.843720 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.835331 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 07 13:38:48.843720 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.835335 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 07 13:38:48.843720 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.835337 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 07 13:38:48.843720 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.835340 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 07 13:38:48.843720 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.835342 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 07 13:38:48.843720 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.835344 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 07 13:38:48.843720 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.835347 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 07 13:38:48.843720 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.835349 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 07 13:38:48.843720 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.835351 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 07 13:38:48.843720 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.835354 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 07 13:38:48.843720 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.835356 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 07 13:38:48.843720 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.835359 2575 feature_gate.go:328] unrecognized feature gate: Example Sep 07 13:38:48.843720 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.835361 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 07 13:38:48.843720 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.835364 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 07 13:38:48.844189 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.835366 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 07 13:38:48.844189 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.835368 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 07 13:38:48.844189 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.835371 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 07 13:38:48.844189 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.835373 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 07 13:38:48.844189 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.835376 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 07 13:38:48.844189 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.835379 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 07 13:38:48.844189 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.835382 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 07 13:38:48.844189 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.835385 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 07 13:38:48.844189 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.835388 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 07 13:38:48.844189 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.835390 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 07 13:38:48.844189 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.835394 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 07 13:38:48.844189 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.835397 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 07 13:38:48.844189 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.835399 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 07 13:38:48.844189 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.835402 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 07 13:38:48.844189 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.835406 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 07 13:38:48.844189 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.835409 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 07 13:38:48.844189 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.835412 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 07 13:38:48.844189 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.835414 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 07 13:38:48.844189 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.835417 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 07 13:38:48.844683 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.835420 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 07 13:38:48.844683 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.835422 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 07 13:38:48.844683 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.835425 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 07 13:38:48.844683 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.835428 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 07 13:38:48.844683 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.835431 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 07 13:38:48.844683 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.835433 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 07 13:38:48.844683 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.835436 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 07 13:38:48.844683 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.835438 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 07 13:38:48.844683 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.835441 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 07 13:38:48.844683 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.835443 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 07 13:38:48.844683 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.835446 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 07 13:38:48.844683 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.835448 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 07 13:38:48.844683 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.835450 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 07 13:38:48.844683 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.835453 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 07 13:38:48.844683 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.835455 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 07 13:38:48.844683 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.835458 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 07 13:38:48.844683 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.835460 2575 feature_gate.go:328] unrecognized feature gate: Example2 Sep 07 13:38:48.844683 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.835462 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 07 13:38:48.844683 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.835466 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 07 13:38:48.844683 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.835468 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 07 13:38:48.845192 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.835471 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 07 13:38:48.845192 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.835473 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 07 13:38:48.845192 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.835476 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 07 13:38:48.845192 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.835478 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 07 13:38:48.845192 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.835486 2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 07 13:38:48.845192 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.844772 2575 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 07 13:38:48.845192 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.844802 2575 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 07 13:38:48.845192 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.844822 2575 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 07 13:38:48.845192 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.844827 2575 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 07 13:38:48.845192 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.844900 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 07 13:38:48.845192 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.844905 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 07 13:38:48.845192 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.844908 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 07 13:38:48.845192 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.844911 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 07 13:38:48.845192 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.844914 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 07 13:38:48.845578 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.844917 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 07 13:38:48.845578 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.844919 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 07 13:38:48.845578 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.844922 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 07 13:38:48.845578 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.844924 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 07 13:38:48.845578 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.844927 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 07 13:38:48.845578 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.844930 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 07 13:38:48.845578 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.844932 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 07 13:38:48.845578 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.844936 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 07 13:38:48.845578 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.844938 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 07 13:38:48.845578 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.844941 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 07 13:38:48.845578 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.844943 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 07 13:38:48.845578 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.844946 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 07 13:38:48.845578 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.844949 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 07 13:38:48.845578 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.844951 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 07 13:38:48.845578 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.844954 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 07 13:38:48.845578 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.844957 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 07 13:38:48.845578 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.844961 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 07 13:38:48.845578 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.844964 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 07 13:38:48.845578 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.844966 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 07 13:38:48.845578 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.844969 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 07 13:38:48.846071 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.844972 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 07 13:38:48.846071 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.844975 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 07 13:38:48.846071 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.844977 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 07 13:38:48.846071 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.844980 2575 feature_gate.go:328] unrecognized feature gate: Example Sep 07 13:38:48.846071 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.844983 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 07 13:38:48.846071 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.844986 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 07 13:38:48.846071 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.844988 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 07 13:38:48.846071 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.844991 2575 feature_gate.go:328] unrecognized feature gate: Example2 Sep 07 13:38:48.846071 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.844993 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 07 13:38:48.846071 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.844996 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 07 13:38:48.846071 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.844999 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 07 13:38:48.846071 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.845001 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 07 13:38:48.846071 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.845004 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 07 13:38:48.846071 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.845006 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 07 13:38:48.846071 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.845008 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 07 13:38:48.846071 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.845011 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 07 13:38:48.846071 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.845013 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 07 13:38:48.846071 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.845017 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 07 13:38:48.846071 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.845020 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 07 13:38:48.846071 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.845023 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 07 13:38:48.846542 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.845026 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 07 13:38:48.846542 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.845029 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 07 13:38:48.846542 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.845032 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 07 13:38:48.846542 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.845034 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 07 13:38:48.846542 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.845037 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 07 13:38:48.846542 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.845039 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 07 13:38:48.846542 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.845042 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 07 13:38:48.846542 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.845044 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 07 13:38:48.846542 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.845047 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 07 13:38:48.846542 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.845049 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 07 13:38:48.846542 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.845051 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 07 13:38:48.846542 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.845054 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 07 13:38:48.846542 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.845057 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 07 13:38:48.846542 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.845059 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 07 13:38:48.846542 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.845062 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 07 13:38:48.846542 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.845065 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 07 13:38:48.846542 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.845067 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 07 13:38:48.846542 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.845070 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 07 13:38:48.846542 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.845074 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 07 13:38:48.846542 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.845077 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 07 13:38:48.847033 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.845079 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 07 13:38:48.847033 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.845082 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 07 13:38:48.847033 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.845084 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 07 13:38:48.847033 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.845087 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 07 13:38:48.847033 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.845090 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 07 13:38:48.847033 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.845093 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 07 13:38:48.847033 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.845095 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 07 13:38:48.847033 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.845098 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 07 13:38:48.847033 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.845101 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 07 13:38:48.847033 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.845103 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 07 13:38:48.847033 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.845106 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 07 13:38:48.847033 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.845108 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 07 13:38:48.847033 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.845110 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 07 13:38:48.847033 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.845113 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 07 13:38:48.847033 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.845115 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 07 13:38:48.847033 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.845118 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 07 13:38:48.847033 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.845120 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 07 13:38:48.847033 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.845123 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 07 13:38:48.847033 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.845125 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 07 13:38:48.847486 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.845127 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 07 13:38:48.847486 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.845130 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 07 13:38:48.847486 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.845132 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 07 13:38:48.847486 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.845135 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 07 13:38:48.847486 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.845137 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 07 13:38:48.847486 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.845140 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 07 13:38:48.847486 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.845142 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 07 13:38:48.847486 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.845145 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 07 13:38:48.847486 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.845148 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 07 13:38:48.847486 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.845150 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 07 13:38:48.847486 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.845153 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 07 13:38:48.847486 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.845156 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 07 13:38:48.847486 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.845158 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 07 13:38:48.847486 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.845161 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 07 13:38:48.847486 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.845163 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 07 13:38:48.847922 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.845168 2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 07 13:38:48.847922 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.845287 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 07 13:38:48.847922 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.845292 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 07 13:38:48.847922 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.845295 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 07 13:38:48.847922 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.845298 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 07 13:38:48.847922 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.845300 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 07 13:38:48.847922 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.845303 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 07 13:38:48.847922 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.845306 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 07 13:38:48.847922 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.845309 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 07 13:38:48.847922 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.845312 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 07 13:38:48.847922 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.845315 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 07 13:38:48.847922 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.845317 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 07 13:38:48.847922 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.845320 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 07 13:38:48.847922 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.845322 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 07 13:38:48.848267 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.845325 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 07 13:38:48.848267 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.845327 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 07 13:38:48.848267 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.845330 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 07 13:38:48.848267 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.845332 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 07 13:38:48.848267 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.845335 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 07 13:38:48.848267 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.845337 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 07 13:38:48.848267 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.845339 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 07 13:38:48.848267 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.845342 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 07 13:38:48.848267 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.845344 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 07 13:38:48.848267 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.845346 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 07 13:38:48.848267 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.845349 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 07 13:38:48.848267 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.845352 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 07 13:38:48.848267 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.845354 2575 feature_gate.go:328] unrecognized feature gate: Example2 Sep 07 13:38:48.848267 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.845357 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 07 13:38:48.848267 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.845360 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 07 13:38:48.848267 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.845364 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 07 13:38:48.848267 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.845367 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 07 13:38:48.848267 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.845370 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 07 13:38:48.848267 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.845372 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 07 13:38:48.848267 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.845375 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 07 13:38:48.848748 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.845377 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 07 13:38:48.848748 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.845380 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 07 13:38:48.848748 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.845382 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 07 13:38:48.848748 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.845385 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 07 13:38:48.848748 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.845387 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 07 13:38:48.848748 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.845389 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 07 13:38:48.848748 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.845392 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 07 13:38:48.848748 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.845394 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 07 13:38:48.848748 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.845397 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 07 13:38:48.848748 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.845401 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 07 13:38:48.848748 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.845404 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 07 13:38:48.848748 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.845406 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 07 13:38:48.848748 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.845409 2575 feature_gate.go:328] unrecognized feature gate: Example Sep 07 13:38:48.848748 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.845411 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 07 13:38:48.848748 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.845413 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 07 13:38:48.848748 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.845416 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 07 13:38:48.848748 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.845419 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 07 13:38:48.848748 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.845421 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 07 13:38:48.848748 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.845423 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 07 13:38:48.848748 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.845426 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 07 13:38:48.849226 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.845428 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 07 13:38:48.849226 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.845430 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 07 13:38:48.849226 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.845433 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 07 13:38:48.849226 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.845436 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 07 13:38:48.849226 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.845438 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 07 13:38:48.849226 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.845441 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 07 13:38:48.849226 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.845443 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 07 13:38:48.849226 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.845445 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 07 13:38:48.849226 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.845448 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 07 13:38:48.849226 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.845450 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 07 13:38:48.849226 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.845452 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 07 13:38:48.849226 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.845455 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 07 13:38:48.849226 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.845457 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 07 13:38:48.849226 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.845459 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 07 13:38:48.849226 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.845462 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 07 13:38:48.849226 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.845464 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 07 13:38:48.849226 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.845466 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 07 13:38:48.849226 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.845469 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 07 13:38:48.849226 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.845471 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 07 13:38:48.849226 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.845473 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 07 13:38:48.849696 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.845476 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 07 13:38:48.849696 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.845479 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 07 13:38:48.849696 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.845481 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 07 13:38:48.849696 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.845483 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 07 13:38:48.849696 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.845485 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 07 13:38:48.849696 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.845488 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 07 13:38:48.849696 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.845490 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 07 13:38:48.849696 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.845496 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 07 13:38:48.849696 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.845499 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 07 13:38:48.849696 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.845501 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 07 13:38:48.849696 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.845504 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 07 13:38:48.849696 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.845507 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 07 13:38:48.849696 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.845509 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 07 13:38:48.849696 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.845512 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 07 13:38:48.849696 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.845514 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 07 13:38:48.849696 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.845517 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 07 13:38:48.849696 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.845521 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 07 13:38:48.849696 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.845524 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 07 13:38:48.849696 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.845527 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 07 13:38:48.849696 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.845529 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 07 13:38:48.850189 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.845532 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 07 13:38:48.850189 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.845534 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 07 13:38:48.850189 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.845537 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 07 13:38:48.850189 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.845541 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 07 13:38:48.850189 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.845544 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 07 13:38:48.850189 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:48.845546 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 07 13:38:48.850189 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.845551 2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 07 13:38:48.850189 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.845643 2575 server.go:962] "Client rotation is on, will bootstrap in background" Sep 07 13:38:48.850189 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.848812 2575 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 07 13:38:48.850189 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.849819 2575 server.go:1019] "Starting client certificate rotation" Sep 07 13:38:48.850189 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.849920 2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 07 13:38:48.850189 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.849957 2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 07 13:38:48.852615 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.852602 2575 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 07 13:38:48.853716 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.853699 2575 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 07 13:38:48.864705 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.864689 2575 log.go:25] "Validated CRI v1 runtime API" Sep 07 13:38:48.867752 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.867739 2575 log.go:25] "Validated CRI v1 image API" Sep 07 13:38:48.870612 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.870589 2575 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 07 13:38:48.875727 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.875707 2575 fs.go:135] Filesystem UUIDs: map[4afc0a18-025b-4434-99f4-c7ac4e1d70f3:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 c3afed45-dea1-4ab1-99a5-6df5c57efab5:/dev/nvme0n1p3] Sep 07 13:38:48.875830 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.875726 2575 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 07 13:38:48.886223 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.886099 2575 manager.go:216] Machine: {Timestamp:2026-09-07 13:38:48.880460488 +0000 UTC m=+0.374589810 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3102392 MemoryCapacity:32812158976 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec20403c8291a6ca72c3fecebd096b7d SystemUUID:ec20403c-8291-a6ca-72c3-fecebd096b7d BootID:b664370f-f373-43b4-a9a0-132f6400a4ac Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406077440 Type:vfs Inodes:4005390 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406081536 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:74:60:fa:a9:4d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:74:60:fa:a9:4d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:12:26:a0:02:88:10 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812158976 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 07 13:38:48.886223 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.886210 2575 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 07 13:38:48.886386 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.886348 2575 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 07 13:38:48.888771 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.888752 2575 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 07 13:38:48.889827 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.889798 2575 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 07 13:38:48.889954 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.889829 2575 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-124.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 07 13:38:48.890636 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.890627 2575 topology_manager.go:138] "Creating topology manager with none policy" Sep 07 13:38:48.890666 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.890639 2575 container_manager_linux.go:309] "Creating device plugin manager" Sep 07 13:38:48.890666 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.890647 2575 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 07 13:38:48.890666 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.890661 2575 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 07 13:38:48.892554 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.892544 2575 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 07 13:38:48.897312 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.897301 2575 state_mem.go:36] "Initialized new in-memory state store" Sep 07 13:38:48.897418 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.897408 2575 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 07 13:38:48.897449 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.897437 2575 kubelet.go:486] "Attempting to sync node with API server" Sep 07 13:38:48.897449 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.897447 2575 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 07 13:38:48.897506 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.897464 2575 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 07 13:38:48.897506 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.897475 2575 kubelet.go:398] "Adding apiserver pod source" Sep 07 13:38:48.897506 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.897483 2575 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 07 13:38:48.897829 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.897801 2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 07 13:38:48.897883 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.897843 2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 07 13:38:48.900397 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.900381 2575 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1" Sep 07 13:38:48.903586 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.903573 2575 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 07 13:38:48.903632 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.903604 2575 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 07 13:38:48.904449 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.904437 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 07 13:38:48.904489 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.904456 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 07 13:38:48.904489 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.904462 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 07 13:38:48.904489 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.904467 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 07 13:38:48.904489 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.904475 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 07 13:38:48.904489 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.904480 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 07 13:38:48.904643 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.904555 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 07 13:38:48.904643 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.904561 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 07 13:38:48.904643 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.904567 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 07 13:38:48.904643 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.904573 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 07 13:38:48.904643 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.904581 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 07 13:38:48.904643 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.904588 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 07 13:38:48.905459 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.905439 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 07 13:38:48.905459 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.905459 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 07 13:38:48.908022 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.908001 2575 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-124.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Sep 07 13:38:48.909317 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.909302 2575 server.go:1268] "Started kubelet" Sep 07 13:38:48.909382 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.909357 2575 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 07 13:38:48.909485 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.909439 2575 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 07 13:38:48.909579 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.909521 2575 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 07 13:38:48.910032 ip-10-0-141-124 systemd[1]: Started Kubernetes Kubelet. Sep 07 13:38:48.911154 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.911105 2575 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 07 13:38:48.911527 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.911508 2575 server.go:310] "Adding debug handlers to kubelet server" Sep 07 13:38:48.916297 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:38:48.916272 2575 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 07 13:38:48.918947 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.918929 2575 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 07 13:38:48.918947 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.918947 2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 07 13:38:48.919115 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:38:48.919086 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-124.ec2.internal\" not found" Sep 07 13:38:48.919653 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.919627 2575 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 07 13:38:48.919653 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.919643 2575 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 07 13:38:48.919653 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.919627 2575 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 07 13:38:48.919778 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.919721 2575 reconstruct.go:97] "Volume reconstruction finished" Sep 07 13:38:48.919778 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.919727 2575 reconciler.go:29] "Reconciler: start to sync state" Sep 07 13:38:48.920038 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:38:48.920015 2575 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-124.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 07 13:38:48.920038 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:38:48.920023 2575 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Sep 07 13:38:48.920219 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:38:48.920195 2575 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-141-124.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Sep 07 13:38:48.920464 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:38:48.920432 2575 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Sep 07 13:38:48.920618 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.920599 2575 factory.go:55] Registering systemd factory Sep 07 13:38:48.920698 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.920652 2575 factory.go:223] Registration of the systemd container factory successfully Sep 07 13:38:48.920897 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.920875 2575 factory.go:153] Registering CRI-O factory Sep 07 13:38:48.920897 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.920896 2575 factory.go:223] Registration of the crio container factory successfully Sep 07 13:38:48.920997 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.920947 2575 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 07 13:38:48.920997 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.920964 2575 factory.go:103] Registering Raw factory Sep 07 13:38:48.920997 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.920977 2575 manager.go:1196] Started watching for new ooms in manager Sep 07 13:38:48.921135 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:38:48.919988 2575 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-124.ec2.internal.18d30d81fb006b4d default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-124.ec2.internal,UID:ip-10-0-141-124.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-141-124.ec2.internal,},FirstTimestamp:2026-09-07 13:38:48.909269837 +0000 UTC m=+0.403399159,LastTimestamp:2026-09-07 13:38:48.909269837 +0000 UTC m=+0.403399159,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-124.ec2.internal,}" Sep 07 13:38:48.921330 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.921316 2575 manager.go:349] Starting recovery of all containers Sep 07 13:38:48.928877 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.928859 2575 manager.go:354] Recovery completed Sep 07 13:38:48.933878 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.933865 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 07 13:38:48.935346 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.935316 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-124.ec2.internal" event="NodeHasSufficientMemory" Sep 07 13:38:48.935421 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.935361 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-124.ec2.internal" event="NodeHasNoDiskPressure" Sep 07 13:38:48.935421 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.935375 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-124.ec2.internal" event="NodeHasSufficientPID" Sep 07 13:38:48.935983 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.935861 2575 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 07 13:38:48.935983 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.935873 2575 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 07 13:38:48.935983 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.935877 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 07 13:38:48.935983 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.935890 2575 state_mem.go:36] "Initialized new in-memory state store" Sep 07 13:38:48.936576 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.936558 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-124.ec2.internal" event="NodeHasSufficientMemory" Sep 07 13:38:48.936643 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.936587 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-124.ec2.internal" event="NodeHasNoDiskPressure" Sep 07 13:38:48.936643 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.936598 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-124.ec2.internal" event="NodeHasSufficientPID" Sep 07 13:38:48.937224 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:38:48.937162 2575 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-124.ec2.internal.18d30d81fc8e4ebd default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-124.ec2.internal,UID:ip-10-0-141-124.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-141-124.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-141-124.ec2.internal,},FirstTimestamp:2026-09-07 13:38:48.935345853 +0000 UTC m=+0.429475180,LastTimestamp:2026-09-07 13:38:48.935345853 +0000 UTC m=+0.429475180,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-124.ec2.internal,}" Sep 07 13:38:48.938114 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.938103 2575 policy_none.go:49] "None policy: Start" Sep 07 13:38:48.938163 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.938120 2575 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 07 13:38:48.938163 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.938131 2575 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 07 13:38:48.940142 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.940131 2575 policy_none.go:47] "Start" Sep 07 13:38:48.946576 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:38:48.946518 2575 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-124.ec2.internal.18d30d81fc8ea874 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-124.ec2.internal,UID:ip-10-0-141-124.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-141-124.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-141-124.ec2.internal,},FirstTimestamp:2026-09-07 13:38:48.93536882 +0000 UTC m=+0.429498142,LastTimestamp:2026-09-07 13:38:48.93536882 +0000 UTC m=+0.429498142,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-124.ec2.internal,}" Sep 07 13:38:48.949459 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:38:48.949406 2575 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-124.ec2.internal.18d30d81fc8ed7f5 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-124.ec2.internal,UID:ip-10-0-141-124.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-141-124.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-141-124.ec2.internal,},FirstTimestamp:2026-09-07 13:38:48.935380981 +0000 UTC m=+0.429510304,LastTimestamp:2026-09-07 13:38:48.935380981 +0000 UTC m=+0.429510304,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-124.ec2.internal,}" Sep 07 13:38:48.953729 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.953712 2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-66h5n" Sep 07 13:38:48.957088 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:38:48.955664 2575 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-141-124.ec2.internal.18d30d81fc8e4ebd\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-124.ec2.internal.18d30d81fc8e4ebd default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-124.ec2.internal,UID:ip-10-0-141-124.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-141-124.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-141-124.ec2.internal,},FirstTimestamp:2026-09-07 13:38:48.935345853 +0000 UTC m=+0.429475180,LastTimestamp:2026-09-07 13:38:48.936573679 +0000 UTC m=+0.430703000,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-124.ec2.internal,}" Sep 07 13:38:48.959663 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.959643 2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-66h5n" Sep 07 13:38:48.961259 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:38:48.961176 2575 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-141-124.ec2.internal.18d30d81fc8ea874\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-124.ec2.internal.18d30d81fc8ea874 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-124.ec2.internal,UID:ip-10-0-141-124.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-141-124.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-141-124.ec2.internal,},FirstTimestamp:2026-09-07 13:38:48.93536882 +0000 UTC m=+0.429498142,LastTimestamp:2026-09-07 13:38:48.936591345 +0000 UTC m=+0.430720668,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-124.ec2.internal,}" Sep 07 13:38:48.981335 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.981321 2575 manager.go:337] "Starting Device Plugin manager" Sep 07 13:38:48.999515 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:38:48.981358 2575 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 07 13:38:48.999515 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.981372 2575 server.go:87] "Starting device plugin registration server" Sep 07 13:38:48.999515 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.981613 2575 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 07 13:38:48.999515 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.981627 2575 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 07 13:38:48.999515 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.981725 2575 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 07 13:38:48.999515 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.981812 2575 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 07 13:38:48.999515 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.981820 2575 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 07 13:38:48.999515 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:38:48.982322 2575 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 07 13:38:48.999515 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:38:48.982367 2575 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-124.ec2.internal\" not found" Sep 07 13:38:48.999515 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.986733 2575 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 07 13:38:48.999515 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.988040 2575 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 07 13:38:48.999515 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.988081 2575 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 07 13:38:48.999515 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.988101 2575 kubelet.go:2448] "Starting kubelet main sync loop" Sep 07 13:38:48.999515 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:38:48.988139 2575 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Sep 07 13:38:48.999515 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:48.990748 2575 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 07 13:38:49.082265 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:49.082158 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 07 13:38:49.083091 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:49.083076 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-124.ec2.internal" event="NodeHasSufficientMemory" Sep 07 13:38:49.083181 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:49.083110 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-124.ec2.internal" event="NodeHasNoDiskPressure" Sep 07 13:38:49.083181 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:49.083126 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-124.ec2.internal" event="NodeHasSufficientPID" Sep 07 13:38:49.083181 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:49.083154 2575 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-124.ec2.internal" Sep 07 13:38:49.089036 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:49.089019 2575 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-124.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-141-124.ec2.internal"] Sep 07 13:38:49.089103 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:49.089083 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 07 13:38:49.089830 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:49.089816 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-124.ec2.internal" event="NodeHasSufficientMemory" Sep 07 13:38:49.089892 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:49.089842 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-124.ec2.internal" event="NodeHasNoDiskPressure" Sep 07 13:38:49.089892 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:49.089853 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-124.ec2.internal" event="NodeHasSufficientPID" Sep 07 13:38:49.091908 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:49.091898 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 07 13:38:49.092067 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:49.092053 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-124.ec2.internal" Sep 07 13:38:49.092131 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:49.092081 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 07 13:38:49.092578 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:49.092561 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-124.ec2.internal" event="NodeHasSufficientMemory" Sep 07 13:38:49.092648 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:49.092579 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-124.ec2.internal" event="NodeHasSufficientMemory" Sep 07 13:38:49.092648 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:49.092592 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-124.ec2.internal" event="NodeHasNoDiskPressure" Sep 07 13:38:49.092648 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:49.092603 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-124.ec2.internal" event="NodeHasNoDiskPressure" Sep 07 13:38:49.092648 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:49.092608 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-124.ec2.internal" event="NodeHasSufficientPID" Sep 07 13:38:49.092648 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:49.092614 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-124.ec2.internal" event="NodeHasSufficientPID" Sep 07 13:38:49.094640 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:49.094617 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-124.ec2.internal" Sep 07 13:38:49.094720 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:49.094647 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 07 13:38:49.095360 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:49.095346 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-124.ec2.internal" event="NodeHasSufficientMemory" Sep 07 13:38:49.095453 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:49.095368 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-124.ec2.internal" event="NodeHasNoDiskPressure" Sep 07 13:38:49.095453 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:49.095382 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-124.ec2.internal" event="NodeHasSufficientPID" Sep 07 13:38:49.096420 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:49.096402 2575 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-124.ec2.internal" Sep 07 13:38:49.096471 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:38:49.096432 2575 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-124.ec2.internal\": node \"ip-10-0-141-124.ec2.internal\" not found" Sep 07 13:38:49.111712 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:38:49.111693 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-124.ec2.internal\" not found" Sep 07 13:38:49.117422 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:38:49.117409 2575 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-124.ec2.internal\" not found" node="ip-10-0-141-124.ec2.internal" Sep 07 13:38:49.120203 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:49.120185 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0242d5bff45ceb13d06fdf0981d68019-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-124.ec2.internal\" (UID: \"0242d5bff45ceb13d06fdf0981d68019\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-124.ec2.internal" Sep 07 13:38:49.120268 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:49.120217 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0242d5bff45ceb13d06fdf0981d68019-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-124.ec2.internal\" (UID: \"0242d5bff45ceb13d06fdf0981d68019\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-124.ec2.internal" Sep 07 13:38:49.120268 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:49.120241 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e0e557d20b3a4c23ec8e66206ce9e08a-config\") pod \"kube-apiserver-proxy-ip-10-0-141-124.ec2.internal\" (UID: \"e0e557d20b3a4c23ec8e66206ce9e08a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-124.ec2.internal" Sep 07 13:38:49.121925 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:38:49.121911 2575 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-124.ec2.internal\" not found" node="ip-10-0-141-124.ec2.internal" Sep 07 13:38:49.212372 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:38:49.212345 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-124.ec2.internal\" not found" Sep 07 13:38:49.220653 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:49.220630 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0242d5bff45ceb13d06fdf0981d68019-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-124.ec2.internal\" (UID: \"0242d5bff45ceb13d06fdf0981d68019\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-124.ec2.internal" Sep 07 13:38:49.220706 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:49.220691 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0242d5bff45ceb13d06fdf0981d68019-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-124.ec2.internal\" (UID: \"0242d5bff45ceb13d06fdf0981d68019\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-124.ec2.internal" Sep 07 13:38:49.220756 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:49.220705 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0242d5bff45ceb13d06fdf0981d68019-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-124.ec2.internal\" (UID: \"0242d5bff45ceb13d06fdf0981d68019\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-124.ec2.internal" Sep 07 13:38:49.220813 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:49.220757 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e0e557d20b3a4c23ec8e66206ce9e08a-config\") pod \"kube-apiserver-proxy-ip-10-0-141-124.ec2.internal\" (UID: \"e0e557d20b3a4c23ec8e66206ce9e08a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-124.ec2.internal" Sep 07 13:38:49.220813 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:49.220801 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0242d5bff45ceb13d06fdf0981d68019-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-124.ec2.internal\" (UID: \"0242d5bff45ceb13d06fdf0981d68019\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-124.ec2.internal" Sep 07 13:38:49.220884 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:49.220805 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e0e557d20b3a4c23ec8e66206ce9e08a-config\") pod \"kube-apiserver-proxy-ip-10-0-141-124.ec2.internal\" (UID: \"e0e557d20b3a4c23ec8e66206ce9e08a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-124.ec2.internal" Sep 07 13:38:49.312744 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:38:49.312708 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-124.ec2.internal\" not found" Sep 07 13:38:49.413478 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:38:49.413405 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-124.ec2.internal\" not found" Sep 07 13:38:49.421726 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:49.421705 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-124.ec2.internal" Sep 07 13:38:49.425545 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:49.425524 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-124.ec2.internal" Sep 07 13:38:49.513558 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:38:49.513526 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-124.ec2.internal\" not found" Sep 07 13:38:49.614028 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:38:49.613994 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-124.ec2.internal\" not found" Sep 07 13:38:49.714543 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:38:49.714472 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-124.ec2.internal\" not found" Sep 07 13:38:49.751899 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:49.751875 2575 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 07 13:38:49.815249 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:38:49.815222 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-124.ec2.internal\" not found" Sep 07 13:38:49.849748 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:49.849725 2575 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 07 13:38:49.850178 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:49.849902 2575 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 07 13:38:49.850178 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:49.849914 2575 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 07 13:38:49.915692 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:38:49.915663 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-124.ec2.internal\" not found" Sep 07 13:38:49.963841 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:49.963797 2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-06 13:33:49 +0000 UTC" deadline="2028-04-28 13:48:51.292949485 +0000 UTC" Sep 07 13:38:49.963841 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:49.963829 2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14376h10m1.329123653s" Sep 07 13:38:50.015988 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:38:50.015913 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-124.ec2.internal\" not found" Sep 07 13:38:50.091409 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:50.091380 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 07 13:38:50.093074 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:50.093045 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-124.ec2.internal" event="NodeHasSufficientMemory" Sep 07 13:38:50.093176 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:50.093086 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-124.ec2.internal" event="NodeHasNoDiskPressure" Sep 07 13:38:50.093176 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:50.093097 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-124.ec2.internal" event="NodeHasSufficientPID" Sep 07 13:38:50.116874 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:38:50.116847 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-124.ec2.internal\" not found" Sep 07 13:38:50.217378 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:38:50.217349 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-124.ec2.internal\" not found" Sep 07 13:38:50.227123 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:50.227104 2575 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 07 13:38:50.261986 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:50.261841 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0e557d20b3a4c23ec8e66206ce9e08a.slice/crio-6e67fa6f5595b7b8e17ce857d7ba94ba5d8e64fa6aa4ddca3395066ba6eea1ae WatchSource:0}: Error finding container 6e67fa6f5595b7b8e17ce857d7ba94ba5d8e64fa6aa4ddca3395066ba6eea1ae: Status 404 returned error can't find the container with id 6e67fa6f5595b7b8e17ce857d7ba94ba5d8e64fa6aa4ddca3395066ba6eea1ae Sep 07 13:38:50.262292 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:50.262268 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0242d5bff45ceb13d06fdf0981d68019.slice/crio-0c0c4ac53facf39abb4b317b5ebe3eff9f55fb378273d7885dcead5b11c45321 WatchSource:0}: Error finding container 0c0c4ac53facf39abb4b317b5ebe3eff9f55fb378273d7885dcead5b11c45321: Status 404 returned error can't find the container with id 0c0c4ac53facf39abb4b317b5ebe3eff9f55fb378273d7885dcead5b11c45321 Sep 07 13:38:50.267445 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:50.267432 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 07 13:38:50.319361 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:50.319340 2575 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-124.ec2.internal" Sep 07 13:38:50.328505 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:50.328489 2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 07 13:38:50.329661 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:50.329648 2575 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-124.ec2.internal" Sep 07 13:38:50.343600 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:50.343578 2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 07 13:38:50.406402 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:50.406379 2575 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 07 13:38:50.815448 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:50.815421 2575 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 07 13:38:50.898570 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:50.898532 2575 apiserver.go:52] "Watching apiserver" Sep 07 13:38:50.914352 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:50.914317 2575 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 07 13:38:50.914734 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:50.914705 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-8gjr4","kube-system/global-pull-secret-syncer-947k4","kube-system/konnectivity-agent-m784g","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-64mgb","openshift-dns/node-resolver-fv7sq","openshift-image-registry/node-ca-kr8mv","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-124.ec2.internal","openshift-multus/multus-rgmdv","openshift-multus/network-metrics-daemon-pwdkf","kube-system/kube-apiserver-proxy-ip-10-0-141-124.ec2.internal","openshift-cluster-node-tuning-operator/tuned-qpqv9","openshift-multus/multus-additional-cni-plugins-xqq4n","openshift-network-diagnostics/network-check-target-tp5h2","openshift-network-operator/iptables-alerter-brs25"] Sep 07 13:38:50.917460 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:50.917432 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tp5h2" Sep 07 13:38:50.917589 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:38:50.917515 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tp5h2" podUID="8fa51077-bb0c-4245-bdd1-b3dfcea493aa" Sep 07 13:38:50.920194 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:50.919782 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-m784g" Sep 07 13:38:50.920194 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:50.919922 2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 07 13:38:50.922148 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:50.922128 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-fv7sq" Sep 07 13:38:50.925179 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:50.925148 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-8gjr4" Sep 07 13:38:50.928687 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:50.928664 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ad201af3-f88e-4869-a5b7-0726f6282ee2-hosts-file\") pod \"node-resolver-fv7sq\" (UID: \"ad201af3-f88e-4869-a5b7-0726f6282ee2\") " pod="openshift-dns/node-resolver-fv7sq" Sep 07 13:38:50.928819 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:50.928700 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rm942\" (UniqueName: \"kubernetes.io/projected/ad201af3-f88e-4869-a5b7-0726f6282ee2-kube-api-access-rm942\") pod \"node-resolver-fv7sq\" (UID: \"ad201af3-f88e-4869-a5b7-0726f6282ee2\") " pod="openshift-dns/node-resolver-fv7sq" Sep 07 13:38:50.928819 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:50.928733 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v8mqk\" (UniqueName: \"kubernetes.io/projected/8fa51077-bb0c-4245-bdd1-b3dfcea493aa-kube-api-access-v8mqk\") pod \"network-check-target-tp5h2\" (UID: \"8fa51077-bb0c-4245-bdd1-b3dfcea493aa\") " pod="openshift-network-diagnostics/network-check-target-tp5h2" Sep 07 13:38:50.928819 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:50.928758 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3e98ba1a-f358-4d0c-8be7-cf3ad7eadd82-agent-certs\") pod \"konnectivity-agent-m784g\" (UID: \"3e98ba1a-f358-4d0c-8be7-cf3ad7eadd82\") " pod="kube-system/konnectivity-agent-m784g" Sep 07 13:38:50.928819 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:50.928782 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ad201af3-f88e-4869-a5b7-0726f6282ee2-tmp-dir\") pod \"node-resolver-fv7sq\" (UID: \"ad201af3-f88e-4869-a5b7-0726f6282ee2\") " pod="openshift-dns/node-resolver-fv7sq" Sep 07 13:38:50.928819 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:50.928809 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3e98ba1a-f358-4d0c-8be7-cf3ad7eadd82-konnectivity-ca\") pod \"konnectivity-agent-m784g\" (UID: \"3e98ba1a-f358-4d0c-8be7-cf3ad7eadd82\") " pod="kube-system/konnectivity-agent-m784g" Sep 07 13:38:50.929581 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:50.929555 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pwdkf" Sep 07 13:38:50.929677 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:38:50.929644 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pwdkf" podUID="51f8ac5a-daf1-48b6-ace7-9b7674b90409" Sep 07 13:38:50.932579 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:50.932551 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-j5cxz\"" Sep 07 13:38:50.932675 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:50.932612 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 07 13:38:50.932675 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:50.932620 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 07 13:38:50.933092 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:50.932784 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 07 13:38:50.933092 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:50.932850 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-brs25" Sep 07 13:38:50.934058 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:50.934039 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-nw7vw\"" Sep 07 13:38:50.934373 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:50.934338 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 07 13:38:50.934585 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:50.934570 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 07 13:38:50.934814 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:50.934794 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 07 13:38:50.935013 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:50.934998 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-t9fw5\"" Sep 07 13:38:50.935195 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:50.935181 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 07 13:38:50.935421 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:50.935406 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 07 13:38:50.935481 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:50.935419 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 07 13:38:50.935481 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:50.935458 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-xqq4n" Sep 07 13:38:50.936263 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:50.936242 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 07 13:38:50.937719 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:50.937636 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-947k4" Sep 07 13:38:50.937719 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:38:50.937707 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-947k4" podUID="3dccac71-71b0-49e8-bde3-08fd33578be3" Sep 07 13:38:50.938151 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:50.938134 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 07 13:38:50.940457 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:50.940428 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-64mgb" Sep 07 13:38:50.944305 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:50.943616 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-kr8mv" Sep 07 13:38:50.946085 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:50.946069 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-rgmdv" Sep 07 13:38:50.948032 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:50.947124 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 07 13:38:50.948032 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:50.947134 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-mqpc9\"" Sep 07 13:38:50.948032 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:50.947344 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 07 13:38:50.948032 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:50.947435 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 07 13:38:50.948032 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:50.947547 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 07 13:38:50.948032 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:50.947628 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 07 13:38:50.948032 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:50.947821 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 07 13:38:50.948032 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:50.947993 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 07 13:38:50.948512 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:50.948385 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 07 13:38:50.948968 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:50.948769 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 07 13:38:50.948968 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:50.948861 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-qn8wb\"" Sep 07 13:38:50.949135 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:50.949053 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 07 13:38:50.949192 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:50.949145 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 07 13:38:50.949192 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:50.949173 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-xr55p\"" Sep 07 13:38:50.949783 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:50.949380 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 07 13:38:50.949783 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:50.949442 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-qpqv9" Sep 07 13:38:50.949783 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:50.949503 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-cqksd\"" Sep 07 13:38:50.950023 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:50.949904 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-wnshs\"" Sep 07 13:38:50.950111 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:50.950091 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 07 13:38:50.951271 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:50.951252 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 07 13:38:50.955572 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:50.955340 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 07 13:38:50.955572 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:50.955472 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 07 13:38:50.962427 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:50.962401 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-7pff4\"" Sep 07 13:38:50.962798 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:50.962768 2575 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 07 13:38:50.982323 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:50.982300 2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-lnr6r" Sep 07 13:38:50.990651 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:50.990626 2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-lnr6r" Sep 07 13:38:50.994583 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:50.994529 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-124.ec2.internal" event={"ID":"e0e557d20b3a4c23ec8e66206ce9e08a","Type":"ContainerStarted","Data":"6e67fa6f5595b7b8e17ce857d7ba94ba5d8e64fa6aa4ddca3395066ba6eea1ae"} Sep 07 13:38:50.997061 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:50.997032 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-124.ec2.internal" event={"ID":"0242d5bff45ceb13d06fdf0981d68019","Type":"ContainerStarted","Data":"0c0c4ac53facf39abb4b317b5ebe3eff9f55fb378273d7885dcead5b11c45321"} Sep 07 13:38:51.020775 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.020754 2575 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 07 13:38:51.030057 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.030034 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ad201af3-f88e-4869-a5b7-0726f6282ee2-hosts-file\") pod \"node-resolver-fv7sq\" (UID: \"ad201af3-f88e-4869-a5b7-0726f6282ee2\") " pod="openshift-dns/node-resolver-fv7sq" Sep 07 13:38:51.030193 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.030077 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3dccac71-71b0-49e8-bde3-08fd33578be3-kubelet-config\") pod \"global-pull-secret-syncer-947k4\" (UID: \"3dccac71-71b0-49e8-bde3-08fd33578be3\") " pod="kube-system/global-pull-secret-syncer-947k4" Sep 07 13:38:51.030193 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.030104 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3dccac71-71b0-49e8-bde3-08fd33578be3-dbus\") pod \"global-pull-secret-syncer-947k4\" (UID: \"3dccac71-71b0-49e8-bde3-08fd33578be3\") " pod="kube-system/global-pull-secret-syncer-947k4" Sep 07 13:38:51.030193 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.030130 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/cb716f9f-409e-4143-a92e-564996107e14-registration-dir\") pod \"aws-ebs-csi-driver-node-64mgb\" (UID: \"cb716f9f-409e-4143-a92e-564996107e14\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-64mgb" Sep 07 13:38:51.030193 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.030153 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/cb716f9f-409e-4143-a92e-564996107e14-etc-selinux\") pod \"aws-ebs-csi-driver-node-64mgb\" (UID: \"cb716f9f-409e-4143-a92e-564996107e14\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-64mgb" Sep 07 13:38:51.030193 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.030176 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a3f897ca-315e-40ed-bbe7-dad697bf06a1-cni-binary-copy\") pod \"multus-rgmdv\" (UID: \"a3f897ca-315e-40ed-bbe7-dad697bf06a1\") " pod="openshift-multus/multus-rgmdv" Sep 07 13:38:51.030552 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.030202 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ca6aa1df-449e-4aef-98a2-ad6fba49ec8c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8gjr4\" (UID: \"ca6aa1df-449e-4aef-98a2-ad6fba49ec8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gjr4" Sep 07 13:38:51.030552 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.030228 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/95f5dd2f-c6da-468f-9c25-01886f2bbb76-tmp\") pod \"tuned-qpqv9\" (UID: \"95f5dd2f-c6da-468f-9c25-01886f2bbb76\") " pod="openshift-cluster-node-tuning-operator/tuned-qpqv9" Sep 07 13:38:51.030552 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.030257 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3e98ba1a-f358-4d0c-8be7-cf3ad7eadd82-agent-certs\") pod \"konnectivity-agent-m784g\" (UID: \"3e98ba1a-f358-4d0c-8be7-cf3ad7eadd82\") " pod="kube-system/konnectivity-agent-m784g" Sep 07 13:38:51.030552 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.030279 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a3f897ca-315e-40ed-bbe7-dad697bf06a1-multus-cni-dir\") pod \"multus-rgmdv\" (UID: \"a3f897ca-315e-40ed-bbe7-dad697bf06a1\") " pod="openshift-multus/multus-rgmdv" Sep 07 13:38:51.030552 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.030299 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vrtmj\" (UniqueName: \"kubernetes.io/projected/ca6aa1df-449e-4aef-98a2-ad6fba49ec8c-kube-api-access-vrtmj\") pod \"ovnkube-node-8gjr4\" (UID: \"ca6aa1df-449e-4aef-98a2-ad6fba49ec8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gjr4" Sep 07 13:38:51.030552 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.030313 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/95f5dd2f-c6da-468f-9c25-01886f2bbb76-host\") pod \"tuned-qpqv9\" (UID: \"95f5dd2f-c6da-468f-9c25-01886f2bbb76\") " pod="openshift-cluster-node-tuning-operator/tuned-qpqv9" Sep 07 13:38:51.030552 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.030327 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ca6aa1df-449e-4aef-98a2-ad6fba49ec8c-log-socket\") pod \"ovnkube-node-8gjr4\" (UID: \"ca6aa1df-449e-4aef-98a2-ad6fba49ec8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gjr4" Sep 07 13:38:51.030552 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.030342 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/cb716f9f-409e-4143-a92e-564996107e14-kubelet-dir\") pod \"aws-ebs-csi-driver-node-64mgb\" (UID: \"cb716f9f-409e-4143-a92e-564996107e14\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-64mgb" Sep 07 13:38:51.030552 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.030356 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/cb716f9f-409e-4143-a92e-564996107e14-device-dir\") pod \"aws-ebs-csi-driver-node-64mgb\" (UID: \"cb716f9f-409e-4143-a92e-564996107e14\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-64mgb" Sep 07 13:38:51.030552 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.030373 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a3f897ca-315e-40ed-bbe7-dad697bf06a1-system-cni-dir\") pod \"multus-rgmdv\" (UID: \"a3f897ca-315e-40ed-bbe7-dad697bf06a1\") " pod="openshift-multus/multus-rgmdv" Sep 07 13:38:51.030552 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.030396 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a3f897ca-315e-40ed-bbe7-dad697bf06a1-host-var-lib-cni-bin\") pod \"multus-rgmdv\" (UID: \"a3f897ca-315e-40ed-bbe7-dad697bf06a1\") " pod="openshift-multus/multus-rgmdv" Sep 07 13:38:51.030552 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.030420 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ca6aa1df-449e-4aef-98a2-ad6fba49ec8c-host-slash\") pod \"ovnkube-node-8gjr4\" (UID: \"ca6aa1df-449e-4aef-98a2-ad6fba49ec8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gjr4" Sep 07 13:38:51.030552 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.030437 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/95f5dd2f-c6da-468f-9c25-01886f2bbb76-lib-modules\") pod \"tuned-qpqv9\" (UID: \"95f5dd2f-c6da-468f-9c25-01886f2bbb76\") " pod="openshift-cluster-node-tuning-operator/tuned-qpqv9" Sep 07 13:38:51.030552 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.030462 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b12d5e4b-b139-4b59-b6ce-3cbc314a11c6-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xqq4n\" (UID: \"b12d5e4b-b139-4b59-b6ce-3cbc314a11c6\") " pod="openshift-multus/multus-additional-cni-plugins-xqq4n" Sep 07 13:38:51.030552 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.030490 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wbwnj\" (UniqueName: \"kubernetes.io/projected/0add805e-551b-40c5-8cee-8cc240585411-kube-api-access-wbwnj\") pod \"node-ca-kr8mv\" (UID: \"0add805e-551b-40c5-8cee-8cc240585411\") " pod="openshift-image-registry/node-ca-kr8mv" Sep 07 13:38:51.030552 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.030528 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a3f897ca-315e-40ed-bbe7-dad697bf06a1-host-run-netns\") pod \"multus-rgmdv\" (UID: \"a3f897ca-315e-40ed-bbe7-dad697bf06a1\") " pod="openshift-multus/multus-rgmdv" Sep 07 13:38:51.031457 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.030557 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a3f897ca-315e-40ed-bbe7-dad697bf06a1-etc-kubernetes\") pod \"multus-rgmdv\" (UID: \"a3f897ca-315e-40ed-bbe7-dad697bf06a1\") " pod="openshift-multus/multus-rgmdv" Sep 07 13:38:51.031457 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.030582 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ca6aa1df-449e-4aef-98a2-ad6fba49ec8c-node-log\") pod \"ovnkube-node-8gjr4\" (UID: \"ca6aa1df-449e-4aef-98a2-ad6fba49ec8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gjr4" Sep 07 13:38:51.031457 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.030606 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ca6aa1df-449e-4aef-98a2-ad6fba49ec8c-ovnkube-script-lib\") pod \"ovnkube-node-8gjr4\" (UID: \"ca6aa1df-449e-4aef-98a2-ad6fba49ec8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gjr4" Sep 07 13:38:51.031457 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.030643 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/95f5dd2f-c6da-468f-9c25-01886f2bbb76-etc-sysconfig\") pod \"tuned-qpqv9\" (UID: \"95f5dd2f-c6da-468f-9c25-01886f2bbb76\") " pod="openshift-cluster-node-tuning-operator/tuned-qpqv9" Sep 07 13:38:51.031457 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.030668 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b12d5e4b-b139-4b59-b6ce-3cbc314a11c6-system-cni-dir\") pod \"multus-additional-cni-plugins-xqq4n\" (UID: \"b12d5e4b-b139-4b59-b6ce-3cbc314a11c6\") " pod="openshift-multus/multus-additional-cni-plugins-xqq4n" Sep 07 13:38:51.031457 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.030694 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3dccac71-71b0-49e8-bde3-08fd33578be3-original-pull-secret\") pod \"global-pull-secret-syncer-947k4\" (UID: \"3dccac71-71b0-49e8-bde3-08fd33578be3\") " pod="kube-system/global-pull-secret-syncer-947k4" Sep 07 13:38:51.031457 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.030725 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/cb716f9f-409e-4143-a92e-564996107e14-socket-dir\") pod \"aws-ebs-csi-driver-node-64mgb\" (UID: \"cb716f9f-409e-4143-a92e-564996107e14\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-64mgb" Sep 07 13:38:51.031457 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.030750 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ca6aa1df-449e-4aef-98a2-ad6fba49ec8c-var-lib-openvswitch\") pod \"ovnkube-node-8gjr4\" (UID: \"ca6aa1df-449e-4aef-98a2-ad6fba49ec8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gjr4" Sep 07 13:38:51.031457 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.030775 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d2bbad05-d053-4847-bbb5-0636d50734eb-host-slash\") pod \"iptables-alerter-brs25\" (UID: \"d2bbad05-d053-4847-bbb5-0636d50734eb\") " pod="openshift-network-operator/iptables-alerter-brs25" Sep 07 13:38:51.031457 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.030803 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/cb716f9f-409e-4143-a92e-564996107e14-sys-fs\") pod \"aws-ebs-csi-driver-node-64mgb\" (UID: \"cb716f9f-409e-4143-a92e-564996107e14\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-64mgb" Sep 07 13:38:51.031457 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.030836 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a3f897ca-315e-40ed-bbe7-dad697bf06a1-host-run-k8s-cni-cncf-io\") pod \"multus-rgmdv\" (UID: \"a3f897ca-315e-40ed-bbe7-dad697bf06a1\") " pod="openshift-multus/multus-rgmdv" Sep 07 13:38:51.031457 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.030885 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a3f897ca-315e-40ed-bbe7-dad697bf06a1-hostroot\") pod \"multus-rgmdv\" (UID: \"a3f897ca-315e-40ed-bbe7-dad697bf06a1\") " pod="openshift-multus/multus-rgmdv" Sep 07 13:38:51.031457 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.030914 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ca6aa1df-449e-4aef-98a2-ad6fba49ec8c-systemd-units\") pod \"ovnkube-node-8gjr4\" (UID: \"ca6aa1df-449e-4aef-98a2-ad6fba49ec8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gjr4" Sep 07 13:38:51.031457 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.030961 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sb52f\" (UniqueName: \"kubernetes.io/projected/d2bbad05-d053-4847-bbb5-0636d50734eb-kube-api-access-sb52f\") pod \"iptables-alerter-brs25\" (UID: \"d2bbad05-d053-4847-bbb5-0636d50734eb\") " pod="openshift-network-operator/iptables-alerter-brs25" Sep 07 13:38:51.031457 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.030995 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ca6aa1df-449e-4aef-98a2-ad6fba49ec8c-ovnkube-config\") pod \"ovnkube-node-8gjr4\" (UID: \"ca6aa1df-449e-4aef-98a2-ad6fba49ec8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gjr4" Sep 07 13:38:51.031457 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.031079 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ad201af3-f88e-4869-a5b7-0726f6282ee2-hosts-file\") pod \"node-resolver-fv7sq\" (UID: \"ad201af3-f88e-4869-a5b7-0726f6282ee2\") " pod="openshift-dns/node-resolver-fv7sq" Sep 07 13:38:51.032359 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.031121 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b12d5e4b-b139-4b59-b6ce-3cbc314a11c6-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xqq4n\" (UID: \"b12d5e4b-b139-4b59-b6ce-3cbc314a11c6\") " pod="openshift-multus/multus-additional-cni-plugins-xqq4n" Sep 07 13:38:51.032359 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.031149 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0add805e-551b-40c5-8cee-8cc240585411-host\") pod \"node-ca-kr8mv\" (UID: \"0add805e-551b-40c5-8cee-8cc240585411\") " pod="openshift-image-registry/node-ca-kr8mv" Sep 07 13:38:51.032359 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.031176 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a3f897ca-315e-40ed-bbe7-dad697bf06a1-multus-daemon-config\") pod \"multus-rgmdv\" (UID: \"a3f897ca-315e-40ed-bbe7-dad697bf06a1\") " pod="openshift-multus/multus-rgmdv" Sep 07 13:38:51.032359 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.031212 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-96jc9\" (UniqueName: \"kubernetes.io/projected/a3f897ca-315e-40ed-bbe7-dad697bf06a1-kube-api-access-96jc9\") pod \"multus-rgmdv\" (UID: \"a3f897ca-315e-40ed-bbe7-dad697bf06a1\") " pod="openshift-multus/multus-rgmdv" Sep 07 13:38:51.032359 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.031253 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ca6aa1df-449e-4aef-98a2-ad6fba49ec8c-run-ovn\") pod \"ovnkube-node-8gjr4\" (UID: \"ca6aa1df-449e-4aef-98a2-ad6fba49ec8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gjr4" Sep 07 13:38:51.032359 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.031279 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ca6aa1df-449e-4aef-98a2-ad6fba49ec8c-host-run-ovn-kubernetes\") pod \"ovnkube-node-8gjr4\" (UID: \"ca6aa1df-449e-4aef-98a2-ad6fba49ec8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gjr4" Sep 07 13:38:51.032359 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.031304 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/95f5dd2f-c6da-468f-9c25-01886f2bbb76-etc-modprobe-d\") pod \"tuned-qpqv9\" (UID: \"95f5dd2f-c6da-468f-9c25-01886f2bbb76\") " pod="openshift-cluster-node-tuning-operator/tuned-qpqv9" Sep 07 13:38:51.032359 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.031352 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b8ndx\" (UniqueName: \"kubernetes.io/projected/95f5dd2f-c6da-468f-9c25-01886f2bbb76-kube-api-access-b8ndx\") pod \"tuned-qpqv9\" (UID: \"95f5dd2f-c6da-468f-9c25-01886f2bbb76\") " pod="openshift-cluster-node-tuning-operator/tuned-qpqv9" Sep 07 13:38:51.032359 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.031377 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d2bbad05-d053-4847-bbb5-0636d50734eb-iptables-alerter-script\") pod \"iptables-alerter-brs25\" (UID: \"d2bbad05-d053-4847-bbb5-0636d50734eb\") " pod="openshift-network-operator/iptables-alerter-brs25" Sep 07 13:38:51.032359 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.031409 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a3f897ca-315e-40ed-bbe7-dad697bf06a1-cnibin\") pod \"multus-rgmdv\" (UID: \"a3f897ca-315e-40ed-bbe7-dad697bf06a1\") " pod="openshift-multus/multus-rgmdv" Sep 07 13:38:51.032359 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.031442 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ca6aa1df-449e-4aef-98a2-ad6fba49ec8c-host-cni-netd\") pod \"ovnkube-node-8gjr4\" (UID: \"ca6aa1df-449e-4aef-98a2-ad6fba49ec8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gjr4" Sep 07 13:38:51.032359 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.031488 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b12d5e4b-b139-4b59-b6ce-3cbc314a11c6-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xqq4n\" (UID: \"b12d5e4b-b139-4b59-b6ce-3cbc314a11c6\") " pod="openshift-multus/multus-additional-cni-plugins-xqq4n" Sep 07 13:38:51.032359 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.031547 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sbtmx\" (UniqueName: \"kubernetes.io/projected/b12d5e4b-b139-4b59-b6ce-3cbc314a11c6-kube-api-access-sbtmx\") pod \"multus-additional-cni-plugins-xqq4n\" (UID: \"b12d5e4b-b139-4b59-b6ce-3cbc314a11c6\") " pod="openshift-multus/multus-additional-cni-plugins-xqq4n" Sep 07 13:38:51.032359 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.031583 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a3f897ca-315e-40ed-bbe7-dad697bf06a1-host-var-lib-cni-multus\") pod \"multus-rgmdv\" (UID: \"a3f897ca-315e-40ed-bbe7-dad697bf06a1\") " pod="openshift-multus/multus-rgmdv" Sep 07 13:38:51.032359 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.031617 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ca6aa1df-449e-4aef-98a2-ad6fba49ec8c-host-run-netns\") pod \"ovnkube-node-8gjr4\" (UID: \"ca6aa1df-449e-4aef-98a2-ad6fba49ec8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gjr4" Sep 07 13:38:51.032359 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.031648 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/95f5dd2f-c6da-468f-9c25-01886f2bbb76-etc-systemd\") pod \"tuned-qpqv9\" (UID: \"95f5dd2f-c6da-468f-9c25-01886f2bbb76\") " pod="openshift-cluster-node-tuning-operator/tuned-qpqv9" Sep 07 13:38:51.033299 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.031678 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b12d5e4b-b139-4b59-b6ce-3cbc314a11c6-cni-binary-copy\") pod \"multus-additional-cni-plugins-xqq4n\" (UID: \"b12d5e4b-b139-4b59-b6ce-3cbc314a11c6\") " pod="openshift-multus/multus-additional-cni-plugins-xqq4n" Sep 07 13:38:51.033299 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.031717 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a3f897ca-315e-40ed-bbe7-dad697bf06a1-multus-socket-dir-parent\") pod \"multus-rgmdv\" (UID: \"a3f897ca-315e-40ed-bbe7-dad697bf06a1\") " pod="openshift-multus/multus-rgmdv" Sep 07 13:38:51.033299 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.031763 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3e98ba1a-f358-4d0c-8be7-cf3ad7eadd82-konnectivity-ca\") pod \"konnectivity-agent-m784g\" (UID: \"3e98ba1a-f358-4d0c-8be7-cf3ad7eadd82\") " pod="kube-system/konnectivity-agent-m784g" Sep 07 13:38:51.033299 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.031821 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rm942\" (UniqueName: \"kubernetes.io/projected/ad201af3-f88e-4869-a5b7-0726f6282ee2-kube-api-access-rm942\") pod \"node-resolver-fv7sq\" (UID: \"ad201af3-f88e-4869-a5b7-0726f6282ee2\") " pod="openshift-dns/node-resolver-fv7sq" Sep 07 13:38:51.033299 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.031894 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a3f897ca-315e-40ed-bbe7-dad697bf06a1-host-var-lib-kubelet\") pod \"multus-rgmdv\" (UID: \"a3f897ca-315e-40ed-bbe7-dad697bf06a1\") " pod="openshift-multus/multus-rgmdv" Sep 07 13:38:51.033299 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.031923 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ca6aa1df-449e-4aef-98a2-ad6fba49ec8c-host-kubelet\") pod \"ovnkube-node-8gjr4\" (UID: \"ca6aa1df-449e-4aef-98a2-ad6fba49ec8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gjr4" Sep 07 13:38:51.033299 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.031955 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ca6aa1df-449e-4aef-98a2-ad6fba49ec8c-ovn-node-metrics-cert\") pod \"ovnkube-node-8gjr4\" (UID: \"ca6aa1df-449e-4aef-98a2-ad6fba49ec8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gjr4" Sep 07 13:38:51.033299 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.031983 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/51f8ac5a-daf1-48b6-ace7-9b7674b90409-metrics-certs\") pod \"network-metrics-daemon-pwdkf\" (UID: \"51f8ac5a-daf1-48b6-ace7-9b7674b90409\") " pod="openshift-multus/network-metrics-daemon-pwdkf" Sep 07 13:38:51.033299 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.032011 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v8mqk\" (UniqueName: \"kubernetes.io/projected/8fa51077-bb0c-4245-bdd1-b3dfcea493aa-kube-api-access-v8mqk\") pod \"network-check-target-tp5h2\" (UID: \"8fa51077-bb0c-4245-bdd1-b3dfcea493aa\") " pod="openshift-network-diagnostics/network-check-target-tp5h2" Sep 07 13:38:51.033299 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.032038 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ad201af3-f88e-4869-a5b7-0726f6282ee2-tmp-dir\") pod \"node-resolver-fv7sq\" (UID: \"ad201af3-f88e-4869-a5b7-0726f6282ee2\") " pod="openshift-dns/node-resolver-fv7sq" Sep 07 13:38:51.033299 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.032083 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ca6aa1df-449e-4aef-98a2-ad6fba49ec8c-run-systemd\") pod \"ovnkube-node-8gjr4\" (UID: \"ca6aa1df-449e-4aef-98a2-ad6fba49ec8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gjr4" Sep 07 13:38:51.033299 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.032109 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ca6aa1df-449e-4aef-98a2-ad6fba49ec8c-etc-openvswitch\") pod \"ovnkube-node-8gjr4\" (UID: \"ca6aa1df-449e-4aef-98a2-ad6fba49ec8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gjr4" Sep 07 13:38:51.033299 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.032135 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-24cb4\" (UniqueName: \"kubernetes.io/projected/51f8ac5a-daf1-48b6-ace7-9b7674b90409-kube-api-access-24cb4\") pod \"network-metrics-daemon-pwdkf\" (UID: \"51f8ac5a-daf1-48b6-ace7-9b7674b90409\") " pod="openshift-multus/network-metrics-daemon-pwdkf" Sep 07 13:38:51.033299 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.032162 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/95f5dd2f-c6da-468f-9c25-01886f2bbb76-etc-sysctl-d\") pod \"tuned-qpqv9\" (UID: \"95f5dd2f-c6da-468f-9c25-01886f2bbb76\") " pod="openshift-cluster-node-tuning-operator/tuned-qpqv9" Sep 07 13:38:51.033299 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.032185 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/95f5dd2f-c6da-468f-9c25-01886f2bbb76-run\") pod \"tuned-qpqv9\" (UID: \"95f5dd2f-c6da-468f-9c25-01886f2bbb76\") " pod="openshift-cluster-node-tuning-operator/tuned-qpqv9" Sep 07 13:38:51.033299 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.032209 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/95f5dd2f-c6da-468f-9c25-01886f2bbb76-etc-tuned\") pod \"tuned-qpqv9\" (UID: \"95f5dd2f-c6da-468f-9c25-01886f2bbb76\") " pod="openshift-cluster-node-tuning-operator/tuned-qpqv9" Sep 07 13:38:51.034295 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.032236 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-flfvj\" (UniqueName: \"kubernetes.io/projected/cb716f9f-409e-4143-a92e-564996107e14-kube-api-access-flfvj\") pod \"aws-ebs-csi-driver-node-64mgb\" (UID: \"cb716f9f-409e-4143-a92e-564996107e14\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-64mgb" Sep 07 13:38:51.034295 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.032262 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0add805e-551b-40c5-8cee-8cc240585411-serviceca\") pod \"node-ca-kr8mv\" (UID: \"0add805e-551b-40c5-8cee-8cc240585411\") " pod="openshift-image-registry/node-ca-kr8mv" Sep 07 13:38:51.034295 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.032316 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a3f897ca-315e-40ed-bbe7-dad697bf06a1-multus-conf-dir\") pod \"multus-rgmdv\" (UID: \"a3f897ca-315e-40ed-bbe7-dad697bf06a1\") " pod="openshift-multus/multus-rgmdv" Sep 07 13:38:51.034295 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.032344 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a3f897ca-315e-40ed-bbe7-dad697bf06a1-host-run-multus-certs\") pod \"multus-rgmdv\" (UID: \"a3f897ca-315e-40ed-bbe7-dad697bf06a1\") " pod="openshift-multus/multus-rgmdv" Sep 07 13:38:51.034295 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.032368 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/95f5dd2f-c6da-468f-9c25-01886f2bbb76-etc-kubernetes\") pod \"tuned-qpqv9\" (UID: \"95f5dd2f-c6da-468f-9c25-01886f2bbb76\") " pod="openshift-cluster-node-tuning-operator/tuned-qpqv9" Sep 07 13:38:51.034295 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.032391 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/95f5dd2f-c6da-468f-9c25-01886f2bbb76-etc-sysctl-conf\") pod \"tuned-qpqv9\" (UID: \"95f5dd2f-c6da-468f-9c25-01886f2bbb76\") " pod="openshift-cluster-node-tuning-operator/tuned-qpqv9" Sep 07 13:38:51.034295 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.032416 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/95f5dd2f-c6da-468f-9c25-01886f2bbb76-sys\") pod \"tuned-qpqv9\" (UID: \"95f5dd2f-c6da-468f-9c25-01886f2bbb76\") " pod="openshift-cluster-node-tuning-operator/tuned-qpqv9" Sep 07 13:38:51.034295 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.032404 2575 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 07 13:38:51.034295 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.032443 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3e98ba1a-f358-4d0c-8be7-cf3ad7eadd82-konnectivity-ca\") pod \"konnectivity-agent-m784g\" (UID: \"3e98ba1a-f358-4d0c-8be7-cf3ad7eadd82\") " pod="kube-system/konnectivity-agent-m784g" Sep 07 13:38:51.034295 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.032443 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/95f5dd2f-c6da-468f-9c25-01886f2bbb76-var-lib-kubelet\") pod \"tuned-qpqv9\" (UID: \"95f5dd2f-c6da-468f-9c25-01886f2bbb76\") " pod="openshift-cluster-node-tuning-operator/tuned-qpqv9" Sep 07 13:38:51.034295 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.032529 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ca6aa1df-449e-4aef-98a2-ad6fba49ec8c-run-openvswitch\") pod \"ovnkube-node-8gjr4\" (UID: \"ca6aa1df-449e-4aef-98a2-ad6fba49ec8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gjr4" Sep 07 13:38:51.034295 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.032558 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ca6aa1df-449e-4aef-98a2-ad6fba49ec8c-host-cni-bin\") pod \"ovnkube-node-8gjr4\" (UID: \"ca6aa1df-449e-4aef-98a2-ad6fba49ec8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gjr4" Sep 07 13:38:51.034295 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.032583 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ca6aa1df-449e-4aef-98a2-ad6fba49ec8c-env-overrides\") pod \"ovnkube-node-8gjr4\" (UID: \"ca6aa1df-449e-4aef-98a2-ad6fba49ec8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gjr4" Sep 07 13:38:51.034295 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.032608 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b12d5e4b-b139-4b59-b6ce-3cbc314a11c6-cnibin\") pod \"multus-additional-cni-plugins-xqq4n\" (UID: \"b12d5e4b-b139-4b59-b6ce-3cbc314a11c6\") " pod="openshift-multus/multus-additional-cni-plugins-xqq4n" Sep 07 13:38:51.034295 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.032637 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ad201af3-f88e-4869-a5b7-0726f6282ee2-tmp-dir\") pod \"node-resolver-fv7sq\" (UID: \"ad201af3-f88e-4869-a5b7-0726f6282ee2\") " pod="openshift-dns/node-resolver-fv7sq" Sep 07 13:38:51.040359 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.040336 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3e98ba1a-f358-4d0c-8be7-cf3ad7eadd82-agent-certs\") pod \"konnectivity-agent-m784g\" (UID: \"3e98ba1a-f358-4d0c-8be7-cf3ad7eadd82\") " pod="kube-system/konnectivity-agent-m784g" Sep 07 13:38:51.041735 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:38:51.041007 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 07 13:38:51.041735 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:38:51.041050 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 07 13:38:51.041735 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:38:51.041066 2575 projected.go:196] Error preparing data for projected volume kube-api-access-v8mqk for pod openshift-network-diagnostics/network-check-target-tp5h2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 13:38:51.041735 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:38:51.041143 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8fa51077-bb0c-4245-bdd1-b3dfcea493aa-kube-api-access-v8mqk podName:8fa51077-bb0c-4245-bdd1-b3dfcea493aa nodeName:}" failed. No retries permitted until 2026-09-07 13:38:51.541106205 +0000 UTC m=+3.035235521 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-v8mqk" (UniqueName: "kubernetes.io/projected/8fa51077-bb0c-4245-bdd1-b3dfcea493aa-kube-api-access-v8mqk") pod "network-check-target-tp5h2" (UID: "8fa51077-bb0c-4245-bdd1-b3dfcea493aa") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 13:38:51.044354 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.044294 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rm942\" (UniqueName: \"kubernetes.io/projected/ad201af3-f88e-4869-a5b7-0726f6282ee2-kube-api-access-rm942\") pod \"node-resolver-fv7sq\" (UID: \"ad201af3-f88e-4869-a5b7-0726f6282ee2\") " pod="openshift-dns/node-resolver-fv7sq" Sep 07 13:38:51.136063 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.133048 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/cb716f9f-409e-4143-a92e-564996107e14-kubelet-dir\") pod \"aws-ebs-csi-driver-node-64mgb\" (UID: \"cb716f9f-409e-4143-a92e-564996107e14\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-64mgb" Sep 07 13:38:51.136063 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.133090 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/cb716f9f-409e-4143-a92e-564996107e14-device-dir\") pod \"aws-ebs-csi-driver-node-64mgb\" (UID: \"cb716f9f-409e-4143-a92e-564996107e14\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-64mgb" Sep 07 13:38:51.136063 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.133115 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a3f897ca-315e-40ed-bbe7-dad697bf06a1-system-cni-dir\") pod \"multus-rgmdv\" (UID: \"a3f897ca-315e-40ed-bbe7-dad697bf06a1\") " pod="openshift-multus/multus-rgmdv" Sep 07 13:38:51.136063 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.133149 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a3f897ca-315e-40ed-bbe7-dad697bf06a1-host-var-lib-cni-bin\") pod \"multus-rgmdv\" (UID: \"a3f897ca-315e-40ed-bbe7-dad697bf06a1\") " pod="openshift-multus/multus-rgmdv" Sep 07 13:38:51.136063 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.133174 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ca6aa1df-449e-4aef-98a2-ad6fba49ec8c-host-slash\") pod \"ovnkube-node-8gjr4\" (UID: \"ca6aa1df-449e-4aef-98a2-ad6fba49ec8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gjr4" Sep 07 13:38:51.136063 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.133200 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/95f5dd2f-c6da-468f-9c25-01886f2bbb76-lib-modules\") pod \"tuned-qpqv9\" (UID: \"95f5dd2f-c6da-468f-9c25-01886f2bbb76\") " pod="openshift-cluster-node-tuning-operator/tuned-qpqv9" Sep 07 13:38:51.136063 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.133228 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b12d5e4b-b139-4b59-b6ce-3cbc314a11c6-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xqq4n\" (UID: \"b12d5e4b-b139-4b59-b6ce-3cbc314a11c6\") " pod="openshift-multus/multus-additional-cni-plugins-xqq4n" Sep 07 13:38:51.136063 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.133253 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wbwnj\" (UniqueName: \"kubernetes.io/projected/0add805e-551b-40c5-8cee-8cc240585411-kube-api-access-wbwnj\") pod \"node-ca-kr8mv\" (UID: \"0add805e-551b-40c5-8cee-8cc240585411\") " pod="openshift-image-registry/node-ca-kr8mv" Sep 07 13:38:51.136063 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.133278 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a3f897ca-315e-40ed-bbe7-dad697bf06a1-host-run-netns\") pod \"multus-rgmdv\" (UID: \"a3f897ca-315e-40ed-bbe7-dad697bf06a1\") " pod="openshift-multus/multus-rgmdv" Sep 07 13:38:51.136063 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.133304 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a3f897ca-315e-40ed-bbe7-dad697bf06a1-etc-kubernetes\") pod \"multus-rgmdv\" (UID: \"a3f897ca-315e-40ed-bbe7-dad697bf06a1\") " pod="openshift-multus/multus-rgmdv" Sep 07 13:38:51.136063 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.133328 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ca6aa1df-449e-4aef-98a2-ad6fba49ec8c-node-log\") pod \"ovnkube-node-8gjr4\" (UID: \"ca6aa1df-449e-4aef-98a2-ad6fba49ec8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gjr4" Sep 07 13:38:51.136063 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.133354 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ca6aa1df-449e-4aef-98a2-ad6fba49ec8c-ovnkube-script-lib\") pod \"ovnkube-node-8gjr4\" (UID: \"ca6aa1df-449e-4aef-98a2-ad6fba49ec8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gjr4" Sep 07 13:38:51.136063 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.133377 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/95f5dd2f-c6da-468f-9c25-01886f2bbb76-etc-sysconfig\") pod \"tuned-qpqv9\" (UID: \"95f5dd2f-c6da-468f-9c25-01886f2bbb76\") " pod="openshift-cluster-node-tuning-operator/tuned-qpqv9" Sep 07 13:38:51.136063 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.133401 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b12d5e4b-b139-4b59-b6ce-3cbc314a11c6-system-cni-dir\") pod \"multus-additional-cni-plugins-xqq4n\" (UID: \"b12d5e4b-b139-4b59-b6ce-3cbc314a11c6\") " pod="openshift-multus/multus-additional-cni-plugins-xqq4n" Sep 07 13:38:51.136063 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.133429 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3dccac71-71b0-49e8-bde3-08fd33578be3-original-pull-secret\") pod \"global-pull-secret-syncer-947k4\" (UID: \"3dccac71-71b0-49e8-bde3-08fd33578be3\") " pod="kube-system/global-pull-secret-syncer-947k4" Sep 07 13:38:51.136063 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.133454 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/cb716f9f-409e-4143-a92e-564996107e14-socket-dir\") pod \"aws-ebs-csi-driver-node-64mgb\" (UID: \"cb716f9f-409e-4143-a92e-564996107e14\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-64mgb" Sep 07 13:38:51.136063 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.133488 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ca6aa1df-449e-4aef-98a2-ad6fba49ec8c-var-lib-openvswitch\") pod \"ovnkube-node-8gjr4\" (UID: \"ca6aa1df-449e-4aef-98a2-ad6fba49ec8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gjr4" Sep 07 13:38:51.136743 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.133513 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d2bbad05-d053-4847-bbb5-0636d50734eb-host-slash\") pod \"iptables-alerter-brs25\" (UID: \"d2bbad05-d053-4847-bbb5-0636d50734eb\") " pod="openshift-network-operator/iptables-alerter-brs25" Sep 07 13:38:51.136743 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.133545 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/cb716f9f-409e-4143-a92e-564996107e14-sys-fs\") pod \"aws-ebs-csi-driver-node-64mgb\" (UID: \"cb716f9f-409e-4143-a92e-564996107e14\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-64mgb" Sep 07 13:38:51.136743 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.133570 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a3f897ca-315e-40ed-bbe7-dad697bf06a1-host-run-k8s-cni-cncf-io\") pod \"multus-rgmdv\" (UID: \"a3f897ca-315e-40ed-bbe7-dad697bf06a1\") " pod="openshift-multus/multus-rgmdv" Sep 07 13:38:51.136743 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.133605 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a3f897ca-315e-40ed-bbe7-dad697bf06a1-hostroot\") pod \"multus-rgmdv\" (UID: \"a3f897ca-315e-40ed-bbe7-dad697bf06a1\") " pod="openshift-multus/multus-rgmdv" Sep 07 13:38:51.136743 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.133630 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ca6aa1df-449e-4aef-98a2-ad6fba49ec8c-systemd-units\") pod \"ovnkube-node-8gjr4\" (UID: \"ca6aa1df-449e-4aef-98a2-ad6fba49ec8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gjr4" Sep 07 13:38:51.136743 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.133655 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sb52f\" (UniqueName: \"kubernetes.io/projected/d2bbad05-d053-4847-bbb5-0636d50734eb-kube-api-access-sb52f\") pod \"iptables-alerter-brs25\" (UID: \"d2bbad05-d053-4847-bbb5-0636d50734eb\") " pod="openshift-network-operator/iptables-alerter-brs25" Sep 07 13:38:51.136743 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.133679 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ca6aa1df-449e-4aef-98a2-ad6fba49ec8c-ovnkube-config\") pod \"ovnkube-node-8gjr4\" (UID: \"ca6aa1df-449e-4aef-98a2-ad6fba49ec8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gjr4" Sep 07 13:38:51.136743 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.133707 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b12d5e4b-b139-4b59-b6ce-3cbc314a11c6-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xqq4n\" (UID: \"b12d5e4b-b139-4b59-b6ce-3cbc314a11c6\") " pod="openshift-multus/multus-additional-cni-plugins-xqq4n" Sep 07 13:38:51.136743 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.133732 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0add805e-551b-40c5-8cee-8cc240585411-host\") pod \"node-ca-kr8mv\" (UID: \"0add805e-551b-40c5-8cee-8cc240585411\") " pod="openshift-image-registry/node-ca-kr8mv" Sep 07 13:38:51.136743 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.133756 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a3f897ca-315e-40ed-bbe7-dad697bf06a1-multus-daemon-config\") pod \"multus-rgmdv\" (UID: \"a3f897ca-315e-40ed-bbe7-dad697bf06a1\") " pod="openshift-multus/multus-rgmdv" Sep 07 13:38:51.136743 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.133782 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-96jc9\" (UniqueName: \"kubernetes.io/projected/a3f897ca-315e-40ed-bbe7-dad697bf06a1-kube-api-access-96jc9\") pod \"multus-rgmdv\" (UID: \"a3f897ca-315e-40ed-bbe7-dad697bf06a1\") " pod="openshift-multus/multus-rgmdv" Sep 07 13:38:51.136743 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.133809 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ca6aa1df-449e-4aef-98a2-ad6fba49ec8c-run-ovn\") pod \"ovnkube-node-8gjr4\" (UID: \"ca6aa1df-449e-4aef-98a2-ad6fba49ec8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gjr4" Sep 07 13:38:51.136743 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.133834 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ca6aa1df-449e-4aef-98a2-ad6fba49ec8c-host-run-ovn-kubernetes\") pod \"ovnkube-node-8gjr4\" (UID: \"ca6aa1df-449e-4aef-98a2-ad6fba49ec8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gjr4" Sep 07 13:38:51.136743 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.133882 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/95f5dd2f-c6da-468f-9c25-01886f2bbb76-etc-modprobe-d\") pod \"tuned-qpqv9\" (UID: \"95f5dd2f-c6da-468f-9c25-01886f2bbb76\") " pod="openshift-cluster-node-tuning-operator/tuned-qpqv9" Sep 07 13:38:51.136743 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.133909 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b8ndx\" (UniqueName: \"kubernetes.io/projected/95f5dd2f-c6da-468f-9c25-01886f2bbb76-kube-api-access-b8ndx\") pod \"tuned-qpqv9\" (UID: \"95f5dd2f-c6da-468f-9c25-01886f2bbb76\") " pod="openshift-cluster-node-tuning-operator/tuned-qpqv9" Sep 07 13:38:51.136743 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.133935 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d2bbad05-d053-4847-bbb5-0636d50734eb-iptables-alerter-script\") pod \"iptables-alerter-brs25\" (UID: \"d2bbad05-d053-4847-bbb5-0636d50734eb\") " pod="openshift-network-operator/iptables-alerter-brs25" Sep 07 13:38:51.136743 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.133959 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a3f897ca-315e-40ed-bbe7-dad697bf06a1-cnibin\") pod \"multus-rgmdv\" (UID: \"a3f897ca-315e-40ed-bbe7-dad697bf06a1\") " pod="openshift-multus/multus-rgmdv" Sep 07 13:38:51.137483 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.133985 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ca6aa1df-449e-4aef-98a2-ad6fba49ec8c-host-cni-netd\") pod \"ovnkube-node-8gjr4\" (UID: \"ca6aa1df-449e-4aef-98a2-ad6fba49ec8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gjr4" Sep 07 13:38:51.137483 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.134010 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b12d5e4b-b139-4b59-b6ce-3cbc314a11c6-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xqq4n\" (UID: \"b12d5e4b-b139-4b59-b6ce-3cbc314a11c6\") " pod="openshift-multus/multus-additional-cni-plugins-xqq4n" Sep 07 13:38:51.137483 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.134038 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sbtmx\" (UniqueName: \"kubernetes.io/projected/b12d5e4b-b139-4b59-b6ce-3cbc314a11c6-kube-api-access-sbtmx\") pod \"multus-additional-cni-plugins-xqq4n\" (UID: \"b12d5e4b-b139-4b59-b6ce-3cbc314a11c6\") " pod="openshift-multus/multus-additional-cni-plugins-xqq4n" Sep 07 13:38:51.137483 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.134064 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a3f897ca-315e-40ed-bbe7-dad697bf06a1-host-var-lib-cni-multus\") pod \"multus-rgmdv\" (UID: \"a3f897ca-315e-40ed-bbe7-dad697bf06a1\") " pod="openshift-multus/multus-rgmdv" Sep 07 13:38:51.137483 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.134088 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ca6aa1df-449e-4aef-98a2-ad6fba49ec8c-host-run-netns\") pod \"ovnkube-node-8gjr4\" (UID: \"ca6aa1df-449e-4aef-98a2-ad6fba49ec8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gjr4" Sep 07 13:38:51.137483 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.134113 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/95f5dd2f-c6da-468f-9c25-01886f2bbb76-etc-systemd\") pod \"tuned-qpqv9\" (UID: \"95f5dd2f-c6da-468f-9c25-01886f2bbb76\") " pod="openshift-cluster-node-tuning-operator/tuned-qpqv9" Sep 07 13:38:51.137483 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.134138 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b12d5e4b-b139-4b59-b6ce-3cbc314a11c6-cni-binary-copy\") pod \"multus-additional-cni-plugins-xqq4n\" (UID: \"b12d5e4b-b139-4b59-b6ce-3cbc314a11c6\") " pod="openshift-multus/multus-additional-cni-plugins-xqq4n" Sep 07 13:38:51.137483 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.134163 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a3f897ca-315e-40ed-bbe7-dad697bf06a1-multus-socket-dir-parent\") pod \"multus-rgmdv\" (UID: \"a3f897ca-315e-40ed-bbe7-dad697bf06a1\") " pod="openshift-multus/multus-rgmdv" Sep 07 13:38:51.137483 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.134194 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a3f897ca-315e-40ed-bbe7-dad697bf06a1-host-var-lib-kubelet\") pod \"multus-rgmdv\" (UID: \"a3f897ca-315e-40ed-bbe7-dad697bf06a1\") " pod="openshift-multus/multus-rgmdv" Sep 07 13:38:51.137483 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.134220 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ca6aa1df-449e-4aef-98a2-ad6fba49ec8c-host-kubelet\") pod \"ovnkube-node-8gjr4\" (UID: \"ca6aa1df-449e-4aef-98a2-ad6fba49ec8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gjr4" Sep 07 13:38:51.137483 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.134245 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ca6aa1df-449e-4aef-98a2-ad6fba49ec8c-ovn-node-metrics-cert\") pod \"ovnkube-node-8gjr4\" (UID: \"ca6aa1df-449e-4aef-98a2-ad6fba49ec8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gjr4" Sep 07 13:38:51.137483 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.134271 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/51f8ac5a-daf1-48b6-ace7-9b7674b90409-metrics-certs\") pod \"network-metrics-daemon-pwdkf\" (UID: \"51f8ac5a-daf1-48b6-ace7-9b7674b90409\") " pod="openshift-multus/network-metrics-daemon-pwdkf" Sep 07 13:38:51.137483 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.134318 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ca6aa1df-449e-4aef-98a2-ad6fba49ec8c-run-systemd\") pod \"ovnkube-node-8gjr4\" (UID: \"ca6aa1df-449e-4aef-98a2-ad6fba49ec8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gjr4" Sep 07 13:38:51.137483 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.134345 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ca6aa1df-449e-4aef-98a2-ad6fba49ec8c-etc-openvswitch\") pod \"ovnkube-node-8gjr4\" (UID: \"ca6aa1df-449e-4aef-98a2-ad6fba49ec8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gjr4" Sep 07 13:38:51.137483 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.134370 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-24cb4\" (UniqueName: \"kubernetes.io/projected/51f8ac5a-daf1-48b6-ace7-9b7674b90409-kube-api-access-24cb4\") pod \"network-metrics-daemon-pwdkf\" (UID: \"51f8ac5a-daf1-48b6-ace7-9b7674b90409\") " pod="openshift-multus/network-metrics-daemon-pwdkf" Sep 07 13:38:51.137483 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.134404 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/95f5dd2f-c6da-468f-9c25-01886f2bbb76-etc-sysctl-d\") pod \"tuned-qpqv9\" (UID: \"95f5dd2f-c6da-468f-9c25-01886f2bbb76\") " pod="openshift-cluster-node-tuning-operator/tuned-qpqv9" Sep 07 13:38:51.137483 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.134428 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/95f5dd2f-c6da-468f-9c25-01886f2bbb76-run\") pod \"tuned-qpqv9\" (UID: \"95f5dd2f-c6da-468f-9c25-01886f2bbb76\") " pod="openshift-cluster-node-tuning-operator/tuned-qpqv9" Sep 07 13:38:51.138910 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.134454 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/95f5dd2f-c6da-468f-9c25-01886f2bbb76-etc-tuned\") pod \"tuned-qpqv9\" (UID: \"95f5dd2f-c6da-468f-9c25-01886f2bbb76\") " pod="openshift-cluster-node-tuning-operator/tuned-qpqv9" Sep 07 13:38:51.138910 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.134484 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-flfvj\" (UniqueName: \"kubernetes.io/projected/cb716f9f-409e-4143-a92e-564996107e14-kube-api-access-flfvj\") pod \"aws-ebs-csi-driver-node-64mgb\" (UID: \"cb716f9f-409e-4143-a92e-564996107e14\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-64mgb" Sep 07 13:38:51.138910 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.134510 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0add805e-551b-40c5-8cee-8cc240585411-serviceca\") pod \"node-ca-kr8mv\" (UID: \"0add805e-551b-40c5-8cee-8cc240585411\") " pod="openshift-image-registry/node-ca-kr8mv" Sep 07 13:38:51.138910 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.134535 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a3f897ca-315e-40ed-bbe7-dad697bf06a1-multus-conf-dir\") pod \"multus-rgmdv\" (UID: \"a3f897ca-315e-40ed-bbe7-dad697bf06a1\") " pod="openshift-multus/multus-rgmdv" Sep 07 13:38:51.138910 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.134560 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a3f897ca-315e-40ed-bbe7-dad697bf06a1-host-run-multus-certs\") pod \"multus-rgmdv\" (UID: \"a3f897ca-315e-40ed-bbe7-dad697bf06a1\") " pod="openshift-multus/multus-rgmdv" Sep 07 13:38:51.138910 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.134585 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/95f5dd2f-c6da-468f-9c25-01886f2bbb76-etc-kubernetes\") pod \"tuned-qpqv9\" (UID: \"95f5dd2f-c6da-468f-9c25-01886f2bbb76\") " pod="openshift-cluster-node-tuning-operator/tuned-qpqv9" Sep 07 13:38:51.138910 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.134617 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/95f5dd2f-c6da-468f-9c25-01886f2bbb76-etc-sysctl-conf\") pod \"tuned-qpqv9\" (UID: \"95f5dd2f-c6da-468f-9c25-01886f2bbb76\") " pod="openshift-cluster-node-tuning-operator/tuned-qpqv9" Sep 07 13:38:51.138910 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.134640 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/95f5dd2f-c6da-468f-9c25-01886f2bbb76-sys\") pod \"tuned-qpqv9\" (UID: \"95f5dd2f-c6da-468f-9c25-01886f2bbb76\") " pod="openshift-cluster-node-tuning-operator/tuned-qpqv9" Sep 07 13:38:51.138910 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.134666 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/95f5dd2f-c6da-468f-9c25-01886f2bbb76-var-lib-kubelet\") pod \"tuned-qpqv9\" (UID: \"95f5dd2f-c6da-468f-9c25-01886f2bbb76\") " pod="openshift-cluster-node-tuning-operator/tuned-qpqv9" Sep 07 13:38:51.138910 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.134694 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ca6aa1df-449e-4aef-98a2-ad6fba49ec8c-run-openvswitch\") pod \"ovnkube-node-8gjr4\" (UID: \"ca6aa1df-449e-4aef-98a2-ad6fba49ec8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gjr4" Sep 07 13:38:51.138910 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.134720 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ca6aa1df-449e-4aef-98a2-ad6fba49ec8c-host-cni-bin\") pod \"ovnkube-node-8gjr4\" (UID: \"ca6aa1df-449e-4aef-98a2-ad6fba49ec8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gjr4" Sep 07 13:38:51.138910 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.134746 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ca6aa1df-449e-4aef-98a2-ad6fba49ec8c-env-overrides\") pod \"ovnkube-node-8gjr4\" (UID: \"ca6aa1df-449e-4aef-98a2-ad6fba49ec8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gjr4" Sep 07 13:38:51.138910 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.134773 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b12d5e4b-b139-4b59-b6ce-3cbc314a11c6-cnibin\") pod \"multus-additional-cni-plugins-xqq4n\" (UID: \"b12d5e4b-b139-4b59-b6ce-3cbc314a11c6\") " pod="openshift-multus/multus-additional-cni-plugins-xqq4n" Sep 07 13:38:51.138910 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.134805 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3dccac71-71b0-49e8-bde3-08fd33578be3-kubelet-config\") pod \"global-pull-secret-syncer-947k4\" (UID: \"3dccac71-71b0-49e8-bde3-08fd33578be3\") " pod="kube-system/global-pull-secret-syncer-947k4" Sep 07 13:38:51.138910 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.134831 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3dccac71-71b0-49e8-bde3-08fd33578be3-dbus\") pod \"global-pull-secret-syncer-947k4\" (UID: \"3dccac71-71b0-49e8-bde3-08fd33578be3\") " pod="kube-system/global-pull-secret-syncer-947k4" Sep 07 13:38:51.138910 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.134873 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/cb716f9f-409e-4143-a92e-564996107e14-registration-dir\") pod \"aws-ebs-csi-driver-node-64mgb\" (UID: \"cb716f9f-409e-4143-a92e-564996107e14\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-64mgb" Sep 07 13:38:51.138910 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.134936 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/cb716f9f-409e-4143-a92e-564996107e14-etc-selinux\") pod \"aws-ebs-csi-driver-node-64mgb\" (UID: \"cb716f9f-409e-4143-a92e-564996107e14\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-64mgb" Sep 07 13:38:51.139811 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.134966 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a3f897ca-315e-40ed-bbe7-dad697bf06a1-cni-binary-copy\") pod \"multus-rgmdv\" (UID: \"a3f897ca-315e-40ed-bbe7-dad697bf06a1\") " pod="openshift-multus/multus-rgmdv" Sep 07 13:38:51.139811 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.135000 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ca6aa1df-449e-4aef-98a2-ad6fba49ec8c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8gjr4\" (UID: \"ca6aa1df-449e-4aef-98a2-ad6fba49ec8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gjr4" Sep 07 13:38:51.139811 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.135028 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/95f5dd2f-c6da-468f-9c25-01886f2bbb76-tmp\") pod \"tuned-qpqv9\" (UID: \"95f5dd2f-c6da-468f-9c25-01886f2bbb76\") " pod="openshift-cluster-node-tuning-operator/tuned-qpqv9" Sep 07 13:38:51.139811 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.135060 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a3f897ca-315e-40ed-bbe7-dad697bf06a1-multus-cni-dir\") pod \"multus-rgmdv\" (UID: \"a3f897ca-315e-40ed-bbe7-dad697bf06a1\") " pod="openshift-multus/multus-rgmdv" Sep 07 13:38:51.139811 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.135088 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vrtmj\" (UniqueName: \"kubernetes.io/projected/ca6aa1df-449e-4aef-98a2-ad6fba49ec8c-kube-api-access-vrtmj\") pod \"ovnkube-node-8gjr4\" (UID: \"ca6aa1df-449e-4aef-98a2-ad6fba49ec8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gjr4" Sep 07 13:38:51.139811 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.135124 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/95f5dd2f-c6da-468f-9c25-01886f2bbb76-host\") pod \"tuned-qpqv9\" (UID: \"95f5dd2f-c6da-468f-9c25-01886f2bbb76\") " pod="openshift-cluster-node-tuning-operator/tuned-qpqv9" Sep 07 13:38:51.139811 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.135151 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ca6aa1df-449e-4aef-98a2-ad6fba49ec8c-log-socket\") pod \"ovnkube-node-8gjr4\" (UID: \"ca6aa1df-449e-4aef-98a2-ad6fba49ec8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gjr4" Sep 07 13:38:51.139811 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.135262 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ca6aa1df-449e-4aef-98a2-ad6fba49ec8c-log-socket\") pod \"ovnkube-node-8gjr4\" (UID: \"ca6aa1df-449e-4aef-98a2-ad6fba49ec8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gjr4" Sep 07 13:38:51.139811 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.135335 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a3f897ca-315e-40ed-bbe7-dad697bf06a1-cnibin\") pod \"multus-rgmdv\" (UID: \"a3f897ca-315e-40ed-bbe7-dad697bf06a1\") " pod="openshift-multus/multus-rgmdv" Sep 07 13:38:51.139811 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.135379 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ca6aa1df-449e-4aef-98a2-ad6fba49ec8c-host-cni-netd\") pod \"ovnkube-node-8gjr4\" (UID: \"ca6aa1df-449e-4aef-98a2-ad6fba49ec8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gjr4" Sep 07 13:38:51.139811 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.135401 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d2bbad05-d053-4847-bbb5-0636d50734eb-iptables-alerter-script\") pod \"iptables-alerter-brs25\" (UID: \"d2bbad05-d053-4847-bbb5-0636d50734eb\") " pod="openshift-network-operator/iptables-alerter-brs25" Sep 07 13:38:51.139811 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.135536 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b12d5e4b-b139-4b59-b6ce-3cbc314a11c6-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xqq4n\" (UID: \"b12d5e4b-b139-4b59-b6ce-3cbc314a11c6\") " pod="openshift-multus/multus-additional-cni-plugins-xqq4n" Sep 07 13:38:51.139811 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.135572 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/cb716f9f-409e-4143-a92e-564996107e14-kubelet-dir\") pod \"aws-ebs-csi-driver-node-64mgb\" (UID: \"cb716f9f-409e-4143-a92e-564996107e14\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-64mgb" Sep 07 13:38:51.139811 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.135622 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/cb716f9f-409e-4143-a92e-564996107e14-device-dir\") pod \"aws-ebs-csi-driver-node-64mgb\" (UID: \"cb716f9f-409e-4143-a92e-564996107e14\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-64mgb" Sep 07 13:38:51.139811 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.135712 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a3f897ca-315e-40ed-bbe7-dad697bf06a1-system-cni-dir\") pod \"multus-rgmdv\" (UID: \"a3f897ca-315e-40ed-bbe7-dad697bf06a1\") " pod="openshift-multus/multus-rgmdv" Sep 07 13:38:51.139811 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.135747 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a3f897ca-315e-40ed-bbe7-dad697bf06a1-host-var-lib-cni-bin\") pod \"multus-rgmdv\" (UID: \"a3f897ca-315e-40ed-bbe7-dad697bf06a1\") " pod="openshift-multus/multus-rgmdv" Sep 07 13:38:51.139811 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.135794 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ca6aa1df-449e-4aef-98a2-ad6fba49ec8c-host-slash\") pod \"ovnkube-node-8gjr4\" (UID: \"ca6aa1df-449e-4aef-98a2-ad6fba49ec8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gjr4" Sep 07 13:38:51.139811 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.135798 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a3f897ca-315e-40ed-bbe7-dad697bf06a1-host-var-lib-cni-multus\") pod \"multus-rgmdv\" (UID: \"a3f897ca-315e-40ed-bbe7-dad697bf06a1\") " pod="openshift-multus/multus-rgmdv" Sep 07 13:38:51.140632 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.135846 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ca6aa1df-449e-4aef-98a2-ad6fba49ec8c-host-run-netns\") pod \"ovnkube-node-8gjr4\" (UID: \"ca6aa1df-449e-4aef-98a2-ad6fba49ec8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gjr4" Sep 07 13:38:51.140632 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.135886 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/95f5dd2f-c6da-468f-9c25-01886f2bbb76-lib-modules\") pod \"tuned-qpqv9\" (UID: \"95f5dd2f-c6da-468f-9c25-01886f2bbb76\") " pod="openshift-cluster-node-tuning-operator/tuned-qpqv9" Sep 07 13:38:51.140632 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.135923 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/95f5dd2f-c6da-468f-9c25-01886f2bbb76-etc-systemd\") pod \"tuned-qpqv9\" (UID: \"95f5dd2f-c6da-468f-9c25-01886f2bbb76\") " pod="openshift-cluster-node-tuning-operator/tuned-qpqv9" Sep 07 13:38:51.140632 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.136311 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b12d5e4b-b139-4b59-b6ce-3cbc314a11c6-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xqq4n\" (UID: \"b12d5e4b-b139-4b59-b6ce-3cbc314a11c6\") " pod="openshift-multus/multus-additional-cni-plugins-xqq4n" Sep 07 13:38:51.140632 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.136564 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a3f897ca-315e-40ed-bbe7-dad697bf06a1-host-run-netns\") pod \"multus-rgmdv\" (UID: \"a3f897ca-315e-40ed-bbe7-dad697bf06a1\") " pod="openshift-multus/multus-rgmdv" Sep 07 13:38:51.140632 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.136617 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a3f897ca-315e-40ed-bbe7-dad697bf06a1-etc-kubernetes\") pod \"multus-rgmdv\" (UID: \"a3f897ca-315e-40ed-bbe7-dad697bf06a1\") " pod="openshift-multus/multus-rgmdv" Sep 07 13:38:51.140632 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.136658 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ca6aa1df-449e-4aef-98a2-ad6fba49ec8c-node-log\") pod \"ovnkube-node-8gjr4\" (UID: \"ca6aa1df-449e-4aef-98a2-ad6fba49ec8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gjr4" Sep 07 13:38:51.140632 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.136973 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ca6aa1df-449e-4aef-98a2-ad6fba49ec8c-systemd-units\") pod \"ovnkube-node-8gjr4\" (UID: \"ca6aa1df-449e-4aef-98a2-ad6fba49ec8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gjr4" Sep 07 13:38:51.140632 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.136993 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ca6aa1df-449e-4aef-98a2-ad6fba49ec8c-var-lib-openvswitch\") pod \"ovnkube-node-8gjr4\" (UID: \"ca6aa1df-449e-4aef-98a2-ad6fba49ec8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gjr4" Sep 07 13:38:51.140632 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.137038 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d2bbad05-d053-4847-bbb5-0636d50734eb-host-slash\") pod \"iptables-alerter-brs25\" (UID: \"d2bbad05-d053-4847-bbb5-0636d50734eb\") " pod="openshift-network-operator/iptables-alerter-brs25" Sep 07 13:38:51.140632 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.137076 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/95f5dd2f-c6da-468f-9c25-01886f2bbb76-etc-sysconfig\") pod \"tuned-qpqv9\" (UID: \"95f5dd2f-c6da-468f-9c25-01886f2bbb76\") " pod="openshift-cluster-node-tuning-operator/tuned-qpqv9" Sep 07 13:38:51.140632 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.137102 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/cb716f9f-409e-4143-a92e-564996107e14-sys-fs\") pod \"aws-ebs-csi-driver-node-64mgb\" (UID: \"cb716f9f-409e-4143-a92e-564996107e14\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-64mgb" Sep 07 13:38:51.140632 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.137129 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b12d5e4b-b139-4b59-b6ce-3cbc314a11c6-system-cni-dir\") pod \"multus-additional-cni-plugins-xqq4n\" (UID: \"b12d5e4b-b139-4b59-b6ce-3cbc314a11c6\") " pod="openshift-multus/multus-additional-cni-plugins-xqq4n" Sep 07 13:38:51.140632 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.137148 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a3f897ca-315e-40ed-bbe7-dad697bf06a1-host-run-k8s-cni-cncf-io\") pod \"multus-rgmdv\" (UID: \"a3f897ca-315e-40ed-bbe7-dad697bf06a1\") " pod="openshift-multus/multus-rgmdv" Sep 07 13:38:51.140632 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.137181 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ca6aa1df-449e-4aef-98a2-ad6fba49ec8c-ovnkube-script-lib\") pod \"ovnkube-node-8gjr4\" (UID: \"ca6aa1df-449e-4aef-98a2-ad6fba49ec8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gjr4" Sep 07 13:38:51.140632 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.137196 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a3f897ca-315e-40ed-bbe7-dad697bf06a1-hostroot\") pod \"multus-rgmdv\" (UID: \"a3f897ca-315e-40ed-bbe7-dad697bf06a1\") " pod="openshift-multus/multus-rgmdv" Sep 07 13:38:51.140632 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:38:51.137227 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 07 13:38:51.140632 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.137248 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a3f897ca-315e-40ed-bbe7-dad697bf06a1-host-var-lib-kubelet\") pod \"multus-rgmdv\" (UID: \"a3f897ca-315e-40ed-bbe7-dad697bf06a1\") " pod="openshift-multus/multus-rgmdv" Sep 07 13:38:51.141419 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:38:51.137295 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3dccac71-71b0-49e8-bde3-08fd33578be3-original-pull-secret podName:3dccac71-71b0-49e8-bde3-08fd33578be3 nodeName:}" failed. No retries permitted until 2026-09-07 13:38:51.63727718 +0000 UTC m=+3.131406512 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3dccac71-71b0-49e8-bde3-08fd33578be3-original-pull-secret") pod "global-pull-secret-syncer-947k4" (UID: "3dccac71-71b0-49e8-bde3-08fd33578be3") : object "kube-system"/"original-pull-secret" not registered Sep 07 13:38:51.141419 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.137314 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a3f897ca-315e-40ed-bbe7-dad697bf06a1-multus-socket-dir-parent\") pod \"multus-rgmdv\" (UID: \"a3f897ca-315e-40ed-bbe7-dad697bf06a1\") " pod="openshift-multus/multus-rgmdv" Sep 07 13:38:51.141419 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.137325 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/95f5dd2f-c6da-468f-9c25-01886f2bbb76-etc-sysctl-conf\") pod \"tuned-qpqv9\" (UID: \"95f5dd2f-c6da-468f-9c25-01886f2bbb76\") " pod="openshift-cluster-node-tuning-operator/tuned-qpqv9" Sep 07 13:38:51.141419 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.137376 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ca6aa1df-449e-4aef-98a2-ad6fba49ec8c-run-ovn\") pod \"ovnkube-node-8gjr4\" (UID: \"ca6aa1df-449e-4aef-98a2-ad6fba49ec8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gjr4" Sep 07 13:38:51.141419 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.137413 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ca6aa1df-449e-4aef-98a2-ad6fba49ec8c-host-kubelet\") pod \"ovnkube-node-8gjr4\" (UID: \"ca6aa1df-449e-4aef-98a2-ad6fba49ec8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gjr4" Sep 07 13:38:51.141419 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.137420 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ca6aa1df-449e-4aef-98a2-ad6fba49ec8c-host-run-ovn-kubernetes\") pod \"ovnkube-node-8gjr4\" (UID: \"ca6aa1df-449e-4aef-98a2-ad6fba49ec8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gjr4" Sep 07 13:38:51.141419 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.137525 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/95f5dd2f-c6da-468f-9c25-01886f2bbb76-etc-modprobe-d\") pod \"tuned-qpqv9\" (UID: \"95f5dd2f-c6da-468f-9c25-01886f2bbb76\") " pod="openshift-cluster-node-tuning-operator/tuned-qpqv9" Sep 07 13:38:51.141419 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.137696 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/cb716f9f-409e-4143-a92e-564996107e14-socket-dir\") pod \"aws-ebs-csi-driver-node-64mgb\" (UID: \"cb716f9f-409e-4143-a92e-564996107e14\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-64mgb" Sep 07 13:38:51.141419 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.137761 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0add805e-551b-40c5-8cee-8cc240585411-host\") pod \"node-ca-kr8mv\" (UID: \"0add805e-551b-40c5-8cee-8cc240585411\") " pod="openshift-image-registry/node-ca-kr8mv" Sep 07 13:38:51.141419 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:38:51.137879 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 13:38:51.141419 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.137935 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3dccac71-71b0-49e8-bde3-08fd33578be3-dbus\") pod \"global-pull-secret-syncer-947k4\" (UID: \"3dccac71-71b0-49e8-bde3-08fd33578be3\") " pod="kube-system/global-pull-secret-syncer-947k4" Sep 07 13:38:51.141419 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:38:51.137942 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51f8ac5a-daf1-48b6-ace7-9b7674b90409-metrics-certs podName:51f8ac5a-daf1-48b6-ace7-9b7674b90409 nodeName:}" failed. No retries permitted until 2026-09-07 13:38:51.637925579 +0000 UTC m=+3.132054913 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/51f8ac5a-daf1-48b6-ace7-9b7674b90409-metrics-certs") pod "network-metrics-daemon-pwdkf" (UID: "51f8ac5a-daf1-48b6-ace7-9b7674b90409") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 13:38:51.141419 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.137988 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ca6aa1df-449e-4aef-98a2-ad6fba49ec8c-run-systemd\") pod \"ovnkube-node-8gjr4\" (UID: \"ca6aa1df-449e-4aef-98a2-ad6fba49ec8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gjr4" Sep 07 13:38:51.141419 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.138004 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/95f5dd2f-c6da-468f-9c25-01886f2bbb76-sys\") pod \"tuned-qpqv9\" (UID: \"95f5dd2f-c6da-468f-9c25-01886f2bbb76\") " pod="openshift-cluster-node-tuning-operator/tuned-qpqv9" Sep 07 13:38:51.141419 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.138036 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ca6aa1df-449e-4aef-98a2-ad6fba49ec8c-etc-openvswitch\") pod \"ovnkube-node-8gjr4\" (UID: \"ca6aa1df-449e-4aef-98a2-ad6fba49ec8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gjr4" Sep 07 13:38:51.141419 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.138323 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a3f897ca-315e-40ed-bbe7-dad697bf06a1-multus-daemon-config\") pod \"multus-rgmdv\" (UID: \"a3f897ca-315e-40ed-bbe7-dad697bf06a1\") " pod="openshift-multus/multus-rgmdv" Sep 07 13:38:51.141419 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.138417 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/95f5dd2f-c6da-468f-9c25-01886f2bbb76-etc-sysctl-d\") pod \"tuned-qpqv9\" (UID: \"95f5dd2f-c6da-468f-9c25-01886f2bbb76\") " pod="openshift-cluster-node-tuning-operator/tuned-qpqv9" Sep 07 13:38:51.142292 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.138571 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/95f5dd2f-c6da-468f-9c25-01886f2bbb76-var-lib-kubelet\") pod \"tuned-qpqv9\" (UID: \"95f5dd2f-c6da-468f-9c25-01886f2bbb76\") " pod="openshift-cluster-node-tuning-operator/tuned-qpqv9" Sep 07 13:38:51.142292 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.138599 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b12d5e4b-b139-4b59-b6ce-3cbc314a11c6-cni-binary-copy\") pod \"multus-additional-cni-plugins-xqq4n\" (UID: \"b12d5e4b-b139-4b59-b6ce-3cbc314a11c6\") " pod="openshift-multus/multus-additional-cni-plugins-xqq4n" Sep 07 13:38:51.142292 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.138654 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ca6aa1df-449e-4aef-98a2-ad6fba49ec8c-run-openvswitch\") pod \"ovnkube-node-8gjr4\" (UID: \"ca6aa1df-449e-4aef-98a2-ad6fba49ec8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gjr4" Sep 07 13:38:51.142292 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.138708 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ca6aa1df-449e-4aef-98a2-ad6fba49ec8c-host-cni-bin\") pod \"ovnkube-node-8gjr4\" (UID: \"ca6aa1df-449e-4aef-98a2-ad6fba49ec8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gjr4" Sep 07 13:38:51.142292 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.138910 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3dccac71-71b0-49e8-bde3-08fd33578be3-kubelet-config\") pod \"global-pull-secret-syncer-947k4\" (UID: \"3dccac71-71b0-49e8-bde3-08fd33578be3\") " pod="kube-system/global-pull-secret-syncer-947k4" Sep 07 13:38:51.142292 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.138961 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b12d5e4b-b139-4b59-b6ce-3cbc314a11c6-cnibin\") pod \"multus-additional-cni-plugins-xqq4n\" (UID: \"b12d5e4b-b139-4b59-b6ce-3cbc314a11c6\") " pod="openshift-multus/multus-additional-cni-plugins-xqq4n" Sep 07 13:38:51.142292 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.138969 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b12d5e4b-b139-4b59-b6ce-3cbc314a11c6-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xqq4n\" (UID: \"b12d5e4b-b139-4b59-b6ce-3cbc314a11c6\") " pod="openshift-multus/multus-additional-cni-plugins-xqq4n" Sep 07 13:38:51.142292 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.139009 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ca6aa1df-449e-4aef-98a2-ad6fba49ec8c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8gjr4\" (UID: \"ca6aa1df-449e-4aef-98a2-ad6fba49ec8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gjr4" Sep 07 13:38:51.142292 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.139030 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/95f5dd2f-c6da-468f-9c25-01886f2bbb76-run\") pod \"tuned-qpqv9\" (UID: \"95f5dd2f-c6da-468f-9c25-01886f2bbb76\") " pod="openshift-cluster-node-tuning-operator/tuned-qpqv9" Sep 07 13:38:51.142292 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.139067 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/cb716f9f-409e-4143-a92e-564996107e14-registration-dir\") pod \"aws-ebs-csi-driver-node-64mgb\" (UID: \"cb716f9f-409e-4143-a92e-564996107e14\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-64mgb" Sep 07 13:38:51.142292 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.139112 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ca6aa1df-449e-4aef-98a2-ad6fba49ec8c-env-overrides\") pod \"ovnkube-node-8gjr4\" (UID: \"ca6aa1df-449e-4aef-98a2-ad6fba49ec8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gjr4" Sep 07 13:38:51.142292 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.139139 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a3f897ca-315e-40ed-bbe7-dad697bf06a1-host-run-multus-certs\") pod \"multus-rgmdv\" (UID: \"a3f897ca-315e-40ed-bbe7-dad697bf06a1\") " pod="openshift-multus/multus-rgmdv" Sep 07 13:38:51.142292 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.139159 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/cb716f9f-409e-4143-a92e-564996107e14-etc-selinux\") pod \"aws-ebs-csi-driver-node-64mgb\" (UID: \"cb716f9f-409e-4143-a92e-564996107e14\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-64mgb" Sep 07 13:38:51.142292 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.139191 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a3f897ca-315e-40ed-bbe7-dad697bf06a1-multus-conf-dir\") pod \"multus-rgmdv\" (UID: \"a3f897ca-315e-40ed-bbe7-dad697bf06a1\") " pod="openshift-multus/multus-rgmdv" Sep 07 13:38:51.142292 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.139436 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0add805e-551b-40c5-8cee-8cc240585411-serviceca\") pod \"node-ca-kr8mv\" (UID: \"0add805e-551b-40c5-8cee-8cc240585411\") " pod="openshift-image-registry/node-ca-kr8mv" Sep 07 13:38:51.142292 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.139438 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/95f5dd2f-c6da-468f-9c25-01886f2bbb76-etc-kubernetes\") pod \"tuned-qpqv9\" (UID: \"95f5dd2f-c6da-468f-9c25-01886f2bbb76\") " pod="openshift-cluster-node-tuning-operator/tuned-qpqv9" Sep 07 13:38:51.142292 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.139495 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a3f897ca-315e-40ed-bbe7-dad697bf06a1-multus-cni-dir\") pod \"multus-rgmdv\" (UID: \"a3f897ca-315e-40ed-bbe7-dad697bf06a1\") " pod="openshift-multus/multus-rgmdv" Sep 07 13:38:51.143340 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.139568 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/95f5dd2f-c6da-468f-9c25-01886f2bbb76-host\") pod \"tuned-qpqv9\" (UID: \"95f5dd2f-c6da-468f-9c25-01886f2bbb76\") " pod="openshift-cluster-node-tuning-operator/tuned-qpqv9" Sep 07 13:38:51.143340 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.139606 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a3f897ca-315e-40ed-bbe7-dad697bf06a1-cni-binary-copy\") pod \"multus-rgmdv\" (UID: \"a3f897ca-315e-40ed-bbe7-dad697bf06a1\") " pod="openshift-multus/multus-rgmdv" Sep 07 13:38:51.143340 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.140175 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ca6aa1df-449e-4aef-98a2-ad6fba49ec8c-ovnkube-config\") pod \"ovnkube-node-8gjr4\" (UID: \"ca6aa1df-449e-4aef-98a2-ad6fba49ec8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gjr4" Sep 07 13:38:51.143340 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.142152 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/95f5dd2f-c6da-468f-9c25-01886f2bbb76-etc-tuned\") pod \"tuned-qpqv9\" (UID: \"95f5dd2f-c6da-468f-9c25-01886f2bbb76\") " pod="openshift-cluster-node-tuning-operator/tuned-qpqv9" Sep 07 13:38:51.143340 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.142589 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/95f5dd2f-c6da-468f-9c25-01886f2bbb76-tmp\") pod \"tuned-qpqv9\" (UID: \"95f5dd2f-c6da-468f-9c25-01886f2bbb76\") " pod="openshift-cluster-node-tuning-operator/tuned-qpqv9" Sep 07 13:38:51.144627 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.144599 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ca6aa1df-449e-4aef-98a2-ad6fba49ec8c-ovn-node-metrics-cert\") pod \"ovnkube-node-8gjr4\" (UID: \"ca6aa1df-449e-4aef-98a2-ad6fba49ec8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gjr4" Sep 07 13:38:51.156157 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.152136 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sbtmx\" (UniqueName: \"kubernetes.io/projected/b12d5e4b-b139-4b59-b6ce-3cbc314a11c6-kube-api-access-sbtmx\") pod \"multus-additional-cni-plugins-xqq4n\" (UID: \"b12d5e4b-b139-4b59-b6ce-3cbc314a11c6\") " pod="openshift-multus/multus-additional-cni-plugins-xqq4n" Sep 07 13:38:51.156157 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.153468 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wbwnj\" (UniqueName: \"kubernetes.io/projected/0add805e-551b-40c5-8cee-8cc240585411-kube-api-access-wbwnj\") pod \"node-ca-kr8mv\" (UID: \"0add805e-551b-40c5-8cee-8cc240585411\") " pod="openshift-image-registry/node-ca-kr8mv" Sep 07 13:38:51.156342 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.156276 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sb52f\" (UniqueName: \"kubernetes.io/projected/d2bbad05-d053-4847-bbb5-0636d50734eb-kube-api-access-sb52f\") pod \"iptables-alerter-brs25\" (UID: \"d2bbad05-d053-4847-bbb5-0636d50734eb\") " pod="openshift-network-operator/iptables-alerter-brs25" Sep 07 13:38:51.157430 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.157400 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b8ndx\" (UniqueName: \"kubernetes.io/projected/95f5dd2f-c6da-468f-9c25-01886f2bbb76-kube-api-access-b8ndx\") pod \"tuned-qpqv9\" (UID: \"95f5dd2f-c6da-468f-9c25-01886f2bbb76\") " pod="openshift-cluster-node-tuning-operator/tuned-qpqv9" Sep 07 13:38:51.160493 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.160449 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-96jc9\" (UniqueName: \"kubernetes.io/projected/a3f897ca-315e-40ed-bbe7-dad697bf06a1-kube-api-access-96jc9\") pod \"multus-rgmdv\" (UID: \"a3f897ca-315e-40ed-bbe7-dad697bf06a1\") " pod="openshift-multus/multus-rgmdv" Sep 07 13:38:51.160601 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.160568 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-24cb4\" (UniqueName: \"kubernetes.io/projected/51f8ac5a-daf1-48b6-ace7-9b7674b90409-kube-api-access-24cb4\") pod \"network-metrics-daemon-pwdkf\" (UID: \"51f8ac5a-daf1-48b6-ace7-9b7674b90409\") " pod="openshift-multus/network-metrics-daemon-pwdkf" Sep 07 13:38:51.160926 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.160906 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vrtmj\" (UniqueName: \"kubernetes.io/projected/ca6aa1df-449e-4aef-98a2-ad6fba49ec8c-kube-api-access-vrtmj\") pod \"ovnkube-node-8gjr4\" (UID: \"ca6aa1df-449e-4aef-98a2-ad6fba49ec8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gjr4" Sep 07 13:38:51.162724 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.162700 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-flfvj\" (UniqueName: \"kubernetes.io/projected/cb716f9f-409e-4143-a92e-564996107e14-kube-api-access-flfvj\") pod \"aws-ebs-csi-driver-node-64mgb\" (UID: \"cb716f9f-409e-4143-a92e-564996107e14\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-64mgb" Sep 07 13:38:51.239591 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.239554 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-m784g" Sep 07 13:38:51.248485 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.248461 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-fv7sq" Sep 07 13:38:51.262607 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.262575 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-8gjr4" Sep 07 13:38:51.263196 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:51.263163 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad201af3_f88e_4869_a5b7_0726f6282ee2.slice/crio-738523ae40bb45a6fdeb4b100da1b7beaba0bbc407ad4a54ab23f4e4555aee94 WatchSource:0}: Error finding container 738523ae40bb45a6fdeb4b100da1b7beaba0bbc407ad4a54ab23f4e4555aee94: Status 404 returned error can't find the container with id 738523ae40bb45a6fdeb4b100da1b7beaba0bbc407ad4a54ab23f4e4555aee94 Sep 07 13:38:51.272131 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.272106 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-brs25" Sep 07 13:38:51.277676 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:51.277647 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca6aa1df_449e_4aef_98a2_ad6fba49ec8c.slice/crio-215991ec02ddf885b604ddca747e640052ec9148962e71ba9c5f072645219115 WatchSource:0}: Error finding container 215991ec02ddf885b604ddca747e640052ec9148962e71ba9c5f072645219115: Status 404 returned error can't find the container with id 215991ec02ddf885b604ddca747e640052ec9148962e71ba9c5f072645219115 Sep 07 13:38:51.280033 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.280014 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-xqq4n" Sep 07 13:38:51.290627 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.290601 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-64mgb" Sep 07 13:38:51.294068 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:51.294039 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb12d5e4b_b139_4b59_b6ce_3cbc314a11c6.slice/crio-2b13c131a128ce872f77c15eb5f1215b41ba8d2677894a69970ba12290aa4795 WatchSource:0}: Error finding container 2b13c131a128ce872f77c15eb5f1215b41ba8d2677894a69970ba12290aa4795: Status 404 returned error can't find the container with id 2b13c131a128ce872f77c15eb5f1215b41ba8d2677894a69970ba12290aa4795 Sep 07 13:38:51.294466 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:51.294443 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2bbad05_d053_4847_bbb5_0636d50734eb.slice/crio-2b39c8ac50302ed598944de326cd00bee088852dff4d7b233b3711684c77b980 WatchSource:0}: Error finding container 2b39c8ac50302ed598944de326cd00bee088852dff4d7b233b3711684c77b980: Status 404 returned error can't find the container with id 2b39c8ac50302ed598944de326cd00bee088852dff4d7b233b3711684c77b980 Sep 07 13:38:51.300753 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.300599 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-kr8mv" Sep 07 13:38:51.304961 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:51.304820 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb716f9f_409e_4143_a92e_564996107e14.slice/crio-82c67de9ffe933688229fcb7f9dabd4c8d2ff4659d1021b58133fb04e0d865e4 WatchSource:0}: Error finding container 82c67de9ffe933688229fcb7f9dabd4c8d2ff4659d1021b58133fb04e0d865e4: Status 404 returned error can't find the container with id 82c67de9ffe933688229fcb7f9dabd4c8d2ff4659d1021b58133fb04e0d865e4 Sep 07 13:38:51.309013 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.308993 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-rgmdv" Sep 07 13:38:51.315781 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.315439 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-qpqv9" Sep 07 13:38:51.316022 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:51.315978 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0add805e_551b_40c5_8cee_8cc240585411.slice/crio-7c248769afb11e168a44afb1860461965dde15d21c1afb41a4d35611c73db570 WatchSource:0}: Error finding container 7c248769afb11e168a44afb1860461965dde15d21c1afb41a4d35611c73db570: Status 404 returned error can't find the container with id 7c248769afb11e168a44afb1860461965dde15d21c1afb41a4d35611c73db570 Sep 07 13:38:51.323491 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:51.323465 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3f897ca_315e_40ed_bbe7_dad697bf06a1.slice/crio-cbfa25f844f7d9f86f59f46ef12aac2ed4e2029377206bc1869d0bdcba0eb8bb WatchSource:0}: Error finding container cbfa25f844f7d9f86f59f46ef12aac2ed4e2029377206bc1869d0bdcba0eb8bb: Status 404 returned error can't find the container with id cbfa25f844f7d9f86f59f46ef12aac2ed4e2029377206bc1869d0bdcba0eb8bb Sep 07 13:38:51.328084 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:38:51.328063 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95f5dd2f_c6da_468f_9c25_01886f2bbb76.slice/crio-2a4d81ac3616694d1af3f93aa537655d68b0d7e901063cc1ef9afdee704a2c35 WatchSource:0}: Error finding container 2a4d81ac3616694d1af3f93aa537655d68b0d7e901063cc1ef9afdee704a2c35: Status 404 returned error can't find the container with id 2a4d81ac3616694d1af3f93aa537655d68b0d7e901063cc1ef9afdee704a2c35 Sep 07 13:38:51.639119 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.639088 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3dccac71-71b0-49e8-bde3-08fd33578be3-original-pull-secret\") pod \"global-pull-secret-syncer-947k4\" (UID: \"3dccac71-71b0-49e8-bde3-08fd33578be3\") " pod="kube-system/global-pull-secret-syncer-947k4" Sep 07 13:38:51.639325 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.639141 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/51f8ac5a-daf1-48b6-ace7-9b7674b90409-metrics-certs\") pod \"network-metrics-daemon-pwdkf\" (UID: \"51f8ac5a-daf1-48b6-ace7-9b7674b90409\") " pod="openshift-multus/network-metrics-daemon-pwdkf" Sep 07 13:38:51.639325 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.639160 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v8mqk\" (UniqueName: \"kubernetes.io/projected/8fa51077-bb0c-4245-bdd1-b3dfcea493aa-kube-api-access-v8mqk\") pod \"network-check-target-tp5h2\" (UID: \"8fa51077-bb0c-4245-bdd1-b3dfcea493aa\") " pod="openshift-network-diagnostics/network-check-target-tp5h2" Sep 07 13:38:51.639325 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:38:51.639287 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 07 13:38:51.639493 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:38:51.639372 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3dccac71-71b0-49e8-bde3-08fd33578be3-original-pull-secret podName:3dccac71-71b0-49e8-bde3-08fd33578be3 nodeName:}" failed. No retries permitted until 2026-09-07 13:38:52.639349512 +0000 UTC m=+4.133478841 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3dccac71-71b0-49e8-bde3-08fd33578be3-original-pull-secret") pod "global-pull-secret-syncer-947k4" (UID: "3dccac71-71b0-49e8-bde3-08fd33578be3") : object "kube-system"/"original-pull-secret" not registered Sep 07 13:38:51.639493 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:38:51.639287 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 13:38:51.639493 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:38:51.639294 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 07 13:38:51.639493 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:38:51.639431 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51f8ac5a-daf1-48b6-ace7-9b7674b90409-metrics-certs podName:51f8ac5a-daf1-48b6-ace7-9b7674b90409 nodeName:}" failed. No retries permitted until 2026-09-07 13:38:52.639416047 +0000 UTC m=+4.133545364 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/51f8ac5a-daf1-48b6-ace7-9b7674b90409-metrics-certs") pod "network-metrics-daemon-pwdkf" (UID: "51f8ac5a-daf1-48b6-ace7-9b7674b90409") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 13:38:51.639493 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:38:51.639443 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 07 13:38:51.639493 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:38:51.639461 2575 projected.go:196] Error preparing data for projected volume kube-api-access-v8mqk for pod openshift-network-diagnostics/network-check-target-tp5h2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 13:38:51.639723 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:38:51.639517 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8fa51077-bb0c-4245-bdd1-b3dfcea493aa-kube-api-access-v8mqk podName:8fa51077-bb0c-4245-bdd1-b3dfcea493aa nodeName:}" failed. No retries permitted until 2026-09-07 13:38:52.639499745 +0000 UTC m=+4.133629062 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-v8mqk" (UniqueName: "kubernetes.io/projected/8fa51077-bb0c-4245-bdd1-b3dfcea493aa-kube-api-access-v8mqk") pod "network-check-target-tp5h2" (UID: "8fa51077-bb0c-4245-bdd1-b3dfcea493aa") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 13:38:51.995018 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.994897 2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-06 13:33:51 +0000 UTC" deadline="2028-05-08 12:28:49.744497236 +0000 UTC" Sep 07 13:38:51.995018 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:51.994954 2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14614h49m57.749548076s" Sep 07 13:38:52.001321 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:52.001287 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-64mgb" event={"ID":"cb716f9f-409e-4143-a92e-564996107e14","Type":"ContainerStarted","Data":"82c67de9ffe933688229fcb7f9dabd4c8d2ff4659d1021b58133fb04e0d865e4"} Sep 07 13:38:52.002697 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:52.002634 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xqq4n" event={"ID":"b12d5e4b-b139-4b59-b6ce-3cbc314a11c6","Type":"ContainerStarted","Data":"2b13c131a128ce872f77c15eb5f1215b41ba8d2677894a69970ba12290aa4795"} Sep 07 13:38:52.004301 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:52.004271 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-brs25" event={"ID":"d2bbad05-d053-4847-bbb5-0636d50734eb","Type":"ContainerStarted","Data":"2b39c8ac50302ed598944de326cd00bee088852dff4d7b233b3711684c77b980"} Sep 07 13:38:52.005912 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:52.005888 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-m784g" event={"ID":"3e98ba1a-f358-4d0c-8be7-cf3ad7eadd82","Type":"ContainerStarted","Data":"717f2dbca5d894247ee7868ce6bf8f7b320c282dfb1f7dc0bd89d5567daccf1e"} Sep 07 13:38:52.007313 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:52.007285 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-qpqv9" event={"ID":"95f5dd2f-c6da-468f-9c25-01886f2bbb76","Type":"ContainerStarted","Data":"2a4d81ac3616694d1af3f93aa537655d68b0d7e901063cc1ef9afdee704a2c35"} Sep 07 13:38:52.008760 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:52.008698 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-rgmdv" event={"ID":"a3f897ca-315e-40ed-bbe7-dad697bf06a1","Type":"ContainerStarted","Data":"cbfa25f844f7d9f86f59f46ef12aac2ed4e2029377206bc1869d0bdcba0eb8bb"} Sep 07 13:38:52.010141 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:52.010093 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-kr8mv" event={"ID":"0add805e-551b-40c5-8cee-8cc240585411","Type":"ContainerStarted","Data":"7c248769afb11e168a44afb1860461965dde15d21c1afb41a4d35611c73db570"} Sep 07 13:38:52.011529 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:52.011450 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8gjr4" event={"ID":"ca6aa1df-449e-4aef-98a2-ad6fba49ec8c","Type":"ContainerStarted","Data":"215991ec02ddf885b604ddca747e640052ec9148962e71ba9c5f072645219115"} Sep 07 13:38:52.014022 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:52.014000 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-fv7sq" event={"ID":"ad201af3-f88e-4869-a5b7-0726f6282ee2","Type":"ContainerStarted","Data":"738523ae40bb45a6fdeb4b100da1b7beaba0bbc407ad4a54ab23f4e4555aee94"} Sep 07 13:38:52.172273 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:52.172238 2575 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 07 13:38:52.648143 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:52.648097 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3dccac71-71b0-49e8-bde3-08fd33578be3-original-pull-secret\") pod \"global-pull-secret-syncer-947k4\" (UID: \"3dccac71-71b0-49e8-bde3-08fd33578be3\") " pod="kube-system/global-pull-secret-syncer-947k4" Sep 07 13:38:52.648249 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:52.648178 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/51f8ac5a-daf1-48b6-ace7-9b7674b90409-metrics-certs\") pod \"network-metrics-daemon-pwdkf\" (UID: \"51f8ac5a-daf1-48b6-ace7-9b7674b90409\") " pod="openshift-multus/network-metrics-daemon-pwdkf" Sep 07 13:38:52.648249 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:52.648199 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v8mqk\" (UniqueName: \"kubernetes.io/projected/8fa51077-bb0c-4245-bdd1-b3dfcea493aa-kube-api-access-v8mqk\") pod \"network-check-target-tp5h2\" (UID: \"8fa51077-bb0c-4245-bdd1-b3dfcea493aa\") " pod="openshift-network-diagnostics/network-check-target-tp5h2" Sep 07 13:38:52.648350 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:38:52.648331 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 07 13:38:52.648418 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:38:52.648351 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 07 13:38:52.648418 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:38:52.648364 2575 projected.go:196] Error preparing data for projected volume kube-api-access-v8mqk for pod openshift-network-diagnostics/network-check-target-tp5h2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 13:38:52.648418 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:38:52.648414 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8fa51077-bb0c-4245-bdd1-b3dfcea493aa-kube-api-access-v8mqk podName:8fa51077-bb0c-4245-bdd1-b3dfcea493aa nodeName:}" failed. No retries permitted until 2026-09-07 13:38:54.648396598 +0000 UTC m=+6.142525927 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-v8mqk" (UniqueName: "kubernetes.io/projected/8fa51077-bb0c-4245-bdd1-b3dfcea493aa-kube-api-access-v8mqk") pod "network-check-target-tp5h2" (UID: "8fa51077-bb0c-4245-bdd1-b3dfcea493aa") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 13:38:52.648744 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:38:52.648725 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 07 13:38:52.648878 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:38:52.648780 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3dccac71-71b0-49e8-bde3-08fd33578be3-original-pull-secret podName:3dccac71-71b0-49e8-bde3-08fd33578be3 nodeName:}" failed. No retries permitted until 2026-09-07 13:38:54.648758355 +0000 UTC m=+6.142887665 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3dccac71-71b0-49e8-bde3-08fd33578be3-original-pull-secret") pod "global-pull-secret-syncer-947k4" (UID: "3dccac71-71b0-49e8-bde3-08fd33578be3") : object "kube-system"/"original-pull-secret" not registered Sep 07 13:38:52.648878 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:38:52.648835 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 13:38:52.649013 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:38:52.648894 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51f8ac5a-daf1-48b6-ace7-9b7674b90409-metrics-certs podName:51f8ac5a-daf1-48b6-ace7-9b7674b90409 nodeName:}" failed. No retries permitted until 2026-09-07 13:38:54.648881104 +0000 UTC m=+6.143010429 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/51f8ac5a-daf1-48b6-ace7-9b7674b90409-metrics-certs") pod "network-metrics-daemon-pwdkf" (UID: "51f8ac5a-daf1-48b6-ace7-9b7674b90409") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 13:38:52.993657 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:52.991840 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-947k4" Sep 07 13:38:52.993657 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:38:52.992028 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-947k4" podUID="3dccac71-71b0-49e8-bde3-08fd33578be3" Sep 07 13:38:52.993657 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:52.992449 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tp5h2" Sep 07 13:38:52.993657 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:38:52.992547 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tp5h2" podUID="8fa51077-bb0c-4245-bdd1-b3dfcea493aa" Sep 07 13:38:52.993657 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:52.992617 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pwdkf" Sep 07 13:38:52.993657 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:38:52.992705 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pwdkf" podUID="51f8ac5a-daf1-48b6-ace7-9b7674b90409" Sep 07 13:38:53.001953 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:52.995809 2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-06 13:33:51 +0000 UTC" deadline="2028-06-01 07:19:58.584640098 +0000 UTC" Sep 07 13:38:53.001953 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:52.995841 2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15185h41m5.588802626s" Sep 07 13:38:53.024090 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:53.023386 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-124.ec2.internal" event={"ID":"e0e557d20b3a4c23ec8e66206ce9e08a","Type":"ContainerStarted","Data":"fe4634c3c5aa13a7997f8911b9e001e21c072d269ee574a1f3d6e5e8b101c851"} Sep 07 13:38:54.033470 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:54.033431 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-124.ec2.internal" event={"ID":"0242d5bff45ceb13d06fdf0981d68019","Type":"ContainerStarted","Data":"bc228c3643ce20e18e267263e84dfd8514795d19b19fdbb72fdf2e319fe7f685"} Sep 07 13:38:54.056434 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:54.056363 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-124.ec2.internal" podStartSLOduration=3.056340856 podStartE2EDuration="3.056340856s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 13:38:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:38:53.047015703 +0000 UTC m=+4.541145038" watchObservedRunningTime="2026-09-07 13:38:54.056340856 +0000 UTC m=+5.550470191" Sep 07 13:38:54.670734 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:54.669597 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/51f8ac5a-daf1-48b6-ace7-9b7674b90409-metrics-certs\") pod \"network-metrics-daemon-pwdkf\" (UID: \"51f8ac5a-daf1-48b6-ace7-9b7674b90409\") " pod="openshift-multus/network-metrics-daemon-pwdkf" Sep 07 13:38:54.670734 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:54.669657 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v8mqk\" (UniqueName: \"kubernetes.io/projected/8fa51077-bb0c-4245-bdd1-b3dfcea493aa-kube-api-access-v8mqk\") pod \"network-check-target-tp5h2\" (UID: \"8fa51077-bb0c-4245-bdd1-b3dfcea493aa\") " pod="openshift-network-diagnostics/network-check-target-tp5h2" Sep 07 13:38:54.670734 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:54.669716 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3dccac71-71b0-49e8-bde3-08fd33578be3-original-pull-secret\") pod \"global-pull-secret-syncer-947k4\" (UID: \"3dccac71-71b0-49e8-bde3-08fd33578be3\") " pod="kube-system/global-pull-secret-syncer-947k4" Sep 07 13:38:54.670734 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:38:54.669873 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 07 13:38:54.670734 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:38:54.669935 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3dccac71-71b0-49e8-bde3-08fd33578be3-original-pull-secret podName:3dccac71-71b0-49e8-bde3-08fd33578be3 nodeName:}" failed. No retries permitted until 2026-09-07 13:38:58.669914014 +0000 UTC m=+10.164043327 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3dccac71-71b0-49e8-bde3-08fd33578be3-original-pull-secret") pod "global-pull-secret-syncer-947k4" (UID: "3dccac71-71b0-49e8-bde3-08fd33578be3") : object "kube-system"/"original-pull-secret" not registered Sep 07 13:38:54.670734 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:38:54.670438 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 13:38:54.670734 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:38:54.670493 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51f8ac5a-daf1-48b6-ace7-9b7674b90409-metrics-certs podName:51f8ac5a-daf1-48b6-ace7-9b7674b90409 nodeName:}" failed. No retries permitted until 2026-09-07 13:38:58.670477032 +0000 UTC m=+10.164606353 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/51f8ac5a-daf1-48b6-ace7-9b7674b90409-metrics-certs") pod "network-metrics-daemon-pwdkf" (UID: "51f8ac5a-daf1-48b6-ace7-9b7674b90409") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 13:38:54.670734 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:38:54.670577 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 07 13:38:54.670734 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:38:54.670595 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 07 13:38:54.670734 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:38:54.670608 2575 projected.go:196] Error preparing data for projected volume kube-api-access-v8mqk for pod openshift-network-diagnostics/network-check-target-tp5h2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 13:38:54.670734 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:38:54.670662 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8fa51077-bb0c-4245-bdd1-b3dfcea493aa-kube-api-access-v8mqk podName:8fa51077-bb0c-4245-bdd1-b3dfcea493aa nodeName:}" failed. No retries permitted until 2026-09-07 13:38:58.670632181 +0000 UTC m=+10.164761499 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-v8mqk" (UniqueName: "kubernetes.io/projected/8fa51077-bb0c-4245-bdd1-b3dfcea493aa-kube-api-access-v8mqk") pod "network-check-target-tp5h2" (UID: "8fa51077-bb0c-4245-bdd1-b3dfcea493aa") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 13:38:54.990108 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:54.989983 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-947k4" Sep 07 13:38:54.990308 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:38:54.990119 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-947k4" podUID="3dccac71-71b0-49e8-bde3-08fd33578be3" Sep 07 13:38:54.990308 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:54.989990 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tp5h2" Sep 07 13:38:54.990308 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:54.990132 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pwdkf" Sep 07 13:38:54.990308 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:38:54.990241 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tp5h2" podUID="8fa51077-bb0c-4245-bdd1-b3dfcea493aa" Sep 07 13:38:54.990562 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:38:54.990340 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pwdkf" podUID="51f8ac5a-daf1-48b6-ace7-9b7674b90409" Sep 07 13:38:56.989096 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:56.988842 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tp5h2" Sep 07 13:38:56.989556 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:38:56.989211 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tp5h2" podUID="8fa51077-bb0c-4245-bdd1-b3dfcea493aa" Sep 07 13:38:56.989641 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:56.989618 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pwdkf" Sep 07 13:38:56.989759 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:38:56.989734 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pwdkf" podUID="51f8ac5a-daf1-48b6-ace7-9b7674b90409" Sep 07 13:38:56.989844 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:56.989789 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-947k4" Sep 07 13:38:56.989924 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:38:56.989887 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-947k4" podUID="3dccac71-71b0-49e8-bde3-08fd33578be3" Sep 07 13:38:57.047052 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:57.047015 2575 generic.go:356] "Generic (PLEG): container finished" podID="0242d5bff45ceb13d06fdf0981d68019" containerID="bc228c3643ce20e18e267263e84dfd8514795d19b19fdbb72fdf2e319fe7f685" exitCode=0 Sep 07 13:38:57.047234 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:57.047077 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-124.ec2.internal" event={"ID":"0242d5bff45ceb13d06fdf0981d68019","Type":"ContainerDied","Data":"bc228c3643ce20e18e267263e84dfd8514795d19b19fdbb72fdf2e319fe7f685"} Sep 07 13:38:58.709929 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:58.709883 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/51f8ac5a-daf1-48b6-ace7-9b7674b90409-metrics-certs\") pod \"network-metrics-daemon-pwdkf\" (UID: \"51f8ac5a-daf1-48b6-ace7-9b7674b90409\") " pod="openshift-multus/network-metrics-daemon-pwdkf" Sep 07 13:38:58.710404 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:58.709982 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v8mqk\" (UniqueName: \"kubernetes.io/projected/8fa51077-bb0c-4245-bdd1-b3dfcea493aa-kube-api-access-v8mqk\") pod \"network-check-target-tp5h2\" (UID: \"8fa51077-bb0c-4245-bdd1-b3dfcea493aa\") " pod="openshift-network-diagnostics/network-check-target-tp5h2" Sep 07 13:38:58.710404 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:58.710119 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3dccac71-71b0-49e8-bde3-08fd33578be3-original-pull-secret\") pod \"global-pull-secret-syncer-947k4\" (UID: \"3dccac71-71b0-49e8-bde3-08fd33578be3\") " pod="kube-system/global-pull-secret-syncer-947k4" Sep 07 13:38:58.710404 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:38:58.710264 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 07 13:38:58.710404 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:38:58.710326 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3dccac71-71b0-49e8-bde3-08fd33578be3-original-pull-secret podName:3dccac71-71b0-49e8-bde3-08fd33578be3 nodeName:}" failed. No retries permitted until 2026-09-07 13:39:06.710305179 +0000 UTC m=+18.204434493 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3dccac71-71b0-49e8-bde3-08fd33578be3-original-pull-secret") pod "global-pull-secret-syncer-947k4" (UID: "3dccac71-71b0-49e8-bde3-08fd33578be3") : object "kube-system"/"original-pull-secret" not registered Sep 07 13:38:58.710987 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:38:58.710711 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 13:38:58.710987 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:38:58.710774 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51f8ac5a-daf1-48b6-ace7-9b7674b90409-metrics-certs podName:51f8ac5a-daf1-48b6-ace7-9b7674b90409 nodeName:}" failed. No retries permitted until 2026-09-07 13:39:06.710754952 +0000 UTC m=+18.204884266 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/51f8ac5a-daf1-48b6-ace7-9b7674b90409-metrics-certs") pod "network-metrics-daemon-pwdkf" (UID: "51f8ac5a-daf1-48b6-ace7-9b7674b90409") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 13:38:58.710987 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:38:58.710881 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 07 13:38:58.710987 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:38:58.710900 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 07 13:38:58.710987 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:38:58.710914 2575 projected.go:196] Error preparing data for projected volume kube-api-access-v8mqk for pod openshift-network-diagnostics/network-check-target-tp5h2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 13:38:58.710987 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:38:58.710953 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8fa51077-bb0c-4245-bdd1-b3dfcea493aa-kube-api-access-v8mqk podName:8fa51077-bb0c-4245-bdd1-b3dfcea493aa nodeName:}" failed. No retries permitted until 2026-09-07 13:39:06.710940545 +0000 UTC m=+18.205069884 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-v8mqk" (UniqueName: "kubernetes.io/projected/8fa51077-bb0c-4245-bdd1-b3dfcea493aa-kube-api-access-v8mqk") pod "network-check-target-tp5h2" (UID: "8fa51077-bb0c-4245-bdd1-b3dfcea493aa") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 13:38:58.997233 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:58.996698 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-947k4" Sep 07 13:38:58.997233 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:38:58.996795 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-947k4" podUID="3dccac71-71b0-49e8-bde3-08fd33578be3" Sep 07 13:38:58.997233 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:58.996919 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tp5h2" Sep 07 13:38:58.997233 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:38:58.997039 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tp5h2" podUID="8fa51077-bb0c-4245-bdd1-b3dfcea493aa" Sep 07 13:38:58.997233 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:38:58.997114 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pwdkf" Sep 07 13:38:58.997233 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:38:58.997204 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pwdkf" podUID="51f8ac5a-daf1-48b6-ace7-9b7674b90409" Sep 07 13:39:00.991398 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:00.991365 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pwdkf" Sep 07 13:39:00.991753 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:39:00.991506 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pwdkf" podUID="51f8ac5a-daf1-48b6-ace7-9b7674b90409" Sep 07 13:39:00.991910 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:00.991893 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-947k4" Sep 07 13:39:00.992002 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:39:00.991985 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-947k4" podUID="3dccac71-71b0-49e8-bde3-08fd33578be3" Sep 07 13:39:00.992041 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:00.992030 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tp5h2" Sep 07 13:39:00.992118 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:39:00.992103 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tp5h2" podUID="8fa51077-bb0c-4245-bdd1-b3dfcea493aa" Sep 07 13:39:02.989060 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:02.989023 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tp5h2" Sep 07 13:39:02.989504 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:02.989020 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-947k4" Sep 07 13:39:02.989504 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:39:02.989152 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tp5h2" podUID="8fa51077-bb0c-4245-bdd1-b3dfcea493aa" Sep 07 13:39:02.989504 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:39:02.989240 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-947k4" podUID="3dccac71-71b0-49e8-bde3-08fd33578be3" Sep 07 13:39:02.989504 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:02.989038 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pwdkf" Sep 07 13:39:02.989504 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:39:02.989345 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pwdkf" podUID="51f8ac5a-daf1-48b6-ace7-9b7674b90409" Sep 07 13:39:04.988537 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:04.988506 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-947k4" Sep 07 13:39:04.989025 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:04.988545 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pwdkf" Sep 07 13:39:04.989025 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:04.988505 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tp5h2" Sep 07 13:39:04.989025 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:39:04.988630 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-947k4" podUID="3dccac71-71b0-49e8-bde3-08fd33578be3" Sep 07 13:39:04.989025 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:39:04.988703 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tp5h2" podUID="8fa51077-bb0c-4245-bdd1-b3dfcea493aa" Sep 07 13:39:04.989025 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:39:04.988818 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pwdkf" podUID="51f8ac5a-daf1-48b6-ace7-9b7674b90409" Sep 07 13:39:06.772219 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:06.772180 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3dccac71-71b0-49e8-bde3-08fd33578be3-original-pull-secret\") pod \"global-pull-secret-syncer-947k4\" (UID: \"3dccac71-71b0-49e8-bde3-08fd33578be3\") " pod="kube-system/global-pull-secret-syncer-947k4" Sep 07 13:39:06.772712 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:06.772241 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/51f8ac5a-daf1-48b6-ace7-9b7674b90409-metrics-certs\") pod \"network-metrics-daemon-pwdkf\" (UID: \"51f8ac5a-daf1-48b6-ace7-9b7674b90409\") " pod="openshift-multus/network-metrics-daemon-pwdkf" Sep 07 13:39:06.772712 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:39:06.772354 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 07 13:39:06.772712 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:06.772370 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v8mqk\" (UniqueName: \"kubernetes.io/projected/8fa51077-bb0c-4245-bdd1-b3dfcea493aa-kube-api-access-v8mqk\") pod \"network-check-target-tp5h2\" (UID: \"8fa51077-bb0c-4245-bdd1-b3dfcea493aa\") " pod="openshift-network-diagnostics/network-check-target-tp5h2" Sep 07 13:39:06.772712 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:39:06.772424 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3dccac71-71b0-49e8-bde3-08fd33578be3-original-pull-secret podName:3dccac71-71b0-49e8-bde3-08fd33578be3 nodeName:}" failed. No retries permitted until 2026-09-07 13:39:22.772402296 +0000 UTC m=+34.266531624 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3dccac71-71b0-49e8-bde3-08fd33578be3-original-pull-secret") pod "global-pull-secret-syncer-947k4" (UID: "3dccac71-71b0-49e8-bde3-08fd33578be3") : object "kube-system"/"original-pull-secret" not registered Sep 07 13:39:06.772712 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:39:06.772359 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 13:39:06.772712 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:39:06.772496 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51f8ac5a-daf1-48b6-ace7-9b7674b90409-metrics-certs podName:51f8ac5a-daf1-48b6-ace7-9b7674b90409 nodeName:}" failed. No retries permitted until 2026-09-07 13:39:22.772473635 +0000 UTC m=+34.266602958 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/51f8ac5a-daf1-48b6-ace7-9b7674b90409-metrics-certs") pod "network-metrics-daemon-pwdkf" (UID: "51f8ac5a-daf1-48b6-ace7-9b7674b90409") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 13:39:06.772712 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:39:06.772535 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 07 13:39:06.772712 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:39:06.772556 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 07 13:39:06.772712 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:39:06.772572 2575 projected.go:196] Error preparing data for projected volume kube-api-access-v8mqk for pod openshift-network-diagnostics/network-check-target-tp5h2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 13:39:06.772712 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:39:06.772629 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8fa51077-bb0c-4245-bdd1-b3dfcea493aa-kube-api-access-v8mqk podName:8fa51077-bb0c-4245-bdd1-b3dfcea493aa nodeName:}" failed. No retries permitted until 2026-09-07 13:39:22.772612548 +0000 UTC m=+34.266741862 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-v8mqk" (UniqueName: "kubernetes.io/projected/8fa51077-bb0c-4245-bdd1-b3dfcea493aa-kube-api-access-v8mqk") pod "network-check-target-tp5h2" (UID: "8fa51077-bb0c-4245-bdd1-b3dfcea493aa") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 13:39:06.988645 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:06.988606 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tp5h2" Sep 07 13:39:06.988847 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:06.988606 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-947k4" Sep 07 13:39:06.988847 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:39:06.988749 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tp5h2" podUID="8fa51077-bb0c-4245-bdd1-b3dfcea493aa" Sep 07 13:39:06.988847 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:06.988611 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pwdkf" Sep 07 13:39:06.989002 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:39:06.988843 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-947k4" podUID="3dccac71-71b0-49e8-bde3-08fd33578be3" Sep 07 13:39:06.989002 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:39:06.988919 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pwdkf" podUID="51f8ac5a-daf1-48b6-ace7-9b7674b90409" Sep 07 13:39:08.989767 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:08.989736 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-947k4" Sep 07 13:39:08.990247 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:08.989838 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pwdkf" Sep 07 13:39:08.990247 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:39:08.989901 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-947k4" podUID="3dccac71-71b0-49e8-bde3-08fd33578be3" Sep 07 13:39:08.990247 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:39:08.989943 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pwdkf" podUID="51f8ac5a-daf1-48b6-ace7-9b7674b90409" Sep 07 13:39:08.990247 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:08.989991 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tp5h2" Sep 07 13:39:08.990247 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:39:08.990058 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tp5h2" podUID="8fa51077-bb0c-4245-bdd1-b3dfcea493aa" Sep 07 13:39:10.076372 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:10.076009 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-fv7sq" event={"ID":"ad201af3-f88e-4869-a5b7-0726f6282ee2","Type":"ContainerStarted","Data":"3ee1f266c4f34768c07b9f5ded44e064f57f5b2ec9f6eb68f31c8344f7164785"} Sep 07 13:39:10.079952 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:10.079552 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xqq4n" event={"ID":"b12d5e4b-b139-4b59-b6ce-3cbc314a11c6","Type":"ContainerStarted","Data":"9799d4dbbff52d89ad9a13a00eebb08f40a193180b6c657756c0c9ffc884094e"} Sep 07 13:39:10.083338 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:10.083302 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-m784g" event={"ID":"3e98ba1a-f358-4d0c-8be7-cf3ad7eadd82","Type":"ContainerStarted","Data":"09de87326556e5e1973f413b9dbd03bd53a3e1f8ce7d26d1b7a065ae53a6e8fe"} Sep 07 13:39:10.089247 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:10.088758 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-124.ec2.internal" event={"ID":"0242d5bff45ceb13d06fdf0981d68019","Type":"ContainerStarted","Data":"bd7aa003e16fa654a23dcaece5dd2b4a48f9fc32eb9d02c13da40ffea6977b28"} Sep 07 13:39:10.092523 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:10.092203 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-qpqv9" event={"ID":"95f5dd2f-c6da-468f-9c25-01886f2bbb76","Type":"ContainerStarted","Data":"6cd5178560ec7598d409923db062477c66c1d6f6d4470a58ded13f4c2c0fba53"} Sep 07 13:39:10.097699 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:10.097388 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8gjr4" event={"ID":"ca6aa1df-449e-4aef-98a2-ad6fba49ec8c","Type":"ContainerStarted","Data":"b3bfcce6202eaa68851c9bcbb3d9a9eb38fd1a2e23b7070bef3b36bd426967cb"} Sep 07 13:39:10.119604 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:10.118679 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-fv7sq" podStartSLOduration=2.610005647 podStartE2EDuration="21.118660728s" totalImagesPullingTime="18.508655081s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 13:38:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:39:10.099084406 +0000 UTC m=+21.593213758" watchObservedRunningTime="2026-09-07 13:39:10.118660728 +0000 UTC m=+21.612790070" Sep 07 13:39:10.119604 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:10.118997 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-kr8mv" podStartSLOduration=1.615268215 podStartE2EDuration="20.118985173s" totalImagesPullingTime="18.503716958s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 13:38:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:39:10.117765695 +0000 UTC m=+21.611895028" watchObservedRunningTime="2026-09-07 13:39:10.118985173 +0000 UTC m=+21.613114518" Sep 07 13:39:10.138970 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:10.138924 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-qpqv9" podStartSLOduration=1.642870507 podStartE2EDuration="20.13890939s" totalImagesPullingTime="18.496038883s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 13:38:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:39:10.138335531 +0000 UTC m=+21.632464861" watchObservedRunningTime="2026-09-07 13:39:10.13890939 +0000 UTC m=+21.633038720" Sep 07 13:39:10.157340 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:10.157207 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-124.ec2.internal" podStartSLOduration=19.157188222 podStartE2EDuration="19.157188222s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 13:38:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:39:10.156928026 +0000 UTC m=+21.651057361" watchObservedRunningTime="2026-09-07 13:39:10.157188222 +0000 UTC m=+21.651317566" Sep 07 13:39:10.186957 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:10.186907 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-m784g" podStartSLOduration=2.9593857789999998 podStartE2EDuration="21.186892149s" totalImagesPullingTime="18.22750637s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:38:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:39:10.186653044 +0000 UTC m=+21.680782374" watchObservedRunningTime="2026-09-07 13:39:10.186892149 +0000 UTC m=+21.681021477" Sep 07 13:39:10.322306 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:10.322226 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-m784g" Sep 07 13:39:10.989321 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:10.989286 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tp5h2" Sep 07 13:39:10.989542 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:10.989304 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-947k4" Sep 07 13:39:10.989542 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:39:10.989394 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tp5h2" podUID="8fa51077-bb0c-4245-bdd1-b3dfcea493aa" Sep 07 13:39:10.989542 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:39:10.989486 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-947k4" podUID="3dccac71-71b0-49e8-bde3-08fd33578be3" Sep 07 13:39:10.989542 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:10.989377 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pwdkf" Sep 07 13:39:10.989760 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:39:10.989603 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pwdkf" podUID="51f8ac5a-daf1-48b6-ace7-9b7674b90409" Sep 07 13:39:11.101853 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:11.101758 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-rgmdv" event={"ID":"a3f897ca-315e-40ed-bbe7-dad697bf06a1","Type":"ContainerStarted","Data":"4c4ee6f2e2d451bd941974c364b720dc4a62003efd4ddc6b152e77e1ddeeb185"} Sep 07 13:39:11.103734 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:11.103693 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-kr8mv" event={"ID":"0add805e-551b-40c5-8cee-8cc240585411","Type":"ContainerStarted","Data":"c01b3a1e97f0f97ce1f7af1056b013311a0d6118f05716b8ca67713eaabc7edb"} Sep 07 13:39:11.107423 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:11.107400 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8gjr4" event={"ID":"ca6aa1df-449e-4aef-98a2-ad6fba49ec8c","Type":"ContainerStarted","Data":"fb6bd2bccf786f1d53ba35cadfe89cac17d5c6a77aa469f3884f572d4f54d1ec"} Sep 07 13:39:11.107539 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:11.107475 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8gjr4" event={"ID":"ca6aa1df-449e-4aef-98a2-ad6fba49ec8c","Type":"ContainerStarted","Data":"b5d4e769e370c887aabd2b78af14daa1419732f2263f764a7d34163eae569049"} Sep 07 13:39:11.107539 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:11.107527 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8gjr4" event={"ID":"ca6aa1df-449e-4aef-98a2-ad6fba49ec8c","Type":"ContainerStarted","Data":"aa0a2a8d9f556bb2d4c1cc19db0c539dc33d36a711467d2fe70b96459c051de7"} Sep 07 13:39:11.107618 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:11.107572 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8gjr4" event={"ID":"ca6aa1df-449e-4aef-98a2-ad6fba49ec8c","Type":"ContainerStarted","Data":"723f8e3396e68b0873c8fdb38df45634fe212810f4cf58324b7b0ab13a95e336"} Sep 07 13:39:11.107656 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:11.107620 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8gjr4" event={"ID":"ca6aa1df-449e-4aef-98a2-ad6fba49ec8c","Type":"ContainerStarted","Data":"b9f65b005df49d54e7f2954ad106706135ce7b77d2735c72513184c271217bd7"} Sep 07 13:39:11.109292 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:11.109216 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-64mgb" event={"ID":"cb716f9f-409e-4143-a92e-564996107e14","Type":"ContainerStarted","Data":"31530686c6fc646bd173a6fb309c7f23f774cc31a1f8be9f4d3e999e1992619a"} Sep 07 13:39:11.110910 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:11.110884 2575 generic.go:356] "Generic (PLEG): container finished" podID="b12d5e4b-b139-4b59-b6ce-3cbc314a11c6" containerID="9799d4dbbff52d89ad9a13a00eebb08f40a193180b6c657756c0c9ffc884094e" exitCode=0 Sep 07 13:39:11.111027 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:11.110988 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xqq4n" event={"ID":"b12d5e4b-b139-4b59-b6ce-3cbc314a11c6","Type":"ContainerDied","Data":"9799d4dbbff52d89ad9a13a00eebb08f40a193180b6c657756c0c9ffc884094e"} Sep 07 13:39:11.126636 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:11.126599 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-rgmdv" podStartSLOduration=2.5704009599999997 podStartE2EDuration="21.126586328s" totalImagesPullingTime="18.556185368s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 13:38:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:39:11.126089766 +0000 UTC m=+22.620219097" watchObservedRunningTime="2026-09-07 13:39:11.126586328 +0000 UTC m=+22.620715659" Sep 07 13:39:11.286628 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:11.286468 2575 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 07 13:39:12.002711 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:12.002593 2575 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-07T13:39:11.286626751Z","UUID":"47f5d1fc-7be0-42be-8065-3b5051e9f8c8","Handler":null,"Name":"","Endpoint":""} Sep 07 13:39:12.004044 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:12.004025 2575 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 07 13:39:12.004131 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:12.004055 2575 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 07 13:39:12.115176 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:12.115142 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-64mgb" event={"ID":"cb716f9f-409e-4143-a92e-564996107e14","Type":"ContainerStarted","Data":"17c49c824627e8c6bf637fd07b3ae8a71d451aef708ee1375a3f3744a198fc38"} Sep 07 13:39:12.116858 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:12.116796 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-brs25" event={"ID":"d2bbad05-d053-4847-bbb5-0636d50734eb","Type":"ContainerStarted","Data":"44f559be6ba4f1bfa3bae2961f670a140f17d54e8af73c9307890aa805283f5b"} Sep 07 13:39:12.139030 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:12.138985 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-brs25" podStartSLOduration=4.66213628 podStartE2EDuration="23.138972197s" totalImagesPullingTime="18.476835917s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 13:38:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:39:12.13888516 +0000 UTC m=+23.633014491" watchObservedRunningTime="2026-09-07 13:39:12.138972197 +0000 UTC m=+23.633101528" Sep 07 13:39:12.988896 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:12.988773 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tp5h2" Sep 07 13:39:12.988896 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:12.988804 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pwdkf" Sep 07 13:39:12.988896 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:12.988835 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-947k4" Sep 07 13:39:12.989144 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:39:12.988929 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tp5h2" podUID="8fa51077-bb0c-4245-bdd1-b3dfcea493aa" Sep 07 13:39:12.989739 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:39:12.989696 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pwdkf" podUID="51f8ac5a-daf1-48b6-ace7-9b7674b90409" Sep 07 13:39:12.990000 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:39:12.989982 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-947k4" podUID="3dccac71-71b0-49e8-bde3-08fd33578be3" Sep 07 13:39:13.122824 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:13.122769 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8gjr4" event={"ID":"ca6aa1df-449e-4aef-98a2-ad6fba49ec8c","Type":"ContainerStarted","Data":"7a15022938e86a96e7976a97fb06f423871fde9505b55f541e1b6e1db520b33c"} Sep 07 13:39:13.126105 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:13.126072 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-64mgb" event={"ID":"cb716f9f-409e-4143-a92e-564996107e14","Type":"ContainerStarted","Data":"74b87329dba772a260d24e2dc4c102c94da6e8576d88ad03c4447092866d41a3"} Sep 07 13:39:13.316048 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:13.315980 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-m784g" Sep 07 13:39:13.316533 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:13.316516 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-m784g" Sep 07 13:39:13.341186 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:13.341151 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-64mgb" podStartSLOduration=2.505984001 podStartE2EDuration="23.341136578s" totalImagesPullingTime="20.835152577s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 13:38:50 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:39:13.153253992 +0000 UTC m=+24.647383322" watchObservedRunningTime="2026-09-07 13:39:13.341136578 +0000 UTC m=+24.835265908" Sep 07 13:39:14.128425 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:14.128398 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-m784g" Sep 07 13:39:14.989148 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:14.989057 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tp5h2" Sep 07 13:39:14.989307 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:39:14.989174 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tp5h2" podUID="8fa51077-bb0c-4245-bdd1-b3dfcea493aa" Sep 07 13:39:14.989307 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:14.989066 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pwdkf" Sep 07 13:39:14.989307 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:39:14.989287 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pwdkf" podUID="51f8ac5a-daf1-48b6-ace7-9b7674b90409" Sep 07 13:39:14.989307 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:14.989058 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-947k4" Sep 07 13:39:14.989515 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:39:14.989354 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-947k4" podUID="3dccac71-71b0-49e8-bde3-08fd33578be3" Sep 07 13:39:16.989526 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:16.989282 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pwdkf" Sep 07 13:39:16.990255 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:39:16.989692 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pwdkf" podUID="51f8ac5a-daf1-48b6-ace7-9b7674b90409" Sep 07 13:39:16.990255 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:16.989327 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-947k4" Sep 07 13:39:16.990255 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:39:16.989852 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-947k4" podUID="3dccac71-71b0-49e8-bde3-08fd33578be3" Sep 07 13:39:16.990255 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:16.989293 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tp5h2" Sep 07 13:39:16.990255 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:39:16.989974 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tp5h2" podUID="8fa51077-bb0c-4245-bdd1-b3dfcea493aa" Sep 07 13:39:17.138477 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:17.138393 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8gjr4" event={"ID":"ca6aa1df-449e-4aef-98a2-ad6fba49ec8c","Type":"ContainerStarted","Data":"1d34265c04f0bc4c2450568d630f6f4a0f925852a494fb33b40cecd3ef061f47"} Sep 07 13:39:17.138667 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:17.138646 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8gjr4" Sep 07 13:39:17.138743 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:17.138709 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8gjr4" Sep 07 13:39:17.140228 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:17.140199 2575 generic.go:356] "Generic (PLEG): container finished" podID="b12d5e4b-b139-4b59-b6ce-3cbc314a11c6" containerID="ebe631c2fa918836ce23e344aa78ea9144dc4141932e267b7357e77060caf656" exitCode=0 Sep 07 13:39:17.140334 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:17.140246 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xqq4n" event={"ID":"b12d5e4b-b139-4b59-b6ce-3cbc314a11c6","Type":"ContainerDied","Data":"ebe631c2fa918836ce23e344aa78ea9144dc4141932e267b7357e77060caf656"} Sep 07 13:39:17.155377 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:17.155358 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8gjr4" Sep 07 13:39:17.223742 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:17.223695 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-8gjr4" podStartSLOduration=9.656238375000001 podStartE2EDuration="28.22367737s" totalImagesPullingTime="18.567438995s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 13:38:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:39:17.181373735 +0000 UTC m=+28.675503066" watchObservedRunningTime="2026-09-07 13:39:17.22367737 +0000 UTC m=+28.717806728" Sep 07 13:39:18.142504 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:18.142474 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8gjr4" Sep 07 13:39:18.156718 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:18.156695 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8gjr4" Sep 07 13:39:18.247522 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:18.247280 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-tp5h2"] Sep 07 13:39:18.247626 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:18.247615 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tp5h2" Sep 07 13:39:18.247738 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:39:18.247719 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tp5h2" podUID="8fa51077-bb0c-4245-bdd1-b3dfcea493aa" Sep 07 13:39:18.250048 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:18.250019 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-pwdkf"] Sep 07 13:39:18.250141 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:18.250105 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pwdkf" Sep 07 13:39:18.250208 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:39:18.250186 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pwdkf" podUID="51f8ac5a-daf1-48b6-ace7-9b7674b90409" Sep 07 13:39:18.259021 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:18.258988 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-947k4"] Sep 07 13:39:18.259127 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:18.259086 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-947k4" Sep 07 13:39:18.259216 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:39:18.259195 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-947k4" podUID="3dccac71-71b0-49e8-bde3-08fd33578be3" Sep 07 13:39:19.146537 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:19.146461 2575 generic.go:356] "Generic (PLEG): container finished" podID="b12d5e4b-b139-4b59-b6ce-3cbc314a11c6" containerID="c9405bd8a0d2ae6338d9427c20e208292c1079cfec42cc09e3ff90035c9360c1" exitCode=0 Sep 07 13:39:19.146898 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:19.146547 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xqq4n" event={"ID":"b12d5e4b-b139-4b59-b6ce-3cbc314a11c6","Type":"ContainerDied","Data":"c9405bd8a0d2ae6338d9427c20e208292c1079cfec42cc09e3ff90035c9360c1"} Sep 07 13:39:19.988936 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:19.988868 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pwdkf" Sep 07 13:39:19.988936 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:19.988884 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-947k4" Sep 07 13:39:19.988936 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:19.988886 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tp5h2" Sep 07 13:39:19.989205 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:39:19.988975 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pwdkf" podUID="51f8ac5a-daf1-48b6-ace7-9b7674b90409" Sep 07 13:39:19.989205 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:39:19.989030 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-947k4" podUID="3dccac71-71b0-49e8-bde3-08fd33578be3" Sep 07 13:39:19.989205 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:39:19.989097 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tp5h2" podUID="8fa51077-bb0c-4245-bdd1-b3dfcea493aa" Sep 07 13:39:21.153159 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:21.153127 2575 generic.go:356] "Generic (PLEG): container finished" podID="b12d5e4b-b139-4b59-b6ce-3cbc314a11c6" containerID="f4d2d125360c02152444f8d88bf78f9b72cbca48cbf16d571a25109cb04a565f" exitCode=0 Sep 07 13:39:21.153514 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:21.153177 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xqq4n" event={"ID":"b12d5e4b-b139-4b59-b6ce-3cbc314a11c6","Type":"ContainerDied","Data":"f4d2d125360c02152444f8d88bf78f9b72cbca48cbf16d571a25109cb04a565f"} Sep 07 13:39:21.988322 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:21.988288 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-947k4" Sep 07 13:39:21.988497 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:21.988412 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tp5h2" Sep 07 13:39:21.988497 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:21.988421 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pwdkf" Sep 07 13:39:21.988497 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:39:21.988415 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-947k4" podUID="3dccac71-71b0-49e8-bde3-08fd33578be3" Sep 07 13:39:21.988497 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:39:21.988488 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tp5h2" podUID="8fa51077-bb0c-4245-bdd1-b3dfcea493aa" Sep 07 13:39:21.988630 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:39:21.988563 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pwdkf" podUID="51f8ac5a-daf1-48b6-ace7-9b7674b90409" Sep 07 13:39:22.782569 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:22.782487 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/51f8ac5a-daf1-48b6-ace7-9b7674b90409-metrics-certs\") pod \"network-metrics-daemon-pwdkf\" (UID: \"51f8ac5a-daf1-48b6-ace7-9b7674b90409\") " pod="openshift-multus/network-metrics-daemon-pwdkf" Sep 07 13:39:22.782569 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:22.782547 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v8mqk\" (UniqueName: \"kubernetes.io/projected/8fa51077-bb0c-4245-bdd1-b3dfcea493aa-kube-api-access-v8mqk\") pod \"network-check-target-tp5h2\" (UID: \"8fa51077-bb0c-4245-bdd1-b3dfcea493aa\") " pod="openshift-network-diagnostics/network-check-target-tp5h2" Sep 07 13:39:22.783031 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:22.782603 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3dccac71-71b0-49e8-bde3-08fd33578be3-original-pull-secret\") pod \"global-pull-secret-syncer-947k4\" (UID: \"3dccac71-71b0-49e8-bde3-08fd33578be3\") " pod="kube-system/global-pull-secret-syncer-947k4" Sep 07 13:39:22.783031 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:39:22.782609 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 13:39:22.783031 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:39:22.782674 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51f8ac5a-daf1-48b6-ace7-9b7674b90409-metrics-certs podName:51f8ac5a-daf1-48b6-ace7-9b7674b90409 nodeName:}" failed. No retries permitted until 2026-09-07 13:39:54.782656413 +0000 UTC m=+66.276785726 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/51f8ac5a-daf1-48b6-ace7-9b7674b90409-metrics-certs") pod "network-metrics-daemon-pwdkf" (UID: "51f8ac5a-daf1-48b6-ace7-9b7674b90409") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 13:39:22.783031 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:39:22.782687 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 07 13:39:22.783031 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:39:22.782722 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3dccac71-71b0-49e8-bde3-08fd33578be3-original-pull-secret podName:3dccac71-71b0-49e8-bde3-08fd33578be3 nodeName:}" failed. No retries permitted until 2026-09-07 13:39:54.782711723 +0000 UTC m=+66.276841033 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3dccac71-71b0-49e8-bde3-08fd33578be3-original-pull-secret") pod "global-pull-secret-syncer-947k4" (UID: "3dccac71-71b0-49e8-bde3-08fd33578be3") : object "kube-system"/"original-pull-secret" not registered Sep 07 13:39:22.783031 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:39:22.782733 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 07 13:39:22.783031 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:39:22.782761 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 07 13:39:22.783031 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:39:22.782773 2575 projected.go:196] Error preparing data for projected volume kube-api-access-v8mqk for pod openshift-network-diagnostics/network-check-target-tp5h2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 13:39:22.783031 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:39:22.782844 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8fa51077-bb0c-4245-bdd1-b3dfcea493aa-kube-api-access-v8mqk podName:8fa51077-bb0c-4245-bdd1-b3dfcea493aa nodeName:}" failed. No retries permitted until 2026-09-07 13:39:54.78283148 +0000 UTC m=+66.276960789 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-v8mqk" (UniqueName: "kubernetes.io/projected/8fa51077-bb0c-4245-bdd1-b3dfcea493aa-kube-api-access-v8mqk") pod "network-check-target-tp5h2" (UID: "8fa51077-bb0c-4245-bdd1-b3dfcea493aa") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 13:39:22.854507 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:22.854480 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-124.ec2.internal" event="NodeReady" Sep 07 13:39:22.854649 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:22.854608 2575 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 07 13:39:22.904156 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:22.904129 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-575cbc495d-tf4vt"] Sep 07 13:39:22.925205 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:22.925168 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-575cbc495d-tf4vt"] Sep 07 13:39:22.925336 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:22.925286 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-575cbc495d-tf4vt" Sep 07 13:39:22.928393 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:22.927701 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-8s8pc"] Sep 07 13:39:22.930234 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:22.929367 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-fczv6\"" Sep 07 13:39:22.930234 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:22.929383 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Sep 07 13:39:22.930234 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:22.929646 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Sep 07 13:39:22.930234 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:22.929859 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Sep 07 13:39:22.941363 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:22.941180 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Sep 07 13:39:22.943365 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:22.943343 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-hx6nh"] Sep 07 13:39:22.943480 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:22.943463 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8s8pc" Sep 07 13:39:22.946892 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:22.946870 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 07 13:39:22.947264 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:22.947244 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 07 13:39:22.947995 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:22.947979 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-bgvq7\"" Sep 07 13:39:22.965411 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:22.965391 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-8s8pc"] Sep 07 13:39:22.965521 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:22.965433 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-hx6nh"] Sep 07 13:39:22.965581 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:22.965517 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-hx6nh" Sep 07 13:39:22.969436 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:22.969034 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-c4tgk\"" Sep 07 13:39:22.969436 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:22.969328 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 07 13:39:22.969436 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:22.969380 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 07 13:39:22.971643 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:22.971625 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 07 13:39:23.085265 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:23.085233 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e7b30596-01a1-4b88-b841-786c2fc17b86-trusted-ca\") pod \"image-registry-575cbc495d-tf4vt\" (UID: \"e7b30596-01a1-4b88-b841-786c2fc17b86\") " pod="openshift-image-registry/image-registry-575cbc495d-tf4vt" Sep 07 13:39:23.085422 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:23.085278 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e7b30596-01a1-4b88-b841-786c2fc17b86-registry-certificates\") pod \"image-registry-575cbc495d-tf4vt\" (UID: \"e7b30596-01a1-4b88-b841-786c2fc17b86\") " pod="openshift-image-registry/image-registry-575cbc495d-tf4vt" Sep 07 13:39:23.085422 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:23.085356 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/862d7f09-8baa-4fe7-a00a-1dd31feb354c-config-volume\") pod \"dns-default-8s8pc\" (UID: \"862d7f09-8baa-4fe7-a00a-1dd31feb354c\") " pod="openshift-dns/dns-default-8s8pc" Sep 07 13:39:23.085422 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:23.085380 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4wm79\" (UniqueName: \"kubernetes.io/projected/862d7f09-8baa-4fe7-a00a-1dd31feb354c-kube-api-access-4wm79\") pod \"dns-default-8s8pc\" (UID: \"862d7f09-8baa-4fe7-a00a-1dd31feb354c\") " pod="openshift-dns/dns-default-8s8pc" Sep 07 13:39:23.085422 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:23.085420 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e7b30596-01a1-4b88-b841-786c2fc17b86-registry-tls\") pod \"image-registry-575cbc495d-tf4vt\" (UID: \"e7b30596-01a1-4b88-b841-786c2fc17b86\") " pod="openshift-image-registry/image-registry-575cbc495d-tf4vt" Sep 07 13:39:23.085649 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:23.085444 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e7b30596-01a1-4b88-b841-786c2fc17b86-ca-trust-extracted\") pod \"image-registry-575cbc495d-tf4vt\" (UID: \"e7b30596-01a1-4b88-b841-786c2fc17b86\") " pod="openshift-image-registry/image-registry-575cbc495d-tf4vt" Sep 07 13:39:23.085649 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:23.085468 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rg7zh\" (UniqueName: \"kubernetes.io/projected/8202e703-f3f9-48f3-b51c-93f55ef79ebc-kube-api-access-rg7zh\") pod \"ingress-canary-hx6nh\" (UID: \"8202e703-f3f9-48f3-b51c-93f55ef79ebc\") " pod="openshift-ingress-canary/ingress-canary-hx6nh" Sep 07 13:39:23.085649 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:23.085491 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e7b30596-01a1-4b88-b841-786c2fc17b86-installation-pull-secrets\") pod \"image-registry-575cbc495d-tf4vt\" (UID: \"e7b30596-01a1-4b88-b841-786c2fc17b86\") " pod="openshift-image-registry/image-registry-575cbc495d-tf4vt" Sep 07 13:39:23.085649 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:23.085507 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qvjz9\" (UniqueName: \"kubernetes.io/projected/e7b30596-01a1-4b88-b841-786c2fc17b86-kube-api-access-qvjz9\") pod \"image-registry-575cbc495d-tf4vt\" (UID: \"e7b30596-01a1-4b88-b841-786c2fc17b86\") " pod="openshift-image-registry/image-registry-575cbc495d-tf4vt" Sep 07 13:39:23.085649 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:23.085529 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/862d7f09-8baa-4fe7-a00a-1dd31feb354c-metrics-tls\") pod \"dns-default-8s8pc\" (UID: \"862d7f09-8baa-4fe7-a00a-1dd31feb354c\") " pod="openshift-dns/dns-default-8s8pc" Sep 07 13:39:23.085926 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:23.085670 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e7b30596-01a1-4b88-b841-786c2fc17b86-image-registry-private-configuration\") pod \"image-registry-575cbc495d-tf4vt\" (UID: \"e7b30596-01a1-4b88-b841-786c2fc17b86\") " pod="openshift-image-registry/image-registry-575cbc495d-tf4vt" Sep 07 13:39:23.085926 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:23.085710 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8202e703-f3f9-48f3-b51c-93f55ef79ebc-cert\") pod \"ingress-canary-hx6nh\" (UID: \"8202e703-f3f9-48f3-b51c-93f55ef79ebc\") " pod="openshift-ingress-canary/ingress-canary-hx6nh" Sep 07 13:39:23.085926 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:23.085754 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e7b30596-01a1-4b88-b841-786c2fc17b86-bound-sa-token\") pod \"image-registry-575cbc495d-tf4vt\" (UID: \"e7b30596-01a1-4b88-b841-786c2fc17b86\") " pod="openshift-image-registry/image-registry-575cbc495d-tf4vt" Sep 07 13:39:23.085926 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:23.085776 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/862d7f09-8baa-4fe7-a00a-1dd31feb354c-tmp-dir\") pod \"dns-default-8s8pc\" (UID: \"862d7f09-8baa-4fe7-a00a-1dd31feb354c\") " pod="openshift-dns/dns-default-8s8pc" Sep 07 13:39:23.186226 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:23.186190 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e7b30596-01a1-4b88-b841-786c2fc17b86-trusted-ca\") pod \"image-registry-575cbc495d-tf4vt\" (UID: \"e7b30596-01a1-4b88-b841-786c2fc17b86\") " pod="openshift-image-registry/image-registry-575cbc495d-tf4vt" Sep 07 13:39:23.186408 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:23.186237 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e7b30596-01a1-4b88-b841-786c2fc17b86-registry-certificates\") pod \"image-registry-575cbc495d-tf4vt\" (UID: \"e7b30596-01a1-4b88-b841-786c2fc17b86\") " pod="openshift-image-registry/image-registry-575cbc495d-tf4vt" Sep 07 13:39:23.186408 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:23.186263 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/862d7f09-8baa-4fe7-a00a-1dd31feb354c-config-volume\") pod \"dns-default-8s8pc\" (UID: \"862d7f09-8baa-4fe7-a00a-1dd31feb354c\") " pod="openshift-dns/dns-default-8s8pc" Sep 07 13:39:23.186408 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:23.186286 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4wm79\" (UniqueName: \"kubernetes.io/projected/862d7f09-8baa-4fe7-a00a-1dd31feb354c-kube-api-access-4wm79\") pod \"dns-default-8s8pc\" (UID: \"862d7f09-8baa-4fe7-a00a-1dd31feb354c\") " pod="openshift-dns/dns-default-8s8pc" Sep 07 13:39:23.186408 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:23.186328 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e7b30596-01a1-4b88-b841-786c2fc17b86-registry-tls\") pod \"image-registry-575cbc495d-tf4vt\" (UID: \"e7b30596-01a1-4b88-b841-786c2fc17b86\") " pod="openshift-image-registry/image-registry-575cbc495d-tf4vt" Sep 07 13:39:23.186408 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:23.186351 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e7b30596-01a1-4b88-b841-786c2fc17b86-ca-trust-extracted\") pod \"image-registry-575cbc495d-tf4vt\" (UID: \"e7b30596-01a1-4b88-b841-786c2fc17b86\") " pod="openshift-image-registry/image-registry-575cbc495d-tf4vt" Sep 07 13:39:23.186408 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:23.186368 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rg7zh\" (UniqueName: \"kubernetes.io/projected/8202e703-f3f9-48f3-b51c-93f55ef79ebc-kube-api-access-rg7zh\") pod \"ingress-canary-hx6nh\" (UID: \"8202e703-f3f9-48f3-b51c-93f55ef79ebc\") " pod="openshift-ingress-canary/ingress-canary-hx6nh" Sep 07 13:39:23.186408 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:23.186386 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e7b30596-01a1-4b88-b841-786c2fc17b86-installation-pull-secrets\") pod \"image-registry-575cbc495d-tf4vt\" (UID: \"e7b30596-01a1-4b88-b841-786c2fc17b86\") " pod="openshift-image-registry/image-registry-575cbc495d-tf4vt" Sep 07 13:39:23.186408 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:23.186404 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qvjz9\" (UniqueName: \"kubernetes.io/projected/e7b30596-01a1-4b88-b841-786c2fc17b86-kube-api-access-qvjz9\") pod \"image-registry-575cbc495d-tf4vt\" (UID: \"e7b30596-01a1-4b88-b841-786c2fc17b86\") " pod="openshift-image-registry/image-registry-575cbc495d-tf4vt" Sep 07 13:39:23.186800 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:23.186419 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/862d7f09-8baa-4fe7-a00a-1dd31feb354c-metrics-tls\") pod \"dns-default-8s8pc\" (UID: \"862d7f09-8baa-4fe7-a00a-1dd31feb354c\") " pod="openshift-dns/dns-default-8s8pc" Sep 07 13:39:23.186800 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:23.186469 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e7b30596-01a1-4b88-b841-786c2fc17b86-image-registry-private-configuration\") pod \"image-registry-575cbc495d-tf4vt\" (UID: \"e7b30596-01a1-4b88-b841-786c2fc17b86\") " pod="openshift-image-registry/image-registry-575cbc495d-tf4vt" Sep 07 13:39:23.186800 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:23.186483 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8202e703-f3f9-48f3-b51c-93f55ef79ebc-cert\") pod \"ingress-canary-hx6nh\" (UID: \"8202e703-f3f9-48f3-b51c-93f55ef79ebc\") " pod="openshift-ingress-canary/ingress-canary-hx6nh" Sep 07 13:39:23.186800 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:23.186504 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e7b30596-01a1-4b88-b841-786c2fc17b86-bound-sa-token\") pod \"image-registry-575cbc495d-tf4vt\" (UID: \"e7b30596-01a1-4b88-b841-786c2fc17b86\") " pod="openshift-image-registry/image-registry-575cbc495d-tf4vt" Sep 07 13:39:23.186800 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:23.186519 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/862d7f09-8baa-4fe7-a00a-1dd31feb354c-tmp-dir\") pod \"dns-default-8s8pc\" (UID: \"862d7f09-8baa-4fe7-a00a-1dd31feb354c\") " pod="openshift-dns/dns-default-8s8pc" Sep 07 13:39:23.186800 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:23.186737 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/862d7f09-8baa-4fe7-a00a-1dd31feb354c-tmp-dir\") pod \"dns-default-8s8pc\" (UID: \"862d7f09-8baa-4fe7-a00a-1dd31feb354c\") " pod="openshift-dns/dns-default-8s8pc" Sep 07 13:39:23.187101 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:23.187036 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e7b30596-01a1-4b88-b841-786c2fc17b86-registry-certificates\") pod \"image-registry-575cbc495d-tf4vt\" (UID: \"e7b30596-01a1-4b88-b841-786c2fc17b86\") " pod="openshift-image-registry/image-registry-575cbc495d-tf4vt" Sep 07 13:39:23.187101 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:23.187052 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/862d7f09-8baa-4fe7-a00a-1dd31feb354c-config-volume\") pod \"dns-default-8s8pc\" (UID: \"862d7f09-8baa-4fe7-a00a-1dd31feb354c\") " pod="openshift-dns/dns-default-8s8pc" Sep 07 13:39:23.187202 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:39:23.187104 2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 07 13:39:23.187202 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:39:23.187119 2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-575cbc495d-tf4vt: secret "image-registry-tls" not found Sep 07 13:39:23.187202 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:39:23.187163 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e7b30596-01a1-4b88-b841-786c2fc17b86-registry-tls podName:e7b30596-01a1-4b88-b841-786c2fc17b86 nodeName:}" failed. No retries permitted until 2026-09-07 13:39:23.687150293 +0000 UTC m=+35.181279608 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e7b30596-01a1-4b88-b841-786c2fc17b86-registry-tls") pod "image-registry-575cbc495d-tf4vt" (UID: "e7b30596-01a1-4b88-b841-786c2fc17b86") : secret "image-registry-tls" not found Sep 07 13:39:23.187357 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:23.187241 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e7b30596-01a1-4b88-b841-786c2fc17b86-ca-trust-extracted\") pod \"image-registry-575cbc495d-tf4vt\" (UID: \"e7b30596-01a1-4b88-b841-786c2fc17b86\") " pod="openshift-image-registry/image-registry-575cbc495d-tf4vt" Sep 07 13:39:23.187490 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:23.187452 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e7b30596-01a1-4b88-b841-786c2fc17b86-trusted-ca\") pod \"image-registry-575cbc495d-tf4vt\" (UID: \"e7b30596-01a1-4b88-b841-786c2fc17b86\") " pod="openshift-image-registry/image-registry-575cbc495d-tf4vt" Sep 07 13:39:23.187607 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:39:23.187504 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 07 13:39:23.187607 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:39:23.187558 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/862d7f09-8baa-4fe7-a00a-1dd31feb354c-metrics-tls podName:862d7f09-8baa-4fe7-a00a-1dd31feb354c nodeName:}" failed. No retries permitted until 2026-09-07 13:39:23.687530592 +0000 UTC m=+35.181659905 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/862d7f09-8baa-4fe7-a00a-1dd31feb354c-metrics-tls") pod "dns-default-8s8pc" (UID: "862d7f09-8baa-4fe7-a00a-1dd31feb354c") : secret "dns-default-metrics-tls" not found Sep 07 13:39:23.191972 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:23.191949 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8202e703-f3f9-48f3-b51c-93f55ef79ebc-cert\") pod \"ingress-canary-hx6nh\" (UID: \"8202e703-f3f9-48f3-b51c-93f55ef79ebc\") " pod="openshift-ingress-canary/ingress-canary-hx6nh" Sep 07 13:39:23.192064 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:23.192037 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e7b30596-01a1-4b88-b841-786c2fc17b86-image-registry-private-configuration\") pod \"image-registry-575cbc495d-tf4vt\" (UID: \"e7b30596-01a1-4b88-b841-786c2fc17b86\") " pod="openshift-image-registry/image-registry-575cbc495d-tf4vt" Sep 07 13:39:23.193185 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:23.193162 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e7b30596-01a1-4b88-b841-786c2fc17b86-installation-pull-secrets\") pod \"image-registry-575cbc495d-tf4vt\" (UID: \"e7b30596-01a1-4b88-b841-786c2fc17b86\") " pod="openshift-image-registry/image-registry-575cbc495d-tf4vt" Sep 07 13:39:23.198242 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:23.198212 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rg7zh\" (UniqueName: \"kubernetes.io/projected/8202e703-f3f9-48f3-b51c-93f55ef79ebc-kube-api-access-rg7zh\") pod \"ingress-canary-hx6nh\" (UID: \"8202e703-f3f9-48f3-b51c-93f55ef79ebc\") " pod="openshift-ingress-canary/ingress-canary-hx6nh" Sep 07 13:39:23.198330 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:23.198260 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4wm79\" (UniqueName: \"kubernetes.io/projected/862d7f09-8baa-4fe7-a00a-1dd31feb354c-kube-api-access-4wm79\") pod \"dns-default-8s8pc\" (UID: \"862d7f09-8baa-4fe7-a00a-1dd31feb354c\") " pod="openshift-dns/dns-default-8s8pc" Sep 07 13:39:23.201185 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:23.201167 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e7b30596-01a1-4b88-b841-786c2fc17b86-bound-sa-token\") pod \"image-registry-575cbc495d-tf4vt\" (UID: \"e7b30596-01a1-4b88-b841-786c2fc17b86\") " pod="openshift-image-registry/image-registry-575cbc495d-tf4vt" Sep 07 13:39:23.201658 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:23.201638 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qvjz9\" (UniqueName: \"kubernetes.io/projected/e7b30596-01a1-4b88-b841-786c2fc17b86-kube-api-access-qvjz9\") pod \"image-registry-575cbc495d-tf4vt\" (UID: \"e7b30596-01a1-4b88-b841-786c2fc17b86\") " pod="openshift-image-registry/image-registry-575cbc495d-tf4vt" Sep 07 13:39:23.275822 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:23.275776 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-hx6nh" Sep 07 13:39:23.607110 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:23.607085 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-hx6nh"] Sep 07 13:39:23.611304 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:39:23.611177 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8202e703_f3f9_48f3_b51c_93f55ef79ebc.slice/crio-4041e858c5cb33a7c1713c9360339cbccb1c421a9c9a158a3cd148eea0663181 WatchSource:0}: Error finding container 4041e858c5cb33a7c1713c9360339cbccb1c421a9c9a158a3cd148eea0663181: Status 404 returned error can't find the container with id 4041e858c5cb33a7c1713c9360339cbccb1c421a9c9a158a3cd148eea0663181 Sep 07 13:39:23.690564 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:23.690487 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e7b30596-01a1-4b88-b841-786c2fc17b86-registry-tls\") pod \"image-registry-575cbc495d-tf4vt\" (UID: \"e7b30596-01a1-4b88-b841-786c2fc17b86\") " pod="openshift-image-registry/image-registry-575cbc495d-tf4vt" Sep 07 13:39:23.690564 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:23.690530 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/862d7f09-8baa-4fe7-a00a-1dd31feb354c-metrics-tls\") pod \"dns-default-8s8pc\" (UID: \"862d7f09-8baa-4fe7-a00a-1dd31feb354c\") " pod="openshift-dns/dns-default-8s8pc" Sep 07 13:39:23.690759 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:39:23.690640 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 07 13:39:23.690759 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:39:23.690644 2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 07 13:39:23.690759 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:39:23.690698 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/862d7f09-8baa-4fe7-a00a-1dd31feb354c-metrics-tls podName:862d7f09-8baa-4fe7-a00a-1dd31feb354c nodeName:}" failed. No retries permitted until 2026-09-07 13:39:24.690685262 +0000 UTC m=+36.184814571 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/862d7f09-8baa-4fe7-a00a-1dd31feb354c-metrics-tls") pod "dns-default-8s8pc" (UID: "862d7f09-8baa-4fe7-a00a-1dd31feb354c") : secret "dns-default-metrics-tls" not found Sep 07 13:39:23.690759 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:39:23.690707 2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-575cbc495d-tf4vt: secret "image-registry-tls" not found Sep 07 13:39:23.690943 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:39:23.690768 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e7b30596-01a1-4b88-b841-786c2fc17b86-registry-tls podName:e7b30596-01a1-4b88-b841-786c2fc17b86 nodeName:}" failed. No retries permitted until 2026-09-07 13:39:24.690748505 +0000 UTC m=+36.184877816 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e7b30596-01a1-4b88-b841-786c2fc17b86-registry-tls") pod "image-registry-575cbc495d-tf4vt" (UID: "e7b30596-01a1-4b88-b841-786c2fc17b86") : secret "image-registry-tls" not found Sep 07 13:39:23.988604 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:23.988514 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tp5h2" Sep 07 13:39:23.989349 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:23.988628 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-947k4" Sep 07 13:39:23.989349 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:23.988822 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pwdkf" Sep 07 13:39:23.993091 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:23.993071 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 07 13:39:23.993091 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:23.993083 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-pgwth\"" Sep 07 13:39:23.993091 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:23.993100 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 07 13:39:23.993424 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:23.993209 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 07 13:39:23.993424 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:23.993331 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-4w8k6\"" Sep 07 13:39:23.993424 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:23.993376 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 07 13:39:24.160494 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:24.160457 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-hx6nh" event={"ID":"8202e703-f3f9-48f3-b51c-93f55ef79ebc","Type":"ContainerStarted","Data":"4041e858c5cb33a7c1713c9360339cbccb1c421a9c9a158a3cd148eea0663181"} Sep 07 13:39:24.698394 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:24.698363 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e7b30596-01a1-4b88-b841-786c2fc17b86-registry-tls\") pod \"image-registry-575cbc495d-tf4vt\" (UID: \"e7b30596-01a1-4b88-b841-786c2fc17b86\") " pod="openshift-image-registry/image-registry-575cbc495d-tf4vt" Sep 07 13:39:24.698590 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:24.698411 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/862d7f09-8baa-4fe7-a00a-1dd31feb354c-metrics-tls\") pod \"dns-default-8s8pc\" (UID: \"862d7f09-8baa-4fe7-a00a-1dd31feb354c\") " pod="openshift-dns/dns-default-8s8pc" Sep 07 13:39:24.698590 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:39:24.698585 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 07 13:39:24.698704 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:39:24.698649 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/862d7f09-8baa-4fe7-a00a-1dd31feb354c-metrics-tls podName:862d7f09-8baa-4fe7-a00a-1dd31feb354c nodeName:}" failed. No retries permitted until 2026-09-07 13:39:26.698629657 +0000 UTC m=+38.192758982 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/862d7f09-8baa-4fe7-a00a-1dd31feb354c-metrics-tls") pod "dns-default-8s8pc" (UID: "862d7f09-8baa-4fe7-a00a-1dd31feb354c") : secret "dns-default-metrics-tls" not found Sep 07 13:39:24.699000 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:39:24.698910 2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 07 13:39:24.699000 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:39:24.698929 2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-575cbc495d-tf4vt: secret "image-registry-tls" not found Sep 07 13:39:24.699000 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:39:24.698978 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e7b30596-01a1-4b88-b841-786c2fc17b86-registry-tls podName:e7b30596-01a1-4b88-b841-786c2fc17b86 nodeName:}" failed. No retries permitted until 2026-09-07 13:39:26.698963958 +0000 UTC m=+38.193093268 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e7b30596-01a1-4b88-b841-786c2fc17b86-registry-tls") pod "image-registry-575cbc495d-tf4vt" (UID: "e7b30596-01a1-4b88-b841-786c2fc17b86") : secret "image-registry-tls" not found Sep 07 13:39:26.714071 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:26.714035 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e7b30596-01a1-4b88-b841-786c2fc17b86-registry-tls\") pod \"image-registry-575cbc495d-tf4vt\" (UID: \"e7b30596-01a1-4b88-b841-786c2fc17b86\") " pod="openshift-image-registry/image-registry-575cbc495d-tf4vt" Sep 07 13:39:26.714624 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:26.714089 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/862d7f09-8baa-4fe7-a00a-1dd31feb354c-metrics-tls\") pod \"dns-default-8s8pc\" (UID: \"862d7f09-8baa-4fe7-a00a-1dd31feb354c\") " pod="openshift-dns/dns-default-8s8pc" Sep 07 13:39:26.714624 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:39:26.714211 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 07 13:39:26.714624 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:39:26.714220 2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 07 13:39:26.714624 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:39:26.714237 2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-575cbc495d-tf4vt: secret "image-registry-tls" not found Sep 07 13:39:26.714624 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:39:26.714285 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/862d7f09-8baa-4fe7-a00a-1dd31feb354c-metrics-tls podName:862d7f09-8baa-4fe7-a00a-1dd31feb354c nodeName:}" failed. No retries permitted until 2026-09-07 13:39:30.714265675 +0000 UTC m=+42.208394983 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/862d7f09-8baa-4fe7-a00a-1dd31feb354c-metrics-tls") pod "dns-default-8s8pc" (UID: "862d7f09-8baa-4fe7-a00a-1dd31feb354c") : secret "dns-default-metrics-tls" not found Sep 07 13:39:26.714624 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:39:26.714302 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e7b30596-01a1-4b88-b841-786c2fc17b86-registry-tls podName:e7b30596-01a1-4b88-b841-786c2fc17b86 nodeName:}" failed. No retries permitted until 2026-09-07 13:39:30.714294472 +0000 UTC m=+42.208423780 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e7b30596-01a1-4b88-b841-786c2fc17b86-registry-tls") pod "image-registry-575cbc495d-tf4vt" (UID: "e7b30596-01a1-4b88-b841-786c2fc17b86") : secret "image-registry-tls" not found Sep 07 13:39:28.174331 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:28.174157 2575 generic.go:356] "Generic (PLEG): container finished" podID="b12d5e4b-b139-4b59-b6ce-3cbc314a11c6" containerID="42393c0c74fb02fb1955a301171867ca183c835119000b884813f80566586220" exitCode=0 Sep 07 13:39:28.174761 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:28.174233 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xqq4n" event={"ID":"b12d5e4b-b139-4b59-b6ce-3cbc314a11c6","Type":"ContainerDied","Data":"42393c0c74fb02fb1955a301171867ca183c835119000b884813f80566586220"} Sep 07 13:39:28.175876 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:28.175846 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-hx6nh" event={"ID":"8202e703-f3f9-48f3-b51c-93f55ef79ebc","Type":"ContainerStarted","Data":"7316c0ed4595870f66c90a17743c9841553c95492e1d38c459a637390d14d974"} Sep 07 13:39:28.223772 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:28.223717 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-hx6nh" podStartSLOduration=2.544952687 podStartE2EDuration="6.223696556s" totalImagesPullingTime="3.678743869s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:39:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:39:28.223549199 +0000 UTC m=+39.717678532" watchObservedRunningTime="2026-09-07 13:39:28.223696556 +0000 UTC m=+39.717825888" Sep 07 13:39:29.181202 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:29.181166 2575 generic.go:356] "Generic (PLEG): container finished" podID="b12d5e4b-b139-4b59-b6ce-3cbc314a11c6" containerID="5b4128981cf8997fe261b29d5505df833f7ef7d953d7ea2d92cdce9a5db44c12" exitCode=0 Sep 07 13:39:29.181555 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:29.181255 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xqq4n" event={"ID":"b12d5e4b-b139-4b59-b6ce-3cbc314a11c6","Type":"ContainerDied","Data":"5b4128981cf8997fe261b29d5505df833f7ef7d953d7ea2d92cdce9a5db44c12"} Sep 07 13:39:30.186939 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:30.186902 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xqq4n" event={"ID":"b12d5e4b-b139-4b59-b6ce-3cbc314a11c6","Type":"ContainerStarted","Data":"9e6447e819619a188ed99f5f37e1508d782cbbb3d015afc4eef4765625bc06fa"} Sep 07 13:39:30.216813 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:30.216739 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-xqq4n" podStartSLOduration=9.066114459 podStartE2EDuration="41.216719813s" totalImagesPullingTime="32.150605354s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 13:38:49 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:39:30.214438224 +0000 UTC m=+41.708567566" watchObservedRunningTime="2026-09-07 13:39:30.216719813 +0000 UTC m=+41.710849146" Sep 07 13:39:30.748253 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:30.748214 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e7b30596-01a1-4b88-b841-786c2fc17b86-registry-tls\") pod \"image-registry-575cbc495d-tf4vt\" (UID: \"e7b30596-01a1-4b88-b841-786c2fc17b86\") " pod="openshift-image-registry/image-registry-575cbc495d-tf4vt" Sep 07 13:39:30.748416 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:30.748258 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/862d7f09-8baa-4fe7-a00a-1dd31feb354c-metrics-tls\") pod \"dns-default-8s8pc\" (UID: \"862d7f09-8baa-4fe7-a00a-1dd31feb354c\") " pod="openshift-dns/dns-default-8s8pc" Sep 07 13:39:30.748416 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:39:30.748370 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 07 13:39:30.748416 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:39:30.748374 2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 07 13:39:30.748416 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:39:30.748391 2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-575cbc495d-tf4vt: secret "image-registry-tls" not found Sep 07 13:39:30.748535 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:39:30.748438 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e7b30596-01a1-4b88-b841-786c2fc17b86-registry-tls podName:e7b30596-01a1-4b88-b841-786c2fc17b86 nodeName:}" failed. No retries permitted until 2026-09-07 13:39:38.748420193 +0000 UTC m=+50.242549517 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e7b30596-01a1-4b88-b841-786c2fc17b86-registry-tls") pod "image-registry-575cbc495d-tf4vt" (UID: "e7b30596-01a1-4b88-b841-786c2fc17b86") : secret "image-registry-tls" not found Sep 07 13:39:30.748535 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:39:30.748453 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/862d7f09-8baa-4fe7-a00a-1dd31feb354c-metrics-tls podName:862d7f09-8baa-4fe7-a00a-1dd31feb354c nodeName:}" failed. No retries permitted until 2026-09-07 13:39:38.748445403 +0000 UTC m=+50.242574712 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/862d7f09-8baa-4fe7-a00a-1dd31feb354c-metrics-tls") pod "dns-default-8s8pc" (UID: "862d7f09-8baa-4fe7-a00a-1dd31feb354c") : secret "dns-default-metrics-tls" not found Sep 07 13:39:38.809913 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:38.809875 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/862d7f09-8baa-4fe7-a00a-1dd31feb354c-metrics-tls\") pod \"dns-default-8s8pc\" (UID: \"862d7f09-8baa-4fe7-a00a-1dd31feb354c\") " pod="openshift-dns/dns-default-8s8pc" Sep 07 13:39:38.810426 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:38.809979 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e7b30596-01a1-4b88-b841-786c2fc17b86-registry-tls\") pod \"image-registry-575cbc495d-tf4vt\" (UID: \"e7b30596-01a1-4b88-b841-786c2fc17b86\") " pod="openshift-image-registry/image-registry-575cbc495d-tf4vt" Sep 07 13:39:38.810426 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:39:38.810057 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 07 13:39:38.810426 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:39:38.810066 2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 07 13:39:38.810426 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:39:38.810167 2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-575cbc495d-tf4vt: secret "image-registry-tls" not found Sep 07 13:39:38.810426 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:39:38.810157 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/862d7f09-8baa-4fe7-a00a-1dd31feb354c-metrics-tls podName:862d7f09-8baa-4fe7-a00a-1dd31feb354c nodeName:}" failed. No retries permitted until 2026-09-07 13:39:54.810132704 +0000 UTC m=+66.304262027 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/862d7f09-8baa-4fe7-a00a-1dd31feb354c-metrics-tls") pod "dns-default-8s8pc" (UID: "862d7f09-8baa-4fe7-a00a-1dd31feb354c") : secret "dns-default-metrics-tls" not found Sep 07 13:39:38.810426 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:39:38.810233 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e7b30596-01a1-4b88-b841-786c2fc17b86-registry-tls podName:e7b30596-01a1-4b88-b841-786c2fc17b86 nodeName:}" failed. No retries permitted until 2026-09-07 13:39:54.810215372 +0000 UTC m=+66.304344683 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e7b30596-01a1-4b88-b841-786c2fc17b86-registry-tls") pod "image-registry-575cbc495d-tf4vt" (UID: "e7b30596-01a1-4b88-b841-786c2fc17b86") : secret "image-registry-tls" not found Sep 07 13:39:50.164922 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:50.164894 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8gjr4" Sep 07 13:39:54.824456 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:54.824419 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/51f8ac5a-daf1-48b6-ace7-9b7674b90409-metrics-certs\") pod \"network-metrics-daemon-pwdkf\" (UID: \"51f8ac5a-daf1-48b6-ace7-9b7674b90409\") " pod="openshift-multus/network-metrics-daemon-pwdkf" Sep 07 13:39:54.824456 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:54.824458 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v8mqk\" (UniqueName: \"kubernetes.io/projected/8fa51077-bb0c-4245-bdd1-b3dfcea493aa-kube-api-access-v8mqk\") pod \"network-check-target-tp5h2\" (UID: \"8fa51077-bb0c-4245-bdd1-b3dfcea493aa\") " pod="openshift-network-diagnostics/network-check-target-tp5h2" Sep 07 13:39:54.824933 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:54.824507 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3dccac71-71b0-49e8-bde3-08fd33578be3-original-pull-secret\") pod \"global-pull-secret-syncer-947k4\" (UID: \"3dccac71-71b0-49e8-bde3-08fd33578be3\") " pod="kube-system/global-pull-secret-syncer-947k4" Sep 07 13:39:54.824933 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:54.824533 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e7b30596-01a1-4b88-b841-786c2fc17b86-registry-tls\") pod \"image-registry-575cbc495d-tf4vt\" (UID: \"e7b30596-01a1-4b88-b841-786c2fc17b86\") " pod="openshift-image-registry/image-registry-575cbc495d-tf4vt" Sep 07 13:39:54.824933 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:54.824562 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/862d7f09-8baa-4fe7-a00a-1dd31feb354c-metrics-tls\") pod \"dns-default-8s8pc\" (UID: \"862d7f09-8baa-4fe7-a00a-1dd31feb354c\") " pod="openshift-dns/dns-default-8s8pc" Sep 07 13:39:54.824933 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:39:54.824641 2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 07 13:39:54.824933 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:39:54.824653 2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-575cbc495d-tf4vt: secret "image-registry-tls" not found Sep 07 13:39:54.824933 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:39:54.824733 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e7b30596-01a1-4b88-b841-786c2fc17b86-registry-tls podName:e7b30596-01a1-4b88-b841-786c2fc17b86 nodeName:}" failed. No retries permitted until 2026-09-07 13:40:26.82471063 +0000 UTC m=+98.318839940 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e7b30596-01a1-4b88-b841-786c2fc17b86-registry-tls") pod "image-registry-575cbc495d-tf4vt" (UID: "e7b30596-01a1-4b88-b841-786c2fc17b86") : secret "image-registry-tls" not found Sep 07 13:39:54.824933 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:39:54.824774 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 07 13:39:54.824933 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:39:54.824836 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/862d7f09-8baa-4fe7-a00a-1dd31feb354c-metrics-tls podName:862d7f09-8baa-4fe7-a00a-1dd31feb354c nodeName:}" failed. No retries permitted until 2026-09-07 13:40:26.824822691 +0000 UTC m=+98.318952000 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/862d7f09-8baa-4fe7-a00a-1dd31feb354c-metrics-tls") pod "dns-default-8s8pc" (UID: "862d7f09-8baa-4fe7-a00a-1dd31feb354c") : secret "dns-default-metrics-tls" not found Sep 07 13:39:54.827666 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:54.827647 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 07 13:39:54.828069 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:54.828056 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 07 13:39:54.828207 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:54.828194 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 07 13:39:54.835453 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:39:54.835435 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 07 13:39:54.835546 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:39:54.835495 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51f8ac5a-daf1-48b6-ace7-9b7674b90409-metrics-certs podName:51f8ac5a-daf1-48b6-ace7-9b7674b90409 nodeName:}" failed. No retries permitted until 2026-09-07 13:40:58.835477704 +0000 UTC m=+130.329607022 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/51f8ac5a-daf1-48b6-ace7-9b7674b90409-metrics-certs") pod "network-metrics-daemon-pwdkf" (UID: "51f8ac5a-daf1-48b6-ace7-9b7674b90409") : secret "metrics-daemon-secret" not found Sep 07 13:39:54.838469 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:54.838455 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3dccac71-71b0-49e8-bde3-08fd33578be3-original-pull-secret\") pod \"global-pull-secret-syncer-947k4\" (UID: \"3dccac71-71b0-49e8-bde3-08fd33578be3\") " pod="kube-system/global-pull-secret-syncer-947k4" Sep 07 13:39:54.838745 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:54.838728 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 07 13:39:54.848130 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:54.848113 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v8mqk\" (UniqueName: \"kubernetes.io/projected/8fa51077-bb0c-4245-bdd1-b3dfcea493aa-kube-api-access-v8mqk\") pod \"network-check-target-tp5h2\" (UID: \"8fa51077-bb0c-4245-bdd1-b3dfcea493aa\") " pod="openshift-network-diagnostics/network-check-target-tp5h2" Sep 07 13:39:54.902839 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:54.902820 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-4w8k6\"" Sep 07 13:39:54.907411 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:54.907397 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-947k4" Sep 07 13:39:54.910087 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:54.910070 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tp5h2" Sep 07 13:39:55.195145 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:55.194374 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-tp5h2"] Sep 07 13:39:55.195145 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:55.194475 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-947k4"] Sep 07 13:39:55.197050 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:39:55.196837 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8fa51077_bb0c_4245_bdd1_b3dfcea493aa.slice/crio-e5c4a01d51ed329f1ff9a00c643947581f1271f30504bb5012096a2ee4599f9e WatchSource:0}: Error finding container e5c4a01d51ed329f1ff9a00c643947581f1271f30504bb5012096a2ee4599f9e: Status 404 returned error can't find the container with id e5c4a01d51ed329f1ff9a00c643947581f1271f30504bb5012096a2ee4599f9e Sep 07 13:39:55.245469 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:55.245440 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-tp5h2" event={"ID":"8fa51077-bb0c-4245-bdd1-b3dfcea493aa","Type":"ContainerStarted","Data":"e5c4a01d51ed329f1ff9a00c643947581f1271f30504bb5012096a2ee4599f9e"} Sep 07 13:39:55.246465 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:39:55.246439 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-947k4" event={"ID":"3dccac71-71b0-49e8-bde3-08fd33578be3","Type":"ContainerStarted","Data":"57eb1009d439eed21e77957d0effdf1eae55681ff7ed66b941970ba44d9377a9"} Sep 07 13:40:00.260583 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:00.260487 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-tp5h2" event={"ID":"8fa51077-bb0c-4245-bdd1-b3dfcea493aa","Type":"ContainerStarted","Data":"f760e53af45c1c11f4fc4dba8dde5301dbdb8074942c04261b3cdb3f8d77cb60"} Sep 07 13:40:00.260583 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:00.260572 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-tp5h2" Sep 07 13:40:00.262082 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:00.262059 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-947k4" event={"ID":"3dccac71-71b0-49e8-bde3-08fd33578be3","Type":"ContainerStarted","Data":"e9ad48aa7ecc8d58ceea446c5a0561678937fd187537f03d356479270924887a"} Sep 07 13:40:00.282768 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:00.282695 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-tp5h2" podStartSLOduration=66.615253584 podStartE2EDuration="1m11.282675369s" totalImagesPullingTime="4.667421785s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:38:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:40:00.279746252 +0000 UTC m=+71.773875584" watchObservedRunningTime="2026-09-07 13:40:00.282675369 +0000 UTC m=+71.776804700" Sep 07 13:40:00.302736 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:00.302687 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-947k4" podStartSLOduration=65.629551624 podStartE2EDuration="1m10.302675367s" totalImagesPullingTime="4.673123743s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 13:38:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:40:00.300925375 +0000 UTC m=+71.795054705" watchObservedRunningTime="2026-09-07 13:40:00.302675367 +0000 UTC m=+71.796804698" Sep 07 13:40:07.502576 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:07.502540 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-g5t5m"] Sep 07 13:40:07.505342 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:07.505321 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-85b454874b-jc5wl"] Sep 07 13:40:07.505896 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:07.505585 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-76bcd6ccf5-g5t5m" Sep 07 13:40:07.524680 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:07.524647 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Sep 07 13:40:07.525170 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:07.525145 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-rdfq9\"" Sep 07 13:40:07.527515 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:07.527463 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 07 13:40:07.528465 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:07.528443 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 07 13:40:07.528762 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:07.528721 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Sep 07 13:40:07.530519 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:07.530499 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-85b454874b-jc5wl"] Sep 07 13:40:07.530519 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:07.530534 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-g5t5m"] Sep 07 13:40:07.530692 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:07.530660 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-85b454874b-jc5wl" Sep 07 13:40:07.530692 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:07.530681 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Sep 07 13:40:07.535404 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:07.535385 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Sep 07 13:40:07.535528 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:07.535509 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Sep 07 13:40:07.535701 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:07.535683 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-4lmsn\"" Sep 07 13:40:07.535828 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:07.535727 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Sep 07 13:40:07.535828 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:07.535744 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Sep 07 13:40:07.540729 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:07.540709 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Sep 07 13:40:07.618996 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:07.618963 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6qnlc\" (UniqueName: \"kubernetes.io/projected/d58ec2a6-c963-4cf8-a7d5-65877ae45e14-kube-api-access-6qnlc\") pod \"insights-operator-76bcd6ccf5-g5t5m\" (UID: \"d58ec2a6-c963-4cf8-a7d5-65877ae45e14\") " pod="openshift-insights/insights-operator-76bcd6ccf5-g5t5m" Sep 07 13:40:07.618996 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:07.619000 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d58ec2a6-c963-4cf8-a7d5-65877ae45e14-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-g5t5m\" (UID: \"d58ec2a6-c963-4cf8-a7d5-65877ae45e14\") " pod="openshift-insights/insights-operator-76bcd6ccf5-g5t5m" Sep 07 13:40:07.619202 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:07.619023 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6c9qm\" (UniqueName: \"kubernetes.io/projected/53ad2387-73d8-4939-b289-237d027b5bcd-kube-api-access-6c9qm\") pod \"console-operator-85b454874b-jc5wl\" (UID: \"53ad2387-73d8-4939-b289-237d027b5bcd\") " pod="openshift-console-operator/console-operator-85b454874b-jc5wl" Sep 07 13:40:07.619202 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:07.619107 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d58ec2a6-c963-4cf8-a7d5-65877ae45e14-serving-cert\") pod \"insights-operator-76bcd6ccf5-g5t5m\" (UID: \"d58ec2a6-c963-4cf8-a7d5-65877ae45e14\") " pod="openshift-insights/insights-operator-76bcd6ccf5-g5t5m" Sep 07 13:40:07.619202 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:07.619140 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/53ad2387-73d8-4939-b289-237d027b5bcd-serving-cert\") pod \"console-operator-85b454874b-jc5wl\" (UID: \"53ad2387-73d8-4939-b289-237d027b5bcd\") " pod="openshift-console-operator/console-operator-85b454874b-jc5wl" Sep 07 13:40:07.619202 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:07.619181 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/53ad2387-73d8-4939-b289-237d027b5bcd-trusted-ca\") pod \"console-operator-85b454874b-jc5wl\" (UID: \"53ad2387-73d8-4939-b289-237d027b5bcd\") " pod="openshift-console-operator/console-operator-85b454874b-jc5wl" Sep 07 13:40:07.619202 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:07.619195 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d58ec2a6-c963-4cf8-a7d5-65877ae45e14-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-g5t5m\" (UID: \"d58ec2a6-c963-4cf8-a7d5-65877ae45e14\") " pod="openshift-insights/insights-operator-76bcd6ccf5-g5t5m" Sep 07 13:40:07.619378 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:07.619245 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/53ad2387-73d8-4939-b289-237d027b5bcd-config\") pod \"console-operator-85b454874b-jc5wl\" (UID: \"53ad2387-73d8-4939-b289-237d027b5bcd\") " pod="openshift-console-operator/console-operator-85b454874b-jc5wl" Sep 07 13:40:07.619378 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:07.619265 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d58ec2a6-c963-4cf8-a7d5-65877ae45e14-tmp\") pod \"insights-operator-76bcd6ccf5-g5t5m\" (UID: \"d58ec2a6-c963-4cf8-a7d5-65877ae45e14\") " pod="openshift-insights/insights-operator-76bcd6ccf5-g5t5m" Sep 07 13:40:07.619378 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:07.619282 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/d58ec2a6-c963-4cf8-a7d5-65877ae45e14-snapshots\") pod \"insights-operator-76bcd6ccf5-g5t5m\" (UID: \"d58ec2a6-c963-4cf8-a7d5-65877ae45e14\") " pod="openshift-insights/insights-operator-76bcd6ccf5-g5t5m" Sep 07 13:40:07.720549 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:07.720512 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/53ad2387-73d8-4939-b289-237d027b5bcd-serving-cert\") pod \"console-operator-85b454874b-jc5wl\" (UID: \"53ad2387-73d8-4939-b289-237d027b5bcd\") " pod="openshift-console-operator/console-operator-85b454874b-jc5wl" Sep 07 13:40:07.720826 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:07.720581 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/53ad2387-73d8-4939-b289-237d027b5bcd-trusted-ca\") pod \"console-operator-85b454874b-jc5wl\" (UID: \"53ad2387-73d8-4939-b289-237d027b5bcd\") " pod="openshift-console-operator/console-operator-85b454874b-jc5wl" Sep 07 13:40:07.720826 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:07.720607 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d58ec2a6-c963-4cf8-a7d5-65877ae45e14-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-g5t5m\" (UID: \"d58ec2a6-c963-4cf8-a7d5-65877ae45e14\") " pod="openshift-insights/insights-operator-76bcd6ccf5-g5t5m" Sep 07 13:40:07.720826 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:07.720641 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/53ad2387-73d8-4939-b289-237d027b5bcd-config\") pod \"console-operator-85b454874b-jc5wl\" (UID: \"53ad2387-73d8-4939-b289-237d027b5bcd\") " pod="openshift-console-operator/console-operator-85b454874b-jc5wl" Sep 07 13:40:07.720826 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:07.720663 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d58ec2a6-c963-4cf8-a7d5-65877ae45e14-tmp\") pod \"insights-operator-76bcd6ccf5-g5t5m\" (UID: \"d58ec2a6-c963-4cf8-a7d5-65877ae45e14\") " pod="openshift-insights/insights-operator-76bcd6ccf5-g5t5m" Sep 07 13:40:07.720826 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:07.720684 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/d58ec2a6-c963-4cf8-a7d5-65877ae45e14-snapshots\") pod \"insights-operator-76bcd6ccf5-g5t5m\" (UID: \"d58ec2a6-c963-4cf8-a7d5-65877ae45e14\") " pod="openshift-insights/insights-operator-76bcd6ccf5-g5t5m" Sep 07 13:40:07.721062 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:07.720774 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6qnlc\" (UniqueName: \"kubernetes.io/projected/d58ec2a6-c963-4cf8-a7d5-65877ae45e14-kube-api-access-6qnlc\") pod \"insights-operator-76bcd6ccf5-g5t5m\" (UID: \"d58ec2a6-c963-4cf8-a7d5-65877ae45e14\") " pod="openshift-insights/insights-operator-76bcd6ccf5-g5t5m" Sep 07 13:40:07.721117 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:07.721083 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d58ec2a6-c963-4cf8-a7d5-65877ae45e14-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-g5t5m\" (UID: \"d58ec2a6-c963-4cf8-a7d5-65877ae45e14\") " pod="openshift-insights/insights-operator-76bcd6ccf5-g5t5m" Sep 07 13:40:07.721175 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:07.721115 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6c9qm\" (UniqueName: \"kubernetes.io/projected/53ad2387-73d8-4939-b289-237d027b5bcd-kube-api-access-6c9qm\") pod \"console-operator-85b454874b-jc5wl\" (UID: \"53ad2387-73d8-4939-b289-237d027b5bcd\") " pod="openshift-console-operator/console-operator-85b454874b-jc5wl" Sep 07 13:40:07.721175 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:07.721169 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d58ec2a6-c963-4cf8-a7d5-65877ae45e14-serving-cert\") pod \"insights-operator-76bcd6ccf5-g5t5m\" (UID: \"d58ec2a6-c963-4cf8-a7d5-65877ae45e14\") " pod="openshift-insights/insights-operator-76bcd6ccf5-g5t5m" Sep 07 13:40:07.721387 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:07.721365 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/d58ec2a6-c963-4cf8-a7d5-65877ae45e14-snapshots\") pod \"insights-operator-76bcd6ccf5-g5t5m\" (UID: \"d58ec2a6-c963-4cf8-a7d5-65877ae45e14\") " pod="openshift-insights/insights-operator-76bcd6ccf5-g5t5m" Sep 07 13:40:07.721450 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:07.721304 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d58ec2a6-c963-4cf8-a7d5-65877ae45e14-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-g5t5m\" (UID: \"d58ec2a6-c963-4cf8-a7d5-65877ae45e14\") " pod="openshift-insights/insights-operator-76bcd6ccf5-g5t5m" Sep 07 13:40:07.721487 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:07.721443 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/53ad2387-73d8-4939-b289-237d027b5bcd-config\") pod \"console-operator-85b454874b-jc5wl\" (UID: \"53ad2387-73d8-4939-b289-237d027b5bcd\") " pod="openshift-console-operator/console-operator-85b454874b-jc5wl" Sep 07 13:40:07.721650 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:07.721630 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d58ec2a6-c963-4cf8-a7d5-65877ae45e14-tmp\") pod \"insights-operator-76bcd6ccf5-g5t5m\" (UID: \"d58ec2a6-c963-4cf8-a7d5-65877ae45e14\") " pod="openshift-insights/insights-operator-76bcd6ccf5-g5t5m" Sep 07 13:40:07.721742 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:07.721724 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/53ad2387-73d8-4939-b289-237d027b5bcd-trusted-ca\") pod \"console-operator-85b454874b-jc5wl\" (UID: \"53ad2387-73d8-4939-b289-237d027b5bcd\") " pod="openshift-console-operator/console-operator-85b454874b-jc5wl" Sep 07 13:40:07.722042 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:07.722026 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d58ec2a6-c963-4cf8-a7d5-65877ae45e14-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-g5t5m\" (UID: \"d58ec2a6-c963-4cf8-a7d5-65877ae45e14\") " pod="openshift-insights/insights-operator-76bcd6ccf5-g5t5m" Sep 07 13:40:07.723180 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:07.723153 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/53ad2387-73d8-4939-b289-237d027b5bcd-serving-cert\") pod \"console-operator-85b454874b-jc5wl\" (UID: \"53ad2387-73d8-4939-b289-237d027b5bcd\") " pod="openshift-console-operator/console-operator-85b454874b-jc5wl" Sep 07 13:40:07.723554 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:07.723536 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d58ec2a6-c963-4cf8-a7d5-65877ae45e14-serving-cert\") pod \"insights-operator-76bcd6ccf5-g5t5m\" (UID: \"d58ec2a6-c963-4cf8-a7d5-65877ae45e14\") " pod="openshift-insights/insights-operator-76bcd6ccf5-g5t5m" Sep 07 13:40:07.734353 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:07.734332 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6qnlc\" (UniqueName: \"kubernetes.io/projected/d58ec2a6-c963-4cf8-a7d5-65877ae45e14-kube-api-access-6qnlc\") pod \"insights-operator-76bcd6ccf5-g5t5m\" (UID: \"d58ec2a6-c963-4cf8-a7d5-65877ae45e14\") " pod="openshift-insights/insights-operator-76bcd6ccf5-g5t5m" Sep 07 13:40:07.734816 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:07.734775 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6c9qm\" (UniqueName: \"kubernetes.io/projected/53ad2387-73d8-4939-b289-237d027b5bcd-kube-api-access-6c9qm\") pod \"console-operator-85b454874b-jc5wl\" (UID: \"53ad2387-73d8-4939-b289-237d027b5bcd\") " pod="openshift-console-operator/console-operator-85b454874b-jc5wl" Sep 07 13:40:07.836908 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:07.836883 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-76bcd6ccf5-g5t5m" Sep 07 13:40:07.842475 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:07.842456 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-85b454874b-jc5wl" Sep 07 13:40:08.113806 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:08.113767 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-g5t5m"] Sep 07 13:40:08.116032 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:08.116008 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-85b454874b-jc5wl"] Sep 07 13:40:08.116156 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:40:08.116126 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd58ec2a6_c963_4cf8_a7d5_65877ae45e14.slice/crio-2b9e4dbbf2508e7d0ef39406975dafab2ab3251679bccf4c578ff9aa38c28214 WatchSource:0}: Error finding container 2b9e4dbbf2508e7d0ef39406975dafab2ab3251679bccf4c578ff9aa38c28214: Status 404 returned error can't find the container with id 2b9e4dbbf2508e7d0ef39406975dafab2ab3251679bccf4c578ff9aa38c28214 Sep 07 13:40:08.118924 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:40:08.118899 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53ad2387_73d8_4939_b289_237d027b5bcd.slice/crio-8b0d969492dcd312b2a3974ff6040dca730709e769e0ac92f54f508f96e43275 WatchSource:0}: Error finding container 8b0d969492dcd312b2a3974ff6040dca730709e769e0ac92f54f508f96e43275: Status 404 returned error can't find the container with id 8b0d969492dcd312b2a3974ff6040dca730709e769e0ac92f54f508f96e43275 Sep 07 13:40:08.283400 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:08.283364 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-jc5wl" event={"ID":"53ad2387-73d8-4939-b289-237d027b5bcd","Type":"ContainerStarted","Data":"8b0d969492dcd312b2a3974ff6040dca730709e769e0ac92f54f508f96e43275"} Sep 07 13:40:08.284421 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:08.284399 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-g5t5m" event={"ID":"d58ec2a6-c963-4cf8-a7d5-65877ae45e14","Type":"ContainerStarted","Data":"2b9e4dbbf2508e7d0ef39406975dafab2ab3251679bccf4c578ff9aa38c28214"} Sep 07 13:40:10.292989 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:10.292862 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-jc5wl_53ad2387-73d8-4939-b289-237d027b5bcd/console-operator/0.log" Sep 07 13:40:10.292989 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:10.292901 2575 generic.go:356] "Generic (PLEG): container finished" podID="53ad2387-73d8-4939-b289-237d027b5bcd" containerID="ca9006e913d262b7c5ef0c74bd08df0fc9f0c8fc43d40f244847845a57d66138" exitCode=255 Sep 07 13:40:10.292989 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:10.292959 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-jc5wl" event={"ID":"53ad2387-73d8-4939-b289-237d027b5bcd","Type":"ContainerDied","Data":"ca9006e913d262b7c5ef0c74bd08df0fc9f0c8fc43d40f244847845a57d66138"} Sep 07 13:40:10.293466 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:10.293250 2575 scope.go:117] "RemoveContainer" containerID="ca9006e913d262b7c5ef0c74bd08df0fc9f0c8fc43d40f244847845a57d66138" Sep 07 13:40:11.297752 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:11.297725 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-jc5wl_53ad2387-73d8-4939-b289-237d027b5bcd/console-operator/1.log" Sep 07 13:40:11.298208 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:11.298194 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-jc5wl_53ad2387-73d8-4939-b289-237d027b5bcd/console-operator/0.log" Sep 07 13:40:11.298252 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:11.298228 2575 generic.go:356] "Generic (PLEG): container finished" podID="53ad2387-73d8-4939-b289-237d027b5bcd" containerID="e1585cd502fe45043bcd62e7c6da706da21a6bc1a0c0754195f901ab95221416" exitCode=255 Sep 07 13:40:11.298350 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:11.298324 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-jc5wl" event={"ID":"53ad2387-73d8-4939-b289-237d027b5bcd","Type":"ContainerDied","Data":"e1585cd502fe45043bcd62e7c6da706da21a6bc1a0c0754195f901ab95221416"} Sep 07 13:40:11.298476 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:11.298384 2575 scope.go:117] "RemoveContainer" containerID="ca9006e913d262b7c5ef0c74bd08df0fc9f0c8fc43d40f244847845a57d66138" Sep 07 13:40:11.298654 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:11.298632 2575 scope.go:117] "RemoveContainer" containerID="e1585cd502fe45043bcd62e7c6da706da21a6bc1a0c0754195f901ab95221416" Sep 07 13:40:11.298865 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:40:11.298844 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85b454874b-jc5wl_openshift-console-operator(53ad2387-73d8-4939-b289-237d027b5bcd)\"" pod="openshift-console-operator/console-operator-85b454874b-jc5wl" podUID="53ad2387-73d8-4939-b289-237d027b5bcd" Sep 07 13:40:11.299966 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:11.299938 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-g5t5m" event={"ID":"d58ec2a6-c963-4cf8-a7d5-65877ae45e14","Type":"ContainerStarted","Data":"f2b1ae44fc1e9f7b52d2404785e615bbcc66324c3d3bdb0fbb4a1ac6f41569ca"} Sep 07 13:40:11.365677 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:11.365632 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-76bcd6ccf5-g5t5m" podStartSLOduration=1.724157382 podStartE2EDuration="4.365618524s" totalImagesPullingTime="2.641461142s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:40:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:40:11.364365616 +0000 UTC m=+82.858494948" watchObservedRunningTime="2026-09-07 13:40:11.365618524 +0000 UTC m=+82.859747855" Sep 07 13:40:12.304907 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:12.304875 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-jc5wl_53ad2387-73d8-4939-b289-237d027b5bcd/console-operator/1.log" Sep 07 13:40:12.305430 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:12.305411 2575 scope.go:117] "RemoveContainer" containerID="e1585cd502fe45043bcd62e7c6da706da21a6bc1a0c0754195f901ab95221416" Sep 07 13:40:12.305565 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:40:12.305547 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85b454874b-jc5wl_openshift-console-operator(53ad2387-73d8-4939-b289-237d027b5bcd)\"" pod="openshift-console-operator/console-operator-85b454874b-jc5wl" podUID="53ad2387-73d8-4939-b289-237d027b5bcd" Sep 07 13:40:12.565314 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:12.565223 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-lk4b9"] Sep 07 13:40:12.568270 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:12.568244 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-lk4b9" Sep 07 13:40:12.571099 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:12.571078 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 07 13:40:12.571218 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:12.571077 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 07 13:40:12.571634 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:12.571620 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-htt8z\"" Sep 07 13:40:12.585683 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:12.585661 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-lk4b9"] Sep 07 13:40:12.663037 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:12.663008 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kjlr7\" (UniqueName: \"kubernetes.io/projected/56e15401-a8c8-47ab-b7a5-c4bfd7225675-kube-api-access-kjlr7\") pod \"insights-runtime-extractor-lk4b9\" (UID: \"56e15401-a8c8-47ab-b7a5-c4bfd7225675\") " pod="openshift-insights/insights-runtime-extractor-lk4b9" Sep 07 13:40:12.663200 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:12.663056 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/56e15401-a8c8-47ab-b7a5-c4bfd7225675-crio-socket\") pod \"insights-runtime-extractor-lk4b9\" (UID: \"56e15401-a8c8-47ab-b7a5-c4bfd7225675\") " pod="openshift-insights/insights-runtime-extractor-lk4b9" Sep 07 13:40:12.663200 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:12.663126 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/56e15401-a8c8-47ab-b7a5-c4bfd7225675-data-volume\") pod \"insights-runtime-extractor-lk4b9\" (UID: \"56e15401-a8c8-47ab-b7a5-c4bfd7225675\") " pod="openshift-insights/insights-runtime-extractor-lk4b9" Sep 07 13:40:12.663200 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:12.663159 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/56e15401-a8c8-47ab-b7a5-c4bfd7225675-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lk4b9\" (UID: \"56e15401-a8c8-47ab-b7a5-c4bfd7225675\") " pod="openshift-insights/insights-runtime-extractor-lk4b9" Sep 07 13:40:12.663350 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:12.663242 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/56e15401-a8c8-47ab-b7a5-c4bfd7225675-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lk4b9\" (UID: \"56e15401-a8c8-47ab-b7a5-c4bfd7225675\") " pod="openshift-insights/insights-runtime-extractor-lk4b9" Sep 07 13:40:12.764297 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:12.764246 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/56e15401-a8c8-47ab-b7a5-c4bfd7225675-crio-socket\") pod \"insights-runtime-extractor-lk4b9\" (UID: \"56e15401-a8c8-47ab-b7a5-c4bfd7225675\") " pod="openshift-insights/insights-runtime-extractor-lk4b9" Sep 07 13:40:12.764297 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:12.764302 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/56e15401-a8c8-47ab-b7a5-c4bfd7225675-data-volume\") pod \"insights-runtime-extractor-lk4b9\" (UID: \"56e15401-a8c8-47ab-b7a5-c4bfd7225675\") " pod="openshift-insights/insights-runtime-extractor-lk4b9" Sep 07 13:40:12.764571 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:12.764326 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/56e15401-a8c8-47ab-b7a5-c4bfd7225675-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lk4b9\" (UID: \"56e15401-a8c8-47ab-b7a5-c4bfd7225675\") " pod="openshift-insights/insights-runtime-extractor-lk4b9" Sep 07 13:40:12.764571 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:12.764376 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/56e15401-a8c8-47ab-b7a5-c4bfd7225675-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lk4b9\" (UID: \"56e15401-a8c8-47ab-b7a5-c4bfd7225675\") " pod="openshift-insights/insights-runtime-extractor-lk4b9" Sep 07 13:40:12.764571 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:12.764385 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/56e15401-a8c8-47ab-b7a5-c4bfd7225675-crio-socket\") pod \"insights-runtime-extractor-lk4b9\" (UID: \"56e15401-a8c8-47ab-b7a5-c4bfd7225675\") " pod="openshift-insights/insights-runtime-extractor-lk4b9" Sep 07 13:40:12.764571 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:40:12.764454 2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 07 13:40:12.764571 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:40:12.764482 2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 07 13:40:12.764571 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:12.764454 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kjlr7\" (UniqueName: \"kubernetes.io/projected/56e15401-a8c8-47ab-b7a5-c4bfd7225675-kube-api-access-kjlr7\") pod \"insights-runtime-extractor-lk4b9\" (UID: \"56e15401-a8c8-47ab-b7a5-c4bfd7225675\") " pod="openshift-insights/insights-runtime-extractor-lk4b9" Sep 07 13:40:12.764571 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:40:12.764530 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/56e15401-a8c8-47ab-b7a5-c4bfd7225675-kube-rbac-proxy-cm podName:56e15401-a8c8-47ab-b7a5-c4bfd7225675 nodeName:}" failed. No retries permitted until 2026-09-07 13:40:13.264508876 +0000 UTC m=+84.758638191 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/56e15401-a8c8-47ab-b7a5-c4bfd7225675-kube-rbac-proxy-cm") pod "insights-runtime-extractor-lk4b9" (UID: "56e15401-a8c8-47ab-b7a5-c4bfd7225675") : configmap "kube-rbac-proxy" not found Sep 07 13:40:12.764571 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:40:12.764559 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56e15401-a8c8-47ab-b7a5-c4bfd7225675-insights-runtime-extractor-tls podName:56e15401-a8c8-47ab-b7a5-c4bfd7225675 nodeName:}" failed. No retries permitted until 2026-09-07 13:40:13.264544508 +0000 UTC m=+84.758673822 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/56e15401-a8c8-47ab-b7a5-c4bfd7225675-insights-runtime-extractor-tls") pod "insights-runtime-extractor-lk4b9" (UID: "56e15401-a8c8-47ab-b7a5-c4bfd7225675") : secret "insights-runtime-extractor-tls" not found Sep 07 13:40:12.764855 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:12.764642 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/56e15401-a8c8-47ab-b7a5-c4bfd7225675-data-volume\") pod \"insights-runtime-extractor-lk4b9\" (UID: \"56e15401-a8c8-47ab-b7a5-c4bfd7225675\") " pod="openshift-insights/insights-runtime-extractor-lk4b9" Sep 07 13:40:12.778430 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:12.778407 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kjlr7\" (UniqueName: \"kubernetes.io/projected/56e15401-a8c8-47ab-b7a5-c4bfd7225675-kube-api-access-kjlr7\") pod \"insights-runtime-extractor-lk4b9\" (UID: \"56e15401-a8c8-47ab-b7a5-c4bfd7225675\") " pod="openshift-insights/insights-runtime-extractor-lk4b9" Sep 07 13:40:13.268749 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:13.268713 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/56e15401-a8c8-47ab-b7a5-c4bfd7225675-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lk4b9\" (UID: \"56e15401-a8c8-47ab-b7a5-c4bfd7225675\") " pod="openshift-insights/insights-runtime-extractor-lk4b9" Sep 07 13:40:13.268968 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:13.268765 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/56e15401-a8c8-47ab-b7a5-c4bfd7225675-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lk4b9\" (UID: \"56e15401-a8c8-47ab-b7a5-c4bfd7225675\") " pod="openshift-insights/insights-runtime-extractor-lk4b9" Sep 07 13:40:13.268968 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:40:13.268866 2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 07 13:40:13.268968 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:40:13.268909 2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 07 13:40:13.269147 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:40:13.268920 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/56e15401-a8c8-47ab-b7a5-c4bfd7225675-kube-rbac-proxy-cm podName:56e15401-a8c8-47ab-b7a5-c4bfd7225675 nodeName:}" failed. No retries permitted until 2026-09-07 13:40:14.268907641 +0000 UTC m=+85.763036950 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/56e15401-a8c8-47ab-b7a5-c4bfd7225675-kube-rbac-proxy-cm") pod "insights-runtime-extractor-lk4b9" (UID: "56e15401-a8c8-47ab-b7a5-c4bfd7225675") : configmap "kube-rbac-proxy" not found Sep 07 13:40:13.269147 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:40:13.268996 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56e15401-a8c8-47ab-b7a5-c4bfd7225675-insights-runtime-extractor-tls podName:56e15401-a8c8-47ab-b7a5-c4bfd7225675 nodeName:}" failed. No retries permitted until 2026-09-07 13:40:14.268979423 +0000 UTC m=+85.763108738 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/56e15401-a8c8-47ab-b7a5-c4bfd7225675-insights-runtime-extractor-tls") pod "insights-runtime-extractor-lk4b9" (UID: "56e15401-a8c8-47ab-b7a5-c4bfd7225675") : secret "insights-runtime-extractor-tls" not found Sep 07 13:40:13.801849 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:13.801814 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-75d99c484-8lqdg"] Sep 07 13:40:13.803811 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:13.803778 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-75d99c484-8lqdg" Sep 07 13:40:13.808705 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:13.808687 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Sep 07 13:40:13.808986 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:13.808972 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Sep 07 13:40:13.809555 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:13.809536 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Sep 07 13:40:13.809639 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:13.809541 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Sep 07 13:40:13.809639 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:13.809608 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-xtbxr\"" Sep 07 13:40:13.817665 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:13.817646 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-75d99c484-8lqdg"] Sep 07 13:40:13.873814 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:13.873771 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sr54b\" (UniqueName: \"kubernetes.io/projected/ed508ea7-19d5-4646-bbf0-dca05558bdfa-kube-api-access-sr54b\") pod \"service-ca-75d99c484-8lqdg\" (UID: \"ed508ea7-19d5-4646-bbf0-dca05558bdfa\") " pod="openshift-service-ca/service-ca-75d99c484-8lqdg" Sep 07 13:40:13.873814 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:13.873818 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/ed508ea7-19d5-4646-bbf0-dca05558bdfa-signing-cabundle\") pod \"service-ca-75d99c484-8lqdg\" (UID: \"ed508ea7-19d5-4646-bbf0-dca05558bdfa\") " pod="openshift-service-ca/service-ca-75d99c484-8lqdg" Sep 07 13:40:13.873976 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:13.873881 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/ed508ea7-19d5-4646-bbf0-dca05558bdfa-signing-key\") pod \"service-ca-75d99c484-8lqdg\" (UID: \"ed508ea7-19d5-4646-bbf0-dca05558bdfa\") " pod="openshift-service-ca/service-ca-75d99c484-8lqdg" Sep 07 13:40:13.974817 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:13.974767 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sr54b\" (UniqueName: \"kubernetes.io/projected/ed508ea7-19d5-4646-bbf0-dca05558bdfa-kube-api-access-sr54b\") pod \"service-ca-75d99c484-8lqdg\" (UID: \"ed508ea7-19d5-4646-bbf0-dca05558bdfa\") " pod="openshift-service-ca/service-ca-75d99c484-8lqdg" Sep 07 13:40:13.974817 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:13.974820 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/ed508ea7-19d5-4646-bbf0-dca05558bdfa-signing-cabundle\") pod \"service-ca-75d99c484-8lqdg\" (UID: \"ed508ea7-19d5-4646-bbf0-dca05558bdfa\") " pod="openshift-service-ca/service-ca-75d99c484-8lqdg" Sep 07 13:40:13.975029 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:13.974856 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/ed508ea7-19d5-4646-bbf0-dca05558bdfa-signing-key\") pod \"service-ca-75d99c484-8lqdg\" (UID: \"ed508ea7-19d5-4646-bbf0-dca05558bdfa\") " pod="openshift-service-ca/service-ca-75d99c484-8lqdg" Sep 07 13:40:13.975480 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:13.975452 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/ed508ea7-19d5-4646-bbf0-dca05558bdfa-signing-cabundle\") pod \"service-ca-75d99c484-8lqdg\" (UID: \"ed508ea7-19d5-4646-bbf0-dca05558bdfa\") " pod="openshift-service-ca/service-ca-75d99c484-8lqdg" Sep 07 13:40:13.977441 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:13.977419 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/ed508ea7-19d5-4646-bbf0-dca05558bdfa-signing-key\") pod \"service-ca-75d99c484-8lqdg\" (UID: \"ed508ea7-19d5-4646-bbf0-dca05558bdfa\") " pod="openshift-service-ca/service-ca-75d99c484-8lqdg" Sep 07 13:40:13.988060 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:13.988036 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sr54b\" (UniqueName: \"kubernetes.io/projected/ed508ea7-19d5-4646-bbf0-dca05558bdfa-kube-api-access-sr54b\") pod \"service-ca-75d99c484-8lqdg\" (UID: \"ed508ea7-19d5-4646-bbf0-dca05558bdfa\") " pod="openshift-service-ca/service-ca-75d99c484-8lqdg" Sep 07 13:40:14.112805 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:14.112755 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-75d99c484-8lqdg" Sep 07 13:40:14.277571 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:14.277532 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/56e15401-a8c8-47ab-b7a5-c4bfd7225675-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lk4b9\" (UID: \"56e15401-a8c8-47ab-b7a5-c4bfd7225675\") " pod="openshift-insights/insights-runtime-extractor-lk4b9" Sep 07 13:40:14.277768 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:14.277626 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/56e15401-a8c8-47ab-b7a5-c4bfd7225675-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lk4b9\" (UID: \"56e15401-a8c8-47ab-b7a5-c4bfd7225675\") " pod="openshift-insights/insights-runtime-extractor-lk4b9" Sep 07 13:40:14.277768 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:40:14.277684 2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 07 13:40:14.277768 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:40:14.277733 2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 07 13:40:14.277928 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:40:14.277773 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/56e15401-a8c8-47ab-b7a5-c4bfd7225675-kube-rbac-proxy-cm podName:56e15401-a8c8-47ab-b7a5-c4bfd7225675 nodeName:}" failed. No retries permitted until 2026-09-07 13:40:16.277752777 +0000 UTC m=+87.771882100 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/56e15401-a8c8-47ab-b7a5-c4bfd7225675-kube-rbac-proxy-cm") pod "insights-runtime-extractor-lk4b9" (UID: "56e15401-a8c8-47ab-b7a5-c4bfd7225675") : configmap "kube-rbac-proxy" not found Sep 07 13:40:14.277928 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:40:14.277816 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56e15401-a8c8-47ab-b7a5-c4bfd7225675-insights-runtime-extractor-tls podName:56e15401-a8c8-47ab-b7a5-c4bfd7225675 nodeName:}" failed. No retries permitted until 2026-09-07 13:40:16.277805638 +0000 UTC m=+87.771934951 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/56e15401-a8c8-47ab-b7a5-c4bfd7225675-insights-runtime-extractor-tls") pod "insights-runtime-extractor-lk4b9" (UID: "56e15401-a8c8-47ab-b7a5-c4bfd7225675") : secret "insights-runtime-extractor-tls" not found Sep 07 13:40:14.384153 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:14.384084 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-75d99c484-8lqdg"] Sep 07 13:40:14.386808 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:40:14.386764 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded508ea7_19d5_4646_bbf0_dca05558bdfa.slice/crio-a0c84dac8837e1319fc89d46fa3bfd62bd04570cd1bb9cdf91a010039e8f8253 WatchSource:0}: Error finding container a0c84dac8837e1319fc89d46fa3bfd62bd04570cd1bb9cdf91a010039e8f8253: Status 404 returned error can't find the container with id a0c84dac8837e1319fc89d46fa3bfd62bd04570cd1bb9cdf91a010039e8f8253 Sep 07 13:40:15.085037 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:15.085005 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-fv7sq_ad201af3-f88e-4869-a5b7-0726f6282ee2/dns-node-resolver/0.log" Sep 07 13:40:15.315007 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:15.314965 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-75d99c484-8lqdg" event={"ID":"ed508ea7-19d5-4646-bbf0-dca05558bdfa","Type":"ContainerStarted","Data":"a0c84dac8837e1319fc89d46fa3bfd62bd04570cd1bb9cdf91a010039e8f8253"} Sep 07 13:40:16.286130 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:16.286099 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-kr8mv_0add805e-551b-40c5-8cee-8cc240585411/node-ca/0.log" Sep 07 13:40:16.296441 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:16.296407 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/56e15401-a8c8-47ab-b7a5-c4bfd7225675-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lk4b9\" (UID: \"56e15401-a8c8-47ab-b7a5-c4bfd7225675\") " pod="openshift-insights/insights-runtime-extractor-lk4b9" Sep 07 13:40:16.296587 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:16.296454 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/56e15401-a8c8-47ab-b7a5-c4bfd7225675-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lk4b9\" (UID: \"56e15401-a8c8-47ab-b7a5-c4bfd7225675\") " pod="openshift-insights/insights-runtime-extractor-lk4b9" Sep 07 13:40:16.296587 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:40:16.296536 2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 07 13:40:16.296663 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:40:16.296583 2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 07 13:40:16.296663 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:40:16.296589 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/56e15401-a8c8-47ab-b7a5-c4bfd7225675-kube-rbac-proxy-cm podName:56e15401-a8c8-47ab-b7a5-c4bfd7225675 nodeName:}" failed. No retries permitted until 2026-09-07 13:40:20.296575063 +0000 UTC m=+91.790704374 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/56e15401-a8c8-47ab-b7a5-c4bfd7225675-kube-rbac-proxy-cm") pod "insights-runtime-extractor-lk4b9" (UID: "56e15401-a8c8-47ab-b7a5-c4bfd7225675") : configmap "kube-rbac-proxy" not found Sep 07 13:40:16.296663 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:40:16.296652 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56e15401-a8c8-47ab-b7a5-c4bfd7225675-insights-runtime-extractor-tls podName:56e15401-a8c8-47ab-b7a5-c4bfd7225675 nodeName:}" failed. No retries permitted until 2026-09-07 13:40:20.296634211 +0000 UTC m=+91.790763526 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/56e15401-a8c8-47ab-b7a5-c4bfd7225675-insights-runtime-extractor-tls") pod "insights-runtime-extractor-lk4b9" (UID: "56e15401-a8c8-47ab-b7a5-c4bfd7225675") : secret "insights-runtime-extractor-tls" not found Sep 07 13:40:16.320418 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:16.320381 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-75d99c484-8lqdg" event={"ID":"ed508ea7-19d5-4646-bbf0-dca05558bdfa","Type":"ContainerStarted","Data":"50ec81e5358e87590bb9ce7496824c4b15924fd2b3a23f82381768d4fd6176fa"} Sep 07 13:40:16.342580 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:16.342535 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-75d99c484-8lqdg" podStartSLOduration=1.608639226 podStartE2EDuration="3.342519517s" totalImagesPullingTime="1.733880291s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:40:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:40:16.341150775 +0000 UTC m=+87.835280107" watchObservedRunningTime="2026-09-07 13:40:16.342519517 +0000 UTC m=+87.836648848" Sep 07 13:40:16.884961 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:16.884934 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-hx6nh_8202e703-f3f9-48f3-b51c-93f55ef79ebc/serve-healthcheck-canary/0.log" Sep 07 13:40:17.843807 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:17.842757 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-85b454874b-jc5wl" Sep 07 13:40:17.843807 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:17.842840 2575 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-85b454874b-jc5wl" Sep 07 13:40:17.843807 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:17.843242 2575 scope.go:117] "RemoveContainer" containerID="e1585cd502fe45043bcd62e7c6da706da21a6bc1a0c0754195f901ab95221416" Sep 07 13:40:17.843807 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:40:17.843416 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85b454874b-jc5wl_openshift-console-operator(53ad2387-73d8-4939-b289-237d027b5bcd)\"" pod="openshift-console-operator/console-operator-85b454874b-jc5wl" podUID="53ad2387-73d8-4939-b289-237d027b5bcd" Sep 07 13:40:20.326465 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:20.326422 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/56e15401-a8c8-47ab-b7a5-c4bfd7225675-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lk4b9\" (UID: \"56e15401-a8c8-47ab-b7a5-c4bfd7225675\") " pod="openshift-insights/insights-runtime-extractor-lk4b9" Sep 07 13:40:20.326927 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:20.326506 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/56e15401-a8c8-47ab-b7a5-c4bfd7225675-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lk4b9\" (UID: \"56e15401-a8c8-47ab-b7a5-c4bfd7225675\") " pod="openshift-insights/insights-runtime-extractor-lk4b9" Sep 07 13:40:20.326927 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:40:20.326585 2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 07 13:40:20.326927 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:40:20.326640 2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 07 13:40:20.326927 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:40:20.326663 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56e15401-a8c8-47ab-b7a5-c4bfd7225675-insights-runtime-extractor-tls podName:56e15401-a8c8-47ab-b7a5-c4bfd7225675 nodeName:}" failed. No retries permitted until 2026-09-07 13:40:28.326647883 +0000 UTC m=+99.820777197 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/56e15401-a8c8-47ab-b7a5-c4bfd7225675-insights-runtime-extractor-tls") pod "insights-runtime-extractor-lk4b9" (UID: "56e15401-a8c8-47ab-b7a5-c4bfd7225675") : secret "insights-runtime-extractor-tls" not found Sep 07 13:40:20.326927 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:40:20.326701 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/56e15401-a8c8-47ab-b7a5-c4bfd7225675-kube-rbac-proxy-cm podName:56e15401-a8c8-47ab-b7a5-c4bfd7225675 nodeName:}" failed. No retries permitted until 2026-09-07 13:40:28.326682355 +0000 UTC m=+99.820811685 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/56e15401-a8c8-47ab-b7a5-c4bfd7225675-kube-rbac-proxy-cm") pod "insights-runtime-extractor-lk4b9" (UID: "56e15401-a8c8-47ab-b7a5-c4bfd7225675") : configmap "kube-rbac-proxy" not found Sep 07 13:40:26.873895 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:26.873849 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/862d7f09-8baa-4fe7-a00a-1dd31feb354c-metrics-tls\") pod \"dns-default-8s8pc\" (UID: \"862d7f09-8baa-4fe7-a00a-1dd31feb354c\") " pod="openshift-dns/dns-default-8s8pc" Sep 07 13:40:26.874367 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:26.873920 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e7b30596-01a1-4b88-b841-786c2fc17b86-registry-tls\") pod \"image-registry-575cbc495d-tf4vt\" (UID: \"e7b30596-01a1-4b88-b841-786c2fc17b86\") " pod="openshift-image-registry/image-registry-575cbc495d-tf4vt" Sep 07 13:40:26.876311 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:26.876287 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/862d7f09-8baa-4fe7-a00a-1dd31feb354c-metrics-tls\") pod \"dns-default-8s8pc\" (UID: \"862d7f09-8baa-4fe7-a00a-1dd31feb354c\") " pod="openshift-dns/dns-default-8s8pc" Sep 07 13:40:26.876484 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:26.876469 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e7b30596-01a1-4b88-b841-786c2fc17b86-registry-tls\") pod \"image-registry-575cbc495d-tf4vt\" (UID: \"e7b30596-01a1-4b88-b841-786c2fc17b86\") " pod="openshift-image-registry/image-registry-575cbc495d-tf4vt" Sep 07 13:40:27.145899 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:27.145826 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-fczv6\"" Sep 07 13:40:27.152566 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:27.152542 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-575cbc495d-tf4vt" Sep 07 13:40:27.159023 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:27.159006 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-bgvq7\"" Sep 07 13:40:27.166962 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:27.166937 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8s8pc" Sep 07 13:40:27.443376 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:27.443308 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-575cbc495d-tf4vt"] Sep 07 13:40:27.446456 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:40:27.446424 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7b30596_01a1_4b88_b841_786c2fc17b86.slice/crio-d8bfc5078a0e7e8d1792e3ef5cd0cce5d269b53473ad03da273b85a6026fd5cd WatchSource:0}: Error finding container d8bfc5078a0e7e8d1792e3ef5cd0cce5d269b53473ad03da273b85a6026fd5cd: Status 404 returned error can't find the container with id d8bfc5078a0e7e8d1792e3ef5cd0cce5d269b53473ad03da273b85a6026fd5cd Sep 07 13:40:27.452185 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:27.452164 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-8s8pc"] Sep 07 13:40:27.455977 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:40:27.455954 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod862d7f09_8baa_4fe7_a00a_1dd31feb354c.slice/crio-09559b80f98d4be8f566c79a7cfcadbe7d98c037e401845c56f0e4f878f647a8 WatchSource:0}: Error finding container 09559b80f98d4be8f566c79a7cfcadbe7d98c037e401845c56f0e4f878f647a8: Status 404 returned error can't find the container with id 09559b80f98d4be8f566c79a7cfcadbe7d98c037e401845c56f0e4f878f647a8 Sep 07 13:40:28.356597 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:28.356559 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8s8pc" event={"ID":"862d7f09-8baa-4fe7-a00a-1dd31feb354c","Type":"ContainerStarted","Data":"09559b80f98d4be8f566c79a7cfcadbe7d98c037e401845c56f0e4f878f647a8"} Sep 07 13:40:28.358000 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:28.357975 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-575cbc495d-tf4vt" event={"ID":"e7b30596-01a1-4b88-b841-786c2fc17b86","Type":"ContainerStarted","Data":"0465e5d0b4d900791457ad119c8e743a76bb7bde3432e4f2ab3cc54a1320b641"} Sep 07 13:40:28.358067 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:28.358020 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-575cbc495d-tf4vt" event={"ID":"e7b30596-01a1-4b88-b841-786c2fc17b86","Type":"ContainerStarted","Data":"d8bfc5078a0e7e8d1792e3ef5cd0cce5d269b53473ad03da273b85a6026fd5cd"} Sep 07 13:40:28.358135 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:28.358115 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-575cbc495d-tf4vt" Sep 07 13:40:28.385800 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:28.385751 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/56e15401-a8c8-47ab-b7a5-c4bfd7225675-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lk4b9\" (UID: \"56e15401-a8c8-47ab-b7a5-c4bfd7225675\") " pod="openshift-insights/insights-runtime-extractor-lk4b9" Sep 07 13:40:28.385917 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:28.385838 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/56e15401-a8c8-47ab-b7a5-c4bfd7225675-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lk4b9\" (UID: \"56e15401-a8c8-47ab-b7a5-c4bfd7225675\") " pod="openshift-insights/insights-runtime-extractor-lk4b9" Sep 07 13:40:28.386393 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:28.386367 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/56e15401-a8c8-47ab-b7a5-c4bfd7225675-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lk4b9\" (UID: \"56e15401-a8c8-47ab-b7a5-c4bfd7225675\") " pod="openshift-insights/insights-runtime-extractor-lk4b9" Sep 07 13:40:28.387685 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:28.387642 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-575cbc495d-tf4vt" podStartSLOduration=98.38762758 podStartE2EDuration="1m38.38762758s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:38:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:40:28.38582497 +0000 UTC m=+99.879954302" watchObservedRunningTime="2026-09-07 13:40:28.38762758 +0000 UTC m=+99.881756912" Sep 07 13:40:28.388466 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:28.388449 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/56e15401-a8c8-47ab-b7a5-c4bfd7225675-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lk4b9\" (UID: \"56e15401-a8c8-47ab-b7a5-c4bfd7225675\") " pod="openshift-insights/insights-runtime-extractor-lk4b9" Sep 07 13:40:28.476239 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:28.476204 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-lk4b9" Sep 07 13:40:28.770446 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:28.770341 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-lk4b9"] Sep 07 13:40:28.773936 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:40:28.773909 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56e15401_a8c8_47ab_b7a5_c4bfd7225675.slice/crio-7c2f8887f3213f394d7cf01b5fa4cce54bcdd9cd24661f4500c4ffce57a8afdb WatchSource:0}: Error finding container 7c2f8887f3213f394d7cf01b5fa4cce54bcdd9cd24661f4500c4ffce57a8afdb: Status 404 returned error can't find the container with id 7c2f8887f3213f394d7cf01b5fa4cce54bcdd9cd24661f4500c4ffce57a8afdb Sep 07 13:40:29.363196 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:29.363159 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lk4b9" event={"ID":"56e15401-a8c8-47ab-b7a5-c4bfd7225675","Type":"ContainerStarted","Data":"d559d0e4fcf9e3bce6ce11f972d07e8d60531af38f7e6461018af1460b0a0aef"} Sep 07 13:40:29.363640 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:29.363229 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lk4b9" event={"ID":"56e15401-a8c8-47ab-b7a5-c4bfd7225675","Type":"ContainerStarted","Data":"7c2f8887f3213f394d7cf01b5fa4cce54bcdd9cd24661f4500c4ffce57a8afdb"} Sep 07 13:40:30.368935 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:30.368896 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8s8pc" event={"ID":"862d7f09-8baa-4fe7-a00a-1dd31feb354c","Type":"ContainerStarted","Data":"e2c4864ec917bebd55a0dd9c0f77d1fda34ed798ce5711ff59661f9325e864d0"} Sep 07 13:40:30.369395 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:30.368958 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8s8pc" event={"ID":"862d7f09-8baa-4fe7-a00a-1dd31feb354c","Type":"ContainerStarted","Data":"c3c875950109f0bc3b15ad7915df572bb63282a00d39a79ac4bf7ddc16ba0067"} Sep 07 13:40:30.369395 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:30.368998 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-8s8pc" Sep 07 13:40:30.370921 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:30.370890 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lk4b9" event={"ID":"56e15401-a8c8-47ab-b7a5-c4bfd7225675","Type":"ContainerStarted","Data":"0d37cab0b6d2fa6f39bdf947c1b0a6ad5aebc2b193f95aa7ccb126385e538fb0"} Sep 07 13:40:30.989070 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:30.989033 2575 scope.go:117] "RemoveContainer" containerID="e1585cd502fe45043bcd62e7c6da706da21a6bc1a0c0754195f901ab95221416" Sep 07 13:40:31.266760 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:31.266685 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-tp5h2" Sep 07 13:40:31.292039 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:31.291977 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-8s8pc" podStartSLOduration=67.218980218 podStartE2EDuration="1m9.291958772s" totalImagesPullingTime="2.072978554s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:39:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:40:30.39450296 +0000 UTC m=+101.888632292" watchObservedRunningTime="2026-09-07 13:40:31.291958772 +0000 UTC m=+102.786088103" Sep 07 13:40:31.377647 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:31.377623 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-jc5wl_53ad2387-73d8-4939-b289-237d027b5bcd/console-operator/1.log" Sep 07 13:40:31.378072 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:31.377749 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-jc5wl" event={"ID":"53ad2387-73d8-4939-b289-237d027b5bcd","Type":"ContainerStarted","Data":"cb8ab2461f4c758e22e634ec2830e9afa04bec429264599e1228c5d23d91bb1e"} Sep 07 13:40:31.378169 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:31.378147 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-85b454874b-jc5wl" Sep 07 13:40:32.033323 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:32.033290 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-85b454874b-jc5wl" Sep 07 13:40:32.059982 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:32.059881 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-85b454874b-jc5wl" podStartSLOduration=23.220914654 podStartE2EDuration="25.059864881s" totalImagesPullingTime="1.838950227s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:40:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:40:31.405101366 +0000 UTC m=+102.899230696" watchObservedRunningTime="2026-09-07 13:40:32.059864881 +0000 UTC m=+103.553994211" Sep 07 13:40:32.382882 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:32.382850 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lk4b9" event={"ID":"56e15401-a8c8-47ab-b7a5-c4bfd7225675","Type":"ContainerStarted","Data":"1dccf842108b6b18fdb44aa01a31de408aa02cafc4e80d1515191179837da3ca"} Sep 07 13:40:32.510306 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:32.510250 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-lk4b9" podStartSLOduration=17.931603916 podStartE2EDuration="20.510231691s" totalImagesPullingTime="2.578627775s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 13:40:12 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:40:32.453949217 +0000 UTC m=+103.948078548" watchObservedRunningTime="2026-09-07 13:40:32.510231691 +0000 UTC m=+104.004361021" Sep 07 13:40:32.510663 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:32.510650 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c7dfbfd6b-mfbq9"] Sep 07 13:40:32.534679 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:32.534655 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c7dfbfd6b-mfbq9"] Sep 07 13:40:32.534838 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:32.534734 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c7dfbfd6b-mfbq9" Sep 07 13:40:32.542207 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:32.542100 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-ntsl2\"" Sep 07 13:40:32.542207 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:32.542167 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Sep 07 13:40:32.542329 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:32.542248 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Sep 07 13:40:32.542329 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:32.542100 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Sep 07 13:40:32.542471 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:32.542451 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Sep 07 13:40:32.622295 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:32.622262 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e1de759a-d979-4d25-972d-bd46c150e435-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7c7dfbfd6b-mfbq9\" (UID: \"e1de759a-d979-4d25-972d-bd46c150e435\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c7dfbfd6b-mfbq9" Sep 07 13:40:32.622455 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:32.622334 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n2rs8\" (UniqueName: \"kubernetes.io/projected/e1de759a-d979-4d25-972d-bd46c150e435-kube-api-access-n2rs8\") pod \"managed-serviceaccount-addon-agent-7c7dfbfd6b-mfbq9\" (UID: \"e1de759a-d979-4d25-972d-bd46c150e435\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c7dfbfd6b-mfbq9" Sep 07 13:40:32.624564 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:32.624534 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-w6twf"] Sep 07 13:40:32.640948 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:32.640886 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-685456655f-w6twf" Sep 07 13:40:32.644997 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:32.644974 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-7j2g7\"" Sep 07 13:40:32.645106 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:32.645049 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-w6twf"] Sep 07 13:40:32.723215 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:32.723185 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n2rs8\" (UniqueName: \"kubernetes.io/projected/e1de759a-d979-4d25-972d-bd46c150e435-kube-api-access-n2rs8\") pod \"managed-serviceaccount-addon-agent-7c7dfbfd6b-mfbq9\" (UID: \"e1de759a-d979-4d25-972d-bd46c150e435\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c7dfbfd6b-mfbq9" Sep 07 13:40:32.723377 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:32.723226 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e1de759a-d979-4d25-972d-bd46c150e435-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7c7dfbfd6b-mfbq9\" (UID: \"e1de759a-d979-4d25-972d-bd46c150e435\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c7dfbfd6b-mfbq9" Sep 07 13:40:32.723377 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:32.723292 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-94gzf\" (UniqueName: \"kubernetes.io/projected/776aae63-c0cd-4f11-8094-464f103b1411-kube-api-access-94gzf\") pod \"network-check-source-685456655f-w6twf\" (UID: \"776aae63-c0cd-4f11-8094-464f103b1411\") " pod="openshift-network-diagnostics/network-check-source-685456655f-w6twf" Sep 07 13:40:32.726048 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:32.726021 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e1de759a-d979-4d25-972d-bd46c150e435-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7c7dfbfd6b-mfbq9\" (UID: \"e1de759a-d979-4d25-972d-bd46c150e435\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c7dfbfd6b-mfbq9" Sep 07 13:40:32.727680 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:32.727661 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-85d98c998f-bfcpr"] Sep 07 13:40:32.742821 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:32.742770 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n2rs8\" (UniqueName: \"kubernetes.io/projected/e1de759a-d979-4d25-972d-bd46c150e435-kube-api-access-n2rs8\") pod \"managed-serviceaccount-addon-agent-7c7dfbfd6b-mfbq9\" (UID: \"e1de759a-d979-4d25-972d-bd46c150e435\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c7dfbfd6b-mfbq9" Sep 07 13:40:32.743100 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:32.743084 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-85d98c998f-bfcpr" Sep 07 13:40:32.749532 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:32.749509 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Sep 07 13:40:32.749691 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:32.749673 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Sep 07 13:40:32.749822 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:32.749778 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-z4gcn\"" Sep 07 13:40:32.751338 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:32.751316 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-85d98c998f-bfcpr"] Sep 07 13:40:32.824650 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:32.824619 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-94gzf\" (UniqueName: \"kubernetes.io/projected/776aae63-c0cd-4f11-8094-464f103b1411-kube-api-access-94gzf\") pod \"network-check-source-685456655f-w6twf\" (UID: \"776aae63-c0cd-4f11-8094-464f103b1411\") " pod="openshift-network-diagnostics/network-check-source-685456655f-w6twf" Sep 07 13:40:32.824863 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:32.824656 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t8z5v\" (UniqueName: \"kubernetes.io/projected/e561ca49-a4db-4e7a-be5a-6e05a9cda274-kube-api-access-t8z5v\") pod \"downloads-85d98c998f-bfcpr\" (UID: \"e561ca49-a4db-4e7a-be5a-6e05a9cda274\") " pod="openshift-console/downloads-85d98c998f-bfcpr" Sep 07 13:40:32.837275 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:32.837250 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-94gzf\" (UniqueName: \"kubernetes.io/projected/776aae63-c0cd-4f11-8094-464f103b1411-kube-api-access-94gzf\") pod \"network-check-source-685456655f-w6twf\" (UID: \"776aae63-c0cd-4f11-8094-464f103b1411\") " pod="openshift-network-diagnostics/network-check-source-685456655f-w6twf" Sep 07 13:40:32.853089 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:32.853069 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c7dfbfd6b-mfbq9" Sep 07 13:40:32.925723 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:32.925687 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t8z5v\" (UniqueName: \"kubernetes.io/projected/e561ca49-a4db-4e7a-be5a-6e05a9cda274-kube-api-access-t8z5v\") pod \"downloads-85d98c998f-bfcpr\" (UID: \"e561ca49-a4db-4e7a-be5a-6e05a9cda274\") " pod="openshift-console/downloads-85d98c998f-bfcpr" Sep 07 13:40:32.950652 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:32.950618 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-685456655f-w6twf" Sep 07 13:40:32.955961 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:32.955929 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t8z5v\" (UniqueName: \"kubernetes.io/projected/e561ca49-a4db-4e7a-be5a-6e05a9cda274-kube-api-access-t8z5v\") pod \"downloads-85d98c998f-bfcpr\" (UID: \"e561ca49-a4db-4e7a-be5a-6e05a9cda274\") " pod="openshift-console/downloads-85d98c998f-bfcpr" Sep 07 13:40:33.057351 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:33.057323 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-85d98c998f-bfcpr" Sep 07 13:40:33.164114 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:33.164043 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c7dfbfd6b-mfbq9"] Sep 07 13:40:33.166829 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:40:33.166801 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode1de759a_d979_4d25_972d_bd46c150e435.slice/crio-b1bd4c451f9ff0d9e450a8db58ce4ba729e63c39ae24104d70c67d1b8b7e6404 WatchSource:0}: Error finding container b1bd4c451f9ff0d9e450a8db58ce4ba729e63c39ae24104d70c67d1b8b7e6404: Status 404 returned error can't find the container with id b1bd4c451f9ff0d9e450a8db58ce4ba729e63c39ae24104d70c67d1b8b7e6404 Sep 07 13:40:33.253398 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:33.253367 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-w6twf"] Sep 07 13:40:33.255844 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:40:33.255820 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod776aae63_c0cd_4f11_8094_464f103b1411.slice/crio-bb0ca5e696a9a102055d47da1a16c4e68fb8cb56967c710eae1a5be419734c5e WatchSource:0}: Error finding container bb0ca5e696a9a102055d47da1a16c4e68fb8cb56967c710eae1a5be419734c5e: Status 404 returned error can't find the container with id bb0ca5e696a9a102055d47da1a16c4e68fb8cb56967c710eae1a5be419734c5e Sep 07 13:40:33.387441 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:33.387406 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-685456655f-w6twf" event={"ID":"776aae63-c0cd-4f11-8094-464f103b1411","Type":"ContainerStarted","Data":"0105a9ae57bed6708dc465f225849b831f97c029b1814e959848d29277606118"} Sep 07 13:40:33.387876 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:33.387499 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-685456655f-w6twf" event={"ID":"776aae63-c0cd-4f11-8094-464f103b1411","Type":"ContainerStarted","Data":"bb0ca5e696a9a102055d47da1a16c4e68fb8cb56967c710eae1a5be419734c5e"} Sep 07 13:40:33.388803 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:33.388760 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c7dfbfd6b-mfbq9" event={"ID":"e1de759a-d979-4d25-972d-bd46c150e435","Type":"ContainerStarted","Data":"b1bd4c451f9ff0d9e450a8db58ce4ba729e63c39ae24104d70c67d1b8b7e6404"} Sep 07 13:40:33.390737 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:33.390713 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-85d98c998f-bfcpr"] Sep 07 13:40:33.392987 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:40:33.392963 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode561ca49_a4db_4e7a_be5a_6e05a9cda274.slice/crio-67e0de6b5df51e6f9ef1edbfc0e7dc0f9f9732485d72e05374c8c55bc006385b WatchSource:0}: Error finding container 67e0de6b5df51e6f9ef1edbfc0e7dc0f9f9732485d72e05374c8c55bc006385b: Status 404 returned error can't find the container with id 67e0de6b5df51e6f9ef1edbfc0e7dc0f9f9732485d72e05374c8c55bc006385b Sep 07 13:40:33.479172 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:33.479074 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-685456655f-w6twf" podStartSLOduration=1.4790584660000001 podStartE2EDuration="1.479058466s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:40:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:40:33.476897467 +0000 UTC m=+104.971026797" watchObservedRunningTime="2026-09-07 13:40:33.479058466 +0000 UTC m=+104.973187793" Sep 07 13:40:34.395310 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:34.395228 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-85d98c998f-bfcpr" event={"ID":"e561ca49-a4db-4e7a-be5a-6e05a9cda274","Type":"ContainerStarted","Data":"67e0de6b5df51e6f9ef1edbfc0e7dc0f9f9732485d72e05374c8c55bc006385b"} Sep 07 13:40:36.406196 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:36.406160 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c7dfbfd6b-mfbq9" event={"ID":"e1de759a-d979-4d25-972d-bd46c150e435","Type":"ContainerStarted","Data":"5166c35d099ac4fed9ad516fcfcd74067668edc0fbfc132e62d424c6a142f2f1"} Sep 07 13:40:36.430967 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:36.430914 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c7dfbfd6b-mfbq9" podStartSLOduration=1.303241495 podStartE2EDuration="4.430898292s" totalImagesPullingTime="3.127656797s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:40:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:40:36.430157799 +0000 UTC m=+107.924287130" watchObservedRunningTime="2026-09-07 13:40:36.430898292 +0000 UTC m=+107.925027622" Sep 07 13:40:40.380141 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:40.380104 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-8s8pc" Sep 07 13:40:41.894675 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:41.894637 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-777b7789f7-v8lgp"] Sep 07 13:40:41.900776 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:41.900747 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-777b7789f7-v8lgp" Sep 07 13:40:41.907814 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:41.907772 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Sep 07 13:40:41.908287 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:41.908270 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Sep 07 13:40:41.909637 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:41.909616 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Sep 07 13:40:41.909891 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:41.909871 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-vp8ff\"" Sep 07 13:40:41.910191 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:41.910176 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Sep 07 13:40:41.910279 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:41.910259 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Sep 07 13:40:41.928674 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:41.928654 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-777b7789f7-v8lgp"] Sep 07 13:40:41.998646 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:41.998615 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bb093481-1db5-4cc6-9174-01727a3f4b69-console-serving-cert\") pod \"console-777b7789f7-v8lgp\" (UID: \"bb093481-1db5-4cc6-9174-01727a3f4b69\") " pod="openshift-console/console-777b7789f7-v8lgp" Sep 07 13:40:41.998854 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:41.998673 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bb093481-1db5-4cc6-9174-01727a3f4b69-service-ca\") pod \"console-777b7789f7-v8lgp\" (UID: \"bb093481-1db5-4cc6-9174-01727a3f4b69\") " pod="openshift-console/console-777b7789f7-v8lgp" Sep 07 13:40:41.998854 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:41.998740 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bb093481-1db5-4cc6-9174-01727a3f4b69-console-oauth-config\") pod \"console-777b7789f7-v8lgp\" (UID: \"bb093481-1db5-4cc6-9174-01727a3f4b69\") " pod="openshift-console/console-777b7789f7-v8lgp" Sep 07 13:40:41.998854 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:41.998774 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bb093481-1db5-4cc6-9174-01727a3f4b69-console-config\") pod \"console-777b7789f7-v8lgp\" (UID: \"bb093481-1db5-4cc6-9174-01727a3f4b69\") " pod="openshift-console/console-777b7789f7-v8lgp" Sep 07 13:40:41.998854 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:41.998838 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bb093481-1db5-4cc6-9174-01727a3f4b69-oauth-serving-cert\") pod \"console-777b7789f7-v8lgp\" (UID: \"bb093481-1db5-4cc6-9174-01727a3f4b69\") " pod="openshift-console/console-777b7789f7-v8lgp" Sep 07 13:40:41.999015 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:41.998861 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t7sfp\" (UniqueName: \"kubernetes.io/projected/bb093481-1db5-4cc6-9174-01727a3f4b69-kube-api-access-t7sfp\") pod \"console-777b7789f7-v8lgp\" (UID: \"bb093481-1db5-4cc6-9174-01727a3f4b69\") " pod="openshift-console/console-777b7789f7-v8lgp" Sep 07 13:40:42.099386 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:42.099347 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bb093481-1db5-4cc6-9174-01727a3f4b69-console-serving-cert\") pod \"console-777b7789f7-v8lgp\" (UID: \"bb093481-1db5-4cc6-9174-01727a3f4b69\") " pod="openshift-console/console-777b7789f7-v8lgp" Sep 07 13:40:42.099563 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:42.099413 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bb093481-1db5-4cc6-9174-01727a3f4b69-service-ca\") pod \"console-777b7789f7-v8lgp\" (UID: \"bb093481-1db5-4cc6-9174-01727a3f4b69\") " pod="openshift-console/console-777b7789f7-v8lgp" Sep 07 13:40:42.099563 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:42.099451 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bb093481-1db5-4cc6-9174-01727a3f4b69-console-oauth-config\") pod \"console-777b7789f7-v8lgp\" (UID: \"bb093481-1db5-4cc6-9174-01727a3f4b69\") " pod="openshift-console/console-777b7789f7-v8lgp" Sep 07 13:40:42.099563 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:42.099475 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bb093481-1db5-4cc6-9174-01727a3f4b69-console-config\") pod \"console-777b7789f7-v8lgp\" (UID: \"bb093481-1db5-4cc6-9174-01727a3f4b69\") " pod="openshift-console/console-777b7789f7-v8lgp" Sep 07 13:40:42.099563 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:42.099494 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bb093481-1db5-4cc6-9174-01727a3f4b69-oauth-serving-cert\") pod \"console-777b7789f7-v8lgp\" (UID: \"bb093481-1db5-4cc6-9174-01727a3f4b69\") " pod="openshift-console/console-777b7789f7-v8lgp" Sep 07 13:40:42.099563 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:42.099522 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t7sfp\" (UniqueName: \"kubernetes.io/projected/bb093481-1db5-4cc6-9174-01727a3f4b69-kube-api-access-t7sfp\") pod \"console-777b7789f7-v8lgp\" (UID: \"bb093481-1db5-4cc6-9174-01727a3f4b69\") " pod="openshift-console/console-777b7789f7-v8lgp" Sep 07 13:40:42.100838 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:42.100811 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bb093481-1db5-4cc6-9174-01727a3f4b69-service-ca\") pod \"console-777b7789f7-v8lgp\" (UID: \"bb093481-1db5-4cc6-9174-01727a3f4b69\") " pod="openshift-console/console-777b7789f7-v8lgp" Sep 07 13:40:42.100955 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:42.100903 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bb093481-1db5-4cc6-9174-01727a3f4b69-console-config\") pod \"console-777b7789f7-v8lgp\" (UID: \"bb093481-1db5-4cc6-9174-01727a3f4b69\") " pod="openshift-console/console-777b7789f7-v8lgp" Sep 07 13:40:42.101021 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:42.100913 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bb093481-1db5-4cc6-9174-01727a3f4b69-oauth-serving-cert\") pod \"console-777b7789f7-v8lgp\" (UID: \"bb093481-1db5-4cc6-9174-01727a3f4b69\") " pod="openshift-console/console-777b7789f7-v8lgp" Sep 07 13:40:42.102473 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:42.102450 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bb093481-1db5-4cc6-9174-01727a3f4b69-console-serving-cert\") pod \"console-777b7789f7-v8lgp\" (UID: \"bb093481-1db5-4cc6-9174-01727a3f4b69\") " pod="openshift-console/console-777b7789f7-v8lgp" Sep 07 13:40:42.102640 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:42.102623 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bb093481-1db5-4cc6-9174-01727a3f4b69-console-oauth-config\") pod \"console-777b7789f7-v8lgp\" (UID: \"bb093481-1db5-4cc6-9174-01727a3f4b69\") " pod="openshift-console/console-777b7789f7-v8lgp" Sep 07 13:40:42.120254 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:42.120227 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t7sfp\" (UniqueName: \"kubernetes.io/projected/bb093481-1db5-4cc6-9174-01727a3f4b69-kube-api-access-t7sfp\") pod \"console-777b7789f7-v8lgp\" (UID: \"bb093481-1db5-4cc6-9174-01727a3f4b69\") " pod="openshift-console/console-777b7789f7-v8lgp" Sep 07 13:40:42.212499 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:42.212293 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-777b7789f7-v8lgp" Sep 07 13:40:42.513187 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:42.513053 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-777b7789f7-v8lgp"] Sep 07 13:40:42.516072 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:40:42.516042 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb093481_1db5_4cc6_9174_01727a3f4b69.slice/crio-b22dd54bc04efb6febcf84512260fec085b3220959a59de52b3a15bbdc44ecb6 WatchSource:0}: Error finding container b22dd54bc04efb6febcf84512260fec085b3220959a59de52b3a15bbdc44ecb6: Status 404 returned error can't find the container with id b22dd54bc04efb6febcf84512260fec085b3220959a59de52b3a15bbdc44ecb6 Sep 07 13:40:43.434076 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:43.434035 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-777b7789f7-v8lgp" event={"ID":"bb093481-1db5-4cc6-9174-01727a3f4b69","Type":"ContainerStarted","Data":"b22dd54bc04efb6febcf84512260fec085b3220959a59de52b3a15bbdc44ecb6"} Sep 07 13:40:47.158366 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:47.158329 2575 patch_prober.go:28] interesting pod/image-registry-575cbc495d-tf4vt container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Sep 07 13:40:47.158884 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:47.158395 2575 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-575cbc495d-tf4vt" podUID="e7b30596-01a1-4b88-b841-786c2fc17b86" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 07 13:40:49.369333 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:49.369299 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-575cbc495d-tf4vt" Sep 07 13:40:49.719809 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:49.718849 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-9tlcd"] Sep 07 13:40:49.722405 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:49.722384 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-74cb57df7-9tlcd" Sep 07 13:40:49.728956 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:49.728929 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Sep 07 13:40:49.729310 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:49.729005 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 07 13:40:49.731774 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:49.731746 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 07 13:40:49.733305 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:49.732295 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 07 13:40:49.733599 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:49.733468 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-zdf85\"" Sep 07 13:40:49.734386 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:49.734021 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Sep 07 13:40:49.734386 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:49.734219 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Sep 07 13:40:49.746608 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:49.746582 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-vqdpl"] Sep 07 13:40:49.751637 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:49.751468 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-9tlcd"] Sep 07 13:40:49.751637 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:49.751582 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-vqdpl" Sep 07 13:40:49.755866 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:49.755679 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Sep 07 13:40:49.759395 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:49.759365 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Sep 07 13:40:49.759395 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:49.759365 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-c6jld\"" Sep 07 13:40:49.779013 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:49.778986 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-vqdpl"] Sep 07 13:40:49.790386 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:49.790339 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-fnm2w"] Sep 07 13:40:49.792690 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:49.792668 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-fnm2w" Sep 07 13:40:49.795493 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:49.795473 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-xv7pt\"" Sep 07 13:40:49.796459 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:49.796441 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 07 13:40:49.796575 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:49.796466 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 07 13:40:49.796900 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:49.796881 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 07 13:40:49.860379 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:49.860346 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d8934e23-a96f-4f31-bca4-40e7e70639c0-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-9tlcd\" (UID: \"d8934e23-a96f-4f31-bca4-40e7e70639c0\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-9tlcd" Sep 07 13:40:49.860543 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:49.860430 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/277b3ee2-b16f-40cb-b865-c70046a4f8e8-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-vqdpl\" (UID: \"277b3ee2-b16f-40cb-b865-c70046a4f8e8\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-vqdpl" Sep 07 13:40:49.860543 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:49.860482 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vprld\" (UniqueName: \"kubernetes.io/projected/d8934e23-a96f-4f31-bca4-40e7e70639c0-kube-api-access-vprld\") pod \"kube-state-metrics-74cb57df7-9tlcd\" (UID: \"d8934e23-a96f-4f31-bca4-40e7e70639c0\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-9tlcd" Sep 07 13:40:49.860543 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:49.860508 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/d8934e23-a96f-4f31-bca4-40e7e70639c0-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-9tlcd\" (UID: \"d8934e23-a96f-4f31-bca4-40e7e70639c0\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-9tlcd" Sep 07 13:40:49.860543 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:49.860541 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d8934e23-a96f-4f31-bca4-40e7e70639c0-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-9tlcd\" (UID: \"d8934e23-a96f-4f31-bca4-40e7e70639c0\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-9tlcd" Sep 07 13:40:49.860711 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:49.860616 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/277b3ee2-b16f-40cb-b865-c70046a4f8e8-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-vqdpl\" (UID: \"277b3ee2-b16f-40cb-b865-c70046a4f8e8\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-vqdpl" Sep 07 13:40:49.860711 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:49.860645 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/d8934e23-a96f-4f31-bca4-40e7e70639c0-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-9tlcd\" (UID: \"d8934e23-a96f-4f31-bca4-40e7e70639c0\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-9tlcd" Sep 07 13:40:49.860711 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:49.860672 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d8934e23-a96f-4f31-bca4-40e7e70639c0-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-9tlcd\" (UID: \"d8934e23-a96f-4f31-bca4-40e7e70639c0\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-9tlcd" Sep 07 13:40:49.860711 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:49.860691 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pzctt\" (UniqueName: \"kubernetes.io/projected/277b3ee2-b16f-40cb-b865-c70046a4f8e8-kube-api-access-pzctt\") pod \"openshift-state-metrics-657fd6c54-vqdpl\" (UID: \"277b3ee2-b16f-40cb-b865-c70046a4f8e8\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-vqdpl" Sep 07 13:40:49.860899 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:49.860752 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/277b3ee2-b16f-40cb-b865-c70046a4f8e8-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-vqdpl\" (UID: \"277b3ee2-b16f-40cb-b865-c70046a4f8e8\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-vqdpl" Sep 07 13:40:49.961407 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:49.961378 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/277b3ee2-b16f-40cb-b865-c70046a4f8e8-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-vqdpl\" (UID: \"277b3ee2-b16f-40cb-b865-c70046a4f8e8\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-vqdpl" Sep 07 13:40:49.961517 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:49.961417 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/48d72f65-6e57-4f7d-817b-09f37c89080d-node-exporter-accelerators-collector-config\") pod \"node-exporter-fnm2w\" (UID: \"48d72f65-6e57-4f7d-817b-09f37c89080d\") " pod="openshift-monitoring/node-exporter-fnm2w" Sep 07 13:40:49.961517 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:49.961474 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/48d72f65-6e57-4f7d-817b-09f37c89080d-root\") pod \"node-exporter-fnm2w\" (UID: \"48d72f65-6e57-4f7d-817b-09f37c89080d\") " pod="openshift-monitoring/node-exporter-fnm2w" Sep 07 13:40:49.961517 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:49.961503 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/d8934e23-a96f-4f31-bca4-40e7e70639c0-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-9tlcd\" (UID: \"d8934e23-a96f-4f31-bca4-40e7e70639c0\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-9tlcd" Sep 07 13:40:49.961673 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:49.961533 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d8934e23-a96f-4f31-bca4-40e7e70639c0-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-9tlcd\" (UID: \"d8934e23-a96f-4f31-bca4-40e7e70639c0\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-9tlcd" Sep 07 13:40:49.961673 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:49.961559 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pzctt\" (UniqueName: \"kubernetes.io/projected/277b3ee2-b16f-40cb-b865-c70046a4f8e8-kube-api-access-pzctt\") pod \"openshift-state-metrics-657fd6c54-vqdpl\" (UID: \"277b3ee2-b16f-40cb-b865-c70046a4f8e8\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-vqdpl" Sep 07 13:40:49.961771 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:49.961668 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/48d72f65-6e57-4f7d-817b-09f37c89080d-node-exporter-textfile\") pod \"node-exporter-fnm2w\" (UID: \"48d72f65-6e57-4f7d-817b-09f37c89080d\") " pod="openshift-monitoring/node-exporter-fnm2w" Sep 07 13:40:49.961771 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:49.961736 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/277b3ee2-b16f-40cb-b865-c70046a4f8e8-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-vqdpl\" (UID: \"277b3ee2-b16f-40cb-b865-c70046a4f8e8\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-vqdpl" Sep 07 13:40:49.961896 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:49.961798 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/48d72f65-6e57-4f7d-817b-09f37c89080d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fnm2w\" (UID: \"48d72f65-6e57-4f7d-817b-09f37c89080d\") " pod="openshift-monitoring/node-exporter-fnm2w" Sep 07 13:40:49.961896 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:49.961825 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pmrql\" (UniqueName: \"kubernetes.io/projected/48d72f65-6e57-4f7d-817b-09f37c89080d-kube-api-access-pmrql\") pod \"node-exporter-fnm2w\" (UID: \"48d72f65-6e57-4f7d-817b-09f37c89080d\") " pod="openshift-monitoring/node-exporter-fnm2w" Sep 07 13:40:49.961896 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:49.961852 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/48d72f65-6e57-4f7d-817b-09f37c89080d-sys\") pod \"node-exporter-fnm2w\" (UID: \"48d72f65-6e57-4f7d-817b-09f37c89080d\") " pod="openshift-monitoring/node-exporter-fnm2w" Sep 07 13:40:49.962039 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:49.961908 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d8934e23-a96f-4f31-bca4-40e7e70639c0-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-9tlcd\" (UID: \"d8934e23-a96f-4f31-bca4-40e7e70639c0\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-9tlcd" Sep 07 13:40:49.962039 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:49.961939 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/48d72f65-6e57-4f7d-817b-09f37c89080d-node-exporter-wtmp\") pod \"node-exporter-fnm2w\" (UID: \"48d72f65-6e57-4f7d-817b-09f37c89080d\") " pod="openshift-monitoring/node-exporter-fnm2w" Sep 07 13:40:49.962039 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:49.962032 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/277b3ee2-b16f-40cb-b865-c70046a4f8e8-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-vqdpl\" (UID: \"277b3ee2-b16f-40cb-b865-c70046a4f8e8\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-vqdpl" Sep 07 13:40:49.962204 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:49.962065 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vprld\" (UniqueName: \"kubernetes.io/projected/d8934e23-a96f-4f31-bca4-40e7e70639c0-kube-api-access-vprld\") pod \"kube-state-metrics-74cb57df7-9tlcd\" (UID: \"d8934e23-a96f-4f31-bca4-40e7e70639c0\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-9tlcd" Sep 07 13:40:49.962204 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:49.962095 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/d8934e23-a96f-4f31-bca4-40e7e70639c0-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-9tlcd\" (UID: \"d8934e23-a96f-4f31-bca4-40e7e70639c0\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-9tlcd" Sep 07 13:40:49.962204 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:49.962124 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d8934e23-a96f-4f31-bca4-40e7e70639c0-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-9tlcd\" (UID: \"d8934e23-a96f-4f31-bca4-40e7e70639c0\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-9tlcd" Sep 07 13:40:49.962204 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:49.962151 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/48d72f65-6e57-4f7d-817b-09f37c89080d-node-exporter-tls\") pod \"node-exporter-fnm2w\" (UID: \"48d72f65-6e57-4f7d-817b-09f37c89080d\") " pod="openshift-monitoring/node-exporter-fnm2w" Sep 07 13:40:49.962204 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:49.962187 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/48d72f65-6e57-4f7d-817b-09f37c89080d-metrics-client-ca\") pod \"node-exporter-fnm2w\" (UID: \"48d72f65-6e57-4f7d-817b-09f37c89080d\") " pod="openshift-monitoring/node-exporter-fnm2w" Sep 07 13:40:49.962453 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:49.962252 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/d8934e23-a96f-4f31-bca4-40e7e70639c0-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-9tlcd\" (UID: \"d8934e23-a96f-4f31-bca4-40e7e70639c0\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-9tlcd" Sep 07 13:40:49.962453 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:49.962297 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d8934e23-a96f-4f31-bca4-40e7e70639c0-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-9tlcd\" (UID: \"d8934e23-a96f-4f31-bca4-40e7e70639c0\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-9tlcd" Sep 07 13:40:49.962584 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:49.962556 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/277b3ee2-b16f-40cb-b865-c70046a4f8e8-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-vqdpl\" (UID: \"277b3ee2-b16f-40cb-b865-c70046a4f8e8\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-vqdpl" Sep 07 13:40:49.962898 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:49.962859 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/d8934e23-a96f-4f31-bca4-40e7e70639c0-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-9tlcd\" (UID: \"d8934e23-a96f-4f31-bca4-40e7e70639c0\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-9tlcd" Sep 07 13:40:49.964281 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:49.964257 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/277b3ee2-b16f-40cb-b865-c70046a4f8e8-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-vqdpl\" (UID: \"277b3ee2-b16f-40cb-b865-c70046a4f8e8\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-vqdpl" Sep 07 13:40:49.965095 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:49.965072 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d8934e23-a96f-4f31-bca4-40e7e70639c0-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-9tlcd\" (UID: \"d8934e23-a96f-4f31-bca4-40e7e70639c0\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-9tlcd" Sep 07 13:40:49.965180 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:49.965106 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d8934e23-a96f-4f31-bca4-40e7e70639c0-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-9tlcd\" (UID: \"d8934e23-a96f-4f31-bca4-40e7e70639c0\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-9tlcd" Sep 07 13:40:49.965801 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:49.965768 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/277b3ee2-b16f-40cb-b865-c70046a4f8e8-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-vqdpl\" (UID: \"277b3ee2-b16f-40cb-b865-c70046a4f8e8\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-vqdpl" Sep 07 13:40:49.979966 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:49.979901 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vprld\" (UniqueName: \"kubernetes.io/projected/d8934e23-a96f-4f31-bca4-40e7e70639c0-kube-api-access-vprld\") pod \"kube-state-metrics-74cb57df7-9tlcd\" (UID: \"d8934e23-a96f-4f31-bca4-40e7e70639c0\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-9tlcd" Sep 07 13:40:49.980512 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:49.980473 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pzctt\" (UniqueName: \"kubernetes.io/projected/277b3ee2-b16f-40cb-b865-c70046a4f8e8-kube-api-access-pzctt\") pod \"openshift-state-metrics-657fd6c54-vqdpl\" (UID: \"277b3ee2-b16f-40cb-b865-c70046a4f8e8\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-vqdpl" Sep 07 13:40:50.037812 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:50.037756 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-74cb57df7-9tlcd" Sep 07 13:40:50.064307 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:50.063387 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/48d72f65-6e57-4f7d-817b-09f37c89080d-metrics-client-ca\") pod \"node-exporter-fnm2w\" (UID: \"48d72f65-6e57-4f7d-817b-09f37c89080d\") " pod="openshift-monitoring/node-exporter-fnm2w" Sep 07 13:40:50.064307 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:50.063466 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/48d72f65-6e57-4f7d-817b-09f37c89080d-node-exporter-accelerators-collector-config\") pod \"node-exporter-fnm2w\" (UID: \"48d72f65-6e57-4f7d-817b-09f37c89080d\") " pod="openshift-monitoring/node-exporter-fnm2w" Sep 07 13:40:50.064307 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:50.063499 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/48d72f65-6e57-4f7d-817b-09f37c89080d-root\") pod \"node-exporter-fnm2w\" (UID: \"48d72f65-6e57-4f7d-817b-09f37c89080d\") " pod="openshift-monitoring/node-exporter-fnm2w" Sep 07 13:40:50.064307 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:50.063538 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/48d72f65-6e57-4f7d-817b-09f37c89080d-node-exporter-textfile\") pod \"node-exporter-fnm2w\" (UID: \"48d72f65-6e57-4f7d-817b-09f37c89080d\") " pod="openshift-monitoring/node-exporter-fnm2w" Sep 07 13:40:50.064307 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:50.063581 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/48d72f65-6e57-4f7d-817b-09f37c89080d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fnm2w\" (UID: \"48d72f65-6e57-4f7d-817b-09f37c89080d\") " pod="openshift-monitoring/node-exporter-fnm2w" Sep 07 13:40:50.064307 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:50.063608 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pmrql\" (UniqueName: \"kubernetes.io/projected/48d72f65-6e57-4f7d-817b-09f37c89080d-kube-api-access-pmrql\") pod \"node-exporter-fnm2w\" (UID: \"48d72f65-6e57-4f7d-817b-09f37c89080d\") " pod="openshift-monitoring/node-exporter-fnm2w" Sep 07 13:40:50.064307 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:50.063634 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/48d72f65-6e57-4f7d-817b-09f37c89080d-sys\") pod \"node-exporter-fnm2w\" (UID: \"48d72f65-6e57-4f7d-817b-09f37c89080d\") " pod="openshift-monitoring/node-exporter-fnm2w" Sep 07 13:40:50.064307 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:50.063659 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/48d72f65-6e57-4f7d-817b-09f37c89080d-node-exporter-wtmp\") pod \"node-exporter-fnm2w\" (UID: \"48d72f65-6e57-4f7d-817b-09f37c89080d\") " pod="openshift-monitoring/node-exporter-fnm2w" Sep 07 13:40:50.064307 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:50.064235 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/48d72f65-6e57-4f7d-817b-09f37c89080d-node-exporter-textfile\") pod \"node-exporter-fnm2w\" (UID: \"48d72f65-6e57-4f7d-817b-09f37c89080d\") " pod="openshift-monitoring/node-exporter-fnm2w" Sep 07 13:40:50.064307 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:50.064288 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/48d72f65-6e57-4f7d-817b-09f37c89080d-root\") pod \"node-exporter-fnm2w\" (UID: \"48d72f65-6e57-4f7d-817b-09f37c89080d\") " pod="openshift-monitoring/node-exporter-fnm2w" Sep 07 13:40:50.064956 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:50.064713 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/48d72f65-6e57-4f7d-817b-09f37c89080d-node-exporter-accelerators-collector-config\") pod \"node-exporter-fnm2w\" (UID: \"48d72f65-6e57-4f7d-817b-09f37c89080d\") " pod="openshift-monitoring/node-exporter-fnm2w" Sep 07 13:40:50.065113 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:50.065084 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/48d72f65-6e57-4f7d-817b-09f37c89080d-node-exporter-tls\") pod \"node-exporter-fnm2w\" (UID: \"48d72f65-6e57-4f7d-817b-09f37c89080d\") " pod="openshift-monitoring/node-exporter-fnm2w" Sep 07 13:40:50.066294 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:50.065534 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/48d72f65-6e57-4f7d-817b-09f37c89080d-node-exporter-wtmp\") pod \"node-exporter-fnm2w\" (UID: \"48d72f65-6e57-4f7d-817b-09f37c89080d\") " pod="openshift-monitoring/node-exporter-fnm2w" Sep 07 13:40:50.066294 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:50.065590 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/48d72f65-6e57-4f7d-817b-09f37c89080d-sys\") pod \"node-exporter-fnm2w\" (UID: \"48d72f65-6e57-4f7d-817b-09f37c89080d\") " pod="openshift-monitoring/node-exporter-fnm2w" Sep 07 13:40:50.066294 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:40:50.065846 2575 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Sep 07 13:40:50.066294 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:40:50.065928 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/48d72f65-6e57-4f7d-817b-09f37c89080d-node-exporter-tls podName:48d72f65-6e57-4f7d-817b-09f37c89080d nodeName:}" failed. No retries permitted until 2026-09-07 13:40:50.565908746 +0000 UTC m=+122.060038061 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/48d72f65-6e57-4f7d-817b-09f37c89080d-node-exporter-tls") pod "node-exporter-fnm2w" (UID: "48d72f65-6e57-4f7d-817b-09f37c89080d") : secret "node-exporter-tls" not found Sep 07 13:40:50.066294 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:50.066186 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-vqdpl" Sep 07 13:40:50.066294 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:50.066245 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/48d72f65-6e57-4f7d-817b-09f37c89080d-metrics-client-ca\") pod \"node-exporter-fnm2w\" (UID: \"48d72f65-6e57-4f7d-817b-09f37c89080d\") " pod="openshift-monitoring/node-exporter-fnm2w" Sep 07 13:40:50.069754 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:50.069707 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/48d72f65-6e57-4f7d-817b-09f37c89080d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fnm2w\" (UID: \"48d72f65-6e57-4f7d-817b-09f37c89080d\") " pod="openshift-monitoring/node-exporter-fnm2w" Sep 07 13:40:50.085158 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:50.085096 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pmrql\" (UniqueName: \"kubernetes.io/projected/48d72f65-6e57-4f7d-817b-09f37c89080d-kube-api-access-pmrql\") pod \"node-exporter-fnm2w\" (UID: \"48d72f65-6e57-4f7d-817b-09f37c89080d\") " pod="openshift-monitoring/node-exporter-fnm2w" Sep 07 13:40:50.369108 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:50.369078 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-9tlcd"] Sep 07 13:40:50.369472 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:40:50.369362 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8934e23_a96f_4f31_bca4_40e7e70639c0.slice/crio-b207dee144116831b6bb41e00debdaea71eee95ac9e89d31db953077df9f69d5 WatchSource:0}: Error finding container b207dee144116831b6bb41e00debdaea71eee95ac9e89d31db953077df9f69d5: Status 404 returned error can't find the container with id b207dee144116831b6bb41e00debdaea71eee95ac9e89d31db953077df9f69d5 Sep 07 13:40:50.387867 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:50.387770 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-vqdpl"] Sep 07 13:40:50.391487 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:40:50.391381 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod277b3ee2_b16f_40cb_b865_c70046a4f8e8.slice/crio-a16aab60736755396e4ed92f72f01d4bbec048aa0e1b92eba3f791e314210448 WatchSource:0}: Error finding container a16aab60736755396e4ed92f72f01d4bbec048aa0e1b92eba3f791e314210448: Status 404 returned error can't find the container with id a16aab60736755396e4ed92f72f01d4bbec048aa0e1b92eba3f791e314210448 Sep 07 13:40:50.503688 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:50.496099 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-85d98c998f-bfcpr" event={"ID":"e561ca49-a4db-4e7a-be5a-6e05a9cda274","Type":"ContainerStarted","Data":"c96f1660726fdd820c1d108ce46f6d07e518844bfa89d81aa604872a83046a67"} Sep 07 13:40:50.503688 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:50.497012 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-85d98c998f-bfcpr" Sep 07 13:40:50.503688 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:50.499093 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-vqdpl" event={"ID":"277b3ee2-b16f-40cb-b865-c70046a4f8e8","Type":"ContainerStarted","Data":"a16aab60736755396e4ed92f72f01d4bbec048aa0e1b92eba3f791e314210448"} Sep 07 13:40:50.503688 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:50.500671 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-9tlcd" event={"ID":"d8934e23-a96f-4f31-bca4-40e7e70639c0","Type":"ContainerStarted","Data":"b207dee144116831b6bb41e00debdaea71eee95ac9e89d31db953077df9f69d5"} Sep 07 13:40:50.503688 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:50.500815 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-85d98c998f-bfcpr" Sep 07 13:40:50.582520 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:50.582442 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-85d98c998f-bfcpr" podStartSLOduration=2.111293885 podStartE2EDuration="18.582419352s" totalImagesPullingTime="16.471125467s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:40:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:40:50.532121592 +0000 UTC m=+122.026250924" watchObservedRunningTime="2026-09-07 13:40:50.582419352 +0000 UTC m=+122.076548687" Sep 07 13:40:50.583347 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:50.583315 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/48d72f65-6e57-4f7d-817b-09f37c89080d-node-exporter-tls\") pod \"node-exporter-fnm2w\" (UID: \"48d72f65-6e57-4f7d-817b-09f37c89080d\") " pod="openshift-monitoring/node-exporter-fnm2w" Sep 07 13:40:50.588990 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:50.588451 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/48d72f65-6e57-4f7d-817b-09f37c89080d-node-exporter-tls\") pod \"node-exporter-fnm2w\" (UID: \"48d72f65-6e57-4f7d-817b-09f37c89080d\") " pod="openshift-monitoring/node-exporter-fnm2w" Sep 07 13:40:50.681714 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:50.681123 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 07 13:40:50.686457 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:50.685422 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 07 13:40:50.693195 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:50.692508 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Sep 07 13:40:50.693195 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:50.692743 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Sep 07 13:40:50.693195 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:50.693040 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Sep 07 13:40:50.693450 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:50.693242 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Sep 07 13:40:50.693450 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:50.693319 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Sep 07 13:40:50.693450 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:50.693442 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Sep 07 13:40:50.695143 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:50.694021 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Sep 07 13:40:50.695143 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:50.694228 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Sep 07 13:40:50.695143 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:50.694467 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-whpmz\"" Sep 07 13:40:50.695143 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:50.694691 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Sep 07 13:40:50.702159 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:50.702137 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-fnm2w" Sep 07 13:40:50.712207 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:50.712170 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 07 13:40:50.785806 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:50.784927 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dceb3d71-9ec0-43f5-92a5-2923f47a0d9c-web-config\") pod \"alertmanager-main-0\" (UID: \"dceb3d71-9ec0-43f5-92a5-2923f47a0d9c\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 13:40:50.785806 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:50.785007 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dceb3d71-9ec0-43f5-92a5-2923f47a0d9c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"dceb3d71-9ec0-43f5-92a5-2923f47a0d9c\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 13:40:50.785806 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:50.785052 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dceb3d71-9ec0-43f5-92a5-2923f47a0d9c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"dceb3d71-9ec0-43f5-92a5-2923f47a0d9c\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 13:40:50.785806 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:50.785084 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/dceb3d71-9ec0-43f5-92a5-2923f47a0d9c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"dceb3d71-9ec0-43f5-92a5-2923f47a0d9c\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 13:40:50.785806 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:50.785148 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/dceb3d71-9ec0-43f5-92a5-2923f47a0d9c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"dceb3d71-9ec0-43f5-92a5-2923f47a0d9c\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 13:40:50.785806 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:50.785175 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dceb3d71-9ec0-43f5-92a5-2923f47a0d9c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"dceb3d71-9ec0-43f5-92a5-2923f47a0d9c\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 13:40:50.785806 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:50.785218 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/dceb3d71-9ec0-43f5-92a5-2923f47a0d9c-config-volume\") pod \"alertmanager-main-0\" (UID: \"dceb3d71-9ec0-43f5-92a5-2923f47a0d9c\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 13:40:50.785806 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:50.785245 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/dceb3d71-9ec0-43f5-92a5-2923f47a0d9c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"dceb3d71-9ec0-43f5-92a5-2923f47a0d9c\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 13:40:50.785806 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:50.785296 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-km2l7\" (UniqueName: \"kubernetes.io/projected/dceb3d71-9ec0-43f5-92a5-2923f47a0d9c-kube-api-access-km2l7\") pod \"alertmanager-main-0\" (UID: \"dceb3d71-9ec0-43f5-92a5-2923f47a0d9c\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 13:40:50.785806 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:50.785323 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/dceb3d71-9ec0-43f5-92a5-2923f47a0d9c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"dceb3d71-9ec0-43f5-92a5-2923f47a0d9c\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 13:40:50.785806 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:50.785363 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dceb3d71-9ec0-43f5-92a5-2923f47a0d9c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"dceb3d71-9ec0-43f5-92a5-2923f47a0d9c\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 13:40:50.785806 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:50.785391 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dceb3d71-9ec0-43f5-92a5-2923f47a0d9c-config-out\") pod \"alertmanager-main-0\" (UID: \"dceb3d71-9ec0-43f5-92a5-2923f47a0d9c\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 13:40:50.785806 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:50.785421 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dceb3d71-9ec0-43f5-92a5-2923f47a0d9c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"dceb3d71-9ec0-43f5-92a5-2923f47a0d9c\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 13:40:50.887515 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:50.886596 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dceb3d71-9ec0-43f5-92a5-2923f47a0d9c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"dceb3d71-9ec0-43f5-92a5-2923f47a0d9c\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 13:40:50.887515 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:50.886664 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dceb3d71-9ec0-43f5-92a5-2923f47a0d9c-web-config\") pod \"alertmanager-main-0\" (UID: \"dceb3d71-9ec0-43f5-92a5-2923f47a0d9c\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 13:40:50.887515 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:50.886702 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dceb3d71-9ec0-43f5-92a5-2923f47a0d9c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"dceb3d71-9ec0-43f5-92a5-2923f47a0d9c\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 13:40:50.887515 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:50.886731 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dceb3d71-9ec0-43f5-92a5-2923f47a0d9c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"dceb3d71-9ec0-43f5-92a5-2923f47a0d9c\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 13:40:50.887515 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:50.886760 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/dceb3d71-9ec0-43f5-92a5-2923f47a0d9c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"dceb3d71-9ec0-43f5-92a5-2923f47a0d9c\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 13:40:50.887515 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:50.886848 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/dceb3d71-9ec0-43f5-92a5-2923f47a0d9c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"dceb3d71-9ec0-43f5-92a5-2923f47a0d9c\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 13:40:50.887515 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:50.886876 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dceb3d71-9ec0-43f5-92a5-2923f47a0d9c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"dceb3d71-9ec0-43f5-92a5-2923f47a0d9c\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 13:40:50.887515 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:50.886902 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/dceb3d71-9ec0-43f5-92a5-2923f47a0d9c-config-volume\") pod \"alertmanager-main-0\" (UID: \"dceb3d71-9ec0-43f5-92a5-2923f47a0d9c\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 13:40:50.887515 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:50.886934 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/dceb3d71-9ec0-43f5-92a5-2923f47a0d9c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"dceb3d71-9ec0-43f5-92a5-2923f47a0d9c\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 13:40:50.887515 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:50.886984 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-km2l7\" (UniqueName: \"kubernetes.io/projected/dceb3d71-9ec0-43f5-92a5-2923f47a0d9c-kube-api-access-km2l7\") pod \"alertmanager-main-0\" (UID: \"dceb3d71-9ec0-43f5-92a5-2923f47a0d9c\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 13:40:50.887515 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:50.887018 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/dceb3d71-9ec0-43f5-92a5-2923f47a0d9c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"dceb3d71-9ec0-43f5-92a5-2923f47a0d9c\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 13:40:50.887515 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:50.887042 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dceb3d71-9ec0-43f5-92a5-2923f47a0d9c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"dceb3d71-9ec0-43f5-92a5-2923f47a0d9c\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 13:40:50.887515 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:50.887071 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dceb3d71-9ec0-43f5-92a5-2923f47a0d9c-config-out\") pod \"alertmanager-main-0\" (UID: \"dceb3d71-9ec0-43f5-92a5-2923f47a0d9c\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 13:40:50.900131 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:40:50.900101 2575 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Sep 07 13:40:50.900278 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:40:50.900182 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dceb3d71-9ec0-43f5-92a5-2923f47a0d9c-secret-alertmanager-main-tls podName:dceb3d71-9ec0-43f5-92a5-2923f47a0d9c nodeName:}" failed. No retries permitted until 2026-09-07 13:40:51.400160246 +0000 UTC m=+122.894289571 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/dceb3d71-9ec0-43f5-92a5-2923f47a0d9c-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "dceb3d71-9ec0-43f5-92a5-2923f47a0d9c") : secret "alertmanager-main-tls" not found Sep 07 13:40:50.901323 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:50.901290 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dceb3d71-9ec0-43f5-92a5-2923f47a0d9c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"dceb3d71-9ec0-43f5-92a5-2923f47a0d9c\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 13:40:50.901449 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:50.901346 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dceb3d71-9ec0-43f5-92a5-2923f47a0d9c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"dceb3d71-9ec0-43f5-92a5-2923f47a0d9c\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 13:40:50.901880 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:50.901854 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/dceb3d71-9ec0-43f5-92a5-2923f47a0d9c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"dceb3d71-9ec0-43f5-92a5-2923f47a0d9c\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 13:40:50.907491 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:50.907443 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dceb3d71-9ec0-43f5-92a5-2923f47a0d9c-web-config\") pod \"alertmanager-main-0\" (UID: \"dceb3d71-9ec0-43f5-92a5-2923f47a0d9c\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 13:40:50.908087 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:50.908043 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dceb3d71-9ec0-43f5-92a5-2923f47a0d9c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"dceb3d71-9ec0-43f5-92a5-2923f47a0d9c\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 13:40:50.908638 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:50.908601 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/dceb3d71-9ec0-43f5-92a5-2923f47a0d9c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"dceb3d71-9ec0-43f5-92a5-2923f47a0d9c\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 13:40:50.912485 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:50.911160 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dceb3d71-9ec0-43f5-92a5-2923f47a0d9c-config-out\") pod \"alertmanager-main-0\" (UID: \"dceb3d71-9ec0-43f5-92a5-2923f47a0d9c\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 13:40:50.912485 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:50.911497 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dceb3d71-9ec0-43f5-92a5-2923f47a0d9c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"dceb3d71-9ec0-43f5-92a5-2923f47a0d9c\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 13:40:50.912485 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:50.911904 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/dceb3d71-9ec0-43f5-92a5-2923f47a0d9c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"dceb3d71-9ec0-43f5-92a5-2923f47a0d9c\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 13:40:50.912485 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:50.912277 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dceb3d71-9ec0-43f5-92a5-2923f47a0d9c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"dceb3d71-9ec0-43f5-92a5-2923f47a0d9c\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 13:40:50.913235 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:50.913174 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/dceb3d71-9ec0-43f5-92a5-2923f47a0d9c-config-volume\") pod \"alertmanager-main-0\" (UID: \"dceb3d71-9ec0-43f5-92a5-2923f47a0d9c\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 13:40:50.919746 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:50.919686 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-km2l7\" (UniqueName: \"kubernetes.io/projected/dceb3d71-9ec0-43f5-92a5-2923f47a0d9c-kube-api-access-km2l7\") pod \"alertmanager-main-0\" (UID: \"dceb3d71-9ec0-43f5-92a5-2923f47a0d9c\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 13:40:51.493075 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:51.493026 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/dceb3d71-9ec0-43f5-92a5-2923f47a0d9c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"dceb3d71-9ec0-43f5-92a5-2923f47a0d9c\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 13:40:51.509041 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:51.508949 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fnm2w" event={"ID":"48d72f65-6e57-4f7d-817b-09f37c89080d","Type":"ContainerStarted","Data":"0a5ae70d83df84a5537cb512014f96b7d19d552abf54ede66b0aa75447d29a03"} Sep 07 13:40:51.515395 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:51.515301 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-vqdpl" event={"ID":"277b3ee2-b16f-40cb-b865-c70046a4f8e8","Type":"ContainerStarted","Data":"f73fce3ed1c39993174e7d98b4548cb61302bbd72b5970db23f406df808deb84"} Sep 07 13:40:51.515395 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:51.515359 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-vqdpl" event={"ID":"277b3ee2-b16f-40cb-b865-c70046a4f8e8","Type":"ContainerStarted","Data":"692ff6410059bb699f9ca72e15bb42f178965ef7e8563d4c332f06ac077beb52"} Sep 07 13:40:51.525226 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:51.525192 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/dceb3d71-9ec0-43f5-92a5-2923f47a0d9c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"dceb3d71-9ec0-43f5-92a5-2923f47a0d9c\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 13:40:51.600011 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:51.599979 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 07 13:40:51.971652 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:51.971616 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 07 13:40:52.522454 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:52.522339 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dceb3d71-9ec0-43f5-92a5-2923f47a0d9c","Type":"ContainerStarted","Data":"54d8316e00abcf6735c385f778bcf7bd2696d3c5e01057268e6b9f03f2763a81"} Sep 07 13:40:54.254589 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:54.253279 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-7c46d75f98-bd6g4"] Sep 07 13:40:54.286717 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:54.285612 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7c46d75f98-bd6g4" Sep 07 13:40:54.304815 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:54.303893 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7c46d75f98-bd6g4"] Sep 07 13:40:54.304815 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:54.304456 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Sep 07 13:40:54.304815 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:54.304711 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Sep 07 13:40:54.304815 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:54.304726 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Sep 07 13:40:54.305106 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:54.304825 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Sep 07 13:40:54.306007 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:54.305669 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-alrpcg9mfgb3q\"" Sep 07 13:40:54.306007 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:54.305904 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-b6rz9\"" Sep 07 13:40:54.322584 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:54.322487 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/85142a16-87b7-40a4-9247-2259c82fe20b-metrics-server-audit-profiles\") pod \"metrics-server-7c46d75f98-bd6g4\" (UID: \"85142a16-87b7-40a4-9247-2259c82fe20b\") " pod="openshift-monitoring/metrics-server-7c46d75f98-bd6g4" Sep 07 13:40:54.322584 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:54.322524 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vqgqr\" (UniqueName: \"kubernetes.io/projected/85142a16-87b7-40a4-9247-2259c82fe20b-kube-api-access-vqgqr\") pod \"metrics-server-7c46d75f98-bd6g4\" (UID: \"85142a16-87b7-40a4-9247-2259c82fe20b\") " pod="openshift-monitoring/metrics-server-7c46d75f98-bd6g4" Sep 07 13:40:54.322584 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:54.322553 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/85142a16-87b7-40a4-9247-2259c82fe20b-secret-metrics-server-tls\") pod \"metrics-server-7c46d75f98-bd6g4\" (UID: \"85142a16-87b7-40a4-9247-2259c82fe20b\") " pod="openshift-monitoring/metrics-server-7c46d75f98-bd6g4" Sep 07 13:40:54.322854 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:54.322652 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/85142a16-87b7-40a4-9247-2259c82fe20b-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7c46d75f98-bd6g4\" (UID: \"85142a16-87b7-40a4-9247-2259c82fe20b\") " pod="openshift-monitoring/metrics-server-7c46d75f98-bd6g4" Sep 07 13:40:54.322854 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:54.322687 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/85142a16-87b7-40a4-9247-2259c82fe20b-client-ca-bundle\") pod \"metrics-server-7c46d75f98-bd6g4\" (UID: \"85142a16-87b7-40a4-9247-2259c82fe20b\") " pod="openshift-monitoring/metrics-server-7c46d75f98-bd6g4" Sep 07 13:40:54.322854 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:54.322754 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/85142a16-87b7-40a4-9247-2259c82fe20b-secret-metrics-server-client-certs\") pod \"metrics-server-7c46d75f98-bd6g4\" (UID: \"85142a16-87b7-40a4-9247-2259c82fe20b\") " pod="openshift-monitoring/metrics-server-7c46d75f98-bd6g4" Sep 07 13:40:54.323002 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:54.322902 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/85142a16-87b7-40a4-9247-2259c82fe20b-audit-log\") pod \"metrics-server-7c46d75f98-bd6g4\" (UID: \"85142a16-87b7-40a4-9247-2259c82fe20b\") " pod="openshift-monitoring/metrics-server-7c46d75f98-bd6g4" Sep 07 13:40:54.411697 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:54.410331 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-vtqzz"] Sep 07 13:40:54.423663 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:54.423633 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/85142a16-87b7-40a4-9247-2259c82fe20b-secret-metrics-server-client-certs\") pod \"metrics-server-7c46d75f98-bd6g4\" (UID: \"85142a16-87b7-40a4-9247-2259c82fe20b\") " pod="openshift-monitoring/metrics-server-7c46d75f98-bd6g4" Sep 07 13:40:54.423853 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:54.423720 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/85142a16-87b7-40a4-9247-2259c82fe20b-audit-log\") pod \"metrics-server-7c46d75f98-bd6g4\" (UID: \"85142a16-87b7-40a4-9247-2259c82fe20b\") " pod="openshift-monitoring/metrics-server-7c46d75f98-bd6g4" Sep 07 13:40:54.423853 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:54.423771 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/85142a16-87b7-40a4-9247-2259c82fe20b-metrics-server-audit-profiles\") pod \"metrics-server-7c46d75f98-bd6g4\" (UID: \"85142a16-87b7-40a4-9247-2259c82fe20b\") " pod="openshift-monitoring/metrics-server-7c46d75f98-bd6g4" Sep 07 13:40:54.423853 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:54.423810 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqgqr\" (UniqueName: \"kubernetes.io/projected/85142a16-87b7-40a4-9247-2259c82fe20b-kube-api-access-vqgqr\") pod \"metrics-server-7c46d75f98-bd6g4\" (UID: \"85142a16-87b7-40a4-9247-2259c82fe20b\") " pod="openshift-monitoring/metrics-server-7c46d75f98-bd6g4" Sep 07 13:40:54.423853 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:54.423845 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/85142a16-87b7-40a4-9247-2259c82fe20b-secret-metrics-server-tls\") pod \"metrics-server-7c46d75f98-bd6g4\" (UID: \"85142a16-87b7-40a4-9247-2259c82fe20b\") " pod="openshift-monitoring/metrics-server-7c46d75f98-bd6g4" Sep 07 13:40:54.423853 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:54.423873 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/85142a16-87b7-40a4-9247-2259c82fe20b-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7c46d75f98-bd6g4\" (UID: \"85142a16-87b7-40a4-9247-2259c82fe20b\") " pod="openshift-monitoring/metrics-server-7c46d75f98-bd6g4" Sep 07 13:40:54.424160 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:54.423896 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/85142a16-87b7-40a4-9247-2259c82fe20b-client-ca-bundle\") pod \"metrics-server-7c46d75f98-bd6g4\" (UID: \"85142a16-87b7-40a4-9247-2259c82fe20b\") " pod="openshift-monitoring/metrics-server-7c46d75f98-bd6g4" Sep 07 13:40:54.425472 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:54.424956 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/85142a16-87b7-40a4-9247-2259c82fe20b-audit-log\") pod \"metrics-server-7c46d75f98-bd6g4\" (UID: \"85142a16-87b7-40a4-9247-2259c82fe20b\") " pod="openshift-monitoring/metrics-server-7c46d75f98-bd6g4" Sep 07 13:40:54.425472 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:54.425296 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/85142a16-87b7-40a4-9247-2259c82fe20b-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7c46d75f98-bd6g4\" (UID: \"85142a16-87b7-40a4-9247-2259c82fe20b\") " pod="openshift-monitoring/metrics-server-7c46d75f98-bd6g4" Sep 07 13:40:54.425866 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:54.425774 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/85142a16-87b7-40a4-9247-2259c82fe20b-metrics-server-audit-profiles\") pod \"metrics-server-7c46d75f98-bd6g4\" (UID: \"85142a16-87b7-40a4-9247-2259c82fe20b\") " pod="openshift-monitoring/metrics-server-7c46d75f98-bd6g4" Sep 07 13:40:54.427151 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:54.427129 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/85142a16-87b7-40a4-9247-2259c82fe20b-client-ca-bundle\") pod \"metrics-server-7c46d75f98-bd6g4\" (UID: \"85142a16-87b7-40a4-9247-2259c82fe20b\") " pod="openshift-monitoring/metrics-server-7c46d75f98-bd6g4" Sep 07 13:40:54.430584 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:54.430423 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/85142a16-87b7-40a4-9247-2259c82fe20b-secret-metrics-server-client-certs\") pod \"metrics-server-7c46d75f98-bd6g4\" (UID: \"85142a16-87b7-40a4-9247-2259c82fe20b\") " pod="openshift-monitoring/metrics-server-7c46d75f98-bd6g4" Sep 07 13:40:54.430584 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:54.430539 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/85142a16-87b7-40a4-9247-2259c82fe20b-secret-metrics-server-tls\") pod \"metrics-server-7c46d75f98-bd6g4\" (UID: \"85142a16-87b7-40a4-9247-2259c82fe20b\") " pod="openshift-monitoring/metrics-server-7c46d75f98-bd6g4" Sep 07 13:40:54.435537 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:54.434813 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-vtqzz" Sep 07 13:40:54.443687 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:54.443463 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Sep 07 13:40:54.444710 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:54.444648 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-vtqzz"] Sep 07 13:40:54.452717 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:54.447628 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vqgqr\" (UniqueName: \"kubernetes.io/projected/85142a16-87b7-40a4-9247-2259c82fe20b-kube-api-access-vqgqr\") pod \"metrics-server-7c46d75f98-bd6g4\" (UID: \"85142a16-87b7-40a4-9247-2259c82fe20b\") " pod="openshift-monitoring/metrics-server-7c46d75f98-bd6g4" Sep 07 13:40:54.452717 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:54.452324 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-6p4hw\"" Sep 07 13:40:54.524519 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:54.524440 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7eb6bde7-2318-401d-9aaa-3f1d57f83db4-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-vtqzz\" (UID: \"7eb6bde7-2318-401d-9aaa-3f1d57f83db4\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-vtqzz" Sep 07 13:40:54.524519 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:54.524495 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-svgnt\" (UniqueName: \"kubernetes.io/projected/7eb6bde7-2318-401d-9aaa-3f1d57f83db4-kube-api-access-svgnt\") pod \"monitoring-plugin-85bbbbbf4-vtqzz\" (UID: \"7eb6bde7-2318-401d-9aaa-3f1d57f83db4\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-vtqzz" Sep 07 13:40:54.607862 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:54.607828 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7c46d75f98-bd6g4" Sep 07 13:40:54.625535 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:54.625494 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7eb6bde7-2318-401d-9aaa-3f1d57f83db4-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-vtqzz\" (UID: \"7eb6bde7-2318-401d-9aaa-3f1d57f83db4\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-vtqzz" Sep 07 13:40:54.625758 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:54.625549 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-svgnt\" (UniqueName: \"kubernetes.io/projected/7eb6bde7-2318-401d-9aaa-3f1d57f83db4-kube-api-access-svgnt\") pod \"monitoring-plugin-85bbbbbf4-vtqzz\" (UID: \"7eb6bde7-2318-401d-9aaa-3f1d57f83db4\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-vtqzz" Sep 07 13:40:54.631426 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:54.631350 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7eb6bde7-2318-401d-9aaa-3f1d57f83db4-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-vtqzz\" (UID: \"7eb6bde7-2318-401d-9aaa-3f1d57f83db4\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-vtqzz" Sep 07 13:40:54.640959 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:54.640930 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-svgnt\" (UniqueName: \"kubernetes.io/projected/7eb6bde7-2318-401d-9aaa-3f1d57f83db4-kube-api-access-svgnt\") pod \"monitoring-plugin-85bbbbbf4-vtqzz\" (UID: \"7eb6bde7-2318-401d-9aaa-3f1d57f83db4\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-vtqzz" Sep 07 13:40:54.766273 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:54.766008 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-vtqzz" Sep 07 13:40:56.280958 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:56.280931 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-vtqzz"] Sep 07 13:40:56.306937 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:56.306909 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7c46d75f98-bd6g4"] Sep 07 13:40:56.307247 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:40:56.307215 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85142a16_87b7_40a4_9247_2259c82fe20b.slice/crio-b05cd1813c7b2a2e05bed28dfbb3beaac3e954bc2398901ca946efdb901fa56d WatchSource:0}: Error finding container b05cd1813c7b2a2e05bed28dfbb3beaac3e954bc2398901ca946efdb901fa56d: Status 404 returned error can't find the container with id b05cd1813c7b2a2e05bed28dfbb3beaac3e954bc2398901ca946efdb901fa56d Sep 07 13:40:56.328691 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:40:56.328650 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7eb6bde7_2318_401d_9aaa_3f1d57f83db4.slice/crio-8e17a6ce005c0bba76f71a359e99c8a192f49af256bbb5d6336b227c9898b2f6 WatchSource:0}: Error finding container 8e17a6ce005c0bba76f71a359e99c8a192f49af256bbb5d6336b227c9898b2f6: Status 404 returned error can't find the container with id 8e17a6ce005c0bba76f71a359e99c8a192f49af256bbb5d6336b227c9898b2f6 Sep 07 13:40:56.433948 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:56.433867 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 07 13:40:56.454197 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:56.454176 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:40:56.464217 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:56.464188 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Sep 07 13:40:56.481851 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:56.481809 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Sep 07 13:40:56.483944 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:56.482309 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Sep 07 13:40:56.483944 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:56.483073 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Sep 07 13:40:56.485227 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:56.484361 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Sep 07 13:40:56.485227 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:56.484683 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Sep 07 13:40:56.485227 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:56.484886 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Sep 07 13:40:56.485227 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:56.485124 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-pfc9j\"" Sep 07 13:40:56.487710 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:56.487684 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Sep 07 13:40:56.489403 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:56.489383 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Sep 07 13:40:56.489516 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:56.489477 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Sep 07 13:40:56.489654 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:56.489633 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Sep 07 13:40:56.490724 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:56.490371 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Sep 07 13:40:56.490724 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:56.490427 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-282d59l1bnsse\"" Sep 07 13:40:56.490724 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:56.490689 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Sep 07 13:40:56.492702 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:56.492684 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Sep 07 13:40:56.538481 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:56.538449 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 07 13:40:56.544835 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:56.544773 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-vqdpl" event={"ID":"277b3ee2-b16f-40cb-b865-c70046a4f8e8","Type":"ContainerStarted","Data":"71f8b5c7eb9295fffa437c49783907439cf4a94d287f47a5da1290b21ed0cc13"} Sep 07 13:40:56.547267 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:56.547238 2575 generic.go:356] "Generic (PLEG): container finished" podID="48d72f65-6e57-4f7d-817b-09f37c89080d" containerID="5fe2c467b2db75f9b8fb2942aed4223a90210d53d76c9c694e77222d4c4a076c" exitCode=0 Sep 07 13:40:56.547490 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:56.547331 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fnm2w" event={"ID":"48d72f65-6e57-4f7d-817b-09f37c89080d","Type":"ContainerDied","Data":"5fe2c467b2db75f9b8fb2942aed4223a90210d53d76c9c694e77222d4c4a076c"} Sep 07 13:40:56.552093 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:56.551690 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-vtqzz" event={"ID":"7eb6bde7-2318-401d-9aaa-3f1d57f83db4","Type":"ContainerStarted","Data":"8e17a6ce005c0bba76f71a359e99c8a192f49af256bbb5d6336b227c9898b2f6"} Sep 07 13:40:56.554442 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:56.554418 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/63d742cf-3e5e-4327-8271-c2575d83c18a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"63d742cf-3e5e-4327-8271-c2575d83c18a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:40:56.554602 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:56.554581 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/63d742cf-3e5e-4327-8271-c2575d83c18a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"63d742cf-3e5e-4327-8271-c2575d83c18a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:40:56.554735 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:56.554709 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tvw2d\" (UniqueName: \"kubernetes.io/projected/63d742cf-3e5e-4327-8271-c2575d83c18a-kube-api-access-tvw2d\") pod \"prometheus-k8s-0\" (UID: \"63d742cf-3e5e-4327-8271-c2575d83c18a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:40:56.554869 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:56.554746 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/63d742cf-3e5e-4327-8271-c2575d83c18a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"63d742cf-3e5e-4327-8271-c2575d83c18a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:40:56.554869 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:56.554812 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63d742cf-3e5e-4327-8271-c2575d83c18a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"63d742cf-3e5e-4327-8271-c2575d83c18a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:40:56.554869 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:56.554839 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/63d742cf-3e5e-4327-8271-c2575d83c18a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"63d742cf-3e5e-4327-8271-c2575d83c18a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:40:56.555023 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:56.554871 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/63d742cf-3e5e-4327-8271-c2575d83c18a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"63d742cf-3e5e-4327-8271-c2575d83c18a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:40:56.555023 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:56.554897 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63d742cf-3e5e-4327-8271-c2575d83c18a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"63d742cf-3e5e-4327-8271-c2575d83c18a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:40:56.555023 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:56.554921 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/63d742cf-3e5e-4327-8271-c2575d83c18a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"63d742cf-3e5e-4327-8271-c2575d83c18a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:40:56.555023 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:56.554470 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-9tlcd" event={"ID":"d8934e23-a96f-4f31-bca4-40e7e70639c0","Type":"ContainerStarted","Data":"5622353283de698ae83f2a3517edf198b8c4146d67c057f692cbc39c4caf93a3"} Sep 07 13:40:56.555023 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:56.554974 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-9tlcd" event={"ID":"d8934e23-a96f-4f31-bca4-40e7e70639c0","Type":"ContainerStarted","Data":"e24c7c2d0f58a96a6745575ad7cd3a04bdb8472dda8590a2d366cdf583fb6f7d"} Sep 07 13:40:56.555023 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:56.555007 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-9tlcd" event={"ID":"d8934e23-a96f-4f31-bca4-40e7e70639c0","Type":"ContainerStarted","Data":"071e53b0dd6d7704ce2109f2407c1f9366a7027f65a2b8fb5ebbc640c0ddc740"} Sep 07 13:40:56.555342 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:56.555079 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/63d742cf-3e5e-4327-8271-c2575d83c18a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"63d742cf-3e5e-4327-8271-c2575d83c18a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:40:56.555342 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:56.555107 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63d742cf-3e5e-4327-8271-c2575d83c18a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"63d742cf-3e5e-4327-8271-c2575d83c18a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:40:56.555342 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:56.555176 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/63d742cf-3e5e-4327-8271-c2575d83c18a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"63d742cf-3e5e-4327-8271-c2575d83c18a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:40:56.555342 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:56.555233 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/63d742cf-3e5e-4327-8271-c2575d83c18a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"63d742cf-3e5e-4327-8271-c2575d83c18a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:40:56.555342 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:56.555258 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/63d742cf-3e5e-4327-8271-c2575d83c18a-config-out\") pod \"prometheus-k8s-0\" (UID: \"63d742cf-3e5e-4327-8271-c2575d83c18a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:40:56.555342 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:56.555283 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/63d742cf-3e5e-4327-8271-c2575d83c18a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"63d742cf-3e5e-4327-8271-c2575d83c18a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:40:56.555342 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:56.555310 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/63d742cf-3e5e-4327-8271-c2575d83c18a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"63d742cf-3e5e-4327-8271-c2575d83c18a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:40:56.555623 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:56.555600 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/63d742cf-3e5e-4327-8271-c2575d83c18a-web-config\") pod \"prometheus-k8s-0\" (UID: \"63d742cf-3e5e-4327-8271-c2575d83c18a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:40:56.555678 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:56.555636 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/63d742cf-3e5e-4327-8271-c2575d83c18a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"63d742cf-3e5e-4327-8271-c2575d83c18a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:40:56.555734 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:56.555709 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/63d742cf-3e5e-4327-8271-c2575d83c18a-config\") pod \"prometheus-k8s-0\" (UID: \"63d742cf-3e5e-4327-8271-c2575d83c18a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:40:56.555798 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:56.555765 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/63d742cf-3e5e-4327-8271-c2575d83c18a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"63d742cf-3e5e-4327-8271-c2575d83c18a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:40:56.556501 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:56.556476 2575 generic.go:356] "Generic (PLEG): container finished" podID="dceb3d71-9ec0-43f5-92a5-2923f47a0d9c" containerID="06bf5f3e25c4b9ba4a28d5450bff46c0f23b58dfc720de707128f93091ae5716" exitCode=0 Sep 07 13:40:56.556762 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:56.556739 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dceb3d71-9ec0-43f5-92a5-2923f47a0d9c","Type":"ContainerDied","Data":"06bf5f3e25c4b9ba4a28d5450bff46c0f23b58dfc720de707128f93091ae5716"} Sep 07 13:40:56.558316 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:56.558289 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7c46d75f98-bd6g4" event={"ID":"85142a16-87b7-40a4-9247-2259c82fe20b","Type":"ContainerStarted","Data":"b05cd1813c7b2a2e05bed28dfbb3beaac3e954bc2398901ca946efdb901fa56d"} Sep 07 13:40:56.560261 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:56.560233 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-777b7789f7-v8lgp" event={"ID":"bb093481-1db5-4cc6-9174-01727a3f4b69","Type":"ContainerStarted","Data":"16cf505f24f1998d84eda82ef3a135abab286b2ca2d09bd9446392753183177c"} Sep 07 13:40:56.659207 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:56.656976 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/63d742cf-3e5e-4327-8271-c2575d83c18a-web-config\") pod \"prometheus-k8s-0\" (UID: \"63d742cf-3e5e-4327-8271-c2575d83c18a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:40:56.659207 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:56.657071 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/63d742cf-3e5e-4327-8271-c2575d83c18a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"63d742cf-3e5e-4327-8271-c2575d83c18a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:40:56.659207 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:56.657180 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/63d742cf-3e5e-4327-8271-c2575d83c18a-config\") pod \"prometheus-k8s-0\" (UID: \"63d742cf-3e5e-4327-8271-c2575d83c18a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:40:56.659207 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:56.657236 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/63d742cf-3e5e-4327-8271-c2575d83c18a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"63d742cf-3e5e-4327-8271-c2575d83c18a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:40:56.659207 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:56.657289 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/63d742cf-3e5e-4327-8271-c2575d83c18a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"63d742cf-3e5e-4327-8271-c2575d83c18a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:40:56.659207 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:56.657310 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/63d742cf-3e5e-4327-8271-c2575d83c18a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"63d742cf-3e5e-4327-8271-c2575d83c18a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:40:56.659207 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:56.657325 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tvw2d\" (UniqueName: \"kubernetes.io/projected/63d742cf-3e5e-4327-8271-c2575d83c18a-kube-api-access-tvw2d\") pod \"prometheus-k8s-0\" (UID: \"63d742cf-3e5e-4327-8271-c2575d83c18a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:40:56.659207 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:56.657341 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/63d742cf-3e5e-4327-8271-c2575d83c18a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"63d742cf-3e5e-4327-8271-c2575d83c18a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:40:56.659207 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:56.657397 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63d742cf-3e5e-4327-8271-c2575d83c18a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"63d742cf-3e5e-4327-8271-c2575d83c18a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:40:56.659207 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:56.657421 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/63d742cf-3e5e-4327-8271-c2575d83c18a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"63d742cf-3e5e-4327-8271-c2575d83c18a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:40:56.659207 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:56.657463 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/63d742cf-3e5e-4327-8271-c2575d83c18a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"63d742cf-3e5e-4327-8271-c2575d83c18a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:40:56.659207 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:56.657487 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63d742cf-3e5e-4327-8271-c2575d83c18a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"63d742cf-3e5e-4327-8271-c2575d83c18a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:40:56.659207 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:56.657507 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/63d742cf-3e5e-4327-8271-c2575d83c18a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"63d742cf-3e5e-4327-8271-c2575d83c18a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:40:56.659207 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:56.657544 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/63d742cf-3e5e-4327-8271-c2575d83c18a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"63d742cf-3e5e-4327-8271-c2575d83c18a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:40:56.659207 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:56.657579 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63d742cf-3e5e-4327-8271-c2575d83c18a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"63d742cf-3e5e-4327-8271-c2575d83c18a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:40:56.659207 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:56.657708 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/63d742cf-3e5e-4327-8271-c2575d83c18a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"63d742cf-3e5e-4327-8271-c2575d83c18a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:40:56.659207 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:56.657748 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/63d742cf-3e5e-4327-8271-c2575d83c18a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"63d742cf-3e5e-4327-8271-c2575d83c18a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:40:56.660080 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:56.657765 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/63d742cf-3e5e-4327-8271-c2575d83c18a-config-out\") pod \"prometheus-k8s-0\" (UID: \"63d742cf-3e5e-4327-8271-c2575d83c18a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:40:56.660080 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:56.657804 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/63d742cf-3e5e-4327-8271-c2575d83c18a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"63d742cf-3e5e-4327-8271-c2575d83c18a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:40:56.660080 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:56.657841 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/63d742cf-3e5e-4327-8271-c2575d83c18a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"63d742cf-3e5e-4327-8271-c2575d83c18a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:40:56.660080 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:56.658437 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/63d742cf-3e5e-4327-8271-c2575d83c18a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"63d742cf-3e5e-4327-8271-c2575d83c18a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:40:56.660080 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:56.658904 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63d742cf-3e5e-4327-8271-c2575d83c18a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"63d742cf-3e5e-4327-8271-c2575d83c18a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:40:56.660080 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:56.659318 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63d742cf-3e5e-4327-8271-c2575d83c18a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"63d742cf-3e5e-4327-8271-c2575d83c18a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:40:56.660080 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:56.659482 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/63d742cf-3e5e-4327-8271-c2575d83c18a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"63d742cf-3e5e-4327-8271-c2575d83c18a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:40:56.661130 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:56.660702 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/63d742cf-3e5e-4327-8271-c2575d83c18a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"63d742cf-3e5e-4327-8271-c2575d83c18a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:40:56.664881 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:56.664253 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63d742cf-3e5e-4327-8271-c2575d83c18a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"63d742cf-3e5e-4327-8271-c2575d83c18a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:40:56.672968 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:56.665325 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/63d742cf-3e5e-4327-8271-c2575d83c18a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"63d742cf-3e5e-4327-8271-c2575d83c18a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:40:56.672968 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:56.665999 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/63d742cf-3e5e-4327-8271-c2575d83c18a-config\") pod \"prometheus-k8s-0\" (UID: \"63d742cf-3e5e-4327-8271-c2575d83c18a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:40:56.672968 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:56.666456 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/63d742cf-3e5e-4327-8271-c2575d83c18a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"63d742cf-3e5e-4327-8271-c2575d83c18a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:40:56.672968 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:56.666826 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/63d742cf-3e5e-4327-8271-c2575d83c18a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"63d742cf-3e5e-4327-8271-c2575d83c18a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:40:56.672968 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:56.668645 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/63d742cf-3e5e-4327-8271-c2575d83c18a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"63d742cf-3e5e-4327-8271-c2575d83c18a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:40:56.674029 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:56.673871 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/63d742cf-3e5e-4327-8271-c2575d83c18a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"63d742cf-3e5e-4327-8271-c2575d83c18a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:40:56.674151 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:56.674038 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/63d742cf-3e5e-4327-8271-c2575d83c18a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"63d742cf-3e5e-4327-8271-c2575d83c18a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:40:56.676377 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:56.676351 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/63d742cf-3e5e-4327-8271-c2575d83c18a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"63d742cf-3e5e-4327-8271-c2575d83c18a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:40:56.677634 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:56.677283 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/63d742cf-3e5e-4327-8271-c2575d83c18a-config-out\") pod \"prometheus-k8s-0\" (UID: \"63d742cf-3e5e-4327-8271-c2575d83c18a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:40:56.677634 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:56.677373 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/63d742cf-3e5e-4327-8271-c2575d83c18a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"63d742cf-3e5e-4327-8271-c2575d83c18a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:40:56.677634 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:56.677402 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/63d742cf-3e5e-4327-8271-c2575d83c18a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"63d742cf-3e5e-4327-8271-c2575d83c18a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:40:56.678405 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:56.678375 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/63d742cf-3e5e-4327-8271-c2575d83c18a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"63d742cf-3e5e-4327-8271-c2575d83c18a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:40:56.678584 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:56.678547 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/63d742cf-3e5e-4327-8271-c2575d83c18a-web-config\") pod \"prometheus-k8s-0\" (UID: \"63d742cf-3e5e-4327-8271-c2575d83c18a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:40:56.713932 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:56.713901 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tvw2d\" (UniqueName: \"kubernetes.io/projected/63d742cf-3e5e-4327-8271-c2575d83c18a-kube-api-access-tvw2d\") pod \"prometheus-k8s-0\" (UID: \"63d742cf-3e5e-4327-8271-c2575d83c18a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:40:56.765587 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:56.765555 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:40:56.771390 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:56.771363 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-575cbc495d-tf4vt"] Sep 07 13:40:56.881929 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:56.881853 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-74cb57df7-9tlcd" podStartSLOduration=2.37060232 podStartE2EDuration="7.881829001s" totalImagesPullingTime="5.511226681s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:40:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:40:56.789973087 +0000 UTC m=+128.284102438" watchObservedRunningTime="2026-09-07 13:40:56.881829001 +0000 UTC m=+128.375958355" Sep 07 13:40:56.944225 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:56.944097 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-777b7789f7-v8lgp" podStartSLOduration=2.580455649 podStartE2EDuration="15.944075111s" totalImagesPullingTime="13.363619462s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:40:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:40:56.942027654 +0000 UTC m=+128.436156977" watchObservedRunningTime="2026-09-07 13:40:56.944075111 +0000 UTC m=+128.438204440" Sep 07 13:40:56.985525 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:56.985205 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-vqdpl" podStartSLOduration=2.686760266 podStartE2EDuration="7.985183378s" totalImagesPullingTime="5.298423112s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:40:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:40:56.982991347 +0000 UTC m=+128.477120681" watchObservedRunningTime="2026-09-07 13:40:56.985183378 +0000 UTC m=+128.479312709" Sep 07 13:40:57.386887 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:40:57.386858 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63d742cf_3e5e_4327_8271_c2575d83c18a.slice/crio-da0ae68d178c1d53cdd6cec6c2ef8e1577b6b4f553bf7a253ae19cf78383a008 WatchSource:0}: Error finding container da0ae68d178c1d53cdd6cec6c2ef8e1577b6b4f553bf7a253ae19cf78383a008: Status 404 returned error can't find the container with id da0ae68d178c1d53cdd6cec6c2ef8e1577b6b4f553bf7a253ae19cf78383a008 Sep 07 13:40:57.387610 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:57.387585 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 07 13:40:57.585345 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:57.584526 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"63d742cf-3e5e-4327-8271-c2575d83c18a","Type":"ContainerStarted","Data":"5829fc8cdbc11d8e2054d44290df109bcf6560fd95d505c6cf9a40d5755cb873"} Sep 07 13:40:57.585345 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:57.584686 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"63d742cf-3e5e-4327-8271-c2575d83c18a","Type":"ContainerStarted","Data":"da0ae68d178c1d53cdd6cec6c2ef8e1577b6b4f553bf7a253ae19cf78383a008"} Sep 07 13:40:57.591444 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:57.591415 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fnm2w" event={"ID":"48d72f65-6e57-4f7d-817b-09f37c89080d","Type":"ContainerStarted","Data":"9a59643076755cf1196ef1d3bf45dd037265833b550a0558fce3adeedad30efb"} Sep 07 13:40:57.591577 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:57.591464 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fnm2w" event={"ID":"48d72f65-6e57-4f7d-817b-09f37c89080d","Type":"ContainerStarted","Data":"93d80f1054a3139fa0a845e6176c3de70c62249911f265756587dcd5bdd1928d"} Sep 07 13:40:57.776080 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:57.774798 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-fnm2w" podStartSLOduration=3.50963105 podStartE2EDuration="8.77475922s" totalImagesPullingTime="5.165426967s" totalInitContainerRuntime="99.701203ms" isStatefulPod=true podCreationTimestamp="2026-09-07 13:40:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:40:57.772762859 +0000 UTC m=+129.266892191" watchObservedRunningTime="2026-09-07 13:40:57.77475922 +0000 UTC m=+129.268888550" Sep 07 13:40:58.598705 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:58.598673 2575 generic.go:356] "Generic (PLEG): container finished" podID="63d742cf-3e5e-4327-8271-c2575d83c18a" containerID="5829fc8cdbc11d8e2054d44290df109bcf6560fd95d505c6cf9a40d5755cb873" exitCode=0 Sep 07 13:40:58.599248 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:58.598761 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"63d742cf-3e5e-4327-8271-c2575d83c18a","Type":"ContainerDied","Data":"5829fc8cdbc11d8e2054d44290df109bcf6560fd95d505c6cf9a40d5755cb873"} Sep 07 13:40:58.894226 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:58.894145 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/51f8ac5a-daf1-48b6-ace7-9b7674b90409-metrics-certs\") pod \"network-metrics-daemon-pwdkf\" (UID: \"51f8ac5a-daf1-48b6-ace7-9b7674b90409\") " pod="openshift-multus/network-metrics-daemon-pwdkf" Sep 07 13:40:58.896601 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:58.896580 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/51f8ac5a-daf1-48b6-ace7-9b7674b90409-metrics-certs\") pod \"network-metrics-daemon-pwdkf\" (UID: \"51f8ac5a-daf1-48b6-ace7-9b7674b90409\") " pod="openshift-multus/network-metrics-daemon-pwdkf" Sep 07 13:40:59.118467 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:59.118439 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-pgwth\"" Sep 07 13:40:59.125150 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:59.125125 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pwdkf" Sep 07 13:40:59.636960 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:40:59.636924 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-777b7789f7-v8lgp"] Sep 07 13:41:00.076586 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:41:00.076248 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-pwdkf"] Sep 07 13:41:00.084864 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:41:00.084214 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51f8ac5a_daf1_48b6_ace7_9b7674b90409.slice/crio-3fd5bd36121a79a6c21da65a791118d2694868f788b89f622356b047b0ec2b4d WatchSource:0}: Error finding container 3fd5bd36121a79a6c21da65a791118d2694868f788b89f622356b047b0ec2b4d: Status 404 returned error can't find the container with id 3fd5bd36121a79a6c21da65a791118d2694868f788b89f622356b047b0ec2b4d Sep 07 13:41:00.609613 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:41:00.609374 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-vtqzz" event={"ID":"7eb6bde7-2318-401d-9aaa-3f1d57f83db4","Type":"ContainerStarted","Data":"b6296cd44ddc2755319ddfce83a54cc95d4133d18851f3e2eb2b9ad859df954e"} Sep 07 13:41:00.610339 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:41:00.610315 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-vtqzz" Sep 07 13:41:00.614814 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:41:00.614768 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dceb3d71-9ec0-43f5-92a5-2923f47a0d9c","Type":"ContainerStarted","Data":"237b36376b5a22c9038b44faf065f24ccf06eebca8ae20e6d48d452b7db97cfb"} Sep 07 13:41:00.614948 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:41:00.614861 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dceb3d71-9ec0-43f5-92a5-2923f47a0d9c","Type":"ContainerStarted","Data":"0085272a293b0f9e867e1ea3d196adb8c1a9891a4256b6ed4179f29624d1cee2"} Sep 07 13:41:00.614948 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:41:00.614907 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dceb3d71-9ec0-43f5-92a5-2923f47a0d9c","Type":"ContainerStarted","Data":"53c22286dfe3a7c136c2e633dc8f2eb21f7294ff8379e7d66d87519c39f24034"} Sep 07 13:41:00.614948 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:41:00.614945 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dceb3d71-9ec0-43f5-92a5-2923f47a0d9c","Type":"ContainerStarted","Data":"99785e0f89e9b1f483620a0f8f50e7f7e5f637893ca29f87be70310c6ccf4b30"} Sep 07 13:41:00.615097 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:41:00.614983 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dceb3d71-9ec0-43f5-92a5-2923f47a0d9c","Type":"ContainerStarted","Data":"66d92b2887a88bf98317bc2bc8ce606d581fcacfc0253564f4cb067fc96a78f2"} Sep 07 13:41:00.616575 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:41:00.616546 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7c46d75f98-bd6g4" event={"ID":"85142a16-87b7-40a4-9247-2259c82fe20b","Type":"ContainerStarted","Data":"321cfbe654bc5b4deea4b7f383fd93a8716848651ff538396e306961648cff1e"} Sep 07 13:41:00.617756 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:41:00.617736 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-vtqzz" Sep 07 13:41:00.618124 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:41:00.618101 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-pwdkf" event={"ID":"51f8ac5a-daf1-48b6-ace7-9b7674b90409","Type":"ContainerStarted","Data":"3fd5bd36121a79a6c21da65a791118d2694868f788b89f622356b047b0ec2b4d"} Sep 07 13:41:00.636736 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:41:00.636696 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-vtqzz" podStartSLOduration=3.186812844 podStartE2EDuration="6.636679296s" totalImagesPullingTime="3.449866452s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:40:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:41:00.63575948 +0000 UTC m=+132.129888811" watchObservedRunningTime="2026-09-07 13:41:00.636679296 +0000 UTC m=+132.130808627" Sep 07 13:41:00.717105 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:41:00.717034 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-7c46d75f98-bd6g4" podStartSLOduration=3.246261594 podStartE2EDuration="6.717012655s" totalImagesPullingTime="3.470751061s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:40:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:41:00.716727806 +0000 UTC m=+132.210857137" watchObservedRunningTime="2026-09-07 13:41:00.717012655 +0000 UTC m=+132.211141989" Sep 07 13:41:02.213172 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:41:02.213129 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-777b7789f7-v8lgp" Sep 07 13:41:03.636005 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:41:03.635897 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-pwdkf" event={"ID":"51f8ac5a-daf1-48b6-ace7-9b7674b90409","Type":"ContainerStarted","Data":"3e1c165d2795092fa285aaa1e191ab5a15e858de3c1448e1ea89928b2699604a"} Sep 07 13:41:03.639576 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:41:03.639496 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"63d742cf-3e5e-4327-8271-c2575d83c18a","Type":"ContainerStarted","Data":"940c73c3620343ada5f39c497a6a202b563ce43db00425a8dda228d291dcbc30"} Sep 07 13:41:04.648553 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:41:04.648518 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-pwdkf" event={"ID":"51f8ac5a-daf1-48b6-ace7-9b7674b90409","Type":"ContainerStarted","Data":"3d76a285c53264754d3017fc862f7384582cb90475898e659ca2ccc8e03a4f2f"} Sep 07 13:41:04.651452 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:41:04.651417 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"63d742cf-3e5e-4327-8271-c2575d83c18a","Type":"ContainerStarted","Data":"8ff6c2469badce73517ac8062daf82fc4cd3ee07a7568721c33d7ee9ccb822cf"} Sep 07 13:41:04.655675 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:41:04.655649 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dceb3d71-9ec0-43f5-92a5-2923f47a0d9c","Type":"ContainerStarted","Data":"9376d1ff33fbba051e131b06968956af7021fa02bf3277f43577c4e073a1118c"} Sep 07 13:41:04.679629 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:41:04.679566 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-pwdkf" podStartSLOduration=132.545681342 podStartE2EDuration="2m15.679547216s" totalImagesPullingTime="3.133865874s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:38:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:41:04.679322415 +0000 UTC m=+136.173451748" watchObservedRunningTime="2026-09-07 13:41:04.679547216 +0000 UTC m=+136.173676550" Sep 07 13:41:04.746442 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:41:04.746378 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=4.182251218 podStartE2EDuration="14.746356956s" totalImagesPullingTime="10.530449162s" totalInitContainerRuntime="33.656576ms" isStatefulPod=false podCreationTimestamp="2026-09-07 13:40:50 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:41:04.74363897 +0000 UTC m=+136.237768324" watchObservedRunningTime="2026-09-07 13:41:04.746356956 +0000 UTC m=+136.240486288" Sep 07 13:41:06.667814 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:41:06.667693 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"63d742cf-3e5e-4327-8271-c2575d83c18a","Type":"ContainerStarted","Data":"87f3755b285647f50d7881f478ce05df5425dc1175b0dd65772a276151f847a6"} Sep 07 13:41:06.667814 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:41:06.667767 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"63d742cf-3e5e-4327-8271-c2575d83c18a","Type":"ContainerStarted","Data":"79b85251e58df40637ec32a10358f68dec88486e11a602ae8f3e4cf76939529d"} Sep 07 13:41:06.668312 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:41:06.667823 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"63d742cf-3e5e-4327-8271-c2575d83c18a","Type":"ContainerStarted","Data":"16ac67901f2ba489cc7923209ea1b8d74c5d9d0504c09f4525f830fb7b3aaf06"} Sep 07 13:41:06.668312 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:41:06.667849 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"63d742cf-3e5e-4327-8271-c2575d83c18a","Type":"ContainerStarted","Data":"6b5871e896687b34f7a7791f017f80c145ded1d3ec003da64e94933de77ee540"} Sep 07 13:41:06.765765 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:41:06.765720 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:41:14.609066 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:41:14.609022 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-7c46d75f98-bd6g4" Sep 07 13:41:14.609518 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:41:14.609122 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-7c46d75f98-bd6g4" Sep 07 13:41:21.806145 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:41:21.806068 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-575cbc495d-tf4vt" podUID="e7b30596-01a1-4b88-b841-786c2fc17b86" containerName="registry" containerID="cri-o://0465e5d0b4d900791457ad119c8e743a76bb7bde3432e4f2ab3cc54a1320b641" gracePeriod=30 Sep 07 13:41:22.046778 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:41:22.046756 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-575cbc495d-tf4vt" Sep 07 13:41:22.074838 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:41:22.074740 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=18.957822652 podStartE2EDuration="26.074723439s" totalImagesPullingTime="7.08200404s" totalInitContainerRuntime="34.896747ms" isStatefulPod=false podCreationTimestamp="2026-09-07 13:40:56 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:41:06.731840175 +0000 UTC m=+138.225969506" watchObservedRunningTime="2026-09-07 13:41:22.074723439 +0000 UTC m=+153.568852773" Sep 07 13:41:22.206571 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:41:22.206536 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e7b30596-01a1-4b88-b841-786c2fc17b86-trusted-ca\") pod \"e7b30596-01a1-4b88-b841-786c2fc17b86\" (UID: \"e7b30596-01a1-4b88-b841-786c2fc17b86\") " Sep 07 13:41:22.206571 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:41:22.206573 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e7b30596-01a1-4b88-b841-786c2fc17b86-bound-sa-token\") pod \"e7b30596-01a1-4b88-b841-786c2fc17b86\" (UID: \"e7b30596-01a1-4b88-b841-786c2fc17b86\") " Sep 07 13:41:22.206869 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:41:22.206614 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e7b30596-01a1-4b88-b841-786c2fc17b86-registry-certificates\") pod \"e7b30596-01a1-4b88-b841-786c2fc17b86\" (UID: \"e7b30596-01a1-4b88-b841-786c2fc17b86\") " Sep 07 13:41:22.206869 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:41:22.206735 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e7b30596-01a1-4b88-b841-786c2fc17b86-registry-tls\") pod \"e7b30596-01a1-4b88-b841-786c2fc17b86\" (UID: \"e7b30596-01a1-4b88-b841-786c2fc17b86\") " Sep 07 13:41:22.206869 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:41:22.206764 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e7b30596-01a1-4b88-b841-786c2fc17b86-image-registry-private-configuration\") pod \"e7b30596-01a1-4b88-b841-786c2fc17b86\" (UID: \"e7b30596-01a1-4b88-b841-786c2fc17b86\") " Sep 07 13:41:22.207024 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:41:22.206929 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e7b30596-01a1-4b88-b841-786c2fc17b86-ca-trust-extracted\") pod \"e7b30596-01a1-4b88-b841-786c2fc17b86\" (UID: \"e7b30596-01a1-4b88-b841-786c2fc17b86\") " Sep 07 13:41:22.207024 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:41:22.206987 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qvjz9\" (UniqueName: \"kubernetes.io/projected/e7b30596-01a1-4b88-b841-786c2fc17b86-kube-api-access-qvjz9\") pod \"e7b30596-01a1-4b88-b841-786c2fc17b86\" (UID: \"e7b30596-01a1-4b88-b841-786c2fc17b86\") " Sep 07 13:41:22.207024 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:41:22.207017 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e7b30596-01a1-4b88-b841-786c2fc17b86-installation-pull-secrets\") pod \"e7b30596-01a1-4b88-b841-786c2fc17b86\" (UID: \"e7b30596-01a1-4b88-b841-786c2fc17b86\") " Sep 07 13:41:22.207320 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:41:22.207008 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e7b30596-01a1-4b88-b841-786c2fc17b86-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "e7b30596-01a1-4b88-b841-786c2fc17b86" (UID: "e7b30596-01a1-4b88-b841-786c2fc17b86"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 07 13:41:22.207320 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:41:22.207072 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e7b30596-01a1-4b88-b841-786c2fc17b86-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "e7b30596-01a1-4b88-b841-786c2fc17b86" (UID: "e7b30596-01a1-4b88-b841-786c2fc17b86"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 07 13:41:22.209159 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:41:22.209128 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e7b30596-01a1-4b88-b841-786c2fc17b86-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "e7b30596-01a1-4b88-b841-786c2fc17b86" (UID: "e7b30596-01a1-4b88-b841-786c2fc17b86"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 07 13:41:22.209470 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:41:22.209443 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e7b30596-01a1-4b88-b841-786c2fc17b86-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "e7b30596-01a1-4b88-b841-786c2fc17b86" (UID: "e7b30596-01a1-4b88-b841-786c2fc17b86"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 13:41:22.209711 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:41:22.209680 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e7b30596-01a1-4b88-b841-786c2fc17b86-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "e7b30596-01a1-4b88-b841-786c2fc17b86" (UID: "e7b30596-01a1-4b88-b841-786c2fc17b86"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 13:41:22.209775 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:41:22.209720 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e7b30596-01a1-4b88-b841-786c2fc17b86-kube-api-access-qvjz9" (OuterVolumeSpecName: "kube-api-access-qvjz9") pod "e7b30596-01a1-4b88-b841-786c2fc17b86" (UID: "e7b30596-01a1-4b88-b841-786c2fc17b86"). InnerVolumeSpecName "kube-api-access-qvjz9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 07 13:41:22.209775 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:41:22.209746 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e7b30596-01a1-4b88-b841-786c2fc17b86-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "e7b30596-01a1-4b88-b841-786c2fc17b86" (UID: "e7b30596-01a1-4b88-b841-786c2fc17b86"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 07 13:41:22.215359 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:41:22.215333 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7b30596-01a1-4b88-b841-786c2fc17b86-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "e7b30596-01a1-4b88-b841-786c2fc17b86" (UID: "e7b30596-01a1-4b88-b841-786c2fc17b86"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 07 13:41:22.308382 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:41:22.308339 2575 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e7b30596-01a1-4b88-b841-786c2fc17b86-ca-trust-extracted\") on node \"ip-10-0-141-124.ec2.internal\" DevicePath \"\"" Sep 07 13:41:22.308382 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:41:22.308377 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qvjz9\" (UniqueName: \"kubernetes.io/projected/e7b30596-01a1-4b88-b841-786c2fc17b86-kube-api-access-qvjz9\") on node \"ip-10-0-141-124.ec2.internal\" DevicePath \"\"" Sep 07 13:41:22.308382 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:41:22.308388 2575 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e7b30596-01a1-4b88-b841-786c2fc17b86-installation-pull-secrets\") on node \"ip-10-0-141-124.ec2.internal\" DevicePath \"\"" Sep 07 13:41:22.308382 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:41:22.308397 2575 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e7b30596-01a1-4b88-b841-786c2fc17b86-trusted-ca\") on node \"ip-10-0-141-124.ec2.internal\" DevicePath \"\"" Sep 07 13:41:22.308632 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:41:22.308405 2575 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e7b30596-01a1-4b88-b841-786c2fc17b86-bound-sa-token\") on node \"ip-10-0-141-124.ec2.internal\" DevicePath \"\"" Sep 07 13:41:22.308632 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:41:22.308413 2575 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e7b30596-01a1-4b88-b841-786c2fc17b86-registry-certificates\") on node \"ip-10-0-141-124.ec2.internal\" DevicePath \"\"" Sep 07 13:41:22.308632 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:41:22.308421 2575 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e7b30596-01a1-4b88-b841-786c2fc17b86-registry-tls\") on node \"ip-10-0-141-124.ec2.internal\" DevicePath \"\"" Sep 07 13:41:22.308632 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:41:22.308430 2575 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e7b30596-01a1-4b88-b841-786c2fc17b86-image-registry-private-configuration\") on node \"ip-10-0-141-124.ec2.internal\" DevicePath \"\"" Sep 07 13:41:22.736047 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:41:22.736014 2575 generic.go:356] "Generic (PLEG): container finished" podID="e7b30596-01a1-4b88-b841-786c2fc17b86" containerID="0465e5d0b4d900791457ad119c8e743a76bb7bde3432e4f2ab3cc54a1320b641" exitCode=0 Sep 07 13:41:22.736214 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:41:22.736086 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-575cbc495d-tf4vt" Sep 07 13:41:22.736214 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:41:22.736095 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-575cbc495d-tf4vt" event={"ID":"e7b30596-01a1-4b88-b841-786c2fc17b86","Type":"ContainerDied","Data":"0465e5d0b4d900791457ad119c8e743a76bb7bde3432e4f2ab3cc54a1320b641"} Sep 07 13:41:22.736214 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:41:22.736166 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-575cbc495d-tf4vt" event={"ID":"e7b30596-01a1-4b88-b841-786c2fc17b86","Type":"ContainerDied","Data":"d8bfc5078a0e7e8d1792e3ef5cd0cce5d269b53473ad03da273b85a6026fd5cd"} Sep 07 13:41:22.736214 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:41:22.736186 2575 scope.go:117] "RemoveContainer" containerID="0465e5d0b4d900791457ad119c8e743a76bb7bde3432e4f2ab3cc54a1320b641" Sep 07 13:41:22.745888 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:41:22.745872 2575 scope.go:117] "RemoveContainer" containerID="0465e5d0b4d900791457ad119c8e743a76bb7bde3432e4f2ab3cc54a1320b641" Sep 07 13:41:22.746148 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:41:22.746129 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0465e5d0b4d900791457ad119c8e743a76bb7bde3432e4f2ab3cc54a1320b641\": container with ID starting with 0465e5d0b4d900791457ad119c8e743a76bb7bde3432e4f2ab3cc54a1320b641 not found: ID does not exist" containerID="0465e5d0b4d900791457ad119c8e743a76bb7bde3432e4f2ab3cc54a1320b641" Sep 07 13:41:22.746218 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:41:22.746153 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0465e5d0b4d900791457ad119c8e743a76bb7bde3432e4f2ab3cc54a1320b641"} err="failed to get container status \"0465e5d0b4d900791457ad119c8e743a76bb7bde3432e4f2ab3cc54a1320b641\": rpc error: code = NotFound desc = could not find container \"0465e5d0b4d900791457ad119c8e743a76bb7bde3432e4f2ab3cc54a1320b641\": container with ID starting with 0465e5d0b4d900791457ad119c8e743a76bb7bde3432e4f2ab3cc54a1320b641 not found: ID does not exist" Sep 07 13:41:22.764501 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:41:22.764473 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-575cbc495d-tf4vt"] Sep 07 13:41:22.769952 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:41:22.769930 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-575cbc495d-tf4vt"] Sep 07 13:41:22.993832 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:41:22.993746 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e7b30596-01a1-4b88-b841-786c2fc17b86" path="/var/lib/kubelet/pods/e7b30596-01a1-4b88-b841-786c2fc17b86/volumes" Sep 07 13:41:24.661657 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:41:24.661616 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-777b7789f7-v8lgp" podUID="bb093481-1db5-4cc6-9174-01727a3f4b69" containerName="console" containerID="cri-o://16cf505f24f1998d84eda82ef3a135abab286b2ca2d09bd9446392753183177c" gracePeriod=15 Sep 07 13:41:24.929969 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:41:24.929910 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-777b7789f7-v8lgp" Sep 07 13:41:25.028070 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:41:25.028038 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bb093481-1db5-4cc6-9174-01727a3f4b69-console-oauth-config\") pod \"bb093481-1db5-4cc6-9174-01727a3f4b69\" (UID: \"bb093481-1db5-4cc6-9174-01727a3f4b69\") " Sep 07 13:41:25.028241 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:41:25.028095 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bb093481-1db5-4cc6-9174-01727a3f4b69-console-serving-cert\") pod \"bb093481-1db5-4cc6-9174-01727a3f4b69\" (UID: \"bb093481-1db5-4cc6-9174-01727a3f4b69\") " Sep 07 13:41:25.028241 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:41:25.028122 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bb093481-1db5-4cc6-9174-01727a3f4b69-service-ca\") pod \"bb093481-1db5-4cc6-9174-01727a3f4b69\" (UID: \"bb093481-1db5-4cc6-9174-01727a3f4b69\") " Sep 07 13:41:25.028241 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:41:25.028145 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bb093481-1db5-4cc6-9174-01727a3f4b69-console-config\") pod \"bb093481-1db5-4cc6-9174-01727a3f4b69\" (UID: \"bb093481-1db5-4cc6-9174-01727a3f4b69\") " Sep 07 13:41:25.028241 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:41:25.028169 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bb093481-1db5-4cc6-9174-01727a3f4b69-oauth-serving-cert\") pod \"bb093481-1db5-4cc6-9174-01727a3f4b69\" (UID: \"bb093481-1db5-4cc6-9174-01727a3f4b69\") " Sep 07 13:41:25.028241 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:41:25.028201 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t7sfp\" (UniqueName: \"kubernetes.io/projected/bb093481-1db5-4cc6-9174-01727a3f4b69-kube-api-access-t7sfp\") pod \"bb093481-1db5-4cc6-9174-01727a3f4b69\" (UID: \"bb093481-1db5-4cc6-9174-01727a3f4b69\") " Sep 07 13:41:25.028551 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:41:25.028528 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bb093481-1db5-4cc6-9174-01727a3f4b69-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "bb093481-1db5-4cc6-9174-01727a3f4b69" (UID: "bb093481-1db5-4cc6-9174-01727a3f4b69"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 07 13:41:25.028615 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:41:25.028565 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bb093481-1db5-4cc6-9174-01727a3f4b69-service-ca" (OuterVolumeSpecName: "service-ca") pod "bb093481-1db5-4cc6-9174-01727a3f4b69" (UID: "bb093481-1db5-4cc6-9174-01727a3f4b69"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 07 13:41:25.028615 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:41:25.028588 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bb093481-1db5-4cc6-9174-01727a3f4b69-console-config" (OuterVolumeSpecName: "console-config") pod "bb093481-1db5-4cc6-9174-01727a3f4b69" (UID: "bb093481-1db5-4cc6-9174-01727a3f4b69"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 07 13:41:25.030518 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:41:25.030487 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bb093481-1db5-4cc6-9174-01727a3f4b69-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "bb093481-1db5-4cc6-9174-01727a3f4b69" (UID: "bb093481-1db5-4cc6-9174-01727a3f4b69"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 13:41:25.030610 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:41:25.030545 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bb093481-1db5-4cc6-9174-01727a3f4b69-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "bb093481-1db5-4cc6-9174-01727a3f4b69" (UID: "bb093481-1db5-4cc6-9174-01727a3f4b69"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 13:41:25.030610 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:41:25.030566 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bb093481-1db5-4cc6-9174-01727a3f4b69-kube-api-access-t7sfp" (OuterVolumeSpecName: "kube-api-access-t7sfp") pod "bb093481-1db5-4cc6-9174-01727a3f4b69" (UID: "bb093481-1db5-4cc6-9174-01727a3f4b69"). InnerVolumeSpecName "kube-api-access-t7sfp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 07 13:41:25.129270 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:41:25.129234 2575 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bb093481-1db5-4cc6-9174-01727a3f4b69-console-oauth-config\") on node \"ip-10-0-141-124.ec2.internal\" DevicePath \"\"" Sep 07 13:41:25.129270 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:41:25.129263 2575 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bb093481-1db5-4cc6-9174-01727a3f4b69-console-serving-cert\") on node \"ip-10-0-141-124.ec2.internal\" DevicePath \"\"" Sep 07 13:41:25.129270 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:41:25.129274 2575 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bb093481-1db5-4cc6-9174-01727a3f4b69-service-ca\") on node \"ip-10-0-141-124.ec2.internal\" DevicePath \"\"" Sep 07 13:41:25.129481 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:41:25.129282 2575 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bb093481-1db5-4cc6-9174-01727a3f4b69-console-config\") on node \"ip-10-0-141-124.ec2.internal\" DevicePath \"\"" Sep 07 13:41:25.129481 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:41:25.129291 2575 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bb093481-1db5-4cc6-9174-01727a3f4b69-oauth-serving-cert\") on node \"ip-10-0-141-124.ec2.internal\" DevicePath \"\"" Sep 07 13:41:25.129481 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:41:25.129299 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t7sfp\" (UniqueName: \"kubernetes.io/projected/bb093481-1db5-4cc6-9174-01727a3f4b69-kube-api-access-t7sfp\") on node \"ip-10-0-141-124.ec2.internal\" DevicePath \"\"" Sep 07 13:41:25.750161 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:41:25.750131 2575 generic.go:356] "Generic (PLEG): container finished" podID="bb093481-1db5-4cc6-9174-01727a3f4b69" containerID="16cf505f24f1998d84eda82ef3a135abab286b2ca2d09bd9446392753183177c" exitCode=0 Sep 07 13:41:25.750866 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:41:25.750190 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-777b7789f7-v8lgp" Sep 07 13:41:25.750866 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:41:25.750221 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-777b7789f7-v8lgp" event={"ID":"bb093481-1db5-4cc6-9174-01727a3f4b69","Type":"ContainerDied","Data":"16cf505f24f1998d84eda82ef3a135abab286b2ca2d09bd9446392753183177c"} Sep 07 13:41:25.750866 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:41:25.750270 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-777b7789f7-v8lgp" event={"ID":"bb093481-1db5-4cc6-9174-01727a3f4b69","Type":"ContainerDied","Data":"b22dd54bc04efb6febcf84512260fec085b3220959a59de52b3a15bbdc44ecb6"} Sep 07 13:41:25.750866 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:41:25.750290 2575 scope.go:117] "RemoveContainer" containerID="16cf505f24f1998d84eda82ef3a135abab286b2ca2d09bd9446392753183177c" Sep 07 13:41:25.759162 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:41:25.759146 2575 scope.go:117] "RemoveContainer" containerID="16cf505f24f1998d84eda82ef3a135abab286b2ca2d09bd9446392753183177c" Sep 07 13:41:25.759422 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:41:25.759405 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"16cf505f24f1998d84eda82ef3a135abab286b2ca2d09bd9446392753183177c\": container with ID starting with 16cf505f24f1998d84eda82ef3a135abab286b2ca2d09bd9446392753183177c not found: ID does not exist" containerID="16cf505f24f1998d84eda82ef3a135abab286b2ca2d09bd9446392753183177c" Sep 07 13:41:25.759469 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:41:25.759431 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"16cf505f24f1998d84eda82ef3a135abab286b2ca2d09bd9446392753183177c"} err="failed to get container status \"16cf505f24f1998d84eda82ef3a135abab286b2ca2d09bd9446392753183177c\": rpc error: code = NotFound desc = could not find container \"16cf505f24f1998d84eda82ef3a135abab286b2ca2d09bd9446392753183177c\": container with ID starting with 16cf505f24f1998d84eda82ef3a135abab286b2ca2d09bd9446392753183177c not found: ID does not exist" Sep 07 13:41:25.775488 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:41:25.775463 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-777b7789f7-v8lgp"] Sep 07 13:41:25.779585 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:41:25.779561 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-777b7789f7-v8lgp"] Sep 07 13:41:26.993441 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:41:26.993409 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bb093481-1db5-4cc6-9174-01727a3f4b69" path="/var/lib/kubelet/pods/bb093481-1db5-4cc6-9174-01727a3f4b69/volumes" Sep 07 13:41:31.776559 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:41:31.776525 2575 generic.go:356] "Generic (PLEG): container finished" podID="d58ec2a6-c963-4cf8-a7d5-65877ae45e14" containerID="f2b1ae44fc1e9f7b52d2404785e615bbcc66324c3d3bdb0fbb4a1ac6f41569ca" exitCode=0 Sep 07 13:41:31.777039 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:41:31.776583 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-g5t5m" event={"ID":"d58ec2a6-c963-4cf8-a7d5-65877ae45e14","Type":"ContainerDied","Data":"f2b1ae44fc1e9f7b52d2404785e615bbcc66324c3d3bdb0fbb4a1ac6f41569ca"} Sep 07 13:41:31.777039 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:41:31.777015 2575 scope.go:117] "RemoveContainer" containerID="f2b1ae44fc1e9f7b52d2404785e615bbcc66324c3d3bdb0fbb4a1ac6f41569ca" Sep 07 13:41:32.784716 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:41:32.784686 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-g5t5m" event={"ID":"d58ec2a6-c963-4cf8-a7d5-65877ae45e14","Type":"ContainerStarted","Data":"c2e316bc3b89242afd31447a22204fc6c13146920bd2692b7cf8cdf6d36395ea"} Sep 07 13:41:34.614545 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:41:34.614507 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-7c46d75f98-bd6g4" Sep 07 13:41:34.618272 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:41:34.618249 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-7c46d75f98-bd6g4" Sep 07 13:41:56.766463 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:41:56.766429 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:41:56.785961 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:41:56.785938 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:41:56.895300 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:41:56.895276 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:42:10.121661 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:10.121628 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 07 13:42:10.122156 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:10.121973 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="dceb3d71-9ec0-43f5-92a5-2923f47a0d9c" containerName="alertmanager" containerID="cri-o://66d92b2887a88bf98317bc2bc8ce606d581fcacfc0253564f4cb067fc96a78f2" gracePeriod=120 Sep 07 13:42:10.122156 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:10.122041 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="dceb3d71-9ec0-43f5-92a5-2923f47a0d9c" containerName="kube-rbac-proxy-web" containerID="cri-o://53c22286dfe3a7c136c2e633dc8f2eb21f7294ff8379e7d66d87519c39f24034" gracePeriod=120 Sep 07 13:42:10.122156 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:10.122095 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="dceb3d71-9ec0-43f5-92a5-2923f47a0d9c" containerName="config-reloader" containerID="cri-o://99785e0f89e9b1f483620a0f8f50e7f7e5f637893ca29f87be70310c6ccf4b30" gracePeriod=120 Sep 07 13:42:10.122335 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:10.122089 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="dceb3d71-9ec0-43f5-92a5-2923f47a0d9c" containerName="prom-label-proxy" containerID="cri-o://9376d1ff33fbba051e131b06968956af7021fa02bf3277f43577c4e073a1118c" gracePeriod=120 Sep 07 13:42:10.122335 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:10.122037 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="dceb3d71-9ec0-43f5-92a5-2923f47a0d9c" containerName="kube-rbac-proxy-metric" containerID="cri-o://237b36376b5a22c9038b44faf065f24ccf06eebca8ae20e6d48d452b7db97cfb" gracePeriod=120 Sep 07 13:42:10.122427 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:10.122140 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="dceb3d71-9ec0-43f5-92a5-2923f47a0d9c" containerName="kube-rbac-proxy" containerID="cri-o://0085272a293b0f9e867e1ea3d196adb8c1a9891a4256b6ed4179f29624d1cee2" gracePeriod=120 Sep 07 13:42:10.935615 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:10.935582 2575 generic.go:356] "Generic (PLEG): container finished" podID="dceb3d71-9ec0-43f5-92a5-2923f47a0d9c" containerID="9376d1ff33fbba051e131b06968956af7021fa02bf3277f43577c4e073a1118c" exitCode=0 Sep 07 13:42:10.935615 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:10.935606 2575 generic.go:356] "Generic (PLEG): container finished" podID="dceb3d71-9ec0-43f5-92a5-2923f47a0d9c" containerID="237b36376b5a22c9038b44faf065f24ccf06eebca8ae20e6d48d452b7db97cfb" exitCode=0 Sep 07 13:42:10.935615 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:10.935612 2575 generic.go:356] "Generic (PLEG): container finished" podID="dceb3d71-9ec0-43f5-92a5-2923f47a0d9c" containerID="0085272a293b0f9e867e1ea3d196adb8c1a9891a4256b6ed4179f29624d1cee2" exitCode=0 Sep 07 13:42:10.935615 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:10.935618 2575 generic.go:356] "Generic (PLEG): container finished" podID="dceb3d71-9ec0-43f5-92a5-2923f47a0d9c" containerID="99785e0f89e9b1f483620a0f8f50e7f7e5f637893ca29f87be70310c6ccf4b30" exitCode=0 Sep 07 13:42:10.935615 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:10.935623 2575 generic.go:356] "Generic (PLEG): container finished" podID="dceb3d71-9ec0-43f5-92a5-2923f47a0d9c" containerID="66d92b2887a88bf98317bc2bc8ce606d581fcacfc0253564f4cb067fc96a78f2" exitCode=0 Sep 07 13:42:10.935924 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:10.935655 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dceb3d71-9ec0-43f5-92a5-2923f47a0d9c","Type":"ContainerDied","Data":"9376d1ff33fbba051e131b06968956af7021fa02bf3277f43577c4e073a1118c"} Sep 07 13:42:10.935924 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:10.935733 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dceb3d71-9ec0-43f5-92a5-2923f47a0d9c","Type":"ContainerDied","Data":"237b36376b5a22c9038b44faf065f24ccf06eebca8ae20e6d48d452b7db97cfb"} Sep 07 13:42:10.935924 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:10.935761 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dceb3d71-9ec0-43f5-92a5-2923f47a0d9c","Type":"ContainerDied","Data":"0085272a293b0f9e867e1ea3d196adb8c1a9891a4256b6ed4179f29624d1cee2"} Sep 07 13:42:10.935924 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:10.935799 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dceb3d71-9ec0-43f5-92a5-2923f47a0d9c","Type":"ContainerDied","Data":"99785e0f89e9b1f483620a0f8f50e7f7e5f637893ca29f87be70310c6ccf4b30"} Sep 07 13:42:10.935924 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:10.935823 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dceb3d71-9ec0-43f5-92a5-2923f47a0d9c","Type":"ContainerDied","Data":"66d92b2887a88bf98317bc2bc8ce606d581fcacfc0253564f4cb067fc96a78f2"} Sep 07 13:42:11.378436 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:11.378413 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 07 13:42:11.425592 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:11.425562 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dceb3d71-9ec0-43f5-92a5-2923f47a0d9c-tls-assets\") pod \"dceb3d71-9ec0-43f5-92a5-2923f47a0d9c\" (UID: \"dceb3d71-9ec0-43f5-92a5-2923f47a0d9c\") " Sep 07 13:42:11.425592 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:11.425598 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/dceb3d71-9ec0-43f5-92a5-2923f47a0d9c-config-volume\") pod \"dceb3d71-9ec0-43f5-92a5-2923f47a0d9c\" (UID: \"dceb3d71-9ec0-43f5-92a5-2923f47a0d9c\") " Sep 07 13:42:11.425843 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:11.425626 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dceb3d71-9ec0-43f5-92a5-2923f47a0d9c-config-out\") pod \"dceb3d71-9ec0-43f5-92a5-2923f47a0d9c\" (UID: \"dceb3d71-9ec0-43f5-92a5-2923f47a0d9c\") " Sep 07 13:42:11.425843 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:11.425664 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/dceb3d71-9ec0-43f5-92a5-2923f47a0d9c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"dceb3d71-9ec0-43f5-92a5-2923f47a0d9c\" (UID: \"dceb3d71-9ec0-43f5-92a5-2923f47a0d9c\") " Sep 07 13:42:11.425843 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:11.425710 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dceb3d71-9ec0-43f5-92a5-2923f47a0d9c-secret-alertmanager-kube-rbac-proxy\") pod \"dceb3d71-9ec0-43f5-92a5-2923f47a0d9c\" (UID: \"dceb3d71-9ec0-43f5-92a5-2923f47a0d9c\") " Sep 07 13:42:11.425843 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:11.425732 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dceb3d71-9ec0-43f5-92a5-2923f47a0d9c-secret-alertmanager-kube-rbac-proxy-web\") pod \"dceb3d71-9ec0-43f5-92a5-2923f47a0d9c\" (UID: \"dceb3d71-9ec0-43f5-92a5-2923f47a0d9c\") " Sep 07 13:42:11.425843 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:11.425760 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/dceb3d71-9ec0-43f5-92a5-2923f47a0d9c-cluster-tls-config\") pod \"dceb3d71-9ec0-43f5-92a5-2923f47a0d9c\" (UID: \"dceb3d71-9ec0-43f5-92a5-2923f47a0d9c\") " Sep 07 13:42:11.425843 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:11.425823 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dceb3d71-9ec0-43f5-92a5-2923f47a0d9c-alertmanager-trusted-ca-bundle\") pod \"dceb3d71-9ec0-43f5-92a5-2923f47a0d9c\" (UID: \"dceb3d71-9ec0-43f5-92a5-2923f47a0d9c\") " Sep 07 13:42:11.426164 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:11.425856 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/dceb3d71-9ec0-43f5-92a5-2923f47a0d9c-secret-alertmanager-main-tls\") pod \"dceb3d71-9ec0-43f5-92a5-2923f47a0d9c\" (UID: \"dceb3d71-9ec0-43f5-92a5-2923f47a0d9c\") " Sep 07 13:42:11.426164 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:11.425898 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/dceb3d71-9ec0-43f5-92a5-2923f47a0d9c-alertmanager-main-db\") pod \"dceb3d71-9ec0-43f5-92a5-2923f47a0d9c\" (UID: \"dceb3d71-9ec0-43f5-92a5-2923f47a0d9c\") " Sep 07 13:42:11.426164 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:11.425941 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-km2l7\" (UniqueName: \"kubernetes.io/projected/dceb3d71-9ec0-43f5-92a5-2923f47a0d9c-kube-api-access-km2l7\") pod \"dceb3d71-9ec0-43f5-92a5-2923f47a0d9c\" (UID: \"dceb3d71-9ec0-43f5-92a5-2923f47a0d9c\") " Sep 07 13:42:11.426164 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:11.425977 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dceb3d71-9ec0-43f5-92a5-2923f47a0d9c-web-config\") pod \"dceb3d71-9ec0-43f5-92a5-2923f47a0d9c\" (UID: \"dceb3d71-9ec0-43f5-92a5-2923f47a0d9c\") " Sep 07 13:42:11.426164 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:11.426008 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dceb3d71-9ec0-43f5-92a5-2923f47a0d9c-metrics-client-ca\") pod \"dceb3d71-9ec0-43f5-92a5-2923f47a0d9c\" (UID: \"dceb3d71-9ec0-43f5-92a5-2923f47a0d9c\") " Sep 07 13:42:11.426818 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:11.426608 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dceb3d71-9ec0-43f5-92a5-2923f47a0d9c-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "dceb3d71-9ec0-43f5-92a5-2923f47a0d9c" (UID: "dceb3d71-9ec0-43f5-92a5-2923f47a0d9c"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 07 13:42:11.426818 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:11.426648 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dceb3d71-9ec0-43f5-92a5-2923f47a0d9c-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "dceb3d71-9ec0-43f5-92a5-2923f47a0d9c" (UID: "dceb3d71-9ec0-43f5-92a5-2923f47a0d9c"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 07 13:42:11.427283 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:11.427093 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dceb3d71-9ec0-43f5-92a5-2923f47a0d9c-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "dceb3d71-9ec0-43f5-92a5-2923f47a0d9c" (UID: "dceb3d71-9ec0-43f5-92a5-2923f47a0d9c"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 07 13:42:11.430337 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:11.430297 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dceb3d71-9ec0-43f5-92a5-2923f47a0d9c-config-volume" (OuterVolumeSpecName: "config-volume") pod "dceb3d71-9ec0-43f5-92a5-2923f47a0d9c" (UID: "dceb3d71-9ec0-43f5-92a5-2923f47a0d9c"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 13:42:11.430922 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:11.430894 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dceb3d71-9ec0-43f5-92a5-2923f47a0d9c-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "dceb3d71-9ec0-43f5-92a5-2923f47a0d9c" (UID: "dceb3d71-9ec0-43f5-92a5-2923f47a0d9c"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 13:42:11.431044 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:11.430915 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dceb3d71-9ec0-43f5-92a5-2923f47a0d9c-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "dceb3d71-9ec0-43f5-92a5-2923f47a0d9c" (UID: "dceb3d71-9ec0-43f5-92a5-2923f47a0d9c"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 13:42:11.431044 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:11.430998 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dceb3d71-9ec0-43f5-92a5-2923f47a0d9c-config-out" (OuterVolumeSpecName: "config-out") pod "dceb3d71-9ec0-43f5-92a5-2923f47a0d9c" (UID: "dceb3d71-9ec0-43f5-92a5-2923f47a0d9c"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 07 13:42:11.431386 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:11.431345 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dceb3d71-9ec0-43f5-92a5-2923f47a0d9c-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "dceb3d71-9ec0-43f5-92a5-2923f47a0d9c" (UID: "dceb3d71-9ec0-43f5-92a5-2923f47a0d9c"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 13:42:11.431629 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:11.431603 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dceb3d71-9ec0-43f5-92a5-2923f47a0d9c-kube-api-access-km2l7" (OuterVolumeSpecName: "kube-api-access-km2l7") pod "dceb3d71-9ec0-43f5-92a5-2923f47a0d9c" (UID: "dceb3d71-9ec0-43f5-92a5-2923f47a0d9c"). InnerVolumeSpecName "kube-api-access-km2l7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 07 13:42:11.431994 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:11.431970 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dceb3d71-9ec0-43f5-92a5-2923f47a0d9c-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "dceb3d71-9ec0-43f5-92a5-2923f47a0d9c" (UID: "dceb3d71-9ec0-43f5-92a5-2923f47a0d9c"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 13:42:11.432174 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:11.432156 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dceb3d71-9ec0-43f5-92a5-2923f47a0d9c-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "dceb3d71-9ec0-43f5-92a5-2923f47a0d9c" (UID: "dceb3d71-9ec0-43f5-92a5-2923f47a0d9c"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 07 13:42:11.436409 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:11.436381 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dceb3d71-9ec0-43f5-92a5-2923f47a0d9c-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "dceb3d71-9ec0-43f5-92a5-2923f47a0d9c" (UID: "dceb3d71-9ec0-43f5-92a5-2923f47a0d9c"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 13:42:11.443734 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:11.443562 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dceb3d71-9ec0-43f5-92a5-2923f47a0d9c-web-config" (OuterVolumeSpecName: "web-config") pod "dceb3d71-9ec0-43f5-92a5-2923f47a0d9c" (UID: "dceb3d71-9ec0-43f5-92a5-2923f47a0d9c"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 13:42:11.526714 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:11.526634 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-km2l7\" (UniqueName: \"kubernetes.io/projected/dceb3d71-9ec0-43f5-92a5-2923f47a0d9c-kube-api-access-km2l7\") on node \"ip-10-0-141-124.ec2.internal\" DevicePath \"\"" Sep 07 13:42:11.526714 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:11.526664 2575 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dceb3d71-9ec0-43f5-92a5-2923f47a0d9c-web-config\") on node \"ip-10-0-141-124.ec2.internal\" DevicePath \"\"" Sep 07 13:42:11.526714 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:11.526673 2575 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dceb3d71-9ec0-43f5-92a5-2923f47a0d9c-metrics-client-ca\") on node \"ip-10-0-141-124.ec2.internal\" DevicePath \"\"" Sep 07 13:42:11.526714 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:11.526681 2575 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dceb3d71-9ec0-43f5-92a5-2923f47a0d9c-tls-assets\") on node \"ip-10-0-141-124.ec2.internal\" DevicePath \"\"" Sep 07 13:42:11.526714 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:11.526690 2575 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/dceb3d71-9ec0-43f5-92a5-2923f47a0d9c-config-volume\") on node \"ip-10-0-141-124.ec2.internal\" DevicePath \"\"" Sep 07 13:42:11.526714 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:11.526697 2575 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dceb3d71-9ec0-43f5-92a5-2923f47a0d9c-config-out\") on node \"ip-10-0-141-124.ec2.internal\" DevicePath \"\"" Sep 07 13:42:11.526714 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:11.526705 2575 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/dceb3d71-9ec0-43f5-92a5-2923f47a0d9c-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-141-124.ec2.internal\" DevicePath \"\"" Sep 07 13:42:11.526714 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:11.526714 2575 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dceb3d71-9ec0-43f5-92a5-2923f47a0d9c-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-141-124.ec2.internal\" DevicePath \"\"" Sep 07 13:42:11.526714 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:11.526722 2575 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dceb3d71-9ec0-43f5-92a5-2923f47a0d9c-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-141-124.ec2.internal\" DevicePath \"\"" Sep 07 13:42:11.527101 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:11.526731 2575 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/dceb3d71-9ec0-43f5-92a5-2923f47a0d9c-cluster-tls-config\") on node \"ip-10-0-141-124.ec2.internal\" DevicePath \"\"" Sep 07 13:42:11.527101 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:11.526741 2575 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dceb3d71-9ec0-43f5-92a5-2923f47a0d9c-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-141-124.ec2.internal\" DevicePath \"\"" Sep 07 13:42:11.527101 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:11.526750 2575 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/dceb3d71-9ec0-43f5-92a5-2923f47a0d9c-secret-alertmanager-main-tls\") on node \"ip-10-0-141-124.ec2.internal\" DevicePath \"\"" Sep 07 13:42:11.527101 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:11.526758 2575 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/dceb3d71-9ec0-43f5-92a5-2923f47a0d9c-alertmanager-main-db\") on node \"ip-10-0-141-124.ec2.internal\" DevicePath \"\"" Sep 07 13:42:11.942922 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:11.942891 2575 generic.go:356] "Generic (PLEG): container finished" podID="dceb3d71-9ec0-43f5-92a5-2923f47a0d9c" containerID="53c22286dfe3a7c136c2e633dc8f2eb21f7294ff8379e7d66d87519c39f24034" exitCode=0 Sep 07 13:42:11.943113 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:11.942936 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dceb3d71-9ec0-43f5-92a5-2923f47a0d9c","Type":"ContainerDied","Data":"53c22286dfe3a7c136c2e633dc8f2eb21f7294ff8379e7d66d87519c39f24034"} Sep 07 13:42:11.943113 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:11.942974 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 07 13:42:11.943113 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:11.942992 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dceb3d71-9ec0-43f5-92a5-2923f47a0d9c","Type":"ContainerDied","Data":"54d8316e00abcf6735c385f778bcf7bd2696d3c5e01057268e6b9f03f2763a81"} Sep 07 13:42:11.943113 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:11.943026 2575 scope.go:117] "RemoveContainer" containerID="9376d1ff33fbba051e131b06968956af7021fa02bf3277f43577c4e073a1118c" Sep 07 13:42:11.950957 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:11.950936 2575 scope.go:117] "RemoveContainer" containerID="237b36376b5a22c9038b44faf065f24ccf06eebca8ae20e6d48d452b7db97cfb" Sep 07 13:42:11.958311 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:11.958292 2575 scope.go:117] "RemoveContainer" containerID="0085272a293b0f9e867e1ea3d196adb8c1a9891a4256b6ed4179f29624d1cee2" Sep 07 13:42:11.968126 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:11.968102 2575 scope.go:117] "RemoveContainer" containerID="53c22286dfe3a7c136c2e633dc8f2eb21f7294ff8379e7d66d87519c39f24034" Sep 07 13:42:11.970162 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:11.970142 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 07 13:42:11.976235 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:11.976203 2575 scope.go:117] "RemoveContainer" containerID="99785e0f89e9b1f483620a0f8f50e7f7e5f637893ca29f87be70310c6ccf4b30" Sep 07 13:42:11.978139 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:11.978122 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 07 13:42:11.983858 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:11.983836 2575 scope.go:117] "RemoveContainer" containerID="66d92b2887a88bf98317bc2bc8ce606d581fcacfc0253564f4cb067fc96a78f2" Sep 07 13:42:11.991108 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:11.991092 2575 scope.go:117] "RemoveContainer" containerID="06bf5f3e25c4b9ba4a28d5450bff46c0f23b58dfc720de707128f93091ae5716" Sep 07 13:42:11.998914 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:11.998891 2575 scope.go:117] "RemoveContainer" containerID="9376d1ff33fbba051e131b06968956af7021fa02bf3277f43577c4e073a1118c" Sep 07 13:42:11.999183 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:42:11.999165 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9376d1ff33fbba051e131b06968956af7021fa02bf3277f43577c4e073a1118c\": container with ID starting with 9376d1ff33fbba051e131b06968956af7021fa02bf3277f43577c4e073a1118c not found: ID does not exist" containerID="9376d1ff33fbba051e131b06968956af7021fa02bf3277f43577c4e073a1118c" Sep 07 13:42:11.999259 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:11.999191 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9376d1ff33fbba051e131b06968956af7021fa02bf3277f43577c4e073a1118c"} err="failed to get container status \"9376d1ff33fbba051e131b06968956af7021fa02bf3277f43577c4e073a1118c\": rpc error: code = NotFound desc = could not find container \"9376d1ff33fbba051e131b06968956af7021fa02bf3277f43577c4e073a1118c\": container with ID starting with 9376d1ff33fbba051e131b06968956af7021fa02bf3277f43577c4e073a1118c not found: ID does not exist" Sep 07 13:42:11.999259 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:11.999209 2575 scope.go:117] "RemoveContainer" containerID="237b36376b5a22c9038b44faf065f24ccf06eebca8ae20e6d48d452b7db97cfb" Sep 07 13:42:11.999475 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:42:11.999455 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"237b36376b5a22c9038b44faf065f24ccf06eebca8ae20e6d48d452b7db97cfb\": container with ID starting with 237b36376b5a22c9038b44faf065f24ccf06eebca8ae20e6d48d452b7db97cfb not found: ID does not exist" containerID="237b36376b5a22c9038b44faf065f24ccf06eebca8ae20e6d48d452b7db97cfb" Sep 07 13:42:11.999518 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:11.999485 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"237b36376b5a22c9038b44faf065f24ccf06eebca8ae20e6d48d452b7db97cfb"} err="failed to get container status \"237b36376b5a22c9038b44faf065f24ccf06eebca8ae20e6d48d452b7db97cfb\": rpc error: code = NotFound desc = could not find container \"237b36376b5a22c9038b44faf065f24ccf06eebca8ae20e6d48d452b7db97cfb\": container with ID starting with 237b36376b5a22c9038b44faf065f24ccf06eebca8ae20e6d48d452b7db97cfb not found: ID does not exist" Sep 07 13:42:11.999518 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:11.999501 2575 scope.go:117] "RemoveContainer" containerID="0085272a293b0f9e867e1ea3d196adb8c1a9891a4256b6ed4179f29624d1cee2" Sep 07 13:42:11.999796 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:42:11.999762 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0085272a293b0f9e867e1ea3d196adb8c1a9891a4256b6ed4179f29624d1cee2\": container with ID starting with 0085272a293b0f9e867e1ea3d196adb8c1a9891a4256b6ed4179f29624d1cee2 not found: ID does not exist" containerID="0085272a293b0f9e867e1ea3d196adb8c1a9891a4256b6ed4179f29624d1cee2" Sep 07 13:42:11.999872 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:11.999813 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0085272a293b0f9e867e1ea3d196adb8c1a9891a4256b6ed4179f29624d1cee2"} err="failed to get container status \"0085272a293b0f9e867e1ea3d196adb8c1a9891a4256b6ed4179f29624d1cee2\": rpc error: code = NotFound desc = could not find container \"0085272a293b0f9e867e1ea3d196adb8c1a9891a4256b6ed4179f29624d1cee2\": container with ID starting with 0085272a293b0f9e867e1ea3d196adb8c1a9891a4256b6ed4179f29624d1cee2 not found: ID does not exist" Sep 07 13:42:11.999872 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:11.999837 2575 scope.go:117] "RemoveContainer" containerID="53c22286dfe3a7c136c2e633dc8f2eb21f7294ff8379e7d66d87519c39f24034" Sep 07 13:42:12.000113 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:42:12.000096 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"53c22286dfe3a7c136c2e633dc8f2eb21f7294ff8379e7d66d87519c39f24034\": container with ID starting with 53c22286dfe3a7c136c2e633dc8f2eb21f7294ff8379e7d66d87519c39f24034 not found: ID does not exist" containerID="53c22286dfe3a7c136c2e633dc8f2eb21f7294ff8379e7d66d87519c39f24034" Sep 07 13:42:12.000159 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:12.000118 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"53c22286dfe3a7c136c2e633dc8f2eb21f7294ff8379e7d66d87519c39f24034"} err="failed to get container status \"53c22286dfe3a7c136c2e633dc8f2eb21f7294ff8379e7d66d87519c39f24034\": rpc error: code = NotFound desc = could not find container \"53c22286dfe3a7c136c2e633dc8f2eb21f7294ff8379e7d66d87519c39f24034\": container with ID starting with 53c22286dfe3a7c136c2e633dc8f2eb21f7294ff8379e7d66d87519c39f24034 not found: ID does not exist" Sep 07 13:42:12.000159 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:12.000131 2575 scope.go:117] "RemoveContainer" containerID="99785e0f89e9b1f483620a0f8f50e7f7e5f637893ca29f87be70310c6ccf4b30" Sep 07 13:42:12.000367 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:42:12.000350 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"99785e0f89e9b1f483620a0f8f50e7f7e5f637893ca29f87be70310c6ccf4b30\": container with ID starting with 99785e0f89e9b1f483620a0f8f50e7f7e5f637893ca29f87be70310c6ccf4b30 not found: ID does not exist" containerID="99785e0f89e9b1f483620a0f8f50e7f7e5f637893ca29f87be70310c6ccf4b30" Sep 07 13:42:12.000411 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:12.000372 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"99785e0f89e9b1f483620a0f8f50e7f7e5f637893ca29f87be70310c6ccf4b30"} err="failed to get container status \"99785e0f89e9b1f483620a0f8f50e7f7e5f637893ca29f87be70310c6ccf4b30\": rpc error: code = NotFound desc = could not find container \"99785e0f89e9b1f483620a0f8f50e7f7e5f637893ca29f87be70310c6ccf4b30\": container with ID starting with 99785e0f89e9b1f483620a0f8f50e7f7e5f637893ca29f87be70310c6ccf4b30 not found: ID does not exist" Sep 07 13:42:12.000411 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:12.000388 2575 scope.go:117] "RemoveContainer" containerID="66d92b2887a88bf98317bc2bc8ce606d581fcacfc0253564f4cb067fc96a78f2" Sep 07 13:42:12.000614 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:42:12.000599 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"66d92b2887a88bf98317bc2bc8ce606d581fcacfc0253564f4cb067fc96a78f2\": container with ID starting with 66d92b2887a88bf98317bc2bc8ce606d581fcacfc0253564f4cb067fc96a78f2 not found: ID does not exist" containerID="66d92b2887a88bf98317bc2bc8ce606d581fcacfc0253564f4cb067fc96a78f2" Sep 07 13:42:12.000674 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:12.000621 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66d92b2887a88bf98317bc2bc8ce606d581fcacfc0253564f4cb067fc96a78f2"} err="failed to get container status \"66d92b2887a88bf98317bc2bc8ce606d581fcacfc0253564f4cb067fc96a78f2\": rpc error: code = NotFound desc = could not find container \"66d92b2887a88bf98317bc2bc8ce606d581fcacfc0253564f4cb067fc96a78f2\": container with ID starting with 66d92b2887a88bf98317bc2bc8ce606d581fcacfc0253564f4cb067fc96a78f2 not found: ID does not exist" Sep 07 13:42:12.000674 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:12.000646 2575 scope.go:117] "RemoveContainer" containerID="06bf5f3e25c4b9ba4a28d5450bff46c0f23b58dfc720de707128f93091ae5716" Sep 07 13:42:12.000898 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:42:12.000882 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"06bf5f3e25c4b9ba4a28d5450bff46c0f23b58dfc720de707128f93091ae5716\": container with ID starting with 06bf5f3e25c4b9ba4a28d5450bff46c0f23b58dfc720de707128f93091ae5716 not found: ID does not exist" containerID="06bf5f3e25c4b9ba4a28d5450bff46c0f23b58dfc720de707128f93091ae5716" Sep 07 13:42:12.000946 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:12.000900 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"06bf5f3e25c4b9ba4a28d5450bff46c0f23b58dfc720de707128f93091ae5716"} err="failed to get container status \"06bf5f3e25c4b9ba4a28d5450bff46c0f23b58dfc720de707128f93091ae5716\": rpc error: code = NotFound desc = could not find container \"06bf5f3e25c4b9ba4a28d5450bff46c0f23b58dfc720de707128f93091ae5716\": container with ID starting with 06bf5f3e25c4b9ba4a28d5450bff46c0f23b58dfc720de707128f93091ae5716 not found: ID does not exist" Sep 07 13:42:12.037822 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:12.018686 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 07 13:42:12.037822 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:12.019249 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dceb3d71-9ec0-43f5-92a5-2923f47a0d9c" containerName="kube-rbac-proxy" Sep 07 13:42:12.037822 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:12.019286 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="dceb3d71-9ec0-43f5-92a5-2923f47a0d9c" containerName="kube-rbac-proxy" Sep 07 13:42:12.037822 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:12.019303 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dceb3d71-9ec0-43f5-92a5-2923f47a0d9c" containerName="alertmanager" Sep 07 13:42:12.037822 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:12.019312 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="dceb3d71-9ec0-43f5-92a5-2923f47a0d9c" containerName="alertmanager" Sep 07 13:42:12.037822 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:12.019325 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dceb3d71-9ec0-43f5-92a5-2923f47a0d9c" containerName="config-reloader" Sep 07 13:42:12.037822 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:12.019332 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="dceb3d71-9ec0-43f5-92a5-2923f47a0d9c" containerName="config-reloader" Sep 07 13:42:12.037822 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:12.019361 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb093481-1db5-4cc6-9174-01727a3f4b69" containerName="console" Sep 07 13:42:12.037822 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:12.019370 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb093481-1db5-4cc6-9174-01727a3f4b69" containerName="console" Sep 07 13:42:12.037822 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:12.019385 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dceb3d71-9ec0-43f5-92a5-2923f47a0d9c" containerName="kube-rbac-proxy-web" Sep 07 13:42:12.037822 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:12.019392 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="dceb3d71-9ec0-43f5-92a5-2923f47a0d9c" containerName="kube-rbac-proxy-web" Sep 07 13:42:12.037822 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:12.019402 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dceb3d71-9ec0-43f5-92a5-2923f47a0d9c" containerName="kube-rbac-proxy-metric" Sep 07 13:42:12.037822 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:12.019408 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="dceb3d71-9ec0-43f5-92a5-2923f47a0d9c" containerName="kube-rbac-proxy-metric" Sep 07 13:42:12.037822 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:12.019437 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e7b30596-01a1-4b88-b841-786c2fc17b86" containerName="registry" Sep 07 13:42:12.037822 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:12.019446 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="e7b30596-01a1-4b88-b841-786c2fc17b86" containerName="registry" Sep 07 13:42:12.037822 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:12.019461 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dceb3d71-9ec0-43f5-92a5-2923f47a0d9c" containerName="init-config-reloader" Sep 07 13:42:12.037822 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:12.019468 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="dceb3d71-9ec0-43f5-92a5-2923f47a0d9c" containerName="init-config-reloader" Sep 07 13:42:12.037822 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:12.019479 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dceb3d71-9ec0-43f5-92a5-2923f47a0d9c" containerName="prom-label-proxy" Sep 07 13:42:12.037822 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:12.019487 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="dceb3d71-9ec0-43f5-92a5-2923f47a0d9c" containerName="prom-label-proxy" Sep 07 13:42:12.037822 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:12.019607 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="bb093481-1db5-4cc6-9174-01727a3f4b69" containerName="console" Sep 07 13:42:12.037822 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:12.019618 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="dceb3d71-9ec0-43f5-92a5-2923f47a0d9c" containerName="kube-rbac-proxy-metric" Sep 07 13:42:12.037822 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:12.019628 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="dceb3d71-9ec0-43f5-92a5-2923f47a0d9c" containerName="alertmanager" Sep 07 13:42:12.037822 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:12.019636 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="dceb3d71-9ec0-43f5-92a5-2923f47a0d9c" containerName="kube-rbac-proxy" Sep 07 13:42:12.037822 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:12.019645 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="dceb3d71-9ec0-43f5-92a5-2923f47a0d9c" containerName="config-reloader" Sep 07 13:42:12.037822 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:12.019673 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="dceb3d71-9ec0-43f5-92a5-2923f47a0d9c" containerName="prom-label-proxy" Sep 07 13:42:12.037822 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:12.019682 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="e7b30596-01a1-4b88-b841-786c2fc17b86" containerName="registry" Sep 07 13:42:12.037822 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:12.019690 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="dceb3d71-9ec0-43f5-92a5-2923f47a0d9c" containerName="kube-rbac-proxy-web" Sep 07 13:42:12.037822 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:12.024535 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 07 13:42:12.037822 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:12.027973 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Sep 07 13:42:12.037822 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:12.030104 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Sep 07 13:42:12.037822 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:12.030181 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/24c41766-c5f5-41cb-98fc-93a68fb45ff6-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"24c41766-c5f5-41cb-98fc-93a68fb45ff6\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 13:42:12.037822 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:12.030239 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/24c41766-c5f5-41cb-98fc-93a68fb45ff6-tls-assets\") pod \"alertmanager-main-0\" (UID: \"24c41766-c5f5-41cb-98fc-93a68fb45ff6\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 13:42:12.037822 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:12.030291 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24c41766-c5f5-41cb-98fc-93a68fb45ff6-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"24c41766-c5f5-41cb-98fc-93a68fb45ff6\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 13:42:12.039342 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:12.030348 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/24c41766-c5f5-41cb-98fc-93a68fb45ff6-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"24c41766-c5f5-41cb-98fc-93a68fb45ff6\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 13:42:12.039342 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:12.030391 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/24c41766-c5f5-41cb-98fc-93a68fb45ff6-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"24c41766-c5f5-41cb-98fc-93a68fb45ff6\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 13:42:12.039342 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:12.030430 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/24c41766-c5f5-41cb-98fc-93a68fb45ff6-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"24c41766-c5f5-41cb-98fc-93a68fb45ff6\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 13:42:12.039342 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:12.030465 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/24c41766-c5f5-41cb-98fc-93a68fb45ff6-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"24c41766-c5f5-41cb-98fc-93a68fb45ff6\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 13:42:12.039342 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:12.030483 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-whpmz\"" Sep 07 13:42:12.039342 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:12.030503 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/24c41766-c5f5-41cb-98fc-93a68fb45ff6-config-volume\") pod \"alertmanager-main-0\" (UID: \"24c41766-c5f5-41cb-98fc-93a68fb45ff6\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 13:42:12.039342 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:12.030531 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/24c41766-c5f5-41cb-98fc-93a68fb45ff6-web-config\") pod \"alertmanager-main-0\" (UID: \"24c41766-c5f5-41cb-98fc-93a68fb45ff6\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 13:42:12.039342 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:12.030560 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jcvcg\" (UniqueName: \"kubernetes.io/projected/24c41766-c5f5-41cb-98fc-93a68fb45ff6-kube-api-access-jcvcg\") pod \"alertmanager-main-0\" (UID: \"24c41766-c5f5-41cb-98fc-93a68fb45ff6\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 13:42:12.039342 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:12.030588 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/24c41766-c5f5-41cb-98fc-93a68fb45ff6-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"24c41766-c5f5-41cb-98fc-93a68fb45ff6\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 13:42:12.039342 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:12.030635 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/24c41766-c5f5-41cb-98fc-93a68fb45ff6-config-out\") pod \"alertmanager-main-0\" (UID: \"24c41766-c5f5-41cb-98fc-93a68fb45ff6\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 13:42:12.039342 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:12.030661 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/24c41766-c5f5-41cb-98fc-93a68fb45ff6-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"24c41766-c5f5-41cb-98fc-93a68fb45ff6\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 13:42:12.039342 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:12.030807 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Sep 07 13:42:12.039342 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:12.030951 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Sep 07 13:42:12.039342 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:12.031042 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Sep 07 13:42:12.039342 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:12.030351 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Sep 07 13:42:12.039342 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:12.034967 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Sep 07 13:42:12.039342 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:12.035312 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Sep 07 13:42:12.040037 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:12.039684 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Sep 07 13:42:12.047528 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:12.047498 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 07 13:42:12.136776 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:12.132368 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/24c41766-c5f5-41cb-98fc-93a68fb45ff6-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"24c41766-c5f5-41cb-98fc-93a68fb45ff6\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 13:42:12.136776 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:12.132431 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/24c41766-c5f5-41cb-98fc-93a68fb45ff6-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"24c41766-c5f5-41cb-98fc-93a68fb45ff6\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 13:42:12.136776 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:12.132472 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/24c41766-c5f5-41cb-98fc-93a68fb45ff6-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"24c41766-c5f5-41cb-98fc-93a68fb45ff6\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 13:42:12.136776 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:12.132515 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/24c41766-c5f5-41cb-98fc-93a68fb45ff6-config-volume\") pod \"alertmanager-main-0\" (UID: \"24c41766-c5f5-41cb-98fc-93a68fb45ff6\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 13:42:12.136776 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:12.132549 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/24c41766-c5f5-41cb-98fc-93a68fb45ff6-web-config\") pod \"alertmanager-main-0\" (UID: \"24c41766-c5f5-41cb-98fc-93a68fb45ff6\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 13:42:12.136776 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:12.132577 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jcvcg\" (UniqueName: \"kubernetes.io/projected/24c41766-c5f5-41cb-98fc-93a68fb45ff6-kube-api-access-jcvcg\") pod \"alertmanager-main-0\" (UID: \"24c41766-c5f5-41cb-98fc-93a68fb45ff6\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 13:42:12.136776 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:12.132611 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/24c41766-c5f5-41cb-98fc-93a68fb45ff6-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"24c41766-c5f5-41cb-98fc-93a68fb45ff6\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 13:42:12.136776 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:12.132658 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/24c41766-c5f5-41cb-98fc-93a68fb45ff6-config-out\") pod \"alertmanager-main-0\" (UID: \"24c41766-c5f5-41cb-98fc-93a68fb45ff6\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 13:42:12.136776 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:12.132687 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/24c41766-c5f5-41cb-98fc-93a68fb45ff6-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"24c41766-c5f5-41cb-98fc-93a68fb45ff6\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 13:42:12.136776 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:12.132728 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/24c41766-c5f5-41cb-98fc-93a68fb45ff6-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"24c41766-c5f5-41cb-98fc-93a68fb45ff6\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 13:42:12.136776 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:12.132761 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/24c41766-c5f5-41cb-98fc-93a68fb45ff6-tls-assets\") pod \"alertmanager-main-0\" (UID: \"24c41766-c5f5-41cb-98fc-93a68fb45ff6\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 13:42:12.136776 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:12.132822 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24c41766-c5f5-41cb-98fc-93a68fb45ff6-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"24c41766-c5f5-41cb-98fc-93a68fb45ff6\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 13:42:12.136776 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:12.132872 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/24c41766-c5f5-41cb-98fc-93a68fb45ff6-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"24c41766-c5f5-41cb-98fc-93a68fb45ff6\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 13:42:12.136776 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:12.136178 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/24c41766-c5f5-41cb-98fc-93a68fb45ff6-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"24c41766-c5f5-41cb-98fc-93a68fb45ff6\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 13:42:12.137798 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:12.137532 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/24c41766-c5f5-41cb-98fc-93a68fb45ff6-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"24c41766-c5f5-41cb-98fc-93a68fb45ff6\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 13:42:12.137798 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:12.137605 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24c41766-c5f5-41cb-98fc-93a68fb45ff6-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"24c41766-c5f5-41cb-98fc-93a68fb45ff6\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 13:42:12.139395 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:12.139091 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/24c41766-c5f5-41cb-98fc-93a68fb45ff6-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"24c41766-c5f5-41cb-98fc-93a68fb45ff6\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 13:42:12.139799 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:12.139762 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/24c41766-c5f5-41cb-98fc-93a68fb45ff6-web-config\") pod \"alertmanager-main-0\" (UID: \"24c41766-c5f5-41cb-98fc-93a68fb45ff6\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 13:42:12.139925 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:12.139900 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/24c41766-c5f5-41cb-98fc-93a68fb45ff6-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"24c41766-c5f5-41cb-98fc-93a68fb45ff6\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 13:42:12.140192 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:12.139929 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/24c41766-c5f5-41cb-98fc-93a68fb45ff6-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"24c41766-c5f5-41cb-98fc-93a68fb45ff6\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 13:42:12.140192 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:12.140145 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/24c41766-c5f5-41cb-98fc-93a68fb45ff6-config-volume\") pod \"alertmanager-main-0\" (UID: \"24c41766-c5f5-41cb-98fc-93a68fb45ff6\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 13:42:12.140316 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:12.140272 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/24c41766-c5f5-41cb-98fc-93a68fb45ff6-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"24c41766-c5f5-41cb-98fc-93a68fb45ff6\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 13:42:12.140808 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:12.140762 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/24c41766-c5f5-41cb-98fc-93a68fb45ff6-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"24c41766-c5f5-41cb-98fc-93a68fb45ff6\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 13:42:12.140903 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:12.140760 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/24c41766-c5f5-41cb-98fc-93a68fb45ff6-config-out\") pod \"alertmanager-main-0\" (UID: \"24c41766-c5f5-41cb-98fc-93a68fb45ff6\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 13:42:12.141584 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:12.141568 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/24c41766-c5f5-41cb-98fc-93a68fb45ff6-tls-assets\") pod \"alertmanager-main-0\" (UID: \"24c41766-c5f5-41cb-98fc-93a68fb45ff6\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 13:42:12.149177 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:12.149155 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jcvcg\" (UniqueName: \"kubernetes.io/projected/24c41766-c5f5-41cb-98fc-93a68fb45ff6-kube-api-access-jcvcg\") pod \"alertmanager-main-0\" (UID: \"24c41766-c5f5-41cb-98fc-93a68fb45ff6\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 13:42:12.338586 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:12.338556 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 07 13:42:12.622611 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:12.622577 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 07 13:42:12.623973 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:42:12.623947 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24c41766_c5f5_41cb_98fc_93a68fb45ff6.slice/crio-c45b849603b7bd33ca09a5f6840c1fd726dd1cfa3ee27cdd554cc684e3696a75 WatchSource:0}: Error finding container c45b849603b7bd33ca09a5f6840c1fd726dd1cfa3ee27cdd554cc684e3696a75: Status 404 returned error can't find the container with id c45b849603b7bd33ca09a5f6840c1fd726dd1cfa3ee27cdd554cc684e3696a75 Sep 07 13:42:12.948684 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:12.948592 2575 generic.go:356] "Generic (PLEG): container finished" podID="24c41766-c5f5-41cb-98fc-93a68fb45ff6" containerID="8c32d87440f650580a98e34d29614b5d7c70f5317611790b61218475ae3ed169" exitCode=0 Sep 07 13:42:12.948876 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:12.948682 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"24c41766-c5f5-41cb-98fc-93a68fb45ff6","Type":"ContainerDied","Data":"8c32d87440f650580a98e34d29614b5d7c70f5317611790b61218475ae3ed169"} Sep 07 13:42:12.948876 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:12.948759 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"24c41766-c5f5-41cb-98fc-93a68fb45ff6","Type":"ContainerStarted","Data":"c45b849603b7bd33ca09a5f6840c1fd726dd1cfa3ee27cdd554cc684e3696a75"} Sep 07 13:42:12.994425 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:12.994392 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dceb3d71-9ec0-43f5-92a5-2923f47a0d9c" path="/var/lib/kubelet/pods/dceb3d71-9ec0-43f5-92a5-2923f47a0d9c/volumes" Sep 07 13:42:13.957134 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:13.957102 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"24c41766-c5f5-41cb-98fc-93a68fb45ff6","Type":"ContainerStarted","Data":"791c3782469201c1f27302eb9857ddbe315d676129c805cf4dc8802683eed871"} Sep 07 13:42:13.957487 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:13.957166 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"24c41766-c5f5-41cb-98fc-93a68fb45ff6","Type":"ContainerStarted","Data":"0d63ecc10cdf1e4d5ab3b86b9bd3368b47f09142f6ed619bf5097e1e27c0976c"} Sep 07 13:42:13.957487 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:13.957191 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"24c41766-c5f5-41cb-98fc-93a68fb45ff6","Type":"ContainerStarted","Data":"32e06e68f9eab39076abdf1baa705c293d961b2bdb98d5f26e17d92f3b4992b3"} Sep 07 13:42:13.957487 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:13.957217 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"24c41766-c5f5-41cb-98fc-93a68fb45ff6","Type":"ContainerStarted","Data":"696d3c7a38825de515b7e9afa81a002903dd32d73e9fa3e5d2d01f5e56f23233"} Sep 07 13:42:13.957487 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:13.957240 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"24c41766-c5f5-41cb-98fc-93a68fb45ff6","Type":"ContainerStarted","Data":"d65ee03599c0258ee68e25406da67be180197b92a4a925bf6ecbf642cda81ed9"} Sep 07 13:42:13.957487 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:13.957261 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"24c41766-c5f5-41cb-98fc-93a68fb45ff6","Type":"ContainerStarted","Data":"171d3f776e4903bca4825bbed01273d9af25c20d7ff4c0e4526e9eb08bf3b6dd"} Sep 07 13:42:13.995574 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:13.995500 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.976228206 podStartE2EDuration="2.995484355s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.256149ms" isStatefulPod=false podCreationTimestamp="2026-09-07 13:42:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:42:13.994709199 +0000 UTC m=+205.488838528" watchObservedRunningTime="2026-09-07 13:42:13.995484355 +0000 UTC m=+205.489613685" Sep 07 13:42:14.173020 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:14.172987 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-85d5586674-v5tjn"] Sep 07 13:42:14.175498 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:14.175481 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-85d5586674-v5tjn" Sep 07 13:42:14.178668 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:14.178645 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Sep 07 13:42:14.178807 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:14.178703 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Sep 07 13:42:14.178807 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:14.178776 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Sep 07 13:42:14.178932 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:14.178867 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Sep 07 13:42:14.178932 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:14.178912 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Sep 07 13:42:14.179020 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:14.178920 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-vv4rn\"" Sep 07 13:42:14.184953 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:14.184934 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Sep 07 13:42:14.192705 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:14.192672 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-85d5586674-v5tjn"] Sep 07 13:42:14.249887 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:14.249800 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/49aaa3ec-25c9-4ccb-ae61-844d3578402e-secret-telemeter-client\") pod \"telemeter-client-85d5586674-v5tjn\" (UID: \"49aaa3ec-25c9-4ccb-ae61-844d3578402e\") " pod="openshift-monitoring/telemeter-client-85d5586674-v5tjn" Sep 07 13:42:14.249887 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:14.249836 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9zstz\" (UniqueName: \"kubernetes.io/projected/49aaa3ec-25c9-4ccb-ae61-844d3578402e-kube-api-access-9zstz\") pod \"telemeter-client-85d5586674-v5tjn\" (UID: \"49aaa3ec-25c9-4ccb-ae61-844d3578402e\") " pod="openshift-monitoring/telemeter-client-85d5586674-v5tjn" Sep 07 13:42:14.249887 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:14.249860 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/49aaa3ec-25c9-4ccb-ae61-844d3578402e-metrics-client-ca\") pod \"telemeter-client-85d5586674-v5tjn\" (UID: \"49aaa3ec-25c9-4ccb-ae61-844d3578402e\") " pod="openshift-monitoring/telemeter-client-85d5586674-v5tjn" Sep 07 13:42:14.249887 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:14.249878 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/49aaa3ec-25c9-4ccb-ae61-844d3578402e-federate-client-tls\") pod \"telemeter-client-85d5586674-v5tjn\" (UID: \"49aaa3ec-25c9-4ccb-ae61-844d3578402e\") " pod="openshift-monitoring/telemeter-client-85d5586674-v5tjn" Sep 07 13:42:14.250140 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:14.249904 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/49aaa3ec-25c9-4ccb-ae61-844d3578402e-telemeter-client-tls\") pod \"telemeter-client-85d5586674-v5tjn\" (UID: \"49aaa3ec-25c9-4ccb-ae61-844d3578402e\") " pod="openshift-monitoring/telemeter-client-85d5586674-v5tjn" Sep 07 13:42:14.250140 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:14.250001 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/49aaa3ec-25c9-4ccb-ae61-844d3578402e-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-85d5586674-v5tjn\" (UID: \"49aaa3ec-25c9-4ccb-ae61-844d3578402e\") " pod="openshift-monitoring/telemeter-client-85d5586674-v5tjn" Sep 07 13:42:14.250140 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:14.250031 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/49aaa3ec-25c9-4ccb-ae61-844d3578402e-serving-certs-ca-bundle\") pod \"telemeter-client-85d5586674-v5tjn\" (UID: \"49aaa3ec-25c9-4ccb-ae61-844d3578402e\") " pod="openshift-monitoring/telemeter-client-85d5586674-v5tjn" Sep 07 13:42:14.250140 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:14.250055 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/49aaa3ec-25c9-4ccb-ae61-844d3578402e-telemeter-trusted-ca-bundle\") pod \"telemeter-client-85d5586674-v5tjn\" (UID: \"49aaa3ec-25c9-4ccb-ae61-844d3578402e\") " pod="openshift-monitoring/telemeter-client-85d5586674-v5tjn" Sep 07 13:42:14.350461 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:14.350424 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/49aaa3ec-25c9-4ccb-ae61-844d3578402e-telemeter-client-tls\") pod \"telemeter-client-85d5586674-v5tjn\" (UID: \"49aaa3ec-25c9-4ccb-ae61-844d3578402e\") " pod="openshift-monitoring/telemeter-client-85d5586674-v5tjn" Sep 07 13:42:14.350639 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:14.350485 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/49aaa3ec-25c9-4ccb-ae61-844d3578402e-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-85d5586674-v5tjn\" (UID: \"49aaa3ec-25c9-4ccb-ae61-844d3578402e\") " pod="openshift-monitoring/telemeter-client-85d5586674-v5tjn" Sep 07 13:42:14.350639 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:14.350520 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/49aaa3ec-25c9-4ccb-ae61-844d3578402e-serving-certs-ca-bundle\") pod \"telemeter-client-85d5586674-v5tjn\" (UID: \"49aaa3ec-25c9-4ccb-ae61-844d3578402e\") " pod="openshift-monitoring/telemeter-client-85d5586674-v5tjn" Sep 07 13:42:14.350639 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:14.350556 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/49aaa3ec-25c9-4ccb-ae61-844d3578402e-telemeter-trusted-ca-bundle\") pod \"telemeter-client-85d5586674-v5tjn\" (UID: \"49aaa3ec-25c9-4ccb-ae61-844d3578402e\") " pod="openshift-monitoring/telemeter-client-85d5586674-v5tjn" Sep 07 13:42:14.350639 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:14.350608 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/49aaa3ec-25c9-4ccb-ae61-844d3578402e-secret-telemeter-client\") pod \"telemeter-client-85d5586674-v5tjn\" (UID: \"49aaa3ec-25c9-4ccb-ae61-844d3578402e\") " pod="openshift-monitoring/telemeter-client-85d5586674-v5tjn" Sep 07 13:42:14.350867 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:14.350643 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9zstz\" (UniqueName: \"kubernetes.io/projected/49aaa3ec-25c9-4ccb-ae61-844d3578402e-kube-api-access-9zstz\") pod \"telemeter-client-85d5586674-v5tjn\" (UID: \"49aaa3ec-25c9-4ccb-ae61-844d3578402e\") " pod="openshift-monitoring/telemeter-client-85d5586674-v5tjn" Sep 07 13:42:14.350867 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:14.350666 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/49aaa3ec-25c9-4ccb-ae61-844d3578402e-metrics-client-ca\") pod \"telemeter-client-85d5586674-v5tjn\" (UID: \"49aaa3ec-25c9-4ccb-ae61-844d3578402e\") " pod="openshift-monitoring/telemeter-client-85d5586674-v5tjn" Sep 07 13:42:14.350867 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:14.350690 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/49aaa3ec-25c9-4ccb-ae61-844d3578402e-federate-client-tls\") pod \"telemeter-client-85d5586674-v5tjn\" (UID: \"49aaa3ec-25c9-4ccb-ae61-844d3578402e\") " pod="openshift-monitoring/telemeter-client-85d5586674-v5tjn" Sep 07 13:42:14.351640 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:14.351609 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/49aaa3ec-25c9-4ccb-ae61-844d3578402e-serving-certs-ca-bundle\") pod \"telemeter-client-85d5586674-v5tjn\" (UID: \"49aaa3ec-25c9-4ccb-ae61-844d3578402e\") " pod="openshift-monitoring/telemeter-client-85d5586674-v5tjn" Sep 07 13:42:14.352218 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:14.352188 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/49aaa3ec-25c9-4ccb-ae61-844d3578402e-metrics-client-ca\") pod \"telemeter-client-85d5586674-v5tjn\" (UID: \"49aaa3ec-25c9-4ccb-ae61-844d3578402e\") " pod="openshift-monitoring/telemeter-client-85d5586674-v5tjn" Sep 07 13:42:14.352353 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:14.352227 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/49aaa3ec-25c9-4ccb-ae61-844d3578402e-telemeter-trusted-ca-bundle\") pod \"telemeter-client-85d5586674-v5tjn\" (UID: \"49aaa3ec-25c9-4ccb-ae61-844d3578402e\") " pod="openshift-monitoring/telemeter-client-85d5586674-v5tjn" Sep 07 13:42:14.353352 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:14.353319 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/49aaa3ec-25c9-4ccb-ae61-844d3578402e-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-85d5586674-v5tjn\" (UID: \"49aaa3ec-25c9-4ccb-ae61-844d3578402e\") " pod="openshift-monitoring/telemeter-client-85d5586674-v5tjn" Sep 07 13:42:14.353554 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:14.353534 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/49aaa3ec-25c9-4ccb-ae61-844d3578402e-federate-client-tls\") pod \"telemeter-client-85d5586674-v5tjn\" (UID: \"49aaa3ec-25c9-4ccb-ae61-844d3578402e\") " pod="openshift-monitoring/telemeter-client-85d5586674-v5tjn" Sep 07 13:42:14.353613 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:14.353567 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/49aaa3ec-25c9-4ccb-ae61-844d3578402e-telemeter-client-tls\") pod \"telemeter-client-85d5586674-v5tjn\" (UID: \"49aaa3ec-25c9-4ccb-ae61-844d3578402e\") " pod="openshift-monitoring/telemeter-client-85d5586674-v5tjn" Sep 07 13:42:14.353613 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:14.353539 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/49aaa3ec-25c9-4ccb-ae61-844d3578402e-secret-telemeter-client\") pod \"telemeter-client-85d5586674-v5tjn\" (UID: \"49aaa3ec-25c9-4ccb-ae61-844d3578402e\") " pod="openshift-monitoring/telemeter-client-85d5586674-v5tjn" Sep 07 13:42:14.363752 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:14.360469 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9zstz\" (UniqueName: \"kubernetes.io/projected/49aaa3ec-25c9-4ccb-ae61-844d3578402e-kube-api-access-9zstz\") pod \"telemeter-client-85d5586674-v5tjn\" (UID: \"49aaa3ec-25c9-4ccb-ae61-844d3578402e\") " pod="openshift-monitoring/telemeter-client-85d5586674-v5tjn" Sep 07 13:42:14.477326 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:14.477296 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 07 13:42:14.477669 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:14.477615 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="63d742cf-3e5e-4327-8271-c2575d83c18a" containerName="prometheus" containerID="cri-o://940c73c3620343ada5f39c497a6a202b563ce43db00425a8dda228d291dcbc30" gracePeriod=600 Sep 07 13:42:14.477843 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:14.477670 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="63d742cf-3e5e-4327-8271-c2575d83c18a" containerName="thanos-sidecar" containerID="cri-o://6b5871e896687b34f7a7791f017f80c145ded1d3ec003da64e94933de77ee540" gracePeriod=600 Sep 07 13:42:14.477843 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:14.477683 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="63d742cf-3e5e-4327-8271-c2575d83c18a" containerName="kube-rbac-proxy-web" containerID="cri-o://16ac67901f2ba489cc7923209ea1b8d74c5d9d0504c09f4525f830fb7b3aaf06" gracePeriod=600 Sep 07 13:42:14.477843 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:14.477678 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="63d742cf-3e5e-4327-8271-c2575d83c18a" containerName="config-reloader" containerID="cri-o://8ff6c2469badce73517ac8062daf82fc4cd3ee07a7568721c33d7ee9ccb822cf" gracePeriod=600 Sep 07 13:42:14.477843 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:14.477817 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="63d742cf-3e5e-4327-8271-c2575d83c18a" containerName="kube-rbac-proxy-thanos" containerID="cri-o://87f3755b285647f50d7881f478ce05df5425dc1175b0dd65772a276151f847a6" gracePeriod=600 Sep 07 13:42:14.478697 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:14.478218 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="63d742cf-3e5e-4327-8271-c2575d83c18a" containerName="kube-rbac-proxy" containerID="cri-o://79b85251e58df40637ec32a10358f68dec88486e11a602ae8f3e4cf76939529d" gracePeriod=600 Sep 07 13:42:14.485123 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:14.485100 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-85d5586674-v5tjn" Sep 07 13:42:14.726049 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:14.726023 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:42:14.754073 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:14.754048 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63d742cf-3e5e-4327-8271-c2575d83c18a-configmap-kubelet-serving-ca-bundle\") pod \"63d742cf-3e5e-4327-8271-c2575d83c18a\" (UID: \"63d742cf-3e5e-4327-8271-c2575d83c18a\") " Sep 07 13:42:14.754214 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:14.754082 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/63d742cf-3e5e-4327-8271-c2575d83c18a-secret-metrics-client-certs\") pod \"63d742cf-3e5e-4327-8271-c2575d83c18a\" (UID: \"63d742cf-3e5e-4327-8271-c2575d83c18a\") " Sep 07 13:42:14.754214 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:14.754114 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63d742cf-3e5e-4327-8271-c2575d83c18a-prometheus-trusted-ca-bundle\") pod \"63d742cf-3e5e-4327-8271-c2575d83c18a\" (UID: \"63d742cf-3e5e-4327-8271-c2575d83c18a\") " Sep 07 13:42:14.754323 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:14.754302 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/63d742cf-3e5e-4327-8271-c2575d83c18a-secret-grpc-tls\") pod \"63d742cf-3e5e-4327-8271-c2575d83c18a\" (UID: \"63d742cf-3e5e-4327-8271-c2575d83c18a\") " Sep 07 13:42:14.754381 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:14.754350 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/63d742cf-3e5e-4327-8271-c2575d83c18a-configmap-metrics-client-ca\") pod \"63d742cf-3e5e-4327-8271-c2575d83c18a\" (UID: \"63d742cf-3e5e-4327-8271-c2575d83c18a\") " Sep 07 13:42:14.754431 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:14.754383 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/63d742cf-3e5e-4327-8271-c2575d83c18a-prometheus-k8s-rulefiles-2\") pod \"63d742cf-3e5e-4327-8271-c2575d83c18a\" (UID: \"63d742cf-3e5e-4327-8271-c2575d83c18a\") " Sep 07 13:42:14.754487 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:14.754426 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/63d742cf-3e5e-4327-8271-c2575d83c18a-thanos-prometheus-http-client-file\") pod \"63d742cf-3e5e-4327-8271-c2575d83c18a\" (UID: \"63d742cf-3e5e-4327-8271-c2575d83c18a\") " Sep 07 13:42:14.754487 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:14.754460 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/63d742cf-3e5e-4327-8271-c2575d83c18a-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "63d742cf-3e5e-4327-8271-c2575d83c18a" (UID: "63d742cf-3e5e-4327-8271-c2575d83c18a"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 07 13:42:14.754487 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:14.754474 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/63d742cf-3e5e-4327-8271-c2575d83c18a-prometheus-k8s-db\") pod \"63d742cf-3e5e-4327-8271-c2575d83c18a\" (UID: \"63d742cf-3e5e-4327-8271-c2575d83c18a\") " Sep 07 13:42:14.754632 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:14.754499 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/63d742cf-3e5e-4327-8271-c2575d83c18a-secret-kube-rbac-proxy\") pod \"63d742cf-3e5e-4327-8271-c2575d83c18a\" (UID: \"63d742cf-3e5e-4327-8271-c2575d83c18a\") " Sep 07 13:42:14.754632 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:14.754528 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/63d742cf-3e5e-4327-8271-c2575d83c18a-secret-prometheus-k8s-tls\") pod \"63d742cf-3e5e-4327-8271-c2575d83c18a\" (UID: \"63d742cf-3e5e-4327-8271-c2575d83c18a\") " Sep 07 13:42:14.754632 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:14.754566 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/63d742cf-3e5e-4327-8271-c2575d83c18a-tls-assets\") pod \"63d742cf-3e5e-4327-8271-c2575d83c18a\" (UID: \"63d742cf-3e5e-4327-8271-c2575d83c18a\") " Sep 07 13:42:14.754632 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:14.754596 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/63d742cf-3e5e-4327-8271-c2575d83c18a-prometheus-k8s-rulefiles-0\") pod \"63d742cf-3e5e-4327-8271-c2575d83c18a\" (UID: \"63d742cf-3e5e-4327-8271-c2575d83c18a\") " Sep 07 13:42:14.754632 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:14.754621 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/63d742cf-3e5e-4327-8271-c2575d83c18a-config\") pod \"63d742cf-3e5e-4327-8271-c2575d83c18a\" (UID: \"63d742cf-3e5e-4327-8271-c2575d83c18a\") " Sep 07 13:42:14.754924 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:14.754650 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/63d742cf-3e5e-4327-8271-c2575d83c18a-web-config\") pod \"63d742cf-3e5e-4327-8271-c2575d83c18a\" (UID: \"63d742cf-3e5e-4327-8271-c2575d83c18a\") " Sep 07 13:42:14.754924 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:14.754676 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/63d742cf-3e5e-4327-8271-c2575d83c18a-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "63d742cf-3e5e-4327-8271-c2575d83c18a" (UID: "63d742cf-3e5e-4327-8271-c2575d83c18a"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 07 13:42:14.754924 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:14.754694 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63d742cf-3e5e-4327-8271-c2575d83c18a-configmap-serving-certs-ca-bundle\") pod \"63d742cf-3e5e-4327-8271-c2575d83c18a\" (UID: \"63d742cf-3e5e-4327-8271-c2575d83c18a\") " Sep 07 13:42:14.754924 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:14.754722 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/63d742cf-3e5e-4327-8271-c2575d83c18a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"63d742cf-3e5e-4327-8271-c2575d83c18a\" (UID: \"63d742cf-3e5e-4327-8271-c2575d83c18a\") " Sep 07 13:42:14.754924 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:14.754760 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/63d742cf-3e5e-4327-8271-c2575d83c18a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"63d742cf-3e5e-4327-8271-c2575d83c18a\" (UID: \"63d742cf-3e5e-4327-8271-c2575d83c18a\") " Sep 07 13:42:14.754924 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:14.754758 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/63d742cf-3e5e-4327-8271-c2575d83c18a-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "63d742cf-3e5e-4327-8271-c2575d83c18a" (UID: "63d742cf-3e5e-4327-8271-c2575d83c18a"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 07 13:42:14.754924 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:14.754814 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/63d742cf-3e5e-4327-8271-c2575d83c18a-config-out\") pod \"63d742cf-3e5e-4327-8271-c2575d83c18a\" (UID: \"63d742cf-3e5e-4327-8271-c2575d83c18a\") " Sep 07 13:42:14.754924 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:14.754857 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/63d742cf-3e5e-4327-8271-c2575d83c18a-prometheus-k8s-rulefiles-1\") pod \"63d742cf-3e5e-4327-8271-c2575d83c18a\" (UID: \"63d742cf-3e5e-4327-8271-c2575d83c18a\") " Sep 07 13:42:14.754924 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:14.754885 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tvw2d\" (UniqueName: \"kubernetes.io/projected/63d742cf-3e5e-4327-8271-c2575d83c18a-kube-api-access-tvw2d\") pod \"63d742cf-3e5e-4327-8271-c2575d83c18a\" (UID: \"63d742cf-3e5e-4327-8271-c2575d83c18a\") " Sep 07 13:42:14.755316 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:14.755012 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/63d742cf-3e5e-4327-8271-c2575d83c18a-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "63d742cf-3e5e-4327-8271-c2575d83c18a" (UID: "63d742cf-3e5e-4327-8271-c2575d83c18a"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 07 13:42:14.755316 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:14.755191 2575 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63d742cf-3e5e-4327-8271-c2575d83c18a-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-141-124.ec2.internal\" DevicePath \"\"" Sep 07 13:42:14.755316 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:14.755213 2575 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63d742cf-3e5e-4327-8271-c2575d83c18a-prometheus-trusted-ca-bundle\") on node \"ip-10-0-141-124.ec2.internal\" DevicePath \"\"" Sep 07 13:42:14.755316 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:14.755229 2575 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/63d742cf-3e5e-4327-8271-c2575d83c18a-configmap-metrics-client-ca\") on node \"ip-10-0-141-124.ec2.internal\" DevicePath \"\"" Sep 07 13:42:14.755316 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:14.755244 2575 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/63d742cf-3e5e-4327-8271-c2575d83c18a-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-141-124.ec2.internal\" DevicePath \"\"" Sep 07 13:42:14.756398 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:14.755617 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/63d742cf-3e5e-4327-8271-c2575d83c18a-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "63d742cf-3e5e-4327-8271-c2575d83c18a" (UID: "63d742cf-3e5e-4327-8271-c2575d83c18a"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 07 13:42:14.757751 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:14.757466 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/63d742cf-3e5e-4327-8271-c2575d83c18a-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "63d742cf-3e5e-4327-8271-c2575d83c18a" (UID: "63d742cf-3e5e-4327-8271-c2575d83c18a"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 07 13:42:14.758321 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:14.758295 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/63d742cf-3e5e-4327-8271-c2575d83c18a-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "63d742cf-3e5e-4327-8271-c2575d83c18a" (UID: "63d742cf-3e5e-4327-8271-c2575d83c18a"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 07 13:42:14.758613 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:14.758576 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/63d742cf-3e5e-4327-8271-c2575d83c18a-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "63d742cf-3e5e-4327-8271-c2575d83c18a" (UID: "63d742cf-3e5e-4327-8271-c2575d83c18a"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 13:42:14.761056 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:14.759120 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63d742cf-3e5e-4327-8271-c2575d83c18a-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "63d742cf-3e5e-4327-8271-c2575d83c18a" (UID: "63d742cf-3e5e-4327-8271-c2575d83c18a"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 07 13:42:14.761056 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:14.760770 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/63d742cf-3e5e-4327-8271-c2575d83c18a-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "63d742cf-3e5e-4327-8271-c2575d83c18a" (UID: "63d742cf-3e5e-4327-8271-c2575d83c18a"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 13:42:14.761056 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:14.760861 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/63d742cf-3e5e-4327-8271-c2575d83c18a-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "63d742cf-3e5e-4327-8271-c2575d83c18a" (UID: "63d742cf-3e5e-4327-8271-c2575d83c18a"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 13:42:14.761056 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:14.760912 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63d742cf-3e5e-4327-8271-c2575d83c18a-config-out" (OuterVolumeSpecName: "config-out") pod "63d742cf-3e5e-4327-8271-c2575d83c18a" (UID: "63d742cf-3e5e-4327-8271-c2575d83c18a"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 07 13:42:14.761056 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:14.760972 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/63d742cf-3e5e-4327-8271-c2575d83c18a-kube-api-access-tvw2d" (OuterVolumeSpecName: "kube-api-access-tvw2d") pod "63d742cf-3e5e-4327-8271-c2575d83c18a" (UID: "63d742cf-3e5e-4327-8271-c2575d83c18a"). InnerVolumeSpecName "kube-api-access-tvw2d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 07 13:42:14.761580 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:14.761491 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/63d742cf-3e5e-4327-8271-c2575d83c18a-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "63d742cf-3e5e-4327-8271-c2575d83c18a" (UID: "63d742cf-3e5e-4327-8271-c2575d83c18a"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 13:42:14.761901 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:14.761873 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/63d742cf-3e5e-4327-8271-c2575d83c18a-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "63d742cf-3e5e-4327-8271-c2575d83c18a" (UID: "63d742cf-3e5e-4327-8271-c2575d83c18a"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 13:42:14.762436 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:14.762396 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/63d742cf-3e5e-4327-8271-c2575d83c18a-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "63d742cf-3e5e-4327-8271-c2575d83c18a" (UID: "63d742cf-3e5e-4327-8271-c2575d83c18a"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 13:42:14.763637 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:14.762699 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/63d742cf-3e5e-4327-8271-c2575d83c18a-config" (OuterVolumeSpecName: "config") pod "63d742cf-3e5e-4327-8271-c2575d83c18a" (UID: "63d742cf-3e5e-4327-8271-c2575d83c18a"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 13:42:14.764293 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:14.764257 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/63d742cf-3e5e-4327-8271-c2575d83c18a-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "63d742cf-3e5e-4327-8271-c2575d83c18a" (UID: "63d742cf-3e5e-4327-8271-c2575d83c18a"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 13:42:14.764750 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:14.764718 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/63d742cf-3e5e-4327-8271-c2575d83c18a-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "63d742cf-3e5e-4327-8271-c2575d83c18a" (UID: "63d742cf-3e5e-4327-8271-c2575d83c18a"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 07 13:42:14.770631 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:14.770600 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-85d5586674-v5tjn"] Sep 07 13:42:14.774437 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:42:14.774408 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49aaa3ec_25c9_4ccb_ae61_844d3578402e.slice/crio-2a1fdc04706587c2a44b6fc4ce3672dfacc0a7f17075b296322b75d5a7d65ac1 WatchSource:0}: Error finding container 2a1fdc04706587c2a44b6fc4ce3672dfacc0a7f17075b296322b75d5a7d65ac1: Status 404 returned error can't find the container with id 2a1fdc04706587c2a44b6fc4ce3672dfacc0a7f17075b296322b75d5a7d65ac1 Sep 07 13:42:14.777132 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:14.777008 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/63d742cf-3e5e-4327-8271-c2575d83c18a-web-config" (OuterVolumeSpecName: "web-config") pod "63d742cf-3e5e-4327-8271-c2575d83c18a" (UID: "63d742cf-3e5e-4327-8271-c2575d83c18a"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 13:42:14.856220 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:14.856186 2575 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/63d742cf-3e5e-4327-8271-c2575d83c18a-secret-metrics-client-certs\") on node \"ip-10-0-141-124.ec2.internal\" DevicePath \"\"" Sep 07 13:42:14.856220 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:14.856216 2575 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/63d742cf-3e5e-4327-8271-c2575d83c18a-secret-grpc-tls\") on node \"ip-10-0-141-124.ec2.internal\" DevicePath \"\"" Sep 07 13:42:14.856220 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:14.856228 2575 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/63d742cf-3e5e-4327-8271-c2575d83c18a-thanos-prometheus-http-client-file\") on node \"ip-10-0-141-124.ec2.internal\" DevicePath \"\"" Sep 07 13:42:14.856419 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:14.856237 2575 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/63d742cf-3e5e-4327-8271-c2575d83c18a-prometheus-k8s-db\") on node \"ip-10-0-141-124.ec2.internal\" DevicePath \"\"" Sep 07 13:42:14.856419 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:14.856246 2575 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/63d742cf-3e5e-4327-8271-c2575d83c18a-secret-kube-rbac-proxy\") on node \"ip-10-0-141-124.ec2.internal\" DevicePath \"\"" Sep 07 13:42:14.856419 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:14.856255 2575 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/63d742cf-3e5e-4327-8271-c2575d83c18a-secret-prometheus-k8s-tls\") on node \"ip-10-0-141-124.ec2.internal\" DevicePath \"\"" Sep 07 13:42:14.856419 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:14.856264 2575 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/63d742cf-3e5e-4327-8271-c2575d83c18a-tls-assets\") on node \"ip-10-0-141-124.ec2.internal\" DevicePath \"\"" Sep 07 13:42:14.856419 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:14.856272 2575 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/63d742cf-3e5e-4327-8271-c2575d83c18a-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-141-124.ec2.internal\" DevicePath \"\"" Sep 07 13:42:14.856419 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:14.856280 2575 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/63d742cf-3e5e-4327-8271-c2575d83c18a-config\") on node \"ip-10-0-141-124.ec2.internal\" DevicePath \"\"" Sep 07 13:42:14.856419 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:14.856289 2575 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/63d742cf-3e5e-4327-8271-c2575d83c18a-web-config\") on node \"ip-10-0-141-124.ec2.internal\" DevicePath \"\"" Sep 07 13:42:14.856419 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:14.856297 2575 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63d742cf-3e5e-4327-8271-c2575d83c18a-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-141-124.ec2.internal\" DevicePath \"\"" Sep 07 13:42:14.856419 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:14.856305 2575 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/63d742cf-3e5e-4327-8271-c2575d83c18a-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-141-124.ec2.internal\" DevicePath \"\"" Sep 07 13:42:14.856419 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:14.856315 2575 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/63d742cf-3e5e-4327-8271-c2575d83c18a-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-141-124.ec2.internal\" DevicePath \"\"" Sep 07 13:42:14.856419 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:14.856322 2575 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/63d742cf-3e5e-4327-8271-c2575d83c18a-config-out\") on node \"ip-10-0-141-124.ec2.internal\" DevicePath \"\"" Sep 07 13:42:14.856419 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:14.856330 2575 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/63d742cf-3e5e-4327-8271-c2575d83c18a-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-141-124.ec2.internal\" DevicePath \"\"" Sep 07 13:42:14.856419 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:14.856338 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tvw2d\" (UniqueName: \"kubernetes.io/projected/63d742cf-3e5e-4327-8271-c2575d83c18a-kube-api-access-tvw2d\") on node \"ip-10-0-141-124.ec2.internal\" DevicePath \"\"" Sep 07 13:42:14.962527 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:14.962493 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-85d5586674-v5tjn" event={"ID":"49aaa3ec-25c9-4ccb-ae61-844d3578402e","Type":"ContainerStarted","Data":"2a1fdc04706587c2a44b6fc4ce3672dfacc0a7f17075b296322b75d5a7d65ac1"} Sep 07 13:42:14.965680 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:14.965654 2575 generic.go:356] "Generic (PLEG): container finished" podID="63d742cf-3e5e-4327-8271-c2575d83c18a" containerID="87f3755b285647f50d7881f478ce05df5425dc1175b0dd65772a276151f847a6" exitCode=0 Sep 07 13:42:14.965680 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:14.965676 2575 generic.go:356] "Generic (PLEG): container finished" podID="63d742cf-3e5e-4327-8271-c2575d83c18a" containerID="79b85251e58df40637ec32a10358f68dec88486e11a602ae8f3e4cf76939529d" exitCode=0 Sep 07 13:42:14.965680 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:14.965684 2575 generic.go:356] "Generic (PLEG): container finished" podID="63d742cf-3e5e-4327-8271-c2575d83c18a" containerID="16ac67901f2ba489cc7923209ea1b8d74c5d9d0504c09f4525f830fb7b3aaf06" exitCode=0 Sep 07 13:42:14.965869 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:14.965690 2575 generic.go:356] "Generic (PLEG): container finished" podID="63d742cf-3e5e-4327-8271-c2575d83c18a" containerID="6b5871e896687b34f7a7791f017f80c145ded1d3ec003da64e94933de77ee540" exitCode=0 Sep 07 13:42:14.965869 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:14.965695 2575 generic.go:356] "Generic (PLEG): container finished" podID="63d742cf-3e5e-4327-8271-c2575d83c18a" containerID="8ff6c2469badce73517ac8062daf82fc4cd3ee07a7568721c33d7ee9ccb822cf" exitCode=0 Sep 07 13:42:14.965869 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:14.965701 2575 generic.go:356] "Generic (PLEG): container finished" podID="63d742cf-3e5e-4327-8271-c2575d83c18a" containerID="940c73c3620343ada5f39c497a6a202b563ce43db00425a8dda228d291dcbc30" exitCode=0 Sep 07 13:42:14.965869 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:14.965731 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:42:14.965869 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:14.965732 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"63d742cf-3e5e-4327-8271-c2575d83c18a","Type":"ContainerDied","Data":"87f3755b285647f50d7881f478ce05df5425dc1175b0dd65772a276151f847a6"} Sep 07 13:42:14.965869 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:14.965819 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"63d742cf-3e5e-4327-8271-c2575d83c18a","Type":"ContainerDied","Data":"79b85251e58df40637ec32a10358f68dec88486e11a602ae8f3e4cf76939529d"} Sep 07 13:42:14.965869 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:14.965854 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"63d742cf-3e5e-4327-8271-c2575d83c18a","Type":"ContainerDied","Data":"16ac67901f2ba489cc7923209ea1b8d74c5d9d0504c09f4525f830fb7b3aaf06"} Sep 07 13:42:14.966086 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:14.965887 2575 scope.go:117] "RemoveContainer" containerID="87f3755b285647f50d7881f478ce05df5425dc1175b0dd65772a276151f847a6" Sep 07 13:42:14.966086 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:14.965895 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"63d742cf-3e5e-4327-8271-c2575d83c18a","Type":"ContainerDied","Data":"6b5871e896687b34f7a7791f017f80c145ded1d3ec003da64e94933de77ee540"} Sep 07 13:42:14.966086 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:14.965937 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"63d742cf-3e5e-4327-8271-c2575d83c18a","Type":"ContainerDied","Data":"8ff6c2469badce73517ac8062daf82fc4cd3ee07a7568721c33d7ee9ccb822cf"} Sep 07 13:42:14.966086 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:14.965979 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"63d742cf-3e5e-4327-8271-c2575d83c18a","Type":"ContainerDied","Data":"940c73c3620343ada5f39c497a6a202b563ce43db00425a8dda228d291dcbc30"} Sep 07 13:42:14.966086 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:14.966023 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"63d742cf-3e5e-4327-8271-c2575d83c18a","Type":"ContainerDied","Data":"da0ae68d178c1d53cdd6cec6c2ef8e1577b6b4f553bf7a253ae19cf78383a008"} Sep 07 13:42:14.974977 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:14.974958 2575 scope.go:117] "RemoveContainer" containerID="79b85251e58df40637ec32a10358f68dec88486e11a602ae8f3e4cf76939529d" Sep 07 13:42:14.981923 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:14.981907 2575 scope.go:117] "RemoveContainer" containerID="16ac67901f2ba489cc7923209ea1b8d74c5d9d0504c09f4525f830fb7b3aaf06" Sep 07 13:42:14.988596 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:14.988579 2575 scope.go:117] "RemoveContainer" containerID="6b5871e896687b34f7a7791f017f80c145ded1d3ec003da64e94933de77ee540" Sep 07 13:42:14.995584 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:14.995554 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 07 13:42:14.996744 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:14.996643 2575 scope.go:117] "RemoveContainer" containerID="8ff6c2469badce73517ac8062daf82fc4cd3ee07a7568721c33d7ee9ccb822cf" Sep 07 13:42:14.998939 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:14.998918 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 07 13:42:15.004067 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.004052 2575 scope.go:117] "RemoveContainer" containerID="940c73c3620343ada5f39c497a6a202b563ce43db00425a8dda228d291dcbc30" Sep 07 13:42:15.011477 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.011460 2575 scope.go:117] "RemoveContainer" containerID="5829fc8cdbc11d8e2054d44290df109bcf6560fd95d505c6cf9a40d5755cb873" Sep 07 13:42:15.020552 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.020530 2575 scope.go:117] "RemoveContainer" containerID="87f3755b285647f50d7881f478ce05df5425dc1175b0dd65772a276151f847a6" Sep 07 13:42:15.020833 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:42:15.020817 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"87f3755b285647f50d7881f478ce05df5425dc1175b0dd65772a276151f847a6\": container with ID starting with 87f3755b285647f50d7881f478ce05df5425dc1175b0dd65772a276151f847a6 not found: ID does not exist" containerID="87f3755b285647f50d7881f478ce05df5425dc1175b0dd65772a276151f847a6" Sep 07 13:42:15.020881 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.020843 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"87f3755b285647f50d7881f478ce05df5425dc1175b0dd65772a276151f847a6"} err="failed to get container status \"87f3755b285647f50d7881f478ce05df5425dc1175b0dd65772a276151f847a6\": rpc error: code = NotFound desc = could not find container \"87f3755b285647f50d7881f478ce05df5425dc1175b0dd65772a276151f847a6\": container with ID starting with 87f3755b285647f50d7881f478ce05df5425dc1175b0dd65772a276151f847a6 not found: ID does not exist" Sep 07 13:42:15.020881 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.020861 2575 scope.go:117] "RemoveContainer" containerID="79b85251e58df40637ec32a10358f68dec88486e11a602ae8f3e4cf76939529d" Sep 07 13:42:15.021121 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:42:15.021104 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"79b85251e58df40637ec32a10358f68dec88486e11a602ae8f3e4cf76939529d\": container with ID starting with 79b85251e58df40637ec32a10358f68dec88486e11a602ae8f3e4cf76939529d not found: ID does not exist" containerID="79b85251e58df40637ec32a10358f68dec88486e11a602ae8f3e4cf76939529d" Sep 07 13:42:15.021173 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.021125 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79b85251e58df40637ec32a10358f68dec88486e11a602ae8f3e4cf76939529d"} err="failed to get container status \"79b85251e58df40637ec32a10358f68dec88486e11a602ae8f3e4cf76939529d\": rpc error: code = NotFound desc = could not find container \"79b85251e58df40637ec32a10358f68dec88486e11a602ae8f3e4cf76939529d\": container with ID starting with 79b85251e58df40637ec32a10358f68dec88486e11a602ae8f3e4cf76939529d not found: ID does not exist" Sep 07 13:42:15.021173 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.021138 2575 scope.go:117] "RemoveContainer" containerID="16ac67901f2ba489cc7923209ea1b8d74c5d9d0504c09f4525f830fb7b3aaf06" Sep 07 13:42:15.021342 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:42:15.021326 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"16ac67901f2ba489cc7923209ea1b8d74c5d9d0504c09f4525f830fb7b3aaf06\": container with ID starting with 16ac67901f2ba489cc7923209ea1b8d74c5d9d0504c09f4525f830fb7b3aaf06 not found: ID does not exist" containerID="16ac67901f2ba489cc7923209ea1b8d74c5d9d0504c09f4525f830fb7b3aaf06" Sep 07 13:42:15.021382 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.021347 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"16ac67901f2ba489cc7923209ea1b8d74c5d9d0504c09f4525f830fb7b3aaf06"} err="failed to get container status \"16ac67901f2ba489cc7923209ea1b8d74c5d9d0504c09f4525f830fb7b3aaf06\": rpc error: code = NotFound desc = could not find container \"16ac67901f2ba489cc7923209ea1b8d74c5d9d0504c09f4525f830fb7b3aaf06\": container with ID starting with 16ac67901f2ba489cc7923209ea1b8d74c5d9d0504c09f4525f830fb7b3aaf06 not found: ID does not exist" Sep 07 13:42:15.021382 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.021360 2575 scope.go:117] "RemoveContainer" containerID="6b5871e896687b34f7a7791f017f80c145ded1d3ec003da64e94933de77ee540" Sep 07 13:42:15.021551 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:42:15.021535 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6b5871e896687b34f7a7791f017f80c145ded1d3ec003da64e94933de77ee540\": container with ID starting with 6b5871e896687b34f7a7791f017f80c145ded1d3ec003da64e94933de77ee540 not found: ID does not exist" containerID="6b5871e896687b34f7a7791f017f80c145ded1d3ec003da64e94933de77ee540" Sep 07 13:42:15.021585 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.021553 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b5871e896687b34f7a7791f017f80c145ded1d3ec003da64e94933de77ee540"} err="failed to get container status \"6b5871e896687b34f7a7791f017f80c145ded1d3ec003da64e94933de77ee540\": rpc error: code = NotFound desc = could not find container \"6b5871e896687b34f7a7791f017f80c145ded1d3ec003da64e94933de77ee540\": container with ID starting with 6b5871e896687b34f7a7791f017f80c145ded1d3ec003da64e94933de77ee540 not found: ID does not exist" Sep 07 13:42:15.021585 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.021565 2575 scope.go:117] "RemoveContainer" containerID="8ff6c2469badce73517ac8062daf82fc4cd3ee07a7568721c33d7ee9ccb822cf" Sep 07 13:42:15.021763 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:42:15.021748 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8ff6c2469badce73517ac8062daf82fc4cd3ee07a7568721c33d7ee9ccb822cf\": container with ID starting with 8ff6c2469badce73517ac8062daf82fc4cd3ee07a7568721c33d7ee9ccb822cf not found: ID does not exist" containerID="8ff6c2469badce73517ac8062daf82fc4cd3ee07a7568721c33d7ee9ccb822cf" Sep 07 13:42:15.021825 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.021766 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ff6c2469badce73517ac8062daf82fc4cd3ee07a7568721c33d7ee9ccb822cf"} err="failed to get container status \"8ff6c2469badce73517ac8062daf82fc4cd3ee07a7568721c33d7ee9ccb822cf\": rpc error: code = NotFound desc = could not find container \"8ff6c2469badce73517ac8062daf82fc4cd3ee07a7568721c33d7ee9ccb822cf\": container with ID starting with 8ff6c2469badce73517ac8062daf82fc4cd3ee07a7568721c33d7ee9ccb822cf not found: ID does not exist" Sep 07 13:42:15.021825 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.021797 2575 scope.go:117] "RemoveContainer" containerID="940c73c3620343ada5f39c497a6a202b563ce43db00425a8dda228d291dcbc30" Sep 07 13:42:15.022065 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:42:15.022050 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"940c73c3620343ada5f39c497a6a202b563ce43db00425a8dda228d291dcbc30\": container with ID starting with 940c73c3620343ada5f39c497a6a202b563ce43db00425a8dda228d291dcbc30 not found: ID does not exist" containerID="940c73c3620343ada5f39c497a6a202b563ce43db00425a8dda228d291dcbc30" Sep 07 13:42:15.022109 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.022070 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"940c73c3620343ada5f39c497a6a202b563ce43db00425a8dda228d291dcbc30"} err="failed to get container status \"940c73c3620343ada5f39c497a6a202b563ce43db00425a8dda228d291dcbc30\": rpc error: code = NotFound desc = could not find container \"940c73c3620343ada5f39c497a6a202b563ce43db00425a8dda228d291dcbc30\": container with ID starting with 940c73c3620343ada5f39c497a6a202b563ce43db00425a8dda228d291dcbc30 not found: ID does not exist" Sep 07 13:42:15.022109 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.022082 2575 scope.go:117] "RemoveContainer" containerID="5829fc8cdbc11d8e2054d44290df109bcf6560fd95d505c6cf9a40d5755cb873" Sep 07 13:42:15.022308 ip-10-0-141-124 kubenswrapper[2575]: E0907 13:42:15.022295 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5829fc8cdbc11d8e2054d44290df109bcf6560fd95d505c6cf9a40d5755cb873\": container with ID starting with 5829fc8cdbc11d8e2054d44290df109bcf6560fd95d505c6cf9a40d5755cb873 not found: ID does not exist" containerID="5829fc8cdbc11d8e2054d44290df109bcf6560fd95d505c6cf9a40d5755cb873" Sep 07 13:42:15.022346 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.022313 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5829fc8cdbc11d8e2054d44290df109bcf6560fd95d505c6cf9a40d5755cb873"} err="failed to get container status \"5829fc8cdbc11d8e2054d44290df109bcf6560fd95d505c6cf9a40d5755cb873\": rpc error: code = NotFound desc = could not find container \"5829fc8cdbc11d8e2054d44290df109bcf6560fd95d505c6cf9a40d5755cb873\": container with ID starting with 5829fc8cdbc11d8e2054d44290df109bcf6560fd95d505c6cf9a40d5755cb873 not found: ID does not exist" Sep 07 13:42:15.022346 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.022323 2575 scope.go:117] "RemoveContainer" containerID="87f3755b285647f50d7881f478ce05df5425dc1175b0dd65772a276151f847a6" Sep 07 13:42:15.022548 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.022532 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"87f3755b285647f50d7881f478ce05df5425dc1175b0dd65772a276151f847a6"} err="failed to get container status \"87f3755b285647f50d7881f478ce05df5425dc1175b0dd65772a276151f847a6\": rpc error: code = NotFound desc = could not find container \"87f3755b285647f50d7881f478ce05df5425dc1175b0dd65772a276151f847a6\": container with ID starting with 87f3755b285647f50d7881f478ce05df5425dc1175b0dd65772a276151f847a6 not found: ID does not exist" Sep 07 13:42:15.022548 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.022547 2575 scope.go:117] "RemoveContainer" containerID="79b85251e58df40637ec32a10358f68dec88486e11a602ae8f3e4cf76939529d" Sep 07 13:42:15.022745 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.022729 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79b85251e58df40637ec32a10358f68dec88486e11a602ae8f3e4cf76939529d"} err="failed to get container status \"79b85251e58df40637ec32a10358f68dec88486e11a602ae8f3e4cf76939529d\": rpc error: code = NotFound desc = could not find container \"79b85251e58df40637ec32a10358f68dec88486e11a602ae8f3e4cf76939529d\": container with ID starting with 79b85251e58df40637ec32a10358f68dec88486e11a602ae8f3e4cf76939529d not found: ID does not exist" Sep 07 13:42:15.022836 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.022746 2575 scope.go:117] "RemoveContainer" containerID="16ac67901f2ba489cc7923209ea1b8d74c5d9d0504c09f4525f830fb7b3aaf06" Sep 07 13:42:15.022993 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.022970 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"16ac67901f2ba489cc7923209ea1b8d74c5d9d0504c09f4525f830fb7b3aaf06"} err="failed to get container status \"16ac67901f2ba489cc7923209ea1b8d74c5d9d0504c09f4525f830fb7b3aaf06\": rpc error: code = NotFound desc = could not find container \"16ac67901f2ba489cc7923209ea1b8d74c5d9d0504c09f4525f830fb7b3aaf06\": container with ID starting with 16ac67901f2ba489cc7923209ea1b8d74c5d9d0504c09f4525f830fb7b3aaf06 not found: ID does not exist" Sep 07 13:42:15.022993 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.022987 2575 scope.go:117] "RemoveContainer" containerID="6b5871e896687b34f7a7791f017f80c145ded1d3ec003da64e94933de77ee540" Sep 07 13:42:15.023204 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.023190 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b5871e896687b34f7a7791f017f80c145ded1d3ec003da64e94933de77ee540"} err="failed to get container status \"6b5871e896687b34f7a7791f017f80c145ded1d3ec003da64e94933de77ee540\": rpc error: code = NotFound desc = could not find container \"6b5871e896687b34f7a7791f017f80c145ded1d3ec003da64e94933de77ee540\": container with ID starting with 6b5871e896687b34f7a7791f017f80c145ded1d3ec003da64e94933de77ee540 not found: ID does not exist" Sep 07 13:42:15.023246 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.023204 2575 scope.go:117] "RemoveContainer" containerID="8ff6c2469badce73517ac8062daf82fc4cd3ee07a7568721c33d7ee9ccb822cf" Sep 07 13:42:15.023447 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.023428 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ff6c2469badce73517ac8062daf82fc4cd3ee07a7568721c33d7ee9ccb822cf"} err="failed to get container status \"8ff6c2469badce73517ac8062daf82fc4cd3ee07a7568721c33d7ee9ccb822cf\": rpc error: code = NotFound desc = could not find container \"8ff6c2469badce73517ac8062daf82fc4cd3ee07a7568721c33d7ee9ccb822cf\": container with ID starting with 8ff6c2469badce73517ac8062daf82fc4cd3ee07a7568721c33d7ee9ccb822cf not found: ID does not exist" Sep 07 13:42:15.023511 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.023449 2575 scope.go:117] "RemoveContainer" containerID="940c73c3620343ada5f39c497a6a202b563ce43db00425a8dda228d291dcbc30" Sep 07 13:42:15.023700 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.023685 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"940c73c3620343ada5f39c497a6a202b563ce43db00425a8dda228d291dcbc30"} err="failed to get container status \"940c73c3620343ada5f39c497a6a202b563ce43db00425a8dda228d291dcbc30\": rpc error: code = NotFound desc = could not find container \"940c73c3620343ada5f39c497a6a202b563ce43db00425a8dda228d291dcbc30\": container with ID starting with 940c73c3620343ada5f39c497a6a202b563ce43db00425a8dda228d291dcbc30 not found: ID does not exist" Sep 07 13:42:15.023752 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.023701 2575 scope.go:117] "RemoveContainer" containerID="5829fc8cdbc11d8e2054d44290df109bcf6560fd95d505c6cf9a40d5755cb873" Sep 07 13:42:15.023948 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.023927 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5829fc8cdbc11d8e2054d44290df109bcf6560fd95d505c6cf9a40d5755cb873"} err="failed to get container status \"5829fc8cdbc11d8e2054d44290df109bcf6560fd95d505c6cf9a40d5755cb873\": rpc error: code = NotFound desc = could not find container \"5829fc8cdbc11d8e2054d44290df109bcf6560fd95d505c6cf9a40d5755cb873\": container with ID starting with 5829fc8cdbc11d8e2054d44290df109bcf6560fd95d505c6cf9a40d5755cb873 not found: ID does not exist" Sep 07 13:42:15.023948 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.023948 2575 scope.go:117] "RemoveContainer" containerID="87f3755b285647f50d7881f478ce05df5425dc1175b0dd65772a276151f847a6" Sep 07 13:42:15.024163 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.024147 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"87f3755b285647f50d7881f478ce05df5425dc1175b0dd65772a276151f847a6"} err="failed to get container status \"87f3755b285647f50d7881f478ce05df5425dc1175b0dd65772a276151f847a6\": rpc error: code = NotFound desc = could not find container \"87f3755b285647f50d7881f478ce05df5425dc1175b0dd65772a276151f847a6\": container with ID starting with 87f3755b285647f50d7881f478ce05df5425dc1175b0dd65772a276151f847a6 not found: ID does not exist" Sep 07 13:42:15.024163 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.024164 2575 scope.go:117] "RemoveContainer" containerID="79b85251e58df40637ec32a10358f68dec88486e11a602ae8f3e4cf76939529d" Sep 07 13:42:15.024366 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.024350 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79b85251e58df40637ec32a10358f68dec88486e11a602ae8f3e4cf76939529d"} err="failed to get container status \"79b85251e58df40637ec32a10358f68dec88486e11a602ae8f3e4cf76939529d\": rpc error: code = NotFound desc = could not find container \"79b85251e58df40637ec32a10358f68dec88486e11a602ae8f3e4cf76939529d\": container with ID starting with 79b85251e58df40637ec32a10358f68dec88486e11a602ae8f3e4cf76939529d not found: ID does not exist" Sep 07 13:42:15.024406 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.024366 2575 scope.go:117] "RemoveContainer" containerID="16ac67901f2ba489cc7923209ea1b8d74c5d9d0504c09f4525f830fb7b3aaf06" Sep 07 13:42:15.024616 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.024591 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"16ac67901f2ba489cc7923209ea1b8d74c5d9d0504c09f4525f830fb7b3aaf06"} err="failed to get container status \"16ac67901f2ba489cc7923209ea1b8d74c5d9d0504c09f4525f830fb7b3aaf06\": rpc error: code = NotFound desc = could not find container \"16ac67901f2ba489cc7923209ea1b8d74c5d9d0504c09f4525f830fb7b3aaf06\": container with ID starting with 16ac67901f2ba489cc7923209ea1b8d74c5d9d0504c09f4525f830fb7b3aaf06 not found: ID does not exist" Sep 07 13:42:15.024616 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.024610 2575 scope.go:117] "RemoveContainer" containerID="6b5871e896687b34f7a7791f017f80c145ded1d3ec003da64e94933de77ee540" Sep 07 13:42:15.024858 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.024842 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b5871e896687b34f7a7791f017f80c145ded1d3ec003da64e94933de77ee540"} err="failed to get container status \"6b5871e896687b34f7a7791f017f80c145ded1d3ec003da64e94933de77ee540\": rpc error: code = NotFound desc = could not find container \"6b5871e896687b34f7a7791f017f80c145ded1d3ec003da64e94933de77ee540\": container with ID starting with 6b5871e896687b34f7a7791f017f80c145ded1d3ec003da64e94933de77ee540 not found: ID does not exist" Sep 07 13:42:15.024858 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.024857 2575 scope.go:117] "RemoveContainer" containerID="8ff6c2469badce73517ac8062daf82fc4cd3ee07a7568721c33d7ee9ccb822cf" Sep 07 13:42:15.025066 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.025052 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ff6c2469badce73517ac8062daf82fc4cd3ee07a7568721c33d7ee9ccb822cf"} err="failed to get container status \"8ff6c2469badce73517ac8062daf82fc4cd3ee07a7568721c33d7ee9ccb822cf\": rpc error: code = NotFound desc = could not find container \"8ff6c2469badce73517ac8062daf82fc4cd3ee07a7568721c33d7ee9ccb822cf\": container with ID starting with 8ff6c2469badce73517ac8062daf82fc4cd3ee07a7568721c33d7ee9ccb822cf not found: ID does not exist" Sep 07 13:42:15.025104 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.025066 2575 scope.go:117] "RemoveContainer" containerID="940c73c3620343ada5f39c497a6a202b563ce43db00425a8dda228d291dcbc30" Sep 07 13:42:15.025267 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.025249 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"940c73c3620343ada5f39c497a6a202b563ce43db00425a8dda228d291dcbc30"} err="failed to get container status \"940c73c3620343ada5f39c497a6a202b563ce43db00425a8dda228d291dcbc30\": rpc error: code = NotFound desc = could not find container \"940c73c3620343ada5f39c497a6a202b563ce43db00425a8dda228d291dcbc30\": container with ID starting with 940c73c3620343ada5f39c497a6a202b563ce43db00425a8dda228d291dcbc30 not found: ID does not exist" Sep 07 13:42:15.025323 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.025268 2575 scope.go:117] "RemoveContainer" containerID="5829fc8cdbc11d8e2054d44290df109bcf6560fd95d505c6cf9a40d5755cb873" Sep 07 13:42:15.025473 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.025457 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5829fc8cdbc11d8e2054d44290df109bcf6560fd95d505c6cf9a40d5755cb873"} err="failed to get container status \"5829fc8cdbc11d8e2054d44290df109bcf6560fd95d505c6cf9a40d5755cb873\": rpc error: code = NotFound desc = could not find container \"5829fc8cdbc11d8e2054d44290df109bcf6560fd95d505c6cf9a40d5755cb873\": container with ID starting with 5829fc8cdbc11d8e2054d44290df109bcf6560fd95d505c6cf9a40d5755cb873 not found: ID does not exist" Sep 07 13:42:15.025510 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.025475 2575 scope.go:117] "RemoveContainer" containerID="87f3755b285647f50d7881f478ce05df5425dc1175b0dd65772a276151f847a6" Sep 07 13:42:15.025671 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.025656 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"87f3755b285647f50d7881f478ce05df5425dc1175b0dd65772a276151f847a6"} err="failed to get container status \"87f3755b285647f50d7881f478ce05df5425dc1175b0dd65772a276151f847a6\": rpc error: code = NotFound desc = could not find container \"87f3755b285647f50d7881f478ce05df5425dc1175b0dd65772a276151f847a6\": container with ID starting with 87f3755b285647f50d7881f478ce05df5425dc1175b0dd65772a276151f847a6 not found: ID does not exist" Sep 07 13:42:15.025714 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.025672 2575 scope.go:117] "RemoveContainer" containerID="79b85251e58df40637ec32a10358f68dec88486e11a602ae8f3e4cf76939529d" Sep 07 13:42:15.025915 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.025892 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79b85251e58df40637ec32a10358f68dec88486e11a602ae8f3e4cf76939529d"} err="failed to get container status \"79b85251e58df40637ec32a10358f68dec88486e11a602ae8f3e4cf76939529d\": rpc error: code = NotFound desc = could not find container \"79b85251e58df40637ec32a10358f68dec88486e11a602ae8f3e4cf76939529d\": container with ID starting with 79b85251e58df40637ec32a10358f68dec88486e11a602ae8f3e4cf76939529d not found: ID does not exist" Sep 07 13:42:15.025963 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.025916 2575 scope.go:117] "RemoveContainer" containerID="16ac67901f2ba489cc7923209ea1b8d74c5d9d0504c09f4525f830fb7b3aaf06" Sep 07 13:42:15.026141 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.026125 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"16ac67901f2ba489cc7923209ea1b8d74c5d9d0504c09f4525f830fb7b3aaf06"} err="failed to get container status \"16ac67901f2ba489cc7923209ea1b8d74c5d9d0504c09f4525f830fb7b3aaf06\": rpc error: code = NotFound desc = could not find container \"16ac67901f2ba489cc7923209ea1b8d74c5d9d0504c09f4525f830fb7b3aaf06\": container with ID starting with 16ac67901f2ba489cc7923209ea1b8d74c5d9d0504c09f4525f830fb7b3aaf06 not found: ID does not exist" Sep 07 13:42:15.026183 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.026141 2575 scope.go:117] "RemoveContainer" containerID="6b5871e896687b34f7a7791f017f80c145ded1d3ec003da64e94933de77ee540" Sep 07 13:42:15.026346 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.026332 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b5871e896687b34f7a7791f017f80c145ded1d3ec003da64e94933de77ee540"} err="failed to get container status \"6b5871e896687b34f7a7791f017f80c145ded1d3ec003da64e94933de77ee540\": rpc error: code = NotFound desc = could not find container \"6b5871e896687b34f7a7791f017f80c145ded1d3ec003da64e94933de77ee540\": container with ID starting with 6b5871e896687b34f7a7791f017f80c145ded1d3ec003da64e94933de77ee540 not found: ID does not exist" Sep 07 13:42:15.026383 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.026347 2575 scope.go:117] "RemoveContainer" containerID="8ff6c2469badce73517ac8062daf82fc4cd3ee07a7568721c33d7ee9ccb822cf" Sep 07 13:42:15.026594 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.026578 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ff6c2469badce73517ac8062daf82fc4cd3ee07a7568721c33d7ee9ccb822cf"} err="failed to get container status \"8ff6c2469badce73517ac8062daf82fc4cd3ee07a7568721c33d7ee9ccb822cf\": rpc error: code = NotFound desc = could not find container \"8ff6c2469badce73517ac8062daf82fc4cd3ee07a7568721c33d7ee9ccb822cf\": container with ID starting with 8ff6c2469badce73517ac8062daf82fc4cd3ee07a7568721c33d7ee9ccb822cf not found: ID does not exist" Sep 07 13:42:15.026647 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.026596 2575 scope.go:117] "RemoveContainer" containerID="940c73c3620343ada5f39c497a6a202b563ce43db00425a8dda228d291dcbc30" Sep 07 13:42:15.026850 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.026831 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"940c73c3620343ada5f39c497a6a202b563ce43db00425a8dda228d291dcbc30"} err="failed to get container status \"940c73c3620343ada5f39c497a6a202b563ce43db00425a8dda228d291dcbc30\": rpc error: code = NotFound desc = could not find container \"940c73c3620343ada5f39c497a6a202b563ce43db00425a8dda228d291dcbc30\": container with ID starting with 940c73c3620343ada5f39c497a6a202b563ce43db00425a8dda228d291dcbc30 not found: ID does not exist" Sep 07 13:42:15.026850 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.026850 2575 scope.go:117] "RemoveContainer" containerID="5829fc8cdbc11d8e2054d44290df109bcf6560fd95d505c6cf9a40d5755cb873" Sep 07 13:42:15.027070 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.027052 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5829fc8cdbc11d8e2054d44290df109bcf6560fd95d505c6cf9a40d5755cb873"} err="failed to get container status \"5829fc8cdbc11d8e2054d44290df109bcf6560fd95d505c6cf9a40d5755cb873\": rpc error: code = NotFound desc = could not find container \"5829fc8cdbc11d8e2054d44290df109bcf6560fd95d505c6cf9a40d5755cb873\": container with ID starting with 5829fc8cdbc11d8e2054d44290df109bcf6560fd95d505c6cf9a40d5755cb873 not found: ID does not exist" Sep 07 13:42:15.027112 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.027071 2575 scope.go:117] "RemoveContainer" containerID="87f3755b285647f50d7881f478ce05df5425dc1175b0dd65772a276151f847a6" Sep 07 13:42:15.027297 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.027280 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"87f3755b285647f50d7881f478ce05df5425dc1175b0dd65772a276151f847a6"} err="failed to get container status \"87f3755b285647f50d7881f478ce05df5425dc1175b0dd65772a276151f847a6\": rpc error: code = NotFound desc = could not find container \"87f3755b285647f50d7881f478ce05df5425dc1175b0dd65772a276151f847a6\": container with ID starting with 87f3755b285647f50d7881f478ce05df5425dc1175b0dd65772a276151f847a6 not found: ID does not exist" Sep 07 13:42:15.027334 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.027298 2575 scope.go:117] "RemoveContainer" containerID="79b85251e58df40637ec32a10358f68dec88486e11a602ae8f3e4cf76939529d" Sep 07 13:42:15.027501 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.027484 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79b85251e58df40637ec32a10358f68dec88486e11a602ae8f3e4cf76939529d"} err="failed to get container status \"79b85251e58df40637ec32a10358f68dec88486e11a602ae8f3e4cf76939529d\": rpc error: code = NotFound desc = could not find container \"79b85251e58df40637ec32a10358f68dec88486e11a602ae8f3e4cf76939529d\": container with ID starting with 79b85251e58df40637ec32a10358f68dec88486e11a602ae8f3e4cf76939529d not found: ID does not exist" Sep 07 13:42:15.027541 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.027501 2575 scope.go:117] "RemoveContainer" containerID="16ac67901f2ba489cc7923209ea1b8d74c5d9d0504c09f4525f830fb7b3aaf06" Sep 07 13:42:15.027745 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.027725 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"16ac67901f2ba489cc7923209ea1b8d74c5d9d0504c09f4525f830fb7b3aaf06"} err="failed to get container status \"16ac67901f2ba489cc7923209ea1b8d74c5d9d0504c09f4525f830fb7b3aaf06\": rpc error: code = NotFound desc = could not find container \"16ac67901f2ba489cc7923209ea1b8d74c5d9d0504c09f4525f830fb7b3aaf06\": container with ID starting with 16ac67901f2ba489cc7923209ea1b8d74c5d9d0504c09f4525f830fb7b3aaf06 not found: ID does not exist" Sep 07 13:42:15.027745 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.027746 2575 scope.go:117] "RemoveContainer" containerID="6b5871e896687b34f7a7791f017f80c145ded1d3ec003da64e94933de77ee540" Sep 07 13:42:15.028015 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.027999 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b5871e896687b34f7a7791f017f80c145ded1d3ec003da64e94933de77ee540"} err="failed to get container status \"6b5871e896687b34f7a7791f017f80c145ded1d3ec003da64e94933de77ee540\": rpc error: code = NotFound desc = could not find container \"6b5871e896687b34f7a7791f017f80c145ded1d3ec003da64e94933de77ee540\": container with ID starting with 6b5871e896687b34f7a7791f017f80c145ded1d3ec003da64e94933de77ee540 not found: ID does not exist" Sep 07 13:42:15.028065 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.028016 2575 scope.go:117] "RemoveContainer" containerID="8ff6c2469badce73517ac8062daf82fc4cd3ee07a7568721c33d7ee9ccb822cf" Sep 07 13:42:15.028253 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.028235 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ff6c2469badce73517ac8062daf82fc4cd3ee07a7568721c33d7ee9ccb822cf"} err="failed to get container status \"8ff6c2469badce73517ac8062daf82fc4cd3ee07a7568721c33d7ee9ccb822cf\": rpc error: code = NotFound desc = could not find container \"8ff6c2469badce73517ac8062daf82fc4cd3ee07a7568721c33d7ee9ccb822cf\": container with ID starting with 8ff6c2469badce73517ac8062daf82fc4cd3ee07a7568721c33d7ee9ccb822cf not found: ID does not exist" Sep 07 13:42:15.028324 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.028254 2575 scope.go:117] "RemoveContainer" containerID="940c73c3620343ada5f39c497a6a202b563ce43db00425a8dda228d291dcbc30" Sep 07 13:42:15.028483 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.028465 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"940c73c3620343ada5f39c497a6a202b563ce43db00425a8dda228d291dcbc30"} err="failed to get container status \"940c73c3620343ada5f39c497a6a202b563ce43db00425a8dda228d291dcbc30\": rpc error: code = NotFound desc = could not find container \"940c73c3620343ada5f39c497a6a202b563ce43db00425a8dda228d291dcbc30\": container with ID starting with 940c73c3620343ada5f39c497a6a202b563ce43db00425a8dda228d291dcbc30 not found: ID does not exist" Sep 07 13:42:15.028535 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.028483 2575 scope.go:117] "RemoveContainer" containerID="5829fc8cdbc11d8e2054d44290df109bcf6560fd95d505c6cf9a40d5755cb873" Sep 07 13:42:15.028709 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.028692 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5829fc8cdbc11d8e2054d44290df109bcf6560fd95d505c6cf9a40d5755cb873"} err="failed to get container status \"5829fc8cdbc11d8e2054d44290df109bcf6560fd95d505c6cf9a40d5755cb873\": rpc error: code = NotFound desc = could not find container \"5829fc8cdbc11d8e2054d44290df109bcf6560fd95d505c6cf9a40d5755cb873\": container with ID starting with 5829fc8cdbc11d8e2054d44290df109bcf6560fd95d505c6cf9a40d5755cb873 not found: ID does not exist" Sep 07 13:42:15.028766 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.028710 2575 scope.go:117] "RemoveContainer" containerID="87f3755b285647f50d7881f478ce05df5425dc1175b0dd65772a276151f847a6" Sep 07 13:42:15.028964 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.028947 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"87f3755b285647f50d7881f478ce05df5425dc1175b0dd65772a276151f847a6"} err="failed to get container status \"87f3755b285647f50d7881f478ce05df5425dc1175b0dd65772a276151f847a6\": rpc error: code = NotFound desc = could not find container \"87f3755b285647f50d7881f478ce05df5425dc1175b0dd65772a276151f847a6\": container with ID starting with 87f3755b285647f50d7881f478ce05df5425dc1175b0dd65772a276151f847a6 not found: ID does not exist" Sep 07 13:42:15.028964 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.028964 2575 scope.go:117] "RemoveContainer" containerID="79b85251e58df40637ec32a10358f68dec88486e11a602ae8f3e4cf76939529d" Sep 07 13:42:15.029172 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.029155 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79b85251e58df40637ec32a10358f68dec88486e11a602ae8f3e4cf76939529d"} err="failed to get container status \"79b85251e58df40637ec32a10358f68dec88486e11a602ae8f3e4cf76939529d\": rpc error: code = NotFound desc = could not find container \"79b85251e58df40637ec32a10358f68dec88486e11a602ae8f3e4cf76939529d\": container with ID starting with 79b85251e58df40637ec32a10358f68dec88486e11a602ae8f3e4cf76939529d not found: ID does not exist" Sep 07 13:42:15.029223 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.029174 2575 scope.go:117] "RemoveContainer" containerID="16ac67901f2ba489cc7923209ea1b8d74c5d9d0504c09f4525f830fb7b3aaf06" Sep 07 13:42:15.029373 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.029358 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"16ac67901f2ba489cc7923209ea1b8d74c5d9d0504c09f4525f830fb7b3aaf06"} err="failed to get container status \"16ac67901f2ba489cc7923209ea1b8d74c5d9d0504c09f4525f830fb7b3aaf06\": rpc error: code = NotFound desc = could not find container \"16ac67901f2ba489cc7923209ea1b8d74c5d9d0504c09f4525f830fb7b3aaf06\": container with ID starting with 16ac67901f2ba489cc7923209ea1b8d74c5d9d0504c09f4525f830fb7b3aaf06 not found: ID does not exist" Sep 07 13:42:15.029416 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.029373 2575 scope.go:117] "RemoveContainer" containerID="6b5871e896687b34f7a7791f017f80c145ded1d3ec003da64e94933de77ee540" Sep 07 13:42:15.029598 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.029577 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b5871e896687b34f7a7791f017f80c145ded1d3ec003da64e94933de77ee540"} err="failed to get container status \"6b5871e896687b34f7a7791f017f80c145ded1d3ec003da64e94933de77ee540\": rpc error: code = NotFound desc = could not find container \"6b5871e896687b34f7a7791f017f80c145ded1d3ec003da64e94933de77ee540\": container with ID starting with 6b5871e896687b34f7a7791f017f80c145ded1d3ec003da64e94933de77ee540 not found: ID does not exist" Sep 07 13:42:15.029643 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.029600 2575 scope.go:117] "RemoveContainer" containerID="8ff6c2469badce73517ac8062daf82fc4cd3ee07a7568721c33d7ee9ccb822cf" Sep 07 13:42:15.029888 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.029865 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ff6c2469badce73517ac8062daf82fc4cd3ee07a7568721c33d7ee9ccb822cf"} err="failed to get container status \"8ff6c2469badce73517ac8062daf82fc4cd3ee07a7568721c33d7ee9ccb822cf\": rpc error: code = NotFound desc = could not find container \"8ff6c2469badce73517ac8062daf82fc4cd3ee07a7568721c33d7ee9ccb822cf\": container with ID starting with 8ff6c2469badce73517ac8062daf82fc4cd3ee07a7568721c33d7ee9ccb822cf not found: ID does not exist" Sep 07 13:42:15.029888 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.029888 2575 scope.go:117] "RemoveContainer" containerID="940c73c3620343ada5f39c497a6a202b563ce43db00425a8dda228d291dcbc30" Sep 07 13:42:15.030133 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.030111 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"940c73c3620343ada5f39c497a6a202b563ce43db00425a8dda228d291dcbc30"} err="failed to get container status \"940c73c3620343ada5f39c497a6a202b563ce43db00425a8dda228d291dcbc30\": rpc error: code = NotFound desc = could not find container \"940c73c3620343ada5f39c497a6a202b563ce43db00425a8dda228d291dcbc30\": container with ID starting with 940c73c3620343ada5f39c497a6a202b563ce43db00425a8dda228d291dcbc30 not found: ID does not exist" Sep 07 13:42:15.030133 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.030135 2575 scope.go:117] "RemoveContainer" containerID="5829fc8cdbc11d8e2054d44290df109bcf6560fd95d505c6cf9a40d5755cb873" Sep 07 13:42:15.030426 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.030401 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5829fc8cdbc11d8e2054d44290df109bcf6560fd95d505c6cf9a40d5755cb873"} err="failed to get container status \"5829fc8cdbc11d8e2054d44290df109bcf6560fd95d505c6cf9a40d5755cb873\": rpc error: code = NotFound desc = could not find container \"5829fc8cdbc11d8e2054d44290df109bcf6560fd95d505c6cf9a40d5755cb873\": container with ID starting with 5829fc8cdbc11d8e2054d44290df109bcf6560fd95d505c6cf9a40d5755cb873 not found: ID does not exist" Sep 07 13:42:15.043290 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.043270 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 07 13:42:15.043584 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.043573 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63d742cf-3e5e-4327-8271-c2575d83c18a" containerName="prometheus" Sep 07 13:42:15.043620 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.043587 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="63d742cf-3e5e-4327-8271-c2575d83c18a" containerName="prometheus" Sep 07 13:42:15.043620 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.043596 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63d742cf-3e5e-4327-8271-c2575d83c18a" containerName="kube-rbac-proxy-thanos" Sep 07 13:42:15.043620 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.043601 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="63d742cf-3e5e-4327-8271-c2575d83c18a" containerName="kube-rbac-proxy-thanos" Sep 07 13:42:15.043620 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.043617 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63d742cf-3e5e-4327-8271-c2575d83c18a" containerName="kube-rbac-proxy" Sep 07 13:42:15.043750 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.043622 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="63d742cf-3e5e-4327-8271-c2575d83c18a" containerName="kube-rbac-proxy" Sep 07 13:42:15.043750 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.043629 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63d742cf-3e5e-4327-8271-c2575d83c18a" containerName="init-config-reloader" Sep 07 13:42:15.043750 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.043634 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="63d742cf-3e5e-4327-8271-c2575d83c18a" containerName="init-config-reloader" Sep 07 13:42:15.043750 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.043642 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63d742cf-3e5e-4327-8271-c2575d83c18a" containerName="kube-rbac-proxy-web" Sep 07 13:42:15.043750 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.043647 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="63d742cf-3e5e-4327-8271-c2575d83c18a" containerName="kube-rbac-proxy-web" Sep 07 13:42:15.043750 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.043657 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63d742cf-3e5e-4327-8271-c2575d83c18a" containerName="thanos-sidecar" Sep 07 13:42:15.043750 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.043663 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="63d742cf-3e5e-4327-8271-c2575d83c18a" containerName="thanos-sidecar" Sep 07 13:42:15.043750 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.043673 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63d742cf-3e5e-4327-8271-c2575d83c18a" containerName="config-reloader" Sep 07 13:42:15.043750 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.043678 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="63d742cf-3e5e-4327-8271-c2575d83c18a" containerName="config-reloader" Sep 07 13:42:15.043750 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.043734 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="63d742cf-3e5e-4327-8271-c2575d83c18a" containerName="thanos-sidecar" Sep 07 13:42:15.043750 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.043744 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="63d742cf-3e5e-4327-8271-c2575d83c18a" containerName="config-reloader" Sep 07 13:42:15.043750 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.043752 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="63d742cf-3e5e-4327-8271-c2575d83c18a" containerName="kube-rbac-proxy" Sep 07 13:42:15.044126 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.043758 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="63d742cf-3e5e-4327-8271-c2575d83c18a" containerName="prometheus" Sep 07 13:42:15.044126 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.043764 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="63d742cf-3e5e-4327-8271-c2575d83c18a" containerName="kube-rbac-proxy-web" Sep 07 13:42:15.044126 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.043769 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="63d742cf-3e5e-4327-8271-c2575d83c18a" containerName="kube-rbac-proxy-thanos" Sep 07 13:42:15.047498 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.047481 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:42:15.052618 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.052596 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Sep 07 13:42:15.052691 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.052625 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Sep 07 13:42:15.052914 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.052892 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Sep 07 13:42:15.053003 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.052955 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-pfc9j\"" Sep 07 13:42:15.053110 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.053092 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Sep 07 13:42:15.053179 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.053130 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Sep 07 13:42:15.053179 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.053155 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Sep 07 13:42:15.053274 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.053186 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Sep 07 13:42:15.053274 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.053186 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-282d59l1bnsse\"" Sep 07 13:42:15.053274 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.052758 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Sep 07 13:42:15.053500 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.053483 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Sep 07 13:42:15.053500 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.053495 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Sep 07 13:42:15.053633 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.053500 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Sep 07 13:42:15.053991 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.053970 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Sep 07 13:42:15.055944 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.055925 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Sep 07 13:42:15.057582 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.057562 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d1bea57a-5530-46ea-864c-0871ff65fcb3-web-config\") pod \"prometheus-k8s-0\" (UID: \"d1bea57a-5530-46ea-864c-0871ff65fcb3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:42:15.057691 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.057617 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d1bea57a-5530-46ea-864c-0871ff65fcb3-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d1bea57a-5530-46ea-864c-0871ff65fcb3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:42:15.057691 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.057653 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d1bea57a-5530-46ea-864c-0871ff65fcb3-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d1bea57a-5530-46ea-864c-0871ff65fcb3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:42:15.057691 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.057683 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d1bea57a-5530-46ea-864c-0871ff65fcb3-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d1bea57a-5530-46ea-864c-0871ff65fcb3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:42:15.057853 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.057735 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d1bea57a-5530-46ea-864c-0871ff65fcb3-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d1bea57a-5530-46ea-864c-0871ff65fcb3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:42:15.057853 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.057755 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d1bea57a-5530-46ea-864c-0871ff65fcb3-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d1bea57a-5530-46ea-864c-0871ff65fcb3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:42:15.057853 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.057771 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d1bea57a-5530-46ea-864c-0871ff65fcb3-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d1bea57a-5530-46ea-864c-0871ff65fcb3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:42:15.057853 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.057848 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d1bea57a-5530-46ea-864c-0871ff65fcb3-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"d1bea57a-5530-46ea-864c-0871ff65fcb3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:42:15.057983 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.057956 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d1bea57a-5530-46ea-864c-0871ff65fcb3-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"d1bea57a-5530-46ea-864c-0871ff65fcb3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:42:15.058140 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.058115 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d1bea57a-5530-46ea-864c-0871ff65fcb3-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d1bea57a-5530-46ea-864c-0871ff65fcb3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:42:15.058214 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.058160 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d1bea57a-5530-46ea-864c-0871ff65fcb3-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d1bea57a-5530-46ea-864c-0871ff65fcb3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:42:15.058214 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.058189 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d1bea57a-5530-46ea-864c-0871ff65fcb3-config\") pod \"prometheus-k8s-0\" (UID: \"d1bea57a-5530-46ea-864c-0871ff65fcb3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:42:15.058323 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.058232 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d1bea57a-5530-46ea-864c-0871ff65fcb3-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d1bea57a-5530-46ea-864c-0871ff65fcb3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:42:15.058323 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.058298 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d1bea57a-5530-46ea-864c-0871ff65fcb3-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d1bea57a-5530-46ea-864c-0871ff65fcb3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:42:15.058424 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.058324 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d1bea57a-5530-46ea-864c-0871ff65fcb3-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d1bea57a-5530-46ea-864c-0871ff65fcb3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:42:15.058424 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.058363 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d1bea57a-5530-46ea-864c-0871ff65fcb3-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d1bea57a-5530-46ea-864c-0871ff65fcb3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:42:15.058424 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.058399 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d1bea57a-5530-46ea-864c-0871ff65fcb3-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d1bea57a-5530-46ea-864c-0871ff65fcb3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:42:15.058559 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.058438 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d1bea57a-5530-46ea-864c-0871ff65fcb3-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d1bea57a-5530-46ea-864c-0871ff65fcb3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:42:15.058559 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.058463 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d1bea57a-5530-46ea-864c-0871ff65fcb3-config-out\") pod \"prometheus-k8s-0\" (UID: \"d1bea57a-5530-46ea-864c-0871ff65fcb3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:42:15.058559 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.058481 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bq26n\" (UniqueName: \"kubernetes.io/projected/d1bea57a-5530-46ea-864c-0871ff65fcb3-kube-api-access-bq26n\") pod \"prometheus-k8s-0\" (UID: \"d1bea57a-5530-46ea-864c-0871ff65fcb3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:42:15.058707 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.058692 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Sep 07 13:42:15.070600 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.070579 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 07 13:42:15.159901 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.159864 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d1bea57a-5530-46ea-864c-0871ff65fcb3-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d1bea57a-5530-46ea-864c-0871ff65fcb3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:42:15.159901 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.159906 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d1bea57a-5530-46ea-864c-0871ff65fcb3-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d1bea57a-5530-46ea-864c-0871ff65fcb3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:42:15.160131 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.159932 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d1bea57a-5530-46ea-864c-0871ff65fcb3-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d1bea57a-5530-46ea-864c-0871ff65fcb3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:42:15.160202 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.160185 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d1bea57a-5530-46ea-864c-0871ff65fcb3-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d1bea57a-5530-46ea-864c-0871ff65fcb3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:42:15.160263 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.160217 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d1bea57a-5530-46ea-864c-0871ff65fcb3-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d1bea57a-5530-46ea-864c-0871ff65fcb3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:42:15.160263 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.160243 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d1bea57a-5530-46ea-864c-0871ff65fcb3-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d1bea57a-5530-46ea-864c-0871ff65fcb3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:42:15.160367 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.160254 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d1bea57a-5530-46ea-864c-0871ff65fcb3-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d1bea57a-5530-46ea-864c-0871ff65fcb3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:42:15.160409 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.160364 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d1bea57a-5530-46ea-864c-0871ff65fcb3-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"d1bea57a-5530-46ea-864c-0871ff65fcb3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:42:15.160456 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.160405 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d1bea57a-5530-46ea-864c-0871ff65fcb3-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"d1bea57a-5530-46ea-864c-0871ff65fcb3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:42:15.160506 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.160457 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d1bea57a-5530-46ea-864c-0871ff65fcb3-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d1bea57a-5530-46ea-864c-0871ff65fcb3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:42:15.160506 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.160489 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d1bea57a-5530-46ea-864c-0871ff65fcb3-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d1bea57a-5530-46ea-864c-0871ff65fcb3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:42:15.160606 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.160516 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d1bea57a-5530-46ea-864c-0871ff65fcb3-config\") pod \"prometheus-k8s-0\" (UID: \"d1bea57a-5530-46ea-864c-0871ff65fcb3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:42:15.160741 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.160620 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d1bea57a-5530-46ea-864c-0871ff65fcb3-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d1bea57a-5530-46ea-864c-0871ff65fcb3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:42:15.160915 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.160850 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d1bea57a-5530-46ea-864c-0871ff65fcb3-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d1bea57a-5530-46ea-864c-0871ff65fcb3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:42:15.160915 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.160878 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d1bea57a-5530-46ea-864c-0871ff65fcb3-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d1bea57a-5530-46ea-864c-0871ff65fcb3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:42:15.160915 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.160903 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d1bea57a-5530-46ea-864c-0871ff65fcb3-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d1bea57a-5530-46ea-864c-0871ff65fcb3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:42:15.160915 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.160937 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d1bea57a-5530-46ea-864c-0871ff65fcb3-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d1bea57a-5530-46ea-864c-0871ff65fcb3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:42:15.161251 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.160970 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d1bea57a-5530-46ea-864c-0871ff65fcb3-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d1bea57a-5530-46ea-864c-0871ff65fcb3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:42:15.161251 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.160996 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d1bea57a-5530-46ea-864c-0871ff65fcb3-config-out\") pod \"prometheus-k8s-0\" (UID: \"d1bea57a-5530-46ea-864c-0871ff65fcb3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:42:15.161251 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.161018 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d1bea57a-5530-46ea-864c-0871ff65fcb3-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"d1bea57a-5530-46ea-864c-0871ff65fcb3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:42:15.161251 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.161027 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bq26n\" (UniqueName: \"kubernetes.io/projected/d1bea57a-5530-46ea-864c-0871ff65fcb3-kube-api-access-bq26n\") pod \"prometheus-k8s-0\" (UID: \"d1bea57a-5530-46ea-864c-0871ff65fcb3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:42:15.161445 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.161270 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d1bea57a-5530-46ea-864c-0871ff65fcb3-web-config\") pod \"prometheus-k8s-0\" (UID: \"d1bea57a-5530-46ea-864c-0871ff65fcb3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:42:15.162050 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.161686 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d1bea57a-5530-46ea-864c-0871ff65fcb3-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d1bea57a-5530-46ea-864c-0871ff65fcb3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:42:15.162257 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.162233 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d1bea57a-5530-46ea-864c-0871ff65fcb3-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"d1bea57a-5530-46ea-864c-0871ff65fcb3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:42:15.163749 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.163405 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d1bea57a-5530-46ea-864c-0871ff65fcb3-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d1bea57a-5530-46ea-864c-0871ff65fcb3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:42:15.163749 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.163555 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d1bea57a-5530-46ea-864c-0871ff65fcb3-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d1bea57a-5530-46ea-864c-0871ff65fcb3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:42:15.163749 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.163556 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d1bea57a-5530-46ea-864c-0871ff65fcb3-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d1bea57a-5530-46ea-864c-0871ff65fcb3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:42:15.163749 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.163573 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d1bea57a-5530-46ea-864c-0871ff65fcb3-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d1bea57a-5530-46ea-864c-0871ff65fcb3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:42:15.163749 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.160712 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d1bea57a-5530-46ea-864c-0871ff65fcb3-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d1bea57a-5530-46ea-864c-0871ff65fcb3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:42:15.164524 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.164088 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d1bea57a-5530-46ea-864c-0871ff65fcb3-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d1bea57a-5530-46ea-864c-0871ff65fcb3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:42:15.164524 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.164112 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d1bea57a-5530-46ea-864c-0871ff65fcb3-web-config\") pod \"prometheus-k8s-0\" (UID: \"d1bea57a-5530-46ea-864c-0871ff65fcb3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:42:15.164524 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.164196 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d1bea57a-5530-46ea-864c-0871ff65fcb3-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d1bea57a-5530-46ea-864c-0871ff65fcb3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:42:15.164524 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.164477 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/d1bea57a-5530-46ea-864c-0871ff65fcb3-config\") pod \"prometheus-k8s-0\" (UID: \"d1bea57a-5530-46ea-864c-0871ff65fcb3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:42:15.164767 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.164542 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d1bea57a-5530-46ea-864c-0871ff65fcb3-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d1bea57a-5530-46ea-864c-0871ff65fcb3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:42:15.165147 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.165127 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d1bea57a-5530-46ea-864c-0871ff65fcb3-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d1bea57a-5530-46ea-864c-0871ff65fcb3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:42:15.165823 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.165805 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d1bea57a-5530-46ea-864c-0871ff65fcb3-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d1bea57a-5530-46ea-864c-0871ff65fcb3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:42:15.166292 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.166277 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d1bea57a-5530-46ea-864c-0871ff65fcb3-config-out\") pod \"prometheus-k8s-0\" (UID: \"d1bea57a-5530-46ea-864c-0871ff65fcb3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:42:15.166364 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.166310 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d1bea57a-5530-46ea-864c-0871ff65fcb3-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d1bea57a-5530-46ea-864c-0871ff65fcb3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:42:15.167066 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.167036 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d1bea57a-5530-46ea-864c-0871ff65fcb3-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d1bea57a-5530-46ea-864c-0871ff65fcb3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:42:15.169954 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.169936 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bq26n\" (UniqueName: \"kubernetes.io/projected/d1bea57a-5530-46ea-864c-0871ff65fcb3-kube-api-access-bq26n\") pod \"prometheus-k8s-0\" (UID: \"d1bea57a-5530-46ea-864c-0871ff65fcb3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:42:15.358015 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.357981 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:42:15.645366 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.645331 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 07 13:42:15.647179 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:42:15.647133 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1bea57a_5530_46ea_864c_0871ff65fcb3.slice/crio-9702e41eb7b562450c7d6349dd7f8938b4309757318333d6b9517047b8aa2109 WatchSource:0}: Error finding container 9702e41eb7b562450c7d6349dd7f8938b4309757318333d6b9517047b8aa2109: Status 404 returned error can't find the container with id 9702e41eb7b562450c7d6349dd7f8938b4309757318333d6b9517047b8aa2109 Sep 07 13:42:15.977136 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.977041 2575 generic.go:356] "Generic (PLEG): container finished" podID="d1bea57a-5530-46ea-864c-0871ff65fcb3" containerID="2e01c3bc8dec3d2a8709f33c3ddf5641efb005760e78eab93ce25a98672279e6" exitCode=0 Sep 07 13:42:15.977668 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.977645 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d1bea57a-5530-46ea-864c-0871ff65fcb3","Type":"ContainerDied","Data":"2e01c3bc8dec3d2a8709f33c3ddf5641efb005760e78eab93ce25a98672279e6"} Sep 07 13:42:15.977905 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:15.977886 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d1bea57a-5530-46ea-864c-0871ff65fcb3","Type":"ContainerStarted","Data":"9702e41eb7b562450c7d6349dd7f8938b4309757318333d6b9517047b8aa2109"} Sep 07 13:42:16.985825 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:16.985719 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d1bea57a-5530-46ea-864c-0871ff65fcb3","Type":"ContainerStarted","Data":"630b8d4e7b19593909cbdbc328766fd5d2e99aa841803f93333b4c88dd34be1a"} Sep 07 13:42:16.985825 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:16.985806 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d1bea57a-5530-46ea-864c-0871ff65fcb3","Type":"ContainerStarted","Data":"f1496bdfa728cfa4e0a6f0e58928ea35f04350177992ea858225ef754649989b"} Sep 07 13:42:16.986275 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:16.985848 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d1bea57a-5530-46ea-864c-0871ff65fcb3","Type":"ContainerStarted","Data":"0e6f52560aef8d82955e06031ec4312f8704b4d3ea380deec4cc8505875f3e2a"} Sep 07 13:42:16.986275 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:16.985890 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d1bea57a-5530-46ea-864c-0871ff65fcb3","Type":"ContainerStarted","Data":"b2d7b52f2815969dd8b95ebc099b2a1408c580f8191a8acd9f7d8339a391c375"} Sep 07 13:42:16.986275 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:16.985915 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d1bea57a-5530-46ea-864c-0871ff65fcb3","Type":"ContainerStarted","Data":"31e7a28be8fbc91286fcee4a4f9a53c6d52269aa62184a0267e9e442796a9267"} Sep 07 13:42:16.986275 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:16.985948 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d1bea57a-5530-46ea-864c-0871ff65fcb3","Type":"ContainerStarted","Data":"1580e5d8de5e329147582efd1c503b11c60dc88ee024766ac33e2a23c1654e91"} Sep 07 13:42:16.987834 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:16.987804 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-85d5586674-v5tjn" event={"ID":"49aaa3ec-25c9-4ccb-ae61-844d3578402e","Type":"ContainerStarted","Data":"e4758ea0ac83fcb1024baa1a82b6dd57739a71ca16921ad05893f27b6d514660"} Sep 07 13:42:16.987937 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:16.987847 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-85d5586674-v5tjn" event={"ID":"49aaa3ec-25c9-4ccb-ae61-844d3578402e","Type":"ContainerStarted","Data":"f516183e66459615e4d7de587f0ec19895fab566759d863181b3bca05c9cd945"} Sep 07 13:42:16.987937 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:16.987864 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-85d5586674-v5tjn" event={"ID":"49aaa3ec-25c9-4ccb-ae61-844d3578402e","Type":"ContainerStarted","Data":"4ee95fcced232ee7ff0813c5b24089f29b1aa40fda4983003bfee0776e3c78d3"} Sep 07 13:42:16.993610 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:16.993587 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="63d742cf-3e5e-4327-8271-c2575d83c18a" path="/var/lib/kubelet/pods/63d742cf-3e5e-4327-8271-c2575d83c18a/volumes" Sep 07 13:42:17.032705 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:17.032650 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.013081638 podStartE2EDuration="2.03262964s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.548002ms" isStatefulPod=false podCreationTimestamp="2026-09-07 13:42:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:42:17.031751777 +0000 UTC m=+208.525881108" watchObservedRunningTime="2026-09-07 13:42:17.03262964 +0000 UTC m=+208.526758972" Sep 07 13:42:17.063251 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:17.063194 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-85d5586674-v5tjn" podStartSLOduration=1.184425991 podStartE2EDuration="3.063178478s" totalImagesPullingTime="1.878752487s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:42:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:42:17.062982442 +0000 UTC m=+208.557111773" watchObservedRunningTime="2026-09-07 13:42:17.063178478 +0000 UTC m=+208.557307809" Sep 07 13:42:20.358313 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:42:20.358268 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:43:15.359147 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:43:15.359056 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:43:15.375424 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:43:15.375396 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:43:16.251697 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:43:16.251671 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:43:48.937771 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:43:48.937738 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-jc5wl_53ad2387-73d8-4939-b289-237d027b5bcd/console-operator/1.log" Sep 07 13:43:48.942823 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:43:48.942803 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-jc5wl_53ad2387-73d8-4939-b289-237d027b5bcd/console-operator/1.log" Sep 07 13:43:48.948704 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:43:48.948685 2575 kubelet.go:1648] "Image garbage collection succeeded" Sep 07 13:47:44.998343 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:47:44.998264 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-7f9b886978-wssmg"] Sep 07 13:47:45.006119 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:47:45.006097 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-7f9b886978-wssmg" Sep 07 13:47:45.009301 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:47:45.009272 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kubeflow-trainer-webhook-cert\"" Sep 07 13:47:45.010516 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:47:45.010498 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Sep 07 13:47:45.010746 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:47:45.010724 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kubeflow-trainer-controller-manager-dockercfg-655lw\"" Sep 07 13:47:45.010908 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:47:45.010746 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kubeflow-trainer-config\"" Sep 07 13:47:45.010908 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:47:45.010766 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Sep 07 13:47:45.014543 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:47:45.014518 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-7f9b886978-wssmg"] Sep 07 13:47:45.150130 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:47:45.150098 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/24a7354f-6c46-404c-89c0-008ec9e9efbe-cert\") pod \"kubeflow-trainer-controller-manager-7f9b886978-wssmg\" (UID: \"24a7354f-6c46-404c-89c0-008ec9e9efbe\") " pod="opendatahub/kubeflow-trainer-controller-manager-7f9b886978-wssmg" Sep 07 13:47:45.150287 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:47:45.150137 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w89sr\" (UniqueName: \"kubernetes.io/projected/24a7354f-6c46-404c-89c0-008ec9e9efbe-kube-api-access-w89sr\") pod \"kubeflow-trainer-controller-manager-7f9b886978-wssmg\" (UID: \"24a7354f-6c46-404c-89c0-008ec9e9efbe\") " pod="opendatahub/kubeflow-trainer-controller-manager-7f9b886978-wssmg" Sep 07 13:47:45.150287 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:47:45.150159 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/24a7354f-6c46-404c-89c0-008ec9e9efbe-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-7f9b886978-wssmg\" (UID: \"24a7354f-6c46-404c-89c0-008ec9e9efbe\") " pod="opendatahub/kubeflow-trainer-controller-manager-7f9b886978-wssmg" Sep 07 13:47:45.251055 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:47:45.250958 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/24a7354f-6c46-404c-89c0-008ec9e9efbe-cert\") pod \"kubeflow-trainer-controller-manager-7f9b886978-wssmg\" (UID: \"24a7354f-6c46-404c-89c0-008ec9e9efbe\") " pod="opendatahub/kubeflow-trainer-controller-manager-7f9b886978-wssmg" Sep 07 13:47:45.251055 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:47:45.251002 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w89sr\" (UniqueName: \"kubernetes.io/projected/24a7354f-6c46-404c-89c0-008ec9e9efbe-kube-api-access-w89sr\") pod \"kubeflow-trainer-controller-manager-7f9b886978-wssmg\" (UID: \"24a7354f-6c46-404c-89c0-008ec9e9efbe\") " pod="opendatahub/kubeflow-trainer-controller-manager-7f9b886978-wssmg" Sep 07 13:47:45.251055 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:47:45.251022 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/24a7354f-6c46-404c-89c0-008ec9e9efbe-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-7f9b886978-wssmg\" (UID: \"24a7354f-6c46-404c-89c0-008ec9e9efbe\") " pod="opendatahub/kubeflow-trainer-controller-manager-7f9b886978-wssmg" Sep 07 13:47:45.251675 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:47:45.251653 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/24a7354f-6c46-404c-89c0-008ec9e9efbe-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-7f9b886978-wssmg\" (UID: \"24a7354f-6c46-404c-89c0-008ec9e9efbe\") " pod="opendatahub/kubeflow-trainer-controller-manager-7f9b886978-wssmg" Sep 07 13:47:45.253514 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:47:45.253490 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/24a7354f-6c46-404c-89c0-008ec9e9efbe-cert\") pod \"kubeflow-trainer-controller-manager-7f9b886978-wssmg\" (UID: \"24a7354f-6c46-404c-89c0-008ec9e9efbe\") " pod="opendatahub/kubeflow-trainer-controller-manager-7f9b886978-wssmg" Sep 07 13:47:45.260709 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:47:45.260689 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w89sr\" (UniqueName: \"kubernetes.io/projected/24a7354f-6c46-404c-89c0-008ec9e9efbe-kube-api-access-w89sr\") pod \"kubeflow-trainer-controller-manager-7f9b886978-wssmg\" (UID: \"24a7354f-6c46-404c-89c0-008ec9e9efbe\") " pod="opendatahub/kubeflow-trainer-controller-manager-7f9b886978-wssmg" Sep 07 13:47:45.316330 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:47:45.316306 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-7f9b886978-wssmg" Sep 07 13:47:45.590532 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:47:45.590377 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-7f9b886978-wssmg"] Sep 07 13:47:45.592730 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:47:45.592705 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod24a7354f_6c46_404c_89c0_008ec9e9efbe.slice/crio-a51d37baf7947b2a532769c10926a4b43c57a357258e271621485bef44772c50 WatchSource:0}: Error finding container a51d37baf7947b2a532769c10926a4b43c57a357258e271621485bef44772c50: Status 404 returned error can't find the container with id a51d37baf7947b2a532769c10926a4b43c57a357258e271621485bef44772c50 Sep 07 13:47:45.594598 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:47:45.594582 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 07 13:47:46.321404 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:47:46.321365 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-7f9b886978-wssmg" event={"ID":"24a7354f-6c46-404c-89c0-008ec9e9efbe","Type":"ContainerStarted","Data":"a51d37baf7947b2a532769c10926a4b43c57a357258e271621485bef44772c50"} Sep 07 13:47:48.333498 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:47:48.333469 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-7f9b886978-wssmg" event={"ID":"24a7354f-6c46-404c-89c0-008ec9e9efbe","Type":"ContainerStarted","Data":"3ab485aac4145bd71a6fc984b08074bffeb943025e4f2aafc4dde971b54fdfb7"} Sep 07 13:47:48.333902 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:47:48.333580 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kubeflow-trainer-controller-manager-7f9b886978-wssmg" Sep 07 13:47:48.354532 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:47:48.354431 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kubeflow-trainer-controller-manager-7f9b886978-wssmg" podStartSLOduration=1.9926940640000002 podStartE2EDuration="4.354411584s" totalImagesPullingTime="2.36171752s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:47:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:47:48.354080275 +0000 UTC m=+539.848209609" watchObservedRunningTime="2026-09-07 13:47:48.354411584 +0000 UTC m=+539.848540918" Sep 07 13:48:04.342946 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:48:04.342910 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kubeflow-trainer-controller-manager-7f9b886978-wssmg" Sep 07 13:48:48.967723 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:48:48.967693 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-jc5wl_53ad2387-73d8-4939-b289-237d027b5bcd/console-operator/1.log" Sep 07 13:48:48.970085 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:48:48.970062 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-jc5wl_53ad2387-73d8-4939-b289-237d027b5bcd/console-operator/1.log" Sep 07 13:48:58.401188 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:48:58.401148 2575 ???:1] "http: TLS handshake error from 10.0.138.240:48042: EOF" Sep 07 13:48:58.408490 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:48:58.408461 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kubeflow-trainer-controller-manager-7f9b886978-wssmg_24a7354f-6c46-404c-89c0-008ec9e9efbe/manager/0.log" Sep 07 13:48:59.094777 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:48:59.091347 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kubeflow-trainer-controller-manager-7f9b886978-wssmg_24a7354f-6c46-404c-89c0-008ec9e9efbe/manager/0.log" Sep 07 13:48:59.650647 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:48:59.650615 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kubeflow-trainer-controller-manager-7f9b886978-wssmg_24a7354f-6c46-404c-89c0-008ec9e9efbe/manager/0.log" Sep 07 13:49:45.451294 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:49:45.451256 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-gqwz6/must-gather-7bwr2"] Sep 07 13:49:45.454579 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:49:45.454559 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gqwz6/must-gather-7bwr2" Sep 07 13:49:45.462376 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:49:45.462354 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-gqwz6\"/\"kube-root-ca.crt\"" Sep 07 13:49:45.462483 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:49:45.462355 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-gqwz6\"/\"default-dockercfg-5dh9r\"" Sep 07 13:49:45.479983 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:49:45.479957 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gqwz6/must-gather-7bwr2"] Sep 07 13:49:45.483946 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:49:45.483926 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-gqwz6\"/\"openshift-service-ca.crt\"" Sep 07 13:49:45.576308 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:49:45.576274 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nthpd\" (UniqueName: \"kubernetes.io/projected/9240f944-2d5f-4b45-9746-f8a70e49f3b7-kube-api-access-nthpd\") pod \"must-gather-7bwr2\" (UID: \"9240f944-2d5f-4b45-9746-f8a70e49f3b7\") " pod="openshift-must-gather-gqwz6/must-gather-7bwr2" Sep 07 13:49:45.576474 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:49:45.576404 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/9240f944-2d5f-4b45-9746-f8a70e49f3b7-must-gather-output\") pod \"must-gather-7bwr2\" (UID: \"9240f944-2d5f-4b45-9746-f8a70e49f3b7\") " pod="openshift-must-gather-gqwz6/must-gather-7bwr2" Sep 07 13:49:45.677295 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:49:45.677263 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/9240f944-2d5f-4b45-9746-f8a70e49f3b7-must-gather-output\") pod \"must-gather-7bwr2\" (UID: \"9240f944-2d5f-4b45-9746-f8a70e49f3b7\") " pod="openshift-must-gather-gqwz6/must-gather-7bwr2" Sep 07 13:49:45.677452 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:49:45.677312 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nthpd\" (UniqueName: \"kubernetes.io/projected/9240f944-2d5f-4b45-9746-f8a70e49f3b7-kube-api-access-nthpd\") pod \"must-gather-7bwr2\" (UID: \"9240f944-2d5f-4b45-9746-f8a70e49f3b7\") " pod="openshift-must-gather-gqwz6/must-gather-7bwr2" Sep 07 13:49:45.677623 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:49:45.677602 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/9240f944-2d5f-4b45-9746-f8a70e49f3b7-must-gather-output\") pod \"must-gather-7bwr2\" (UID: \"9240f944-2d5f-4b45-9746-f8a70e49f3b7\") " pod="openshift-must-gather-gqwz6/must-gather-7bwr2" Sep 07 13:49:45.689002 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:49:45.688980 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nthpd\" (UniqueName: \"kubernetes.io/projected/9240f944-2d5f-4b45-9746-f8a70e49f3b7-kube-api-access-nthpd\") pod \"must-gather-7bwr2\" (UID: \"9240f944-2d5f-4b45-9746-f8a70e49f3b7\") " pod="openshift-must-gather-gqwz6/must-gather-7bwr2" Sep 07 13:49:45.763526 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:49:45.763443 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gqwz6/must-gather-7bwr2" Sep 07 13:49:46.059711 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:49:46.059685 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gqwz6/must-gather-7bwr2"] Sep 07 13:49:46.062396 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:49:46.062369 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9240f944_2d5f_4b45_9746_f8a70e49f3b7.slice/crio-ac4b2a9846dd67ecfbc9e1e88cac592645eeb7e6fa7da5efb112a417e16ba6ec WatchSource:0}: Error finding container ac4b2a9846dd67ecfbc9e1e88cac592645eeb7e6fa7da5efb112a417e16ba6ec: Status 404 returned error can't find the container with id ac4b2a9846dd67ecfbc9e1e88cac592645eeb7e6fa7da5efb112a417e16ba6ec Sep 07 13:49:46.825469 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:49:46.825431 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gqwz6/must-gather-7bwr2" event={"ID":"9240f944-2d5f-4b45-9746-f8a70e49f3b7","Type":"ContainerStarted","Data":"ac4b2a9846dd67ecfbc9e1e88cac592645eeb7e6fa7da5efb112a417e16ba6ec"} Sep 07 13:49:47.833966 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:49:47.833921 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gqwz6/must-gather-7bwr2" event={"ID":"9240f944-2d5f-4b45-9746-f8a70e49f3b7","Type":"ContainerStarted","Data":"aa3c4867659a62cc04b68ea20e992720cfa7a3a864f56ab9a30ca7396ed4f86b"} Sep 07 13:49:47.834432 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:49:47.833980 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gqwz6/must-gather-7bwr2" event={"ID":"9240f944-2d5f-4b45-9746-f8a70e49f3b7","Type":"ContainerStarted","Data":"6617647bc4008f2088d73a8cdae20045837284aa54186e7d9a9dad0ae47c62d6"} Sep 07 13:49:49.065256 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:49:49.065228 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-947k4_3dccac71-71b0-49e8-bde3-08fd33578be3/global-pull-secret-syncer/0.log" Sep 07 13:49:49.300051 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:49:49.300021 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-m784g_3e98ba1a-f358-4d0c-8be7-cf3ad7eadd82/konnectivity-agent/0.log" Sep 07 13:49:49.663218 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:49:49.663181 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-124.ec2.internal_e0e557d20b3a4c23ec8e66206ce9e08a/haproxy/0.log" Sep 07 13:49:51.772759 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:49:51.772685 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_24c41766-c5f5-41cb-98fc-93a68fb45ff6/alertmanager/0.log" Sep 07 13:49:51.842697 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:49:51.842639 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_24c41766-c5f5-41cb-98fc-93a68fb45ff6/config-reloader/0.log" Sep 07 13:49:51.920395 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:49:51.920371 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_24c41766-c5f5-41cb-98fc-93a68fb45ff6/kube-rbac-proxy-web/0.log" Sep 07 13:49:51.988001 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:49:51.987977 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_24c41766-c5f5-41cb-98fc-93a68fb45ff6/kube-rbac-proxy/0.log" Sep 07 13:49:52.062700 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:49:52.062602 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_24c41766-c5f5-41cb-98fc-93a68fb45ff6/kube-rbac-proxy-metric/0.log" Sep 07 13:49:52.143737 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:49:52.143704 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_24c41766-c5f5-41cb-98fc-93a68fb45ff6/prom-label-proxy/0.log" Sep 07 13:49:52.247328 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:49:52.247302 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_24c41766-c5f5-41cb-98fc-93a68fb45ff6/init-config-reloader/0.log" Sep 07 13:49:52.483032 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:49:52.483004 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-9tlcd_d8934e23-a96f-4f31-bca4-40e7e70639c0/kube-state-metrics/0.log" Sep 07 13:49:52.567401 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:49:52.567374 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-9tlcd_d8934e23-a96f-4f31-bca4-40e7e70639c0/kube-rbac-proxy-main/0.log" Sep 07 13:49:52.708815 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:49:52.708770 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-9tlcd_d8934e23-a96f-4f31-bca4-40e7e70639c0/kube-rbac-proxy-self/0.log" Sep 07 13:49:52.833937 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:49:52.833905 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-7c46d75f98-bd6g4_85142a16-87b7-40a4-9247-2259c82fe20b/metrics-server/0.log" Sep 07 13:49:52.940199 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:49:52.940163 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-85bbbbbf4-vtqzz_7eb6bde7-2318-401d-9aaa-3f1d57f83db4/monitoring-plugin/0.log" Sep 07 13:49:53.412082 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:49:53.412056 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fnm2w_48d72f65-6e57-4f7d-817b-09f37c89080d/node-exporter/0.log" Sep 07 13:49:53.471870 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:49:53.471840 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fnm2w_48d72f65-6e57-4f7d-817b-09f37c89080d/kube-rbac-proxy/0.log" Sep 07 13:49:53.526903 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:49:53.526873 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fnm2w_48d72f65-6e57-4f7d-817b-09f37c89080d/init-textfile/0.log" Sep 07 13:49:53.862422 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:49:53.862351 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-vqdpl_277b3ee2-b16f-40cb-b865-c70046a4f8e8/kube-rbac-proxy-main/0.log" Sep 07 13:49:53.939965 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:49:53.939939 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-vqdpl_277b3ee2-b16f-40cb-b865-c70046a4f8e8/kube-rbac-proxy-self/0.log" Sep 07 13:49:54.030123 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:49:54.030019 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-vqdpl_277b3ee2-b16f-40cb-b865-c70046a4f8e8/openshift-state-metrics/0.log" Sep 07 13:49:54.104436 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:49:54.104411 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d1bea57a-5530-46ea-864c-0871ff65fcb3/prometheus/0.log" Sep 07 13:49:54.164074 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:49:54.164043 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d1bea57a-5530-46ea-864c-0871ff65fcb3/config-reloader/0.log" Sep 07 13:49:54.220626 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:49:54.220600 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d1bea57a-5530-46ea-864c-0871ff65fcb3/thanos-sidecar/0.log" Sep 07 13:49:54.273754 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:49:54.273721 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d1bea57a-5530-46ea-864c-0871ff65fcb3/kube-rbac-proxy-web/0.log" Sep 07 13:49:54.328639 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:49:54.328552 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d1bea57a-5530-46ea-864c-0871ff65fcb3/kube-rbac-proxy/0.log" Sep 07 13:49:54.392338 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:49:54.392292 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d1bea57a-5530-46ea-864c-0871ff65fcb3/kube-rbac-proxy-thanos/0.log" Sep 07 13:49:54.451912 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:49:54.451883 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d1bea57a-5530-46ea-864c-0871ff65fcb3/init-config-reloader/0.log" Sep 07 13:49:54.703832 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:49:54.703770 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-85d5586674-v5tjn_49aaa3ec-25c9-4ccb-ae61-844d3578402e/telemeter-client/0.log" Sep 07 13:49:54.946104 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:49:54.946079 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-85d5586674-v5tjn_49aaa3ec-25c9-4ccb-ae61-844d3578402e/reload/0.log" Sep 07 13:49:55.079937 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:49:55.079897 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-85d5586674-v5tjn_49aaa3ec-25c9-4ccb-ae61-844d3578402e/kube-rbac-proxy/0.log" Sep 07 13:49:56.134641 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:49:56.134583 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-gqwz6/must-gather-7bwr2" podStartSLOduration=10.313131146 podStartE2EDuration="11.134566038s" totalImagesPullingTime="821.434892ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:49:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:49:47.870303275 +0000 UTC m=+659.364432606" watchObservedRunningTime="2026-09-07 13:49:56.134566038 +0000 UTC m=+667.628695369" Sep 07 13:49:56.135233 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:49:56.135199 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-gqwz6/perf-node-gather-daemonset-6qvzv"] Sep 07 13:49:56.141758 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:49:56.141737 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gqwz6/perf-node-gather-daemonset-6qvzv" Sep 07 13:49:56.190343 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:49:56.190307 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gqwz6/perf-node-gather-daemonset-6qvzv"] Sep 07 13:49:56.283726 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:49:56.283685 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2293da2b-eb68-4d4e-afbf-f36bbfb4a2a7-proc\") pod \"perf-node-gather-daemonset-6qvzv\" (UID: \"2293da2b-eb68-4d4e-afbf-f36bbfb4a2a7\") " pod="openshift-must-gather-gqwz6/perf-node-gather-daemonset-6qvzv" Sep 07 13:49:56.283726 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:49:56.283723 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2293da2b-eb68-4d4e-afbf-f36bbfb4a2a7-lib-modules\") pod \"perf-node-gather-daemonset-6qvzv\" (UID: \"2293da2b-eb68-4d4e-afbf-f36bbfb4a2a7\") " pod="openshift-must-gather-gqwz6/perf-node-gather-daemonset-6qvzv" Sep 07 13:49:56.284002 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:49:56.283825 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mbms5\" (UniqueName: \"kubernetes.io/projected/2293da2b-eb68-4d4e-afbf-f36bbfb4a2a7-kube-api-access-mbms5\") pod \"perf-node-gather-daemonset-6qvzv\" (UID: \"2293da2b-eb68-4d4e-afbf-f36bbfb4a2a7\") " pod="openshift-must-gather-gqwz6/perf-node-gather-daemonset-6qvzv" Sep 07 13:49:56.284002 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:49:56.283850 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2293da2b-eb68-4d4e-afbf-f36bbfb4a2a7-sys\") pod \"perf-node-gather-daemonset-6qvzv\" (UID: \"2293da2b-eb68-4d4e-afbf-f36bbfb4a2a7\") " pod="openshift-must-gather-gqwz6/perf-node-gather-daemonset-6qvzv" Sep 07 13:49:56.284002 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:49:56.283883 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2293da2b-eb68-4d4e-afbf-f36bbfb4a2a7-podres\") pod \"perf-node-gather-daemonset-6qvzv\" (UID: \"2293da2b-eb68-4d4e-afbf-f36bbfb4a2a7\") " pod="openshift-must-gather-gqwz6/perf-node-gather-daemonset-6qvzv" Sep 07 13:49:56.385356 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:49:56.385267 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mbms5\" (UniqueName: \"kubernetes.io/projected/2293da2b-eb68-4d4e-afbf-f36bbfb4a2a7-kube-api-access-mbms5\") pod \"perf-node-gather-daemonset-6qvzv\" (UID: \"2293da2b-eb68-4d4e-afbf-f36bbfb4a2a7\") " pod="openshift-must-gather-gqwz6/perf-node-gather-daemonset-6qvzv" Sep 07 13:49:56.385356 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:49:56.385309 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2293da2b-eb68-4d4e-afbf-f36bbfb4a2a7-sys\") pod \"perf-node-gather-daemonset-6qvzv\" (UID: \"2293da2b-eb68-4d4e-afbf-f36bbfb4a2a7\") " pod="openshift-must-gather-gqwz6/perf-node-gather-daemonset-6qvzv" Sep 07 13:49:56.385356 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:49:56.385339 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2293da2b-eb68-4d4e-afbf-f36bbfb4a2a7-podres\") pod \"perf-node-gather-daemonset-6qvzv\" (UID: \"2293da2b-eb68-4d4e-afbf-f36bbfb4a2a7\") " pod="openshift-must-gather-gqwz6/perf-node-gather-daemonset-6qvzv" Sep 07 13:49:56.385697 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:49:56.385397 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2293da2b-eb68-4d4e-afbf-f36bbfb4a2a7-proc\") pod \"perf-node-gather-daemonset-6qvzv\" (UID: \"2293da2b-eb68-4d4e-afbf-f36bbfb4a2a7\") " pod="openshift-must-gather-gqwz6/perf-node-gather-daemonset-6qvzv" Sep 07 13:49:56.385697 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:49:56.385417 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2293da2b-eb68-4d4e-afbf-f36bbfb4a2a7-lib-modules\") pod \"perf-node-gather-daemonset-6qvzv\" (UID: \"2293da2b-eb68-4d4e-afbf-f36bbfb4a2a7\") " pod="openshift-must-gather-gqwz6/perf-node-gather-daemonset-6qvzv" Sep 07 13:49:56.385697 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:49:56.385424 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2293da2b-eb68-4d4e-afbf-f36bbfb4a2a7-sys\") pod \"perf-node-gather-daemonset-6qvzv\" (UID: \"2293da2b-eb68-4d4e-afbf-f36bbfb4a2a7\") " pod="openshift-must-gather-gqwz6/perf-node-gather-daemonset-6qvzv" Sep 07 13:49:56.385697 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:49:56.385498 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2293da2b-eb68-4d4e-afbf-f36bbfb4a2a7-proc\") pod \"perf-node-gather-daemonset-6qvzv\" (UID: \"2293da2b-eb68-4d4e-afbf-f36bbfb4a2a7\") " pod="openshift-must-gather-gqwz6/perf-node-gather-daemonset-6qvzv" Sep 07 13:49:56.385697 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:49:56.385527 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2293da2b-eb68-4d4e-afbf-f36bbfb4a2a7-podres\") pod \"perf-node-gather-daemonset-6qvzv\" (UID: \"2293da2b-eb68-4d4e-afbf-f36bbfb4a2a7\") " pod="openshift-must-gather-gqwz6/perf-node-gather-daemonset-6qvzv" Sep 07 13:49:56.385697 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:49:56.385587 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2293da2b-eb68-4d4e-afbf-f36bbfb4a2a7-lib-modules\") pod \"perf-node-gather-daemonset-6qvzv\" (UID: \"2293da2b-eb68-4d4e-afbf-f36bbfb4a2a7\") " pod="openshift-must-gather-gqwz6/perf-node-gather-daemonset-6qvzv" Sep 07 13:49:56.401092 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:49:56.401059 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mbms5\" (UniqueName: \"kubernetes.io/projected/2293da2b-eb68-4d4e-afbf-f36bbfb4a2a7-kube-api-access-mbms5\") pod \"perf-node-gather-daemonset-6qvzv\" (UID: \"2293da2b-eb68-4d4e-afbf-f36bbfb4a2a7\") " pod="openshift-must-gather-gqwz6/perf-node-gather-daemonset-6qvzv" Sep 07 13:49:56.457124 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:49:56.456821 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gqwz6/perf-node-gather-daemonset-6qvzv" Sep 07 13:49:56.768136 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:49:56.768105 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gqwz6/perf-node-gather-daemonset-6qvzv"] Sep 07 13:49:56.768885 ip-10-0-141-124 kubenswrapper[2575]: W0907 13:49:56.768855 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod2293da2b_eb68_4d4e_afbf_f36bbfb4a2a7.slice/crio-76f0e4d6c6f099d608384de0198b6fbb2d187144a03962dab936a7400f0ce044 WatchSource:0}: Error finding container 76f0e4d6c6f099d608384de0198b6fbb2d187144a03962dab936a7400f0ce044: Status 404 returned error can't find the container with id 76f0e4d6c6f099d608384de0198b6fbb2d187144a03962dab936a7400f0ce044 Sep 07 13:49:56.900952 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:49:56.900908 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gqwz6/perf-node-gather-daemonset-6qvzv" event={"ID":"2293da2b-eb68-4d4e-afbf-f36bbfb4a2a7","Type":"ContainerStarted","Data":"f6500b4453e24fef916d8a5e2659eb574277beb4156919ff333202f7c18cdb2f"} Sep 07 13:49:56.901106 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:49:56.901050 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gqwz6/perf-node-gather-daemonset-6qvzv" event={"ID":"2293da2b-eb68-4d4e-afbf-f36bbfb4a2a7","Type":"ContainerStarted","Data":"76f0e4d6c6f099d608384de0198b6fbb2d187144a03962dab936a7400f0ce044"} Sep 07 13:49:56.901166 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:49:56.901128 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-gqwz6/perf-node-gather-daemonset-6qvzv" Sep 07 13:49:56.940573 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:49:56.940524 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-gqwz6/perf-node-gather-daemonset-6qvzv" podStartSLOduration=0.940507456 podStartE2EDuration="940.507456ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 13:49:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:49:56.936035525 +0000 UTC m=+668.430164855" watchObservedRunningTime="2026-09-07 13:49:56.940507456 +0000 UTC m=+668.434636808" Sep 07 13:49:57.401050 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:49:57.401019 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-jc5wl_53ad2387-73d8-4939-b289-237d027b5bcd/console-operator/1.log" Sep 07 13:49:57.406063 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:49:57.406035 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-jc5wl_53ad2387-73d8-4939-b289-237d027b5bcd/console-operator/2.log" Sep 07 13:49:57.957947 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:49:57.957919 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-85d98c998f-bfcpr_e561ca49-a4db-4e7a-be5a-6e05a9cda274/download-server/0.log" Sep 07 13:49:59.703894 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:49:59.703860 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-8s8pc_862d7f09-8baa-4fe7-a00a-1dd31feb354c/dns/0.log" Sep 07 13:49:59.756672 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:49:59.756642 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-8s8pc_862d7f09-8baa-4fe7-a00a-1dd31feb354c/kube-rbac-proxy/0.log" Sep 07 13:50:00.005740 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:50:00.005659 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-fv7sq_ad201af3-f88e-4869-a5b7-0726f6282ee2/dns-node-resolver/0.log" Sep 07 13:50:00.780196 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:50:00.780168 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-kr8mv_0add805e-551b-40c5-8cee-8cc240585411/node-ca/0.log" Sep 07 13:50:02.432460 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:50:02.432436 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-hx6nh_8202e703-f3f9-48f3-b51c-93f55ef79ebc/serve-healthcheck-canary/0.log" Sep 07 13:50:02.917644 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:50:02.917619 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-gqwz6/perf-node-gather-daemonset-6qvzv" Sep 07 13:50:03.014239 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:50:03.014206 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-76bcd6ccf5-g5t5m_d58ec2a6-c963-4cf8-a7d5-65877ae45e14/insights-operator/1.log" Sep 07 13:50:03.014622 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:50:03.014605 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-76bcd6ccf5-g5t5m_d58ec2a6-c963-4cf8-a7d5-65877ae45e14/insights-operator/0.log" Sep 07 13:50:03.249041 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:50:03.248976 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lk4b9_56e15401-a8c8-47ab-b7a5-c4bfd7225675/kube-rbac-proxy/0.log" Sep 07 13:50:03.289084 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:50:03.289054 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lk4b9_56e15401-a8c8-47ab-b7a5-c4bfd7225675/exporter/0.log" Sep 07 13:50:03.359009 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:50:03.358981 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lk4b9_56e15401-a8c8-47ab-b7a5-c4bfd7225675/extractor/0.log" Sep 07 13:50:12.677797 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:50:12.677655 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xqq4n_b12d5e4b-b139-4b59-b6ce-3cbc314a11c6/kube-multus-additional-cni-plugins/0.log" Sep 07 13:50:12.713643 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:50:12.713615 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xqq4n_b12d5e4b-b139-4b59-b6ce-3cbc314a11c6/egress-router-binary-copy/0.log" Sep 07 13:50:12.743158 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:50:12.743057 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xqq4n_b12d5e4b-b139-4b59-b6ce-3cbc314a11c6/cni-plugins/0.log" Sep 07 13:50:12.770616 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:50:12.770589 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xqq4n_b12d5e4b-b139-4b59-b6ce-3cbc314a11c6/bond-cni-plugin/0.log" Sep 07 13:50:12.807898 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:50:12.807866 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xqq4n_b12d5e4b-b139-4b59-b6ce-3cbc314a11c6/routeoverride-cni/0.log" Sep 07 13:50:12.832826 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:50:12.832802 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xqq4n_b12d5e4b-b139-4b59-b6ce-3cbc314a11c6/whereabouts-cni-bincopy/0.log" Sep 07 13:50:12.866325 ip-10-0-141-124 kubenswrapper[2575]: I0907 13:50:12.866302 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xqq4n_b12d5e4b-b139-4b59-b6ce-3cbc314a11c6/whereabouts-cni/0.log"