Sep 17 14:07:10.941776 ip-10-0-129-36 systemd[1]: Starting Kubernetes Kubelet... Sep 17 14:07:11.311167 ip-10-0-129-36 kubenswrapper[2558]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 17 14:07:11.311167 ip-10-0-129-36 kubenswrapper[2558]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 17 14:07:11.311167 ip-10-0-129-36 kubenswrapper[2558]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 17 14:07:11.311167 ip-10-0-129-36 kubenswrapper[2558]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 17 14:07:11.311167 ip-10-0-129-36 kubenswrapper[2558]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 17 14:07:11.312769 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.312674 2558 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 17 14:07:11.316219 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.316196 2558 feature_gate.go:328] unrecognized feature gate: Example2 Sep 17 14:07:11.316219 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.316213 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 17 14:07:11.316219 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.316219 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 17 14:07:11.316219 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.316225 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 17 14:07:11.316452 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.316229 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 17 14:07:11.316452 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.316234 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 17 14:07:11.316452 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.316238 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 17 14:07:11.316452 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.316242 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 17 14:07:11.316452 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.316246 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 17 14:07:11.316452 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.316250 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 17 14:07:11.316452 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.316253 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 17 14:07:11.316452 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.316257 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 17 14:07:11.316452 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.316262 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 17 14:07:11.316452 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.316266 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 17 14:07:11.316452 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.316270 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 17 14:07:11.316452 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.316273 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 17 14:07:11.316452 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.316277 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 17 14:07:11.316452 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.316281 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 17 14:07:11.316452 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.316285 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 17 14:07:11.316452 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.316289 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 17 14:07:11.316452 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.316302 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 17 14:07:11.316452 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.316308 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 17 14:07:11.316452 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.316313 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 17 14:07:11.317254 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.316318 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 17 14:07:11.317254 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.316322 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 17 14:07:11.317254 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.316326 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 17 14:07:11.317254 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.316330 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 17 14:07:11.317254 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.316334 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 17 14:07:11.317254 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.316339 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 17 14:07:11.317254 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.316343 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 17 14:07:11.317254 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.316347 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 17 14:07:11.317254 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.316351 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 17 14:07:11.317254 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.316355 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 17 14:07:11.317254 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.316359 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 17 14:07:11.317254 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.316363 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 17 14:07:11.317254 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.316367 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 17 14:07:11.317254 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.316371 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 17 14:07:11.317254 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.316377 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 17 14:07:11.317254 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.316381 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 17 14:07:11.317254 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.316385 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 17 14:07:11.317254 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.316390 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 17 14:07:11.317254 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.316394 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 17 14:07:11.318075 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.316398 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 17 14:07:11.318075 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.316403 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 17 14:07:11.318075 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.316407 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 17 14:07:11.318075 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.316410 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 17 14:07:11.318075 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.316415 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 17 14:07:11.318075 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.316419 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 17 14:07:11.318075 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.316424 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 17 14:07:11.318075 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.316428 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 17 14:07:11.318075 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.316434 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 17 14:07:11.318075 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.316438 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 17 14:07:11.318075 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.316442 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 17 14:07:11.318075 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.316447 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 17 14:07:11.318075 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.316451 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 17 14:07:11.318075 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.316455 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 17 14:07:11.318075 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.316459 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 17 14:07:11.318075 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.316463 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 17 14:07:11.318075 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.316467 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 17 14:07:11.318075 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.316472 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 17 14:07:11.318075 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.316475 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 17 14:07:11.318075 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.316479 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 17 14:07:11.318985 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.316484 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 17 14:07:11.318985 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.316488 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 17 14:07:11.318985 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.316492 2558 feature_gate.go:328] unrecognized feature gate: Example Sep 17 14:07:11.318985 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.316514 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 17 14:07:11.318985 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.316518 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 17 14:07:11.318985 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.316522 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 17 14:07:11.318985 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.316526 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 17 14:07:11.318985 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.316531 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 17 14:07:11.318985 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.316536 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 17 14:07:11.318985 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.316541 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 17 14:07:11.318985 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.316548 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 17 14:07:11.318985 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.316554 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 17 14:07:11.318985 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.316559 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 17 14:07:11.318985 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.316564 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 17 14:07:11.318985 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.316569 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 17 14:07:11.318985 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.316573 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 17 14:07:11.318985 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.316577 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 17 14:07:11.318985 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.316581 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 17 14:07:11.318985 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.316586 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 17 14:07:11.319814 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.316592 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 17 14:07:11.319814 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.316596 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 17 14:07:11.319814 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.316600 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 17 14:07:11.319814 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.316606 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 17 14:07:11.319814 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.316611 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 17 14:07:11.319814 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.316616 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 17 14:07:11.319814 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.316621 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 17 14:07:11.319814 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.316626 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 17 14:07:11.319814 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.316631 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 17 14:07:11.319814 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.316635 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 17 14:07:11.319814 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.316639 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 17 14:07:11.319814 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.316643 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 17 14:07:11.319814 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.316647 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 17 14:07:11.319814 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.316651 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 17 14:07:11.319814 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.316656 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 17 14:07:11.319814 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.316661 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 17 14:07:11.319814 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.316665 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 17 14:07:11.319814 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.316668 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 17 14:07:11.319814 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.317859 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 17 14:07:11.319814 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.317870 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 17 14:07:11.320683 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.317878 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 17 14:07:11.320683 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.317883 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 17 14:07:11.320683 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.317887 2558 feature_gate.go:328] unrecognized feature gate: Example2 Sep 17 14:07:11.320683 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.317892 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 17 14:07:11.320683 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.317897 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 17 14:07:11.320683 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.317901 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 17 14:07:11.320683 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.317905 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 17 14:07:11.320683 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.317909 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 17 14:07:11.320683 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.317914 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 17 14:07:11.320683 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.317921 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 17 14:07:11.320683 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.317927 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 17 14:07:11.320683 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.317933 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 17 14:07:11.320683 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.317938 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 17 14:07:11.320683 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.317942 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 17 14:07:11.320683 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.317946 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 17 14:07:11.320683 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.317950 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 17 14:07:11.320683 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.317955 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 17 14:07:11.320683 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.317959 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 17 14:07:11.320683 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.317963 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 17 14:07:11.320683 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.317967 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 17 14:07:11.321327 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.317971 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 17 14:07:11.321327 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.317976 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 17 14:07:11.321327 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.317980 2558 feature_gate.go:328] unrecognized feature gate: Example Sep 17 14:07:11.321327 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.317984 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 17 14:07:11.321327 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.317989 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 17 14:07:11.321327 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.317995 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 17 14:07:11.321327 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.318001 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 17 14:07:11.321327 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.318006 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 17 14:07:11.321327 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.318012 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 17 14:07:11.321327 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.318016 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 17 14:07:11.321327 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.318020 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 17 14:07:11.321327 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.318025 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 17 14:07:11.321327 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.318030 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 17 14:07:11.321327 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.318034 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 17 14:07:11.321327 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.318038 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 17 14:07:11.321327 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.318043 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 17 14:07:11.321327 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.318048 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 17 14:07:11.321327 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.318053 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 17 14:07:11.321327 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.318057 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 17 14:07:11.321922 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.318061 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 17 14:07:11.321922 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.318066 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 17 14:07:11.321922 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.318070 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 17 14:07:11.321922 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.318073 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 17 14:07:11.321922 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.318077 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 17 14:07:11.321922 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.318081 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 17 14:07:11.321922 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.318085 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 17 14:07:11.321922 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.318089 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 17 14:07:11.321922 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.318093 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 17 14:07:11.321922 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.318097 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 17 14:07:11.321922 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.318101 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 17 14:07:11.321922 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.318105 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 17 14:07:11.321922 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.318110 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 17 14:07:11.321922 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.318114 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 17 14:07:11.321922 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.318118 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 17 14:07:11.321922 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.318123 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 17 14:07:11.321922 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.318127 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 17 14:07:11.321922 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.318132 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 17 14:07:11.321922 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.318136 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 17 14:07:11.321922 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.318140 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 17 14:07:11.322448 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.318145 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 17 14:07:11.322448 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.318149 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 17 14:07:11.322448 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.318153 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 17 14:07:11.322448 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.318158 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 17 14:07:11.322448 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.318162 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 17 14:07:11.322448 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.318166 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 17 14:07:11.322448 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.318170 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 17 14:07:11.322448 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.318175 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 17 14:07:11.322448 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.318179 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 17 14:07:11.322448 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.318185 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 17 14:07:11.322448 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.318190 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 17 14:07:11.322448 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.318195 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 17 14:07:11.322448 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.318200 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 17 14:07:11.322448 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.318204 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 17 14:07:11.322448 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.318208 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 17 14:07:11.322448 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.318212 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 17 14:07:11.322448 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.318216 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 17 14:07:11.322448 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.318220 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 17 14:07:11.322448 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.318224 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 17 14:07:11.322448 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.318229 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 17 14:07:11.323144 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.318233 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 17 14:07:11.323144 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.318237 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 17 14:07:11.323144 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.318242 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 17 14:07:11.323144 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.318248 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 17 14:07:11.323144 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.318254 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 17 14:07:11.323144 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.318259 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 17 14:07:11.323144 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.318263 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 17 14:07:11.323144 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.318267 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 17 14:07:11.323144 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.318271 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 17 14:07:11.323144 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.318275 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 17 14:07:11.323144 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.318280 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 17 14:07:11.323144 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.318284 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 17 14:07:11.323144 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.318288 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 17 14:07:11.323144 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.318293 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 17 14:07:11.323144 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.318297 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 17 14:07:11.323144 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.318301 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 17 14:07:11.323144 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.318306 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 17 14:07:11.323144 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.318309 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 17 14:07:11.323144 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.318968 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 17 14:07:11.323144 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.318977 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 17 14:07:11.323671 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.318981 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 17 14:07:11.323671 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.318986 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 17 14:07:11.323671 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.318991 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 17 14:07:11.323671 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.318995 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 17 14:07:11.323671 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.318999 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 17 14:07:11.323671 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.319003 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 17 14:07:11.323671 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.319007 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 17 14:07:11.323671 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.319011 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 17 14:07:11.323671 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.319015 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 17 14:07:11.323671 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.319019 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 17 14:07:11.323671 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.319023 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 17 14:07:11.323671 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.319028 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 17 14:07:11.323671 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.319032 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 17 14:07:11.323671 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.319036 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 17 14:07:11.323671 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.319040 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 17 14:07:11.323671 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.319044 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 17 14:07:11.323671 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.319048 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 17 14:07:11.323671 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.319053 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 17 14:07:11.323671 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.319056 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 17 14:07:11.323671 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.319061 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 17 14:07:11.324294 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.319066 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 17 14:07:11.324294 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.319070 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 17 14:07:11.324294 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.319078 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 17 14:07:11.324294 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.319084 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 17 14:07:11.324294 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.319088 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 17 14:07:11.324294 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.319093 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 17 14:07:11.324294 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.319098 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 17 14:07:11.324294 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.319102 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 17 14:07:11.324294 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.319107 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 17 14:07:11.324294 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.319112 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 17 14:07:11.324294 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.319116 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 17 14:07:11.324294 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.319120 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 17 14:07:11.324294 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.319124 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 17 14:07:11.324294 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.319128 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 17 14:07:11.324294 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.319132 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 17 14:07:11.324294 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.319137 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 17 14:07:11.324294 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.319142 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 17 14:07:11.324294 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.319146 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 17 14:07:11.324294 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.319150 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 17 14:07:11.324856 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.319154 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 17 14:07:11.324856 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.319158 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 17 14:07:11.324856 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.319162 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 17 14:07:11.324856 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.319166 2558 feature_gate.go:328] unrecognized feature gate: Example Sep 17 14:07:11.324856 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.319170 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 17 14:07:11.324856 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.319175 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 17 14:07:11.324856 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.319179 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 17 14:07:11.324856 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.319183 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 17 14:07:11.324856 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.319188 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 17 14:07:11.324856 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.319192 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 17 14:07:11.324856 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.319196 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 17 14:07:11.324856 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.319200 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 17 14:07:11.324856 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.319205 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 17 14:07:11.324856 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.319209 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 17 14:07:11.324856 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.319213 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 17 14:07:11.324856 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.319218 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 17 14:07:11.324856 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.319222 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 17 14:07:11.324856 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.319226 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 17 14:07:11.324856 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.319230 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 17 14:07:11.324856 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.319235 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 17 14:07:11.325379 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.319239 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 17 14:07:11.325379 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.319243 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 17 14:07:11.325379 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.319247 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 17 14:07:11.325379 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.319251 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 17 14:07:11.325379 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.319255 2558 feature_gate.go:328] unrecognized feature gate: Example2 Sep 17 14:07:11.325379 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.319259 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 17 14:07:11.325379 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.319263 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 17 14:07:11.325379 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.319267 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 17 14:07:11.325379 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.319272 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 17 14:07:11.325379 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.319278 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 17 14:07:11.325379 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.319282 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 17 14:07:11.325379 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.319286 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 17 14:07:11.325379 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.319292 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 17 14:07:11.325379 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.319298 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 17 14:07:11.325379 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.319303 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 17 14:07:11.325379 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.319308 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 17 14:07:11.325379 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.319313 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 17 14:07:11.325379 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.319318 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 17 14:07:11.325379 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.319322 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 17 14:07:11.325924 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.319327 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 17 14:07:11.325924 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.319333 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 17 14:07:11.325924 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.319337 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 17 14:07:11.325924 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.319341 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 17 14:07:11.325924 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.319345 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 17 14:07:11.325924 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.319353 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 17 14:07:11.325924 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.319358 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 17 14:07:11.325924 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.319362 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 17 14:07:11.325924 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.319368 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 17 14:07:11.325924 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.319374 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 17 14:07:11.325924 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.319378 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 17 14:07:11.325924 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.319383 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 17 14:07:11.325924 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.319387 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 17 14:07:11.325924 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.319392 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 17 14:07:11.325924 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.319396 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 17 14:07:11.325924 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.319400 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 17 14:07:11.325924 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.319405 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 17 14:07:11.325924 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.319409 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 17 14:07:11.325924 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.319413 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 17 14:07:11.325924 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.319531 2558 flags.go:64] FLAG: --address="0.0.0.0" Sep 17 14:07:11.326403 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.319584 2558 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 17 14:07:11.326403 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.319595 2558 flags.go:64] FLAG: --anonymous-auth="true" Sep 17 14:07:11.326403 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.319602 2558 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 17 14:07:11.326403 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.319609 2558 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 17 14:07:11.326403 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.319615 2558 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 17 14:07:11.326403 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.319621 2558 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 17 14:07:11.326403 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.319628 2558 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 17 14:07:11.326403 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.319633 2558 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 17 14:07:11.326403 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.319638 2558 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 17 14:07:11.326403 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.319643 2558 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 17 14:07:11.326403 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.319648 2558 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 17 14:07:11.326403 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.319653 2558 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 17 14:07:11.326403 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.319658 2558 flags.go:64] FLAG: --cgroup-root="" Sep 17 14:07:11.326403 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.319663 2558 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 17 14:07:11.326403 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.319668 2558 flags.go:64] FLAG: --client-ca-file="" Sep 17 14:07:11.326403 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.319672 2558 flags.go:64] FLAG: --cloud-provider="external" Sep 17 14:07:11.326403 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.319677 2558 flags.go:64] FLAG: --cluster-dns="[]" Sep 17 14:07:11.326403 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.319687 2558 flags.go:64] FLAG: --cluster-domain="" Sep 17 14:07:11.326403 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.319692 2558 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 17 14:07:11.326403 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.319696 2558 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 17 14:07:11.326403 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.319702 2558 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 17 14:07:11.326403 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.319708 2558 flags.go:64] FLAG: --container-log-max-files="5" Sep 17 14:07:11.326403 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.319714 2558 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 17 14:07:11.326403 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.319719 2558 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 17 14:07:11.327009 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.319724 2558 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 17 14:07:11.327009 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.319729 2558 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 17 14:07:11.327009 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.319734 2558 flags.go:64] FLAG: --contention-profiling="false" Sep 17 14:07:11.327009 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.319738 2558 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 17 14:07:11.327009 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.319743 2558 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 17 14:07:11.327009 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.319748 2558 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 17 14:07:11.327009 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.319753 2558 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 17 14:07:11.327009 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.319759 2558 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 17 14:07:11.327009 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.319765 2558 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 17 14:07:11.327009 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.319770 2558 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 17 14:07:11.327009 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.319774 2558 flags.go:64] FLAG: --enable-load-reader="false" Sep 17 14:07:11.327009 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.319779 2558 flags.go:64] FLAG: --enable-server="true" Sep 17 14:07:11.327009 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.319784 2558 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 17 14:07:11.327009 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.319792 2558 flags.go:64] FLAG: --event-burst="100" Sep 17 14:07:11.327009 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.319797 2558 flags.go:64] FLAG: --event-qps="50" Sep 17 14:07:11.327009 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.319802 2558 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 17 14:07:11.327009 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.319807 2558 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 17 14:07:11.327009 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.319812 2558 flags.go:64] FLAG: --eviction-hard="" Sep 17 14:07:11.327009 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.319818 2558 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 17 14:07:11.327009 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.319823 2558 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 17 14:07:11.327009 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.319827 2558 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 17 14:07:11.327009 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.319832 2558 flags.go:64] FLAG: --eviction-soft="" Sep 17 14:07:11.327009 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.319836 2558 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 17 14:07:11.327009 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.319841 2558 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 17 14:07:11.327009 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.319846 2558 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 17 14:07:11.327644 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.319852 2558 flags.go:64] FLAG: --experimental-mounter-path="" Sep 17 14:07:11.327644 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.319857 2558 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 17 14:07:11.327644 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.319862 2558 flags.go:64] FLAG: --fail-swap-on="true" Sep 17 14:07:11.327644 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.319866 2558 flags.go:64] FLAG: --feature-gates="" Sep 17 14:07:11.327644 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.319872 2558 flags.go:64] FLAG: --file-check-frequency="20s" Sep 17 14:07:11.327644 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.319877 2558 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 17 14:07:11.327644 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.319882 2558 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 17 14:07:11.327644 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.319887 2558 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 17 14:07:11.327644 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.319892 2558 flags.go:64] FLAG: --healthz-port="10248" Sep 17 14:07:11.327644 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.319897 2558 flags.go:64] FLAG: --help="false" Sep 17 14:07:11.327644 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.319902 2558 flags.go:64] FLAG: --hostname-override="ip-10-0-129-36.ec2.internal" Sep 17 14:07:11.327644 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.319907 2558 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 17 14:07:11.327644 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.319912 2558 flags.go:64] FLAG: --http-check-frequency="20s" Sep 17 14:07:11.327644 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.319917 2558 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 17 14:07:11.327644 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.319922 2558 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 17 14:07:11.327644 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.319928 2558 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 17 14:07:11.327644 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.319933 2558 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 17 14:07:11.327644 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.319937 2558 flags.go:64] FLAG: --image-service-endpoint="" Sep 17 14:07:11.327644 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.319942 2558 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 17 14:07:11.327644 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.319947 2558 flags.go:64] FLAG: --kube-api-burst="100" Sep 17 14:07:11.327644 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.319953 2558 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 17 14:07:11.327644 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.319958 2558 flags.go:64] FLAG: --kube-api-qps="50" Sep 17 14:07:11.327644 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.319962 2558 flags.go:64] FLAG: --kube-reserved="" Sep 17 14:07:11.327644 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.319967 2558 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 17 14:07:11.328234 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.319972 2558 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 17 14:07:11.328234 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.319977 2558 flags.go:64] FLAG: --kubelet-cgroups="" Sep 17 14:07:11.328234 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.319982 2558 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 17 14:07:11.328234 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.319986 2558 flags.go:64] FLAG: --lock-file="" Sep 17 14:07:11.328234 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.319991 2558 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 17 14:07:11.328234 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.319995 2558 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 17 14:07:11.328234 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.320000 2558 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 17 14:07:11.328234 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.320009 2558 flags.go:64] FLAG: --log-json-split-stream="false" Sep 17 14:07:11.328234 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.320015 2558 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 17 14:07:11.328234 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.320020 2558 flags.go:64] FLAG: --log-text-split-stream="false" Sep 17 14:07:11.328234 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.320025 2558 flags.go:64] FLAG: --logging-format="text" Sep 17 14:07:11.328234 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.320029 2558 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 17 14:07:11.328234 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.320035 2558 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 17 14:07:11.328234 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.320039 2558 flags.go:64] FLAG: --manifest-url="" Sep 17 14:07:11.328234 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.320044 2558 flags.go:64] FLAG: --manifest-url-header="" Sep 17 14:07:11.328234 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.320053 2558 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 17 14:07:11.328234 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.320059 2558 flags.go:64] FLAG: --max-open-files="1000000" Sep 17 14:07:11.328234 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.320065 2558 flags.go:64] FLAG: --max-pods="110" Sep 17 14:07:11.328234 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.320070 2558 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 17 14:07:11.328234 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.320075 2558 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 17 14:07:11.328234 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.320079 2558 flags.go:64] FLAG: --memory-manager-policy="None" Sep 17 14:07:11.328234 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.320084 2558 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 17 14:07:11.328234 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.320089 2558 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 17 14:07:11.328234 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.320093 2558 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 17 14:07:11.328234 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.320098 2558 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 17 14:07:11.328898 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.320109 2558 flags.go:64] FLAG: --node-status-max-images="50" Sep 17 14:07:11.328898 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.320114 2558 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 17 14:07:11.328898 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.320119 2558 flags.go:64] FLAG: --oom-score-adj="-999" Sep 17 14:07:11.328898 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.320124 2558 flags.go:64] FLAG: --pod-cidr="" Sep 17 14:07:11.328898 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.320129 2558 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eee392dbe3ac2ed4a38bca29ae3bd486f5b7780406c62c600154cd1906871b10" Sep 17 14:07:11.328898 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.320137 2558 flags.go:64] FLAG: --pod-manifest-path="" Sep 17 14:07:11.328898 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.320142 2558 flags.go:64] FLAG: --pod-max-pids="-1" Sep 17 14:07:11.328898 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.320147 2558 flags.go:64] FLAG: --pods-per-core="0" Sep 17 14:07:11.328898 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.320152 2558 flags.go:64] FLAG: --port="10250" Sep 17 14:07:11.328898 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.320156 2558 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 17 14:07:11.328898 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.320161 2558 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-015b176788768c04b" Sep 17 14:07:11.328898 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.320166 2558 flags.go:64] FLAG: --qos-reserved="" Sep 17 14:07:11.328898 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.320171 2558 flags.go:64] FLAG: --read-only-port="10255" Sep 17 14:07:11.328898 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.320176 2558 flags.go:64] FLAG: --register-node="true" Sep 17 14:07:11.328898 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.320181 2558 flags.go:64] FLAG: --register-with-taints="" Sep 17 14:07:11.328898 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.320186 2558 flags.go:64] FLAG: --registry-burst="10" Sep 17 14:07:11.328898 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.320193 2558 flags.go:64] FLAG: --registry-qps="5" Sep 17 14:07:11.328898 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.320197 2558 flags.go:64] FLAG: --reserved-cpus="" Sep 17 14:07:11.328898 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.320202 2558 flags.go:64] FLAG: --reserved-memory="" Sep 17 14:07:11.328898 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.320208 2558 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 17 14:07:11.328898 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.320214 2558 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 17 14:07:11.328898 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.320218 2558 flags.go:64] FLAG: --rotate-certificates="false" Sep 17 14:07:11.328898 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.320225 2558 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 17 14:07:11.328898 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.320230 2558 flags.go:64] FLAG: --runonce="false" Sep 17 14:07:11.328898 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.320235 2558 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 17 14:07:11.329523 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.320240 2558 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 17 14:07:11.329523 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.320244 2558 flags.go:64] FLAG: --seccomp-default="false" Sep 17 14:07:11.329523 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.320249 2558 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 17 14:07:11.329523 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.320254 2558 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 17 14:07:11.329523 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.320258 2558 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 17 14:07:11.329523 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.320263 2558 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 17 14:07:11.329523 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.320268 2558 flags.go:64] FLAG: --storage-driver-password="root" Sep 17 14:07:11.329523 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.320273 2558 flags.go:64] FLAG: --storage-driver-secure="false" Sep 17 14:07:11.329523 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.320278 2558 flags.go:64] FLAG: --storage-driver-table="stats" Sep 17 14:07:11.329523 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.320282 2558 flags.go:64] FLAG: --storage-driver-user="root" Sep 17 14:07:11.329523 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.320287 2558 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 17 14:07:11.329523 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.320291 2558 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 17 14:07:11.329523 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.320297 2558 flags.go:64] FLAG: --system-cgroups="" Sep 17 14:07:11.329523 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.320302 2558 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 17 14:07:11.329523 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.320311 2558 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 17 14:07:11.329523 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.320315 2558 flags.go:64] FLAG: --tls-cert-file="" Sep 17 14:07:11.329523 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.320320 2558 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 17 14:07:11.329523 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.320327 2558 flags.go:64] FLAG: --tls-min-version="" Sep 17 14:07:11.329523 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.320331 2558 flags.go:64] FLAG: --tls-private-key-file="" Sep 17 14:07:11.329523 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.320336 2558 flags.go:64] FLAG: --topology-manager-policy="none" Sep 17 14:07:11.329523 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.320340 2558 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 17 14:07:11.329523 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.320344 2558 flags.go:64] FLAG: --topology-manager-scope="container" Sep 17 14:07:11.329523 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.320349 2558 flags.go:64] FLAG: --v="2" Sep 17 14:07:11.329523 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.320357 2558 flags.go:64] FLAG: --version="false" Sep 17 14:07:11.329523 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.320363 2558 flags.go:64] FLAG: --vmodule="" Sep 17 14:07:11.330144 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.320369 2558 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 17 14:07:11.330144 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.320374 2558 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 17 14:07:11.330144 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.320566 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 17 14:07:11.330144 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.320576 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 17 14:07:11.330144 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.320584 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 17 14:07:11.330144 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.320589 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 17 14:07:11.330144 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.320594 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 17 14:07:11.330144 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.320598 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 17 14:07:11.330144 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.320602 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 17 14:07:11.330144 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.320607 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 17 14:07:11.330144 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.320613 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 17 14:07:11.330144 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.320618 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 17 14:07:11.330144 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.320622 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 17 14:07:11.330144 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.320626 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 17 14:07:11.330144 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.320631 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 17 14:07:11.330144 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.320636 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 17 14:07:11.330144 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.320640 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 17 14:07:11.330144 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.320644 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 17 14:07:11.330144 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.320649 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 17 14:07:11.330144 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.320653 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 17 14:07:11.330650 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.320658 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 17 14:07:11.330650 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.320662 2558 feature_gate.go:328] unrecognized feature gate: Example Sep 17 14:07:11.330650 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.320667 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 17 14:07:11.330650 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.320671 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 17 14:07:11.330650 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.320675 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 17 14:07:11.330650 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.320679 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 17 14:07:11.330650 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.320684 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 17 14:07:11.330650 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.320687 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 17 14:07:11.330650 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.320691 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 17 14:07:11.330650 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.320695 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 17 14:07:11.330650 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.320701 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 17 14:07:11.330650 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.320706 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 17 14:07:11.330650 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.320710 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 17 14:07:11.330650 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.320714 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 17 14:07:11.330650 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.320718 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 17 14:07:11.330650 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.320723 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 17 14:07:11.330650 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.320729 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 17 14:07:11.330650 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.320734 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 17 14:07:11.330650 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.320738 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 17 14:07:11.330650 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.320742 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 17 14:07:11.331122 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.320746 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 17 14:07:11.331122 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.320751 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 17 14:07:11.331122 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.320755 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 17 14:07:11.331122 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.320759 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 17 14:07:11.331122 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.320764 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 17 14:07:11.331122 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.320768 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 17 14:07:11.331122 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.320772 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 17 14:07:11.331122 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.320776 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 17 14:07:11.331122 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.320780 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 17 14:07:11.331122 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.320784 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 17 14:07:11.331122 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.320788 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 17 14:07:11.331122 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.320792 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 17 14:07:11.331122 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.320797 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 17 14:07:11.331122 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.320802 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 17 14:07:11.331122 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.320806 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 17 14:07:11.331122 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.320810 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 17 14:07:11.331122 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.320814 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 17 14:07:11.331122 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.320818 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 17 14:07:11.331122 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.320822 2558 feature_gate.go:328] unrecognized feature gate: Example2 Sep 17 14:07:11.331122 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.320826 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 17 14:07:11.331633 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.320830 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 17 14:07:11.331633 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.320835 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 17 14:07:11.331633 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.320841 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 17 14:07:11.331633 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.320845 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 17 14:07:11.331633 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.320850 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 17 14:07:11.331633 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.320854 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 17 14:07:11.331633 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.320858 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 17 14:07:11.331633 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.320862 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 17 14:07:11.331633 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.320868 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 17 14:07:11.331633 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.320872 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 17 14:07:11.331633 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.320876 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 17 14:07:11.331633 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.320880 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 17 14:07:11.331633 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.320885 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 17 14:07:11.331633 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.320889 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 17 14:07:11.331633 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.320893 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 17 14:07:11.331633 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.320897 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 17 14:07:11.331633 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.320903 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 17 14:07:11.331633 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.320908 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 17 14:07:11.331633 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.320912 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 17 14:07:11.332090 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.320916 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 17 14:07:11.332090 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.320920 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 17 14:07:11.332090 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.320924 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 17 14:07:11.332090 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.320928 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 17 14:07:11.332090 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.320933 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 17 14:07:11.332090 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.320937 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 17 14:07:11.332090 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.320941 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 17 14:07:11.332090 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.320946 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 17 14:07:11.332090 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.320950 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 17 14:07:11.332090 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.320954 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 17 14:07:11.332090 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.320958 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 17 14:07:11.332090 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.320965 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 17 14:07:11.332090 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.320970 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 17 14:07:11.332090 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.320976 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 17 14:07:11.332090 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.320980 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 17 14:07:11.332090 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.320987 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 17 14:07:11.332090 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.320991 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 17 14:07:11.332090 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.320995 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 17 14:07:11.332090 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.321000 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 17 14:07:11.332661 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.321004 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 17 14:07:11.332661 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.321008 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 17 14:07:11.332661 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.321014 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 17 14:07:11.332661 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.321484 2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 17 14:07:11.332661 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.328599 2558 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 17 14:07:11.332661 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.328615 2558 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 17 14:07:11.332661 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.328632 2558 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 17 14:07:11.332661 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.328641 2558 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 17 14:07:11.332661 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.328695 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 17 14:07:11.332661 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.328701 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 17 14:07:11.332661 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.328704 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 17 14:07:11.332661 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.328708 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 17 14:07:11.332661 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.328712 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 17 14:07:11.332661 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.328716 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 17 14:07:11.333048 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.328719 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 17 14:07:11.333048 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.328722 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 17 14:07:11.333048 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.328725 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 17 14:07:11.333048 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.328728 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 17 14:07:11.333048 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.328731 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 17 14:07:11.333048 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.328735 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 17 14:07:11.333048 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.328738 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 17 14:07:11.333048 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.328741 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 17 14:07:11.333048 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.328743 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 17 14:07:11.333048 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.328746 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 17 14:07:11.333048 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.328749 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 17 14:07:11.333048 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.328751 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 17 14:07:11.333048 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.328754 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 17 14:07:11.333048 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.328757 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 17 14:07:11.333048 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.328759 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 17 14:07:11.333048 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.328762 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 17 14:07:11.333048 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.328764 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 17 14:07:11.333048 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.328767 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 17 14:07:11.333048 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.328770 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 17 14:07:11.333048 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.328772 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 17 14:07:11.333593 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.328775 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 17 14:07:11.333593 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.328778 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 17 14:07:11.333593 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.328780 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 17 14:07:11.333593 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.328787 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 17 14:07:11.333593 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.328790 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 17 14:07:11.333593 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.328793 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 17 14:07:11.333593 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.328795 2558 feature_gate.go:328] unrecognized feature gate: Example Sep 17 14:07:11.333593 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.328798 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 17 14:07:11.333593 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.328801 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 17 14:07:11.333593 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.328803 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 17 14:07:11.333593 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.328806 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 17 14:07:11.333593 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.328809 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 17 14:07:11.333593 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.328812 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 17 14:07:11.333593 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.328814 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 17 14:07:11.333593 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.328817 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 17 14:07:11.333593 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.328820 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 17 14:07:11.333593 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.328823 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 17 14:07:11.333593 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.328825 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 17 14:07:11.333593 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.328828 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 17 14:07:11.333593 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.328830 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 17 14:07:11.334169 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.328834 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 17 14:07:11.334169 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.328838 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 17 14:07:11.334169 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.328842 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 17 14:07:11.334169 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.328845 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 17 14:07:11.334169 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.328848 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 17 14:07:11.334169 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.328851 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 17 14:07:11.334169 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.328854 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 17 14:07:11.334169 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.328857 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 17 14:07:11.334169 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.328859 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 17 14:07:11.334169 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.328862 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 17 14:07:11.334169 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.328865 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 17 14:07:11.334169 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.328868 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 17 14:07:11.334169 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.328871 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 17 14:07:11.334169 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.328874 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 17 14:07:11.334169 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.328877 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 17 14:07:11.334169 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.328880 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 17 14:07:11.334169 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.328883 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 17 14:07:11.334169 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.328886 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 17 14:07:11.334169 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.328890 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 17 14:07:11.334658 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.328893 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 17 14:07:11.334658 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.328896 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 17 14:07:11.334658 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.328898 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 17 14:07:11.334658 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.328901 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 17 14:07:11.334658 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.328904 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 17 14:07:11.334658 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.328907 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 17 14:07:11.334658 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.328909 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 17 14:07:11.334658 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.328912 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 17 14:07:11.334658 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.328915 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 17 14:07:11.334658 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.328918 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 17 14:07:11.334658 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.328920 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 17 14:07:11.334658 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.328923 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 17 14:07:11.334658 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.328925 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 17 14:07:11.334658 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.328927 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 17 14:07:11.334658 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.328930 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 17 14:07:11.334658 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.328934 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 17 14:07:11.334658 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.328937 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 17 14:07:11.334658 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.328939 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 17 14:07:11.334658 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.328942 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 17 14:07:11.334658 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.328945 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 17 14:07:11.335145 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.328947 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 17 14:07:11.335145 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.328950 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 17 14:07:11.335145 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.328953 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 17 14:07:11.335145 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.328955 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 17 14:07:11.335145 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.328958 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 17 14:07:11.335145 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.328960 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 17 14:07:11.335145 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.328963 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 17 14:07:11.335145 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.328966 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 17 14:07:11.335145 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.328969 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 17 14:07:11.335145 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.328971 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 17 14:07:11.335145 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.328974 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 17 14:07:11.335145 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.328977 2558 feature_gate.go:328] unrecognized feature gate: Example2 Sep 17 14:07:11.335145 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.328979 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 17 14:07:11.335145 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.328982 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 17 14:07:11.335145 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.328987 2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 17 14:07:11.335537 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.329097 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 17 14:07:11.335537 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.329101 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 17 14:07:11.335537 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.329104 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 17 14:07:11.335537 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.329107 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 17 14:07:11.335537 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.329110 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 17 14:07:11.335537 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.329113 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 17 14:07:11.335537 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.329115 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 17 14:07:11.335537 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.329118 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 17 14:07:11.335537 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.329121 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 17 14:07:11.335537 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.329124 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 17 14:07:11.335537 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.329127 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 17 14:07:11.335537 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.329130 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 17 14:07:11.335537 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.329133 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 17 14:07:11.335537 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.329135 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 17 14:07:11.335537 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.329138 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 17 14:07:11.335537 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.329140 2558 feature_gate.go:328] unrecognized feature gate: Example Sep 17 14:07:11.335537 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.329143 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 17 14:07:11.335537 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.329147 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 17 14:07:11.335537 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.329151 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 17 14:07:11.336007 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.329154 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 17 14:07:11.336007 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.329156 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 17 14:07:11.336007 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.329159 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 17 14:07:11.336007 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.329162 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 17 14:07:11.336007 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.329165 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 17 14:07:11.336007 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.329168 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 17 14:07:11.336007 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.329170 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 17 14:07:11.336007 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.329173 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 17 14:07:11.336007 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.329176 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 17 14:07:11.336007 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.329179 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 17 14:07:11.336007 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.329182 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 17 14:07:11.336007 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.329184 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 17 14:07:11.336007 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.329187 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 17 14:07:11.336007 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.329189 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 17 14:07:11.336007 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.329193 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 17 14:07:11.336007 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.329196 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 17 14:07:11.336007 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.329199 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 17 14:07:11.336007 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.329202 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 17 14:07:11.336007 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.329205 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 17 14:07:11.336472 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.329207 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 17 14:07:11.336472 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.329210 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 17 14:07:11.336472 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.329212 2558 feature_gate.go:328] unrecognized feature gate: Example2 Sep 17 14:07:11.336472 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.329215 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 17 14:07:11.336472 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.329217 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 17 14:07:11.336472 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.329220 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 17 14:07:11.336472 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.329222 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 17 14:07:11.336472 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.329225 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 17 14:07:11.336472 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.329229 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 17 14:07:11.336472 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.329232 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 17 14:07:11.336472 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.329235 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 17 14:07:11.336472 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.329238 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 17 14:07:11.336472 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.329240 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 17 14:07:11.336472 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.329243 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 17 14:07:11.336472 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.329245 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 17 14:07:11.336472 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.329248 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 17 14:07:11.336472 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.329250 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 17 14:07:11.336472 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.329253 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 17 14:07:11.336472 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.329256 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 17 14:07:11.336472 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.329259 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 17 14:07:11.336982 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.329261 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 17 14:07:11.336982 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.329264 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 17 14:07:11.336982 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.329266 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 17 14:07:11.336982 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.329270 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 17 14:07:11.336982 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.329272 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 17 14:07:11.336982 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.329275 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 17 14:07:11.336982 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.329277 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 17 14:07:11.336982 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.329280 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 17 14:07:11.336982 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.329283 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 17 14:07:11.336982 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.329285 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 17 14:07:11.336982 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.329288 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 17 14:07:11.336982 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.329291 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 17 14:07:11.336982 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.329293 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 17 14:07:11.336982 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.329296 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 17 14:07:11.336982 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.329298 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 17 14:07:11.336982 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.329301 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 17 14:07:11.336982 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.329303 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 17 14:07:11.336982 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.329306 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 17 14:07:11.336982 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.329308 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 17 14:07:11.337457 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.329311 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 17 14:07:11.337457 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.329314 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 17 14:07:11.337457 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.329316 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 17 14:07:11.337457 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.329319 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 17 14:07:11.337457 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.329321 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 17 14:07:11.337457 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.329324 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 17 14:07:11.337457 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.329326 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 17 14:07:11.337457 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.329329 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 17 14:07:11.337457 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.329331 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 17 14:07:11.337457 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.329334 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 17 14:07:11.337457 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.329337 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 17 14:07:11.337457 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.329340 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 17 14:07:11.337457 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.329342 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 17 14:07:11.337457 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.329345 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 17 14:07:11.337457 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.329347 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 17 14:07:11.337457 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.329350 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 17 14:07:11.337457 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.329352 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 17 14:07:11.337457 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.329355 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 17 14:07:11.337457 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.329358 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 17 14:07:11.337457 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.329360 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 17 14:07:11.338063 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.329363 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 17 14:07:11.338063 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:11.329366 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 17 14:07:11.338063 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.329371 2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 17 14:07:11.338063 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.329459 2558 server.go:962] "Client rotation is on, will bootstrap in background" Sep 17 14:07:11.338063 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.331410 2558 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 17 14:07:11.338063 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.334585 2558 server.go:1019] "Starting client certificate rotation" Sep 17 14:07:11.338063 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.334688 2558 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 17 14:07:11.338063 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.334719 2558 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 17 14:07:11.338063 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.336902 2558 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 17 14:07:11.339346 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.339330 2558 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 17 14:07:11.348329 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.348315 2558 log.go:25] "Validated CRI v1 runtime API" Sep 17 14:07:11.352664 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.352650 2558 log.go:25] "Validated CRI v1 image API" Sep 17 14:07:11.353525 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.353490 2558 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 17 14:07:11.358251 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.358229 2558 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 9adda62a-9f67-46b4-9095-806056ffe7e4:/dev/nvme0n1p4 cbcec06f-71c7-4529-9ace-535b76a93699:/dev/nvme0n1p3] Sep 17 14:07:11.358321 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.358249 2558 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 17 14:07:11.363257 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.363154 2558 manager.go:216] Machine: {Timestamp:2026-09-17 14:07:11.361842028 +0000 UTC m=+0.320861527 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3132356 MemoryCapacity:33164476416 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec221d157a62557ba7b1c3209b4fb7a2 SystemUUID:ec221d15-7a62-557b-a7b1-c3209b4fb7a2 BootID:fb0d388f-88f1-4210-9327-36b09d65ee43 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582238208 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:df:6c:64:b7 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:df:6c:64:b7 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:2a:78:8f:87:38:7b Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164476416 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 17 14:07:11.363257 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.363247 2558 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 17 14:07:11.363405 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.363341 2558 manager.go:232] Version: {KernelVersion:5.14.0-570.140.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260908-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 17 14:07:11.366110 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.366093 2558 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 17 14:07:11.368101 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.368076 2558 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 17 14:07:11.368230 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.368105 2558 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-129-36.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 17 14:07:11.368866 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.368856 2558 topology_manager.go:138] "Creating topology manager with none policy" Sep 17 14:07:11.368898 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.368869 2558 container_manager_linux.go:309] "Creating device plugin manager" Sep 17 14:07:11.368898 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.368876 2558 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 17 14:07:11.369552 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.369542 2558 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 17 14:07:11.370455 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.370446 2558 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 17 14:07:11.374097 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.374086 2558 state_mem.go:36] "Initialized new in-memory state store" Sep 17 14:07:11.374212 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.374203 2558 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 17 14:07:11.374242 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.374231 2558 kubelet.go:486] "Attempting to sync node with API server" Sep 17 14:07:11.374242 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.374241 2558 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 17 14:07:11.374290 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.374250 2558 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 17 14:07:11.374290 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.374260 2558 kubelet.go:398] "Adding apiserver pod source" Sep 17 14:07:11.374290 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.374268 2558 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 17 14:07:11.374601 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.374589 2558 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 17 14:07:11.374650 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.374609 2558 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 17 14:07:11.377635 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.377619 2558 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1" Sep 17 14:07:11.379302 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.379289 2558 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 17 14:07:11.379359 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.379320 2558 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 17 14:07:11.380636 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.380624 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 17 14:07:11.380692 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.380643 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 17 14:07:11.380692 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.380652 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 17 14:07:11.380692 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.380661 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 17 14:07:11.380692 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.380673 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 17 14:07:11.380692 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.380680 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 17 14:07:11.380817 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.380699 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 17 14:07:11.380817 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.380708 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 17 14:07:11.380817 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.380717 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 17 14:07:11.380817 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.380725 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 17 14:07:11.380817 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.380746 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 17 14:07:11.380817 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.380756 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 17 14:07:11.381384 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.381371 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 17 14:07:11.381414 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.381388 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 17 14:07:11.386165 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.386148 2558 server.go:1268] "Started kubelet" Sep 17 14:07:11.386467 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.386440 2558 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 17 14:07:11.386467 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.386425 2558 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 17 14:07:11.386641 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.386545 2558 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 17 14:07:11.387357 ip-10-0-129-36 systemd[1]: Started Kubernetes Kubelet. Sep 17 14:07:11.388760 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.388745 2558 server.go:310] "Adding debug handlers to kubelet server" Sep 17 14:07:11.389490 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.389472 2558 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-129-36.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Sep 17 14:07:11.390205 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:11.389851 2558 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-129-36.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 17 14:07:11.390205 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:11.390065 2558 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Sep 17 14:07:11.391006 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.390914 2558 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 17 14:07:11.392604 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:11.392582 2558 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 17 14:07:11.393778 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:11.392865 2558 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-36.ec2.internal.18d620dc0b9d936f default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-36.ec2.internal,UID:ip-10-0-129-36.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-129-36.ec2.internal,},FirstTimestamp:2026-09-17 14:07:11.386121071 +0000 UTC m=+0.345140569,LastTimestamp:2026-09-17 14:07:11.386121071 +0000 UTC m=+0.345140569,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-36.ec2.internal,}" Sep 17 14:07:11.396033 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.396018 2558 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 17 14:07:11.396075 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.396036 2558 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 17 14:07:11.396188 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:11.396171 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-36.ec2.internal\" not found" Sep 17 14:07:11.396736 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.396719 2558 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 17 14:07:11.396736 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.396738 2558 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 17 14:07:11.396881 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.396756 2558 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 17 14:07:11.396881 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.396823 2558 reconstruct.go:97] "Volume reconstruction finished" Sep 17 14:07:11.396881 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.396833 2558 reconciler.go:29] "Reconciler: start to sync state" Sep 17 14:07:11.396881 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.396859 2558 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 17 14:07:11.396881 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.396872 2558 factory.go:55] Registering systemd factory Sep 17 14:07:11.396881 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.396880 2558 factory.go:223] Registration of the systemd container factory successfully Sep 17 14:07:11.397152 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.397139 2558 factory.go:153] Registering CRI-O factory Sep 17 14:07:11.397152 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.397151 2558 factory.go:223] Registration of the crio container factory successfully Sep 17 14:07:11.397217 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.397164 2558 factory.go:103] Registering Raw factory Sep 17 14:07:11.397217 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.397175 2558 manager.go:1196] Started watching for new ooms in manager Sep 17 14:07:11.397564 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.397551 2558 manager.go:349] Starting recovery of all containers Sep 17 14:07:11.406474 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.406454 2558 manager.go:354] Recovery completed Sep 17 14:07:11.408087 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:11.408064 2558 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Sep 17 14:07:11.408184 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:11.408117 2558 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-129-36.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Sep 17 14:07:11.408901 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.408885 2558 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-c8w5b" Sep 17 14:07:11.412610 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.412517 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 14:07:11.414385 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.414369 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-36.ec2.internal" event="NodeHasSufficientMemory" Sep 17 14:07:11.414447 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.414397 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-36.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 14:07:11.414447 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.414407 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-36.ec2.internal" event="NodeHasSufficientPID" Sep 17 14:07:11.415078 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.415063 2558 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 17 14:07:11.415078 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.415077 2558 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 17 14:07:11.415180 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.415094 2558 state_mem.go:36] "Initialized new in-memory state store" Sep 17 14:07:11.415180 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.415093 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 14:07:11.415410 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.415365 2558 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-c8w5b" Sep 17 14:07:11.415857 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.415840 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-36.ec2.internal" event="NodeHasSufficientMemory" Sep 17 14:07:11.415942 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.415866 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-36.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 14:07:11.415942 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.415881 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-36.ec2.internal" event="NodeHasSufficientPID" Sep 17 14:07:11.417285 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.417271 2558 policy_none.go:49] "None policy: Start" Sep 17 14:07:11.417351 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.417291 2558 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 17 14:07:11.417351 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.417304 2558 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 17 14:07:11.419332 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.419318 2558 policy_none.go:47] "Start" Sep 17 14:07:11.442053 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.442036 2558 manager.go:337] "Starting Device Plugin manager" Sep 17 14:07:11.442174 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:11.442078 2558 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 17 14:07:11.442174 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.442090 2558 server.go:87] "Starting device plugin registration server" Sep 17 14:07:11.442420 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.442403 2558 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 17 14:07:11.442535 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.442418 2558 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 17 14:07:11.442685 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.442653 2558 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 17 14:07:11.442834 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.442820 2558 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 17 14:07:11.442834 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.442835 2558 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 17 14:07:11.443196 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:11.443172 2558 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 17 14:07:11.443278 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:11.443221 2558 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-129-36.ec2.internal\" not found" Sep 17 14:07:11.525186 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.525155 2558 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 17 14:07:11.526303 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.526286 2558 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 17 14:07:11.526382 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.526341 2558 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 17 14:07:11.526382 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.526365 2558 kubelet.go:2448] "Starting kubelet main sync loop" Sep 17 14:07:11.526475 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:11.526440 2558 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Sep 17 14:07:11.529013 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.528996 2558 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 17 14:07:11.543185 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.543171 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 14:07:11.543984 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.543967 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-36.ec2.internal" event="NodeHasSufficientMemory" Sep 17 14:07:11.544071 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.543994 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-36.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 14:07:11.544071 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.544005 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-36.ec2.internal" event="NodeHasSufficientPID" Sep 17 14:07:11.544071 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.544024 2558 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-129-36.ec2.internal" Sep 17 14:07:11.552719 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.552704 2558 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-129-36.ec2.internal" Sep 17 14:07:11.552780 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:11.552725 2558 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-129-36.ec2.internal\": node \"ip-10-0-129-36.ec2.internal\" not found" Sep 17 14:07:11.578225 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:11.578163 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-36.ec2.internal\" not found" Sep 17 14:07:11.626715 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.626686 2558 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-36.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-129-36.ec2.internal"] Sep 17 14:07:11.626842 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.626755 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 14:07:11.628359 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.628339 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-36.ec2.internal" event="NodeHasSufficientMemory" Sep 17 14:07:11.628454 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.628367 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-36.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 14:07:11.628454 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.628379 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-36.ec2.internal" event="NodeHasSufficientPID" Sep 17 14:07:11.630685 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.630672 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 14:07:11.630790 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.630777 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-36.ec2.internal" Sep 17 14:07:11.630835 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.630807 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 14:07:11.631412 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.631390 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-36.ec2.internal" event="NodeHasSufficientMemory" Sep 17 14:07:11.631412 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.631396 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-36.ec2.internal" event="NodeHasSufficientMemory" Sep 17 14:07:11.631511 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.631419 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-36.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 14:07:11.631511 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.631431 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-36.ec2.internal" event="NodeHasSufficientPID" Sep 17 14:07:11.631511 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.631486 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-36.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 14:07:11.631511 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.631511 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-36.ec2.internal" event="NodeHasSufficientPID" Sep 17 14:07:11.633614 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.633598 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-36.ec2.internal" Sep 17 14:07:11.633670 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.633630 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 14:07:11.634286 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.634268 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-36.ec2.internal" event="NodeHasSufficientMemory" Sep 17 14:07:11.634365 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.634301 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-36.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 14:07:11.634365 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.634316 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-36.ec2.internal" event="NodeHasSufficientPID" Sep 17 14:07:11.661083 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:11.661065 2558 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-36.ec2.internal\" not found" node="ip-10-0-129-36.ec2.internal" Sep 17 14:07:11.665373 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:11.665359 2558 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-36.ec2.internal\" not found" node="ip-10-0-129-36.ec2.internal" Sep 17 14:07:11.678608 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:11.678589 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-36.ec2.internal\" not found" Sep 17 14:07:11.699301 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.699282 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/67918d56e813f77237d3fada69cdbd8e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-36.ec2.internal\" (UID: \"67918d56e813f77237d3fada69cdbd8e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-36.ec2.internal" Sep 17 14:07:11.699370 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.699304 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/67918d56e813f77237d3fada69cdbd8e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-36.ec2.internal\" (UID: \"67918d56e813f77237d3fada69cdbd8e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-36.ec2.internal" Sep 17 14:07:11.699370 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.699321 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/88a7a62367d3ac850bfa7c5bf5f45309-config\") pod \"kube-apiserver-proxy-ip-10-0-129-36.ec2.internal\" (UID: \"88a7a62367d3ac850bfa7c5bf5f45309\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-36.ec2.internal" Sep 17 14:07:11.779481 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:11.779461 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-36.ec2.internal\" not found" Sep 17 14:07:11.800140 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.800121 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/67918d56e813f77237d3fada69cdbd8e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-36.ec2.internal\" (UID: \"67918d56e813f77237d3fada69cdbd8e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-36.ec2.internal" Sep 17 14:07:11.800199 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.800148 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/67918d56e813f77237d3fada69cdbd8e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-36.ec2.internal\" (UID: \"67918d56e813f77237d3fada69cdbd8e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-36.ec2.internal" Sep 17 14:07:11.800199 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.800168 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/88a7a62367d3ac850bfa7c5bf5f45309-config\") pod \"kube-apiserver-proxy-ip-10-0-129-36.ec2.internal\" (UID: \"88a7a62367d3ac850bfa7c5bf5f45309\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-36.ec2.internal" Sep 17 14:07:11.800264 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.800209 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/88a7a62367d3ac850bfa7c5bf5f45309-config\") pod \"kube-apiserver-proxy-ip-10-0-129-36.ec2.internal\" (UID: \"88a7a62367d3ac850bfa7c5bf5f45309\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-36.ec2.internal" Sep 17 14:07:11.800264 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.800218 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/67918d56e813f77237d3fada69cdbd8e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-36.ec2.internal\" (UID: \"67918d56e813f77237d3fada69cdbd8e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-36.ec2.internal" Sep 17 14:07:11.800264 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.800228 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/67918d56e813f77237d3fada69cdbd8e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-36.ec2.internal\" (UID: \"67918d56e813f77237d3fada69cdbd8e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-36.ec2.internal" Sep 17 14:07:11.880585 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:11.880519 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-36.ec2.internal\" not found" Sep 17 14:07:11.963049 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.963024 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-36.ec2.internal" Sep 17 14:07:11.968516 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:11.968486 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-36.ec2.internal" Sep 17 14:07:11.981410 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:11.981389 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-36.ec2.internal\" not found" Sep 17 14:07:12.081976 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:12.081943 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-36.ec2.internal\" not found" Sep 17 14:07:12.182116 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:12.182018 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-36.ec2.internal\" not found" Sep 17 14:07:12.283647 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:12.283616 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-36.ec2.internal\" not found" Sep 17 14:07:12.328115 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.328094 2558 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 17 14:07:12.334794 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.334775 2558 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 17 14:07:12.334912 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.334894 2558 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 17 14:07:12.334971 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.334947 2558 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 17 14:07:12.375294 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.375270 2558 apiserver.go:52] "Watching apiserver" Sep 17 14:07:12.394479 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.394455 2558 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 17 14:07:12.394832 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.394812 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-8cqcg","kube-system/konnectivity-agent-r9gxb","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4fmh9","openshift-cluster-node-tuning-operator/tuned-j5lc5","openshift-dns/node-resolver-kjm5t","openshift-image-registry/node-ca-wxv7s","openshift-multus/multus-f4grz","openshift-multus/network-metrics-daemon-8qrmx","openshift-network-operator/iptables-alerter-tmm7h","kube-system/global-pull-secret-syncer-9jk57","openshift-multus/multus-additional-cni-plugins-g2rvj","openshift-network-diagnostics/network-check-target-sqr44"] Sep 17 14:07:12.396596 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.396582 2558 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 17 14:07:12.396686 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.396586 2558 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-36.ec2.internal" Sep 17 14:07:12.397611 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.397593 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-8cqcg" Sep 17 14:07:12.400008 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.399990 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-r9gxb" Sep 17 14:07:12.402461 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.402446 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4fmh9" Sep 17 14:07:12.403057 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.403041 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 17 14:07:12.403397 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.403381 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 17 14:07:12.403474 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.403427 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 17 14:07:12.403537 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.403475 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 17 14:07:12.403537 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.403510 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 17 14:07:12.403537 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.403523 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 17 14:07:12.403711 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.403525 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-8z7fs\"" Sep 17 14:07:12.403711 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.403574 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 17 14:07:12.403711 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.403549 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 17 14:07:12.403711 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.403639 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-qlcx8\"" Sep 17 14:07:12.403851 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.403827 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2dccbfdd-669a-4df0-b6f4-dbff79453c09-run-systemd\") pod \"ovnkube-node-8cqcg\" (UID: \"2dccbfdd-669a-4df0-b6f4-dbff79453c09\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cqcg" Sep 17 14:07:12.403851 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.403848 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2dccbfdd-669a-4df0-b6f4-dbff79453c09-log-socket\") pod \"ovnkube-node-8cqcg\" (UID: \"2dccbfdd-669a-4df0-b6f4-dbff79453c09\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cqcg" Sep 17 14:07:12.403915 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.403864 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2dccbfdd-669a-4df0-b6f4-dbff79453c09-ovn-node-metrics-cert\") pod \"ovnkube-node-8cqcg\" (UID: \"2dccbfdd-669a-4df0-b6f4-dbff79453c09\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cqcg" Sep 17 14:07:12.403915 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.403881 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2dccbfdd-669a-4df0-b6f4-dbff79453c09-ovnkube-script-lib\") pod \"ovnkube-node-8cqcg\" (UID: \"2dccbfdd-669a-4df0-b6f4-dbff79453c09\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cqcg" Sep 17 14:07:12.403974 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.403917 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2dccbfdd-669a-4df0-b6f4-dbff79453c09-systemd-units\") pod \"ovnkube-node-8cqcg\" (UID: \"2dccbfdd-669a-4df0-b6f4-dbff79453c09\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cqcg" Sep 17 14:07:12.403974 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.403938 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2dccbfdd-669a-4df0-b6f4-dbff79453c09-run-openvswitch\") pod \"ovnkube-node-8cqcg\" (UID: \"2dccbfdd-669a-4df0-b6f4-dbff79453c09\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cqcg" Sep 17 14:07:12.403974 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.403967 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2dccbfdd-669a-4df0-b6f4-dbff79453c09-run-ovn\") pod \"ovnkube-node-8cqcg\" (UID: \"2dccbfdd-669a-4df0-b6f4-dbff79453c09\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cqcg" Sep 17 14:07:12.404065 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.403993 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2dccbfdd-669a-4df0-b6f4-dbff79453c09-host-run-ovn-kubernetes\") pod \"ovnkube-node-8cqcg\" (UID: \"2dccbfdd-669a-4df0-b6f4-dbff79453c09\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cqcg" Sep 17 14:07:12.404065 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.404016 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2dccbfdd-669a-4df0-b6f4-dbff79453c09-host-cni-bin\") pod \"ovnkube-node-8cqcg\" (UID: \"2dccbfdd-669a-4df0-b6f4-dbff79453c09\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cqcg" Sep 17 14:07:12.404065 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.404033 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2dccbfdd-669a-4df0-b6f4-dbff79453c09-host-cni-netd\") pod \"ovnkube-node-8cqcg\" (UID: \"2dccbfdd-669a-4df0-b6f4-dbff79453c09\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cqcg" Sep 17 14:07:12.404065 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.404047 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2dccbfdd-669a-4df0-b6f4-dbff79453c09-var-lib-openvswitch\") pod \"ovnkube-node-8cqcg\" (UID: \"2dccbfdd-669a-4df0-b6f4-dbff79453c09\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cqcg" Sep 17 14:07:12.404065 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.404064 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2dccbfdd-669a-4df0-b6f4-dbff79453c09-etc-openvswitch\") pod \"ovnkube-node-8cqcg\" (UID: \"2dccbfdd-669a-4df0-b6f4-dbff79453c09\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cqcg" Sep 17 14:07:12.404258 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.404085 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2dccbfdd-669a-4df0-b6f4-dbff79453c09-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8cqcg\" (UID: \"2dccbfdd-669a-4df0-b6f4-dbff79453c09\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cqcg" Sep 17 14:07:12.404258 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.404108 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2dccbfdd-669a-4df0-b6f4-dbff79453c09-host-kubelet\") pod \"ovnkube-node-8cqcg\" (UID: \"2dccbfdd-669a-4df0-b6f4-dbff79453c09\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cqcg" Sep 17 14:07:12.404258 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.404122 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2dccbfdd-669a-4df0-b6f4-dbff79453c09-host-slash\") pod \"ovnkube-node-8cqcg\" (UID: \"2dccbfdd-669a-4df0-b6f4-dbff79453c09\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cqcg" Sep 17 14:07:12.404258 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.404146 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2dccbfdd-669a-4df0-b6f4-dbff79453c09-node-log\") pod \"ovnkube-node-8cqcg\" (UID: \"2dccbfdd-669a-4df0-b6f4-dbff79453c09\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cqcg" Sep 17 14:07:12.404258 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.404192 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2dccbfdd-669a-4df0-b6f4-dbff79453c09-ovnkube-config\") pod \"ovnkube-node-8cqcg\" (UID: \"2dccbfdd-669a-4df0-b6f4-dbff79453c09\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cqcg" Sep 17 14:07:12.404258 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.404218 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2dccbfdd-669a-4df0-b6f4-dbff79453c09-env-overrides\") pod \"ovnkube-node-8cqcg\" (UID: \"2dccbfdd-669a-4df0-b6f4-dbff79453c09\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cqcg" Sep 17 14:07:12.404258 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.404235 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vzslj\" (UniqueName: \"kubernetes.io/projected/2dccbfdd-669a-4df0-b6f4-dbff79453c09-kube-api-access-vzslj\") pod \"ovnkube-node-8cqcg\" (UID: \"2dccbfdd-669a-4df0-b6f4-dbff79453c09\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cqcg" Sep 17 14:07:12.404496 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.404261 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2dccbfdd-669a-4df0-b6f4-dbff79453c09-host-run-netns\") pod \"ovnkube-node-8cqcg\" (UID: \"2dccbfdd-669a-4df0-b6f4-dbff79453c09\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cqcg" Sep 17 14:07:12.404958 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.404939 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-j5lc5" Sep 17 14:07:12.405309 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.405294 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 17 14:07:12.405388 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.405375 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 17 14:07:12.406620 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.406605 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-zvxtf\"" Sep 17 14:07:12.407225 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.407210 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-xhv8j\"" Sep 17 14:07:12.407296 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.407227 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 17 14:07:12.407359 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.407292 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-kjm5t" Sep 17 14:07:12.407430 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.407214 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 17 14:07:12.407537 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.407496 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 17 14:07:12.409709 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.409687 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 17 14:07:12.409806 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.409779 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 17 14:07:12.409966 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.409946 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wxv7s" Sep 17 14:07:12.410248 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.410226 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-g5dgm\"" Sep 17 14:07:12.412207 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.412191 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-f4grz" Sep 17 14:07:12.414465 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.414450 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8qrmx" Sep 17 14:07:12.414537 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:12.414520 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8qrmx" podUID="345f5575-9f8c-486b-9d57-7570a932d5a4" Sep 17 14:07:12.414851 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.414829 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 17 14:07:12.414917 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.414861 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 17 14:07:12.415037 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.415024 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 17 14:07:12.415118 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.415100 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-qscjr\"" Sep 17 14:07:12.417545 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.417525 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-tmm7h" Sep 17 14:07:12.420808 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.420790 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9jk57" Sep 17 14:07:12.420895 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:12.420859 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9jk57" podUID="78551199-0cec-4921-b8a1-0858742751f4" Sep 17 14:07:12.420946 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.420891 2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-16 14:02:11 +0000 UTC" deadline="2028-04-19 12:52:52.818098737 +0000 UTC" Sep 17 14:07:12.420946 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.420906 2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13918h45m40.397194956s" Sep 17 14:07:12.421865 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.421843 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 17 14:07:12.422014 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.421999 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 17 14:07:12.422124 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.422111 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 17 14:07:12.425068 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.423176 2558 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 17 14:07:12.425068 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.423216 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 17 14:07:12.425068 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.423242 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 17 14:07:12.425068 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.423438 2558 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-36.ec2.internal" Sep 17 14:07:12.425068 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.423176 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 17 14:07:12.425068 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.423765 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 17 14:07:12.425068 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.423860 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-c5nvl\"" Sep 17 14:07:12.425068 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.424744 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-g2rvj" Sep 17 14:07:12.425860 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.425770 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-ln7c6\"" Sep 17 14:07:12.429402 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.429383 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 17 14:07:12.429745 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.429556 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-kjxsq\"" Sep 17 14:07:12.429745 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.429638 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 17 14:07:12.430510 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.430370 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-36.ec2.internal"] Sep 17 14:07:12.430510 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.430482 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sqr44" Sep 17 14:07:12.430633 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:12.430573 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sqr44" podUID="b4cde3bb-db2e-4afd-b878-1ff65574484c" Sep 17 14:07:12.433728 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.433688 2558 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 17 14:07:12.438735 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.438718 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-129-36.ec2.internal"] Sep 17 14:07:12.440969 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.440953 2558 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 17 14:07:12.483564 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.483545 2558 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-9j95s" Sep 17 14:07:12.493796 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.493775 2558 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-9j95s" Sep 17 14:07:12.498328 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.498305 2558 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 17 14:07:12.505480 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.505457 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2dccbfdd-669a-4df0-b6f4-dbff79453c09-env-overrides\") pod \"ovnkube-node-8cqcg\" (UID: \"2dccbfdd-669a-4df0-b6f4-dbff79453c09\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cqcg" Sep 17 14:07:12.505600 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.505487 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/438ea2f7-067a-441e-b529-ec696ecd3152-host-slash\") pod \"iptables-alerter-tmm7h\" (UID: \"438ea2f7-067a-441e-b529-ec696ecd3152\") " pod="openshift-network-operator/iptables-alerter-tmm7h" Sep 17 14:07:12.505600 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.505507 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/04e96b35-1239-43a4-92fb-ade601f5358e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-g2rvj\" (UID: \"04e96b35-1239-43a4-92fb-ade601f5358e\") " pod="openshift-multus/multus-additional-cni-plugins-g2rvj" Sep 17 14:07:12.505600 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.505537 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gxdds\" (UniqueName: \"kubernetes.io/projected/04e96b35-1239-43a4-92fb-ade601f5358e-kube-api-access-gxdds\") pod \"multus-additional-cni-plugins-g2rvj\" (UID: \"04e96b35-1239-43a4-92fb-ade601f5358e\") " pod="openshift-multus/multus-additional-cni-plugins-g2rvj" Sep 17 14:07:12.505600 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.505554 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dg8lf\" (UniqueName: \"kubernetes.io/projected/4ea05435-876e-4840-bc47-88b919b7a5a9-kube-api-access-dg8lf\") pod \"aws-ebs-csi-driver-node-4fmh9\" (UID: \"4ea05435-876e-4840-bc47-88b919b7a5a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4fmh9" Sep 17 14:07:12.505600 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.505572 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g46l9\" (UniqueName: \"kubernetes.io/projected/438ea2f7-067a-441e-b529-ec696ecd3152-kube-api-access-g46l9\") pod \"iptables-alerter-tmm7h\" (UID: \"438ea2f7-067a-441e-b529-ec696ecd3152\") " pod="openshift-network-operator/iptables-alerter-tmm7h" Sep 17 14:07:12.505600 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.505598 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/04e96b35-1239-43a4-92fb-ade601f5358e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-g2rvj\" (UID: \"04e96b35-1239-43a4-92fb-ade601f5358e\") " pod="openshift-multus/multus-additional-cni-plugins-g2rvj" Sep 17 14:07:12.505928 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.505623 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/78551199-0cec-4921-b8a1-0858742751f4-kubelet-config\") pod \"global-pull-secret-syncer-9jk57\" (UID: \"78551199-0cec-4921-b8a1-0858742751f4\") " pod="kube-system/global-pull-secret-syncer-9jk57" Sep 17 14:07:12.505928 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.505666 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e25776cb-8927-43ec-9e09-911616fb8dfe-host\") pod \"tuned-j5lc5\" (UID: \"e25776cb-8927-43ec-9e09-911616fb8dfe\") " pod="openshift-cluster-node-tuning-operator/tuned-j5lc5" Sep 17 14:07:12.505928 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.505692 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/90708755-5dda-47a7-8c9d-aab17778d946-multus-cni-dir\") pod \"multus-f4grz\" (UID: \"90708755-5dda-47a7-8c9d-aab17778d946\") " pod="openshift-multus/multus-f4grz" Sep 17 14:07:12.505928 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.505710 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c6tr8\" (UniqueName: \"kubernetes.io/projected/90708755-5dda-47a7-8c9d-aab17778d946-kube-api-access-c6tr8\") pod \"multus-f4grz\" (UID: \"90708755-5dda-47a7-8c9d-aab17778d946\") " pod="openshift-multus/multus-f4grz" Sep 17 14:07:12.505928 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.505729 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2dccbfdd-669a-4df0-b6f4-dbff79453c09-run-openvswitch\") pod \"ovnkube-node-8cqcg\" (UID: \"2dccbfdd-669a-4df0-b6f4-dbff79453c09\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cqcg" Sep 17 14:07:12.505928 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.505760 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/345f5575-9f8c-486b-9d57-7570a932d5a4-metrics-certs\") pod \"network-metrics-daemon-8qrmx\" (UID: \"345f5575-9f8c-486b-9d57-7570a932d5a4\") " pod="openshift-multus/network-metrics-daemon-8qrmx" Sep 17 14:07:12.505928 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.505769 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2dccbfdd-669a-4df0-b6f4-dbff79453c09-run-openvswitch\") pod \"ovnkube-node-8cqcg\" (UID: \"2dccbfdd-669a-4df0-b6f4-dbff79453c09\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cqcg" Sep 17 14:07:12.505928 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.505788 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e25776cb-8927-43ec-9e09-911616fb8dfe-etc-systemd\") pod \"tuned-j5lc5\" (UID: \"e25776cb-8927-43ec-9e09-911616fb8dfe\") " pod="openshift-cluster-node-tuning-operator/tuned-j5lc5" Sep 17 14:07:12.505928 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.505817 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/04e96b35-1239-43a4-92fb-ade601f5358e-cni-binary-copy\") pod \"multus-additional-cni-plugins-g2rvj\" (UID: \"04e96b35-1239-43a4-92fb-ade601f5358e\") " pod="openshift-multus/multus-additional-cni-plugins-g2rvj" Sep 17 14:07:12.505928 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.505839 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4ea05435-876e-4840-bc47-88b919b7a5a9-sys-fs\") pod \"aws-ebs-csi-driver-node-4fmh9\" (UID: \"4ea05435-876e-4840-bc47-88b919b7a5a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4fmh9" Sep 17 14:07:12.505928 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.505854 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/29942cdd-392c-45cc-94ad-e0e570e04856-serviceca\") pod \"node-ca-wxv7s\" (UID: \"29942cdd-392c-45cc-94ad-e0e570e04856\") " pod="openshift-image-registry/node-ca-wxv7s" Sep 17 14:07:12.505928 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.505870 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/90708755-5dda-47a7-8c9d-aab17778d946-host-run-netns\") pod \"multus-f4grz\" (UID: \"90708755-5dda-47a7-8c9d-aab17778d946\") " pod="openshift-multus/multus-f4grz" Sep 17 14:07:12.505928 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.505889 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2dccbfdd-669a-4df0-b6f4-dbff79453c09-host-slash\") pod \"ovnkube-node-8cqcg\" (UID: \"2dccbfdd-669a-4df0-b6f4-dbff79453c09\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cqcg" Sep 17 14:07:12.505928 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.505913 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2dccbfdd-669a-4df0-b6f4-dbff79453c09-ovnkube-config\") pod \"ovnkube-node-8cqcg\" (UID: \"2dccbfdd-669a-4df0-b6f4-dbff79453c09\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cqcg" Sep 17 14:07:12.505928 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.505928 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4ea05435-876e-4840-bc47-88b919b7a5a9-etc-selinux\") pod \"aws-ebs-csi-driver-node-4fmh9\" (UID: \"4ea05435-876e-4840-bc47-88b919b7a5a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4fmh9" Sep 17 14:07:12.506723 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.505944 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0f675bf6-8f81-470f-b259-a9b21ddf230f-hosts-file\") pod \"node-resolver-kjm5t\" (UID: \"0f675bf6-8f81-470f-b259-a9b21ddf230f\") " pod="openshift-dns/node-resolver-kjm5t" Sep 17 14:07:12.506723 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.505959 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/90708755-5dda-47a7-8c9d-aab17778d946-multus-socket-dir-parent\") pod \"multus-f4grz\" (UID: \"90708755-5dda-47a7-8c9d-aab17778d946\") " pod="openshift-multus/multus-f4grz" Sep 17 14:07:12.506723 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.505975 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2dccbfdd-669a-4df0-b6f4-dbff79453c09-host-run-netns\") pod \"ovnkube-node-8cqcg\" (UID: \"2dccbfdd-669a-4df0-b6f4-dbff79453c09\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cqcg" Sep 17 14:07:12.506723 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.506013 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e25776cb-8927-43ec-9e09-911616fb8dfe-etc-sysctl-conf\") pod \"tuned-j5lc5\" (UID: \"e25776cb-8927-43ec-9e09-911616fb8dfe\") " pod="openshift-cluster-node-tuning-operator/tuned-j5lc5" Sep 17 14:07:12.506723 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.506037 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2dccbfdd-669a-4df0-b6f4-dbff79453c09-env-overrides\") pod \"ovnkube-node-8cqcg\" (UID: \"2dccbfdd-669a-4df0-b6f4-dbff79453c09\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cqcg" Sep 17 14:07:12.506723 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.506043 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2dccbfdd-669a-4df0-b6f4-dbff79453c09-host-slash\") pod \"ovnkube-node-8cqcg\" (UID: \"2dccbfdd-669a-4df0-b6f4-dbff79453c09\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cqcg" Sep 17 14:07:12.506723 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.506046 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2dccbfdd-669a-4df0-b6f4-dbff79453c09-systemd-units\") pod \"ovnkube-node-8cqcg\" (UID: \"2dccbfdd-669a-4df0-b6f4-dbff79453c09\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cqcg" Sep 17 14:07:12.506723 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.506046 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2dccbfdd-669a-4df0-b6f4-dbff79453c09-host-run-netns\") pod \"ovnkube-node-8cqcg\" (UID: \"2dccbfdd-669a-4df0-b6f4-dbff79453c09\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cqcg" Sep 17 14:07:12.506723 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.506092 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2dccbfdd-669a-4df0-b6f4-dbff79453c09-run-ovn\") pod \"ovnkube-node-8cqcg\" (UID: \"2dccbfdd-669a-4df0-b6f4-dbff79453c09\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cqcg" Sep 17 14:07:12.506723 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.506097 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2dccbfdd-669a-4df0-b6f4-dbff79453c09-systemd-units\") pod \"ovnkube-node-8cqcg\" (UID: \"2dccbfdd-669a-4df0-b6f4-dbff79453c09\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cqcg" Sep 17 14:07:12.506723 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.506126 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/78551199-0cec-4921-b8a1-0858742751f4-original-pull-secret\") pod \"global-pull-secret-syncer-9jk57\" (UID: \"78551199-0cec-4921-b8a1-0858742751f4\") " pod="kube-system/global-pull-secret-syncer-9jk57" Sep 17 14:07:12.506723 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.506155 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/90708755-5dda-47a7-8c9d-aab17778d946-host-var-lib-cni-bin\") pod \"multus-f4grz\" (UID: \"90708755-5dda-47a7-8c9d-aab17778d946\") " pod="openshift-multus/multus-f4grz" Sep 17 14:07:12.506723 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.506132 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2dccbfdd-669a-4df0-b6f4-dbff79453c09-run-ovn\") pod \"ovnkube-node-8cqcg\" (UID: \"2dccbfdd-669a-4df0-b6f4-dbff79453c09\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cqcg" Sep 17 14:07:12.506723 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.506187 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/90708755-5dda-47a7-8c9d-aab17778d946-etc-kubernetes\") pod \"multus-f4grz\" (UID: \"90708755-5dda-47a7-8c9d-aab17778d946\") " pod="openshift-multus/multus-f4grz" Sep 17 14:07:12.506723 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.506209 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e25776cb-8927-43ec-9e09-911616fb8dfe-etc-sysctl-d\") pod \"tuned-j5lc5\" (UID: \"e25776cb-8927-43ec-9e09-911616fb8dfe\") " pod="openshift-cluster-node-tuning-operator/tuned-j5lc5" Sep 17 14:07:12.506723 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.506236 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2dccbfdd-669a-4df0-b6f4-dbff79453c09-var-lib-openvswitch\") pod \"ovnkube-node-8cqcg\" (UID: \"2dccbfdd-669a-4df0-b6f4-dbff79453c09\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cqcg" Sep 17 14:07:12.506723 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.506269 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2dccbfdd-669a-4df0-b6f4-dbff79453c09-var-lib-openvswitch\") pod \"ovnkube-node-8cqcg\" (UID: \"2dccbfdd-669a-4df0-b6f4-dbff79453c09\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cqcg" Sep 17 14:07:12.507602 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.506289 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2dccbfdd-669a-4df0-b6f4-dbff79453c09-etc-openvswitch\") pod \"ovnkube-node-8cqcg\" (UID: \"2dccbfdd-669a-4df0-b6f4-dbff79453c09\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cqcg" Sep 17 14:07:12.507602 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.506312 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4ea05435-876e-4840-bc47-88b919b7a5a9-device-dir\") pod \"aws-ebs-csi-driver-node-4fmh9\" (UID: \"4ea05435-876e-4840-bc47-88b919b7a5a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4fmh9" Sep 17 14:07:12.507602 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.506330 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dh5vw\" (UniqueName: \"kubernetes.io/projected/345f5575-9f8c-486b-9d57-7570a932d5a4-kube-api-access-dh5vw\") pod \"network-metrics-daemon-8qrmx\" (UID: \"345f5575-9f8c-486b-9d57-7570a932d5a4\") " pod="openshift-multus/network-metrics-daemon-8qrmx" Sep 17 14:07:12.507602 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.506313 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2dccbfdd-669a-4df0-b6f4-dbff79453c09-etc-openvswitch\") pod \"ovnkube-node-8cqcg\" (UID: \"2dccbfdd-669a-4df0-b6f4-dbff79453c09\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cqcg" Sep 17 14:07:12.507602 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.506346 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ad60e34b-b278-428d-bedc-005487e24b27-konnectivity-ca\") pod \"konnectivity-agent-r9gxb\" (UID: \"ad60e34b-b278-428d-bedc-005487e24b27\") " pod="kube-system/konnectivity-agent-r9gxb" Sep 17 14:07:12.507602 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.506362 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e25776cb-8927-43ec-9e09-911616fb8dfe-etc-sysconfig\") pod \"tuned-j5lc5\" (UID: \"e25776cb-8927-43ec-9e09-911616fb8dfe\") " pod="openshift-cluster-node-tuning-operator/tuned-j5lc5" Sep 17 14:07:12.507602 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.506368 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2dccbfdd-669a-4df0-b6f4-dbff79453c09-ovnkube-config\") pod \"ovnkube-node-8cqcg\" (UID: \"2dccbfdd-669a-4df0-b6f4-dbff79453c09\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cqcg" Sep 17 14:07:12.507602 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.506379 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e25776cb-8927-43ec-9e09-911616fb8dfe-etc-tuned\") pod \"tuned-j5lc5\" (UID: \"e25776cb-8927-43ec-9e09-911616fb8dfe\") " pod="openshift-cluster-node-tuning-operator/tuned-j5lc5" Sep 17 14:07:12.507602 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.506401 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2dccbfdd-669a-4df0-b6f4-dbff79453c09-host-kubelet\") pod \"ovnkube-node-8cqcg\" (UID: \"2dccbfdd-669a-4df0-b6f4-dbff79453c09\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cqcg" Sep 17 14:07:12.507602 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.506417 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/29942cdd-392c-45cc-94ad-e0e570e04856-host\") pod \"node-ca-wxv7s\" (UID: \"29942cdd-392c-45cc-94ad-e0e570e04856\") " pod="openshift-image-registry/node-ca-wxv7s" Sep 17 14:07:12.507602 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.506454 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/90708755-5dda-47a7-8c9d-aab17778d946-cni-binary-copy\") pod \"multus-f4grz\" (UID: \"90708755-5dda-47a7-8c9d-aab17778d946\") " pod="openshift-multus/multus-f4grz" Sep 17 14:07:12.507602 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.506465 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2dccbfdd-669a-4df0-b6f4-dbff79453c09-host-kubelet\") pod \"ovnkube-node-8cqcg\" (UID: \"2dccbfdd-669a-4df0-b6f4-dbff79453c09\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cqcg" Sep 17 14:07:12.507602 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.506484 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2dccbfdd-669a-4df0-b6f4-dbff79453c09-run-systemd\") pod \"ovnkube-node-8cqcg\" (UID: \"2dccbfdd-669a-4df0-b6f4-dbff79453c09\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cqcg" Sep 17 14:07:12.507602 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.506503 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2dccbfdd-669a-4df0-b6f4-dbff79453c09-ovn-node-metrics-cert\") pod \"ovnkube-node-8cqcg\" (UID: \"2dccbfdd-669a-4df0-b6f4-dbff79453c09\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cqcg" Sep 17 14:07:12.507602 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.506547 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2dccbfdd-669a-4df0-b6f4-dbff79453c09-ovnkube-script-lib\") pod \"ovnkube-node-8cqcg\" (UID: \"2dccbfdd-669a-4df0-b6f4-dbff79453c09\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cqcg" Sep 17 14:07:12.507602 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.506564 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4ea05435-876e-4840-bc47-88b919b7a5a9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4fmh9\" (UID: \"4ea05435-876e-4840-bc47-88b919b7a5a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4fmh9" Sep 17 14:07:12.507602 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.506587 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4ea05435-876e-4840-bc47-88b919b7a5a9-socket-dir\") pod \"aws-ebs-csi-driver-node-4fmh9\" (UID: \"4ea05435-876e-4840-bc47-88b919b7a5a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4fmh9" Sep 17 14:07:12.508434 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.506610 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vqsk7\" (UniqueName: \"kubernetes.io/projected/b4cde3bb-db2e-4afd-b878-1ff65574484c-kube-api-access-vqsk7\") pod \"network-check-target-sqr44\" (UID: \"b4cde3bb-db2e-4afd-b878-1ff65574484c\") " pod="openshift-network-diagnostics/network-check-target-sqr44" Sep 17 14:07:12.508434 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.506624 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2dccbfdd-669a-4df0-b6f4-dbff79453c09-run-systemd\") pod \"ovnkube-node-8cqcg\" (UID: \"2dccbfdd-669a-4df0-b6f4-dbff79453c09\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cqcg" Sep 17 14:07:12.508434 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.506631 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e25776cb-8927-43ec-9e09-911616fb8dfe-sys\") pod \"tuned-j5lc5\" (UID: \"e25776cb-8927-43ec-9e09-911616fb8dfe\") " pod="openshift-cluster-node-tuning-operator/tuned-j5lc5" Sep 17 14:07:12.508434 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.506732 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e25776cb-8927-43ec-9e09-911616fb8dfe-lib-modules\") pod \"tuned-j5lc5\" (UID: \"e25776cb-8927-43ec-9e09-911616fb8dfe\") " pod="openshift-cluster-node-tuning-operator/tuned-j5lc5" Sep 17 14:07:12.508434 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.506766 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2dccbfdd-669a-4df0-b6f4-dbff79453c09-host-run-ovn-kubernetes\") pod \"ovnkube-node-8cqcg\" (UID: \"2dccbfdd-669a-4df0-b6f4-dbff79453c09\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cqcg" Sep 17 14:07:12.508434 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.506797 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2dccbfdd-669a-4df0-b6f4-dbff79453c09-host-run-ovn-kubernetes\") pod \"ovnkube-node-8cqcg\" (UID: \"2dccbfdd-669a-4df0-b6f4-dbff79453c09\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cqcg" Sep 17 14:07:12.508434 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.506819 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2dccbfdd-669a-4df0-b6f4-dbff79453c09-host-cni-netd\") pod \"ovnkube-node-8cqcg\" (UID: \"2dccbfdd-669a-4df0-b6f4-dbff79453c09\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cqcg" Sep 17 14:07:12.508434 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.506854 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4ea05435-876e-4840-bc47-88b919b7a5a9-registration-dir\") pod \"aws-ebs-csi-driver-node-4fmh9\" (UID: \"4ea05435-876e-4840-bc47-88b919b7a5a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4fmh9" Sep 17 14:07:12.508434 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.506880 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/78551199-0cec-4921-b8a1-0858742751f4-dbus\") pod \"global-pull-secret-syncer-9jk57\" (UID: \"78551199-0cec-4921-b8a1-0858742751f4\") " pod="kube-system/global-pull-secret-syncer-9jk57" Sep 17 14:07:12.508434 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.506888 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2dccbfdd-669a-4df0-b6f4-dbff79453c09-host-cni-netd\") pod \"ovnkube-node-8cqcg\" (UID: \"2dccbfdd-669a-4df0-b6f4-dbff79453c09\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cqcg" Sep 17 14:07:12.508434 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.506903 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e25776cb-8927-43ec-9e09-911616fb8dfe-tmp\") pod \"tuned-j5lc5\" (UID: \"e25776cb-8927-43ec-9e09-911616fb8dfe\") " pod="openshift-cluster-node-tuning-operator/tuned-j5lc5" Sep 17 14:07:12.508434 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.506947 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/90708755-5dda-47a7-8c9d-aab17778d946-system-cni-dir\") pod \"multus-f4grz\" (UID: \"90708755-5dda-47a7-8c9d-aab17778d946\") " pod="openshift-multus/multus-f4grz" Sep 17 14:07:12.508434 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.506984 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/90708755-5dda-47a7-8c9d-aab17778d946-host-run-k8s-cni-cncf-io\") pod \"multus-f4grz\" (UID: \"90708755-5dda-47a7-8c9d-aab17778d946\") " pod="openshift-multus/multus-f4grz" Sep 17 14:07:12.508434 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.507008 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/90708755-5dda-47a7-8c9d-aab17778d946-host-var-lib-cni-multus\") pod \"multus-f4grz\" (UID: \"90708755-5dda-47a7-8c9d-aab17778d946\") " pod="openshift-multus/multus-f4grz" Sep 17 14:07:12.508434 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.507024 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/04e96b35-1239-43a4-92fb-ade601f5358e-cnibin\") pod \"multus-additional-cni-plugins-g2rvj\" (UID: \"04e96b35-1239-43a4-92fb-ade601f5358e\") " pod="openshift-multus/multus-additional-cni-plugins-g2rvj" Sep 17 14:07:12.508434 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.507030 2558 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 17 14:07:12.508434 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.507045 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e25776cb-8927-43ec-9e09-911616fb8dfe-var-lib-kubelet\") pod \"tuned-j5lc5\" (UID: \"e25776cb-8927-43ec-9e09-911616fb8dfe\") " pod="openshift-cluster-node-tuning-operator/tuned-j5lc5" Sep 17 14:07:12.509256 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.507066 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/90708755-5dda-47a7-8c9d-aab17778d946-host-run-multus-certs\") pod \"multus-f4grz\" (UID: \"90708755-5dda-47a7-8c9d-aab17778d946\") " pod="openshift-multus/multus-f4grz" Sep 17 14:07:12.509256 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.507099 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2dccbfdd-669a-4df0-b6f4-dbff79453c09-ovnkube-script-lib\") pod \"ovnkube-node-8cqcg\" (UID: \"2dccbfdd-669a-4df0-b6f4-dbff79453c09\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cqcg" Sep 17 14:07:12.509256 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.507114 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2dccbfdd-669a-4df0-b6f4-dbff79453c09-node-log\") pod \"ovnkube-node-8cqcg\" (UID: \"2dccbfdd-669a-4df0-b6f4-dbff79453c09\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cqcg" Sep 17 14:07:12.509256 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.507147 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vzslj\" (UniqueName: \"kubernetes.io/projected/2dccbfdd-669a-4df0-b6f4-dbff79453c09-kube-api-access-vzslj\") pod \"ovnkube-node-8cqcg\" (UID: \"2dccbfdd-669a-4df0-b6f4-dbff79453c09\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cqcg" Sep 17 14:07:12.509256 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.507166 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2dccbfdd-669a-4df0-b6f4-dbff79453c09-node-log\") pod \"ovnkube-node-8cqcg\" (UID: \"2dccbfdd-669a-4df0-b6f4-dbff79453c09\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cqcg" Sep 17 14:07:12.509256 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.507179 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/04e96b35-1239-43a4-92fb-ade601f5358e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-g2rvj\" (UID: \"04e96b35-1239-43a4-92fb-ade601f5358e\") " pod="openshift-multus/multus-additional-cni-plugins-g2rvj" Sep 17 14:07:12.509256 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.507200 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e25776cb-8927-43ec-9e09-911616fb8dfe-etc-modprobe-d\") pod \"tuned-j5lc5\" (UID: \"e25776cb-8927-43ec-9e09-911616fb8dfe\") " pod="openshift-cluster-node-tuning-operator/tuned-j5lc5" Sep 17 14:07:12.509256 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.507217 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/90708755-5dda-47a7-8c9d-aab17778d946-host-var-lib-kubelet\") pod \"multus-f4grz\" (UID: \"90708755-5dda-47a7-8c9d-aab17778d946\") " pod="openshift-multus/multus-f4grz" Sep 17 14:07:12.509256 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.507242 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/90708755-5dda-47a7-8c9d-aab17778d946-hostroot\") pod \"multus-f4grz\" (UID: \"90708755-5dda-47a7-8c9d-aab17778d946\") " pod="openshift-multus/multus-f4grz" Sep 17 14:07:12.509256 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.507259 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2dccbfdd-669a-4df0-b6f4-dbff79453c09-log-socket\") pod \"ovnkube-node-8cqcg\" (UID: \"2dccbfdd-669a-4df0-b6f4-dbff79453c09\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cqcg" Sep 17 14:07:12.509256 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.507273 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e25776cb-8927-43ec-9e09-911616fb8dfe-etc-kubernetes\") pod \"tuned-j5lc5\" (UID: \"e25776cb-8927-43ec-9e09-911616fb8dfe\") " pod="openshift-cluster-node-tuning-operator/tuned-j5lc5" Sep 17 14:07:12.509256 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.507296 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xzj7m\" (UniqueName: \"kubernetes.io/projected/29942cdd-392c-45cc-94ad-e0e570e04856-kube-api-access-xzj7m\") pod \"node-ca-wxv7s\" (UID: \"29942cdd-392c-45cc-94ad-e0e570e04856\") " pod="openshift-image-registry/node-ca-wxv7s" Sep 17 14:07:12.509256 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.507324 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2dccbfdd-669a-4df0-b6f4-dbff79453c09-log-socket\") pod \"ovnkube-node-8cqcg\" (UID: \"2dccbfdd-669a-4df0-b6f4-dbff79453c09\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cqcg" Sep 17 14:07:12.509256 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.507323 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/90708755-5dda-47a7-8c9d-aab17778d946-multus-daemon-config\") pod \"multus-f4grz\" (UID: \"90708755-5dda-47a7-8c9d-aab17778d946\") " pod="openshift-multus/multus-f4grz" Sep 17 14:07:12.509256 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.507365 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2dccbfdd-669a-4df0-b6f4-dbff79453c09-host-cni-bin\") pod \"ovnkube-node-8cqcg\" (UID: \"2dccbfdd-669a-4df0-b6f4-dbff79453c09\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cqcg" Sep 17 14:07:12.509256 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.507423 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2dccbfdd-669a-4df0-b6f4-dbff79453c09-host-cni-bin\") pod \"ovnkube-node-8cqcg\" (UID: \"2dccbfdd-669a-4df0-b6f4-dbff79453c09\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cqcg" Sep 17 14:07:12.509256 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.507428 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/04e96b35-1239-43a4-92fb-ade601f5358e-system-cni-dir\") pod \"multus-additional-cni-plugins-g2rvj\" (UID: \"04e96b35-1239-43a4-92fb-ade601f5358e\") " pod="openshift-multus/multus-additional-cni-plugins-g2rvj" Sep 17 14:07:12.510063 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.507467 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0f675bf6-8f81-470f-b259-a9b21ddf230f-tmp-dir\") pod \"node-resolver-kjm5t\" (UID: \"0f675bf6-8f81-470f-b259-a9b21ddf230f\") " pod="openshift-dns/node-resolver-kjm5t" Sep 17 14:07:12.510063 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.507485 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9ckjr\" (UniqueName: \"kubernetes.io/projected/0f675bf6-8f81-470f-b259-a9b21ddf230f-kube-api-access-9ckjr\") pod \"node-resolver-kjm5t\" (UID: \"0f675bf6-8f81-470f-b259-a9b21ddf230f\") " pod="openshift-dns/node-resolver-kjm5t" Sep 17 14:07:12.510063 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.507501 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ad60e34b-b278-428d-bedc-005487e24b27-agent-certs\") pod \"konnectivity-agent-r9gxb\" (UID: \"ad60e34b-b278-428d-bedc-005487e24b27\") " pod="kube-system/konnectivity-agent-r9gxb" Sep 17 14:07:12.510063 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.507548 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e25776cb-8927-43ec-9e09-911616fb8dfe-run\") pod \"tuned-j5lc5\" (UID: \"e25776cb-8927-43ec-9e09-911616fb8dfe\") " pod="openshift-cluster-node-tuning-operator/tuned-j5lc5" Sep 17 14:07:12.510063 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.507589 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2dccbfdd-669a-4df0-b6f4-dbff79453c09-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8cqcg\" (UID: \"2dccbfdd-669a-4df0-b6f4-dbff79453c09\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cqcg" Sep 17 14:07:12.510063 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.507619 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/438ea2f7-067a-441e-b529-ec696ecd3152-iptables-alerter-script\") pod \"iptables-alerter-tmm7h\" (UID: \"438ea2f7-067a-441e-b529-ec696ecd3152\") " pod="openshift-network-operator/iptables-alerter-tmm7h" Sep 17 14:07:12.510063 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.507641 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sz6rh\" (UniqueName: \"kubernetes.io/projected/e25776cb-8927-43ec-9e09-911616fb8dfe-kube-api-access-sz6rh\") pod \"tuned-j5lc5\" (UID: \"e25776cb-8927-43ec-9e09-911616fb8dfe\") " pod="openshift-cluster-node-tuning-operator/tuned-j5lc5" Sep 17 14:07:12.510063 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.507647 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2dccbfdd-669a-4df0-b6f4-dbff79453c09-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8cqcg\" (UID: \"2dccbfdd-669a-4df0-b6f4-dbff79453c09\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cqcg" Sep 17 14:07:12.510063 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.507662 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/90708755-5dda-47a7-8c9d-aab17778d946-cnibin\") pod \"multus-f4grz\" (UID: \"90708755-5dda-47a7-8c9d-aab17778d946\") " pod="openshift-multus/multus-f4grz" Sep 17 14:07:12.510063 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.507696 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/90708755-5dda-47a7-8c9d-aab17778d946-multus-conf-dir\") pod \"multus-f4grz\" (UID: \"90708755-5dda-47a7-8c9d-aab17778d946\") " pod="openshift-multus/multus-f4grz" Sep 17 14:07:12.510476 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.510456 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2dccbfdd-669a-4df0-b6f4-dbff79453c09-ovn-node-metrics-cert\") pod \"ovnkube-node-8cqcg\" (UID: \"2dccbfdd-669a-4df0-b6f4-dbff79453c09\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cqcg" Sep 17 14:07:12.512595 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.512547 2558 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 17 14:07:12.519620 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.519596 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vzslj\" (UniqueName: \"kubernetes.io/projected/2dccbfdd-669a-4df0-b6f4-dbff79453c09-kube-api-access-vzslj\") pod \"ovnkube-node-8cqcg\" (UID: \"2dccbfdd-669a-4df0-b6f4-dbff79453c09\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cqcg" Sep 17 14:07:12.556460 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.556442 2558 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 17 14:07:12.608103 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.608081 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/04e96b35-1239-43a4-92fb-ade601f5358e-system-cni-dir\") pod \"multus-additional-cni-plugins-g2rvj\" (UID: \"04e96b35-1239-43a4-92fb-ade601f5358e\") " pod="openshift-multus/multus-additional-cni-plugins-g2rvj" Sep 17 14:07:12.608208 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.608116 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0f675bf6-8f81-470f-b259-a9b21ddf230f-tmp-dir\") pod \"node-resolver-kjm5t\" (UID: \"0f675bf6-8f81-470f-b259-a9b21ddf230f\") " pod="openshift-dns/node-resolver-kjm5t" Sep 17 14:07:12.608208 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.608135 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9ckjr\" (UniqueName: \"kubernetes.io/projected/0f675bf6-8f81-470f-b259-a9b21ddf230f-kube-api-access-9ckjr\") pod \"node-resolver-kjm5t\" (UID: \"0f675bf6-8f81-470f-b259-a9b21ddf230f\") " pod="openshift-dns/node-resolver-kjm5t" Sep 17 14:07:12.608208 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.608149 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ad60e34b-b278-428d-bedc-005487e24b27-agent-certs\") pod \"konnectivity-agent-r9gxb\" (UID: \"ad60e34b-b278-428d-bedc-005487e24b27\") " pod="kube-system/konnectivity-agent-r9gxb" Sep 17 14:07:12.608208 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.608197 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e25776cb-8927-43ec-9e09-911616fb8dfe-run\") pod \"tuned-j5lc5\" (UID: \"e25776cb-8927-43ec-9e09-911616fb8dfe\") " pod="openshift-cluster-node-tuning-operator/tuned-j5lc5" Sep 17 14:07:12.608441 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.608213 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/438ea2f7-067a-441e-b529-ec696ecd3152-iptables-alerter-script\") pod \"iptables-alerter-tmm7h\" (UID: \"438ea2f7-067a-441e-b529-ec696ecd3152\") " pod="openshift-network-operator/iptables-alerter-tmm7h" Sep 17 14:07:12.608441 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.608231 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sz6rh\" (UniqueName: \"kubernetes.io/projected/e25776cb-8927-43ec-9e09-911616fb8dfe-kube-api-access-sz6rh\") pod \"tuned-j5lc5\" (UID: \"e25776cb-8927-43ec-9e09-911616fb8dfe\") " pod="openshift-cluster-node-tuning-operator/tuned-j5lc5" Sep 17 14:07:12.608441 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.608233 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/04e96b35-1239-43a4-92fb-ade601f5358e-system-cni-dir\") pod \"multus-additional-cni-plugins-g2rvj\" (UID: \"04e96b35-1239-43a4-92fb-ade601f5358e\") " pod="openshift-multus/multus-additional-cni-plugins-g2rvj" Sep 17 14:07:12.608441 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.608248 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/90708755-5dda-47a7-8c9d-aab17778d946-cnibin\") pod \"multus-f4grz\" (UID: \"90708755-5dda-47a7-8c9d-aab17778d946\") " pod="openshift-multus/multus-f4grz" Sep 17 14:07:12.608441 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.608273 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/90708755-5dda-47a7-8c9d-aab17778d946-multus-conf-dir\") pod \"multus-f4grz\" (UID: \"90708755-5dda-47a7-8c9d-aab17778d946\") " pod="openshift-multus/multus-f4grz" Sep 17 14:07:12.608441 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.608299 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/438ea2f7-067a-441e-b529-ec696ecd3152-host-slash\") pod \"iptables-alerter-tmm7h\" (UID: \"438ea2f7-067a-441e-b529-ec696ecd3152\") " pod="openshift-network-operator/iptables-alerter-tmm7h" Sep 17 14:07:12.608441 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.608317 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e25776cb-8927-43ec-9e09-911616fb8dfe-run\") pod \"tuned-j5lc5\" (UID: \"e25776cb-8927-43ec-9e09-911616fb8dfe\") " pod="openshift-cluster-node-tuning-operator/tuned-j5lc5" Sep 17 14:07:12.608441 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.608354 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/90708755-5dda-47a7-8c9d-aab17778d946-cnibin\") pod \"multus-f4grz\" (UID: \"90708755-5dda-47a7-8c9d-aab17778d946\") " pod="openshift-multus/multus-f4grz" Sep 17 14:07:12.608441 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.608359 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/04e96b35-1239-43a4-92fb-ade601f5358e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-g2rvj\" (UID: \"04e96b35-1239-43a4-92fb-ade601f5358e\") " pod="openshift-multus/multus-additional-cni-plugins-g2rvj" Sep 17 14:07:12.608441 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.608395 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/90708755-5dda-47a7-8c9d-aab17778d946-multus-conf-dir\") pod \"multus-f4grz\" (UID: \"90708755-5dda-47a7-8c9d-aab17778d946\") " pod="openshift-multus/multus-f4grz" Sep 17 14:07:12.608441 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.608392 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gxdds\" (UniqueName: \"kubernetes.io/projected/04e96b35-1239-43a4-92fb-ade601f5358e-kube-api-access-gxdds\") pod \"multus-additional-cni-plugins-g2rvj\" (UID: \"04e96b35-1239-43a4-92fb-ade601f5358e\") " pod="openshift-multus/multus-additional-cni-plugins-g2rvj" Sep 17 14:07:12.608441 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.608431 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dg8lf\" (UniqueName: \"kubernetes.io/projected/4ea05435-876e-4840-bc47-88b919b7a5a9-kube-api-access-dg8lf\") pod \"aws-ebs-csi-driver-node-4fmh9\" (UID: \"4ea05435-876e-4840-bc47-88b919b7a5a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4fmh9" Sep 17 14:07:12.608441 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.608443 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0f675bf6-8f81-470f-b259-a9b21ddf230f-tmp-dir\") pod \"node-resolver-kjm5t\" (UID: \"0f675bf6-8f81-470f-b259-a9b21ddf230f\") " pod="openshift-dns/node-resolver-kjm5t" Sep 17 14:07:12.609147 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.608448 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/438ea2f7-067a-441e-b529-ec696ecd3152-host-slash\") pod \"iptables-alerter-tmm7h\" (UID: \"438ea2f7-067a-441e-b529-ec696ecd3152\") " pod="openshift-network-operator/iptables-alerter-tmm7h" Sep 17 14:07:12.609147 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.608461 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g46l9\" (UniqueName: \"kubernetes.io/projected/438ea2f7-067a-441e-b529-ec696ecd3152-kube-api-access-g46l9\") pod \"iptables-alerter-tmm7h\" (UID: \"438ea2f7-067a-441e-b529-ec696ecd3152\") " pod="openshift-network-operator/iptables-alerter-tmm7h" Sep 17 14:07:12.609147 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.608496 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/04e96b35-1239-43a4-92fb-ade601f5358e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-g2rvj\" (UID: \"04e96b35-1239-43a4-92fb-ade601f5358e\") " pod="openshift-multus/multus-additional-cni-plugins-g2rvj" Sep 17 14:07:12.609147 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.608537 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/78551199-0cec-4921-b8a1-0858742751f4-kubelet-config\") pod \"global-pull-secret-syncer-9jk57\" (UID: \"78551199-0cec-4921-b8a1-0858742751f4\") " pod="kube-system/global-pull-secret-syncer-9jk57" Sep 17 14:07:12.609147 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.608566 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e25776cb-8927-43ec-9e09-911616fb8dfe-host\") pod \"tuned-j5lc5\" (UID: \"e25776cb-8927-43ec-9e09-911616fb8dfe\") " pod="openshift-cluster-node-tuning-operator/tuned-j5lc5" Sep 17 14:07:12.609147 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.608593 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/90708755-5dda-47a7-8c9d-aab17778d946-multus-cni-dir\") pod \"multus-f4grz\" (UID: \"90708755-5dda-47a7-8c9d-aab17778d946\") " pod="openshift-multus/multus-f4grz" Sep 17 14:07:12.609147 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.608618 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6tr8\" (UniqueName: \"kubernetes.io/projected/90708755-5dda-47a7-8c9d-aab17778d946-kube-api-access-c6tr8\") pod \"multus-f4grz\" (UID: \"90708755-5dda-47a7-8c9d-aab17778d946\") " pod="openshift-multus/multus-f4grz" Sep 17 14:07:12.609147 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.608643 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/345f5575-9f8c-486b-9d57-7570a932d5a4-metrics-certs\") pod \"network-metrics-daemon-8qrmx\" (UID: \"345f5575-9f8c-486b-9d57-7570a932d5a4\") " pod="openshift-multus/network-metrics-daemon-8qrmx" Sep 17 14:07:12.609147 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.608666 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/04e96b35-1239-43a4-92fb-ade601f5358e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-g2rvj\" (UID: \"04e96b35-1239-43a4-92fb-ade601f5358e\") " pod="openshift-multus/multus-additional-cni-plugins-g2rvj" Sep 17 14:07:12.609147 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.608685 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e25776cb-8927-43ec-9e09-911616fb8dfe-host\") pod \"tuned-j5lc5\" (UID: \"e25776cb-8927-43ec-9e09-911616fb8dfe\") " pod="openshift-cluster-node-tuning-operator/tuned-j5lc5" Sep 17 14:07:12.609147 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.608675 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e25776cb-8927-43ec-9e09-911616fb8dfe-etc-systemd\") pod \"tuned-j5lc5\" (UID: \"e25776cb-8927-43ec-9e09-911616fb8dfe\") " pod="openshift-cluster-node-tuning-operator/tuned-j5lc5" Sep 17 14:07:12.609147 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.608734 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e25776cb-8927-43ec-9e09-911616fb8dfe-etc-systemd\") pod \"tuned-j5lc5\" (UID: \"e25776cb-8927-43ec-9e09-911616fb8dfe\") " pod="openshift-cluster-node-tuning-operator/tuned-j5lc5" Sep 17 14:07:12.609147 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.608738 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/04e96b35-1239-43a4-92fb-ade601f5358e-cni-binary-copy\") pod \"multus-additional-cni-plugins-g2rvj\" (UID: \"04e96b35-1239-43a4-92fb-ade601f5358e\") " pod="openshift-multus/multus-additional-cni-plugins-g2rvj" Sep 17 14:07:12.609147 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.608773 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4ea05435-876e-4840-bc47-88b919b7a5a9-sys-fs\") pod \"aws-ebs-csi-driver-node-4fmh9\" (UID: \"4ea05435-876e-4840-bc47-88b919b7a5a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4fmh9" Sep 17 14:07:12.609147 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.608799 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/78551199-0cec-4921-b8a1-0858742751f4-kubelet-config\") pod \"global-pull-secret-syncer-9jk57\" (UID: \"78551199-0cec-4921-b8a1-0858742751f4\") " pod="kube-system/global-pull-secret-syncer-9jk57" Sep 17 14:07:12.609147 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.608798 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/29942cdd-392c-45cc-94ad-e0e570e04856-serviceca\") pod \"node-ca-wxv7s\" (UID: \"29942cdd-392c-45cc-94ad-e0e570e04856\") " pod="openshift-image-registry/node-ca-wxv7s" Sep 17 14:07:12.609147 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:12.608808 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 14:07:12.609147 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.608832 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/90708755-5dda-47a7-8c9d-aab17778d946-host-run-netns\") pod \"multus-f4grz\" (UID: \"90708755-5dda-47a7-8c9d-aab17778d946\") " pod="openshift-multus/multus-f4grz" Sep 17 14:07:12.610133 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.608853 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4ea05435-876e-4840-bc47-88b919b7a5a9-sys-fs\") pod \"aws-ebs-csi-driver-node-4fmh9\" (UID: \"4ea05435-876e-4840-bc47-88b919b7a5a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4fmh9" Sep 17 14:07:12.610133 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.608861 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4ea05435-876e-4840-bc47-88b919b7a5a9-etc-selinux\") pod \"aws-ebs-csi-driver-node-4fmh9\" (UID: \"4ea05435-876e-4840-bc47-88b919b7a5a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4fmh9" Sep 17 14:07:12.610133 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.608870 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/438ea2f7-067a-441e-b529-ec696ecd3152-iptables-alerter-script\") pod \"iptables-alerter-tmm7h\" (UID: \"438ea2f7-067a-441e-b529-ec696ecd3152\") " pod="openshift-network-operator/iptables-alerter-tmm7h" Sep 17 14:07:12.610133 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:12.608885 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/345f5575-9f8c-486b-9d57-7570a932d5a4-metrics-certs podName:345f5575-9f8c-486b-9d57-7570a932d5a4 nodeName:}" failed. No retries permitted until 2026-09-17 14:07:13.108858564 +0000 UTC m=+2.067878072 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/345f5575-9f8c-486b-9d57-7570a932d5a4-metrics-certs") pod "network-metrics-daemon-8qrmx" (UID: "345f5575-9f8c-486b-9d57-7570a932d5a4") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 14:07:12.610133 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.608928 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/90708755-5dda-47a7-8c9d-aab17778d946-multus-cni-dir\") pod \"multus-f4grz\" (UID: \"90708755-5dda-47a7-8c9d-aab17778d946\") " pod="openshift-multus/multus-f4grz" Sep 17 14:07:12.610133 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.608931 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/90708755-5dda-47a7-8c9d-aab17778d946-host-run-netns\") pod \"multus-f4grz\" (UID: \"90708755-5dda-47a7-8c9d-aab17778d946\") " pod="openshift-multus/multus-f4grz" Sep 17 14:07:12.610133 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.608953 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0f675bf6-8f81-470f-b259-a9b21ddf230f-hosts-file\") pod \"node-resolver-kjm5t\" (UID: \"0f675bf6-8f81-470f-b259-a9b21ddf230f\") " pod="openshift-dns/node-resolver-kjm5t" Sep 17 14:07:12.610133 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.608976 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/04e96b35-1239-43a4-92fb-ade601f5358e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-g2rvj\" (UID: \"04e96b35-1239-43a4-92fb-ade601f5358e\") " pod="openshift-multus/multus-additional-cni-plugins-g2rvj" Sep 17 14:07:12.610133 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.608983 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/90708755-5dda-47a7-8c9d-aab17778d946-multus-socket-dir-parent\") pod \"multus-f4grz\" (UID: \"90708755-5dda-47a7-8c9d-aab17778d946\") " pod="openshift-multus/multus-f4grz" Sep 17 14:07:12.610133 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.609013 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e25776cb-8927-43ec-9e09-911616fb8dfe-etc-sysctl-conf\") pod \"tuned-j5lc5\" (UID: \"e25776cb-8927-43ec-9e09-911616fb8dfe\") " pod="openshift-cluster-node-tuning-operator/tuned-j5lc5" Sep 17 14:07:12.610133 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.609042 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/78551199-0cec-4921-b8a1-0858742751f4-original-pull-secret\") pod \"global-pull-secret-syncer-9jk57\" (UID: \"78551199-0cec-4921-b8a1-0858742751f4\") " pod="kube-system/global-pull-secret-syncer-9jk57" Sep 17 14:07:12.610133 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.609052 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0f675bf6-8f81-470f-b259-a9b21ddf230f-hosts-file\") pod \"node-resolver-kjm5t\" (UID: \"0f675bf6-8f81-470f-b259-a9b21ddf230f\") " pod="openshift-dns/node-resolver-kjm5t" Sep 17 14:07:12.610133 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.609067 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/90708755-5dda-47a7-8c9d-aab17778d946-host-var-lib-cni-bin\") pod \"multus-f4grz\" (UID: \"90708755-5dda-47a7-8c9d-aab17778d946\") " pod="openshift-multus/multus-f4grz" Sep 17 14:07:12.610133 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.609095 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/90708755-5dda-47a7-8c9d-aab17778d946-multus-socket-dir-parent\") pod \"multus-f4grz\" (UID: \"90708755-5dda-47a7-8c9d-aab17778d946\") " pod="openshift-multus/multus-f4grz" Sep 17 14:07:12.610133 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.609115 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/90708755-5dda-47a7-8c9d-aab17778d946-etc-kubernetes\") pod \"multus-f4grz\" (UID: \"90708755-5dda-47a7-8c9d-aab17778d946\") " pod="openshift-multus/multus-f4grz" Sep 17 14:07:12.610133 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.609139 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e25776cb-8927-43ec-9e09-911616fb8dfe-etc-sysctl-d\") pod \"tuned-j5lc5\" (UID: \"e25776cb-8927-43ec-9e09-911616fb8dfe\") " pod="openshift-cluster-node-tuning-operator/tuned-j5lc5" Sep 17 14:07:12.610133 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:12.609156 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 14:07:12.611067 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.609164 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e25776cb-8927-43ec-9e09-911616fb8dfe-etc-sysctl-conf\") pod \"tuned-j5lc5\" (UID: \"e25776cb-8927-43ec-9e09-911616fb8dfe\") " pod="openshift-cluster-node-tuning-operator/tuned-j5lc5" Sep 17 14:07:12.611067 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.609169 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4ea05435-876e-4840-bc47-88b919b7a5a9-device-dir\") pod \"aws-ebs-csi-driver-node-4fmh9\" (UID: \"4ea05435-876e-4840-bc47-88b919b7a5a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4fmh9" Sep 17 14:07:12.611067 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.609193 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/90708755-5dda-47a7-8c9d-aab17778d946-etc-kubernetes\") pod \"multus-f4grz\" (UID: \"90708755-5dda-47a7-8c9d-aab17778d946\") " pod="openshift-multus/multus-f4grz" Sep 17 14:07:12.611067 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.609155 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/90708755-5dda-47a7-8c9d-aab17778d946-host-var-lib-cni-bin\") pod \"multus-f4grz\" (UID: \"90708755-5dda-47a7-8c9d-aab17778d946\") " pod="openshift-multus/multus-f4grz" Sep 17 14:07:12.611067 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.609206 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dh5vw\" (UniqueName: \"kubernetes.io/projected/345f5575-9f8c-486b-9d57-7570a932d5a4-kube-api-access-dh5vw\") pod \"network-metrics-daemon-8qrmx\" (UID: \"345f5575-9f8c-486b-9d57-7570a932d5a4\") " pod="openshift-multus/network-metrics-daemon-8qrmx" Sep 17 14:07:12.611067 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:12.609219 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/78551199-0cec-4921-b8a1-0858742751f4-original-pull-secret podName:78551199-0cec-4921-b8a1-0858742751f4 nodeName:}" failed. No retries permitted until 2026-09-17 14:07:13.109200652 +0000 UTC m=+2.068220159 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/78551199-0cec-4921-b8a1-0858742751f4-original-pull-secret") pod "global-pull-secret-syncer-9jk57" (UID: "78551199-0cec-4921-b8a1-0858742751f4") : object "kube-system"/"original-pull-secret" not registered Sep 17 14:07:12.611067 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.609224 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4ea05435-876e-4840-bc47-88b919b7a5a9-device-dir\") pod \"aws-ebs-csi-driver-node-4fmh9\" (UID: \"4ea05435-876e-4840-bc47-88b919b7a5a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4fmh9" Sep 17 14:07:12.611067 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.609275 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4ea05435-876e-4840-bc47-88b919b7a5a9-etc-selinux\") pod \"aws-ebs-csi-driver-node-4fmh9\" (UID: \"4ea05435-876e-4840-bc47-88b919b7a5a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4fmh9" Sep 17 14:07:12.611067 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.609302 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ad60e34b-b278-428d-bedc-005487e24b27-konnectivity-ca\") pod \"konnectivity-agent-r9gxb\" (UID: \"ad60e34b-b278-428d-bedc-005487e24b27\") " pod="kube-system/konnectivity-agent-r9gxb" Sep 17 14:07:12.611067 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.609328 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e25776cb-8927-43ec-9e09-911616fb8dfe-etc-sysconfig\") pod \"tuned-j5lc5\" (UID: \"e25776cb-8927-43ec-9e09-911616fb8dfe\") " pod="openshift-cluster-node-tuning-operator/tuned-j5lc5" Sep 17 14:07:12.611067 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.609332 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e25776cb-8927-43ec-9e09-911616fb8dfe-etc-sysctl-d\") pod \"tuned-j5lc5\" (UID: \"e25776cb-8927-43ec-9e09-911616fb8dfe\") " pod="openshift-cluster-node-tuning-operator/tuned-j5lc5" Sep 17 14:07:12.611067 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.609343 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/29942cdd-392c-45cc-94ad-e0e570e04856-serviceca\") pod \"node-ca-wxv7s\" (UID: \"29942cdd-392c-45cc-94ad-e0e570e04856\") " pod="openshift-image-registry/node-ca-wxv7s" Sep 17 14:07:12.611067 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.609354 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e25776cb-8927-43ec-9e09-911616fb8dfe-etc-tuned\") pod \"tuned-j5lc5\" (UID: \"e25776cb-8927-43ec-9e09-911616fb8dfe\") " pod="openshift-cluster-node-tuning-operator/tuned-j5lc5" Sep 17 14:07:12.611067 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.609354 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/04e96b35-1239-43a4-92fb-ade601f5358e-cni-binary-copy\") pod \"multus-additional-cni-plugins-g2rvj\" (UID: \"04e96b35-1239-43a4-92fb-ade601f5358e\") " pod="openshift-multus/multus-additional-cni-plugins-g2rvj" Sep 17 14:07:12.611067 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.609408 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e25776cb-8927-43ec-9e09-911616fb8dfe-etc-sysconfig\") pod \"tuned-j5lc5\" (UID: \"e25776cb-8927-43ec-9e09-911616fb8dfe\") " pod="openshift-cluster-node-tuning-operator/tuned-j5lc5" Sep 17 14:07:12.611067 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.609401 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/29942cdd-392c-45cc-94ad-e0e570e04856-host\") pod \"node-ca-wxv7s\" (UID: \"29942cdd-392c-45cc-94ad-e0e570e04856\") " pod="openshift-image-registry/node-ca-wxv7s" Sep 17 14:07:12.611067 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.609453 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/29942cdd-392c-45cc-94ad-e0e570e04856-host\") pod \"node-ca-wxv7s\" (UID: \"29942cdd-392c-45cc-94ad-e0e570e04856\") " pod="openshift-image-registry/node-ca-wxv7s" Sep 17 14:07:12.612006 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.609460 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/90708755-5dda-47a7-8c9d-aab17778d946-cni-binary-copy\") pod \"multus-f4grz\" (UID: \"90708755-5dda-47a7-8c9d-aab17778d946\") " pod="openshift-multus/multus-f4grz" Sep 17 14:07:12.612006 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.609497 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4ea05435-876e-4840-bc47-88b919b7a5a9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4fmh9\" (UID: \"4ea05435-876e-4840-bc47-88b919b7a5a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4fmh9" Sep 17 14:07:12.612006 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.609523 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4ea05435-876e-4840-bc47-88b919b7a5a9-socket-dir\") pod \"aws-ebs-csi-driver-node-4fmh9\" (UID: \"4ea05435-876e-4840-bc47-88b919b7a5a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4fmh9" Sep 17 14:07:12.612006 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.609550 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqsk7\" (UniqueName: \"kubernetes.io/projected/b4cde3bb-db2e-4afd-b878-1ff65574484c-kube-api-access-vqsk7\") pod \"network-check-target-sqr44\" (UID: \"b4cde3bb-db2e-4afd-b878-1ff65574484c\") " pod="openshift-network-diagnostics/network-check-target-sqr44" Sep 17 14:07:12.612006 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.609557 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4ea05435-876e-4840-bc47-88b919b7a5a9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4fmh9\" (UID: \"4ea05435-876e-4840-bc47-88b919b7a5a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4fmh9" Sep 17 14:07:12.612006 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.609595 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e25776cb-8927-43ec-9e09-911616fb8dfe-sys\") pod \"tuned-j5lc5\" (UID: \"e25776cb-8927-43ec-9e09-911616fb8dfe\") " pod="openshift-cluster-node-tuning-operator/tuned-j5lc5" Sep 17 14:07:12.612006 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.609630 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e25776cb-8927-43ec-9e09-911616fb8dfe-lib-modules\") pod \"tuned-j5lc5\" (UID: \"e25776cb-8927-43ec-9e09-911616fb8dfe\") " pod="openshift-cluster-node-tuning-operator/tuned-j5lc5" Sep 17 14:07:12.612006 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.609658 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4ea05435-876e-4840-bc47-88b919b7a5a9-registration-dir\") pod \"aws-ebs-csi-driver-node-4fmh9\" (UID: \"4ea05435-876e-4840-bc47-88b919b7a5a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4fmh9" Sep 17 14:07:12.612006 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.609682 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/78551199-0cec-4921-b8a1-0858742751f4-dbus\") pod \"global-pull-secret-syncer-9jk57\" (UID: \"78551199-0cec-4921-b8a1-0858742751f4\") " pod="kube-system/global-pull-secret-syncer-9jk57" Sep 17 14:07:12.612006 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.609699 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4ea05435-876e-4840-bc47-88b919b7a5a9-socket-dir\") pod \"aws-ebs-csi-driver-node-4fmh9\" (UID: \"4ea05435-876e-4840-bc47-88b919b7a5a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4fmh9" Sep 17 14:07:12.612006 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.609705 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e25776cb-8927-43ec-9e09-911616fb8dfe-tmp\") pod \"tuned-j5lc5\" (UID: \"e25776cb-8927-43ec-9e09-911616fb8dfe\") " pod="openshift-cluster-node-tuning-operator/tuned-j5lc5" Sep 17 14:07:12.612006 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.609746 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/90708755-5dda-47a7-8c9d-aab17778d946-system-cni-dir\") pod \"multus-f4grz\" (UID: \"90708755-5dda-47a7-8c9d-aab17778d946\") " pod="openshift-multus/multus-f4grz" Sep 17 14:07:12.612006 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.609773 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/90708755-5dda-47a7-8c9d-aab17778d946-host-run-k8s-cni-cncf-io\") pod \"multus-f4grz\" (UID: \"90708755-5dda-47a7-8c9d-aab17778d946\") " pod="openshift-multus/multus-f4grz" Sep 17 14:07:12.612006 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.609799 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/90708755-5dda-47a7-8c9d-aab17778d946-host-var-lib-cni-multus\") pod \"multus-f4grz\" (UID: \"90708755-5dda-47a7-8c9d-aab17778d946\") " pod="openshift-multus/multus-f4grz" Sep 17 14:07:12.612006 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.609833 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e25776cb-8927-43ec-9e09-911616fb8dfe-lib-modules\") pod \"tuned-j5lc5\" (UID: \"e25776cb-8927-43ec-9e09-911616fb8dfe\") " pod="openshift-cluster-node-tuning-operator/tuned-j5lc5" Sep 17 14:07:12.612006 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.609855 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/04e96b35-1239-43a4-92fb-ade601f5358e-cnibin\") pod \"multus-additional-cni-plugins-g2rvj\" (UID: \"04e96b35-1239-43a4-92fb-ade601f5358e\") " pod="openshift-multus/multus-additional-cni-plugins-g2rvj" Sep 17 14:07:12.612006 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.609883 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e25776cb-8927-43ec-9e09-911616fb8dfe-var-lib-kubelet\") pod \"tuned-j5lc5\" (UID: \"e25776cb-8927-43ec-9e09-911616fb8dfe\") " pod="openshift-cluster-node-tuning-operator/tuned-j5lc5" Sep 17 14:07:12.612855 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.609895 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e25776cb-8927-43ec-9e09-911616fb8dfe-sys\") pod \"tuned-j5lc5\" (UID: \"e25776cb-8927-43ec-9e09-911616fb8dfe\") " pod="openshift-cluster-node-tuning-operator/tuned-j5lc5" Sep 17 14:07:12.612855 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.609906 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ad60e34b-b278-428d-bedc-005487e24b27-konnectivity-ca\") pod \"konnectivity-agent-r9gxb\" (UID: \"ad60e34b-b278-428d-bedc-005487e24b27\") " pod="kube-system/konnectivity-agent-r9gxb" Sep 17 14:07:12.612855 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.609911 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/90708755-5dda-47a7-8c9d-aab17778d946-host-run-multus-certs\") pod \"multus-f4grz\" (UID: \"90708755-5dda-47a7-8c9d-aab17778d946\") " pod="openshift-multus/multus-f4grz" Sep 17 14:07:12.612855 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.609940 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/90708755-5dda-47a7-8c9d-aab17778d946-host-var-lib-cni-multus\") pod \"multus-f4grz\" (UID: \"90708755-5dda-47a7-8c9d-aab17778d946\") " pod="openshift-multus/multus-f4grz" Sep 17 14:07:12.612855 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.609947 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/90708755-5dda-47a7-8c9d-aab17778d946-host-run-multus-certs\") pod \"multus-f4grz\" (UID: \"90708755-5dda-47a7-8c9d-aab17778d946\") " pod="openshift-multus/multus-f4grz" Sep 17 14:07:12.612855 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.609970 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/04e96b35-1239-43a4-92fb-ade601f5358e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-g2rvj\" (UID: \"04e96b35-1239-43a4-92fb-ade601f5358e\") " pod="openshift-multus/multus-additional-cni-plugins-g2rvj" Sep 17 14:07:12.612855 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.609981 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/04e96b35-1239-43a4-92fb-ade601f5358e-cnibin\") pod \"multus-additional-cni-plugins-g2rvj\" (UID: \"04e96b35-1239-43a4-92fb-ade601f5358e\") " pod="openshift-multus/multus-additional-cni-plugins-g2rvj" Sep 17 14:07:12.612855 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.610004 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e25776cb-8927-43ec-9e09-911616fb8dfe-etc-modprobe-d\") pod \"tuned-j5lc5\" (UID: \"e25776cb-8927-43ec-9e09-911616fb8dfe\") " pod="openshift-cluster-node-tuning-operator/tuned-j5lc5" Sep 17 14:07:12.612855 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.610025 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/90708755-5dda-47a7-8c9d-aab17778d946-cni-binary-copy\") pod \"multus-f4grz\" (UID: \"90708755-5dda-47a7-8c9d-aab17778d946\") " pod="openshift-multus/multus-f4grz" Sep 17 14:07:12.612855 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.610032 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e25776cb-8927-43ec-9e09-911616fb8dfe-var-lib-kubelet\") pod \"tuned-j5lc5\" (UID: \"e25776cb-8927-43ec-9e09-911616fb8dfe\") " pod="openshift-cluster-node-tuning-operator/tuned-j5lc5" Sep 17 14:07:12.612855 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.610037 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/90708755-5dda-47a7-8c9d-aab17778d946-host-var-lib-kubelet\") pod \"multus-f4grz\" (UID: \"90708755-5dda-47a7-8c9d-aab17778d946\") " pod="openshift-multus/multus-f4grz" Sep 17 14:07:12.612855 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.610040 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/90708755-5dda-47a7-8c9d-aab17778d946-system-cni-dir\") pod \"multus-f4grz\" (UID: \"90708755-5dda-47a7-8c9d-aab17778d946\") " pod="openshift-multus/multus-f4grz" Sep 17 14:07:12.612855 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.610070 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/90708755-5dda-47a7-8c9d-aab17778d946-hostroot\") pod \"multus-f4grz\" (UID: \"90708755-5dda-47a7-8c9d-aab17778d946\") " pod="openshift-multus/multus-f4grz" Sep 17 14:07:12.612855 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.610098 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e25776cb-8927-43ec-9e09-911616fb8dfe-etc-kubernetes\") pod \"tuned-j5lc5\" (UID: \"e25776cb-8927-43ec-9e09-911616fb8dfe\") " pod="openshift-cluster-node-tuning-operator/tuned-j5lc5" Sep 17 14:07:12.612855 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.610099 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/90708755-5dda-47a7-8c9d-aab17778d946-host-var-lib-kubelet\") pod \"multus-f4grz\" (UID: \"90708755-5dda-47a7-8c9d-aab17778d946\") " pod="openshift-multus/multus-f4grz" Sep 17 14:07:12.612855 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.610141 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e25776cb-8927-43ec-9e09-911616fb8dfe-etc-modprobe-d\") pod \"tuned-j5lc5\" (UID: \"e25776cb-8927-43ec-9e09-911616fb8dfe\") " pod="openshift-cluster-node-tuning-operator/tuned-j5lc5" Sep 17 14:07:12.612855 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.610146 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4ea05435-876e-4840-bc47-88b919b7a5a9-registration-dir\") pod \"aws-ebs-csi-driver-node-4fmh9\" (UID: \"4ea05435-876e-4840-bc47-88b919b7a5a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4fmh9" Sep 17 14:07:12.612855 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.610148 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/90708755-5dda-47a7-8c9d-aab17778d946-host-run-k8s-cni-cncf-io\") pod \"multus-f4grz\" (UID: \"90708755-5dda-47a7-8c9d-aab17778d946\") " pod="openshift-multus/multus-f4grz" Sep 17 14:07:12.613396 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.610175 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/90708755-5dda-47a7-8c9d-aab17778d946-hostroot\") pod \"multus-f4grz\" (UID: \"90708755-5dda-47a7-8c9d-aab17778d946\") " pod="openshift-multus/multus-f4grz" Sep 17 14:07:12.613396 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.610181 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xzj7m\" (UniqueName: \"kubernetes.io/projected/29942cdd-392c-45cc-94ad-e0e570e04856-kube-api-access-xzj7m\") pod \"node-ca-wxv7s\" (UID: \"29942cdd-392c-45cc-94ad-e0e570e04856\") " pod="openshift-image-registry/node-ca-wxv7s" Sep 17 14:07:12.613396 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.610201 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e25776cb-8927-43ec-9e09-911616fb8dfe-etc-kubernetes\") pod \"tuned-j5lc5\" (UID: \"e25776cb-8927-43ec-9e09-911616fb8dfe\") " pod="openshift-cluster-node-tuning-operator/tuned-j5lc5" Sep 17 14:07:12.613396 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.610209 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/90708755-5dda-47a7-8c9d-aab17778d946-multus-daemon-config\") pod \"multus-f4grz\" (UID: \"90708755-5dda-47a7-8c9d-aab17778d946\") " pod="openshift-multus/multus-f4grz" Sep 17 14:07:12.613396 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.610239 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/78551199-0cec-4921-b8a1-0858742751f4-dbus\") pod \"global-pull-secret-syncer-9jk57\" (UID: \"78551199-0cec-4921-b8a1-0858742751f4\") " pod="kube-system/global-pull-secret-syncer-9jk57" Sep 17 14:07:12.613396 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.610509 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/04e96b35-1239-43a4-92fb-ade601f5358e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-g2rvj\" (UID: \"04e96b35-1239-43a4-92fb-ade601f5358e\") " pod="openshift-multus/multus-additional-cni-plugins-g2rvj" Sep 17 14:07:12.613396 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.610753 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/90708755-5dda-47a7-8c9d-aab17778d946-multus-daemon-config\") pod \"multus-f4grz\" (UID: \"90708755-5dda-47a7-8c9d-aab17778d946\") " pod="openshift-multus/multus-f4grz" Sep 17 14:07:12.613396 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.612059 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e25776cb-8927-43ec-9e09-911616fb8dfe-tmp\") pod \"tuned-j5lc5\" (UID: \"e25776cb-8927-43ec-9e09-911616fb8dfe\") " pod="openshift-cluster-node-tuning-operator/tuned-j5lc5" Sep 17 14:07:12.613396 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.612236 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e25776cb-8927-43ec-9e09-911616fb8dfe-etc-tuned\") pod \"tuned-j5lc5\" (UID: \"e25776cb-8927-43ec-9e09-911616fb8dfe\") " pod="openshift-cluster-node-tuning-operator/tuned-j5lc5" Sep 17 14:07:12.613396 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.613164 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ad60e34b-b278-428d-bedc-005487e24b27-agent-certs\") pod \"konnectivity-agent-r9gxb\" (UID: \"ad60e34b-b278-428d-bedc-005487e24b27\") " pod="kube-system/konnectivity-agent-r9gxb" Sep 17 14:07:12.618694 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:12.618543 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88a7a62367d3ac850bfa7c5bf5f45309.slice/crio-33c183764d42f3b4c215149b12db5665d5a10b9c5fd3404842bfdd5d7114fe58 WatchSource:0}: Error finding container 33c183764d42f3b4c215149b12db5665d5a10b9c5fd3404842bfdd5d7114fe58: Status 404 returned error can't find the container with id 33c183764d42f3b4c215149b12db5665d5a10b9c5fd3404842bfdd5d7114fe58 Sep 17 14:07:12.619158 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:12.619105 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67918d56e813f77237d3fada69cdbd8e.slice/crio-b489528cf918506b2faf40fba8f31c20c4c0fd8b73430a19b23cc2c8df927c55 WatchSource:0}: Error finding container b489528cf918506b2faf40fba8f31c20c4c0fd8b73430a19b23cc2c8df927c55: Status 404 returned error can't find the container with id b489528cf918506b2faf40fba8f31c20c4c0fd8b73430a19b23cc2c8df927c55 Sep 17 14:07:12.621041 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.621014 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9ckjr\" (UniqueName: \"kubernetes.io/projected/0f675bf6-8f81-470f-b259-a9b21ddf230f-kube-api-access-9ckjr\") pod \"node-resolver-kjm5t\" (UID: \"0f675bf6-8f81-470f-b259-a9b21ddf230f\") " pod="openshift-dns/node-resolver-kjm5t" Sep 17 14:07:12.621713 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.621613 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gxdds\" (UniqueName: \"kubernetes.io/projected/04e96b35-1239-43a4-92fb-ade601f5358e-kube-api-access-gxdds\") pod \"multus-additional-cni-plugins-g2rvj\" (UID: \"04e96b35-1239-43a4-92fb-ade601f5358e\") " pod="openshift-multus/multus-additional-cni-plugins-g2rvj" Sep 17 14:07:12.621887 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.621863 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dg8lf\" (UniqueName: \"kubernetes.io/projected/4ea05435-876e-4840-bc47-88b919b7a5a9-kube-api-access-dg8lf\") pod \"aws-ebs-csi-driver-node-4fmh9\" (UID: \"4ea05435-876e-4840-bc47-88b919b7a5a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4fmh9" Sep 17 14:07:12.621976 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:12.621923 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 14:07:12.621976 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:12.621946 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 14:07:12.621976 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:12.621961 2558 projected.go:196] Error preparing data for projected volume kube-api-access-vqsk7 for pod openshift-network-diagnostics/network-check-target-sqr44: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 14:07:12.622151 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:12.622028 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b4cde3bb-db2e-4afd-b878-1ff65574484c-kube-api-access-vqsk7 podName:b4cde3bb-db2e-4afd-b878-1ff65574484c nodeName:}" failed. No retries permitted until 2026-09-17 14:07:13.122011189 +0000 UTC m=+2.081030701 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-vqsk7" (UniqueName: "kubernetes.io/projected/b4cde3bb-db2e-4afd-b878-1ff65574484c-kube-api-access-vqsk7") pod "network-check-target-sqr44" (UID: "b4cde3bb-db2e-4afd-b878-1ff65574484c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 14:07:12.622719 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.622595 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g46l9\" (UniqueName: \"kubernetes.io/projected/438ea2f7-067a-441e-b529-ec696ecd3152-kube-api-access-g46l9\") pod \"iptables-alerter-tmm7h\" (UID: \"438ea2f7-067a-441e-b529-ec696ecd3152\") " pod="openshift-network-operator/iptables-alerter-tmm7h" Sep 17 14:07:12.622779 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.622756 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dh5vw\" (UniqueName: \"kubernetes.io/projected/345f5575-9f8c-486b-9d57-7570a932d5a4-kube-api-access-dh5vw\") pod \"network-metrics-daemon-8qrmx\" (UID: \"345f5575-9f8c-486b-9d57-7570a932d5a4\") " pod="openshift-multus/network-metrics-daemon-8qrmx" Sep 17 14:07:12.623479 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.623457 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c6tr8\" (UniqueName: \"kubernetes.io/projected/90708755-5dda-47a7-8c9d-aab17778d946-kube-api-access-c6tr8\") pod \"multus-f4grz\" (UID: \"90708755-5dda-47a7-8c9d-aab17778d946\") " pod="openshift-multus/multus-f4grz" Sep 17 14:07:12.624014 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.623991 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sz6rh\" (UniqueName: \"kubernetes.io/projected/e25776cb-8927-43ec-9e09-911616fb8dfe-kube-api-access-sz6rh\") pod \"tuned-j5lc5\" (UID: \"e25776cb-8927-43ec-9e09-911616fb8dfe\") " pod="openshift-cluster-node-tuning-operator/tuned-j5lc5" Sep 17 14:07:12.624098 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.624041 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xzj7m\" (UniqueName: \"kubernetes.io/projected/29942cdd-392c-45cc-94ad-e0e570e04856-kube-api-access-xzj7m\") pod \"node-ca-wxv7s\" (UID: \"29942cdd-392c-45cc-94ad-e0e570e04856\") " pod="openshift-image-registry/node-ca-wxv7s" Sep 17 14:07:12.624754 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.624739 2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 17 14:07:12.735241 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.735171 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-8cqcg" Sep 17 14:07:12.743947 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.743926 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-r9gxb" Sep 17 14:07:12.747197 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:12.747177 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2dccbfdd_669a_4df0_b6f4_dbff79453c09.slice/crio-d17045eaa1d7e3e0d732f60a1e0fa0d0fbebe100ef46e08df44c63ca3383e155 WatchSource:0}: Error finding container d17045eaa1d7e3e0d732f60a1e0fa0d0fbebe100ef46e08df44c63ca3383e155: Status 404 returned error can't find the container with id d17045eaa1d7e3e0d732f60a1e0fa0d0fbebe100ef46e08df44c63ca3383e155 Sep 17 14:07:12.753377 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:12.753354 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad60e34b_b278_428d_bedc_005487e24b27.slice/crio-5f32fa4bcadf814e2b3b1b4b0baea5dea8059dd69933609b3da88c80a2dc1c59 WatchSource:0}: Error finding container 5f32fa4bcadf814e2b3b1b4b0baea5dea8059dd69933609b3da88c80a2dc1c59: Status 404 returned error can't find the container with id 5f32fa4bcadf814e2b3b1b4b0baea5dea8059dd69933609b3da88c80a2dc1c59 Sep 17 14:07:12.758685 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.758666 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4fmh9" Sep 17 14:07:12.766762 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:12.766741 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ea05435_876e_4840_bc47_88b919b7a5a9.slice/crio-0496bfbdd37781e5dfd3bbe1c91e9b7f12aee3889c70ecd1cefc9bb918a5682b WatchSource:0}: Error finding container 0496bfbdd37781e5dfd3bbe1c91e9b7f12aee3889c70ecd1cefc9bb918a5682b: Status 404 returned error can't find the container with id 0496bfbdd37781e5dfd3bbe1c91e9b7f12aee3889c70ecd1cefc9bb918a5682b Sep 17 14:07:12.771653 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.771637 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-j5lc5" Sep 17 14:07:12.781196 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:12.781172 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode25776cb_8927_43ec_9e09_911616fb8dfe.slice/crio-39b983f89378912a0d538801f80cebadf5836a5aad97173f6ec7d7be702c92a4 WatchSource:0}: Error finding container 39b983f89378912a0d538801f80cebadf5836a5aad97173f6ec7d7be702c92a4: Status 404 returned error can't find the container with id 39b983f89378912a0d538801f80cebadf5836a5aad97173f6ec7d7be702c92a4 Sep 17 14:07:12.786009 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.785992 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-kjm5t" Sep 17 14:07:12.793821 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:12.793800 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f675bf6_8f81_470f_b259_a9b21ddf230f.slice/crio-3ceec3a645317e414ca795adcd9a8f26c49507c4d9b961024e030e46daacdbc1 WatchSource:0}: Error finding container 3ceec3a645317e414ca795adcd9a8f26c49507c4d9b961024e030e46daacdbc1: Status 404 returned error can't find the container with id 3ceec3a645317e414ca795adcd9a8f26c49507c4d9b961024e030e46daacdbc1 Sep 17 14:07:12.800819 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.800801 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wxv7s" Sep 17 14:07:12.808572 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:12.808551 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29942cdd_392c_45cc_94ad_e0e570e04856.slice/crio-957a85eec684c0717a848e7f4134d8fe869c29f4f1db4d0f127786de3c305d46 WatchSource:0}: Error finding container 957a85eec684c0717a848e7f4134d8fe869c29f4f1db4d0f127786de3c305d46: Status 404 returned error can't find the container with id 957a85eec684c0717a848e7f4134d8fe869c29f4f1db4d0f127786de3c305d46 Sep 17 14:07:12.818386 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.818369 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-f4grz" Sep 17 14:07:12.826791 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:12.826772 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90708755_5dda_47a7_8c9d_aab17778d946.slice/crio-99f5667f3144290c27b70a89c2a862f72ea40da313d751aebfe169e11726b8f4 WatchSource:0}: Error finding container 99f5667f3144290c27b70a89c2a862f72ea40da313d751aebfe169e11726b8f4: Status 404 returned error can't find the container with id 99f5667f3144290c27b70a89c2a862f72ea40da313d751aebfe169e11726b8f4 Sep 17 14:07:12.837714 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.837694 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-tmm7h" Sep 17 14:07:12.842863 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:12.842834 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-g2rvj" Sep 17 14:07:12.845627 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:12.845606 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod438ea2f7_067a_441e_b529_ec696ecd3152.slice/crio-1bfd2ae7dee258c02b990ae61e0db2501beab3f29382914d486a4b175cc91eb1 WatchSource:0}: Error finding container 1bfd2ae7dee258c02b990ae61e0db2501beab3f29382914d486a4b175cc91eb1: Status 404 returned error can't find the container with id 1bfd2ae7dee258c02b990ae61e0db2501beab3f29382914d486a4b175cc91eb1 Sep 17 14:07:12.850544 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:12.850526 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04e96b35_1239_43a4_92fb_ade601f5358e.slice/crio-6199ef75296a00cb4ae29b06a45d532d781dbba1221932b10228f43bdb2f4570 WatchSource:0}: Error finding container 6199ef75296a00cb4ae29b06a45d532d781dbba1221932b10228f43bdb2f4570: Status 404 returned error can't find the container with id 6199ef75296a00cb4ae29b06a45d532d781dbba1221932b10228f43bdb2f4570 Sep 17 14:07:13.114542 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:13.114463 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/345f5575-9f8c-486b-9d57-7570a932d5a4-metrics-certs\") pod \"network-metrics-daemon-8qrmx\" (UID: \"345f5575-9f8c-486b-9d57-7570a932d5a4\") " pod="openshift-multus/network-metrics-daemon-8qrmx" Sep 17 14:07:13.114542 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:13.114498 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/78551199-0cec-4921-b8a1-0858742751f4-original-pull-secret\") pod \"global-pull-secret-syncer-9jk57\" (UID: \"78551199-0cec-4921-b8a1-0858742751f4\") " pod="kube-system/global-pull-secret-syncer-9jk57" Sep 17 14:07:13.114701 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:13.114614 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 14:07:13.114701 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:13.114666 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/345f5575-9f8c-486b-9d57-7570a932d5a4-metrics-certs podName:345f5575-9f8c-486b-9d57-7570a932d5a4 nodeName:}" failed. No retries permitted until 2026-09-17 14:07:14.114652723 +0000 UTC m=+3.073672216 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/345f5575-9f8c-486b-9d57-7570a932d5a4-metrics-certs") pod "network-metrics-daemon-8qrmx" (UID: "345f5575-9f8c-486b-9d57-7570a932d5a4") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 14:07:13.114778 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:13.114614 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 14:07:13.114778 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:13.114746 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/78551199-0cec-4921-b8a1-0858742751f4-original-pull-secret podName:78551199-0cec-4921-b8a1-0858742751f4 nodeName:}" failed. No retries permitted until 2026-09-17 14:07:14.114733498 +0000 UTC m=+3.073752991 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/78551199-0cec-4921-b8a1-0858742751f4-original-pull-secret") pod "global-pull-secret-syncer-9jk57" (UID: "78551199-0cec-4921-b8a1-0858742751f4") : object "kube-system"/"original-pull-secret" not registered Sep 17 14:07:13.215704 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:13.215670 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqsk7\" (UniqueName: \"kubernetes.io/projected/b4cde3bb-db2e-4afd-b878-1ff65574484c-kube-api-access-vqsk7\") pod \"network-check-target-sqr44\" (UID: \"b4cde3bb-db2e-4afd-b878-1ff65574484c\") " pod="openshift-network-diagnostics/network-check-target-sqr44" Sep 17 14:07:13.215864 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:13.215812 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 14:07:13.215864 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:13.215832 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 14:07:13.215864 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:13.215842 2558 projected.go:196] Error preparing data for projected volume kube-api-access-vqsk7 for pod openshift-network-diagnostics/network-check-target-sqr44: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 14:07:13.216059 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:13.215891 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b4cde3bb-db2e-4afd-b878-1ff65574484c-kube-api-access-vqsk7 podName:b4cde3bb-db2e-4afd-b878-1ff65574484c nodeName:}" failed. No retries permitted until 2026-09-17 14:07:14.215876131 +0000 UTC m=+3.174895619 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-vqsk7" (UniqueName: "kubernetes.io/projected/b4cde3bb-db2e-4afd-b878-1ff65574484c-kube-api-access-vqsk7") pod "network-check-target-sqr44" (UID: "b4cde3bb-db2e-4afd-b878-1ff65574484c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 14:07:13.496985 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:13.496812 2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-16 14:02:12 +0000 UTC" deadline="2028-06-13 05:30:21.155943932 +0000 UTC" Sep 17 14:07:13.496985 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:13.496878 2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15231h23m7.659071016s" Sep 17 14:07:13.529778 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:13.529064 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sqr44" Sep 17 14:07:13.529778 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:13.529187 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sqr44" podUID="b4cde3bb-db2e-4afd-b878-1ff65574484c" Sep 17 14:07:13.568481 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:13.568418 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-tmm7h" event={"ID":"438ea2f7-067a-441e-b529-ec696ecd3152","Type":"ContainerStarted","Data":"1bfd2ae7dee258c02b990ae61e0db2501beab3f29382914d486a4b175cc91eb1"} Sep 17 14:07:13.573282 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:13.573214 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-f4grz" event={"ID":"90708755-5dda-47a7-8c9d-aab17778d946","Type":"ContainerStarted","Data":"99f5667f3144290c27b70a89c2a862f72ea40da313d751aebfe169e11726b8f4"} Sep 17 14:07:13.585146 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:13.584719 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wxv7s" event={"ID":"29942cdd-392c-45cc-94ad-e0e570e04856","Type":"ContainerStarted","Data":"957a85eec684c0717a848e7f4134d8fe869c29f4f1db4d0f127786de3c305d46"} Sep 17 14:07:13.587401 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:13.587374 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-j5lc5" event={"ID":"e25776cb-8927-43ec-9e09-911616fb8dfe","Type":"ContainerStarted","Data":"39b983f89378912a0d538801f80cebadf5836a5aad97173f6ec7d7be702c92a4"} Sep 17 14:07:13.601635 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:13.601594 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-r9gxb" event={"ID":"ad60e34b-b278-428d-bedc-005487e24b27","Type":"ContainerStarted","Data":"5f32fa4bcadf814e2b3b1b4b0baea5dea8059dd69933609b3da88c80a2dc1c59"} Sep 17 14:07:13.630458 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:13.630171 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-36.ec2.internal" event={"ID":"88a7a62367d3ac850bfa7c5bf5f45309","Type":"ContainerStarted","Data":"33c183764d42f3b4c215149b12db5665d5a10b9c5fd3404842bfdd5d7114fe58"} Sep 17 14:07:13.647490 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:13.647407 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-kjm5t" event={"ID":"0f675bf6-8f81-470f-b259-a9b21ddf230f","Type":"ContainerStarted","Data":"3ceec3a645317e414ca795adcd9a8f26c49507c4d9b961024e030e46daacdbc1"} Sep 17 14:07:13.672152 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:13.672047 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4fmh9" event={"ID":"4ea05435-876e-4840-bc47-88b919b7a5a9","Type":"ContainerStarted","Data":"0496bfbdd37781e5dfd3bbe1c91e9b7f12aee3889c70ecd1cefc9bb918a5682b"} Sep 17 14:07:13.684510 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:13.684483 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8cqcg" event={"ID":"2dccbfdd-669a-4df0-b6f4-dbff79453c09","Type":"ContainerStarted","Data":"d17045eaa1d7e3e0d732f60a1e0fa0d0fbebe100ef46e08df44c63ca3383e155"} Sep 17 14:07:13.710765 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:13.710687 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-36.ec2.internal" event={"ID":"67918d56e813f77237d3fada69cdbd8e","Type":"ContainerStarted","Data":"b489528cf918506b2faf40fba8f31c20c4c0fd8b73430a19b23cc2c8df927c55"} Sep 17 14:07:13.724422 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:13.724372 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g2rvj" event={"ID":"04e96b35-1239-43a4-92fb-ade601f5358e","Type":"ContainerStarted","Data":"6199ef75296a00cb4ae29b06a45d532d781dbba1221932b10228f43bdb2f4570"} Sep 17 14:07:13.751312 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:13.751242 2558 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 17 14:07:14.125233 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:14.124862 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/345f5575-9f8c-486b-9d57-7570a932d5a4-metrics-certs\") pod \"network-metrics-daemon-8qrmx\" (UID: \"345f5575-9f8c-486b-9d57-7570a932d5a4\") " pod="openshift-multus/network-metrics-daemon-8qrmx" Sep 17 14:07:14.125233 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:14.124918 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/78551199-0cec-4921-b8a1-0858742751f4-original-pull-secret\") pod \"global-pull-secret-syncer-9jk57\" (UID: \"78551199-0cec-4921-b8a1-0858742751f4\") " pod="kube-system/global-pull-secret-syncer-9jk57" Sep 17 14:07:14.125233 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:14.125053 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 14:07:14.125233 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:14.125116 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/78551199-0cec-4921-b8a1-0858742751f4-original-pull-secret podName:78551199-0cec-4921-b8a1-0858742751f4 nodeName:}" failed. No retries permitted until 2026-09-17 14:07:16.125097575 +0000 UTC m=+5.084117071 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/78551199-0cec-4921-b8a1-0858742751f4-original-pull-secret") pod "global-pull-secret-syncer-9jk57" (UID: "78551199-0cec-4921-b8a1-0858742751f4") : object "kube-system"/"original-pull-secret" not registered Sep 17 14:07:14.125675 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:14.125539 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 14:07:14.125675 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:14.125613 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/345f5575-9f8c-486b-9d57-7570a932d5a4-metrics-certs podName:345f5575-9f8c-486b-9d57-7570a932d5a4 nodeName:}" failed. No retries permitted until 2026-09-17 14:07:16.125594736 +0000 UTC m=+5.084614232 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/345f5575-9f8c-486b-9d57-7570a932d5a4-metrics-certs") pod "network-metrics-daemon-8qrmx" (UID: "345f5575-9f8c-486b-9d57-7570a932d5a4") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 14:07:14.225494 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:14.225453 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqsk7\" (UniqueName: \"kubernetes.io/projected/b4cde3bb-db2e-4afd-b878-1ff65574484c-kube-api-access-vqsk7\") pod \"network-check-target-sqr44\" (UID: \"b4cde3bb-db2e-4afd-b878-1ff65574484c\") " pod="openshift-network-diagnostics/network-check-target-sqr44" Sep 17 14:07:14.225724 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:14.225691 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 14:07:14.225724 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:14.225712 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 14:07:14.225724 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:14.225725 2558 projected.go:196] Error preparing data for projected volume kube-api-access-vqsk7 for pod openshift-network-diagnostics/network-check-target-sqr44: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 14:07:14.225834 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:14.225793 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b4cde3bb-db2e-4afd-b878-1ff65574484c-kube-api-access-vqsk7 podName:b4cde3bb-db2e-4afd-b878-1ff65574484c nodeName:}" failed. No retries permitted until 2026-09-17 14:07:16.225773431 +0000 UTC m=+5.184792924 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-vqsk7" (UniqueName: "kubernetes.io/projected/b4cde3bb-db2e-4afd-b878-1ff65574484c-kube-api-access-vqsk7") pod "network-check-target-sqr44" (UID: "b4cde3bb-db2e-4afd-b878-1ff65574484c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 14:07:14.497424 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:14.497323 2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-16 14:02:12 +0000 UTC" deadline="2028-03-22 07:31:14.876384787 +0000 UTC" Sep 17 14:07:14.497424 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:14.497361 2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13241h24m0.379028166s" Sep 17 14:07:14.528173 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:14.527165 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9jk57" Sep 17 14:07:14.528173 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:14.527304 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9jk57" podUID="78551199-0cec-4921-b8a1-0858742751f4" Sep 17 14:07:14.528173 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:14.527386 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8qrmx" Sep 17 14:07:14.528173 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:14.527485 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8qrmx" podUID="345f5575-9f8c-486b-9d57-7570a932d5a4" Sep 17 14:07:15.016135 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:15.016101 2558 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 17 14:07:15.528718 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:15.528683 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sqr44" Sep 17 14:07:15.529227 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:15.528827 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sqr44" podUID="b4cde3bb-db2e-4afd-b878-1ff65574484c" Sep 17 14:07:16.142994 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:16.142715 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/345f5575-9f8c-486b-9d57-7570a932d5a4-metrics-certs\") pod \"network-metrics-daemon-8qrmx\" (UID: \"345f5575-9f8c-486b-9d57-7570a932d5a4\") " pod="openshift-multus/network-metrics-daemon-8qrmx" Sep 17 14:07:16.143187 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:16.143042 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/78551199-0cec-4921-b8a1-0858742751f4-original-pull-secret\") pod \"global-pull-secret-syncer-9jk57\" (UID: \"78551199-0cec-4921-b8a1-0858742751f4\") " pod="kube-system/global-pull-secret-syncer-9jk57" Sep 17 14:07:16.146823 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:16.146794 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 14:07:16.146967 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:16.146905 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/345f5575-9f8c-486b-9d57-7570a932d5a4-metrics-certs podName:345f5575-9f8c-486b-9d57-7570a932d5a4 nodeName:}" failed. No retries permitted until 2026-09-17 14:07:20.146866806 +0000 UTC m=+9.105886298 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/345f5575-9f8c-486b-9d57-7570a932d5a4-metrics-certs") pod "network-metrics-daemon-8qrmx" (UID: "345f5575-9f8c-486b-9d57-7570a932d5a4") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 14:07:16.149649 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:16.147564 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 14:07:16.149649 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:16.147637 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/78551199-0cec-4921-b8a1-0858742751f4-original-pull-secret podName:78551199-0cec-4921-b8a1-0858742751f4 nodeName:}" failed. No retries permitted until 2026-09-17 14:07:20.147618464 +0000 UTC m=+9.106637973 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/78551199-0cec-4921-b8a1-0858742751f4-original-pull-secret") pod "global-pull-secret-syncer-9jk57" (UID: "78551199-0cec-4921-b8a1-0858742751f4") : object "kube-system"/"original-pull-secret" not registered Sep 17 14:07:16.245278 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:16.244601 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqsk7\" (UniqueName: \"kubernetes.io/projected/b4cde3bb-db2e-4afd-b878-1ff65574484c-kube-api-access-vqsk7\") pod \"network-check-target-sqr44\" (UID: \"b4cde3bb-db2e-4afd-b878-1ff65574484c\") " pod="openshift-network-diagnostics/network-check-target-sqr44" Sep 17 14:07:16.245278 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:16.244801 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 14:07:16.245278 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:16.244820 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 14:07:16.245278 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:16.244834 2558 projected.go:196] Error preparing data for projected volume kube-api-access-vqsk7 for pod openshift-network-diagnostics/network-check-target-sqr44: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 14:07:16.245278 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:16.244889 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b4cde3bb-db2e-4afd-b878-1ff65574484c-kube-api-access-vqsk7 podName:b4cde3bb-db2e-4afd-b878-1ff65574484c nodeName:}" failed. No retries permitted until 2026-09-17 14:07:20.244870723 +0000 UTC m=+9.203890226 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-vqsk7" (UniqueName: "kubernetes.io/projected/b4cde3bb-db2e-4afd-b878-1ff65574484c-kube-api-access-vqsk7") pod "network-check-target-sqr44" (UID: "b4cde3bb-db2e-4afd-b878-1ff65574484c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 14:07:16.527545 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:16.527442 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9jk57" Sep 17 14:07:16.527718 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:16.527607 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9jk57" podUID="78551199-0cec-4921-b8a1-0858742751f4" Sep 17 14:07:16.527718 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:16.527687 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8qrmx" Sep 17 14:07:16.527838 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:16.527815 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8qrmx" podUID="345f5575-9f8c-486b-9d57-7570a932d5a4" Sep 17 14:07:17.528052 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:17.527824 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sqr44" Sep 17 14:07:17.528560 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:17.528149 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sqr44" podUID="b4cde3bb-db2e-4afd-b878-1ff65574484c" Sep 17 14:07:18.529052 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:18.529014 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9jk57" Sep 17 14:07:18.529560 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:18.529166 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9jk57" podUID="78551199-0cec-4921-b8a1-0858742751f4" Sep 17 14:07:18.529560 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:18.529524 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8qrmx" Sep 17 14:07:18.529724 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:18.529661 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8qrmx" podUID="345f5575-9f8c-486b-9d57-7570a932d5a4" Sep 17 14:07:19.527592 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:19.527101 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sqr44" Sep 17 14:07:19.527592 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:19.527236 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sqr44" podUID="b4cde3bb-db2e-4afd-b878-1ff65574484c" Sep 17 14:07:20.177637 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:20.177605 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/345f5575-9f8c-486b-9d57-7570a932d5a4-metrics-certs\") pod \"network-metrics-daemon-8qrmx\" (UID: \"345f5575-9f8c-486b-9d57-7570a932d5a4\") " pod="openshift-multus/network-metrics-daemon-8qrmx" Sep 17 14:07:20.177992 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:20.177692 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/78551199-0cec-4921-b8a1-0858742751f4-original-pull-secret\") pod \"global-pull-secret-syncer-9jk57\" (UID: \"78551199-0cec-4921-b8a1-0858742751f4\") " pod="kube-system/global-pull-secret-syncer-9jk57" Sep 17 14:07:20.177992 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:20.177743 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 14:07:20.177992 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:20.177815 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/345f5575-9f8c-486b-9d57-7570a932d5a4-metrics-certs podName:345f5575-9f8c-486b-9d57-7570a932d5a4 nodeName:}" failed. No retries permitted until 2026-09-17 14:07:28.177794206 +0000 UTC m=+17.136813705 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/345f5575-9f8c-486b-9d57-7570a932d5a4-metrics-certs") pod "network-metrics-daemon-8qrmx" (UID: "345f5575-9f8c-486b-9d57-7570a932d5a4") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 14:07:20.177992 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:20.177833 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 14:07:20.177992 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:20.177875 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/78551199-0cec-4921-b8a1-0858742751f4-original-pull-secret podName:78551199-0cec-4921-b8a1-0858742751f4 nodeName:}" failed. No retries permitted until 2026-09-17 14:07:28.177862966 +0000 UTC m=+17.136882452 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/78551199-0cec-4921-b8a1-0858742751f4-original-pull-secret") pod "global-pull-secret-syncer-9jk57" (UID: "78551199-0cec-4921-b8a1-0858742751f4") : object "kube-system"/"original-pull-secret" not registered Sep 17 14:07:20.279028 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:20.278959 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqsk7\" (UniqueName: \"kubernetes.io/projected/b4cde3bb-db2e-4afd-b878-1ff65574484c-kube-api-access-vqsk7\") pod \"network-check-target-sqr44\" (UID: \"b4cde3bb-db2e-4afd-b878-1ff65574484c\") " pod="openshift-network-diagnostics/network-check-target-sqr44" Sep 17 14:07:20.279161 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:20.279120 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 14:07:20.279161 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:20.279140 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 14:07:20.279161 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:20.279153 2558 projected.go:196] Error preparing data for projected volume kube-api-access-vqsk7 for pod openshift-network-diagnostics/network-check-target-sqr44: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 14:07:20.279266 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:20.279197 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b4cde3bb-db2e-4afd-b878-1ff65574484c-kube-api-access-vqsk7 podName:b4cde3bb-db2e-4afd-b878-1ff65574484c nodeName:}" failed. No retries permitted until 2026-09-17 14:07:28.279185079 +0000 UTC m=+17.238204564 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-vqsk7" (UniqueName: "kubernetes.io/projected/b4cde3bb-db2e-4afd-b878-1ff65574484c-kube-api-access-vqsk7") pod "network-check-target-sqr44" (UID: "b4cde3bb-db2e-4afd-b878-1ff65574484c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 14:07:20.527241 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:20.527158 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9jk57" Sep 17 14:07:20.527403 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:20.527296 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9jk57" podUID="78551199-0cec-4921-b8a1-0858742751f4" Sep 17 14:07:20.527403 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:20.527340 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8qrmx" Sep 17 14:07:20.527527 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:20.527474 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8qrmx" podUID="345f5575-9f8c-486b-9d57-7570a932d5a4" Sep 17 14:07:21.527567 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:21.527522 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sqr44" Sep 17 14:07:21.528023 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:21.527638 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sqr44" podUID="b4cde3bb-db2e-4afd-b878-1ff65574484c" Sep 17 14:07:22.527612 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:22.527570 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8qrmx" Sep 17 14:07:22.528080 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:22.527570 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9jk57" Sep 17 14:07:22.528080 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:22.527720 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8qrmx" podUID="345f5575-9f8c-486b-9d57-7570a932d5a4" Sep 17 14:07:22.528080 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:22.527775 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9jk57" podUID="78551199-0cec-4921-b8a1-0858742751f4" Sep 17 14:07:23.526925 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:23.526888 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sqr44" Sep 17 14:07:23.527078 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:23.527058 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sqr44" podUID="b4cde3bb-db2e-4afd-b878-1ff65574484c" Sep 17 14:07:24.527472 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:24.527445 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9jk57" Sep 17 14:07:24.527862 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:24.527448 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8qrmx" Sep 17 14:07:24.527862 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:24.527550 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9jk57" podUID="78551199-0cec-4921-b8a1-0858742751f4" Sep 17 14:07:24.527862 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:24.527618 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8qrmx" podUID="345f5575-9f8c-486b-9d57-7570a932d5a4" Sep 17 14:07:25.526612 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:25.526585 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sqr44" Sep 17 14:07:25.526797 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:25.526691 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sqr44" podUID="b4cde3bb-db2e-4afd-b878-1ff65574484c" Sep 17 14:07:26.527477 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:26.527443 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9jk57" Sep 17 14:07:26.527477 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:26.527458 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8qrmx" Sep 17 14:07:26.528007 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:26.527576 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9jk57" podUID="78551199-0cec-4921-b8a1-0858742751f4" Sep 17 14:07:26.528007 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:26.527699 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8qrmx" podUID="345f5575-9f8c-486b-9d57-7570a932d5a4" Sep 17 14:07:27.527714 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:27.527624 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sqr44" Sep 17 14:07:27.528148 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:27.527751 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sqr44" podUID="b4cde3bb-db2e-4afd-b878-1ff65574484c" Sep 17 14:07:28.237010 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:28.236972 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/345f5575-9f8c-486b-9d57-7570a932d5a4-metrics-certs\") pod \"network-metrics-daemon-8qrmx\" (UID: \"345f5575-9f8c-486b-9d57-7570a932d5a4\") " pod="openshift-multus/network-metrics-daemon-8qrmx" Sep 17 14:07:28.237234 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:28.237026 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/78551199-0cec-4921-b8a1-0858742751f4-original-pull-secret\") pod \"global-pull-secret-syncer-9jk57\" (UID: \"78551199-0cec-4921-b8a1-0858742751f4\") " pod="kube-system/global-pull-secret-syncer-9jk57" Sep 17 14:07:28.237234 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:28.237146 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 14:07:28.237234 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:28.237227 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/345f5575-9f8c-486b-9d57-7570a932d5a4-metrics-certs podName:345f5575-9f8c-486b-9d57-7570a932d5a4 nodeName:}" failed. No retries permitted until 2026-09-17 14:07:44.23720554 +0000 UTC m=+33.196225029 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/345f5575-9f8c-486b-9d57-7570a932d5a4-metrics-certs") pod "network-metrics-daemon-8qrmx" (UID: "345f5575-9f8c-486b-9d57-7570a932d5a4") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 14:07:28.237426 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:28.237154 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 14:07:28.237426 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:28.237301 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/78551199-0cec-4921-b8a1-0858742751f4-original-pull-secret podName:78551199-0cec-4921-b8a1-0858742751f4 nodeName:}" failed. No retries permitted until 2026-09-17 14:07:44.237281415 +0000 UTC m=+33.196300906 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/78551199-0cec-4921-b8a1-0858742751f4-original-pull-secret") pod "global-pull-secret-syncer-9jk57" (UID: "78551199-0cec-4921-b8a1-0858742751f4") : object "kube-system"/"original-pull-secret" not registered Sep 17 14:07:28.338040 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:28.337997 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqsk7\" (UniqueName: \"kubernetes.io/projected/b4cde3bb-db2e-4afd-b878-1ff65574484c-kube-api-access-vqsk7\") pod \"network-check-target-sqr44\" (UID: \"b4cde3bb-db2e-4afd-b878-1ff65574484c\") " pod="openshift-network-diagnostics/network-check-target-sqr44" Sep 17 14:07:28.338248 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:28.338221 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 14:07:28.338248 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:28.338254 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 14:07:28.338427 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:28.338269 2558 projected.go:196] Error preparing data for projected volume kube-api-access-vqsk7 for pod openshift-network-diagnostics/network-check-target-sqr44: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 14:07:28.338427 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:28.338339 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b4cde3bb-db2e-4afd-b878-1ff65574484c-kube-api-access-vqsk7 podName:b4cde3bb-db2e-4afd-b878-1ff65574484c nodeName:}" failed. No retries permitted until 2026-09-17 14:07:44.338321255 +0000 UTC m=+33.297340742 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-vqsk7" (UniqueName: "kubernetes.io/projected/b4cde3bb-db2e-4afd-b878-1ff65574484c-kube-api-access-vqsk7") pod "network-check-target-sqr44" (UID: "b4cde3bb-db2e-4afd-b878-1ff65574484c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 14:07:28.526896 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:28.526812 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9jk57" Sep 17 14:07:28.527050 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:28.526812 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8qrmx" Sep 17 14:07:28.527050 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:28.526950 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9jk57" podUID="78551199-0cec-4921-b8a1-0858742751f4" Sep 17 14:07:28.527050 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:28.527033 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8qrmx" podUID="345f5575-9f8c-486b-9d57-7570a932d5a4" Sep 17 14:07:29.527675 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:29.527634 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sqr44" Sep 17 14:07:29.528364 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:29.527778 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sqr44" podUID="b4cde3bb-db2e-4afd-b878-1ff65574484c" Sep 17 14:07:30.527283 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:30.527246 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8qrmx" Sep 17 14:07:30.527472 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:30.527289 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9jk57" Sep 17 14:07:30.527472 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:30.527375 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8qrmx" podUID="345f5575-9f8c-486b-9d57-7570a932d5a4" Sep 17 14:07:30.527610 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:30.527542 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9jk57" podUID="78551199-0cec-4921-b8a1-0858742751f4" Sep 17 14:07:31.527575 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:31.527544 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sqr44" Sep 17 14:07:31.527953 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:31.527655 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sqr44" podUID="b4cde3bb-db2e-4afd-b878-1ff65574484c" Sep 17 14:07:32.527652 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:32.527431 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9jk57" Sep 17 14:07:32.528394 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:32.527788 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9jk57" podUID="78551199-0cec-4921-b8a1-0858742751f4" Sep 17 14:07:32.528394 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:32.527460 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8qrmx" Sep 17 14:07:32.528394 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:32.527899 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8qrmx" podUID="345f5575-9f8c-486b-9d57-7570a932d5a4" Sep 17 14:07:32.772764 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:32.772515 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-j5lc5" event={"ID":"e25776cb-8927-43ec-9e09-911616fb8dfe","Type":"ContainerStarted","Data":"71536f34869831ddd50d370c5097ac3800e2ea74fe977e2f9633b4c123969744"} Sep 17 14:07:32.774278 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:32.774252 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-r9gxb" event={"ID":"ad60e34b-b278-428d-bedc-005487e24b27","Type":"ContainerStarted","Data":"92841b3a24bafc0baed5161afde67e0a6f670b6ed211e4e59c677b8ccbced1fa"} Sep 17 14:07:32.776024 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:32.776005 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-36.ec2.internal" event={"ID":"88a7a62367d3ac850bfa7c5bf5f45309","Type":"ContainerStarted","Data":"79b3a8cfc40a622910adca705a2321cb2d5b3e246d12fbf625552bc0f34274d7"} Sep 17 14:07:32.777626 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:32.777587 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-kjm5t" event={"ID":"0f675bf6-8f81-470f-b259-a9b21ddf230f","Type":"ContainerStarted","Data":"9186515755b50e1827861abd8aa66edf25b2edaefaf1c186f0add4afe45a8887"} Sep 17 14:07:32.779297 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:32.779277 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4fmh9" event={"ID":"4ea05435-876e-4840-bc47-88b919b7a5a9","Type":"ContainerStarted","Data":"f53e5b2fb0a5e588753ece6b05f6cb749e166abf090b8a20e228887d713916f3"} Sep 17 14:07:32.782351 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:32.782329 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8cqcg" event={"ID":"2dccbfdd-669a-4df0-b6f4-dbff79453c09","Type":"ContainerStarted","Data":"7787454016feb5968b3b3c2691dae5736be1c7adce9e308ed1d6cc720e1fa2b9"} Sep 17 14:07:32.782436 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:32.782418 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8cqcg" event={"ID":"2dccbfdd-669a-4df0-b6f4-dbff79453c09","Type":"ContainerStarted","Data":"08abf70245e5d3f8caed7efa94f71ee31c37c354b1832f6178b67af2f2c43c51"} Sep 17 14:07:32.782539 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:32.782488 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8cqcg" event={"ID":"2dccbfdd-669a-4df0-b6f4-dbff79453c09","Type":"ContainerStarted","Data":"a301f1fd94537cf9486d9489e2a11f18b25808d6ee704f3e778d4c2f47cc8110"} Sep 17 14:07:32.782610 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:32.782585 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8cqcg" event={"ID":"2dccbfdd-669a-4df0-b6f4-dbff79453c09","Type":"ContainerStarted","Data":"2318bbe472df28c8a6160dcef33a841b368f4d73d80d4d99a8e56de4f1379a1d"} Sep 17 14:07:32.782666 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:32.782653 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8cqcg" event={"ID":"2dccbfdd-669a-4df0-b6f4-dbff79453c09","Type":"ContainerStarted","Data":"54f46116f5080964b65af1f2a0cfa8b664a77463772c9404e2bee2bdffed21e1"} Sep 17 14:07:32.784029 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:32.784007 2558 generic.go:356] "Generic (PLEG): container finished" podID="67918d56e813f77237d3fada69cdbd8e" containerID="1b54e4a51483f4e31498ab3b02e60a2ffc5a67c4d3e55d83b730d181b2a918bf" exitCode=0 Sep 17 14:07:32.784090 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:32.784078 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-36.ec2.internal" event={"ID":"67918d56e813f77237d3fada69cdbd8e","Type":"ContainerDied","Data":"1b54e4a51483f4e31498ab3b02e60a2ffc5a67c4d3e55d83b730d181b2a918bf"} Sep 17 14:07:32.785719 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:32.785698 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g2rvj" event={"ID":"04e96b35-1239-43a4-92fb-ade601f5358e","Type":"ContainerStarted","Data":"1948b8bb25ceff627d4e8c974cc1b09fad8c5786a4ba67b26357bcf204da20a9"} Sep 17 14:07:32.787198 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:32.787176 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-f4grz" event={"ID":"90708755-5dda-47a7-8c9d-aab17778d946","Type":"ContainerStarted","Data":"e2a569812a7c40ff2218e505ee96318c46427a62154c513d5c288b601ae9fc69"} Sep 17 14:07:32.788965 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:32.788891 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wxv7s" event={"ID":"29942cdd-392c-45cc-94ad-e0e570e04856","Type":"ContainerStarted","Data":"b0a822d301c3c3017d31fcf6e0da18c2d7cba0cc495540a2eef80ace021adfb6"} Sep 17 14:07:32.807262 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:32.807216 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-j5lc5" podStartSLOduration=1.495370805 podStartE2EDuration="20.807199952s" totalImagesPullingTime="19.311829147s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 14:07:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:07:32.7913441 +0000 UTC m=+21.750363607" watchObservedRunningTime="2026-09-17 14:07:32.807199952 +0000 UTC m=+21.766219459" Sep 17 14:07:32.824385 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:32.824329 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-f4grz" podStartSLOduration=1.528176242 podStartE2EDuration="20.824311247s" totalImagesPullingTime="19.296135005s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 14:07:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:07:32.824011314 +0000 UTC m=+21.783030824" watchObservedRunningTime="2026-09-17 14:07:32.824311247 +0000 UTC m=+21.783330799" Sep 17 14:07:32.870431 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:32.870384 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-36.ec2.internal" podStartSLOduration=20.87036777 podStartE2EDuration="20.87036777s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 14:07:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:07:32.869808472 +0000 UTC m=+21.828827981" watchObservedRunningTime="2026-09-17 14:07:32.87036777 +0000 UTC m=+21.829387277" Sep 17 14:07:32.889865 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:32.889829 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-r9gxb" podStartSLOduration=5.512660933 podStartE2EDuration="20.889814169s" totalImagesPullingTime="15.377153236s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:07:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:07:32.889754677 +0000 UTC m=+21.848774184" watchObservedRunningTime="2026-09-17 14:07:32.889814169 +0000 UTC m=+21.848833671" Sep 17 14:07:32.906205 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:32.906092 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-kjm5t" podStartSLOduration=1.642600024 podStartE2EDuration="20.906073432s" totalImagesPullingTime="19.263473408s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 14:07:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:07:32.90534959 +0000 UTC m=+21.864369100" watchObservedRunningTime="2026-09-17 14:07:32.906073432 +0000 UTC m=+21.865092941" Sep 17 14:07:32.923557 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:32.923515 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-wxv7s" podStartSLOduration=1.674695343 podStartE2EDuration="20.923483984s" totalImagesPullingTime="19.248788641s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 14:07:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:07:32.923155503 +0000 UTC m=+21.882175013" watchObservedRunningTime="2026-09-17 14:07:32.923483984 +0000 UTC m=+21.882503532" Sep 17 14:07:33.528132 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:33.528098 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sqr44" Sep 17 14:07:33.528941 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:33.528239 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sqr44" podUID="b4cde3bb-db2e-4afd-b878-1ff65574484c" Sep 17 14:07:33.592086 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:33.592065 2558 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 17 14:07:33.793185 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:33.793100 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4fmh9" event={"ID":"4ea05435-876e-4840-bc47-88b919b7a5a9","Type":"ContainerStarted","Data":"aed6ef2f5dc868c9c0969147b03984b1c1f15bcf2a80c958582ff03aca341de1"} Sep 17 14:07:33.796091 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:33.796062 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8cqcg" event={"ID":"2dccbfdd-669a-4df0-b6f4-dbff79453c09","Type":"ContainerStarted","Data":"5b94076a4c03111038b5bec9f6ac5862c5b1713529d5488fddcbf37e5fd982d3"} Sep 17 14:07:33.797802 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:33.797781 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-36.ec2.internal" event={"ID":"67918d56e813f77237d3fada69cdbd8e","Type":"ContainerStarted","Data":"678219fdb152c6c78323f4b123acb3e6c7920cf2b463279b3f60ae1ae502030a"} Sep 17 14:07:33.799321 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:33.799299 2558 generic.go:356] "Generic (PLEG): container finished" podID="04e96b35-1239-43a4-92fb-ade601f5358e" containerID="1948b8bb25ceff627d4e8c974cc1b09fad8c5786a4ba67b26357bcf204da20a9" exitCode=0 Sep 17 14:07:33.799428 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:33.799360 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g2rvj" event={"ID":"04e96b35-1239-43a4-92fb-ade601f5358e","Type":"ContainerDied","Data":"1948b8bb25ceff627d4e8c974cc1b09fad8c5786a4ba67b26357bcf204da20a9"} Sep 17 14:07:33.800901 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:33.800879 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-tmm7h" event={"ID":"438ea2f7-067a-441e-b529-ec696ecd3152","Type":"ContainerStarted","Data":"8fb55bae23871626ff5d5574a1ee4d8d3f7cf148f294df9f1233783bbbb1403c"} Sep 17 14:07:33.815794 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:33.815746 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-36.ec2.internal" podStartSLOduration=21.815728362 podStartE2EDuration="21.815728362s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 14:07:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:07:33.815554052 +0000 UTC m=+22.774573560" watchObservedRunningTime="2026-09-17 14:07:33.815728362 +0000 UTC m=+22.774747867" Sep 17 14:07:33.828326 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:33.828290 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-r9gxb" Sep 17 14:07:33.828843 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:33.828827 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-r9gxb" Sep 17 14:07:33.862893 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:33.862842 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-tmm7h" podStartSLOduration=2.634402011 podStartE2EDuration="21.862825768s" totalImagesPullingTime="19.228423757s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 14:07:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:07:33.862773698 +0000 UTC m=+22.821793206" watchObservedRunningTime="2026-09-17 14:07:33.862825768 +0000 UTC m=+22.821845275" Sep 17 14:07:34.457506 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:34.457402 2558 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-17T14:07:33.592081164Z","UUID":"c7e87182-cdac-4027-afa9-b4ab882306e6","Handler":null,"Name":"","Endpoint":""} Sep 17 14:07:34.459075 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:34.459052 2558 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 17 14:07:34.459185 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:34.459083 2558 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 17 14:07:34.527384 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:34.527352 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9jk57" Sep 17 14:07:34.527598 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:34.527464 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9jk57" podUID="78551199-0cec-4921-b8a1-0858742751f4" Sep 17 14:07:34.527598 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:34.527519 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8qrmx" Sep 17 14:07:34.527721 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:34.527658 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8qrmx" podUID="345f5575-9f8c-486b-9d57-7570a932d5a4" Sep 17 14:07:34.805849 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:34.805752 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4fmh9" event={"ID":"4ea05435-876e-4840-bc47-88b919b7a5a9","Type":"ContainerStarted","Data":"cbefca98fe0b7476138f85513b67ad69d12cfc02eb515e2e58005de3c58ef440"} Sep 17 14:07:34.827410 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:34.827361 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4fmh9" podStartSLOduration=2.008538192 podStartE2EDuration="22.827341324s" totalImagesPullingTime="20.818803132s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 14:07:12 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:07:34.827336207 +0000 UTC m=+23.786355717" watchObservedRunningTime="2026-09-17 14:07:34.827341324 +0000 UTC m=+23.786360832" Sep 17 14:07:35.527068 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:35.527036 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sqr44" Sep 17 14:07:35.527323 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:35.527155 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sqr44" podUID="b4cde3bb-db2e-4afd-b878-1ff65574484c" Sep 17 14:07:35.812057 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:35.811969 2558 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Sep 17 14:07:35.812057 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:35.811983 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8cqcg" event={"ID":"2dccbfdd-669a-4df0-b6f4-dbff79453c09","Type":"ContainerStarted","Data":"292882e8d33e349b77815336163e7af47d61f21351499df572bbe9a3df9d43db"} Sep 17 14:07:36.527665 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:36.527452 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9jk57" Sep 17 14:07:36.527827 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:36.527465 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8qrmx" Sep 17 14:07:36.527827 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:36.527767 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9jk57" podUID="78551199-0cec-4921-b8a1-0858742751f4" Sep 17 14:07:36.527959 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:36.527860 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8qrmx" podUID="345f5575-9f8c-486b-9d57-7570a932d5a4" Sep 17 14:07:37.526655 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:37.526585 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sqr44" Sep 17 14:07:37.527085 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:37.526707 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sqr44" podUID="b4cde3bb-db2e-4afd-b878-1ff65574484c" Sep 17 14:07:38.003709 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:38.003444 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-r9gxb" Sep 17 14:07:38.003925 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:38.003707 2558 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Sep 17 14:07:38.004366 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:38.004261 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-r9gxb" Sep 17 14:07:38.527493 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:38.527281 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8qrmx" Sep 17 14:07:38.527827 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:38.527281 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9jk57" Sep 17 14:07:38.527827 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:38.527544 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8qrmx" podUID="345f5575-9f8c-486b-9d57-7570a932d5a4" Sep 17 14:07:38.527827 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:38.527603 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9jk57" podUID="78551199-0cec-4921-b8a1-0858742751f4" Sep 17 14:07:38.821533 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:38.821486 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8cqcg" event={"ID":"2dccbfdd-669a-4df0-b6f4-dbff79453c09","Type":"ContainerStarted","Data":"62bc76e19d4be51834649018be44d9771144ef956ca2f4a70cb1eed17de77503"} Sep 17 14:07:38.821768 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:38.821742 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8cqcg" Sep 17 14:07:38.823559 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:38.823528 2558 generic.go:356] "Generic (PLEG): container finished" podID="04e96b35-1239-43a4-92fb-ade601f5358e" containerID="6517c0614910df9e90be197bb83a3c230f98556e0177ad0436b6542380b19ff7" exitCode=0 Sep 17 14:07:38.823639 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:38.823602 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g2rvj" event={"ID":"04e96b35-1239-43a4-92fb-ade601f5358e","Type":"ContainerDied","Data":"6517c0614910df9e90be197bb83a3c230f98556e0177ad0436b6542380b19ff7"} Sep 17 14:07:38.840978 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:38.840960 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8cqcg" Sep 17 14:07:38.850693 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:38.850657 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-8cqcg" podStartSLOduration=7.331149446 podStartE2EDuration="26.850644116s" totalImagesPullingTime="19.51949467s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 14:07:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:07:38.849701091 +0000 UTC m=+27.808720613" watchObservedRunningTime="2026-09-17 14:07:38.850644116 +0000 UTC m=+27.809663642" Sep 17 14:07:39.527558 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:39.527529 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sqr44" Sep 17 14:07:39.528162 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:39.527653 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sqr44" podUID="b4cde3bb-db2e-4afd-b878-1ff65574484c" Sep 17 14:07:39.830067 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:39.830039 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8cqcg" Sep 17 14:07:39.830221 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:39.830145 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8cqcg" Sep 17 14:07:39.835014 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:39.834987 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-sqr44"] Sep 17 14:07:39.835151 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:39.835104 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sqr44" Sep 17 14:07:39.835268 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:39.835206 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sqr44" podUID="b4cde3bb-db2e-4afd-b878-1ff65574484c" Sep 17 14:07:39.835722 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:39.835700 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-9jk57"] Sep 17 14:07:39.835825 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:39.835810 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9jk57" Sep 17 14:07:39.835929 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:39.835909 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9jk57" podUID="78551199-0cec-4921-b8a1-0858742751f4" Sep 17 14:07:39.837465 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:39.837443 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-8qrmx"] Sep 17 14:07:39.837624 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:39.837604 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8qrmx" Sep 17 14:07:39.837746 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:39.837724 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8qrmx" podUID="345f5575-9f8c-486b-9d57-7570a932d5a4" Sep 17 14:07:39.847955 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:39.847935 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8cqcg" Sep 17 14:07:40.833610 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:40.833576 2558 generic.go:356] "Generic (PLEG): container finished" podID="04e96b35-1239-43a4-92fb-ade601f5358e" containerID="12a2a45ea8f3eeea740d32215a35934f81e09961b1bad41980e2e5e7f18124e3" exitCode=0 Sep 17 14:07:40.834381 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:40.833646 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g2rvj" event={"ID":"04e96b35-1239-43a4-92fb-ade601f5358e","Type":"ContainerDied","Data":"12a2a45ea8f3eeea740d32215a35934f81e09961b1bad41980e2e5e7f18124e3"} Sep 17 14:07:41.529878 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:41.529808 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sqr44" Sep 17 14:07:41.530003 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:41.529903 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sqr44" podUID="b4cde3bb-db2e-4afd-b878-1ff65574484c" Sep 17 14:07:41.530003 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:41.529977 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8qrmx" Sep 17 14:07:41.530088 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:41.530071 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8qrmx" podUID="345f5575-9f8c-486b-9d57-7570a932d5a4" Sep 17 14:07:41.530123 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:41.530113 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9jk57" Sep 17 14:07:41.530197 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:41.530181 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9jk57" podUID="78551199-0cec-4921-b8a1-0858742751f4" Sep 17 14:07:42.840358 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:42.840116 2558 generic.go:356] "Generic (PLEG): container finished" podID="04e96b35-1239-43a4-92fb-ade601f5358e" containerID="02481db378746245f0ec8e9af43f623e70f1a26005ce04275af19485b1d8cbfc" exitCode=0 Sep 17 14:07:42.840752 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:42.840194 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g2rvj" event={"ID":"04e96b35-1239-43a4-92fb-ade601f5358e","Type":"ContainerDied","Data":"02481db378746245f0ec8e9af43f623e70f1a26005ce04275af19485b1d8cbfc"} Sep 17 14:07:43.531562 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:43.531044 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sqr44" Sep 17 14:07:43.531562 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:43.531160 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8qrmx" Sep 17 14:07:43.531562 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:43.531176 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sqr44" podUID="b4cde3bb-db2e-4afd-b878-1ff65574484c" Sep 17 14:07:43.531562 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:43.531195 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9jk57" Sep 17 14:07:43.531562 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:43.531297 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8qrmx" podUID="345f5575-9f8c-486b-9d57-7570a932d5a4" Sep 17 14:07:43.531562 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:43.531382 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9jk57" podUID="78551199-0cec-4921-b8a1-0858742751f4" Sep 17 14:07:44.250328 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:44.250291 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/345f5575-9f8c-486b-9d57-7570a932d5a4-metrics-certs\") pod \"network-metrics-daemon-8qrmx\" (UID: \"345f5575-9f8c-486b-9d57-7570a932d5a4\") " pod="openshift-multus/network-metrics-daemon-8qrmx" Sep 17 14:07:44.250737 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:44.250345 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/78551199-0cec-4921-b8a1-0858742751f4-original-pull-secret\") pod \"global-pull-secret-syncer-9jk57\" (UID: \"78551199-0cec-4921-b8a1-0858742751f4\") " pod="kube-system/global-pull-secret-syncer-9jk57" Sep 17 14:07:44.250737 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:44.250450 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 14:07:44.250737 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:44.250468 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 14:07:44.250737 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:44.250548 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/78551199-0cec-4921-b8a1-0858742751f4-original-pull-secret podName:78551199-0cec-4921-b8a1-0858742751f4 nodeName:}" failed. No retries permitted until 2026-09-17 14:08:16.250528621 +0000 UTC m=+65.209548108 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/78551199-0cec-4921-b8a1-0858742751f4-original-pull-secret") pod "global-pull-secret-syncer-9jk57" (UID: "78551199-0cec-4921-b8a1-0858742751f4") : object "kube-system"/"original-pull-secret" not registered Sep 17 14:07:44.250737 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:44.250567 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/345f5575-9f8c-486b-9d57-7570a932d5a4-metrics-certs podName:345f5575-9f8c-486b-9d57-7570a932d5a4 nodeName:}" failed. No retries permitted until 2026-09-17 14:08:16.25055723 +0000 UTC m=+65.209576719 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/345f5575-9f8c-486b-9d57-7570a932d5a4-metrics-certs") pod "network-metrics-daemon-8qrmx" (UID: "345f5575-9f8c-486b-9d57-7570a932d5a4") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 14:07:44.351636 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:44.351602 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqsk7\" (UniqueName: \"kubernetes.io/projected/b4cde3bb-db2e-4afd-b878-1ff65574484c-kube-api-access-vqsk7\") pod \"network-check-target-sqr44\" (UID: \"b4cde3bb-db2e-4afd-b878-1ff65574484c\") " pod="openshift-network-diagnostics/network-check-target-sqr44" Sep 17 14:07:44.351775 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:44.351733 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 14:07:44.351775 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:44.351751 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 14:07:44.351775 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:44.351759 2558 projected.go:196] Error preparing data for projected volume kube-api-access-vqsk7 for pod openshift-network-diagnostics/network-check-target-sqr44: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 14:07:44.351938 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:44.351805 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b4cde3bb-db2e-4afd-b878-1ff65574484c-kube-api-access-vqsk7 podName:b4cde3bb-db2e-4afd-b878-1ff65574484c nodeName:}" failed. No retries permitted until 2026-09-17 14:08:16.351789035 +0000 UTC m=+65.310808541 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-vqsk7" (UniqueName: "kubernetes.io/projected/b4cde3bb-db2e-4afd-b878-1ff65574484c-kube-api-access-vqsk7") pod "network-check-target-sqr44" (UID: "b4cde3bb-db2e-4afd-b878-1ff65574484c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 14:07:44.803715 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:44.803688 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-36.ec2.internal" event="NodeReady" Sep 17 14:07:44.803854 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:44.803841 2558 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 17 14:07:44.868346 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:44.868320 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-gjjjg"] Sep 17 14:07:44.880913 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:44.880888 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-dgk98"] Sep 17 14:07:44.881062 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:44.881038 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-gjjjg" Sep 17 14:07:44.886332 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:44.886276 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 17 14:07:44.886483 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:44.886289 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 17 14:07:44.887536 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:44.887360 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-kn9wk\"" Sep 17 14:07:44.893076 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:44.893054 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-gjjjg"] Sep 17 14:07:44.893169 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:44.893095 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-dgk98"] Sep 17 14:07:44.893228 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:44.893179 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-dgk98" Sep 17 14:07:44.895759 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:44.895739 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-bmplm\"" Sep 17 14:07:44.895855 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:44.895774 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 17 14:07:44.896216 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:44.896198 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 17 14:07:44.896538 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:44.896519 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 17 14:07:44.955743 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:44.955716 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h2x2r\" (UniqueName: \"kubernetes.io/projected/288ba618-7808-4554-946b-8a4ed475131a-kube-api-access-h2x2r\") pod \"dns-default-gjjjg\" (UID: \"288ba618-7808-4554-946b-8a4ed475131a\") " pod="openshift-dns/dns-default-gjjjg" Sep 17 14:07:44.955881 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:44.955746 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/288ba618-7808-4554-946b-8a4ed475131a-tmp-dir\") pod \"dns-default-gjjjg\" (UID: \"288ba618-7808-4554-946b-8a4ed475131a\") " pod="openshift-dns/dns-default-gjjjg" Sep 17 14:07:44.955881 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:44.955817 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/288ba618-7808-4554-946b-8a4ed475131a-metrics-tls\") pod \"dns-default-gjjjg\" (UID: \"288ba618-7808-4554-946b-8a4ed475131a\") " pod="openshift-dns/dns-default-gjjjg" Sep 17 14:07:44.955881 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:44.955841 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/288ba618-7808-4554-946b-8a4ed475131a-config-volume\") pod \"dns-default-gjjjg\" (UID: \"288ba618-7808-4554-946b-8a4ed475131a\") " pod="openshift-dns/dns-default-gjjjg" Sep 17 14:07:45.056845 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:45.056771 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/288ba618-7808-4554-946b-8a4ed475131a-config-volume\") pod \"dns-default-gjjjg\" (UID: \"288ba618-7808-4554-946b-8a4ed475131a\") " pod="openshift-dns/dns-default-gjjjg" Sep 17 14:07:45.056845 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:45.056820 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-snnp5\" (UniqueName: \"kubernetes.io/projected/77b443e6-d1b4-4737-b928-32ade7a07259-kube-api-access-snnp5\") pod \"ingress-canary-dgk98\" (UID: \"77b443e6-d1b4-4737-b928-32ade7a07259\") " pod="openshift-ingress-canary/ingress-canary-dgk98" Sep 17 14:07:45.057032 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:45.056923 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h2x2r\" (UniqueName: \"kubernetes.io/projected/288ba618-7808-4554-946b-8a4ed475131a-kube-api-access-h2x2r\") pod \"dns-default-gjjjg\" (UID: \"288ba618-7808-4554-946b-8a4ed475131a\") " pod="openshift-dns/dns-default-gjjjg" Sep 17 14:07:45.057032 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:45.056956 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/77b443e6-d1b4-4737-b928-32ade7a07259-cert\") pod \"ingress-canary-dgk98\" (UID: \"77b443e6-d1b4-4737-b928-32ade7a07259\") " pod="openshift-ingress-canary/ingress-canary-dgk98" Sep 17 14:07:45.057032 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:45.056991 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/288ba618-7808-4554-946b-8a4ed475131a-tmp-dir\") pod \"dns-default-gjjjg\" (UID: \"288ba618-7808-4554-946b-8a4ed475131a\") " pod="openshift-dns/dns-default-gjjjg" Sep 17 14:07:45.057173 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:45.057042 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/288ba618-7808-4554-946b-8a4ed475131a-metrics-tls\") pod \"dns-default-gjjjg\" (UID: \"288ba618-7808-4554-946b-8a4ed475131a\") " pod="openshift-dns/dns-default-gjjjg" Sep 17 14:07:45.057228 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:45.057178 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 17 14:07:45.057278 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:45.057236 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/288ba618-7808-4554-946b-8a4ed475131a-metrics-tls podName:288ba618-7808-4554-946b-8a4ed475131a nodeName:}" failed. No retries permitted until 2026-09-17 14:07:45.557217309 +0000 UTC m=+34.516236809 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/288ba618-7808-4554-946b-8a4ed475131a-metrics-tls") pod "dns-default-gjjjg" (UID: "288ba618-7808-4554-946b-8a4ed475131a") : secret "dns-default-metrics-tls" not found Sep 17 14:07:45.057470 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:45.057444 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/288ba618-7808-4554-946b-8a4ed475131a-config-volume\") pod \"dns-default-gjjjg\" (UID: \"288ba618-7808-4554-946b-8a4ed475131a\") " pod="openshift-dns/dns-default-gjjjg" Sep 17 14:07:45.057599 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:45.057476 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/288ba618-7808-4554-946b-8a4ed475131a-tmp-dir\") pod \"dns-default-gjjjg\" (UID: \"288ba618-7808-4554-946b-8a4ed475131a\") " pod="openshift-dns/dns-default-gjjjg" Sep 17 14:07:45.069764 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:45.069743 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h2x2r\" (UniqueName: \"kubernetes.io/projected/288ba618-7808-4554-946b-8a4ed475131a-kube-api-access-h2x2r\") pod \"dns-default-gjjjg\" (UID: \"288ba618-7808-4554-946b-8a4ed475131a\") " pod="openshift-dns/dns-default-gjjjg" Sep 17 14:07:45.158228 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:45.158201 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-snnp5\" (UniqueName: \"kubernetes.io/projected/77b443e6-d1b4-4737-b928-32ade7a07259-kube-api-access-snnp5\") pod \"ingress-canary-dgk98\" (UID: \"77b443e6-d1b4-4737-b928-32ade7a07259\") " pod="openshift-ingress-canary/ingress-canary-dgk98" Sep 17 14:07:45.158329 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:45.158285 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/77b443e6-d1b4-4737-b928-32ade7a07259-cert\") pod \"ingress-canary-dgk98\" (UID: \"77b443e6-d1b4-4737-b928-32ade7a07259\") " pod="openshift-ingress-canary/ingress-canary-dgk98" Sep 17 14:07:45.161032 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:45.161012 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/77b443e6-d1b4-4737-b928-32ade7a07259-cert\") pod \"ingress-canary-dgk98\" (UID: \"77b443e6-d1b4-4737-b928-32ade7a07259\") " pod="openshift-ingress-canary/ingress-canary-dgk98" Sep 17 14:07:45.167164 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:45.167142 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-snnp5\" (UniqueName: \"kubernetes.io/projected/77b443e6-d1b4-4737-b928-32ade7a07259-kube-api-access-snnp5\") pod \"ingress-canary-dgk98\" (UID: \"77b443e6-d1b4-4737-b928-32ade7a07259\") " pod="openshift-ingress-canary/ingress-canary-dgk98" Sep 17 14:07:45.203095 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:45.203070 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-dgk98" Sep 17 14:07:45.527013 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:45.526827 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9jk57" Sep 17 14:07:45.527488 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:45.526828 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8qrmx" Sep 17 14:07:45.527488 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:45.526890 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sqr44" Sep 17 14:07:45.529611 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:45.529592 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 17 14:07:45.530796 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:45.530768 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 17 14:07:45.530895 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:45.530862 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-wjfsd\"" Sep 17 14:07:45.530954 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:45.530912 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 17 14:07:45.530954 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:45.530859 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 17 14:07:45.531047 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:45.530912 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-5qqvj\"" Sep 17 14:07:45.540280 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:45.540258 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-dgk98"] Sep 17 14:07:45.543612 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:45.543592 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77b443e6_d1b4_4737_b928_32ade7a07259.slice/crio-eb5b637d84e504c77ef644430f53b1522f5d60f067e7ebfb2aef6b326a8c0b85 WatchSource:0}: Error finding container eb5b637d84e504c77ef644430f53b1522f5d60f067e7ebfb2aef6b326a8c0b85: Status 404 returned error can't find the container with id eb5b637d84e504c77ef644430f53b1522f5d60f067e7ebfb2aef6b326a8c0b85 Sep 17 14:07:45.560790 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:45.560737 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/288ba618-7808-4554-946b-8a4ed475131a-metrics-tls\") pod \"dns-default-gjjjg\" (UID: \"288ba618-7808-4554-946b-8a4ed475131a\") " pod="openshift-dns/dns-default-gjjjg" Sep 17 14:07:45.560875 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:45.560832 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 17 14:07:45.560927 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:45.560886 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/288ba618-7808-4554-946b-8a4ed475131a-metrics-tls podName:288ba618-7808-4554-946b-8a4ed475131a nodeName:}" failed. No retries permitted until 2026-09-17 14:07:46.560871824 +0000 UTC m=+35.519891309 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/288ba618-7808-4554-946b-8a4ed475131a-metrics-tls") pod "dns-default-gjjjg" (UID: "288ba618-7808-4554-946b-8a4ed475131a") : secret "dns-default-metrics-tls" not found Sep 17 14:07:45.849250 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:45.849212 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-dgk98" event={"ID":"77b443e6-d1b4-4737-b928-32ade7a07259","Type":"ContainerStarted","Data":"eb5b637d84e504c77ef644430f53b1522f5d60f067e7ebfb2aef6b326a8c0b85"} Sep 17 14:07:46.567400 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:46.567346 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/288ba618-7808-4554-946b-8a4ed475131a-metrics-tls\") pod \"dns-default-gjjjg\" (UID: \"288ba618-7808-4554-946b-8a4ed475131a\") " pod="openshift-dns/dns-default-gjjjg" Sep 17 14:07:46.567989 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:46.567487 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 17 14:07:46.567989 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:46.567552 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/288ba618-7808-4554-946b-8a4ed475131a-metrics-tls podName:288ba618-7808-4554-946b-8a4ed475131a nodeName:}" failed. No retries permitted until 2026-09-17 14:07:48.567538253 +0000 UTC m=+37.526557744 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/288ba618-7808-4554-946b-8a4ed475131a-metrics-tls") pod "dns-default-gjjjg" (UID: "288ba618-7808-4554-946b-8a4ed475131a") : secret "dns-default-metrics-tls" not found Sep 17 14:07:47.859752 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:47.859444 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g2rvj" event={"ID":"04e96b35-1239-43a4-92fb-ade601f5358e","Type":"ContainerStarted","Data":"38a0db5562bda25332e70788efa420310b292e0ff22f0dff3c9f9ae52d76ff3c"} Sep 17 14:07:48.583205 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:48.583166 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/288ba618-7808-4554-946b-8a4ed475131a-metrics-tls\") pod \"dns-default-gjjjg\" (UID: \"288ba618-7808-4554-946b-8a4ed475131a\") " pod="openshift-dns/dns-default-gjjjg" Sep 17 14:07:48.583370 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:48.583324 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 17 14:07:48.583425 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:48.583411 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/288ba618-7808-4554-946b-8a4ed475131a-metrics-tls podName:288ba618-7808-4554-946b-8a4ed475131a nodeName:}" failed. No retries permitted until 2026-09-17 14:07:52.583388491 +0000 UTC m=+41.542407982 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/288ba618-7808-4554-946b-8a4ed475131a-metrics-tls") pod "dns-default-gjjjg" (UID: "288ba618-7808-4554-946b-8a4ed475131a") : secret "dns-default-metrics-tls" not found Sep 17 14:07:48.866178 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:48.866097 2558 generic.go:356] "Generic (PLEG): container finished" podID="04e96b35-1239-43a4-92fb-ade601f5358e" containerID="38a0db5562bda25332e70788efa420310b292e0ff22f0dff3c9f9ae52d76ff3c" exitCode=0 Sep 17 14:07:48.866766 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:48.866179 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g2rvj" event={"ID":"04e96b35-1239-43a4-92fb-ade601f5358e","Type":"ContainerDied","Data":"38a0db5562bda25332e70788efa420310b292e0ff22f0dff3c9f9ae52d76ff3c"} Sep 17 14:07:49.872318 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:49.872289 2558 generic.go:356] "Generic (PLEG): container finished" podID="04e96b35-1239-43a4-92fb-ade601f5358e" containerID="205282387c81142afb8e318cddc3043a2b371504b0973200ed4bbd491dd34cec" exitCode=0 Sep 17 14:07:49.872672 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:49.872345 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g2rvj" event={"ID":"04e96b35-1239-43a4-92fb-ade601f5358e","Type":"ContainerDied","Data":"205282387c81142afb8e318cddc3043a2b371504b0973200ed4bbd491dd34cec"} Sep 17 14:07:50.846685 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:50.846491 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-q4dh5"] Sep 17 14:07:50.871322 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:50.871300 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-q4dh5"] Sep 17 14:07:50.871428 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:50.871399 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-q4dh5" Sep 17 14:07:50.878402 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:50.878377 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Sep 17 14:07:50.878826 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:50.878425 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 17 14:07:50.878826 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:50.878384 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Sep 17 14:07:50.878826 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:50.878574 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-ctlhq\"" Sep 17 14:07:50.878826 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:50.878634 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 17 14:07:50.881509 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:50.881471 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g2rvj" event={"ID":"04e96b35-1239-43a4-92fb-ade601f5358e","Type":"ContainerStarted","Data":"5d1310b09c15f869ec9e708644eb072658b2382c288f95757300b855834ad52c"} Sep 17 14:07:50.882992 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:50.882974 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-dgk98" event={"ID":"77b443e6-d1b4-4737-b928-32ade7a07259","Type":"ContainerStarted","Data":"f5985858c438a9e1436c195f68f62b0f10a976e013bcd652212051d97bd5fffe"} Sep 17 14:07:50.905989 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:50.905951 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-dgk98" podStartSLOduration=2.622939974 podStartE2EDuration="6.90593657s" totalImagesPullingTime="4.282996596s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:07:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:07:50.905705227 +0000 UTC m=+39.864724735" watchObservedRunningTime="2026-09-17 14:07:50.90593657 +0000 UTC m=+39.864956078" Sep 17 14:07:50.926506 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:50.926467 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-g2rvj" podStartSLOduration=8.119809282 podStartE2EDuration="38.926451832s" totalImagesPullingTime="30.80664255s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 14:07:12 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:07:50.925862082 +0000 UTC m=+39.884881590" watchObservedRunningTime="2026-09-17 14:07:50.926451832 +0000 UTC m=+39.885471337" Sep 17 14:07:50.958458 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:50.958429 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-cf7c776b7-tx9n9"] Sep 17 14:07:50.978771 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:50.978751 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-696884fb9c-d6h6t"] Sep 17 14:07:50.978886 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:50.978869 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-tx9n9" Sep 17 14:07:50.981883 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:50.981862 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Sep 17 14:07:50.982546 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:50.982526 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Sep 17 14:07:50.982721 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:50.982556 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Sep 17 14:07:50.982840 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:50.982757 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-6lfsq\"" Sep 17 14:07:50.982959 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:50.982947 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Sep 17 14:07:51.001206 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:51.001183 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/7e32a93a-9533-4d08-a4a4-b17a74a3c0f6-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-q4dh5\" (UID: \"7e32a93a-9533-4d08-a4a4-b17a74a3c0f6\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-q4dh5" Sep 17 14:07:51.001380 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:51.001356 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wfrgn\" (UniqueName: \"kubernetes.io/projected/7e32a93a-9533-4d08-a4a4-b17a74a3c0f6-kube-api-access-wfrgn\") pod \"cluster-monitoring-operator-6cd954b897-q4dh5\" (UID: \"7e32a93a-9533-4d08-a4a4-b17a74a3c0f6\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-q4dh5" Sep 17 14:07:51.001456 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:51.001395 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7e32a93a-9533-4d08-a4a4-b17a74a3c0f6-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-q4dh5\" (UID: \"7e32a93a-9533-4d08-a4a4-b17a74a3c0f6\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-q4dh5" Sep 17 14:07:51.003172 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:51.003154 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-gc9vp"] Sep 17 14:07:51.003272 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:51.003257 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-696884fb9c-d6h6t" Sep 17 14:07:51.005678 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:51.005662 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Sep 17 14:07:51.005943 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:51.005922 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Sep 17 14:07:51.006032 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:51.005946 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-9tmqd\"" Sep 17 14:07:51.006032 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:51.005970 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Sep 17 14:07:51.006256 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:51.006240 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Sep 17 14:07:51.014401 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:51.014384 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Sep 17 14:07:51.027069 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:51.027051 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-78f666855d-9dpdw"] Sep 17 14:07:51.027193 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:51.027179 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-gc9vp" Sep 17 14:07:51.029244 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:51.029229 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Sep 17 14:07:51.029828 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:51.029804 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Sep 17 14:07:51.029935 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:51.029918 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-9w7hp\"" Sep 17 14:07:51.030008 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:51.029940 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Sep 17 14:07:51.047083 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:51.047059 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-cf7c776b7-tx9n9"] Sep 17 14:07:51.047158 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:51.047122 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-696884fb9c-d6h6t"] Sep 17 14:07:51.047158 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:51.047139 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-gc9vp"] Sep 17 14:07:51.047158 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:51.047064 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-78f666855d-9dpdw" Sep 17 14:07:51.047247 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:51.047164 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-78f666855d-9dpdw"] Sep 17 14:07:51.052219 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:51.052204 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Sep 17 14:07:51.052330 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:51.052206 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Sep 17 14:07:51.052330 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:51.052276 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Sep 17 14:07:51.052473 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:51.052382 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Sep 17 14:07:51.052553 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:51.052533 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Sep 17 14:07:51.052828 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:51.052812 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-lpllj\"" Sep 17 14:07:51.052987 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:51.052974 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Sep 17 14:07:51.071372 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:51.071354 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6946f4785b-9wxrg"] Sep 17 14:07:51.097511 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:51.097436 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6946f4785b-9wxrg" Sep 17 14:07:51.097651 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:51.097632 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6946f4785b-9wxrg"] Sep 17 14:07:51.102061 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:51.102036 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/7e32a93a-9533-4d08-a4a4-b17a74a3c0f6-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-q4dh5\" (UID: \"7e32a93a-9533-4d08-a4a4-b17a74a3c0f6\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-q4dh5" Sep 17 14:07:51.102162 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:51.102076 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wfrgn\" (UniqueName: \"kubernetes.io/projected/7e32a93a-9533-4d08-a4a4-b17a74a3c0f6-kube-api-access-wfrgn\") pod \"cluster-monitoring-operator-6cd954b897-q4dh5\" (UID: \"7e32a93a-9533-4d08-a4a4-b17a74a3c0f6\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-q4dh5" Sep 17 14:07:51.102162 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:51.102106 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-snxrm\" (UniqueName: \"kubernetes.io/projected/7cceb3c6-9b3b-4d8c-abc0-2febaefa1174-kube-api-access-snxrm\") pod \"service-ca-operator-cf7c776b7-tx9n9\" (UID: \"7cceb3c6-9b3b-4d8c-abc0-2febaefa1174\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-tx9n9" Sep 17 14:07:51.102162 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:51.102135 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7e32a93a-9533-4d08-a4a4-b17a74a3c0f6-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-q4dh5\" (UID: \"7e32a93a-9533-4d08-a4a4-b17a74a3c0f6\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-q4dh5" Sep 17 14:07:51.102414 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:51.102162 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c723f8fb-19bb-4b1a-952b-90698d5605f0-trusted-ca\") pod \"console-operator-696884fb9c-d6h6t\" (UID: \"c723f8fb-19bb-4b1a-952b-90698d5605f0\") " pod="openshift-console-operator/console-operator-696884fb9c-d6h6t" Sep 17 14:07:51.102414 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:51.102190 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c723f8fb-19bb-4b1a-952b-90698d5605f0-config\") pod \"console-operator-696884fb9c-d6h6t\" (UID: \"c723f8fb-19bb-4b1a-952b-90698d5605f0\") " pod="openshift-console-operator/console-operator-696884fb9c-d6h6t" Sep 17 14:07:51.102414 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:51.102222 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wknm\" (UniqueName: \"kubernetes.io/projected/c723f8fb-19bb-4b1a-952b-90698d5605f0-kube-api-access-6wknm\") pod \"console-operator-696884fb9c-d6h6t\" (UID: \"c723f8fb-19bb-4b1a-952b-90698d5605f0\") " pod="openshift-console-operator/console-operator-696884fb9c-d6h6t" Sep 17 14:07:51.102414 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:51.102242 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c723f8fb-19bb-4b1a-952b-90698d5605f0-serving-cert\") pod \"console-operator-696884fb9c-d6h6t\" (UID: \"c723f8fb-19bb-4b1a-952b-90698d5605f0\") " pod="openshift-console-operator/console-operator-696884fb9c-d6h6t" Sep 17 14:07:51.102414 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:51.102268 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7cceb3c6-9b3b-4d8c-abc0-2febaefa1174-config\") pod \"service-ca-operator-cf7c776b7-tx9n9\" (UID: \"7cceb3c6-9b3b-4d8c-abc0-2febaefa1174\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-tx9n9" Sep 17 14:07:51.102414 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:51.102271 2558 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 17 14:07:51.102414 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:51.102299 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7cceb3c6-9b3b-4d8c-abc0-2febaefa1174-serving-cert\") pod \"service-ca-operator-cf7c776b7-tx9n9\" (UID: \"7cceb3c6-9b3b-4d8c-abc0-2febaefa1174\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-tx9n9" Sep 17 14:07:51.102414 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:51.102344 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e32a93a-9533-4d08-a4a4-b17a74a3c0f6-cluster-monitoring-operator-tls podName:7e32a93a-9533-4d08-a4a4-b17a74a3c0f6 nodeName:}" failed. No retries permitted until 2026-09-17 14:07:51.602322752 +0000 UTC m=+40.561342259 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/7e32a93a-9533-4d08-a4a4-b17a74a3c0f6-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-q4dh5" (UID: "7e32a93a-9533-4d08-a4a4-b17a74a3c0f6") : secret "cluster-monitoring-operator-tls" not found Sep 17 14:07:51.102896 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:51.102876 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/7e32a93a-9533-4d08-a4a4-b17a74a3c0f6-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-q4dh5\" (UID: \"7e32a93a-9533-4d08-a4a4-b17a74a3c0f6\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-q4dh5" Sep 17 14:07:51.106076 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:51.106060 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Sep 17 14:07:51.106156 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:51.106097 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Sep 17 14:07:51.106224 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:51.106097 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-lg2lx\"" Sep 17 14:07:51.106532 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:51.106514 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Sep 17 14:07:51.112163 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:51.112146 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Sep 17 14:07:51.114444 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:51.114430 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wfrgn\" (UniqueName: \"kubernetes.io/projected/7e32a93a-9533-4d08-a4a4-b17a74a3c0f6-kube-api-access-wfrgn\") pod \"cluster-monitoring-operator-6cd954b897-q4dh5\" (UID: \"7e32a93a-9533-4d08-a4a4-b17a74a3c0f6\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-q4dh5" Sep 17 14:07:51.202858 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:51.202833 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-snxrm\" (UniqueName: \"kubernetes.io/projected/7cceb3c6-9b3b-4d8c-abc0-2febaefa1174-kube-api-access-snxrm\") pod \"service-ca-operator-cf7c776b7-tx9n9\" (UID: \"7cceb3c6-9b3b-4d8c-abc0-2febaefa1174\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-tx9n9" Sep 17 14:07:51.202961 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:51.202871 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e0e7ba35-7911-4320-97a9-85e2099b81e3-image-registry-private-configuration\") pod \"image-registry-6946f4785b-9wxrg\" (UID: \"e0e7ba35-7911-4320-97a9-85e2099b81e3\") " pod="openshift-image-registry/image-registry-6946f4785b-9wxrg" Sep 17 14:07:51.202961 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:51.202889 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/63f7b6df-18e8-435a-a4eb-488c23b60007-metrics-certs\") pod \"router-default-78f666855d-9dpdw\" (UID: \"63f7b6df-18e8-435a-a4eb-488c23b60007\") " pod="openshift-ingress/router-default-78f666855d-9dpdw" Sep 17 14:07:51.202961 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:51.202927 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e0e7ba35-7911-4320-97a9-85e2099b81e3-installation-pull-secrets\") pod \"image-registry-6946f4785b-9wxrg\" (UID: \"e0e7ba35-7911-4320-97a9-85e2099b81e3\") " pod="openshift-image-registry/image-registry-6946f4785b-9wxrg" Sep 17 14:07:51.203083 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:51.203055 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/63f7b6df-18e8-435a-a4eb-488c23b60007-stats-auth\") pod \"router-default-78f666855d-9dpdw\" (UID: \"63f7b6df-18e8-435a-a4eb-488c23b60007\") " pod="openshift-ingress/router-default-78f666855d-9dpdw" Sep 17 14:07:51.203135 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:51.203109 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c723f8fb-19bb-4b1a-952b-90698d5605f0-serving-cert\") pod \"console-operator-696884fb9c-d6h6t\" (UID: \"c723f8fb-19bb-4b1a-952b-90698d5605f0\") " pod="openshift-console-operator/console-operator-696884fb9c-d6h6t" Sep 17 14:07:51.203187 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:51.203149 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e0e7ba35-7911-4320-97a9-85e2099b81e3-ca-trust-extracted\") pod \"image-registry-6946f4785b-9wxrg\" (UID: \"e0e7ba35-7911-4320-97a9-85e2099b81e3\") " pod="openshift-image-registry/image-registry-6946f4785b-9wxrg" Sep 17 14:07:51.203244 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:51.203193 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c68bd81c-848d-41b8-a09e-82b3c8be7a2d-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-gc9vp\" (UID: \"c68bd81c-848d-41b8-a09e-82b3c8be7a2d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-gc9vp" Sep 17 14:07:51.203244 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:51.203221 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e0e7ba35-7911-4320-97a9-85e2099b81e3-trusted-ca\") pod \"image-registry-6946f4785b-9wxrg\" (UID: \"e0e7ba35-7911-4320-97a9-85e2099b81e3\") " pod="openshift-image-registry/image-registry-6946f4785b-9wxrg" Sep 17 14:07:51.203342 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:51.203249 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7cceb3c6-9b3b-4d8c-abc0-2febaefa1174-serving-cert\") pod \"service-ca-operator-cf7c776b7-tx9n9\" (UID: \"7cceb3c6-9b3b-4d8c-abc0-2febaefa1174\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-tx9n9" Sep 17 14:07:51.203342 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:51.203278 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63f7b6df-18e8-435a-a4eb-488c23b60007-service-ca-bundle\") pod \"router-default-78f666855d-9dpdw\" (UID: \"63f7b6df-18e8-435a-a4eb-488c23b60007\") " pod="openshift-ingress/router-default-78f666855d-9dpdw" Sep 17 14:07:51.203342 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:51.203302 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e0e7ba35-7911-4320-97a9-85e2099b81e3-registry-tls\") pod \"image-registry-6946f4785b-9wxrg\" (UID: \"e0e7ba35-7911-4320-97a9-85e2099b81e3\") " pod="openshift-image-registry/image-registry-6946f4785b-9wxrg" Sep 17 14:07:51.203484 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:51.203348 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6wknm\" (UniqueName: \"kubernetes.io/projected/c723f8fb-19bb-4b1a-952b-90698d5605f0-kube-api-access-6wknm\") pod \"console-operator-696884fb9c-d6h6t\" (UID: \"c723f8fb-19bb-4b1a-952b-90698d5605f0\") " pod="openshift-console-operator/console-operator-696884fb9c-d6h6t" Sep 17 14:07:51.203484 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:51.203377 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xmccs\" (UniqueName: \"kubernetes.io/projected/c68bd81c-848d-41b8-a09e-82b3c8be7a2d-kube-api-access-xmccs\") pod \"cluster-samples-operator-86499c89c4-gc9vp\" (UID: \"c68bd81c-848d-41b8-a09e-82b3c8be7a2d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-gc9vp" Sep 17 14:07:51.203484 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:51.203411 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c723f8fb-19bb-4b1a-952b-90698d5605f0-trusted-ca\") pod \"console-operator-696884fb9c-d6h6t\" (UID: \"c723f8fb-19bb-4b1a-952b-90698d5605f0\") " pod="openshift-console-operator/console-operator-696884fb9c-d6h6t" Sep 17 14:07:51.203484 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:51.203437 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e0e7ba35-7911-4320-97a9-85e2099b81e3-registry-certificates\") pod \"image-registry-6946f4785b-9wxrg\" (UID: \"e0e7ba35-7911-4320-97a9-85e2099b81e3\") " pod="openshift-image-registry/image-registry-6946f4785b-9wxrg" Sep 17 14:07:51.203484 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:51.203460 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l9lll\" (UniqueName: \"kubernetes.io/projected/e0e7ba35-7911-4320-97a9-85e2099b81e3-kube-api-access-l9lll\") pod \"image-registry-6946f4785b-9wxrg\" (UID: \"e0e7ba35-7911-4320-97a9-85e2099b81e3\") " pod="openshift-image-registry/image-registry-6946f4785b-9wxrg" Sep 17 14:07:51.203747 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:51.203514 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c723f8fb-19bb-4b1a-952b-90698d5605f0-config\") pod \"console-operator-696884fb9c-d6h6t\" (UID: \"c723f8fb-19bb-4b1a-952b-90698d5605f0\") " pod="openshift-console-operator/console-operator-696884fb9c-d6h6t" Sep 17 14:07:51.203747 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:51.203587 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7cceb3c6-9b3b-4d8c-abc0-2febaefa1174-config\") pod \"service-ca-operator-cf7c776b7-tx9n9\" (UID: \"7cceb3c6-9b3b-4d8c-abc0-2febaefa1174\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-tx9n9" Sep 17 14:07:51.203747 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:51.203655 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e0e7ba35-7911-4320-97a9-85e2099b81e3-bound-sa-token\") pod \"image-registry-6946f4785b-9wxrg\" (UID: \"e0e7ba35-7911-4320-97a9-85e2099b81e3\") " pod="openshift-image-registry/image-registry-6946f4785b-9wxrg" Sep 17 14:07:51.203747 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:51.203689 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/63f7b6df-18e8-435a-a4eb-488c23b60007-default-certificate\") pod \"router-default-78f666855d-9dpdw\" (UID: \"63f7b6df-18e8-435a-a4eb-488c23b60007\") " pod="openshift-ingress/router-default-78f666855d-9dpdw" Sep 17 14:07:51.203747 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:51.203738 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pt86t\" (UniqueName: \"kubernetes.io/projected/63f7b6df-18e8-435a-a4eb-488c23b60007-kube-api-access-pt86t\") pod \"router-default-78f666855d-9dpdw\" (UID: \"63f7b6df-18e8-435a-a4eb-488c23b60007\") " pod="openshift-ingress/router-default-78f666855d-9dpdw" Sep 17 14:07:51.204181 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:51.204162 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c723f8fb-19bb-4b1a-952b-90698d5605f0-config\") pod \"console-operator-696884fb9c-d6h6t\" (UID: \"c723f8fb-19bb-4b1a-952b-90698d5605f0\") " pod="openshift-console-operator/console-operator-696884fb9c-d6h6t" Sep 17 14:07:51.204255 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:51.204229 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7cceb3c6-9b3b-4d8c-abc0-2febaefa1174-config\") pod \"service-ca-operator-cf7c776b7-tx9n9\" (UID: \"7cceb3c6-9b3b-4d8c-abc0-2febaefa1174\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-tx9n9" Sep 17 14:07:51.204779 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:51.204757 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c723f8fb-19bb-4b1a-952b-90698d5605f0-trusted-ca\") pod \"console-operator-696884fb9c-d6h6t\" (UID: \"c723f8fb-19bb-4b1a-952b-90698d5605f0\") " pod="openshift-console-operator/console-operator-696884fb9c-d6h6t" Sep 17 14:07:51.205322 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:51.205304 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c723f8fb-19bb-4b1a-952b-90698d5605f0-serving-cert\") pod \"console-operator-696884fb9c-d6h6t\" (UID: \"c723f8fb-19bb-4b1a-952b-90698d5605f0\") " pod="openshift-console-operator/console-operator-696884fb9c-d6h6t" Sep 17 14:07:51.205587 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:51.205571 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7cceb3c6-9b3b-4d8c-abc0-2febaefa1174-serving-cert\") pod \"service-ca-operator-cf7c776b7-tx9n9\" (UID: \"7cceb3c6-9b3b-4d8c-abc0-2febaefa1174\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-tx9n9" Sep 17 14:07:51.213089 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:51.213066 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wknm\" (UniqueName: \"kubernetes.io/projected/c723f8fb-19bb-4b1a-952b-90698d5605f0-kube-api-access-6wknm\") pod \"console-operator-696884fb9c-d6h6t\" (UID: \"c723f8fb-19bb-4b1a-952b-90698d5605f0\") " pod="openshift-console-operator/console-operator-696884fb9c-d6h6t" Sep 17 14:07:51.214691 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:51.214676 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-snxrm\" (UniqueName: \"kubernetes.io/projected/7cceb3c6-9b3b-4d8c-abc0-2febaefa1174-kube-api-access-snxrm\") pod \"service-ca-operator-cf7c776b7-tx9n9\" (UID: \"7cceb3c6-9b3b-4d8c-abc0-2febaefa1174\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-tx9n9" Sep 17 14:07:51.289111 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:51.289091 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-tx9n9" Sep 17 14:07:51.304358 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:51.304340 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmccs\" (UniqueName: \"kubernetes.io/projected/c68bd81c-848d-41b8-a09e-82b3c8be7a2d-kube-api-access-xmccs\") pod \"cluster-samples-operator-86499c89c4-gc9vp\" (UID: \"c68bd81c-848d-41b8-a09e-82b3c8be7a2d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-gc9vp" Sep 17 14:07:51.304432 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:51.304366 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e0e7ba35-7911-4320-97a9-85e2099b81e3-registry-certificates\") pod \"image-registry-6946f4785b-9wxrg\" (UID: \"e0e7ba35-7911-4320-97a9-85e2099b81e3\") " pod="openshift-image-registry/image-registry-6946f4785b-9wxrg" Sep 17 14:07:51.304432 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:51.304385 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l9lll\" (UniqueName: \"kubernetes.io/projected/e0e7ba35-7911-4320-97a9-85e2099b81e3-kube-api-access-l9lll\") pod \"image-registry-6946f4785b-9wxrg\" (UID: \"e0e7ba35-7911-4320-97a9-85e2099b81e3\") " pod="openshift-image-registry/image-registry-6946f4785b-9wxrg" Sep 17 14:07:51.304432 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:51.304408 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e0e7ba35-7911-4320-97a9-85e2099b81e3-bound-sa-token\") pod \"image-registry-6946f4785b-9wxrg\" (UID: \"e0e7ba35-7911-4320-97a9-85e2099b81e3\") " pod="openshift-image-registry/image-registry-6946f4785b-9wxrg" Sep 17 14:07:51.304609 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:51.304534 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/63f7b6df-18e8-435a-a4eb-488c23b60007-default-certificate\") pod \"router-default-78f666855d-9dpdw\" (UID: \"63f7b6df-18e8-435a-a4eb-488c23b60007\") " pod="openshift-ingress/router-default-78f666855d-9dpdw" Sep 17 14:07:51.304609 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:51.304577 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pt86t\" (UniqueName: \"kubernetes.io/projected/63f7b6df-18e8-435a-a4eb-488c23b60007-kube-api-access-pt86t\") pod \"router-default-78f666855d-9dpdw\" (UID: \"63f7b6df-18e8-435a-a4eb-488c23b60007\") " pod="openshift-ingress/router-default-78f666855d-9dpdw" Sep 17 14:07:51.304704 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:51.304686 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e0e7ba35-7911-4320-97a9-85e2099b81e3-image-registry-private-configuration\") pod \"image-registry-6946f4785b-9wxrg\" (UID: \"e0e7ba35-7911-4320-97a9-85e2099b81e3\") " pod="openshift-image-registry/image-registry-6946f4785b-9wxrg" Sep 17 14:07:51.304765 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:51.304718 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/63f7b6df-18e8-435a-a4eb-488c23b60007-metrics-certs\") pod \"router-default-78f666855d-9dpdw\" (UID: \"63f7b6df-18e8-435a-a4eb-488c23b60007\") " pod="openshift-ingress/router-default-78f666855d-9dpdw" Sep 17 14:07:51.304765 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:51.304758 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e0e7ba35-7911-4320-97a9-85e2099b81e3-installation-pull-secrets\") pod \"image-registry-6946f4785b-9wxrg\" (UID: \"e0e7ba35-7911-4320-97a9-85e2099b81e3\") " pod="openshift-image-registry/image-registry-6946f4785b-9wxrg" Sep 17 14:07:51.304866 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:51.304782 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/63f7b6df-18e8-435a-a4eb-488c23b60007-stats-auth\") pod \"router-default-78f666855d-9dpdw\" (UID: \"63f7b6df-18e8-435a-a4eb-488c23b60007\") " pod="openshift-ingress/router-default-78f666855d-9dpdw" Sep 17 14:07:51.304866 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:51.304812 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e0e7ba35-7911-4320-97a9-85e2099b81e3-ca-trust-extracted\") pod \"image-registry-6946f4785b-9wxrg\" (UID: \"e0e7ba35-7911-4320-97a9-85e2099b81e3\") " pod="openshift-image-registry/image-registry-6946f4785b-9wxrg" Sep 17 14:07:51.304866 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:51.304840 2558 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 17 14:07:51.304866 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:51.304855 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c68bd81c-848d-41b8-a09e-82b3c8be7a2d-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-gc9vp\" (UID: \"c68bd81c-848d-41b8-a09e-82b3c8be7a2d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-gc9vp" Sep 17 14:07:51.305063 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:51.304887 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e0e7ba35-7911-4320-97a9-85e2099b81e3-trusted-ca\") pod \"image-registry-6946f4785b-9wxrg\" (UID: \"e0e7ba35-7911-4320-97a9-85e2099b81e3\") " pod="openshift-image-registry/image-registry-6946f4785b-9wxrg" Sep 17 14:07:51.305063 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:51.304915 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63f7b6df-18e8-435a-a4eb-488c23b60007-service-ca-bundle\") pod \"router-default-78f666855d-9dpdw\" (UID: \"63f7b6df-18e8-435a-a4eb-488c23b60007\") " pod="openshift-ingress/router-default-78f666855d-9dpdw" Sep 17 14:07:51.305063 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:51.304939 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e0e7ba35-7911-4320-97a9-85e2099b81e3-registry-tls\") pod \"image-registry-6946f4785b-9wxrg\" (UID: \"e0e7ba35-7911-4320-97a9-85e2099b81e3\") " pod="openshift-image-registry/image-registry-6946f4785b-9wxrg" Sep 17 14:07:51.305063 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:51.304972 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e0e7ba35-7911-4320-97a9-85e2099b81e3-registry-certificates\") pod \"image-registry-6946f4785b-9wxrg\" (UID: \"e0e7ba35-7911-4320-97a9-85e2099b81e3\") " pod="openshift-image-registry/image-registry-6946f4785b-9wxrg" Sep 17 14:07:51.305063 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:51.305033 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63f7b6df-18e8-435a-a4eb-488c23b60007-metrics-certs podName:63f7b6df-18e8-435a-a4eb-488c23b60007 nodeName:}" failed. No retries permitted until 2026-09-17 14:07:51.805013945 +0000 UTC m=+40.764033445 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/63f7b6df-18e8-435a-a4eb-488c23b60007-metrics-certs") pod "router-default-78f666855d-9dpdw" (UID: "63f7b6df-18e8-435a-a4eb-488c23b60007") : secret "router-metrics-certs-default" not found Sep 17 14:07:51.305063 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:51.305062 2558 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 17 14:07:51.305364 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:51.305123 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/63f7b6df-18e8-435a-a4eb-488c23b60007-service-ca-bundle podName:63f7b6df-18e8-435a-a4eb-488c23b60007 nodeName:}" failed. No retries permitted until 2026-09-17 14:07:51.805106522 +0000 UTC m=+40.764126011 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/63f7b6df-18e8-435a-a4eb-488c23b60007-service-ca-bundle") pod "router-default-78f666855d-9dpdw" (UID: "63f7b6df-18e8-435a-a4eb-488c23b60007") : configmap references non-existent config key: service-ca.crt Sep 17 14:07:51.305364 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:51.305151 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c68bd81c-848d-41b8-a09e-82b3c8be7a2d-samples-operator-tls podName:c68bd81c-848d-41b8-a09e-82b3c8be7a2d nodeName:}" failed. No retries permitted until 2026-09-17 14:07:51.805134176 +0000 UTC m=+40.764153751 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/c68bd81c-848d-41b8-a09e-82b3c8be7a2d-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-gc9vp" (UID: "c68bd81c-848d-41b8-a09e-82b3c8be7a2d") : secret "samples-operator-tls" not found Sep 17 14:07:51.305364 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:51.305159 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e0e7ba35-7911-4320-97a9-85e2099b81e3-ca-trust-extracted\") pod \"image-registry-6946f4785b-9wxrg\" (UID: \"e0e7ba35-7911-4320-97a9-85e2099b81e3\") " pod="openshift-image-registry/image-registry-6946f4785b-9wxrg" Sep 17 14:07:51.305364 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:51.305248 2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 17 14:07:51.305364 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:51.305263 2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6946f4785b-9wxrg: secret "image-registry-tls" not found Sep 17 14:07:51.305364 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:51.305326 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e0e7ba35-7911-4320-97a9-85e2099b81e3-registry-tls podName:e0e7ba35-7911-4320-97a9-85e2099b81e3 nodeName:}" failed. No retries permitted until 2026-09-17 14:07:51.805310177 +0000 UTC m=+40.764329679 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e0e7ba35-7911-4320-97a9-85e2099b81e3-registry-tls") pod "image-registry-6946f4785b-9wxrg" (UID: "e0e7ba35-7911-4320-97a9-85e2099b81e3") : secret "image-registry-tls" not found Sep 17 14:07:51.306521 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:51.306482 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e0e7ba35-7911-4320-97a9-85e2099b81e3-trusted-ca\") pod \"image-registry-6946f4785b-9wxrg\" (UID: \"e0e7ba35-7911-4320-97a9-85e2099b81e3\") " pod="openshift-image-registry/image-registry-6946f4785b-9wxrg" Sep 17 14:07:51.306883 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:51.306864 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/63f7b6df-18e8-435a-a4eb-488c23b60007-default-certificate\") pod \"router-default-78f666855d-9dpdw\" (UID: \"63f7b6df-18e8-435a-a4eb-488c23b60007\") " pod="openshift-ingress/router-default-78f666855d-9dpdw" Sep 17 14:07:51.307217 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:51.307189 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e0e7ba35-7911-4320-97a9-85e2099b81e3-image-registry-private-configuration\") pod \"image-registry-6946f4785b-9wxrg\" (UID: \"e0e7ba35-7911-4320-97a9-85e2099b81e3\") " pod="openshift-image-registry/image-registry-6946f4785b-9wxrg" Sep 17 14:07:51.307317 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:51.307301 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/63f7b6df-18e8-435a-a4eb-488c23b60007-stats-auth\") pod \"router-default-78f666855d-9dpdw\" (UID: \"63f7b6df-18e8-435a-a4eb-488c23b60007\") " pod="openshift-ingress/router-default-78f666855d-9dpdw" Sep 17 14:07:51.307378 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:51.307363 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e0e7ba35-7911-4320-97a9-85e2099b81e3-installation-pull-secrets\") pod \"image-registry-6946f4785b-9wxrg\" (UID: \"e0e7ba35-7911-4320-97a9-85e2099b81e3\") " pod="openshift-image-registry/image-registry-6946f4785b-9wxrg" Sep 17 14:07:51.311655 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:51.311636 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-696884fb9c-d6h6t" Sep 17 14:07:51.313779 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:51.313753 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e0e7ba35-7911-4320-97a9-85e2099b81e3-bound-sa-token\") pod \"image-registry-6946f4785b-9wxrg\" (UID: \"e0e7ba35-7911-4320-97a9-85e2099b81e3\") " pod="openshift-image-registry/image-registry-6946f4785b-9wxrg" Sep 17 14:07:51.313868 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:51.313850 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pt86t\" (UniqueName: \"kubernetes.io/projected/63f7b6df-18e8-435a-a4eb-488c23b60007-kube-api-access-pt86t\") pod \"router-default-78f666855d-9dpdw\" (UID: \"63f7b6df-18e8-435a-a4eb-488c23b60007\") " pod="openshift-ingress/router-default-78f666855d-9dpdw" Sep 17 14:07:51.314894 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:51.314876 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l9lll\" (UniqueName: \"kubernetes.io/projected/e0e7ba35-7911-4320-97a9-85e2099b81e3-kube-api-access-l9lll\") pod \"image-registry-6946f4785b-9wxrg\" (UID: \"e0e7ba35-7911-4320-97a9-85e2099b81e3\") " pod="openshift-image-registry/image-registry-6946f4785b-9wxrg" Sep 17 14:07:51.315177 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:51.315163 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xmccs\" (UniqueName: \"kubernetes.io/projected/c68bd81c-848d-41b8-a09e-82b3c8be7a2d-kube-api-access-xmccs\") pod \"cluster-samples-operator-86499c89c4-gc9vp\" (UID: \"c68bd81c-848d-41b8-a09e-82b3c8be7a2d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-gc9vp" Sep 17 14:07:51.586567 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:51.586448 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-cf7c776b7-tx9n9"] Sep 17 14:07:51.588811 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:51.588787 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7cceb3c6_9b3b_4d8c_abc0_2febaefa1174.slice/crio-918588ae92e1093b5440d078aa952c44d21f8d9baad708176430d809a99e7036 WatchSource:0}: Error finding container 918588ae92e1093b5440d078aa952c44d21f8d9baad708176430d809a99e7036: Status 404 returned error can't find the container with id 918588ae92e1093b5440d078aa952c44d21f8d9baad708176430d809a99e7036 Sep 17 14:07:51.607704 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:51.607654 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7e32a93a-9533-4d08-a4a4-b17a74a3c0f6-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-q4dh5\" (UID: \"7e32a93a-9533-4d08-a4a4-b17a74a3c0f6\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-q4dh5" Sep 17 14:07:51.607798 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:51.607780 2558 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 17 14:07:51.607854 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:51.607845 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e32a93a-9533-4d08-a4a4-b17a74a3c0f6-cluster-monitoring-operator-tls podName:7e32a93a-9533-4d08-a4a4-b17a74a3c0f6 nodeName:}" failed. No retries permitted until 2026-09-17 14:07:52.607831492 +0000 UTC m=+41.566850978 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/7e32a93a-9533-4d08-a4a4-b17a74a3c0f6-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-q4dh5" (UID: "7e32a93a-9533-4d08-a4a4-b17a74a3c0f6") : secret "cluster-monitoring-operator-tls" not found Sep 17 14:07:51.642272 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:51.642249 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-696884fb9c-d6h6t"] Sep 17 14:07:51.644948 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:07:51.644926 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc723f8fb_19bb_4b1a_952b_90698d5605f0.slice/crio-387ae4031875ac7b945e734d308c0427be5b51801a3dd484e7acb05e9f6fdf64 WatchSource:0}: Error finding container 387ae4031875ac7b945e734d308c0427be5b51801a3dd484e7acb05e9f6fdf64: Status 404 returned error can't find the container with id 387ae4031875ac7b945e734d308c0427be5b51801a3dd484e7acb05e9f6fdf64 Sep 17 14:07:51.809110 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:51.809071 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e0e7ba35-7911-4320-97a9-85e2099b81e3-registry-tls\") pod \"image-registry-6946f4785b-9wxrg\" (UID: \"e0e7ba35-7911-4320-97a9-85e2099b81e3\") " pod="openshift-image-registry/image-registry-6946f4785b-9wxrg" Sep 17 14:07:51.809234 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:51.809218 2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 17 14:07:51.809281 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:51.809237 2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6946f4785b-9wxrg: secret "image-registry-tls" not found Sep 17 14:07:51.809281 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:51.809239 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/63f7b6df-18e8-435a-a4eb-488c23b60007-metrics-certs\") pod \"router-default-78f666855d-9dpdw\" (UID: \"63f7b6df-18e8-435a-a4eb-488c23b60007\") " pod="openshift-ingress/router-default-78f666855d-9dpdw" Sep 17 14:07:51.809348 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:51.809280 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c68bd81c-848d-41b8-a09e-82b3c8be7a2d-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-gc9vp\" (UID: \"c68bd81c-848d-41b8-a09e-82b3c8be7a2d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-gc9vp" Sep 17 14:07:51.809348 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:51.809298 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e0e7ba35-7911-4320-97a9-85e2099b81e3-registry-tls podName:e0e7ba35-7911-4320-97a9-85e2099b81e3 nodeName:}" failed. No retries permitted until 2026-09-17 14:07:52.809277578 +0000 UTC m=+41.768297122 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e0e7ba35-7911-4320-97a9-85e2099b81e3-registry-tls") pod "image-registry-6946f4785b-9wxrg" (UID: "e0e7ba35-7911-4320-97a9-85e2099b81e3") : secret "image-registry-tls" not found Sep 17 14:07:51.809348 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:51.809305 2558 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 17 14:07:51.809348 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:51.809337 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63f7b6df-18e8-435a-a4eb-488c23b60007-service-ca-bundle\") pod \"router-default-78f666855d-9dpdw\" (UID: \"63f7b6df-18e8-435a-a4eb-488c23b60007\") " pod="openshift-ingress/router-default-78f666855d-9dpdw" Sep 17 14:07:51.809486 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:51.809345 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63f7b6df-18e8-435a-a4eb-488c23b60007-metrics-certs podName:63f7b6df-18e8-435a-a4eb-488c23b60007 nodeName:}" failed. No retries permitted until 2026-09-17 14:07:52.809332457 +0000 UTC m=+41.768351950 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/63f7b6df-18e8-435a-a4eb-488c23b60007-metrics-certs") pod "router-default-78f666855d-9dpdw" (UID: "63f7b6df-18e8-435a-a4eb-488c23b60007") : secret "router-metrics-certs-default" not found Sep 17 14:07:51.809486 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:51.809349 2558 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 17 14:07:51.809486 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:51.809406 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c68bd81c-848d-41b8-a09e-82b3c8be7a2d-samples-operator-tls podName:c68bd81c-848d-41b8-a09e-82b3c8be7a2d nodeName:}" failed. No retries permitted until 2026-09-17 14:07:52.809396246 +0000 UTC m=+41.768415747 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/c68bd81c-848d-41b8-a09e-82b3c8be7a2d-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-gc9vp" (UID: "c68bd81c-848d-41b8-a09e-82b3c8be7a2d") : secret "samples-operator-tls" not found Sep 17 14:07:51.809486 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:51.809419 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/63f7b6df-18e8-435a-a4eb-488c23b60007-service-ca-bundle podName:63f7b6df-18e8-435a-a4eb-488c23b60007 nodeName:}" failed. No retries permitted until 2026-09-17 14:07:52.809412452 +0000 UTC m=+41.768431945 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/63f7b6df-18e8-435a-a4eb-488c23b60007-service-ca-bundle") pod "router-default-78f666855d-9dpdw" (UID: "63f7b6df-18e8-435a-a4eb-488c23b60007") : configmap references non-existent config key: service-ca.crt Sep 17 14:07:51.886762 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:51.886694 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-d6h6t" event={"ID":"c723f8fb-19bb-4b1a-952b-90698d5605f0","Type":"ContainerStarted","Data":"387ae4031875ac7b945e734d308c0427be5b51801a3dd484e7acb05e9f6fdf64"} Sep 17 14:07:51.887854 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:51.887836 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-tx9n9" event={"ID":"7cceb3c6-9b3b-4d8c-abc0-2febaefa1174","Type":"ContainerStarted","Data":"918588ae92e1093b5440d078aa952c44d21f8d9baad708176430d809a99e7036"} Sep 17 14:07:52.615916 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:52.615864 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/288ba618-7808-4554-946b-8a4ed475131a-metrics-tls\") pod \"dns-default-gjjjg\" (UID: \"288ba618-7808-4554-946b-8a4ed475131a\") " pod="openshift-dns/dns-default-gjjjg" Sep 17 14:07:52.615916 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:52.615913 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7e32a93a-9533-4d08-a4a4-b17a74a3c0f6-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-q4dh5\" (UID: \"7e32a93a-9533-4d08-a4a4-b17a74a3c0f6\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-q4dh5" Sep 17 14:07:52.616194 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:52.616045 2558 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 17 14:07:52.616194 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:52.616104 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e32a93a-9533-4d08-a4a4-b17a74a3c0f6-cluster-monitoring-operator-tls podName:7e32a93a-9533-4d08-a4a4-b17a74a3c0f6 nodeName:}" failed. No retries permitted until 2026-09-17 14:07:54.616087541 +0000 UTC m=+43.575107034 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/7e32a93a-9533-4d08-a4a4-b17a74a3c0f6-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-q4dh5" (UID: "7e32a93a-9533-4d08-a4a4-b17a74a3c0f6") : secret "cluster-monitoring-operator-tls" not found Sep 17 14:07:52.616491 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:52.616434 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 17 14:07:52.616625 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:52.616516 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/288ba618-7808-4554-946b-8a4ed475131a-metrics-tls podName:288ba618-7808-4554-946b-8a4ed475131a nodeName:}" failed. No retries permitted until 2026-09-17 14:08:00.616478771 +0000 UTC m=+49.575498278 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/288ba618-7808-4554-946b-8a4ed475131a-metrics-tls") pod "dns-default-gjjjg" (UID: "288ba618-7808-4554-946b-8a4ed475131a") : secret "dns-default-metrics-tls" not found Sep 17 14:07:52.817789 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:52.817752 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/63f7b6df-18e8-435a-a4eb-488c23b60007-metrics-certs\") pod \"router-default-78f666855d-9dpdw\" (UID: \"63f7b6df-18e8-435a-a4eb-488c23b60007\") " pod="openshift-ingress/router-default-78f666855d-9dpdw" Sep 17 14:07:52.817964 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:52.817817 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c68bd81c-848d-41b8-a09e-82b3c8be7a2d-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-gc9vp\" (UID: \"c68bd81c-848d-41b8-a09e-82b3c8be7a2d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-gc9vp" Sep 17 14:07:52.817964 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:52.817922 2558 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 17 14:07:52.818079 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:52.817954 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63f7b6df-18e8-435a-a4eb-488c23b60007-service-ca-bundle\") pod \"router-default-78f666855d-9dpdw\" (UID: \"63f7b6df-18e8-435a-a4eb-488c23b60007\") " pod="openshift-ingress/router-default-78f666855d-9dpdw" Sep 17 14:07:52.818079 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:52.817986 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c68bd81c-848d-41b8-a09e-82b3c8be7a2d-samples-operator-tls podName:c68bd81c-848d-41b8-a09e-82b3c8be7a2d nodeName:}" failed. No retries permitted until 2026-09-17 14:07:54.817967881 +0000 UTC m=+43.776987391 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/c68bd81c-848d-41b8-a09e-82b3c8be7a2d-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-gc9vp" (UID: "c68bd81c-848d-41b8-a09e-82b3c8be7a2d") : secret "samples-operator-tls" not found Sep 17 14:07:52.818079 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:52.818016 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e0e7ba35-7911-4320-97a9-85e2099b81e3-registry-tls\") pod \"image-registry-6946f4785b-9wxrg\" (UID: \"e0e7ba35-7911-4320-97a9-85e2099b81e3\") " pod="openshift-image-registry/image-registry-6946f4785b-9wxrg" Sep 17 14:07:52.818079 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:52.818047 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/63f7b6df-18e8-435a-a4eb-488c23b60007-service-ca-bundle podName:63f7b6df-18e8-435a-a4eb-488c23b60007 nodeName:}" failed. No retries permitted until 2026-09-17 14:07:54.818032659 +0000 UTC m=+43.777052147 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/63f7b6df-18e8-435a-a4eb-488c23b60007-service-ca-bundle") pod "router-default-78f666855d-9dpdw" (UID: "63f7b6df-18e8-435a-a4eb-488c23b60007") : configmap references non-existent config key: service-ca.crt Sep 17 14:07:52.818276 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:52.818093 2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 17 14:07:52.818276 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:52.818105 2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6946f4785b-9wxrg: secret "image-registry-tls" not found Sep 17 14:07:52.818276 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:52.817921 2558 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 17 14:07:52.818276 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:52.818139 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e0e7ba35-7911-4320-97a9-85e2099b81e3-registry-tls podName:e0e7ba35-7911-4320-97a9-85e2099b81e3 nodeName:}" failed. No retries permitted until 2026-09-17 14:07:54.818127628 +0000 UTC m=+43.777147141 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e0e7ba35-7911-4320-97a9-85e2099b81e3-registry-tls") pod "image-registry-6946f4785b-9wxrg" (UID: "e0e7ba35-7911-4320-97a9-85e2099b81e3") : secret "image-registry-tls" not found Sep 17 14:07:52.818276 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:52.818156 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63f7b6df-18e8-435a-a4eb-488c23b60007-metrics-certs podName:63f7b6df-18e8-435a-a4eb-488c23b60007 nodeName:}" failed. No retries permitted until 2026-09-17 14:07:54.818146808 +0000 UTC m=+43.777166299 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/63f7b6df-18e8-435a-a4eb-488c23b60007-metrics-certs") pod "router-default-78f666855d-9dpdw" (UID: "63f7b6df-18e8-435a-a4eb-488c23b60007") : secret "router-metrics-certs-default" not found Sep 17 14:07:54.633538 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:54.633491 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7e32a93a-9533-4d08-a4a4-b17a74a3c0f6-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-q4dh5\" (UID: \"7e32a93a-9533-4d08-a4a4-b17a74a3c0f6\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-q4dh5" Sep 17 14:07:54.633844 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:54.633585 2558 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 17 14:07:54.633844 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:54.633654 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e32a93a-9533-4d08-a4a4-b17a74a3c0f6-cluster-monitoring-operator-tls podName:7e32a93a-9533-4d08-a4a4-b17a74a3c0f6 nodeName:}" failed. No retries permitted until 2026-09-17 14:07:58.633634153 +0000 UTC m=+47.592653644 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/7e32a93a-9533-4d08-a4a4-b17a74a3c0f6-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-q4dh5" (UID: "7e32a93a-9533-4d08-a4a4-b17a74a3c0f6") : secret "cluster-monitoring-operator-tls" not found Sep 17 14:07:54.834746 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:54.834711 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/63f7b6df-18e8-435a-a4eb-488c23b60007-metrics-certs\") pod \"router-default-78f666855d-9dpdw\" (UID: \"63f7b6df-18e8-435a-a4eb-488c23b60007\") " pod="openshift-ingress/router-default-78f666855d-9dpdw" Sep 17 14:07:54.834866 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:54.834774 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c68bd81c-848d-41b8-a09e-82b3c8be7a2d-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-gc9vp\" (UID: \"c68bd81c-848d-41b8-a09e-82b3c8be7a2d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-gc9vp" Sep 17 14:07:54.834866 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:54.834807 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63f7b6df-18e8-435a-a4eb-488c23b60007-service-ca-bundle\") pod \"router-default-78f666855d-9dpdw\" (UID: \"63f7b6df-18e8-435a-a4eb-488c23b60007\") " pod="openshift-ingress/router-default-78f666855d-9dpdw" Sep 17 14:07:54.834866 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:54.834833 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e0e7ba35-7911-4320-97a9-85e2099b81e3-registry-tls\") pod \"image-registry-6946f4785b-9wxrg\" (UID: \"e0e7ba35-7911-4320-97a9-85e2099b81e3\") " pod="openshift-image-registry/image-registry-6946f4785b-9wxrg" Sep 17 14:07:54.834979 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:54.834860 2558 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 17 14:07:54.834979 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:54.834923 2558 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 17 14:07:54.834979 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:54.834937 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63f7b6df-18e8-435a-a4eb-488c23b60007-metrics-certs podName:63f7b6df-18e8-435a-a4eb-488c23b60007 nodeName:}" failed. No retries permitted until 2026-09-17 14:07:58.834916185 +0000 UTC m=+47.793935671 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/63f7b6df-18e8-435a-a4eb-488c23b60007-metrics-certs") pod "router-default-78f666855d-9dpdw" (UID: "63f7b6df-18e8-435a-a4eb-488c23b60007") : secret "router-metrics-certs-default" not found Sep 17 14:07:54.834979 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:54.834945 2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 17 14:07:54.834979 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:54.834954 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/63f7b6df-18e8-435a-a4eb-488c23b60007-service-ca-bundle podName:63f7b6df-18e8-435a-a4eb-488c23b60007 nodeName:}" failed. No retries permitted until 2026-09-17 14:07:58.834946806 +0000 UTC m=+47.793966292 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/63f7b6df-18e8-435a-a4eb-488c23b60007-service-ca-bundle") pod "router-default-78f666855d-9dpdw" (UID: "63f7b6df-18e8-435a-a4eb-488c23b60007") : configmap references non-existent config key: service-ca.crt Sep 17 14:07:54.834979 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:54.834958 2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6946f4785b-9wxrg: secret "image-registry-tls" not found Sep 17 14:07:54.835178 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:54.834972 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c68bd81c-848d-41b8-a09e-82b3c8be7a2d-samples-operator-tls podName:c68bd81c-848d-41b8-a09e-82b3c8be7a2d nodeName:}" failed. No retries permitted until 2026-09-17 14:07:58.834958971 +0000 UTC m=+47.793978461 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/c68bd81c-848d-41b8-a09e-82b3c8be7a2d-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-gc9vp" (UID: "c68bd81c-848d-41b8-a09e-82b3c8be7a2d") : secret "samples-operator-tls" not found Sep 17 14:07:54.835178 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:54.835001 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e0e7ba35-7911-4320-97a9-85e2099b81e3-registry-tls podName:e0e7ba35-7911-4320-97a9-85e2099b81e3 nodeName:}" failed. No retries permitted until 2026-09-17 14:07:58.834994269 +0000 UTC m=+47.794013754 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e0e7ba35-7911-4320-97a9-85e2099b81e3-registry-tls") pod "image-registry-6946f4785b-9wxrg" (UID: "e0e7ba35-7911-4320-97a9-85e2099b81e3") : secret "image-registry-tls" not found Sep 17 14:07:54.897613 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:54.897561 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-d6h6t_c723f8fb-19bb-4b1a-952b-90698d5605f0/console-operator/0.log" Sep 17 14:07:54.897613 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:54.897605 2558 generic.go:356] "Generic (PLEG): container finished" podID="c723f8fb-19bb-4b1a-952b-90698d5605f0" containerID="885ead5b401c333cb248ef20fe5280c3821da0f28ac148e8970be47ffd5ca6c1" exitCode=255 Sep 17 14:07:54.897763 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:54.897676 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-d6h6t" event={"ID":"c723f8fb-19bb-4b1a-952b-90698d5605f0","Type":"ContainerDied","Data":"885ead5b401c333cb248ef20fe5280c3821da0f28ac148e8970be47ffd5ca6c1"} Sep 17 14:07:54.897906 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:54.897891 2558 scope.go:117] "RemoveContainer" containerID="885ead5b401c333cb248ef20fe5280c3821da0f28ac148e8970be47ffd5ca6c1" Sep 17 14:07:54.899311 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:54.899291 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-tx9n9" event={"ID":"7cceb3c6-9b3b-4d8c-abc0-2febaefa1174","Type":"ContainerStarted","Data":"e5115db29b44228b557ae6efd1c054b07b20aaa286e23f1a0e8c7894afee226e"} Sep 17 14:07:54.941474 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:54.941437 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-tx9n9" podStartSLOduration=1.9202919120000002 podStartE2EDuration="4.941424096s" totalImagesPullingTime="3.021132184s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:07:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:07:54.941417259 +0000 UTC m=+43.900436770" watchObservedRunningTime="2026-09-17 14:07:54.941424096 +0000 UTC m=+43.900443604" Sep 17 14:07:55.405474 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:55.405443 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-zvgd2"] Sep 17 14:07:55.422411 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:55.422393 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-zvgd2" Sep 17 14:07:55.429210 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:55.429184 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 17 14:07:55.429472 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:55.429458 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 17 14:07:55.430222 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:55.430206 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 17 14:07:55.430269 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:55.430207 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 17 14:07:55.430607 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:55.430591 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-8wsdt\"" Sep 17 14:07:55.443762 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:55.443724 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-zvgd2"] Sep 17 14:07:55.542325 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:55.542305 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/57f41982-5828-4481-986b-59808cc7c372-data-volume\") pod \"insights-runtime-extractor-zvgd2\" (UID: \"57f41982-5828-4481-986b-59808cc7c372\") " pod="openshift-insights/insights-runtime-extractor-zvgd2" Sep 17 14:07:55.542440 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:55.542352 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9b82v\" (UniqueName: \"kubernetes.io/projected/57f41982-5828-4481-986b-59808cc7c372-kube-api-access-9b82v\") pod \"insights-runtime-extractor-zvgd2\" (UID: \"57f41982-5828-4481-986b-59808cc7c372\") " pod="openshift-insights/insights-runtime-extractor-zvgd2" Sep 17 14:07:55.542440 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:55.542407 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/57f41982-5828-4481-986b-59808cc7c372-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zvgd2\" (UID: \"57f41982-5828-4481-986b-59808cc7c372\") " pod="openshift-insights/insights-runtime-extractor-zvgd2" Sep 17 14:07:55.542527 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:55.542483 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/57f41982-5828-4481-986b-59808cc7c372-crio-socket\") pod \"insights-runtime-extractor-zvgd2\" (UID: \"57f41982-5828-4481-986b-59808cc7c372\") " pod="openshift-insights/insights-runtime-extractor-zvgd2" Sep 17 14:07:55.542527 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:55.542519 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/57f41982-5828-4481-986b-59808cc7c372-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zvgd2\" (UID: \"57f41982-5828-4481-986b-59808cc7c372\") " pod="openshift-insights/insights-runtime-extractor-zvgd2" Sep 17 14:07:55.642794 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:55.642773 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/57f41982-5828-4481-986b-59808cc7c372-crio-socket\") pod \"insights-runtime-extractor-zvgd2\" (UID: \"57f41982-5828-4481-986b-59808cc7c372\") " pod="openshift-insights/insights-runtime-extractor-zvgd2" Sep 17 14:07:55.643149 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:55.642805 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/57f41982-5828-4481-986b-59808cc7c372-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zvgd2\" (UID: \"57f41982-5828-4481-986b-59808cc7c372\") " pod="openshift-insights/insights-runtime-extractor-zvgd2" Sep 17 14:07:55.643149 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:55.642836 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/57f41982-5828-4481-986b-59808cc7c372-data-volume\") pod \"insights-runtime-extractor-zvgd2\" (UID: \"57f41982-5828-4481-986b-59808cc7c372\") " pod="openshift-insights/insights-runtime-extractor-zvgd2" Sep 17 14:07:55.643149 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:55.642880 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9b82v\" (UniqueName: \"kubernetes.io/projected/57f41982-5828-4481-986b-59808cc7c372-kube-api-access-9b82v\") pod \"insights-runtime-extractor-zvgd2\" (UID: \"57f41982-5828-4481-986b-59808cc7c372\") " pod="openshift-insights/insights-runtime-extractor-zvgd2" Sep 17 14:07:55.643149 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:55.642914 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/57f41982-5828-4481-986b-59808cc7c372-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zvgd2\" (UID: \"57f41982-5828-4481-986b-59808cc7c372\") " pod="openshift-insights/insights-runtime-extractor-zvgd2" Sep 17 14:07:55.643149 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:55.642943 2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 17 14:07:55.643149 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:55.643002 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/57f41982-5828-4481-986b-59808cc7c372-insights-runtime-extractor-tls podName:57f41982-5828-4481-986b-59808cc7c372 nodeName:}" failed. No retries permitted until 2026-09-17 14:07:56.142987492 +0000 UTC m=+45.102006978 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/57f41982-5828-4481-986b-59808cc7c372-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zvgd2" (UID: "57f41982-5828-4481-986b-59808cc7c372") : secret "insights-runtime-extractor-tls" not found Sep 17 14:07:55.643149 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:55.643017 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/57f41982-5828-4481-986b-59808cc7c372-crio-socket\") pod \"insights-runtime-extractor-zvgd2\" (UID: \"57f41982-5828-4481-986b-59808cc7c372\") " pod="openshift-insights/insights-runtime-extractor-zvgd2" Sep 17 14:07:55.643149 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:55.643052 2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 17 14:07:55.643149 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:55.643112 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/57f41982-5828-4481-986b-59808cc7c372-kube-rbac-proxy-cm podName:57f41982-5828-4481-986b-59808cc7c372 nodeName:}" failed. No retries permitted until 2026-09-17 14:07:56.143096489 +0000 UTC m=+45.102115975 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/57f41982-5828-4481-986b-59808cc7c372-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zvgd2" (UID: "57f41982-5828-4481-986b-59808cc7c372") : configmap "kube-rbac-proxy" not found Sep 17 14:07:55.643477 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:55.643248 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/57f41982-5828-4481-986b-59808cc7c372-data-volume\") pod \"insights-runtime-extractor-zvgd2\" (UID: \"57f41982-5828-4481-986b-59808cc7c372\") " pod="openshift-insights/insights-runtime-extractor-zvgd2" Sep 17 14:07:55.654770 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:55.654749 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9b82v\" (UniqueName: \"kubernetes.io/projected/57f41982-5828-4481-986b-59808cc7c372-kube-api-access-9b82v\") pod \"insights-runtime-extractor-zvgd2\" (UID: \"57f41982-5828-4481-986b-59808cc7c372\") " pod="openshift-insights/insights-runtime-extractor-zvgd2" Sep 17 14:07:55.903580 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:55.903549 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-d6h6t_c723f8fb-19bb-4b1a-952b-90698d5605f0/console-operator/1.log" Sep 17 14:07:55.903972 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:55.903953 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-d6h6t_c723f8fb-19bb-4b1a-952b-90698d5605f0/console-operator/0.log" Sep 17 14:07:55.904081 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:55.903994 2558 generic.go:356] "Generic (PLEG): container finished" podID="c723f8fb-19bb-4b1a-952b-90698d5605f0" containerID="cc1ab315dd84c39dc2fe3ead61e561f5e41b909f163e02bff112e03042fa48da" exitCode=255 Sep 17 14:07:55.904132 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:55.904079 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-d6h6t" event={"ID":"c723f8fb-19bb-4b1a-952b-90698d5605f0","Type":"ContainerDied","Data":"cc1ab315dd84c39dc2fe3ead61e561f5e41b909f163e02bff112e03042fa48da"} Sep 17 14:07:55.904175 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:55.904142 2558 scope.go:117] "RemoveContainer" containerID="885ead5b401c333cb248ef20fe5280c3821da0f28ac148e8970be47ffd5ca6c1" Sep 17 14:07:55.904395 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:55.904378 2558 scope.go:117] "RemoveContainer" containerID="cc1ab315dd84c39dc2fe3ead61e561f5e41b909f163e02bff112e03042fa48da" Sep 17 14:07:55.904589 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:55.904570 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-696884fb9c-d6h6t_openshift-console-operator(c723f8fb-19bb-4b1a-952b-90698d5605f0)\"" pod="openshift-console-operator/console-operator-696884fb9c-d6h6t" podUID="c723f8fb-19bb-4b1a-952b-90698d5605f0" Sep 17 14:07:56.147053 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:56.147021 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/57f41982-5828-4481-986b-59808cc7c372-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zvgd2\" (UID: \"57f41982-5828-4481-986b-59808cc7c372\") " pod="openshift-insights/insights-runtime-extractor-zvgd2" Sep 17 14:07:56.147201 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:56.147102 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/57f41982-5828-4481-986b-59808cc7c372-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zvgd2\" (UID: \"57f41982-5828-4481-986b-59808cc7c372\") " pod="openshift-insights/insights-runtime-extractor-zvgd2" Sep 17 14:07:56.147201 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:56.147143 2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 17 14:07:56.147201 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:56.147192 2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 17 14:07:56.147291 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:56.147226 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/57f41982-5828-4481-986b-59808cc7c372-kube-rbac-proxy-cm podName:57f41982-5828-4481-986b-59808cc7c372 nodeName:}" failed. No retries permitted until 2026-09-17 14:07:57.14720917 +0000 UTC m=+46.106228675 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/57f41982-5828-4481-986b-59808cc7c372-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zvgd2" (UID: "57f41982-5828-4481-986b-59808cc7c372") : configmap "kube-rbac-proxy" not found Sep 17 14:07:56.147291 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:56.147241 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/57f41982-5828-4481-986b-59808cc7c372-insights-runtime-extractor-tls podName:57f41982-5828-4481-986b-59808cc7c372 nodeName:}" failed. No retries permitted until 2026-09-17 14:07:57.147234852 +0000 UTC m=+46.106254338 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/57f41982-5828-4481-986b-59808cc7c372-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zvgd2" (UID: "57f41982-5828-4481-986b-59808cc7c372") : secret "insights-runtime-extractor-tls" not found Sep 17 14:07:56.908113 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:56.908086 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-d6h6t_c723f8fb-19bb-4b1a-952b-90698d5605f0/console-operator/1.log" Sep 17 14:07:56.908519 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:56.908407 2558 scope.go:117] "RemoveContainer" containerID="cc1ab315dd84c39dc2fe3ead61e561f5e41b909f163e02bff112e03042fa48da" Sep 17 14:07:56.908596 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:56.908573 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-696884fb9c-d6h6t_openshift-console-operator(c723f8fb-19bb-4b1a-952b-90698d5605f0)\"" pod="openshift-console-operator/console-operator-696884fb9c-d6h6t" podUID="c723f8fb-19bb-4b1a-952b-90698d5605f0" Sep 17 14:07:57.154830 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:57.154798 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/57f41982-5828-4481-986b-59808cc7c372-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zvgd2\" (UID: \"57f41982-5828-4481-986b-59808cc7c372\") " pod="openshift-insights/insights-runtime-extractor-zvgd2" Sep 17 14:07:57.155000 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:57.154896 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/57f41982-5828-4481-986b-59808cc7c372-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zvgd2\" (UID: \"57f41982-5828-4481-986b-59808cc7c372\") " pod="openshift-insights/insights-runtime-extractor-zvgd2" Sep 17 14:07:57.155000 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:57.154938 2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 17 14:07:57.155076 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:57.154998 2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 17 14:07:57.155076 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:57.155009 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/57f41982-5828-4481-986b-59808cc7c372-kube-rbac-proxy-cm podName:57f41982-5828-4481-986b-59808cc7c372 nodeName:}" failed. No retries permitted until 2026-09-17 14:07:59.154989049 +0000 UTC m=+48.114008543 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/57f41982-5828-4481-986b-59808cc7c372-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zvgd2" (UID: "57f41982-5828-4481-986b-59808cc7c372") : configmap "kube-rbac-proxy" not found Sep 17 14:07:57.155076 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:57.155034 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/57f41982-5828-4481-986b-59808cc7c372-insights-runtime-extractor-tls podName:57f41982-5828-4481-986b-59808cc7c372 nodeName:}" failed. No retries permitted until 2026-09-17 14:07:59.155024695 +0000 UTC m=+48.114044185 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/57f41982-5828-4481-986b-59808cc7c372-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zvgd2" (UID: "57f41982-5828-4481-986b-59808cc7c372") : secret "insights-runtime-extractor-tls" not found Sep 17 14:07:57.515019 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:57.514994 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-kjm5t_0f675bf6-8f81-470f-b259-a9b21ddf230f/dns-node-resolver/0.log" Sep 17 14:07:58.315591 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:58.315564 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wxv7s_29942cdd-392c-45cc-94ad-e0e570e04856/node-ca/0.log" Sep 17 14:07:58.666589 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:58.666489 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7e32a93a-9533-4d08-a4a4-b17a74a3c0f6-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-q4dh5\" (UID: \"7e32a93a-9533-4d08-a4a4-b17a74a3c0f6\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-q4dh5" Sep 17 14:07:58.666728 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:58.666641 2558 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 17 14:07:58.666728 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:58.666705 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e32a93a-9533-4d08-a4a4-b17a74a3c0f6-cluster-monitoring-operator-tls podName:7e32a93a-9533-4d08-a4a4-b17a74a3c0f6 nodeName:}" failed. No retries permitted until 2026-09-17 14:08:06.66668986 +0000 UTC m=+55.625709347 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/7e32a93a-9533-4d08-a4a4-b17a74a3c0f6-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-q4dh5" (UID: "7e32a93a-9533-4d08-a4a4-b17a74a3c0f6") : secret "cluster-monitoring-operator-tls" not found Sep 17 14:07:58.871394 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:58.871360 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c68bd81c-848d-41b8-a09e-82b3c8be7a2d-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-gc9vp\" (UID: \"c68bd81c-848d-41b8-a09e-82b3c8be7a2d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-gc9vp" Sep 17 14:07:58.871394 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:58.871396 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63f7b6df-18e8-435a-a4eb-488c23b60007-service-ca-bundle\") pod \"router-default-78f666855d-9dpdw\" (UID: \"63f7b6df-18e8-435a-a4eb-488c23b60007\") " pod="openshift-ingress/router-default-78f666855d-9dpdw" Sep 17 14:07:58.871647 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:58.871414 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e0e7ba35-7911-4320-97a9-85e2099b81e3-registry-tls\") pod \"image-registry-6946f4785b-9wxrg\" (UID: \"e0e7ba35-7911-4320-97a9-85e2099b81e3\") " pod="openshift-image-registry/image-registry-6946f4785b-9wxrg" Sep 17 14:07:58.871647 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:58.871546 2558 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 17 14:07:58.871647 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:58.871551 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/63f7b6df-18e8-435a-a4eb-488c23b60007-service-ca-bundle podName:63f7b6df-18e8-435a-a4eb-488c23b60007 nodeName:}" failed. No retries permitted until 2026-09-17 14:08:06.871533996 +0000 UTC m=+55.830553499 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/63f7b6df-18e8-435a-a4eb-488c23b60007-service-ca-bundle") pod "router-default-78f666855d-9dpdw" (UID: "63f7b6df-18e8-435a-a4eb-488c23b60007") : configmap references non-existent config key: service-ca.crt Sep 17 14:07:58.871647 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:58.871556 2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 17 14:07:58.871647 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:58.871646 2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6946f4785b-9wxrg: secret "image-registry-tls" not found Sep 17 14:07:58.871835 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:58.871679 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/63f7b6df-18e8-435a-a4eb-488c23b60007-metrics-certs\") pod \"router-default-78f666855d-9dpdw\" (UID: \"63f7b6df-18e8-435a-a4eb-488c23b60007\") " pod="openshift-ingress/router-default-78f666855d-9dpdw" Sep 17 14:07:58.871835 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:58.871688 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e0e7ba35-7911-4320-97a9-85e2099b81e3-registry-tls podName:e0e7ba35-7911-4320-97a9-85e2099b81e3 nodeName:}" failed. No retries permitted until 2026-09-17 14:08:06.871676263 +0000 UTC m=+55.830695749 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e0e7ba35-7911-4320-97a9-85e2099b81e3-registry-tls") pod "image-registry-6946f4785b-9wxrg" (UID: "e0e7ba35-7911-4320-97a9-85e2099b81e3") : secret "image-registry-tls" not found Sep 17 14:07:58.871835 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:58.871744 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c68bd81c-848d-41b8-a09e-82b3c8be7a2d-samples-operator-tls podName:c68bd81c-848d-41b8-a09e-82b3c8be7a2d nodeName:}" failed. No retries permitted until 2026-09-17 14:08:06.871726065 +0000 UTC m=+55.830745562 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/c68bd81c-848d-41b8-a09e-82b3c8be7a2d-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-gc9vp" (UID: "c68bd81c-848d-41b8-a09e-82b3c8be7a2d") : secret "samples-operator-tls" not found Sep 17 14:07:58.871835 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:58.871744 2558 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 17 14:07:58.871835 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:58.871791 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63f7b6df-18e8-435a-a4eb-488c23b60007-metrics-certs podName:63f7b6df-18e8-435a-a4eb-488c23b60007 nodeName:}" failed. No retries permitted until 2026-09-17 14:08:06.871781577 +0000 UTC m=+55.830801081 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/63f7b6df-18e8-435a-a4eb-488c23b60007-metrics-certs") pod "router-default-78f666855d-9dpdw" (UID: "63f7b6df-18e8-435a-a4eb-488c23b60007") : secret "router-metrics-certs-default" not found Sep 17 14:07:58.913512 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:58.913471 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-dgk98_77b443e6-d1b4-4737-b928-32ade7a07259/serve-healthcheck-canary/0.log" Sep 17 14:07:59.174780 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:59.174741 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/57f41982-5828-4481-986b-59808cc7c372-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zvgd2\" (UID: \"57f41982-5828-4481-986b-59808cc7c372\") " pod="openshift-insights/insights-runtime-extractor-zvgd2" Sep 17 14:07:59.174929 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:07:59.174832 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/57f41982-5828-4481-986b-59808cc7c372-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zvgd2\" (UID: \"57f41982-5828-4481-986b-59808cc7c372\") " pod="openshift-insights/insights-runtime-extractor-zvgd2" Sep 17 14:07:59.174929 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:59.174868 2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 17 14:07:59.175003 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:59.174932 2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 17 14:07:59.175003 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:59.174960 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/57f41982-5828-4481-986b-59808cc7c372-kube-rbac-proxy-cm podName:57f41982-5828-4481-986b-59808cc7c372 nodeName:}" failed. No retries permitted until 2026-09-17 14:08:03.174944239 +0000 UTC m=+52.133963730 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/57f41982-5828-4481-986b-59808cc7c372-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zvgd2" (UID: "57f41982-5828-4481-986b-59808cc7c372") : configmap "kube-rbac-proxy" not found Sep 17 14:07:59.175003 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:07:59.174985 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/57f41982-5828-4481-986b-59808cc7c372-insights-runtime-extractor-tls podName:57f41982-5828-4481-986b-59808cc7c372 nodeName:}" failed. No retries permitted until 2026-09-17 14:08:03.174974282 +0000 UTC m=+52.133993767 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/57f41982-5828-4481-986b-59808cc7c372-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zvgd2" (UID: "57f41982-5828-4481-986b-59808cc7c372") : secret "insights-runtime-extractor-tls" not found Sep 17 14:08:00.687994 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:00.687957 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/288ba618-7808-4554-946b-8a4ed475131a-metrics-tls\") pod \"dns-default-gjjjg\" (UID: \"288ba618-7808-4554-946b-8a4ed475131a\") " pod="openshift-dns/dns-default-gjjjg" Sep 17 14:08:00.688373 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:08:00.688107 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 17 14:08:00.688373 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:08:00.688180 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/288ba618-7808-4554-946b-8a4ed475131a-metrics-tls podName:288ba618-7808-4554-946b-8a4ed475131a nodeName:}" failed. No retries permitted until 2026-09-17 14:08:16.688164014 +0000 UTC m=+65.647183500 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/288ba618-7808-4554-946b-8a4ed475131a-metrics-tls") pod "dns-default-gjjjg" (UID: "288ba618-7808-4554-946b-8a4ed475131a") : secret "dns-default-metrics-tls" not found Sep 17 14:08:01.312383 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:01.312351 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-696884fb9c-d6h6t" Sep 17 14:08:01.312556 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:01.312403 2558 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-696884fb9c-d6h6t" Sep 17 14:08:01.312715 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:01.312703 2558 scope.go:117] "RemoveContainer" containerID="cc1ab315dd84c39dc2fe3ead61e561f5e41b909f163e02bff112e03042fa48da" Sep 17 14:08:01.312858 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:08:01.312840 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-696884fb9c-d6h6t_openshift-console-operator(c723f8fb-19bb-4b1a-952b-90698d5605f0)\"" pod="openshift-console-operator/console-operator-696884fb9c-d6h6t" podUID="c723f8fb-19bb-4b1a-952b-90698d5605f0" Sep 17 14:08:03.207749 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:03.207714 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/57f41982-5828-4481-986b-59808cc7c372-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zvgd2\" (UID: \"57f41982-5828-4481-986b-59808cc7c372\") " pod="openshift-insights/insights-runtime-extractor-zvgd2" Sep 17 14:08:03.208107 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:03.207804 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/57f41982-5828-4481-986b-59808cc7c372-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zvgd2\" (UID: \"57f41982-5828-4481-986b-59808cc7c372\") " pod="openshift-insights/insights-runtime-extractor-zvgd2" Sep 17 14:08:03.208107 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:08:03.207853 2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 17 14:08:03.208107 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:08:03.207864 2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 17 14:08:03.208107 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:08:03.207910 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/57f41982-5828-4481-986b-59808cc7c372-insights-runtime-extractor-tls podName:57f41982-5828-4481-986b-59808cc7c372 nodeName:}" failed. No retries permitted until 2026-09-17 14:08:11.207894879 +0000 UTC m=+60.166914366 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/57f41982-5828-4481-986b-59808cc7c372-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zvgd2" (UID: "57f41982-5828-4481-986b-59808cc7c372") : secret "insights-runtime-extractor-tls" not found Sep 17 14:08:03.208107 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:08:03.207925 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/57f41982-5828-4481-986b-59808cc7c372-kube-rbac-proxy-cm podName:57f41982-5828-4481-986b-59808cc7c372 nodeName:}" failed. No retries permitted until 2026-09-17 14:08:11.207919094 +0000 UTC m=+60.166938580 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/57f41982-5828-4481-986b-59808cc7c372-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zvgd2" (UID: "57f41982-5828-4481-986b-59808cc7c372") : configmap "kube-rbac-proxy" not found Sep 17 14:08:06.737349 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:06.737309 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7e32a93a-9533-4d08-a4a4-b17a74a3c0f6-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-q4dh5\" (UID: \"7e32a93a-9533-4d08-a4a4-b17a74a3c0f6\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-q4dh5" Sep 17 14:08:06.737838 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:08:06.737469 2558 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 17 14:08:06.737838 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:08:06.737574 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e32a93a-9533-4d08-a4a4-b17a74a3c0f6-cluster-monitoring-operator-tls podName:7e32a93a-9533-4d08-a4a4-b17a74a3c0f6 nodeName:}" failed. No retries permitted until 2026-09-17 14:08:22.737556891 +0000 UTC m=+71.696576376 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/7e32a93a-9533-4d08-a4a4-b17a74a3c0f6-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-q4dh5" (UID: "7e32a93a-9533-4d08-a4a4-b17a74a3c0f6") : secret "cluster-monitoring-operator-tls" not found Sep 17 14:08:06.938463 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:06.938430 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/63f7b6df-18e8-435a-a4eb-488c23b60007-metrics-certs\") pod \"router-default-78f666855d-9dpdw\" (UID: \"63f7b6df-18e8-435a-a4eb-488c23b60007\") " pod="openshift-ingress/router-default-78f666855d-9dpdw" Sep 17 14:08:06.938625 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:06.938483 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c68bd81c-848d-41b8-a09e-82b3c8be7a2d-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-gc9vp\" (UID: \"c68bd81c-848d-41b8-a09e-82b3c8be7a2d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-gc9vp" Sep 17 14:08:06.938625 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:06.938520 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63f7b6df-18e8-435a-a4eb-488c23b60007-service-ca-bundle\") pod \"router-default-78f666855d-9dpdw\" (UID: \"63f7b6df-18e8-435a-a4eb-488c23b60007\") " pod="openshift-ingress/router-default-78f666855d-9dpdw" Sep 17 14:08:06.938625 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:06.938536 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e0e7ba35-7911-4320-97a9-85e2099b81e3-registry-tls\") pod \"image-registry-6946f4785b-9wxrg\" (UID: \"e0e7ba35-7911-4320-97a9-85e2099b81e3\") " pod="openshift-image-registry/image-registry-6946f4785b-9wxrg" Sep 17 14:08:06.938625 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:08:06.938593 2558 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 17 14:08:06.938815 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:08:06.938627 2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 17 14:08:06.938815 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:08:06.938636 2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6946f4785b-9wxrg: secret "image-registry-tls" not found Sep 17 14:08:06.938815 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:08:06.938669 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63f7b6df-18e8-435a-a4eb-488c23b60007-metrics-certs podName:63f7b6df-18e8-435a-a4eb-488c23b60007 nodeName:}" failed. No retries permitted until 2026-09-17 14:08:22.938646948 +0000 UTC m=+71.897666434 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/63f7b6df-18e8-435a-a4eb-488c23b60007-metrics-certs") pod "router-default-78f666855d-9dpdw" (UID: "63f7b6df-18e8-435a-a4eb-488c23b60007") : secret "router-metrics-certs-default" not found Sep 17 14:08:06.938815 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:08:06.938688 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e0e7ba35-7911-4320-97a9-85e2099b81e3-registry-tls podName:e0e7ba35-7911-4320-97a9-85e2099b81e3 nodeName:}" failed. No retries permitted until 2026-09-17 14:08:22.938679584 +0000 UTC m=+71.897699071 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e0e7ba35-7911-4320-97a9-85e2099b81e3-registry-tls") pod "image-registry-6946f4785b-9wxrg" (UID: "e0e7ba35-7911-4320-97a9-85e2099b81e3") : secret "image-registry-tls" not found Sep 17 14:08:06.938815 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:08:06.938700 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/63f7b6df-18e8-435a-a4eb-488c23b60007-service-ca-bundle podName:63f7b6df-18e8-435a-a4eb-488c23b60007 nodeName:}" failed. No retries permitted until 2026-09-17 14:08:22.938693627 +0000 UTC m=+71.897713113 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/63f7b6df-18e8-435a-a4eb-488c23b60007-service-ca-bundle") pod "router-default-78f666855d-9dpdw" (UID: "63f7b6df-18e8-435a-a4eb-488c23b60007") : configmap references non-existent config key: service-ca.crt Sep 17 14:08:06.940968 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:06.940949 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c68bd81c-848d-41b8-a09e-82b3c8be7a2d-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-gc9vp\" (UID: \"c68bd81c-848d-41b8-a09e-82b3c8be7a2d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-gc9vp" Sep 17 14:08:07.236521 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:07.236464 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-gc9vp" Sep 17 14:08:07.524479 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:07.524457 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-gc9vp"] Sep 17 14:08:07.935976 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:07.935942 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-gc9vp" event={"ID":"c68bd81c-848d-41b8-a09e-82b3c8be7a2d","Type":"ContainerStarted","Data":"ba9ca26315cfbf0068c8247bb85555c76c0c17e8157e22b419f3311503b26f99"} Sep 17 14:08:09.943126 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:09.943087 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-gc9vp" event={"ID":"c68bd81c-848d-41b8-a09e-82b3c8be7a2d","Type":"ContainerStarted","Data":"0eee373765af824dfbef249b0384a371852ff5ae8028678401df202dd5440593"} Sep 17 14:08:09.943537 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:09.943141 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-gc9vp" event={"ID":"c68bd81c-848d-41b8-a09e-82b3c8be7a2d","Type":"ContainerStarted","Data":"32d227dd4b3af32c568abf662967abdaa8bc448219aeaf6b3aacc50ace63e12a"} Sep 17 14:08:09.963314 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:09.963264 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-gc9vp" podStartSLOduration=17.958936992 podStartE2EDuration="19.963250147s" totalImagesPullingTime="2.004313155s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:07:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:08:09.961853029 +0000 UTC m=+58.920872536" watchObservedRunningTime="2026-09-17 14:08:09.963250147 +0000 UTC m=+58.922269651" Sep 17 14:08:11.269665 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:11.269627 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/57f41982-5828-4481-986b-59808cc7c372-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zvgd2\" (UID: \"57f41982-5828-4481-986b-59808cc7c372\") " pod="openshift-insights/insights-runtime-extractor-zvgd2" Sep 17 14:08:11.270113 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:11.269730 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/57f41982-5828-4481-986b-59808cc7c372-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zvgd2\" (UID: \"57f41982-5828-4481-986b-59808cc7c372\") " pod="openshift-insights/insights-runtime-extractor-zvgd2" Sep 17 14:08:11.270113 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:08:11.269844 2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 17 14:08:11.270113 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:08:11.269909 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/57f41982-5828-4481-986b-59808cc7c372-insights-runtime-extractor-tls podName:57f41982-5828-4481-986b-59808cc7c372 nodeName:}" failed. No retries permitted until 2026-09-17 14:08:27.269890868 +0000 UTC m=+76.228910367 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/57f41982-5828-4481-986b-59808cc7c372-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zvgd2" (UID: "57f41982-5828-4481-986b-59808cc7c372") : secret "insights-runtime-extractor-tls" not found Sep 17 14:08:11.270266 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:11.270219 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/57f41982-5828-4481-986b-59808cc7c372-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zvgd2\" (UID: \"57f41982-5828-4481-986b-59808cc7c372\") " pod="openshift-insights/insights-runtime-extractor-zvgd2" Sep 17 14:08:11.845726 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:11.845697 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8cqcg" Sep 17 14:08:15.527875 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:15.527844 2558 scope.go:117] "RemoveContainer" containerID="cc1ab315dd84c39dc2fe3ead61e561f5e41b909f163e02bff112e03042fa48da" Sep 17 14:08:15.962851 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:15.962819 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-d6h6t_c723f8fb-19bb-4b1a-952b-90698d5605f0/console-operator/1.log" Sep 17 14:08:15.963025 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:15.962903 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-d6h6t" event={"ID":"c723f8fb-19bb-4b1a-952b-90698d5605f0","Type":"ContainerStarted","Data":"7684f02264cfec6a20b7b84616fa0052a151094eaf8b8da706f07945a40c903c"} Sep 17 14:08:15.963285 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:15.963233 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-696884fb9c-d6h6t" Sep 17 14:08:15.967768 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:15.967750 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-696884fb9c-d6h6t" Sep 17 14:08:15.989069 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:15.989017 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-696884fb9c-d6h6t" podStartSLOduration=23.029337611 podStartE2EDuration="25.989003737s" totalImagesPullingTime="2.959666126s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:07:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:08:15.988324739 +0000 UTC m=+64.947344250" watchObservedRunningTime="2026-09-17 14:08:15.989003737 +0000 UTC m=+64.948023280" Sep 17 14:08:16.308357 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:16.308274 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/345f5575-9f8c-486b-9d57-7570a932d5a4-metrics-certs\") pod \"network-metrics-daemon-8qrmx\" (UID: \"345f5575-9f8c-486b-9d57-7570a932d5a4\") " pod="openshift-multus/network-metrics-daemon-8qrmx" Sep 17 14:08:16.308357 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:16.308324 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/78551199-0cec-4921-b8a1-0858742751f4-original-pull-secret\") pod \"global-pull-secret-syncer-9jk57\" (UID: \"78551199-0cec-4921-b8a1-0858742751f4\") " pod="kube-system/global-pull-secret-syncer-9jk57" Sep 17 14:08:16.311334 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:16.311312 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 17 14:08:16.312391 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:16.312375 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 17 14:08:16.320950 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:16.320926 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/345f5575-9f8c-486b-9d57-7570a932d5a4-metrics-certs\") pod \"network-metrics-daemon-8qrmx\" (UID: \"345f5575-9f8c-486b-9d57-7570a932d5a4\") " pod="openshift-multus/network-metrics-daemon-8qrmx" Sep 17 14:08:16.321028 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:16.320925 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/78551199-0cec-4921-b8a1-0858742751f4-original-pull-secret\") pod \"global-pull-secret-syncer-9jk57\" (UID: \"78551199-0cec-4921-b8a1-0858742751f4\") " pod="kube-system/global-pull-secret-syncer-9jk57" Sep 17 14:08:16.409283 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:16.409259 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqsk7\" (UniqueName: \"kubernetes.io/projected/b4cde3bb-db2e-4afd-b878-1ff65574484c-kube-api-access-vqsk7\") pod \"network-check-target-sqr44\" (UID: \"b4cde3bb-db2e-4afd-b878-1ff65574484c\") " pod="openshift-network-diagnostics/network-check-target-sqr44" Sep 17 14:08:16.411786 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:16.411771 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 17 14:08:16.426711 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:16.426692 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 17 14:08:16.432342 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:16.432322 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vqsk7\" (UniqueName: \"kubernetes.io/projected/b4cde3bb-db2e-4afd-b878-1ff65574484c-kube-api-access-vqsk7\") pod \"network-check-target-sqr44\" (UID: \"b4cde3bb-db2e-4afd-b878-1ff65574484c\") " pod="openshift-network-diagnostics/network-check-target-sqr44" Sep 17 14:08:16.439094 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:16.439077 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9jk57" Sep 17 14:08:16.448661 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:16.448644 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-wjfsd\"" Sep 17 14:08:16.454904 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:16.454885 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-5qqvj\"" Sep 17 14:08:16.456082 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:16.456067 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8qrmx" Sep 17 14:08:16.461277 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:16.461102 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sqr44" Sep 17 14:08:16.712393 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:16.712368 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/288ba618-7808-4554-946b-8a4ed475131a-metrics-tls\") pod \"dns-default-gjjjg\" (UID: \"288ba618-7808-4554-946b-8a4ed475131a\") " pod="openshift-dns/dns-default-gjjjg" Sep 17 14:08:16.714703 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:16.714680 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/288ba618-7808-4554-946b-8a4ed475131a-metrics-tls\") pod \"dns-default-gjjjg\" (UID: \"288ba618-7808-4554-946b-8a4ed475131a\") " pod="openshift-dns/dns-default-gjjjg" Sep 17 14:08:16.723909 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:16.723886 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-9jk57"] Sep 17 14:08:16.726818 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:08:16.726796 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78551199_0cec_4921_b8a1_0858742751f4.slice/crio-1d490dd589ada851a231ad8699687e0ca76bf2f9f4e3579dc8379cfd39167dae WatchSource:0}: Error finding container 1d490dd589ada851a231ad8699687e0ca76bf2f9f4e3579dc8379cfd39167dae: Status 404 returned error can't find the container with id 1d490dd589ada851a231ad8699687e0ca76bf2f9f4e3579dc8379cfd39167dae Sep 17 14:08:16.760355 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:16.760332 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-8qrmx"] Sep 17 14:08:16.766097 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:16.766078 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-sqr44"] Sep 17 14:08:16.768868 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:08:16.768842 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod345f5575_9f8c_486b_9d57_7570a932d5a4.slice/crio-2d22225bb6a83f3a7c236e07c8263d956a6a97c4ab0065223170afc680f08897 WatchSource:0}: Error finding container 2d22225bb6a83f3a7c236e07c8263d956a6a97c4ab0065223170afc680f08897: Status 404 returned error can't find the container with id 2d22225bb6a83f3a7c236e07c8263d956a6a97c4ab0065223170afc680f08897 Sep 17 14:08:16.769694 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:08:16.769672 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4cde3bb_db2e_4afd_b878_1ff65574484c.slice/crio-efe2d0a06725a4e8b7bcdaaadc6c10b293f42bc007dc1649d4678e471a620488 WatchSource:0}: Error finding container efe2d0a06725a4e8b7bcdaaadc6c10b293f42bc007dc1649d4678e471a620488: Status 404 returned error can't find the container with id efe2d0a06725a4e8b7bcdaaadc6c10b293f42bc007dc1649d4678e471a620488 Sep 17 14:08:16.967267 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:16.967198 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8qrmx" event={"ID":"345f5575-9f8c-486b-9d57-7570a932d5a4","Type":"ContainerStarted","Data":"2d22225bb6a83f3a7c236e07c8263d956a6a97c4ab0065223170afc680f08897"} Sep 17 14:08:16.968249 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:16.968227 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-9jk57" event={"ID":"78551199-0cec-4921-b8a1-0858742751f4","Type":"ContainerStarted","Data":"1d490dd589ada851a231ad8699687e0ca76bf2f9f4e3579dc8379cfd39167dae"} Sep 17 14:08:16.969200 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:16.969180 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-sqr44" event={"ID":"b4cde3bb-db2e-4afd-b878-1ff65574484c","Type":"ContainerStarted","Data":"efe2d0a06725a4e8b7bcdaaadc6c10b293f42bc007dc1649d4678e471a620488"} Sep 17 14:08:16.998035 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:16.998019 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-kn9wk\"" Sep 17 14:08:17.006658 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:17.006643 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-gjjjg" Sep 17 14:08:17.281760 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:17.281690 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-gjjjg"] Sep 17 14:08:17.284849 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:08:17.284821 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod288ba618_7808_4554_946b_8a4ed475131a.slice/crio-508f839fbe2007650989355735345a48e4977f53a4526cf93a1702e2cc4883b2 WatchSource:0}: Error finding container 508f839fbe2007650989355735345a48e4977f53a4526cf93a1702e2cc4883b2: Status 404 returned error can't find the container with id 508f839fbe2007650989355735345a48e4977f53a4526cf93a1702e2cc4883b2 Sep 17 14:08:17.975506 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:17.975400 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8qrmx" event={"ID":"345f5575-9f8c-486b-9d57-7570a932d5a4","Type":"ContainerStarted","Data":"15a00291db05d234744bc1e3944cb2962c6a10a183e797cc83af7b8a54e39ede"} Sep 17 14:08:17.975506 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:17.975474 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8qrmx" event={"ID":"345f5575-9f8c-486b-9d57-7570a932d5a4","Type":"ContainerStarted","Data":"e0b60db624938a00934a066dd7e20c4a9f1eb4f6986f4826b79186f3be26c3b4"} Sep 17 14:08:17.976804 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:17.976780 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gjjjg" event={"ID":"288ba618-7808-4554-946b-8a4ed475131a","Type":"ContainerStarted","Data":"508f839fbe2007650989355735345a48e4977f53a4526cf93a1702e2cc4883b2"} Sep 17 14:08:17.993331 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:17.993276 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-8qrmx" podStartSLOduration=65.143627212 podStartE2EDuration="1m5.993259438s" totalImagesPullingTime="849.632226ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:07:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:08:17.992897207 +0000 UTC m=+66.951916713" watchObservedRunningTime="2026-09-17 14:08:17.993259438 +0000 UTC m=+66.952278949" Sep 17 14:08:19.984003 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:19.983624 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6946f4785b-9wxrg"] Sep 17 14:08:19.984003 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:08:19.983940 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-6946f4785b-9wxrg" podUID="e0e7ba35-7911-4320-97a9-85e2099b81e3" Sep 17 14:08:20.037578 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:20.037005 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-76f99584f4-9wcnk"] Sep 17 14:08:20.040146 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:20.040121 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-76f99584f4-9wcnk" Sep 17 14:08:20.042850 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:20.042806 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Sep 17 14:08:20.043127 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:20.043104 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Sep 17 14:08:20.043240 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:20.043104 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-dt8fw\"" Sep 17 14:08:20.071989 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:20.071962 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-76f99584f4-9wcnk"] Sep 17 14:08:20.144165 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:20.144046 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tts94\" (UniqueName: \"kubernetes.io/projected/14f67a3c-fb51-46e1-a7f7-f693c6310088-kube-api-access-tts94\") pod \"downloads-76f99584f4-9wcnk\" (UID: \"14f67a3c-fb51-46e1-a7f7-f693c6310088\") " pod="openshift-console/downloads-76f99584f4-9wcnk" Sep 17 14:08:20.245591 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:20.245512 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tts94\" (UniqueName: \"kubernetes.io/projected/14f67a3c-fb51-46e1-a7f7-f693c6310088-kube-api-access-tts94\") pod \"downloads-76f99584f4-9wcnk\" (UID: \"14f67a3c-fb51-46e1-a7f7-f693c6310088\") " pod="openshift-console/downloads-76f99584f4-9wcnk" Sep 17 14:08:20.257402 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:20.257377 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tts94\" (UniqueName: \"kubernetes.io/projected/14f67a3c-fb51-46e1-a7f7-f693c6310088-kube-api-access-tts94\") pod \"downloads-76f99584f4-9wcnk\" (UID: \"14f67a3c-fb51-46e1-a7f7-f693c6310088\") " pod="openshift-console/downloads-76f99584f4-9wcnk" Sep 17 14:08:20.352129 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:20.352050 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-76f99584f4-9wcnk" Sep 17 14:08:20.988726 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:20.988697 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6946f4785b-9wxrg" Sep 17 14:08:21.005646 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:21.005619 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6946f4785b-9wxrg" Sep 17 14:08:21.053328 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:21.053299 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e0e7ba35-7911-4320-97a9-85e2099b81e3-registry-certificates\") pod \"e0e7ba35-7911-4320-97a9-85e2099b81e3\" (UID: \"e0e7ba35-7911-4320-97a9-85e2099b81e3\") " Sep 17 14:08:21.053509 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:21.053359 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e0e7ba35-7911-4320-97a9-85e2099b81e3-installation-pull-secrets\") pod \"e0e7ba35-7911-4320-97a9-85e2099b81e3\" (UID: \"e0e7ba35-7911-4320-97a9-85e2099b81e3\") " Sep 17 14:08:21.053509 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:21.053438 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l9lll\" (UniqueName: \"kubernetes.io/projected/e0e7ba35-7911-4320-97a9-85e2099b81e3-kube-api-access-l9lll\") pod \"e0e7ba35-7911-4320-97a9-85e2099b81e3\" (UID: \"e0e7ba35-7911-4320-97a9-85e2099b81e3\") " Sep 17 14:08:21.053509 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:21.053479 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e0e7ba35-7911-4320-97a9-85e2099b81e3-trusted-ca\") pod \"e0e7ba35-7911-4320-97a9-85e2099b81e3\" (UID: \"e0e7ba35-7911-4320-97a9-85e2099b81e3\") " Sep 17 14:08:21.053663 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:21.053524 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e0e7ba35-7911-4320-97a9-85e2099b81e3-image-registry-private-configuration\") pod \"e0e7ba35-7911-4320-97a9-85e2099b81e3\" (UID: \"e0e7ba35-7911-4320-97a9-85e2099b81e3\") " Sep 17 14:08:21.053663 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:21.053562 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e0e7ba35-7911-4320-97a9-85e2099b81e3-bound-sa-token\") pod \"e0e7ba35-7911-4320-97a9-85e2099b81e3\" (UID: \"e0e7ba35-7911-4320-97a9-85e2099b81e3\") " Sep 17 14:08:21.053663 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:21.053589 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e0e7ba35-7911-4320-97a9-85e2099b81e3-ca-trust-extracted\") pod \"e0e7ba35-7911-4320-97a9-85e2099b81e3\" (UID: \"e0e7ba35-7911-4320-97a9-85e2099b81e3\") " Sep 17 14:08:21.053776 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:21.053684 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e0e7ba35-7911-4320-97a9-85e2099b81e3-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "e0e7ba35-7911-4320-97a9-85e2099b81e3" (UID: "e0e7ba35-7911-4320-97a9-85e2099b81e3"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 14:08:21.053827 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:21.053798 2558 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e0e7ba35-7911-4320-97a9-85e2099b81e3-registry-certificates\") on node \"ip-10-0-129-36.ec2.internal\" DevicePath \"\"" Sep 17 14:08:21.054065 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:21.054025 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e0e7ba35-7911-4320-97a9-85e2099b81e3-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "e0e7ba35-7911-4320-97a9-85e2099b81e3" (UID: "e0e7ba35-7911-4320-97a9-85e2099b81e3"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 17 14:08:21.054188 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:21.054088 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e0e7ba35-7911-4320-97a9-85e2099b81e3-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "e0e7ba35-7911-4320-97a9-85e2099b81e3" (UID: "e0e7ba35-7911-4320-97a9-85e2099b81e3"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 14:08:21.056149 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:21.056101 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e0e7ba35-7911-4320-97a9-85e2099b81e3-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "e0e7ba35-7911-4320-97a9-85e2099b81e3" (UID: "e0e7ba35-7911-4320-97a9-85e2099b81e3"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 14:08:21.056299 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:21.056272 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e0e7ba35-7911-4320-97a9-85e2099b81e3-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "e0e7ba35-7911-4320-97a9-85e2099b81e3" (UID: "e0e7ba35-7911-4320-97a9-85e2099b81e3"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 14:08:21.056402 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:21.056376 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e0e7ba35-7911-4320-97a9-85e2099b81e3-kube-api-access-l9lll" (OuterVolumeSpecName: "kube-api-access-l9lll") pod "e0e7ba35-7911-4320-97a9-85e2099b81e3" (UID: "e0e7ba35-7911-4320-97a9-85e2099b81e3"). InnerVolumeSpecName "kube-api-access-l9lll". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 14:08:21.056452 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:21.056402 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e0e7ba35-7911-4320-97a9-85e2099b81e3-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "e0e7ba35-7911-4320-97a9-85e2099b81e3" (UID: "e0e7ba35-7911-4320-97a9-85e2099b81e3"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 14:08:21.154699 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:21.154628 2558 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e0e7ba35-7911-4320-97a9-85e2099b81e3-installation-pull-secrets\") on node \"ip-10-0-129-36.ec2.internal\" DevicePath \"\"" Sep 17 14:08:21.154699 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:21.154657 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l9lll\" (UniqueName: \"kubernetes.io/projected/e0e7ba35-7911-4320-97a9-85e2099b81e3-kube-api-access-l9lll\") on node \"ip-10-0-129-36.ec2.internal\" DevicePath \"\"" Sep 17 14:08:21.154699 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:21.154672 2558 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e0e7ba35-7911-4320-97a9-85e2099b81e3-trusted-ca\") on node \"ip-10-0-129-36.ec2.internal\" DevicePath \"\"" Sep 17 14:08:21.154699 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:21.154686 2558 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e0e7ba35-7911-4320-97a9-85e2099b81e3-image-registry-private-configuration\") on node \"ip-10-0-129-36.ec2.internal\" DevicePath \"\"" Sep 17 14:08:21.154699 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:21.154698 2558 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e0e7ba35-7911-4320-97a9-85e2099b81e3-bound-sa-token\") on node \"ip-10-0-129-36.ec2.internal\" DevicePath \"\"" Sep 17 14:08:21.154993 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:21.154708 2558 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e0e7ba35-7911-4320-97a9-85e2099b81e3-ca-trust-extracted\") on node \"ip-10-0-129-36.ec2.internal\" DevicePath \"\"" Sep 17 14:08:21.991742 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:21.991709 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6946f4785b-9wxrg" Sep 17 14:08:22.028246 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:22.028215 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6946f4785b-9wxrg"] Sep 17 14:08:22.032825 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:22.032800 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6946f4785b-9wxrg"] Sep 17 14:08:22.162703 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:22.162673 2558 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e0e7ba35-7911-4320-97a9-85e2099b81e3-registry-tls\") on node \"ip-10-0-129-36.ec2.internal\" DevicePath \"\"" Sep 17 14:08:22.547351 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:22.547327 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-76f99584f4-9wcnk"] Sep 17 14:08:22.550327 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:08:22.550300 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14f67a3c_fb51_46e1_a7f7_f693c6310088.slice/crio-30a6c2c7c3e1a6a919273f2e84780f3f0903aee74b5dbb7111b4719e8ec0ff78 WatchSource:0}: Error finding container 30a6c2c7c3e1a6a919273f2e84780f3f0903aee74b5dbb7111b4719e8ec0ff78: Status 404 returned error can't find the container with id 30a6c2c7c3e1a6a919273f2e84780f3f0903aee74b5dbb7111b4719e8ec0ff78 Sep 17 14:08:22.766980 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:22.766948 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7e32a93a-9533-4d08-a4a4-b17a74a3c0f6-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-q4dh5\" (UID: \"7e32a93a-9533-4d08-a4a4-b17a74a3c0f6\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-q4dh5" Sep 17 14:08:22.769556 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:22.769523 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7e32a93a-9533-4d08-a4a4-b17a74a3c0f6-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-q4dh5\" (UID: \"7e32a93a-9533-4d08-a4a4-b17a74a3c0f6\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-q4dh5" Sep 17 14:08:22.969049 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:22.969011 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/63f7b6df-18e8-435a-a4eb-488c23b60007-metrics-certs\") pod \"router-default-78f666855d-9dpdw\" (UID: \"63f7b6df-18e8-435a-a4eb-488c23b60007\") " pod="openshift-ingress/router-default-78f666855d-9dpdw" Sep 17 14:08:22.969228 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:22.969064 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63f7b6df-18e8-435a-a4eb-488c23b60007-service-ca-bundle\") pod \"router-default-78f666855d-9dpdw\" (UID: \"63f7b6df-18e8-435a-a4eb-488c23b60007\") " pod="openshift-ingress/router-default-78f666855d-9dpdw" Sep 17 14:08:22.969676 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:22.969655 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63f7b6df-18e8-435a-a4eb-488c23b60007-service-ca-bundle\") pod \"router-default-78f666855d-9dpdw\" (UID: \"63f7b6df-18e8-435a-a4eb-488c23b60007\") " pod="openshift-ingress/router-default-78f666855d-9dpdw" Sep 17 14:08:22.971225 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:22.971205 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/63f7b6df-18e8-435a-a4eb-488c23b60007-metrics-certs\") pod \"router-default-78f666855d-9dpdw\" (UID: \"63f7b6df-18e8-435a-a4eb-488c23b60007\") " pod="openshift-ingress/router-default-78f666855d-9dpdw" Sep 17 14:08:22.986715 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:22.986692 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-ctlhq\"" Sep 17 14:08:22.994124 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:22.994097 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-q4dh5" Sep 17 14:08:22.996193 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:22.996166 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-76f99584f4-9wcnk" event={"ID":"14f67a3c-fb51-46e1-a7f7-f693c6310088","Type":"ContainerStarted","Data":"30a6c2c7c3e1a6a919273f2e84780f3f0903aee74b5dbb7111b4719e8ec0ff78"} Sep 17 14:08:22.998040 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:22.998020 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gjjjg" event={"ID":"288ba618-7808-4554-946b-8a4ed475131a","Type":"ContainerStarted","Data":"09bdd01418ce8f81abd52d70a0cf998931596fee84e90baf1104ec6ca058fee3"} Sep 17 14:08:22.998138 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:22.998060 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gjjjg" event={"ID":"288ba618-7808-4554-946b-8a4ed475131a","Type":"ContainerStarted","Data":"8ff5ca0d1822ed6979fc26a349574be77b44e535bd79b2c79dcc19bbbd14a031"} Sep 17 14:08:22.998138 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:22.998114 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-gjjjg" Sep 17 14:08:22.999484 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:22.999461 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-9jk57" event={"ID":"78551199-0cec-4921-b8a1-0858742751f4","Type":"ContainerStarted","Data":"85c899bbde50a311a9e3f80084a1a464f597a89419abf353de9d83dd6db320ad"} Sep 17 14:08:23.000837 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:23.000816 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-sqr44" event={"ID":"b4cde3bb-db2e-4afd-b878-1ff65574484c","Type":"ContainerStarted","Data":"ecdb65712f464ba400d206120e1bdedc04d3683c12b0f77f4d58406cd9ac1043"} Sep 17 14:08:23.000963 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:23.000947 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-sqr44" Sep 17 14:08:23.017673 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:23.017637 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-gjjjg" podStartSLOduration=34.027660183 podStartE2EDuration="39.017624115s" totalImagesPullingTime="4.989963932s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:07:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:08:23.017234606 +0000 UTC m=+71.976254115" watchObservedRunningTime="2026-09-17 14:08:23.017624115 +0000 UTC m=+71.976643623" Sep 17 14:08:23.038950 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:23.038902 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-9jk57" podStartSLOduration=65.226588008 podStartE2EDuration="1m11.038888146s" totalImagesPullingTime="5.812300138s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 14:07:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:08:23.038239579 +0000 UTC m=+71.997259086" watchObservedRunningTime="2026-09-17 14:08:23.038888146 +0000 UTC m=+71.997907653" Sep 17 14:08:23.058195 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:23.058156 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-sqr44" podStartSLOduration=65.542804102 podStartE2EDuration="1m11.058144643s" totalImagesPullingTime="5.515340541s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:07:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:08:23.057423549 +0000 UTC m=+72.016443063" watchObservedRunningTime="2026-09-17 14:08:23.058144643 +0000 UTC m=+72.017164152" Sep 17 14:08:23.158049 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:23.158024 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-lpllj\"" Sep 17 14:08:23.166814 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:23.166796 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-78f666855d-9dpdw" Sep 17 14:08:23.278133 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:23.278102 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-q4dh5"] Sep 17 14:08:23.281381 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:08:23.281346 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e32a93a_9533_4d08_a4a4_b17a74a3c0f6.slice/crio-f4138040350dbd3c75e475ccd9e6bfb36074a4af21ba4d1b77ac31f05df7fa81 WatchSource:0}: Error finding container f4138040350dbd3c75e475ccd9e6bfb36074a4af21ba4d1b77ac31f05df7fa81: Status 404 returned error can't find the container with id f4138040350dbd3c75e475ccd9e6bfb36074a4af21ba4d1b77ac31f05df7fa81 Sep 17 14:08:23.462673 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:23.462638 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-78f666855d-9dpdw"] Sep 17 14:08:23.467568 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:08:23.466961 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63f7b6df_18e8_435a_a4eb_488c23b60007.slice/crio-c38a9d8a2db24970747d5ae818510c51ab77a893fa2f77002cace0f8c69c94c9 WatchSource:0}: Error finding container c38a9d8a2db24970747d5ae818510c51ab77a893fa2f77002cace0f8c69c94c9: Status 404 returned error can't find the container with id c38a9d8a2db24970747d5ae818510c51ab77a893fa2f77002cace0f8c69c94c9 Sep 17 14:08:23.531918 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:23.531890 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e0e7ba35-7911-4320-97a9-85e2099b81e3" path="/var/lib/kubelet/pods/e0e7ba35-7911-4320-97a9-85e2099b81e3/volumes" Sep 17 14:08:24.007449 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:24.007414 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-78f666855d-9dpdw" event={"ID":"63f7b6df-18e8-435a-a4eb-488c23b60007","Type":"ContainerStarted","Data":"3325c023930c87f77514b4d718bcfb5213d7d756741f2aa277a21f2f796eb0c4"} Sep 17 14:08:24.007925 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:24.007469 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-78f666855d-9dpdw" event={"ID":"63f7b6df-18e8-435a-a4eb-488c23b60007","Type":"ContainerStarted","Data":"c38a9d8a2db24970747d5ae818510c51ab77a893fa2f77002cace0f8c69c94c9"} Sep 17 14:08:24.009303 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:24.009252 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-q4dh5" event={"ID":"7e32a93a-9533-4d08-a4a4-b17a74a3c0f6","Type":"ContainerStarted","Data":"f4138040350dbd3c75e475ccd9e6bfb36074a4af21ba4d1b77ac31f05df7fa81"} Sep 17 14:08:24.031274 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:24.031234 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-78f666855d-9dpdw" podStartSLOduration=34.031221182 podStartE2EDuration="34.031221182s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:07:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:08:24.030451141 +0000 UTC m=+72.989470650" watchObservedRunningTime="2026-09-17 14:08:24.031221182 +0000 UTC m=+72.990240687" Sep 17 14:08:24.167970 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:24.167942 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-78f666855d-9dpdw" Sep 17 14:08:24.170821 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:24.170797 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-78f666855d-9dpdw" Sep 17 14:08:25.013528 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:25.013470 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-78f666855d-9dpdw" Sep 17 14:08:25.014898 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:25.014873 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-78f666855d-9dpdw" Sep 17 14:08:26.019252 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:26.019163 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-q4dh5" event={"ID":"7e32a93a-9533-4d08-a4a4-b17a74a3c0f6","Type":"ContainerStarted","Data":"27d8a2ed17cc7e90d8ff67112ac3ae06f3cc90385626e2ea0cee4c2767a4aba7"} Sep 17 14:08:26.044764 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:26.044718 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-q4dh5" podStartSLOduration=33.63239103 podStartE2EDuration="36.044698743s" totalImagesPullingTime="2.412307713s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:07:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:08:26.043459327 +0000 UTC m=+75.002478835" watchObservedRunningTime="2026-09-17 14:08:26.044698743 +0000 UTC m=+75.003718250" Sep 17 14:08:26.340735 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:26.340701 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-ksq9z"] Sep 17 14:08:26.343073 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:26.343049 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-ksq9z" Sep 17 14:08:26.346385 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:26.346361 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-fnk2j\"" Sep 17 14:08:26.346521 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:26.346406 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Sep 17 14:08:26.353372 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:26.353337 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-ksq9z"] Sep 17 14:08:26.401562 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:26.401533 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/60fde3c5-7af2-4841-83ea-1b57b12ffdd4-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-ksq9z\" (UID: \"60fde3c5-7af2-4841-83ea-1b57b12ffdd4\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-ksq9z" Sep 17 14:08:26.502099 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:26.502059 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/60fde3c5-7af2-4841-83ea-1b57b12ffdd4-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-ksq9z\" (UID: \"60fde3c5-7af2-4841-83ea-1b57b12ffdd4\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-ksq9z" Sep 17 14:08:26.505014 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:26.504982 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/60fde3c5-7af2-4841-83ea-1b57b12ffdd4-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-ksq9z\" (UID: \"60fde3c5-7af2-4841-83ea-1b57b12ffdd4\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-ksq9z" Sep 17 14:08:26.655301 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:26.655188 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-ksq9z" Sep 17 14:08:26.958064 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:26.958036 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-ksq9z"] Sep 17 14:08:26.960194 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:08:26.960162 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60fde3c5_7af2_4841_83ea_1b57b12ffdd4.slice/crio-e2d3e11b2928b7ba783787a9eb8b8acec20c12cd1ca2c361ca74c846c5f2956b WatchSource:0}: Error finding container e2d3e11b2928b7ba783787a9eb8b8acec20c12cd1ca2c361ca74c846c5f2956b: Status 404 returned error can't find the container with id e2d3e11b2928b7ba783787a9eb8b8acec20c12cd1ca2c361ca74c846c5f2956b Sep 17 14:08:27.023964 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:27.023927 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-ksq9z" event={"ID":"60fde3c5-7af2-4841-83ea-1b57b12ffdd4","Type":"ContainerStarted","Data":"e2d3e11b2928b7ba783787a9eb8b8acec20c12cd1ca2c361ca74c846c5f2956b"} Sep 17 14:08:27.308871 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:27.308788 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/57f41982-5828-4481-986b-59808cc7c372-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zvgd2\" (UID: \"57f41982-5828-4481-986b-59808cc7c372\") " pod="openshift-insights/insights-runtime-extractor-zvgd2" Sep 17 14:08:27.311363 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:27.311340 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/57f41982-5828-4481-986b-59808cc7c372-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zvgd2\" (UID: \"57f41982-5828-4481-986b-59808cc7c372\") " pod="openshift-insights/insights-runtime-extractor-zvgd2" Sep 17 14:08:27.533968 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:27.533761 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-8wsdt\"" Sep 17 14:08:27.541297 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:27.541264 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-zvgd2" Sep 17 14:08:27.830622 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:27.830591 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-zvgd2"] Sep 17 14:08:28.066531 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:08:28.066477 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57f41982_5828_4481_986b_59808cc7c372.slice/crio-69689d84f062b67a58d9d00e9a57b4f867e770a0ab4732b438b5b0ec3a7c0bfb WatchSource:0}: Error finding container 69689d84f062b67a58d9d00e9a57b4f867e770a0ab4732b438b5b0ec3a7c0bfb: Status 404 returned error can't find the container with id 69689d84f062b67a58d9d00e9a57b4f867e770a0ab4732b438b5b0ec3a7c0bfb Sep 17 14:08:29.032896 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:29.032855 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-ksq9z" event={"ID":"60fde3c5-7af2-4841-83ea-1b57b12ffdd4","Type":"ContainerStarted","Data":"45cfd765ba5a9ca3dcdb7bd697ecf2aebcbc0f5de95298a0303664022820467d"} Sep 17 14:08:29.033080 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:29.032949 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-ksq9z" Sep 17 14:08:29.034706 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:29.034677 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zvgd2" event={"ID":"57f41982-5828-4481-986b-59808cc7c372","Type":"ContainerStarted","Data":"7e35ad536476b8e59d00187170fec5121cb983461c5b6b6b0d11c1d6868e085f"} Sep 17 14:08:29.034804 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:29.034735 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zvgd2" event={"ID":"57f41982-5828-4481-986b-59808cc7c372","Type":"ContainerStarted","Data":"69689d84f062b67a58d9d00e9a57b4f867e770a0ab4732b438b5b0ec3a7c0bfb"} Sep 17 14:08:29.038182 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:29.038164 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-ksq9z" Sep 17 14:08:29.064385 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:29.064341 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-ksq9z" podStartSLOduration=1.935067157 podStartE2EDuration="3.064327854s" totalImagesPullingTime="1.129260697s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:08:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:08:29.048238802 +0000 UTC m=+78.007258307" watchObservedRunningTime="2026-09-17 14:08:29.064327854 +0000 UTC m=+78.023347361" Sep 17 14:08:29.389253 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:29.389222 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-m64vh"] Sep 17 14:08:29.391739 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:29.391715 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-68bcd7f987-m64vh" Sep 17 14:08:29.394149 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:29.394124 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Sep 17 14:08:29.395137 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:29.395116 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Sep 17 14:08:29.395630 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:29.395347 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 17 14:08:29.395630 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:29.395411 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-gsh64\"" Sep 17 14:08:29.405064 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:29.404990 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-m64vh"] Sep 17 14:08:29.526325 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:29.526284 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4c8c001e-8382-49fa-a771-cf911ded2e0a-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-m64vh\" (UID: \"4c8c001e-8382-49fa-a771-cf911ded2e0a\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-m64vh" Sep 17 14:08:29.526325 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:29.526326 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f5454\" (UniqueName: \"kubernetes.io/projected/4c8c001e-8382-49fa-a771-cf911ded2e0a-kube-api-access-f5454\") pod \"prometheus-operator-68bcd7f987-m64vh\" (UID: \"4c8c001e-8382-49fa-a771-cf911ded2e0a\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-m64vh" Sep 17 14:08:29.526570 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:29.526369 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/4c8c001e-8382-49fa-a771-cf911ded2e0a-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-m64vh\" (UID: \"4c8c001e-8382-49fa-a771-cf911ded2e0a\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-m64vh" Sep 17 14:08:29.526570 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:29.526460 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4c8c001e-8382-49fa-a771-cf911ded2e0a-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-m64vh\" (UID: \"4c8c001e-8382-49fa-a771-cf911ded2e0a\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-m64vh" Sep 17 14:08:29.627624 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:29.627596 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/4c8c001e-8382-49fa-a771-cf911ded2e0a-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-m64vh\" (UID: \"4c8c001e-8382-49fa-a771-cf911ded2e0a\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-m64vh" Sep 17 14:08:29.627753 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:29.627645 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4c8c001e-8382-49fa-a771-cf911ded2e0a-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-m64vh\" (UID: \"4c8c001e-8382-49fa-a771-cf911ded2e0a\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-m64vh" Sep 17 14:08:29.627753 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:29.627687 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4c8c001e-8382-49fa-a771-cf911ded2e0a-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-m64vh\" (UID: \"4c8c001e-8382-49fa-a771-cf911ded2e0a\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-m64vh" Sep 17 14:08:29.627753 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:29.627711 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f5454\" (UniqueName: \"kubernetes.io/projected/4c8c001e-8382-49fa-a771-cf911ded2e0a-kube-api-access-f5454\") pod \"prometheus-operator-68bcd7f987-m64vh\" (UID: \"4c8c001e-8382-49fa-a771-cf911ded2e0a\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-m64vh" Sep 17 14:08:29.627913 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:08:29.627759 2558 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Sep 17 14:08:29.627913 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:08:29.627831 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c8c001e-8382-49fa-a771-cf911ded2e0a-prometheus-operator-tls podName:4c8c001e-8382-49fa-a771-cf911ded2e0a nodeName:}" failed. No retries permitted until 2026-09-17 14:08:30.127810568 +0000 UTC m=+79.086830069 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/4c8c001e-8382-49fa-a771-cf911ded2e0a-prometheus-operator-tls") pod "prometheus-operator-68bcd7f987-m64vh" (UID: "4c8c001e-8382-49fa-a771-cf911ded2e0a") : secret "prometheus-operator-tls" not found Sep 17 14:08:29.628424 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:29.628400 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4c8c001e-8382-49fa-a771-cf911ded2e0a-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-m64vh\" (UID: \"4c8c001e-8382-49fa-a771-cf911ded2e0a\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-m64vh" Sep 17 14:08:29.630225 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:29.630200 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4c8c001e-8382-49fa-a771-cf911ded2e0a-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-m64vh\" (UID: \"4c8c001e-8382-49fa-a771-cf911ded2e0a\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-m64vh" Sep 17 14:08:29.636250 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:29.636230 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f5454\" (UniqueName: \"kubernetes.io/projected/4c8c001e-8382-49fa-a771-cf911ded2e0a-kube-api-access-f5454\") pod \"prometheus-operator-68bcd7f987-m64vh\" (UID: \"4c8c001e-8382-49fa-a771-cf911ded2e0a\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-m64vh" Sep 17 14:08:30.040506 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:30.040467 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zvgd2" event={"ID":"57f41982-5828-4481-986b-59808cc7c372","Type":"ContainerStarted","Data":"607e68928a469671b87fcbb9ca71f3d9a991180b13d8fec5db70a4392ecd3aac"} Sep 17 14:08:30.132316 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:30.132257 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/4c8c001e-8382-49fa-a771-cf911ded2e0a-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-m64vh\" (UID: \"4c8c001e-8382-49fa-a771-cf911ded2e0a\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-m64vh" Sep 17 14:08:30.134881 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:30.134853 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/4c8c001e-8382-49fa-a771-cf911ded2e0a-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-m64vh\" (UID: \"4c8c001e-8382-49fa-a771-cf911ded2e0a\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-m64vh" Sep 17 14:08:30.305333 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:30.305250 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-68bcd7f987-m64vh" Sep 17 14:08:30.591664 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:30.591627 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-m64vh"] Sep 17 14:08:30.597592 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:08:30.597564 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c8c001e_8382_49fa_a771_cf911ded2e0a.slice/crio-11925091e378d4f39566446d567ac26b9716f00975de26c883753ea1cc7ae7dd WatchSource:0}: Error finding container 11925091e378d4f39566446d567ac26b9716f00975de26c883753ea1cc7ae7dd: Status 404 returned error can't find the container with id 11925091e378d4f39566446d567ac26b9716f00975de26c883753ea1cc7ae7dd Sep 17 14:08:31.046808 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:31.046552 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-m64vh" event={"ID":"4c8c001e-8382-49fa-a771-cf911ded2e0a","Type":"ContainerStarted","Data":"11925091e378d4f39566446d567ac26b9716f00975de26c883753ea1cc7ae7dd"} Sep 17 14:08:32.053226 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:32.053189 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zvgd2" event={"ID":"57f41982-5828-4481-986b-59808cc7c372","Type":"ContainerStarted","Data":"339ca29ecde60af205784cee494be44a650a3bacdda08d2e6f31955c2796c10c"} Sep 17 14:08:32.080956 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:32.080900 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-zvgd2" podStartSLOduration=34.16562064 podStartE2EDuration="37.080879165s" totalImagesPullingTime="2.915258525s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 14:07:55 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:08:32.078872763 +0000 UTC m=+81.037892271" watchObservedRunningTime="2026-09-17 14:08:32.080879165 +0000 UTC m=+81.039898672" Sep 17 14:08:33.012264 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:33.012229 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-gjjjg" Sep 17 14:08:33.060259 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:33.060095 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-m64vh" event={"ID":"4c8c001e-8382-49fa-a771-cf911ded2e0a","Type":"ContainerStarted","Data":"6367909343f30c145f32d4fb38282aded9cd75fe42345178654d2f8589dedf7a"} Sep 17 14:08:33.060259 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:33.060171 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-m64vh" event={"ID":"4c8c001e-8382-49fa-a771-cf911ded2e0a","Type":"ContainerStarted","Data":"edabbf209b65ecd4cf7ac6723f36d5286ce75a05f251fc6937cc9fd4d9a143a5"} Sep 17 14:08:33.077856 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:33.077805 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-68bcd7f987-m64vh" podStartSLOduration=2.676401368 podStartE2EDuration="4.077786238s" totalImagesPullingTime="1.40138487s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:08:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:08:33.076411687 +0000 UTC m=+82.035431208" watchObservedRunningTime="2026-09-17 14:08:33.077786238 +0000 UTC m=+82.036805749" Sep 17 14:08:34.758377 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:34.758244 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-bhd5q"] Sep 17 14:08:34.761530 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:34.761473 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-bhd5q" Sep 17 14:08:34.763883 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:34.763858 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-68f6j\"" Sep 17 14:08:34.764020 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:34.763988 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Sep 17 14:08:34.764463 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:34.764441 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Sep 17 14:08:34.781598 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:34.781574 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-bhd5q"] Sep 17 14:08:34.795803 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:34.795772 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-59fbdd77d-b89qd"] Sep 17 14:08:34.798739 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:34.798721 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-b89qd" Sep 17 14:08:34.802005 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:34.801984 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-xmn7r\"" Sep 17 14:08:34.802138 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:34.802076 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Sep 17 14:08:34.802678 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:34.802657 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Sep 17 14:08:34.802946 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:34.802923 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Sep 17 14:08:34.815605 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:34.815583 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-59fbdd77d-b89qd"] Sep 17 14:08:34.819924 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:34.819905 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-5phpk"] Sep 17 14:08:34.822223 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:34.822206 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5phpk" Sep 17 14:08:34.824458 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:34.824439 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 17 14:08:34.824614 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:34.824591 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 17 14:08:34.824754 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:34.824737 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-mnb26\"" Sep 17 14:08:34.824984 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:34.824809 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 17 14:08:34.869433 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:34.869397 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/cd52454b-212b-4ead-8178-8a0f439b66de-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-b89qd\" (UID: \"cd52454b-212b-4ead-8178-8a0f439b66de\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-b89qd" Sep 17 14:08:34.869621 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:34.869445 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/cd52454b-212b-4ead-8178-8a0f439b66de-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-59fbdd77d-b89qd\" (UID: \"cd52454b-212b-4ead-8178-8a0f439b66de\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-b89qd" Sep 17 14:08:34.869621 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:34.869483 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/177d2a1f-db87-4340-b6db-9a53277f0310-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-bhd5q\" (UID: \"177d2a1f-db87-4340-b6db-9a53277f0310\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-bhd5q" Sep 17 14:08:34.869621 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:34.869548 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/177d2a1f-db87-4340-b6db-9a53277f0310-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-bhd5q\" (UID: \"177d2a1f-db87-4340-b6db-9a53277f0310\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-bhd5q" Sep 17 14:08:34.869621 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:34.869568 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cd52454b-212b-4ead-8178-8a0f439b66de-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-59fbdd77d-b89qd\" (UID: \"cd52454b-212b-4ead-8178-8a0f439b66de\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-b89qd" Sep 17 14:08:34.869621 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:34.869609 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxxsx\" (UniqueName: \"kubernetes.io/projected/177d2a1f-db87-4340-b6db-9a53277f0310-kube-api-access-sxxsx\") pod \"openshift-state-metrics-67dcf8c979-bhd5q\" (UID: \"177d2a1f-db87-4340-b6db-9a53277f0310\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-bhd5q" Sep 17 14:08:34.869848 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:34.869667 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4fjmq\" (UniqueName: \"kubernetes.io/projected/cd52454b-212b-4ead-8178-8a0f439b66de-kube-api-access-4fjmq\") pod \"kube-state-metrics-59fbdd77d-b89qd\" (UID: \"cd52454b-212b-4ead-8178-8a0f439b66de\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-b89qd" Sep 17 14:08:34.869848 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:34.869739 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/177d2a1f-db87-4340-b6db-9a53277f0310-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-bhd5q\" (UID: \"177d2a1f-db87-4340-b6db-9a53277f0310\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-bhd5q" Sep 17 14:08:34.869848 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:34.869764 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/cd52454b-212b-4ead-8178-8a0f439b66de-volume-directive-shadow\") pod \"kube-state-metrics-59fbdd77d-b89qd\" (UID: \"cd52454b-212b-4ead-8178-8a0f439b66de\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-b89qd" Sep 17 14:08:34.869848 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:34.869787 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cd52454b-212b-4ead-8178-8a0f439b66de-metrics-client-ca\") pod \"kube-state-metrics-59fbdd77d-b89qd\" (UID: \"cd52454b-212b-4ead-8178-8a0f439b66de\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-b89qd" Sep 17 14:08:34.970858 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:34.970820 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/78dd496d-c4d0-4b08-9d80-48a098851103-node-exporter-wtmp\") pod \"node-exporter-5phpk\" (UID: \"78dd496d-c4d0-4b08-9d80-48a098851103\") " pod="openshift-monitoring/node-exporter-5phpk" Sep 17 14:08:34.971019 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:34.970870 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/177d2a1f-db87-4340-b6db-9a53277f0310-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-bhd5q\" (UID: \"177d2a1f-db87-4340-b6db-9a53277f0310\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-bhd5q" Sep 17 14:08:34.971019 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:34.970893 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/78dd496d-c4d0-4b08-9d80-48a098851103-node-exporter-textfile\") pod \"node-exporter-5phpk\" (UID: \"78dd496d-c4d0-4b08-9d80-48a098851103\") " pod="openshift-monitoring/node-exporter-5phpk" Sep 17 14:08:34.971019 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:34.970916 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/177d2a1f-db87-4340-b6db-9a53277f0310-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-bhd5q\" (UID: \"177d2a1f-db87-4340-b6db-9a53277f0310\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-bhd5q" Sep 17 14:08:34.971019 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:34.970934 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cd52454b-212b-4ead-8178-8a0f439b66de-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-59fbdd77d-b89qd\" (UID: \"cd52454b-212b-4ead-8178-8a0f439b66de\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-b89qd" Sep 17 14:08:34.971019 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:34.970959 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5vd54\" (UniqueName: \"kubernetes.io/projected/78dd496d-c4d0-4b08-9d80-48a098851103-kube-api-access-5vd54\") pod \"node-exporter-5phpk\" (UID: \"78dd496d-c4d0-4b08-9d80-48a098851103\") " pod="openshift-monitoring/node-exporter-5phpk" Sep 17 14:08:34.971019 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:34.970986 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxxsx\" (UniqueName: \"kubernetes.io/projected/177d2a1f-db87-4340-b6db-9a53277f0310-kube-api-access-sxxsx\") pod \"openshift-state-metrics-67dcf8c979-bhd5q\" (UID: \"177d2a1f-db87-4340-b6db-9a53277f0310\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-bhd5q" Sep 17 14:08:34.971019 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:34.971012 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/78dd496d-c4d0-4b08-9d80-48a098851103-node-exporter-tls\") pod \"node-exporter-5phpk\" (UID: \"78dd496d-c4d0-4b08-9d80-48a098851103\") " pod="openshift-monitoring/node-exporter-5phpk" Sep 17 14:08:34.971691 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:34.971047 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4fjmq\" (UniqueName: \"kubernetes.io/projected/cd52454b-212b-4ead-8178-8a0f439b66de-kube-api-access-4fjmq\") pod \"kube-state-metrics-59fbdd77d-b89qd\" (UID: \"cd52454b-212b-4ead-8178-8a0f439b66de\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-b89qd" Sep 17 14:08:34.971691 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:34.971093 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/78dd496d-c4d0-4b08-9d80-48a098851103-metrics-client-ca\") pod \"node-exporter-5phpk\" (UID: \"78dd496d-c4d0-4b08-9d80-48a098851103\") " pod="openshift-monitoring/node-exporter-5phpk" Sep 17 14:08:34.971691 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:34.971242 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/78dd496d-c4d0-4b08-9d80-48a098851103-node-exporter-accelerators-collector-config\") pod \"node-exporter-5phpk\" (UID: \"78dd496d-c4d0-4b08-9d80-48a098851103\") " pod="openshift-monitoring/node-exporter-5phpk" Sep 17 14:08:34.971691 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:34.971291 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/78dd496d-c4d0-4b08-9d80-48a098851103-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5phpk\" (UID: \"78dd496d-c4d0-4b08-9d80-48a098851103\") " pod="openshift-monitoring/node-exporter-5phpk" Sep 17 14:08:34.971691 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:34.971335 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/177d2a1f-db87-4340-b6db-9a53277f0310-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-bhd5q\" (UID: \"177d2a1f-db87-4340-b6db-9a53277f0310\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-bhd5q" Sep 17 14:08:34.971691 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:34.971364 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/cd52454b-212b-4ead-8178-8a0f439b66de-volume-directive-shadow\") pod \"kube-state-metrics-59fbdd77d-b89qd\" (UID: \"cd52454b-212b-4ead-8178-8a0f439b66de\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-b89qd" Sep 17 14:08:34.971691 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:34.971543 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cd52454b-212b-4ead-8178-8a0f439b66de-metrics-client-ca\") pod \"kube-state-metrics-59fbdd77d-b89qd\" (UID: \"cd52454b-212b-4ead-8178-8a0f439b66de\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-b89qd" Sep 17 14:08:34.971691 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:34.971593 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/78dd496d-c4d0-4b08-9d80-48a098851103-sys\") pod \"node-exporter-5phpk\" (UID: \"78dd496d-c4d0-4b08-9d80-48a098851103\") " pod="openshift-monitoring/node-exporter-5phpk" Sep 17 14:08:34.971691 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:34.971623 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/78dd496d-c4d0-4b08-9d80-48a098851103-root\") pod \"node-exporter-5phpk\" (UID: \"78dd496d-c4d0-4b08-9d80-48a098851103\") " pod="openshift-monitoring/node-exporter-5phpk" Sep 17 14:08:34.971691 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:34.971660 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/cd52454b-212b-4ead-8178-8a0f439b66de-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-b89qd\" (UID: \"cd52454b-212b-4ead-8178-8a0f439b66de\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-b89qd" Sep 17 14:08:34.971691 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:34.971690 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/cd52454b-212b-4ead-8178-8a0f439b66de-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-59fbdd77d-b89qd\" (UID: \"cd52454b-212b-4ead-8178-8a0f439b66de\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-b89qd" Sep 17 14:08:34.972243 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:34.971749 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/177d2a1f-db87-4340-b6db-9a53277f0310-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-bhd5q\" (UID: \"177d2a1f-db87-4340-b6db-9a53277f0310\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-bhd5q" Sep 17 14:08:34.972243 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:34.971749 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/cd52454b-212b-4ead-8178-8a0f439b66de-volume-directive-shadow\") pod \"kube-state-metrics-59fbdd77d-b89qd\" (UID: \"cd52454b-212b-4ead-8178-8a0f439b66de\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-b89qd" Sep 17 14:08:34.972243 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:08:34.971858 2558 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Sep 17 14:08:34.972243 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:08:34.971930 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd52454b-212b-4ead-8178-8a0f439b66de-kube-state-metrics-tls podName:cd52454b-212b-4ead-8178-8a0f439b66de nodeName:}" failed. No retries permitted until 2026-09-17 14:08:35.471910027 +0000 UTC m=+84.430929517 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/cd52454b-212b-4ead-8178-8a0f439b66de-kube-state-metrics-tls") pod "kube-state-metrics-59fbdd77d-b89qd" (UID: "cd52454b-212b-4ead-8178-8a0f439b66de") : secret "kube-state-metrics-tls" not found Sep 17 14:08:34.972432 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:34.972409 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/cd52454b-212b-4ead-8178-8a0f439b66de-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-59fbdd77d-b89qd\" (UID: \"cd52454b-212b-4ead-8178-8a0f439b66de\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-b89qd" Sep 17 14:08:34.972478 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:34.972463 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cd52454b-212b-4ead-8178-8a0f439b66de-metrics-client-ca\") pod \"kube-state-metrics-59fbdd77d-b89qd\" (UID: \"cd52454b-212b-4ead-8178-8a0f439b66de\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-b89qd" Sep 17 14:08:34.973774 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:34.973750 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/177d2a1f-db87-4340-b6db-9a53277f0310-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-bhd5q\" (UID: \"177d2a1f-db87-4340-b6db-9a53277f0310\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-bhd5q" Sep 17 14:08:34.973942 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:34.973919 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cd52454b-212b-4ead-8178-8a0f439b66de-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-59fbdd77d-b89qd\" (UID: \"cd52454b-212b-4ead-8178-8a0f439b66de\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-b89qd" Sep 17 14:08:34.974132 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:34.974107 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/177d2a1f-db87-4340-b6db-9a53277f0310-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-bhd5q\" (UID: \"177d2a1f-db87-4340-b6db-9a53277f0310\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-bhd5q" Sep 17 14:08:34.983901 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:34.983841 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4fjmq\" (UniqueName: \"kubernetes.io/projected/cd52454b-212b-4ead-8178-8a0f439b66de-kube-api-access-4fjmq\") pod \"kube-state-metrics-59fbdd77d-b89qd\" (UID: \"cd52454b-212b-4ead-8178-8a0f439b66de\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-b89qd" Sep 17 14:08:34.995589 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:34.995560 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxxsx\" (UniqueName: \"kubernetes.io/projected/177d2a1f-db87-4340-b6db-9a53277f0310-kube-api-access-sxxsx\") pod \"openshift-state-metrics-67dcf8c979-bhd5q\" (UID: \"177d2a1f-db87-4340-b6db-9a53277f0310\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-bhd5q" Sep 17 14:08:35.072431 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:35.072400 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/78dd496d-c4d0-4b08-9d80-48a098851103-node-exporter-wtmp\") pod \"node-exporter-5phpk\" (UID: \"78dd496d-c4d0-4b08-9d80-48a098851103\") " pod="openshift-monitoring/node-exporter-5phpk" Sep 17 14:08:35.072431 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:35.072436 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/78dd496d-c4d0-4b08-9d80-48a098851103-node-exporter-textfile\") pod \"node-exporter-5phpk\" (UID: \"78dd496d-c4d0-4b08-9d80-48a098851103\") " pod="openshift-monitoring/node-exporter-5phpk" Sep 17 14:08:35.072687 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:35.072457 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5vd54\" (UniqueName: \"kubernetes.io/projected/78dd496d-c4d0-4b08-9d80-48a098851103-kube-api-access-5vd54\") pod \"node-exporter-5phpk\" (UID: \"78dd496d-c4d0-4b08-9d80-48a098851103\") " pod="openshift-monitoring/node-exporter-5phpk" Sep 17 14:08:35.072687 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:35.072476 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/78dd496d-c4d0-4b08-9d80-48a098851103-node-exporter-tls\") pod \"node-exporter-5phpk\" (UID: \"78dd496d-c4d0-4b08-9d80-48a098851103\") " pod="openshift-monitoring/node-exporter-5phpk" Sep 17 14:08:35.072687 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:35.072524 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/78dd496d-c4d0-4b08-9d80-48a098851103-metrics-client-ca\") pod \"node-exporter-5phpk\" (UID: \"78dd496d-c4d0-4b08-9d80-48a098851103\") " pod="openshift-monitoring/node-exporter-5phpk" Sep 17 14:08:35.072687 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:35.072565 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/78dd496d-c4d0-4b08-9d80-48a098851103-node-exporter-accelerators-collector-config\") pod \"node-exporter-5phpk\" (UID: \"78dd496d-c4d0-4b08-9d80-48a098851103\") " pod="openshift-monitoring/node-exporter-5phpk" Sep 17 14:08:35.072687 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:35.072594 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/78dd496d-c4d0-4b08-9d80-48a098851103-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5phpk\" (UID: \"78dd496d-c4d0-4b08-9d80-48a098851103\") " pod="openshift-monitoring/node-exporter-5phpk" Sep 17 14:08:35.072687 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:35.072643 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/78dd496d-c4d0-4b08-9d80-48a098851103-sys\") pod \"node-exporter-5phpk\" (UID: \"78dd496d-c4d0-4b08-9d80-48a098851103\") " pod="openshift-monitoring/node-exporter-5phpk" Sep 17 14:08:35.072687 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:35.072670 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-bhd5q" Sep 17 14:08:35.073028 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:35.072716 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/78dd496d-c4d0-4b08-9d80-48a098851103-root\") pod \"node-exporter-5phpk\" (UID: \"78dd496d-c4d0-4b08-9d80-48a098851103\") " pod="openshift-monitoring/node-exporter-5phpk" Sep 17 14:08:35.073028 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:35.072843 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/78dd496d-c4d0-4b08-9d80-48a098851103-sys\") pod \"node-exporter-5phpk\" (UID: \"78dd496d-c4d0-4b08-9d80-48a098851103\") " pod="openshift-monitoring/node-exporter-5phpk" Sep 17 14:08:35.073028 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:35.072861 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/78dd496d-c4d0-4b08-9d80-48a098851103-node-exporter-textfile\") pod \"node-exporter-5phpk\" (UID: \"78dd496d-c4d0-4b08-9d80-48a098851103\") " pod="openshift-monitoring/node-exporter-5phpk" Sep 17 14:08:35.073028 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:35.073002 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/78dd496d-c4d0-4b08-9d80-48a098851103-node-exporter-wtmp\") pod \"node-exporter-5phpk\" (UID: \"78dd496d-c4d0-4b08-9d80-48a098851103\") " pod="openshift-monitoring/node-exporter-5phpk" Sep 17 14:08:35.073028 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:35.072670 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/78dd496d-c4d0-4b08-9d80-48a098851103-root\") pod \"node-exporter-5phpk\" (UID: \"78dd496d-c4d0-4b08-9d80-48a098851103\") " pod="openshift-monitoring/node-exporter-5phpk" Sep 17 14:08:35.073317 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:35.073295 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/78dd496d-c4d0-4b08-9d80-48a098851103-metrics-client-ca\") pod \"node-exporter-5phpk\" (UID: \"78dd496d-c4d0-4b08-9d80-48a098851103\") " pod="openshift-monitoring/node-exporter-5phpk" Sep 17 14:08:35.073434 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:35.073386 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/78dd496d-c4d0-4b08-9d80-48a098851103-node-exporter-accelerators-collector-config\") pod \"node-exporter-5phpk\" (UID: \"78dd496d-c4d0-4b08-9d80-48a098851103\") " pod="openshift-monitoring/node-exporter-5phpk" Sep 17 14:08:35.075483 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:35.075303 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/78dd496d-c4d0-4b08-9d80-48a098851103-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5phpk\" (UID: \"78dd496d-c4d0-4b08-9d80-48a098851103\") " pod="openshift-monitoring/node-exporter-5phpk" Sep 17 14:08:35.075483 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:35.075409 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/78dd496d-c4d0-4b08-9d80-48a098851103-node-exporter-tls\") pod \"node-exporter-5phpk\" (UID: \"78dd496d-c4d0-4b08-9d80-48a098851103\") " pod="openshift-monitoring/node-exporter-5phpk" Sep 17 14:08:35.081277 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:35.081248 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vd54\" (UniqueName: \"kubernetes.io/projected/78dd496d-c4d0-4b08-9d80-48a098851103-kube-api-access-5vd54\") pod \"node-exporter-5phpk\" (UID: \"78dd496d-c4d0-4b08-9d80-48a098851103\") " pod="openshift-monitoring/node-exporter-5phpk" Sep 17 14:08:35.131948 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:35.131919 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5phpk" Sep 17 14:08:35.476557 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:35.476473 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/cd52454b-212b-4ead-8178-8a0f439b66de-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-b89qd\" (UID: \"cd52454b-212b-4ead-8178-8a0f439b66de\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-b89qd" Sep 17 14:08:35.479135 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:35.479108 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/cd52454b-212b-4ead-8178-8a0f439b66de-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-b89qd\" (UID: \"cd52454b-212b-4ead-8178-8a0f439b66de\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-b89qd" Sep 17 14:08:35.709093 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:35.709051 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-b89qd" Sep 17 14:08:35.883757 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:35.883721 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 17 14:08:35.886941 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:35.886908 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 17 14:08:35.889806 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:35.889777 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Sep 17 14:08:35.889806 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:35.889789 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Sep 17 14:08:35.889959 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:35.889776 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Sep 17 14:08:35.890616 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:35.890278 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Sep 17 14:08:35.890731 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:35.890627 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Sep 17 14:08:35.892076 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:35.891323 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Sep 17 14:08:35.892076 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:35.891562 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-wwrzt\"" Sep 17 14:08:35.892076 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:35.891748 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Sep 17 14:08:35.892076 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:35.891921 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Sep 17 14:08:35.898710 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:35.898547 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Sep 17 14:08:35.920735 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:35.920712 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 17 14:08:35.982005 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:35.981980 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/455ca95c-b3b6-4aab-94c1-64f728c758a6-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"455ca95c-b3b6-4aab-94c1-64f728c758a6\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 14:08:35.982165 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:35.982015 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/455ca95c-b3b6-4aab-94c1-64f728c758a6-web-config\") pod \"alertmanager-main-0\" (UID: \"455ca95c-b3b6-4aab-94c1-64f728c758a6\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 14:08:35.982165 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:35.982044 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/455ca95c-b3b6-4aab-94c1-64f728c758a6-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"455ca95c-b3b6-4aab-94c1-64f728c758a6\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 14:08:35.982165 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:35.982095 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/455ca95c-b3b6-4aab-94c1-64f728c758a6-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"455ca95c-b3b6-4aab-94c1-64f728c758a6\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 14:08:35.982322 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:35.982166 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/455ca95c-b3b6-4aab-94c1-64f728c758a6-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"455ca95c-b3b6-4aab-94c1-64f728c758a6\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 14:08:35.982322 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:35.982186 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/455ca95c-b3b6-4aab-94c1-64f728c758a6-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"455ca95c-b3b6-4aab-94c1-64f728c758a6\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 14:08:35.982322 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:35.982207 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/455ca95c-b3b6-4aab-94c1-64f728c758a6-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"455ca95c-b3b6-4aab-94c1-64f728c758a6\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 14:08:35.982322 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:35.982248 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/455ca95c-b3b6-4aab-94c1-64f728c758a6-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"455ca95c-b3b6-4aab-94c1-64f728c758a6\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 14:08:35.982322 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:35.982297 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/455ca95c-b3b6-4aab-94c1-64f728c758a6-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"455ca95c-b3b6-4aab-94c1-64f728c758a6\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 14:08:35.982322 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:35.982323 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/455ca95c-b3b6-4aab-94c1-64f728c758a6-config-volume\") pod \"alertmanager-main-0\" (UID: \"455ca95c-b3b6-4aab-94c1-64f728c758a6\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 14:08:35.982609 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:35.982347 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/455ca95c-b3b6-4aab-94c1-64f728c758a6-config-out\") pod \"alertmanager-main-0\" (UID: \"455ca95c-b3b6-4aab-94c1-64f728c758a6\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 14:08:35.982609 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:35.982385 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-66ttl\" (UniqueName: \"kubernetes.io/projected/455ca95c-b3b6-4aab-94c1-64f728c758a6-kube-api-access-66ttl\") pod \"alertmanager-main-0\" (UID: \"455ca95c-b3b6-4aab-94c1-64f728c758a6\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 14:08:35.982609 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:35.982410 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/455ca95c-b3b6-4aab-94c1-64f728c758a6-tls-assets\") pod \"alertmanager-main-0\" (UID: \"455ca95c-b3b6-4aab-94c1-64f728c758a6\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 14:08:36.082920 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:36.082881 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/455ca95c-b3b6-4aab-94c1-64f728c758a6-config-out\") pod \"alertmanager-main-0\" (UID: \"455ca95c-b3b6-4aab-94c1-64f728c758a6\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 14:08:36.083088 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:36.082938 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-66ttl\" (UniqueName: \"kubernetes.io/projected/455ca95c-b3b6-4aab-94c1-64f728c758a6-kube-api-access-66ttl\") pod \"alertmanager-main-0\" (UID: \"455ca95c-b3b6-4aab-94c1-64f728c758a6\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 14:08:36.083088 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:36.082970 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/455ca95c-b3b6-4aab-94c1-64f728c758a6-tls-assets\") pod \"alertmanager-main-0\" (UID: \"455ca95c-b3b6-4aab-94c1-64f728c758a6\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 14:08:36.083088 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:36.083003 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/455ca95c-b3b6-4aab-94c1-64f728c758a6-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"455ca95c-b3b6-4aab-94c1-64f728c758a6\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 14:08:36.083088 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:36.083034 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/455ca95c-b3b6-4aab-94c1-64f728c758a6-web-config\") pod \"alertmanager-main-0\" (UID: \"455ca95c-b3b6-4aab-94c1-64f728c758a6\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 14:08:36.083088 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:36.083063 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/455ca95c-b3b6-4aab-94c1-64f728c758a6-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"455ca95c-b3b6-4aab-94c1-64f728c758a6\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 14:08:36.083088 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:36.083089 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/455ca95c-b3b6-4aab-94c1-64f728c758a6-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"455ca95c-b3b6-4aab-94c1-64f728c758a6\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 14:08:36.083383 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:36.083138 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/455ca95c-b3b6-4aab-94c1-64f728c758a6-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"455ca95c-b3b6-4aab-94c1-64f728c758a6\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 14:08:36.083383 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:36.083164 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/455ca95c-b3b6-4aab-94c1-64f728c758a6-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"455ca95c-b3b6-4aab-94c1-64f728c758a6\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 14:08:36.083383 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:36.083188 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/455ca95c-b3b6-4aab-94c1-64f728c758a6-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"455ca95c-b3b6-4aab-94c1-64f728c758a6\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 14:08:36.083383 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:36.083215 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/455ca95c-b3b6-4aab-94c1-64f728c758a6-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"455ca95c-b3b6-4aab-94c1-64f728c758a6\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 14:08:36.083383 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:36.083248 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/455ca95c-b3b6-4aab-94c1-64f728c758a6-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"455ca95c-b3b6-4aab-94c1-64f728c758a6\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 14:08:36.083383 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:36.083287 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/455ca95c-b3b6-4aab-94c1-64f728c758a6-config-volume\") pod \"alertmanager-main-0\" (UID: \"455ca95c-b3b6-4aab-94c1-64f728c758a6\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 14:08:36.083832 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:36.083802 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/455ca95c-b3b6-4aab-94c1-64f728c758a6-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"455ca95c-b3b6-4aab-94c1-64f728c758a6\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 14:08:36.085291 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:36.084323 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/455ca95c-b3b6-4aab-94c1-64f728c758a6-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"455ca95c-b3b6-4aab-94c1-64f728c758a6\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 14:08:36.085291 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:36.084965 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/455ca95c-b3b6-4aab-94c1-64f728c758a6-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"455ca95c-b3b6-4aab-94c1-64f728c758a6\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 14:08:36.086008 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:36.085941 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/455ca95c-b3b6-4aab-94c1-64f728c758a6-tls-assets\") pod \"alertmanager-main-0\" (UID: \"455ca95c-b3b6-4aab-94c1-64f728c758a6\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 14:08:36.086870 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:36.086842 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/455ca95c-b3b6-4aab-94c1-64f728c758a6-web-config\") pod \"alertmanager-main-0\" (UID: \"455ca95c-b3b6-4aab-94c1-64f728c758a6\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 14:08:36.087237 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:36.087212 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/455ca95c-b3b6-4aab-94c1-64f728c758a6-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"455ca95c-b3b6-4aab-94c1-64f728c758a6\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 14:08:36.087301 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:36.087268 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/455ca95c-b3b6-4aab-94c1-64f728c758a6-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"455ca95c-b3b6-4aab-94c1-64f728c758a6\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 14:08:36.087605 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:36.087565 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/455ca95c-b3b6-4aab-94c1-64f728c758a6-config-out\") pod \"alertmanager-main-0\" (UID: \"455ca95c-b3b6-4aab-94c1-64f728c758a6\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 14:08:36.088053 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:36.088028 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/455ca95c-b3b6-4aab-94c1-64f728c758a6-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"455ca95c-b3b6-4aab-94c1-64f728c758a6\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 14:08:36.088153 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:36.088059 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/455ca95c-b3b6-4aab-94c1-64f728c758a6-config-volume\") pod \"alertmanager-main-0\" (UID: \"455ca95c-b3b6-4aab-94c1-64f728c758a6\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 14:08:36.088395 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:36.088379 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/455ca95c-b3b6-4aab-94c1-64f728c758a6-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"455ca95c-b3b6-4aab-94c1-64f728c758a6\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 14:08:36.089530 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:36.089511 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/455ca95c-b3b6-4aab-94c1-64f728c758a6-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"455ca95c-b3b6-4aab-94c1-64f728c758a6\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 14:08:36.097371 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:36.097352 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-66ttl\" (UniqueName: \"kubernetes.io/projected/455ca95c-b3b6-4aab-94c1-64f728c758a6-kube-api-access-66ttl\") pod \"alertmanager-main-0\" (UID: \"455ca95c-b3b6-4aab-94c1-64f728c758a6\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 14:08:36.200750 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:36.200670 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 17 14:08:39.405406 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:08:39.405362 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78dd496d_c4d0_4b08_9d80_48a098851103.slice/crio-6fbcbbe33e26eb878f1100698ce00938940cf0c23cfac3ee387216402899f06c WatchSource:0}: Error finding container 6fbcbbe33e26eb878f1100698ce00938940cf0c23cfac3ee387216402899f06c: Status 404 returned error can't find the container with id 6fbcbbe33e26eb878f1100698ce00938940cf0c23cfac3ee387216402899f06c Sep 17 14:08:39.548673 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:39.548642 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-cvgxn"] Sep 17 14:08:39.561086 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:39.561047 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-cvgxn" Sep 17 14:08:39.562832 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:39.562806 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-cvgxn"] Sep 17 14:08:39.563732 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:39.563710 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Sep 17 14:08:39.564380 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:39.564359 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-9frk8\"" Sep 17 14:08:39.666731 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:39.666707 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-667cd659d8-4rw6b"] Sep 17 14:08:39.669462 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:39.669443 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-667cd659d8-4rw6b" Sep 17 14:08:39.671721 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:39.671703 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-kkwn8\"" Sep 17 14:08:39.672013 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:39.671998 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Sep 17 14:08:39.672063 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:39.672017 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Sep 17 14:08:39.672095 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:39.672084 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Sep 17 14:08:39.672337 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:39.672291 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Sep 17 14:08:39.672464 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:39.672447 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Sep 17 14:08:39.675118 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:39.674862 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-bhd5q"] Sep 17 14:08:39.677276 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:39.677252 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Sep 17 14:08:39.678032 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:39.678012 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-59fbdd77d-b89qd"] Sep 17 14:08:39.678176 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:08:39.678155 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod177d2a1f_db87_4340_b6db_9a53277f0310.slice/crio-a7a5c1ccb28df93dc5dbcc489c15aed13c3bbc631b4af507b66a800f3fa13629 WatchSource:0}: Error finding container a7a5c1ccb28df93dc5dbcc489c15aed13c3bbc631b4af507b66a800f3fa13629: Status 404 returned error can't find the container with id a7a5c1ccb28df93dc5dbcc489c15aed13c3bbc631b4af507b66a800f3fa13629 Sep 17 14:08:39.681994 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:08:39.681964 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd52454b_212b_4ead_8178_8a0f439b66de.slice/crio-59e5c3ac9c180f0739bcb6e96a0244993bdfb9459b1ba8b07077e043896f12b0 WatchSource:0}: Error finding container 59e5c3ac9c180f0739bcb6e96a0244993bdfb9459b1ba8b07077e043896f12b0: Status 404 returned error can't find the container with id 59e5c3ac9c180f0739bcb6e96a0244993bdfb9459b1ba8b07077e043896f12b0 Sep 17 14:08:39.682368 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:39.682296 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-667cd659d8-4rw6b"] Sep 17 14:08:39.691030 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:39.691002 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 17 14:08:39.698087 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:08:39.698039 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod455ca95c_b3b6_4aab_94c1_64f728c758a6.slice/crio-e0aed7a0c3a6a28404ff83a387feaece226b6eca6c97a9e073f95af6dc118fe5 WatchSource:0}: Error finding container e0aed7a0c3a6a28404ff83a387feaece226b6eca6c97a9e073f95af6dc118fe5: Status 404 returned error can't find the container with id e0aed7a0c3a6a28404ff83a387feaece226b6eca6c97a9e073f95af6dc118fe5 Sep 17 14:08:39.715770 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:39.715743 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n7vjq\" (UniqueName: \"kubernetes.io/projected/1fca741e-577d-45b0-acfe-68f066585082-kube-api-access-n7vjq\") pod \"monitoring-plugin-5d85778b9d-cvgxn\" (UID: \"1fca741e-577d-45b0-acfe-68f066585082\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-cvgxn" Sep 17 14:08:39.715872 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:39.715801 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1fca741e-577d-45b0-acfe-68f066585082-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-cvgxn\" (UID: \"1fca741e-577d-45b0-acfe-68f066585082\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-cvgxn" Sep 17 14:08:39.817283 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:39.817254 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1fca741e-577d-45b0-acfe-68f066585082-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-cvgxn\" (UID: \"1fca741e-577d-45b0-acfe-68f066585082\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-cvgxn" Sep 17 14:08:39.817409 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:39.817304 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eadd0df5-d39a-4715-8128-697c0e1812c7-trusted-ca-bundle\") pod \"console-667cd659d8-4rw6b\" (UID: \"eadd0df5-d39a-4715-8128-697c0e1812c7\") " pod="openshift-console/console-667cd659d8-4rw6b" Sep 17 14:08:39.817409 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:39.817356 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4l5fj\" (UniqueName: \"kubernetes.io/projected/eadd0df5-d39a-4715-8128-697c0e1812c7-kube-api-access-4l5fj\") pod \"console-667cd659d8-4rw6b\" (UID: \"eadd0df5-d39a-4715-8128-697c0e1812c7\") " pod="openshift-console/console-667cd659d8-4rw6b" Sep 17 14:08:39.817409 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:39.817383 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/eadd0df5-d39a-4715-8128-697c0e1812c7-console-config\") pod \"console-667cd659d8-4rw6b\" (UID: \"eadd0df5-d39a-4715-8128-697c0e1812c7\") " pod="openshift-console/console-667cd659d8-4rw6b" Sep 17 14:08:39.817559 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:39.817410 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/eadd0df5-d39a-4715-8128-697c0e1812c7-console-serving-cert\") pod \"console-667cd659d8-4rw6b\" (UID: \"eadd0df5-d39a-4715-8128-697c0e1812c7\") " pod="openshift-console/console-667cd659d8-4rw6b" Sep 17 14:08:39.817559 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:39.817511 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/eadd0df5-d39a-4715-8128-697c0e1812c7-oauth-serving-cert\") pod \"console-667cd659d8-4rw6b\" (UID: \"eadd0df5-d39a-4715-8128-697c0e1812c7\") " pod="openshift-console/console-667cd659d8-4rw6b" Sep 17 14:08:39.817559 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:39.817544 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/eadd0df5-d39a-4715-8128-697c0e1812c7-console-oauth-config\") pod \"console-667cd659d8-4rw6b\" (UID: \"eadd0df5-d39a-4715-8128-697c0e1812c7\") " pod="openshift-console/console-667cd659d8-4rw6b" Sep 17 14:08:39.817811 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:39.817571 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/eadd0df5-d39a-4715-8128-697c0e1812c7-service-ca\") pod \"console-667cd659d8-4rw6b\" (UID: \"eadd0df5-d39a-4715-8128-697c0e1812c7\") " pod="openshift-console/console-667cd659d8-4rw6b" Sep 17 14:08:39.817811 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:39.817630 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n7vjq\" (UniqueName: \"kubernetes.io/projected/1fca741e-577d-45b0-acfe-68f066585082-kube-api-access-n7vjq\") pod \"monitoring-plugin-5d85778b9d-cvgxn\" (UID: \"1fca741e-577d-45b0-acfe-68f066585082\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-cvgxn" Sep 17 14:08:39.820366 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:39.820344 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1fca741e-577d-45b0-acfe-68f066585082-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-cvgxn\" (UID: \"1fca741e-577d-45b0-acfe-68f066585082\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-cvgxn" Sep 17 14:08:39.826631 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:39.826609 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n7vjq\" (UniqueName: \"kubernetes.io/projected/1fca741e-577d-45b0-acfe-68f066585082-kube-api-access-n7vjq\") pod \"monitoring-plugin-5d85778b9d-cvgxn\" (UID: \"1fca741e-577d-45b0-acfe-68f066585082\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-cvgxn" Sep 17 14:08:39.871388 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:39.871352 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-cvgxn" Sep 17 14:08:39.918944 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:39.918424 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/eadd0df5-d39a-4715-8128-697c0e1812c7-oauth-serving-cert\") pod \"console-667cd659d8-4rw6b\" (UID: \"eadd0df5-d39a-4715-8128-697c0e1812c7\") " pod="openshift-console/console-667cd659d8-4rw6b" Sep 17 14:08:39.918944 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:39.918508 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/eadd0df5-d39a-4715-8128-697c0e1812c7-console-oauth-config\") pod \"console-667cd659d8-4rw6b\" (UID: \"eadd0df5-d39a-4715-8128-697c0e1812c7\") " pod="openshift-console/console-667cd659d8-4rw6b" Sep 17 14:08:39.918944 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:39.918544 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/eadd0df5-d39a-4715-8128-697c0e1812c7-service-ca\") pod \"console-667cd659d8-4rw6b\" (UID: \"eadd0df5-d39a-4715-8128-697c0e1812c7\") " pod="openshift-console/console-667cd659d8-4rw6b" Sep 17 14:08:39.918944 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:39.918623 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eadd0df5-d39a-4715-8128-697c0e1812c7-trusted-ca-bundle\") pod \"console-667cd659d8-4rw6b\" (UID: \"eadd0df5-d39a-4715-8128-697c0e1812c7\") " pod="openshift-console/console-667cd659d8-4rw6b" Sep 17 14:08:39.918944 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:39.918683 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4l5fj\" (UniqueName: \"kubernetes.io/projected/eadd0df5-d39a-4715-8128-697c0e1812c7-kube-api-access-4l5fj\") pod \"console-667cd659d8-4rw6b\" (UID: \"eadd0df5-d39a-4715-8128-697c0e1812c7\") " pod="openshift-console/console-667cd659d8-4rw6b" Sep 17 14:08:39.918944 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:39.918712 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/eadd0df5-d39a-4715-8128-697c0e1812c7-console-config\") pod \"console-667cd659d8-4rw6b\" (UID: \"eadd0df5-d39a-4715-8128-697c0e1812c7\") " pod="openshift-console/console-667cd659d8-4rw6b" Sep 17 14:08:39.918944 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:39.918740 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/eadd0df5-d39a-4715-8128-697c0e1812c7-console-serving-cert\") pod \"console-667cd659d8-4rw6b\" (UID: \"eadd0df5-d39a-4715-8128-697c0e1812c7\") " pod="openshift-console/console-667cd659d8-4rw6b" Sep 17 14:08:39.919409 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:39.919237 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/eadd0df5-d39a-4715-8128-697c0e1812c7-oauth-serving-cert\") pod \"console-667cd659d8-4rw6b\" (UID: \"eadd0df5-d39a-4715-8128-697c0e1812c7\") " pod="openshift-console/console-667cd659d8-4rw6b" Sep 17 14:08:39.919409 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:39.919355 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/eadd0df5-d39a-4715-8128-697c0e1812c7-service-ca\") pod \"console-667cd659d8-4rw6b\" (UID: \"eadd0df5-d39a-4715-8128-697c0e1812c7\") " pod="openshift-console/console-667cd659d8-4rw6b" Sep 17 14:08:39.920333 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:39.920250 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eadd0df5-d39a-4715-8128-697c0e1812c7-trusted-ca-bundle\") pod \"console-667cd659d8-4rw6b\" (UID: \"eadd0df5-d39a-4715-8128-697c0e1812c7\") " pod="openshift-console/console-667cd659d8-4rw6b" Sep 17 14:08:39.920333 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:39.920250 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/eadd0df5-d39a-4715-8128-697c0e1812c7-console-config\") pod \"console-667cd659d8-4rw6b\" (UID: \"eadd0df5-d39a-4715-8128-697c0e1812c7\") " pod="openshift-console/console-667cd659d8-4rw6b" Sep 17 14:08:39.922962 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:39.922934 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/eadd0df5-d39a-4715-8128-697c0e1812c7-console-oauth-config\") pod \"console-667cd659d8-4rw6b\" (UID: \"eadd0df5-d39a-4715-8128-697c0e1812c7\") " pod="openshift-console/console-667cd659d8-4rw6b" Sep 17 14:08:39.923434 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:39.923403 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/eadd0df5-d39a-4715-8128-697c0e1812c7-console-serving-cert\") pod \"console-667cd659d8-4rw6b\" (UID: \"eadd0df5-d39a-4715-8128-697c0e1812c7\") " pod="openshift-console/console-667cd659d8-4rw6b" Sep 17 14:08:39.931954 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:39.931891 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4l5fj\" (UniqueName: \"kubernetes.io/projected/eadd0df5-d39a-4715-8128-697c0e1812c7-kube-api-access-4l5fj\") pod \"console-667cd659d8-4rw6b\" (UID: \"eadd0df5-d39a-4715-8128-697c0e1812c7\") " pod="openshift-console/console-667cd659d8-4rw6b" Sep 17 14:08:40.004904 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:40.004866 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-667cd659d8-4rw6b" Sep 17 14:08:40.091540 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:40.091486 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-b89qd" event={"ID":"cd52454b-212b-4ead-8178-8a0f439b66de","Type":"ContainerStarted","Data":"59e5c3ac9c180f0739bcb6e96a0244993bdfb9459b1ba8b07077e043896f12b0"} Sep 17 14:08:40.093393 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:40.093349 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5phpk" event={"ID":"78dd496d-c4d0-4b08-9d80-48a098851103","Type":"ContainerStarted","Data":"6fbcbbe33e26eb878f1100698ce00938940cf0c23cfac3ee387216402899f06c"} Sep 17 14:08:40.095714 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:40.095581 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-76f99584f4-9wcnk" event={"ID":"14f67a3c-fb51-46e1-a7f7-f693c6310088","Type":"ContainerStarted","Data":"34a19a4ba98e3631f4bd474355ed09892ca10ff4f25caa6db58dd2bd99d86176"} Sep 17 14:08:40.096234 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:40.096079 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-76f99584f4-9wcnk" Sep 17 14:08:40.098604 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:40.098519 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"455ca95c-b3b6-4aab-94c1-64f728c758a6","Type":"ContainerStarted","Data":"e0aed7a0c3a6a28404ff83a387feaece226b6eca6c97a9e073f95af6dc118fe5"} Sep 17 14:08:40.101387 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:40.101365 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-bhd5q" event={"ID":"177d2a1f-db87-4340-b6db-9a53277f0310","Type":"ContainerStarted","Data":"678f67456c1f892cce22a5a8c92e693944885cd88992d309f8ec819e4284a5f7"} Sep 17 14:08:40.101469 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:40.101418 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-bhd5q" event={"ID":"177d2a1f-db87-4340-b6db-9a53277f0310","Type":"ContainerStarted","Data":"5c87c585d4e4eafd6f7d088c253339abb2b79b36897dd3c11f0605f988d6635d"} Sep 17 14:08:40.101469 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:40.101447 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-bhd5q" event={"ID":"177d2a1f-db87-4340-b6db-9a53277f0310","Type":"ContainerStarted","Data":"a7a5c1ccb28df93dc5dbcc489c15aed13c3bbc631b4af507b66a800f3fa13629"} Sep 17 14:08:40.114305 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:40.114260 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-76f99584f4-9wcnk" Sep 17 14:08:40.119836 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:40.119785 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-76f99584f4-9wcnk" podStartSLOduration=3.056050247 podStartE2EDuration="20.119767082s" totalImagesPullingTime="17.063716835s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:08:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:08:40.117924597 +0000 UTC m=+89.076944107" watchObservedRunningTime="2026-09-17 14:08:40.119767082 +0000 UTC m=+89.078786592" Sep 17 14:08:40.164426 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:40.164381 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-cvgxn"] Sep 17 14:08:40.169681 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:08:40.169614 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1fca741e_577d_45b0_acfe_68f066585082.slice/crio-1290515cf03470ae6cc7420bc1f8f56a9bb26d0f83ee9b1642fc3b14c29a4945 WatchSource:0}: Error finding container 1290515cf03470ae6cc7420bc1f8f56a9bb26d0f83ee9b1642fc3b14c29a4945: Status 404 returned error can't find the container with id 1290515cf03470ae6cc7420bc1f8f56a9bb26d0f83ee9b1642fc3b14c29a4945 Sep 17 14:08:40.322750 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:40.320783 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-667cd659d8-4rw6b"] Sep 17 14:08:40.329697 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:08:40.329632 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeadd0df5_d39a_4715_8128_697c0e1812c7.slice/crio-fe60599ecbb6175561d71e7b688263141d7cd8bc6f4eb71eedf9ca2a27bd62e8 WatchSource:0}: Error finding container fe60599ecbb6175561d71e7b688263141d7cd8bc6f4eb71eedf9ca2a27bd62e8: Status 404 returned error can't find the container with id fe60599ecbb6175561d71e7b688263141d7cd8bc6f4eb71eedf9ca2a27bd62e8 Sep 17 14:08:41.109778 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:41.109676 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-667cd659d8-4rw6b" event={"ID":"eadd0df5-d39a-4715-8128-697c0e1812c7","Type":"ContainerStarted","Data":"fe60599ecbb6175561d71e7b688263141d7cd8bc6f4eb71eedf9ca2a27bd62e8"} Sep 17 14:08:41.112471 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:41.112409 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-cvgxn" event={"ID":"1fca741e-577d-45b0-acfe-68f066585082","Type":"ContainerStarted","Data":"1290515cf03470ae6cc7420bc1f8f56a9bb26d0f83ee9b1642fc3b14c29a4945"} Sep 17 14:08:41.262018 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:41.261951 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 17 14:08:41.279732 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:41.279697 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:08:41.284894 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:41.283863 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Sep 17 14:08:41.284894 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:41.284012 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Sep 17 14:08:41.284894 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:41.284079 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Sep 17 14:08:41.284894 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:41.283863 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Sep 17 14:08:41.284894 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:41.284282 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Sep 17 14:08:41.284894 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:41.284385 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Sep 17 14:08:41.284894 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:41.284454 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Sep 17 14:08:41.284894 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:41.284630 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-e4a07916lrmdd\"" Sep 17 14:08:41.285398 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:41.285283 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Sep 17 14:08:41.287024 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:41.285586 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Sep 17 14:08:41.287024 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:41.285770 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Sep 17 14:08:41.287024 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:41.286280 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Sep 17 14:08:41.287024 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:41.286461 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Sep 17 14:08:41.287024 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:41.286660 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-kzg4t\"" Sep 17 14:08:41.287024 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:41.286836 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Sep 17 14:08:41.293867 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:41.293844 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Sep 17 14:08:41.297877 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:41.296361 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 17 14:08:41.297877 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:41.296545 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Sep 17 14:08:41.437337 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:41.437251 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e0417d03-deb9-4a36-928d-604c37111cdf-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"e0417d03-deb9-4a36-928d-604c37111cdf\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:08:41.437337 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:41.437303 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6t9hn\" (UniqueName: \"kubernetes.io/projected/e0417d03-deb9-4a36-928d-604c37111cdf-kube-api-access-6t9hn\") pod \"prometheus-k8s-0\" (UID: \"e0417d03-deb9-4a36-928d-604c37111cdf\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:08:41.437637 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:41.437338 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0417d03-deb9-4a36-928d-604c37111cdf-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e0417d03-deb9-4a36-928d-604c37111cdf\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:08:41.437637 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:41.437420 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e0417d03-deb9-4a36-928d-604c37111cdf-config-out\") pod \"prometheus-k8s-0\" (UID: \"e0417d03-deb9-4a36-928d-604c37111cdf\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:08:41.437637 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:41.437458 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e0417d03-deb9-4a36-928d-604c37111cdf-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e0417d03-deb9-4a36-928d-604c37111cdf\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:08:41.437637 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:41.437524 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e0417d03-deb9-4a36-928d-604c37111cdf-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e0417d03-deb9-4a36-928d-604c37111cdf\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:08:41.437637 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:41.437552 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e0417d03-deb9-4a36-928d-604c37111cdf-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e0417d03-deb9-4a36-928d-604c37111cdf\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:08:41.437637 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:41.437579 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e0417d03-deb9-4a36-928d-604c37111cdf-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e0417d03-deb9-4a36-928d-604c37111cdf\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:08:41.437957 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:41.437647 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e0417d03-deb9-4a36-928d-604c37111cdf-web-config\") pod \"prometheus-k8s-0\" (UID: \"e0417d03-deb9-4a36-928d-604c37111cdf\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:08:41.437957 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:41.437685 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/e0417d03-deb9-4a36-928d-604c37111cdf-config\") pod \"prometheus-k8s-0\" (UID: \"e0417d03-deb9-4a36-928d-604c37111cdf\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:08:41.437957 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:41.437726 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e0417d03-deb9-4a36-928d-604c37111cdf-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e0417d03-deb9-4a36-928d-604c37111cdf\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:08:41.437957 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:41.437746 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e0417d03-deb9-4a36-928d-604c37111cdf-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e0417d03-deb9-4a36-928d-604c37111cdf\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:08:41.437957 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:41.437766 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0417d03-deb9-4a36-928d-604c37111cdf-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e0417d03-deb9-4a36-928d-604c37111cdf\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:08:41.437957 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:41.437797 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e0417d03-deb9-4a36-928d-604c37111cdf-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e0417d03-deb9-4a36-928d-604c37111cdf\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:08:41.437957 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:41.437841 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e0417d03-deb9-4a36-928d-604c37111cdf-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e0417d03-deb9-4a36-928d-604c37111cdf\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:08:41.437957 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:41.437878 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e0417d03-deb9-4a36-928d-604c37111cdf-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"e0417d03-deb9-4a36-928d-604c37111cdf\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:08:41.437957 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:41.437922 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0417d03-deb9-4a36-928d-604c37111cdf-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e0417d03-deb9-4a36-928d-604c37111cdf\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:08:41.438361 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:41.437967 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e0417d03-deb9-4a36-928d-604c37111cdf-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e0417d03-deb9-4a36-928d-604c37111cdf\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:08:41.438361 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:41.437992 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e0417d03-deb9-4a36-928d-604c37111cdf-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e0417d03-deb9-4a36-928d-604c37111cdf\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:08:41.438361 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:41.438022 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e0417d03-deb9-4a36-928d-604c37111cdf-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e0417d03-deb9-4a36-928d-604c37111cdf\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:08:41.539249 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:41.539213 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e0417d03-deb9-4a36-928d-604c37111cdf-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e0417d03-deb9-4a36-928d-604c37111cdf\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:08:41.539461 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:41.539257 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e0417d03-deb9-4a36-928d-604c37111cdf-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e0417d03-deb9-4a36-928d-604c37111cdf\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:08:41.539461 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:41.539286 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0417d03-deb9-4a36-928d-604c37111cdf-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e0417d03-deb9-4a36-928d-604c37111cdf\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:08:41.539461 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:41.539314 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e0417d03-deb9-4a36-928d-604c37111cdf-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e0417d03-deb9-4a36-928d-604c37111cdf\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:08:41.539461 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:41.539336 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e0417d03-deb9-4a36-928d-604c37111cdf-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e0417d03-deb9-4a36-928d-604c37111cdf\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:08:41.539461 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:41.539365 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e0417d03-deb9-4a36-928d-604c37111cdf-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"e0417d03-deb9-4a36-928d-604c37111cdf\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:08:41.539461 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:41.539403 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0417d03-deb9-4a36-928d-604c37111cdf-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e0417d03-deb9-4a36-928d-604c37111cdf\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:08:41.539461 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:41.539450 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e0417d03-deb9-4a36-928d-604c37111cdf-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e0417d03-deb9-4a36-928d-604c37111cdf\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:08:41.539843 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:41.539470 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e0417d03-deb9-4a36-928d-604c37111cdf-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e0417d03-deb9-4a36-928d-604c37111cdf\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:08:41.539843 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:41.539530 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e0417d03-deb9-4a36-928d-604c37111cdf-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e0417d03-deb9-4a36-928d-604c37111cdf\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:08:41.539843 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:41.539559 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e0417d03-deb9-4a36-928d-604c37111cdf-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"e0417d03-deb9-4a36-928d-604c37111cdf\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:08:41.539843 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:41.539582 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6t9hn\" (UniqueName: \"kubernetes.io/projected/e0417d03-deb9-4a36-928d-604c37111cdf-kube-api-access-6t9hn\") pod \"prometheus-k8s-0\" (UID: \"e0417d03-deb9-4a36-928d-604c37111cdf\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:08:41.539843 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:41.539618 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0417d03-deb9-4a36-928d-604c37111cdf-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e0417d03-deb9-4a36-928d-604c37111cdf\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:08:41.539843 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:41.539647 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e0417d03-deb9-4a36-928d-604c37111cdf-config-out\") pod \"prometheus-k8s-0\" (UID: \"e0417d03-deb9-4a36-928d-604c37111cdf\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:08:41.539843 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:41.539671 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e0417d03-deb9-4a36-928d-604c37111cdf-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e0417d03-deb9-4a36-928d-604c37111cdf\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:08:41.539843 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:41.539736 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e0417d03-deb9-4a36-928d-604c37111cdf-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e0417d03-deb9-4a36-928d-604c37111cdf\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:08:41.539843 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:41.539777 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e0417d03-deb9-4a36-928d-604c37111cdf-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e0417d03-deb9-4a36-928d-604c37111cdf\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:08:41.539843 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:41.539806 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e0417d03-deb9-4a36-928d-604c37111cdf-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e0417d03-deb9-4a36-928d-604c37111cdf\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:08:41.540291 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:41.539853 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e0417d03-deb9-4a36-928d-604c37111cdf-web-config\") pod \"prometheus-k8s-0\" (UID: \"e0417d03-deb9-4a36-928d-604c37111cdf\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:08:41.540291 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:41.539889 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/e0417d03-deb9-4a36-928d-604c37111cdf-config\") pod \"prometheus-k8s-0\" (UID: \"e0417d03-deb9-4a36-928d-604c37111cdf\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:08:41.550534 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:41.544202 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e0417d03-deb9-4a36-928d-604c37111cdf-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"e0417d03-deb9-4a36-928d-604c37111cdf\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:08:41.550534 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:41.550277 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e0417d03-deb9-4a36-928d-604c37111cdf-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"e0417d03-deb9-4a36-928d-604c37111cdf\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:08:41.550534 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:41.550391 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0417d03-deb9-4a36-928d-604c37111cdf-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e0417d03-deb9-4a36-928d-604c37111cdf\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:08:41.550790 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:41.550628 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e0417d03-deb9-4a36-928d-604c37111cdf-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e0417d03-deb9-4a36-928d-604c37111cdf\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:08:41.554367 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:41.552305 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0417d03-deb9-4a36-928d-604c37111cdf-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e0417d03-deb9-4a36-928d-604c37111cdf\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:08:41.556507 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:41.556211 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e0417d03-deb9-4a36-928d-604c37111cdf-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e0417d03-deb9-4a36-928d-604c37111cdf\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:08:41.558935 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:41.558909 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/e0417d03-deb9-4a36-928d-604c37111cdf-config\") pod \"prometheus-k8s-0\" (UID: \"e0417d03-deb9-4a36-928d-604c37111cdf\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:08:41.560216 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:41.559168 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e0417d03-deb9-4a36-928d-604c37111cdf-config-out\") pod \"prometheus-k8s-0\" (UID: \"e0417d03-deb9-4a36-928d-604c37111cdf\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:08:41.560216 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:41.559327 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e0417d03-deb9-4a36-928d-604c37111cdf-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e0417d03-deb9-4a36-928d-604c37111cdf\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:08:41.560216 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:41.559699 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0417d03-deb9-4a36-928d-604c37111cdf-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e0417d03-deb9-4a36-928d-604c37111cdf\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:08:41.562226 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:41.561377 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e0417d03-deb9-4a36-928d-604c37111cdf-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e0417d03-deb9-4a36-928d-604c37111cdf\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:08:41.564522 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:41.563305 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e0417d03-deb9-4a36-928d-604c37111cdf-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e0417d03-deb9-4a36-928d-604c37111cdf\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:08:41.564522 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:41.563604 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6t9hn\" (UniqueName: \"kubernetes.io/projected/e0417d03-deb9-4a36-928d-604c37111cdf-kube-api-access-6t9hn\") pod \"prometheus-k8s-0\" (UID: \"e0417d03-deb9-4a36-928d-604c37111cdf\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:08:41.565722 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:41.565702 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e0417d03-deb9-4a36-928d-604c37111cdf-web-config\") pod \"prometheus-k8s-0\" (UID: \"e0417d03-deb9-4a36-928d-604c37111cdf\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:08:41.567004 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:41.566962 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e0417d03-deb9-4a36-928d-604c37111cdf-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e0417d03-deb9-4a36-928d-604c37111cdf\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:08:41.567262 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:41.567240 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e0417d03-deb9-4a36-928d-604c37111cdf-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e0417d03-deb9-4a36-928d-604c37111cdf\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:08:41.567334 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:41.567277 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e0417d03-deb9-4a36-928d-604c37111cdf-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e0417d03-deb9-4a36-928d-604c37111cdf\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:08:41.567988 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:41.567961 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e0417d03-deb9-4a36-928d-604c37111cdf-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e0417d03-deb9-4a36-928d-604c37111cdf\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:08:41.568298 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:41.568277 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e0417d03-deb9-4a36-928d-604c37111cdf-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e0417d03-deb9-4a36-928d-604c37111cdf\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:08:41.570316 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:41.570287 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e0417d03-deb9-4a36-928d-604c37111cdf-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e0417d03-deb9-4a36-928d-604c37111cdf\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:08:41.606526 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:41.603609 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:08:45.508978 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:45.508945 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-667cd659d8-4rw6b"] Sep 17 14:08:46.063045 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:46.061188 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 17 14:08:46.143664 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:46.142540 2558 generic.go:356] "Generic (PLEG): container finished" podID="455ca95c-b3b6-4aab-94c1-64f728c758a6" containerID="16cbf7367da0b0a8cd43ea4ee5386510e40210df520fa2b925597faac26b5529" exitCode=0 Sep 17 14:08:46.143664 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:46.143355 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"455ca95c-b3b6-4aab-94c1-64f728c758a6","Type":"ContainerDied","Data":"16cbf7367da0b0a8cd43ea4ee5386510e40210df520fa2b925597faac26b5529"} Sep 17 14:08:46.148430 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:46.148407 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-bhd5q" event={"ID":"177d2a1f-db87-4340-b6db-9a53277f0310","Type":"ContainerStarted","Data":"b4776b96d52de7232fc5898c46aa42ebc910b921fb24df28672cbf3a3c7385ac"} Sep 17 14:08:46.152271 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:46.151231 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-667cd659d8-4rw6b" event={"ID":"eadd0df5-d39a-4715-8128-697c0e1812c7","Type":"ContainerStarted","Data":"ad51b854421ab618fdeed119645f8f4cee268a3a37c2ef90b9855aa1fcfdc858"} Sep 17 14:08:46.162784 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:46.162721 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-b89qd" event={"ID":"cd52454b-212b-4ead-8178-8a0f439b66de","Type":"ContainerStarted","Data":"7f6c28071d315d9a23885f2b07a01ee5b2885cbcdd3c74329f0c4bc1665b69d8"} Sep 17 14:08:46.168052 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:46.168023 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-cvgxn" event={"ID":"1fca741e-577d-45b0-acfe-68f066585082","Type":"ContainerStarted","Data":"1af81813f163ff984e9fea12771a9bb15f01522b860ae0ada36ad30d4b963a02"} Sep 17 14:08:46.171083 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:46.171055 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-cvgxn" Sep 17 14:08:46.173176 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:46.173147 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5phpk" event={"ID":"78dd496d-c4d0-4b08-9d80-48a098851103","Type":"ContainerStarted","Data":"617df48126e6940e0fbe1a2f3a7115c03fa527d7450b01c29a82d0aacf25abb1"} Sep 17 14:08:46.175352 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:46.175319 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e0417d03-deb9-4a36-928d-604c37111cdf","Type":"ContainerStarted","Data":"5044b80352733cf587b9bb9e1263780217a5d230ec28b72f8c54b4f2fc50546f"} Sep 17 14:08:46.181132 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:46.180919 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-cvgxn" Sep 17 14:08:46.279440 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:46.279323 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-667cd659d8-4rw6b" podStartSLOduration=1.832151397 podStartE2EDuration="7.279301922s" totalImagesPullingTime="5.447150525s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:08:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:08:46.277901085 +0000 UTC m=+95.236920595" watchObservedRunningTime="2026-09-17 14:08:46.279301922 +0000 UTC m=+95.238321425" Sep 17 14:08:46.279985 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:46.279944 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-bhd5q" podStartSLOduration=6.345019175 podStartE2EDuration="12.279927265s" totalImagesPullingTime="5.93490809s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:08:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:08:46.246923551 +0000 UTC m=+95.205943060" watchObservedRunningTime="2026-09-17 14:08:46.279927265 +0000 UTC m=+95.238946774" Sep 17 14:08:46.300079 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:46.299828 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-cvgxn" podStartSLOduration=1.68734187 podStartE2EDuration="7.299812666s" totalImagesPullingTime="5.612470796s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:08:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:08:46.29903525 +0000 UTC m=+95.258054758" watchObservedRunningTime="2026-09-17 14:08:46.299812666 +0000 UTC m=+95.258832174" Sep 17 14:08:47.183546 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:47.183447 2558 generic.go:356] "Generic (PLEG): container finished" podID="e0417d03-deb9-4a36-928d-604c37111cdf" containerID="0aaaba82584e0578c4dd3e427f644be32d28a4ed608434eefb122a511ac2b3d6" exitCode=0 Sep 17 14:08:47.184086 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:47.183552 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e0417d03-deb9-4a36-928d-604c37111cdf","Type":"ContainerDied","Data":"0aaaba82584e0578c4dd3e427f644be32d28a4ed608434eefb122a511ac2b3d6"} Sep 17 14:08:47.187246 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:47.187200 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-b89qd" event={"ID":"cd52454b-212b-4ead-8178-8a0f439b66de","Type":"ContainerStarted","Data":"41c4e4202c2aa8da64553c0917dcae3ff54eb435edf4533f41ff99efb9a316af"} Sep 17 14:08:47.187357 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:47.187271 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-b89qd" event={"ID":"cd52454b-212b-4ead-8178-8a0f439b66de","Type":"ContainerStarted","Data":"b4cadf639355d03af60e71e220bb815a80f251225b30195437f53aca9a116ca5"} Sep 17 14:08:47.190131 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:47.189455 2558 generic.go:356] "Generic (PLEG): container finished" podID="78dd496d-c4d0-4b08-9d80-48a098851103" containerID="617df48126e6940e0fbe1a2f3a7115c03fa527d7450b01c29a82d0aacf25abb1" exitCode=0 Sep 17 14:08:47.190131 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:47.189565 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5phpk" event={"ID":"78dd496d-c4d0-4b08-9d80-48a098851103","Type":"ContainerDied","Data":"617df48126e6940e0fbe1a2f3a7115c03fa527d7450b01c29a82d0aacf25abb1"} Sep 17 14:08:47.300409 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:47.300362 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-b89qd" podStartSLOduration=7.242759394 podStartE2EDuration="13.300344579s" totalImagesPullingTime="6.057585185s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:08:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:08:47.299105044 +0000 UTC m=+96.258124566" watchObservedRunningTime="2026-09-17 14:08:47.300344579 +0000 UTC m=+96.259364121" Sep 17 14:08:48.198900 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:48.198796 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5phpk" event={"ID":"78dd496d-c4d0-4b08-9d80-48a098851103","Type":"ContainerStarted","Data":"b2a5685118d2ccda2833340f66a909febac742ae2cb10626d94d4fd94380fe1d"} Sep 17 14:08:48.198900 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:48.198866 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5phpk" event={"ID":"78dd496d-c4d0-4b08-9d80-48a098851103","Type":"ContainerStarted","Data":"3822345af3bf2e59da4b5f30bcef49206301f9aeb550799c97f3f31f1443e9ba"} Sep 17 14:08:48.232345 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:48.232288 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-5phpk" podStartSLOduration=8.139450454 podStartE2EDuration="14.232271567s" totalImagesPullingTime="5.870124112s" totalInitContainerRuntime="222.697001ms" isStatefulPod=true podCreationTimestamp="2026-09-17 14:08:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:08:48.231281309 +0000 UTC m=+97.190300816" watchObservedRunningTime="2026-09-17 14:08:48.232271567 +0000 UTC m=+97.191291074" Sep 17 14:08:50.005135 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:50.005089 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-667cd659d8-4rw6b" Sep 17 14:08:52.223508 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:52.223313 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e0417d03-deb9-4a36-928d-604c37111cdf","Type":"ContainerStarted","Data":"27a24bee905634b2ecf773a085cfc6e794494518196b4975161cd59bf06a46f8"} Sep 17 14:08:52.223508 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:52.223401 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e0417d03-deb9-4a36-928d-604c37111cdf","Type":"ContainerStarted","Data":"d8df93f37813c872543a609e522a728635415cb9bcb4dcf7250c0dfe2d6134dc"} Sep 17 14:08:52.227089 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:52.227062 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"455ca95c-b3b6-4aab-94c1-64f728c758a6","Type":"ContainerStarted","Data":"3798b5ffa50ba21991bcb0173374fd2364b404fb4c89477694b61a2e92cb4dc4"} Sep 17 14:08:52.227232 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:52.227132 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"455ca95c-b3b6-4aab-94c1-64f728c758a6","Type":"ContainerStarted","Data":"41cb2b6823fe6130528a1ad3ef566674bb9f484f863d7e4c15e9a9ed3c5a4613"} Sep 17 14:08:52.227232 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:52.227175 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"455ca95c-b3b6-4aab-94c1-64f728c758a6","Type":"ContainerStarted","Data":"48c20d6acbbb91c9d159e9e83c28f6ecccf4cc91075557eb88593faa421610c7"} Sep 17 14:08:52.227232 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:52.227214 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"455ca95c-b3b6-4aab-94c1-64f728c758a6","Type":"ContainerStarted","Data":"9d8f554c46b94402d94d11c96b3eabe2385aea6aca627548d6168fe24b659902"} Sep 17 14:08:52.227373 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:52.227251 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"455ca95c-b3b6-4aab-94c1-64f728c758a6","Type":"ContainerStarted","Data":"95cbb9837971b3e8727d21de5d39f12350a0bc9fb8d5d2e4394df0062ffdfd03"} Sep 17 14:08:54.012621 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:54.012465 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-sqr44" Sep 17 14:08:54.238721 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:54.238696 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e0417d03-deb9-4a36-928d-604c37111cdf","Type":"ContainerStarted","Data":"e99a166e2ff703e5ef3b8577a255bdd170c34b6738f5a78d4e1abc12e6d71376"} Sep 17 14:08:54.238825 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:54.238771 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e0417d03-deb9-4a36-928d-604c37111cdf","Type":"ContainerStarted","Data":"752b569a14161cbf36f59fc015452fb1db1e291ba2ea23a5109d3fd0f8286232"} Sep 17 14:08:54.238825 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:54.238799 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e0417d03-deb9-4a36-928d-604c37111cdf","Type":"ContainerStarted","Data":"b6f092d5475b8a488ad46181730b0f8ec82dc716ac7d71adfb0021a2e352f2ef"} Sep 17 14:08:55.246873 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:55.246837 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e0417d03-deb9-4a36-928d-604c37111cdf","Type":"ContainerStarted","Data":"f4dc837fa14d92900b567667e783175f704de86246420816c637e27430ed7be4"} Sep 17 14:08:55.308802 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:55.308738 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=7.869418366 podStartE2EDuration="14.308714781s" totalImagesPullingTime="6.406072508s" totalInitContainerRuntime="33.223907ms" isStatefulPod=false podCreationTimestamp="2026-09-17 14:08:41 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:08:55.305946132 +0000 UTC m=+104.264965651" watchObservedRunningTime="2026-09-17 14:08:55.308714781 +0000 UTC m=+104.267734292" Sep 17 14:08:56.603774 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:56.603736 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:08:58.264190 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:58.264154 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"455ca95c-b3b6-4aab-94c1-64f728c758a6","Type":"ContainerStarted","Data":"b2de440426fceba4a36428f4b0e6c62de634b93c7744c6ea122f18a1019933c8"} Sep 17 14:08:58.309755 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:08:58.309708 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=7.067463326 podStartE2EDuration="23.309690866s" totalImagesPullingTime="16.219490664s" totalInitContainerRuntime="22.736876ms" isStatefulPod=false podCreationTimestamp="2026-09-17 14:08:35 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:08:58.308870517 +0000 UTC m=+107.267890017" watchObservedRunningTime="2026-09-17 14:08:58.309690866 +0000 UTC m=+107.268710425" Sep 17 14:09:11.186890 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:09:11.186820 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-667cd659d8-4rw6b" podUID="eadd0df5-d39a-4715-8128-697c0e1812c7" containerName="console" containerID="cri-o://ad51b854421ab618fdeed119645f8f4cee268a3a37c2ef90b9855aa1fcfdc858" gracePeriod=15 Sep 17 14:09:11.318405 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:09:11.318371 2558 generic.go:356] "Generic (PLEG): container finished" podID="eadd0df5-d39a-4715-8128-697c0e1812c7" containerID="ad51b854421ab618fdeed119645f8f4cee268a3a37c2ef90b9855aa1fcfdc858" exitCode=0 Sep 17 14:09:11.318510 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:09:11.318440 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-667cd659d8-4rw6b" event={"ID":"eadd0df5-d39a-4715-8128-697c0e1812c7","Type":"ContainerDied","Data":"ad51b854421ab618fdeed119645f8f4cee268a3a37c2ef90b9855aa1fcfdc858"} Sep 17 14:09:11.455093 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:09:11.455072 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-667cd659d8-4rw6b" Sep 17 14:09:11.534369 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:09:11.534344 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/eadd0df5-d39a-4715-8128-697c0e1812c7-console-config\") pod \"eadd0df5-d39a-4715-8128-697c0e1812c7\" (UID: \"eadd0df5-d39a-4715-8128-697c0e1812c7\") " Sep 17 14:09:11.534543 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:09:11.534393 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/eadd0df5-d39a-4715-8128-697c0e1812c7-console-serving-cert\") pod \"eadd0df5-d39a-4715-8128-697c0e1812c7\" (UID: \"eadd0df5-d39a-4715-8128-697c0e1812c7\") " Sep 17 14:09:11.534543 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:09:11.534412 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/eadd0df5-d39a-4715-8128-697c0e1812c7-service-ca\") pod \"eadd0df5-d39a-4715-8128-697c0e1812c7\" (UID: \"eadd0df5-d39a-4715-8128-697c0e1812c7\") " Sep 17 14:09:11.534543 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:09:11.534427 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/eadd0df5-d39a-4715-8128-697c0e1812c7-oauth-serving-cert\") pod \"eadd0df5-d39a-4715-8128-697c0e1812c7\" (UID: \"eadd0df5-d39a-4715-8128-697c0e1812c7\") " Sep 17 14:09:11.534543 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:09:11.534478 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4l5fj\" (UniqueName: \"kubernetes.io/projected/eadd0df5-d39a-4715-8128-697c0e1812c7-kube-api-access-4l5fj\") pod \"eadd0df5-d39a-4715-8128-697c0e1812c7\" (UID: \"eadd0df5-d39a-4715-8128-697c0e1812c7\") " Sep 17 14:09:11.534543 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:09:11.534519 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eadd0df5-d39a-4715-8128-697c0e1812c7-trusted-ca-bundle\") pod \"eadd0df5-d39a-4715-8128-697c0e1812c7\" (UID: \"eadd0df5-d39a-4715-8128-697c0e1812c7\") " Sep 17 14:09:11.534802 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:09:11.534557 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/eadd0df5-d39a-4715-8128-697c0e1812c7-console-oauth-config\") pod \"eadd0df5-d39a-4715-8128-697c0e1812c7\" (UID: \"eadd0df5-d39a-4715-8128-697c0e1812c7\") " Sep 17 14:09:11.534858 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:09:11.534799 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eadd0df5-d39a-4715-8128-697c0e1812c7-service-ca" (OuterVolumeSpecName: "service-ca") pod "eadd0df5-d39a-4715-8128-697c0e1812c7" (UID: "eadd0df5-d39a-4715-8128-697c0e1812c7"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 14:09:11.534858 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:09:11.534820 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eadd0df5-d39a-4715-8128-697c0e1812c7-console-config" (OuterVolumeSpecName: "console-config") pod "eadd0df5-d39a-4715-8128-697c0e1812c7" (UID: "eadd0df5-d39a-4715-8128-697c0e1812c7"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 14:09:11.534948 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:09:11.534887 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eadd0df5-d39a-4715-8128-697c0e1812c7-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "eadd0df5-d39a-4715-8128-697c0e1812c7" (UID: "eadd0df5-d39a-4715-8128-697c0e1812c7"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 14:09:11.534948 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:09:11.534918 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eadd0df5-d39a-4715-8128-697c0e1812c7-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "eadd0df5-d39a-4715-8128-697c0e1812c7" (UID: "eadd0df5-d39a-4715-8128-697c0e1812c7"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 14:09:11.535084 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:09:11.535064 2558 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eadd0df5-d39a-4715-8128-697c0e1812c7-trusted-ca-bundle\") on node \"ip-10-0-129-36.ec2.internal\" DevicePath \"\"" Sep 17 14:09:11.535128 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:09:11.535091 2558 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/eadd0df5-d39a-4715-8128-697c0e1812c7-console-config\") on node \"ip-10-0-129-36.ec2.internal\" DevicePath \"\"" Sep 17 14:09:11.535128 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:09:11.535105 2558 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/eadd0df5-d39a-4715-8128-697c0e1812c7-service-ca\") on node \"ip-10-0-129-36.ec2.internal\" DevicePath \"\"" Sep 17 14:09:11.535128 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:09:11.535117 2558 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/eadd0df5-d39a-4715-8128-697c0e1812c7-oauth-serving-cert\") on node \"ip-10-0-129-36.ec2.internal\" DevicePath \"\"" Sep 17 14:09:11.536709 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:09:11.536684 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eadd0df5-d39a-4715-8128-697c0e1812c7-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "eadd0df5-d39a-4715-8128-697c0e1812c7" (UID: "eadd0df5-d39a-4715-8128-697c0e1812c7"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 14:09:11.536815 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:09:11.536713 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eadd0df5-d39a-4715-8128-697c0e1812c7-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "eadd0df5-d39a-4715-8128-697c0e1812c7" (UID: "eadd0df5-d39a-4715-8128-697c0e1812c7"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 14:09:11.536815 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:09:11.536724 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eadd0df5-d39a-4715-8128-697c0e1812c7-kube-api-access-4l5fj" (OuterVolumeSpecName: "kube-api-access-4l5fj") pod "eadd0df5-d39a-4715-8128-697c0e1812c7" (UID: "eadd0df5-d39a-4715-8128-697c0e1812c7"). InnerVolumeSpecName "kube-api-access-4l5fj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 14:09:11.636141 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:09:11.636113 2558 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/eadd0df5-d39a-4715-8128-697c0e1812c7-console-oauth-config\") on node \"ip-10-0-129-36.ec2.internal\" DevicePath \"\"" Sep 17 14:09:11.636141 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:09:11.636133 2558 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/eadd0df5-d39a-4715-8128-697c0e1812c7-console-serving-cert\") on node \"ip-10-0-129-36.ec2.internal\" DevicePath \"\"" Sep 17 14:09:11.636141 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:09:11.636143 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4l5fj\" (UniqueName: \"kubernetes.io/projected/eadd0df5-d39a-4715-8128-697c0e1812c7-kube-api-access-4l5fj\") on node \"ip-10-0-129-36.ec2.internal\" DevicePath \"\"" Sep 17 14:09:12.323523 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:09:12.323480 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-667cd659d8-4rw6b" Sep 17 14:09:12.323523 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:09:12.323516 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-667cd659d8-4rw6b" event={"ID":"eadd0df5-d39a-4715-8128-697c0e1812c7","Type":"ContainerDied","Data":"fe60599ecbb6175561d71e7b688263141d7cd8bc6f4eb71eedf9ca2a27bd62e8"} Sep 17 14:09:12.323998 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:09:12.323598 2558 scope.go:117] "RemoveContainer" containerID="ad51b854421ab618fdeed119645f8f4cee268a3a37c2ef90b9855aa1fcfdc858" Sep 17 14:09:12.343707 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:09:12.343683 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-667cd659d8-4rw6b"] Sep 17 14:09:12.349754 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:09:12.349734 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-667cd659d8-4rw6b"] Sep 17 14:09:13.532644 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:09:13.532610 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eadd0df5-d39a-4715-8128-697c0e1812c7" path="/var/lib/kubelet/pods/eadd0df5-d39a-4715-8128-697c0e1812c7/volumes" Sep 17 14:09:30.400935 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:09:30.400889 2558 generic.go:356] "Generic (PLEG): container finished" podID="7cceb3c6-9b3b-4d8c-abc0-2febaefa1174" containerID="e5115db29b44228b557ae6efd1c054b07b20aaa286e23f1a0e8c7894afee226e" exitCode=0 Sep 17 14:09:30.401384 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:09:30.400960 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-tx9n9" event={"ID":"7cceb3c6-9b3b-4d8c-abc0-2febaefa1174","Type":"ContainerDied","Data":"e5115db29b44228b557ae6efd1c054b07b20aaa286e23f1a0e8c7894afee226e"} Sep 17 14:09:30.401384 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:09:30.401268 2558 scope.go:117] "RemoveContainer" containerID="e5115db29b44228b557ae6efd1c054b07b20aaa286e23f1a0e8c7894afee226e" Sep 17 14:09:31.406707 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:09:31.406673 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-tx9n9" event={"ID":"7cceb3c6-9b3b-4d8c-abc0-2febaefa1174","Type":"ContainerStarted","Data":"8141f968d3369e1595e3652209c1d3a98638a5086fd9e24196f9edd89c6df12a"} Sep 17 14:09:41.604665 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:09:41.604633 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:09:41.620864 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:09:41.620841 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:09:42.463958 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:09:42.463932 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:09:55.470999 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:09:55.470962 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 17 14:09:55.471772 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:09:55.471303 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="455ca95c-b3b6-4aab-94c1-64f728c758a6" containerName="alertmanager" containerID="cri-o://95cbb9837971b3e8727d21de5d39f12350a0bc9fb8d5d2e4394df0062ffdfd03" gracePeriod=120 Sep 17 14:09:55.471772 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:09:55.471341 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="455ca95c-b3b6-4aab-94c1-64f728c758a6" containerName="prom-label-proxy" containerID="cri-o://b2de440426fceba4a36428f4b0e6c62de634b93c7744c6ea122f18a1019933c8" gracePeriod=120 Sep 17 14:09:55.471772 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:09:55.471379 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="455ca95c-b3b6-4aab-94c1-64f728c758a6" containerName="kube-rbac-proxy-metric" containerID="cri-o://3798b5ffa50ba21991bcb0173374fd2364b404fb4c89477694b61a2e92cb4dc4" gracePeriod=120 Sep 17 14:09:55.471772 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:09:55.471405 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="455ca95c-b3b6-4aab-94c1-64f728c758a6" containerName="config-reloader" containerID="cri-o://9d8f554c46b94402d94d11c96b3eabe2385aea6aca627548d6168fe24b659902" gracePeriod=120 Sep 17 14:09:55.471772 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:09:55.471389 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="455ca95c-b3b6-4aab-94c1-64f728c758a6" containerName="kube-rbac-proxy-web" containerID="cri-o://48c20d6acbbb91c9d159e9e83c28f6ecccf4cc91075557eb88593faa421610c7" gracePeriod=120 Sep 17 14:09:55.471772 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:09:55.471341 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="455ca95c-b3b6-4aab-94c1-64f728c758a6" containerName="kube-rbac-proxy" containerID="cri-o://41cb2b6823fe6130528a1ad3ef566674bb9f484f863d7e4c15e9a9ed3c5a4613" gracePeriod=120 Sep 17 14:09:56.508116 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:09:56.508083 2558 generic.go:356] "Generic (PLEG): container finished" podID="455ca95c-b3b6-4aab-94c1-64f728c758a6" containerID="b2de440426fceba4a36428f4b0e6c62de634b93c7744c6ea122f18a1019933c8" exitCode=0 Sep 17 14:09:56.508116 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:09:56.508107 2558 generic.go:356] "Generic (PLEG): container finished" podID="455ca95c-b3b6-4aab-94c1-64f728c758a6" containerID="3798b5ffa50ba21991bcb0173374fd2364b404fb4c89477694b61a2e92cb4dc4" exitCode=0 Sep 17 14:09:56.508116 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:09:56.508113 2558 generic.go:356] "Generic (PLEG): container finished" podID="455ca95c-b3b6-4aab-94c1-64f728c758a6" containerID="41cb2b6823fe6130528a1ad3ef566674bb9f484f863d7e4c15e9a9ed3c5a4613" exitCode=0 Sep 17 14:09:56.508116 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:09:56.508119 2558 generic.go:356] "Generic (PLEG): container finished" podID="455ca95c-b3b6-4aab-94c1-64f728c758a6" containerID="9d8f554c46b94402d94d11c96b3eabe2385aea6aca627548d6168fe24b659902" exitCode=0 Sep 17 14:09:56.508116 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:09:56.508125 2558 generic.go:356] "Generic (PLEG): container finished" podID="455ca95c-b3b6-4aab-94c1-64f728c758a6" containerID="95cbb9837971b3e8727d21de5d39f12350a0bc9fb8d5d2e4394df0062ffdfd03" exitCode=0 Sep 17 14:09:56.508625 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:09:56.508155 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"455ca95c-b3b6-4aab-94c1-64f728c758a6","Type":"ContainerDied","Data":"b2de440426fceba4a36428f4b0e6c62de634b93c7744c6ea122f18a1019933c8"} Sep 17 14:09:56.508625 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:09:56.508220 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"455ca95c-b3b6-4aab-94c1-64f728c758a6","Type":"ContainerDied","Data":"3798b5ffa50ba21991bcb0173374fd2364b404fb4c89477694b61a2e92cb4dc4"} Sep 17 14:09:56.508625 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:09:56.508248 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"455ca95c-b3b6-4aab-94c1-64f728c758a6","Type":"ContainerDied","Data":"41cb2b6823fe6130528a1ad3ef566674bb9f484f863d7e4c15e9a9ed3c5a4613"} Sep 17 14:09:56.508625 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:09:56.508274 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"455ca95c-b3b6-4aab-94c1-64f728c758a6","Type":"ContainerDied","Data":"9d8f554c46b94402d94d11c96b3eabe2385aea6aca627548d6168fe24b659902"} Sep 17 14:09:56.508625 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:09:56.508297 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"455ca95c-b3b6-4aab-94c1-64f728c758a6","Type":"ContainerDied","Data":"95cbb9837971b3e8727d21de5d39f12350a0bc9fb8d5d2e4394df0062ffdfd03"} Sep 17 14:09:56.719213 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:09:56.719190 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 17 14:09:56.788978 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:09:56.788903 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/455ca95c-b3b6-4aab-94c1-64f728c758a6-cluster-tls-config\") pod \"455ca95c-b3b6-4aab-94c1-64f728c758a6\" (UID: \"455ca95c-b3b6-4aab-94c1-64f728c758a6\") " Sep 17 14:09:56.788978 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:09:56.788966 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/455ca95c-b3b6-4aab-94c1-64f728c758a6-web-config\") pod \"455ca95c-b3b6-4aab-94c1-64f728c758a6\" (UID: \"455ca95c-b3b6-4aab-94c1-64f728c758a6\") " Sep 17 14:09:56.789159 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:09:56.788996 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/455ca95c-b3b6-4aab-94c1-64f728c758a6-config-volume\") pod \"455ca95c-b3b6-4aab-94c1-64f728c758a6\" (UID: \"455ca95c-b3b6-4aab-94c1-64f728c758a6\") " Sep 17 14:09:56.789159 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:09:56.789027 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/455ca95c-b3b6-4aab-94c1-64f728c758a6-config-out\") pod \"455ca95c-b3b6-4aab-94c1-64f728c758a6\" (UID: \"455ca95c-b3b6-4aab-94c1-64f728c758a6\") " Sep 17 14:09:56.789159 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:09:56.789085 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/455ca95c-b3b6-4aab-94c1-64f728c758a6-secret-alertmanager-kube-rbac-proxy-metric\") pod \"455ca95c-b3b6-4aab-94c1-64f728c758a6\" (UID: \"455ca95c-b3b6-4aab-94c1-64f728c758a6\") " Sep 17 14:09:56.789159 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:09:56.789126 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/455ca95c-b3b6-4aab-94c1-64f728c758a6-tls-assets\") pod \"455ca95c-b3b6-4aab-94c1-64f728c758a6\" (UID: \"455ca95c-b3b6-4aab-94c1-64f728c758a6\") " Sep 17 14:09:56.789861 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:09:56.789833 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/455ca95c-b3b6-4aab-94c1-64f728c758a6-secret-alertmanager-kube-rbac-proxy\") pod \"455ca95c-b3b6-4aab-94c1-64f728c758a6\" (UID: \"455ca95c-b3b6-4aab-94c1-64f728c758a6\") " Sep 17 14:09:56.789986 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:09:56.789896 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-66ttl\" (UniqueName: \"kubernetes.io/projected/455ca95c-b3b6-4aab-94c1-64f728c758a6-kube-api-access-66ttl\") pod \"455ca95c-b3b6-4aab-94c1-64f728c758a6\" (UID: \"455ca95c-b3b6-4aab-94c1-64f728c758a6\") " Sep 17 14:09:56.789986 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:09:56.789930 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/455ca95c-b3b6-4aab-94c1-64f728c758a6-alertmanager-main-db\") pod \"455ca95c-b3b6-4aab-94c1-64f728c758a6\" (UID: \"455ca95c-b3b6-4aab-94c1-64f728c758a6\") " Sep 17 14:09:56.789986 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:09:56.789969 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/455ca95c-b3b6-4aab-94c1-64f728c758a6-metrics-client-ca\") pod \"455ca95c-b3b6-4aab-94c1-64f728c758a6\" (UID: \"455ca95c-b3b6-4aab-94c1-64f728c758a6\") " Sep 17 14:09:56.790205 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:09:56.790020 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/455ca95c-b3b6-4aab-94c1-64f728c758a6-secret-alertmanager-main-tls\") pod \"455ca95c-b3b6-4aab-94c1-64f728c758a6\" (UID: \"455ca95c-b3b6-4aab-94c1-64f728c758a6\") " Sep 17 14:09:56.790205 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:09:56.790066 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/455ca95c-b3b6-4aab-94c1-64f728c758a6-secret-alertmanager-kube-rbac-proxy-web\") pod \"455ca95c-b3b6-4aab-94c1-64f728c758a6\" (UID: \"455ca95c-b3b6-4aab-94c1-64f728c758a6\") " Sep 17 14:09:56.790205 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:09:56.790100 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/455ca95c-b3b6-4aab-94c1-64f728c758a6-alertmanager-trusted-ca-bundle\") pod \"455ca95c-b3b6-4aab-94c1-64f728c758a6\" (UID: \"455ca95c-b3b6-4aab-94c1-64f728c758a6\") " Sep 17 14:09:56.790791 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:09:56.790759 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/455ca95c-b3b6-4aab-94c1-64f728c758a6-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "455ca95c-b3b6-4aab-94c1-64f728c758a6" (UID: "455ca95c-b3b6-4aab-94c1-64f728c758a6"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 14:09:56.791339 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:09:56.790996 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/455ca95c-b3b6-4aab-94c1-64f728c758a6-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "455ca95c-b3b6-4aab-94c1-64f728c758a6" (UID: "455ca95c-b3b6-4aab-94c1-64f728c758a6"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 17 14:09:56.791339 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:09:56.791154 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/455ca95c-b3b6-4aab-94c1-64f728c758a6-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "455ca95c-b3b6-4aab-94c1-64f728c758a6" (UID: "455ca95c-b3b6-4aab-94c1-64f728c758a6"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 14:09:56.792103 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:09:56.792069 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/455ca95c-b3b6-4aab-94c1-64f728c758a6-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "455ca95c-b3b6-4aab-94c1-64f728c758a6" (UID: "455ca95c-b3b6-4aab-94c1-64f728c758a6"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 14:09:56.794064 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:09:56.794011 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/455ca95c-b3b6-4aab-94c1-64f728c758a6-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "455ca95c-b3b6-4aab-94c1-64f728c758a6" (UID: "455ca95c-b3b6-4aab-94c1-64f728c758a6"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 14:09:56.794064 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:09:56.794051 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/455ca95c-b3b6-4aab-94c1-64f728c758a6-config-out" (OuterVolumeSpecName: "config-out") pod "455ca95c-b3b6-4aab-94c1-64f728c758a6" (UID: "455ca95c-b3b6-4aab-94c1-64f728c758a6"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 17 14:09:56.794222 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:09:56.794060 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/455ca95c-b3b6-4aab-94c1-64f728c758a6-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "455ca95c-b3b6-4aab-94c1-64f728c758a6" (UID: "455ca95c-b3b6-4aab-94c1-64f728c758a6"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 14:09:56.794934 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:09:56.794893 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/455ca95c-b3b6-4aab-94c1-64f728c758a6-kube-api-access-66ttl" (OuterVolumeSpecName: "kube-api-access-66ttl") pod "455ca95c-b3b6-4aab-94c1-64f728c758a6" (UID: "455ca95c-b3b6-4aab-94c1-64f728c758a6"). InnerVolumeSpecName "kube-api-access-66ttl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 14:09:56.795417 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:09:56.795392 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/455ca95c-b3b6-4aab-94c1-64f728c758a6-config-volume" (OuterVolumeSpecName: "config-volume") pod "455ca95c-b3b6-4aab-94c1-64f728c758a6" (UID: "455ca95c-b3b6-4aab-94c1-64f728c758a6"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 14:09:56.795534 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:09:56.795450 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/455ca95c-b3b6-4aab-94c1-64f728c758a6-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "455ca95c-b3b6-4aab-94c1-64f728c758a6" (UID: "455ca95c-b3b6-4aab-94c1-64f728c758a6"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 14:09:56.795616 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:09:56.795598 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/455ca95c-b3b6-4aab-94c1-64f728c758a6-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "455ca95c-b3b6-4aab-94c1-64f728c758a6" (UID: "455ca95c-b3b6-4aab-94c1-64f728c758a6"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 14:09:56.797871 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:09:56.797849 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/455ca95c-b3b6-4aab-94c1-64f728c758a6-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "455ca95c-b3b6-4aab-94c1-64f728c758a6" (UID: "455ca95c-b3b6-4aab-94c1-64f728c758a6"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 14:09:56.805382 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:09:56.805359 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/455ca95c-b3b6-4aab-94c1-64f728c758a6-web-config" (OuterVolumeSpecName: "web-config") pod "455ca95c-b3b6-4aab-94c1-64f728c758a6" (UID: "455ca95c-b3b6-4aab-94c1-64f728c758a6"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 14:09:56.891577 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:09:56.891551 2558 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/455ca95c-b3b6-4aab-94c1-64f728c758a6-config-out\") on node \"ip-10-0-129-36.ec2.internal\" DevicePath \"\"" Sep 17 14:09:56.891577 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:09:56.891573 2558 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/455ca95c-b3b6-4aab-94c1-64f728c758a6-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-129-36.ec2.internal\" DevicePath \"\"" Sep 17 14:09:56.891725 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:09:56.891583 2558 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/455ca95c-b3b6-4aab-94c1-64f728c758a6-tls-assets\") on node \"ip-10-0-129-36.ec2.internal\" DevicePath \"\"" Sep 17 14:09:56.891725 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:09:56.891593 2558 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/455ca95c-b3b6-4aab-94c1-64f728c758a6-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-129-36.ec2.internal\" DevicePath \"\"" Sep 17 14:09:56.891725 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:09:56.891602 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-66ttl\" (UniqueName: \"kubernetes.io/projected/455ca95c-b3b6-4aab-94c1-64f728c758a6-kube-api-access-66ttl\") on node \"ip-10-0-129-36.ec2.internal\" DevicePath \"\"" Sep 17 14:09:56.891725 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:09:56.891611 2558 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/455ca95c-b3b6-4aab-94c1-64f728c758a6-alertmanager-main-db\") on node \"ip-10-0-129-36.ec2.internal\" DevicePath \"\"" Sep 17 14:09:56.891725 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:09:56.891619 2558 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/455ca95c-b3b6-4aab-94c1-64f728c758a6-metrics-client-ca\") on node \"ip-10-0-129-36.ec2.internal\" DevicePath \"\"" Sep 17 14:09:56.891725 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:09:56.891628 2558 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/455ca95c-b3b6-4aab-94c1-64f728c758a6-secret-alertmanager-main-tls\") on node \"ip-10-0-129-36.ec2.internal\" DevicePath \"\"" Sep 17 14:09:56.891725 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:09:56.891636 2558 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/455ca95c-b3b6-4aab-94c1-64f728c758a6-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-129-36.ec2.internal\" DevicePath \"\"" Sep 17 14:09:56.891725 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:09:56.891644 2558 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/455ca95c-b3b6-4aab-94c1-64f728c758a6-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-129-36.ec2.internal\" DevicePath \"\"" Sep 17 14:09:56.891725 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:09:56.891652 2558 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/455ca95c-b3b6-4aab-94c1-64f728c758a6-cluster-tls-config\") on node \"ip-10-0-129-36.ec2.internal\" DevicePath \"\"" Sep 17 14:09:56.891725 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:09:56.891661 2558 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/455ca95c-b3b6-4aab-94c1-64f728c758a6-web-config\") on node \"ip-10-0-129-36.ec2.internal\" DevicePath \"\"" Sep 17 14:09:56.891725 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:09:56.891668 2558 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/455ca95c-b3b6-4aab-94c1-64f728c758a6-config-volume\") on node \"ip-10-0-129-36.ec2.internal\" DevicePath \"\"" Sep 17 14:09:57.515757 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:09:57.515726 2558 generic.go:356] "Generic (PLEG): container finished" podID="455ca95c-b3b6-4aab-94c1-64f728c758a6" containerID="48c20d6acbbb91c9d159e9e83c28f6ecccf4cc91075557eb88593faa421610c7" exitCode=0 Sep 17 14:09:57.516139 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:09:57.515799 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"455ca95c-b3b6-4aab-94c1-64f728c758a6","Type":"ContainerDied","Data":"48c20d6acbbb91c9d159e9e83c28f6ecccf4cc91075557eb88593faa421610c7"} Sep 17 14:09:57.516139 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:09:57.515818 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 17 14:09:57.516139 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:09:57.515902 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"455ca95c-b3b6-4aab-94c1-64f728c758a6","Type":"ContainerDied","Data":"e0aed7a0c3a6a28404ff83a387feaece226b6eca6c97a9e073f95af6dc118fe5"} Sep 17 14:09:57.516139 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:09:57.515936 2558 scope.go:117] "RemoveContainer" containerID="b2de440426fceba4a36428f4b0e6c62de634b93c7744c6ea122f18a1019933c8" Sep 17 14:09:57.523401 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:09:57.523348 2558 scope.go:117] "RemoveContainer" containerID="3798b5ffa50ba21991bcb0173374fd2364b404fb4c89477694b61a2e92cb4dc4" Sep 17 14:09:57.531025 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:09:57.531008 2558 scope.go:117] "RemoveContainer" containerID="41cb2b6823fe6130528a1ad3ef566674bb9f484f863d7e4c15e9a9ed3c5a4613" Sep 17 14:09:57.537569 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:09:57.537553 2558 scope.go:117] "RemoveContainer" containerID="48c20d6acbbb91c9d159e9e83c28f6ecccf4cc91075557eb88593faa421610c7" Sep 17 14:09:57.546431 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:09:57.546412 2558 scope.go:117] "RemoveContainer" containerID="9d8f554c46b94402d94d11c96b3eabe2385aea6aca627548d6168fe24b659902" Sep 17 14:09:57.549852 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:09:57.549829 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 17 14:09:57.554367 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:09:57.554348 2558 scope.go:117] "RemoveContainer" containerID="95cbb9837971b3e8727d21de5d39f12350a0bc9fb8d5d2e4394df0062ffdfd03" Sep 17 14:09:57.558258 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:09:57.558237 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 17 14:09:57.562565 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:09:57.562545 2558 scope.go:117] "RemoveContainer" containerID="16cbf7367da0b0a8cd43ea4ee5386510e40210df520fa2b925597faac26b5529" Sep 17 14:09:57.572885 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:09:57.572868 2558 scope.go:117] "RemoveContainer" containerID="b2de440426fceba4a36428f4b0e6c62de634b93c7744c6ea122f18a1019933c8" Sep 17 14:09:57.573167 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:09:57.573147 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b2de440426fceba4a36428f4b0e6c62de634b93c7744c6ea122f18a1019933c8\": container with ID starting with b2de440426fceba4a36428f4b0e6c62de634b93c7744c6ea122f18a1019933c8 not found: ID does not exist" containerID="b2de440426fceba4a36428f4b0e6c62de634b93c7744c6ea122f18a1019933c8" Sep 17 14:09:57.573213 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:09:57.573176 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b2de440426fceba4a36428f4b0e6c62de634b93c7744c6ea122f18a1019933c8"} err="failed to get container status \"b2de440426fceba4a36428f4b0e6c62de634b93c7744c6ea122f18a1019933c8\": rpc error: code = NotFound desc = could not find container \"b2de440426fceba4a36428f4b0e6c62de634b93c7744c6ea122f18a1019933c8\": container with ID starting with b2de440426fceba4a36428f4b0e6c62de634b93c7744c6ea122f18a1019933c8 not found: ID does not exist" Sep 17 14:09:57.573213 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:09:57.573207 2558 scope.go:117] "RemoveContainer" containerID="3798b5ffa50ba21991bcb0173374fd2364b404fb4c89477694b61a2e92cb4dc4" Sep 17 14:09:57.573446 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:09:57.573432 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3798b5ffa50ba21991bcb0173374fd2364b404fb4c89477694b61a2e92cb4dc4\": container with ID starting with 3798b5ffa50ba21991bcb0173374fd2364b404fb4c89477694b61a2e92cb4dc4 not found: ID does not exist" containerID="3798b5ffa50ba21991bcb0173374fd2364b404fb4c89477694b61a2e92cb4dc4" Sep 17 14:09:57.573491 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:09:57.573450 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3798b5ffa50ba21991bcb0173374fd2364b404fb4c89477694b61a2e92cb4dc4"} err="failed to get container status \"3798b5ffa50ba21991bcb0173374fd2364b404fb4c89477694b61a2e92cb4dc4\": rpc error: code = NotFound desc = could not find container \"3798b5ffa50ba21991bcb0173374fd2364b404fb4c89477694b61a2e92cb4dc4\": container with ID starting with 3798b5ffa50ba21991bcb0173374fd2364b404fb4c89477694b61a2e92cb4dc4 not found: ID does not exist" Sep 17 14:09:57.573491 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:09:57.573463 2558 scope.go:117] "RemoveContainer" containerID="41cb2b6823fe6130528a1ad3ef566674bb9f484f863d7e4c15e9a9ed3c5a4613" Sep 17 14:09:57.573713 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:09:57.573697 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"41cb2b6823fe6130528a1ad3ef566674bb9f484f863d7e4c15e9a9ed3c5a4613\": container with ID starting with 41cb2b6823fe6130528a1ad3ef566674bb9f484f863d7e4c15e9a9ed3c5a4613 not found: ID does not exist" containerID="41cb2b6823fe6130528a1ad3ef566674bb9f484f863d7e4c15e9a9ed3c5a4613" Sep 17 14:09:57.573756 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:09:57.573718 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41cb2b6823fe6130528a1ad3ef566674bb9f484f863d7e4c15e9a9ed3c5a4613"} err="failed to get container status \"41cb2b6823fe6130528a1ad3ef566674bb9f484f863d7e4c15e9a9ed3c5a4613\": rpc error: code = NotFound desc = could not find container \"41cb2b6823fe6130528a1ad3ef566674bb9f484f863d7e4c15e9a9ed3c5a4613\": container with ID starting with 41cb2b6823fe6130528a1ad3ef566674bb9f484f863d7e4c15e9a9ed3c5a4613 not found: ID does not exist" Sep 17 14:09:57.573756 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:09:57.573737 2558 scope.go:117] "RemoveContainer" containerID="48c20d6acbbb91c9d159e9e83c28f6ecccf4cc91075557eb88593faa421610c7" Sep 17 14:09:57.573935 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:09:57.573918 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"48c20d6acbbb91c9d159e9e83c28f6ecccf4cc91075557eb88593faa421610c7\": container with ID starting with 48c20d6acbbb91c9d159e9e83c28f6ecccf4cc91075557eb88593faa421610c7 not found: ID does not exist" containerID="48c20d6acbbb91c9d159e9e83c28f6ecccf4cc91075557eb88593faa421610c7" Sep 17 14:09:57.573979 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:09:57.573939 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"48c20d6acbbb91c9d159e9e83c28f6ecccf4cc91075557eb88593faa421610c7"} err="failed to get container status \"48c20d6acbbb91c9d159e9e83c28f6ecccf4cc91075557eb88593faa421610c7\": rpc error: code = NotFound desc = could not find container \"48c20d6acbbb91c9d159e9e83c28f6ecccf4cc91075557eb88593faa421610c7\": container with ID starting with 48c20d6acbbb91c9d159e9e83c28f6ecccf4cc91075557eb88593faa421610c7 not found: ID does not exist" Sep 17 14:09:57.573979 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:09:57.573951 2558 scope.go:117] "RemoveContainer" containerID="9d8f554c46b94402d94d11c96b3eabe2385aea6aca627548d6168fe24b659902" Sep 17 14:09:57.574158 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:09:57.574143 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9d8f554c46b94402d94d11c96b3eabe2385aea6aca627548d6168fe24b659902\": container with ID starting with 9d8f554c46b94402d94d11c96b3eabe2385aea6aca627548d6168fe24b659902 not found: ID does not exist" containerID="9d8f554c46b94402d94d11c96b3eabe2385aea6aca627548d6168fe24b659902" Sep 17 14:09:57.574195 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:09:57.574161 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d8f554c46b94402d94d11c96b3eabe2385aea6aca627548d6168fe24b659902"} err="failed to get container status \"9d8f554c46b94402d94d11c96b3eabe2385aea6aca627548d6168fe24b659902\": rpc error: code = NotFound desc = could not find container \"9d8f554c46b94402d94d11c96b3eabe2385aea6aca627548d6168fe24b659902\": container with ID starting with 9d8f554c46b94402d94d11c96b3eabe2385aea6aca627548d6168fe24b659902 not found: ID does not exist" Sep 17 14:09:57.574195 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:09:57.574174 2558 scope.go:117] "RemoveContainer" containerID="95cbb9837971b3e8727d21de5d39f12350a0bc9fb8d5d2e4394df0062ffdfd03" Sep 17 14:09:57.574399 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:09:57.574385 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"95cbb9837971b3e8727d21de5d39f12350a0bc9fb8d5d2e4394df0062ffdfd03\": container with ID starting with 95cbb9837971b3e8727d21de5d39f12350a0bc9fb8d5d2e4394df0062ffdfd03 not found: ID does not exist" containerID="95cbb9837971b3e8727d21de5d39f12350a0bc9fb8d5d2e4394df0062ffdfd03" Sep 17 14:09:57.574443 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:09:57.574401 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"95cbb9837971b3e8727d21de5d39f12350a0bc9fb8d5d2e4394df0062ffdfd03"} err="failed to get container status \"95cbb9837971b3e8727d21de5d39f12350a0bc9fb8d5d2e4394df0062ffdfd03\": rpc error: code = NotFound desc = could not find container \"95cbb9837971b3e8727d21de5d39f12350a0bc9fb8d5d2e4394df0062ffdfd03\": container with ID starting with 95cbb9837971b3e8727d21de5d39f12350a0bc9fb8d5d2e4394df0062ffdfd03 not found: ID does not exist" Sep 17 14:09:57.574443 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:09:57.574412 2558 scope.go:117] "RemoveContainer" containerID="16cbf7367da0b0a8cd43ea4ee5386510e40210df520fa2b925597faac26b5529" Sep 17 14:09:57.574622 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:09:57.574606 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"16cbf7367da0b0a8cd43ea4ee5386510e40210df520fa2b925597faac26b5529\": container with ID starting with 16cbf7367da0b0a8cd43ea4ee5386510e40210df520fa2b925597faac26b5529 not found: ID does not exist" containerID="16cbf7367da0b0a8cd43ea4ee5386510e40210df520fa2b925597faac26b5529" Sep 17 14:09:57.574680 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:09:57.574626 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"16cbf7367da0b0a8cd43ea4ee5386510e40210df520fa2b925597faac26b5529"} err="failed to get container status \"16cbf7367da0b0a8cd43ea4ee5386510e40210df520fa2b925597faac26b5529\": rpc error: code = NotFound desc = could not find container \"16cbf7367da0b0a8cd43ea4ee5386510e40210df520fa2b925597faac26b5529\": container with ID starting with 16cbf7367da0b0a8cd43ea4ee5386510e40210df520fa2b925597faac26b5529 not found: ID does not exist" Sep 17 14:09:59.532160 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:09:59.532130 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="455ca95c-b3b6-4aab-94c1-64f728c758a6" path="/var/lib/kubelet/pods/455ca95c-b3b6-4aab-94c1-64f728c758a6/volumes" Sep 17 14:09:59.729235 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:09:59.729183 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 17 14:09:59.730168 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:09:59.729950 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="e0417d03-deb9-4a36-928d-604c37111cdf" containerName="kube-rbac-proxy" containerID="cri-o://e99a166e2ff703e5ef3b8577a255bdd170c34b6738f5a78d4e1abc12e6d71376" gracePeriod=600 Sep 17 14:09:59.730168 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:09:59.729980 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="e0417d03-deb9-4a36-928d-604c37111cdf" containerName="thanos-sidecar" containerID="cri-o://b6f092d5475b8a488ad46181730b0f8ec82dc716ac7d71adfb0021a2e352f2ef" gracePeriod=600 Sep 17 14:09:59.730168 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:09:59.730090 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="e0417d03-deb9-4a36-928d-604c37111cdf" containerName="config-reloader" containerID="cri-o://27a24bee905634b2ecf773a085cfc6e794494518196b4975161cd59bf06a46f8" gracePeriod=600 Sep 17 14:09:59.730422 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:09:59.729950 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="e0417d03-deb9-4a36-928d-604c37111cdf" containerName="kube-rbac-proxy-web" containerID="cri-o://752b569a14161cbf36f59fc015452fb1db1e291ba2ea23a5109d3fd0f8286232" gracePeriod=600 Sep 17 14:09:59.730422 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:09:59.730318 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="e0417d03-deb9-4a36-928d-604c37111cdf" containerName="kube-rbac-proxy-thanos" containerID="cri-o://f4dc837fa14d92900b567667e783175f704de86246420816c637e27430ed7be4" gracePeriod=600 Sep 17 14:09:59.730422 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:09:59.729852 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="e0417d03-deb9-4a36-928d-604c37111cdf" containerName="prometheus" containerID="cri-o://d8df93f37813c872543a609e522a728635415cb9bcb4dcf7250c0dfe2d6134dc" gracePeriod=600 Sep 17 14:09:59.991969 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:09:59.991672 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:10:00.119786 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.119756 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e0417d03-deb9-4a36-928d-604c37111cdf-secret-prometheus-k8s-tls\") pod \"e0417d03-deb9-4a36-928d-604c37111cdf\" (UID: \"e0417d03-deb9-4a36-928d-604c37111cdf\") " Sep 17 14:10:00.119786 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.119790 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e0417d03-deb9-4a36-928d-604c37111cdf-secret-kube-rbac-proxy\") pod \"e0417d03-deb9-4a36-928d-604c37111cdf\" (UID: \"e0417d03-deb9-4a36-928d-604c37111cdf\") " Sep 17 14:10:00.120003 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.119844 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0417d03-deb9-4a36-928d-604c37111cdf-configmap-serving-certs-ca-bundle\") pod \"e0417d03-deb9-4a36-928d-604c37111cdf\" (UID: \"e0417d03-deb9-4a36-928d-604c37111cdf\") " Sep 17 14:10:00.120003 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.119884 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e0417d03-deb9-4a36-928d-604c37111cdf-prometheus-k8s-rulefiles-1\") pod \"e0417d03-deb9-4a36-928d-604c37111cdf\" (UID: \"e0417d03-deb9-4a36-928d-604c37111cdf\") " Sep 17 14:10:00.120003 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.119914 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e0417d03-deb9-4a36-928d-604c37111cdf-tls-assets\") pod \"e0417d03-deb9-4a36-928d-604c37111cdf\" (UID: \"e0417d03-deb9-4a36-928d-604c37111cdf\") " Sep 17 14:10:00.120153 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.120025 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/e0417d03-deb9-4a36-928d-604c37111cdf-config\") pod \"e0417d03-deb9-4a36-928d-604c37111cdf\" (UID: \"e0417d03-deb9-4a36-928d-604c37111cdf\") " Sep 17 14:10:00.120153 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.120067 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e0417d03-deb9-4a36-928d-604c37111cdf-prometheus-k8s-db\") pod \"e0417d03-deb9-4a36-928d-604c37111cdf\" (UID: \"e0417d03-deb9-4a36-928d-604c37111cdf\") " Sep 17 14:10:00.120153 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.120110 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0417d03-deb9-4a36-928d-604c37111cdf-prometheus-trusted-ca-bundle\") pod \"e0417d03-deb9-4a36-928d-604c37111cdf\" (UID: \"e0417d03-deb9-4a36-928d-604c37111cdf\") " Sep 17 14:10:00.120153 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.120137 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e0417d03-deb9-4a36-928d-604c37111cdf-secret-metrics-client-certs\") pod \"e0417d03-deb9-4a36-928d-604c37111cdf\" (UID: \"e0417d03-deb9-4a36-928d-604c37111cdf\") " Sep 17 14:10:00.120357 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.120170 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e0417d03-deb9-4a36-928d-604c37111cdf-thanos-prometheus-http-client-file\") pod \"e0417d03-deb9-4a36-928d-604c37111cdf\" (UID: \"e0417d03-deb9-4a36-928d-604c37111cdf\") " Sep 17 14:10:00.120357 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.120196 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e0417d03-deb9-4a36-928d-604c37111cdf-secret-grpc-tls\") pod \"e0417d03-deb9-4a36-928d-604c37111cdf\" (UID: \"e0417d03-deb9-4a36-928d-604c37111cdf\") " Sep 17 14:10:00.120357 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.120232 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6t9hn\" (UniqueName: \"kubernetes.io/projected/e0417d03-deb9-4a36-928d-604c37111cdf-kube-api-access-6t9hn\") pod \"e0417d03-deb9-4a36-928d-604c37111cdf\" (UID: \"e0417d03-deb9-4a36-928d-604c37111cdf\") " Sep 17 14:10:00.120357 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.120234 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e0417d03-deb9-4a36-928d-604c37111cdf-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "e0417d03-deb9-4a36-928d-604c37111cdf" (UID: "e0417d03-deb9-4a36-928d-604c37111cdf"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 14:10:00.120357 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.120256 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e0417d03-deb9-4a36-928d-604c37111cdf-configmap-metrics-client-ca\") pod \"e0417d03-deb9-4a36-928d-604c37111cdf\" (UID: \"e0417d03-deb9-4a36-928d-604c37111cdf\") " Sep 17 14:10:00.120357 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.120283 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e0417d03-deb9-4a36-928d-604c37111cdf-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"e0417d03-deb9-4a36-928d-604c37111cdf\" (UID: \"e0417d03-deb9-4a36-928d-604c37111cdf\") " Sep 17 14:10:00.120357 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.120312 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0417d03-deb9-4a36-928d-604c37111cdf-configmap-kubelet-serving-ca-bundle\") pod \"e0417d03-deb9-4a36-928d-604c37111cdf\" (UID: \"e0417d03-deb9-4a36-928d-604c37111cdf\") " Sep 17 14:10:00.120357 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.120346 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e0417d03-deb9-4a36-928d-604c37111cdf-web-config\") pod \"e0417d03-deb9-4a36-928d-604c37111cdf\" (UID: \"e0417d03-deb9-4a36-928d-604c37111cdf\") " Sep 17 14:10:00.120741 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.120371 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e0417d03-deb9-4a36-928d-604c37111cdf-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"e0417d03-deb9-4a36-928d-604c37111cdf\" (UID: \"e0417d03-deb9-4a36-928d-604c37111cdf\") " Sep 17 14:10:00.120741 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.120383 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e0417d03-deb9-4a36-928d-604c37111cdf-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "e0417d03-deb9-4a36-928d-604c37111cdf" (UID: "e0417d03-deb9-4a36-928d-604c37111cdf"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 14:10:00.120741 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.120405 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e0417d03-deb9-4a36-928d-604c37111cdf-prometheus-k8s-rulefiles-0\") pod \"e0417d03-deb9-4a36-928d-604c37111cdf\" (UID: \"e0417d03-deb9-4a36-928d-604c37111cdf\") " Sep 17 14:10:00.120741 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.120444 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e0417d03-deb9-4a36-928d-604c37111cdf-prometheus-k8s-rulefiles-2\") pod \"e0417d03-deb9-4a36-928d-604c37111cdf\" (UID: \"e0417d03-deb9-4a36-928d-604c37111cdf\") " Sep 17 14:10:00.120741 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.120470 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e0417d03-deb9-4a36-928d-604c37111cdf-config-out\") pod \"e0417d03-deb9-4a36-928d-604c37111cdf\" (UID: \"e0417d03-deb9-4a36-928d-604c37111cdf\") " Sep 17 14:10:00.120741 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.120714 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e0417d03-deb9-4a36-928d-604c37111cdf-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "e0417d03-deb9-4a36-928d-604c37111cdf" (UID: "e0417d03-deb9-4a36-928d-604c37111cdf"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 14:10:00.120741 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.120738 2558 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0417d03-deb9-4a36-928d-604c37111cdf-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-129-36.ec2.internal\" DevicePath \"\"" Sep 17 14:10:00.121057 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.120761 2558 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e0417d03-deb9-4a36-928d-604c37111cdf-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-129-36.ec2.internal\" DevicePath \"\"" Sep 17 14:10:00.121109 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.121073 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e0417d03-deb9-4a36-928d-604c37111cdf-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "e0417d03-deb9-4a36-928d-604c37111cdf" (UID: "e0417d03-deb9-4a36-928d-604c37111cdf"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 14:10:00.121624 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.121331 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e0417d03-deb9-4a36-928d-604c37111cdf-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "e0417d03-deb9-4a36-928d-604c37111cdf" (UID: "e0417d03-deb9-4a36-928d-604c37111cdf"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 17 14:10:00.122761 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.122438 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e0417d03-deb9-4a36-928d-604c37111cdf-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "e0417d03-deb9-4a36-928d-604c37111cdf" (UID: "e0417d03-deb9-4a36-928d-604c37111cdf"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 14:10:00.122890 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.122813 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e0417d03-deb9-4a36-928d-604c37111cdf-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "e0417d03-deb9-4a36-928d-604c37111cdf" (UID: "e0417d03-deb9-4a36-928d-604c37111cdf"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 14:10:00.122953 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.122931 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e0417d03-deb9-4a36-928d-604c37111cdf-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "e0417d03-deb9-4a36-928d-604c37111cdf" (UID: "e0417d03-deb9-4a36-928d-604c37111cdf"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 14:10:00.123832 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.123719 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e0417d03-deb9-4a36-928d-604c37111cdf-config" (OuterVolumeSpecName: "config") pod "e0417d03-deb9-4a36-928d-604c37111cdf" (UID: "e0417d03-deb9-4a36-928d-604c37111cdf"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 14:10:00.123832 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.123750 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e0417d03-deb9-4a36-928d-604c37111cdf-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "e0417d03-deb9-4a36-928d-604c37111cdf" (UID: "e0417d03-deb9-4a36-928d-604c37111cdf"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 14:10:00.123832 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.123768 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e0417d03-deb9-4a36-928d-604c37111cdf-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "e0417d03-deb9-4a36-928d-604c37111cdf" (UID: "e0417d03-deb9-4a36-928d-604c37111cdf"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 14:10:00.123832 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.123808 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e0417d03-deb9-4a36-928d-604c37111cdf-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "e0417d03-deb9-4a36-928d-604c37111cdf" (UID: "e0417d03-deb9-4a36-928d-604c37111cdf"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 14:10:00.123832 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.123817 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e0417d03-deb9-4a36-928d-604c37111cdf-config-out" (OuterVolumeSpecName: "config-out") pod "e0417d03-deb9-4a36-928d-604c37111cdf" (UID: "e0417d03-deb9-4a36-928d-604c37111cdf"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 17 14:10:00.124277 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.124242 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e0417d03-deb9-4a36-928d-604c37111cdf-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "e0417d03-deb9-4a36-928d-604c37111cdf" (UID: "e0417d03-deb9-4a36-928d-604c37111cdf"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 14:10:00.124547 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.124522 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e0417d03-deb9-4a36-928d-604c37111cdf-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "e0417d03-deb9-4a36-928d-604c37111cdf" (UID: "e0417d03-deb9-4a36-928d-604c37111cdf"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 14:10:00.124547 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.124537 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e0417d03-deb9-4a36-928d-604c37111cdf-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "e0417d03-deb9-4a36-928d-604c37111cdf" (UID: "e0417d03-deb9-4a36-928d-604c37111cdf"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 14:10:00.124954 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.124939 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e0417d03-deb9-4a36-928d-604c37111cdf-kube-api-access-6t9hn" (OuterVolumeSpecName: "kube-api-access-6t9hn") pod "e0417d03-deb9-4a36-928d-604c37111cdf" (UID: "e0417d03-deb9-4a36-928d-604c37111cdf"). InnerVolumeSpecName "kube-api-access-6t9hn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 14:10:00.125027 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.125012 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e0417d03-deb9-4a36-928d-604c37111cdf-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "e0417d03-deb9-4a36-928d-604c37111cdf" (UID: "e0417d03-deb9-4a36-928d-604c37111cdf"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 14:10:00.125106 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.125092 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e0417d03-deb9-4a36-928d-604c37111cdf-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "e0417d03-deb9-4a36-928d-604c37111cdf" (UID: "e0417d03-deb9-4a36-928d-604c37111cdf"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 14:10:00.134063 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.134046 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e0417d03-deb9-4a36-928d-604c37111cdf-web-config" (OuterVolumeSpecName: "web-config") pod "e0417d03-deb9-4a36-928d-604c37111cdf" (UID: "e0417d03-deb9-4a36-928d-604c37111cdf"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 14:10:00.221747 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.221722 2558 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e0417d03-deb9-4a36-928d-604c37111cdf-tls-assets\") on node \"ip-10-0-129-36.ec2.internal\" DevicePath \"\"" Sep 17 14:10:00.221747 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.221744 2558 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/e0417d03-deb9-4a36-928d-604c37111cdf-config\") on node \"ip-10-0-129-36.ec2.internal\" DevicePath \"\"" Sep 17 14:10:00.221868 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.221752 2558 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e0417d03-deb9-4a36-928d-604c37111cdf-prometheus-k8s-db\") on node \"ip-10-0-129-36.ec2.internal\" DevicePath \"\"" Sep 17 14:10:00.221868 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.221762 2558 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0417d03-deb9-4a36-928d-604c37111cdf-prometheus-trusted-ca-bundle\") on node \"ip-10-0-129-36.ec2.internal\" DevicePath \"\"" Sep 17 14:10:00.221868 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.221771 2558 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e0417d03-deb9-4a36-928d-604c37111cdf-secret-metrics-client-certs\") on node \"ip-10-0-129-36.ec2.internal\" DevicePath \"\"" Sep 17 14:10:00.221868 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.221780 2558 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e0417d03-deb9-4a36-928d-604c37111cdf-thanos-prometheus-http-client-file\") on node \"ip-10-0-129-36.ec2.internal\" DevicePath \"\"" Sep 17 14:10:00.221868 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.221790 2558 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e0417d03-deb9-4a36-928d-604c37111cdf-secret-grpc-tls\") on node \"ip-10-0-129-36.ec2.internal\" DevicePath \"\"" Sep 17 14:10:00.221868 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.221798 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6t9hn\" (UniqueName: \"kubernetes.io/projected/e0417d03-deb9-4a36-928d-604c37111cdf-kube-api-access-6t9hn\") on node \"ip-10-0-129-36.ec2.internal\" DevicePath \"\"" Sep 17 14:10:00.221868 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.221806 2558 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e0417d03-deb9-4a36-928d-604c37111cdf-configmap-metrics-client-ca\") on node \"ip-10-0-129-36.ec2.internal\" DevicePath \"\"" Sep 17 14:10:00.221868 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.221814 2558 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e0417d03-deb9-4a36-928d-604c37111cdf-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-129-36.ec2.internal\" DevicePath \"\"" Sep 17 14:10:00.221868 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.221823 2558 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0417d03-deb9-4a36-928d-604c37111cdf-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-129-36.ec2.internal\" DevicePath \"\"" Sep 17 14:10:00.221868 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.221848 2558 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e0417d03-deb9-4a36-928d-604c37111cdf-web-config\") on node \"ip-10-0-129-36.ec2.internal\" DevicePath \"\"" Sep 17 14:10:00.221868 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.221856 2558 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e0417d03-deb9-4a36-928d-604c37111cdf-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-129-36.ec2.internal\" DevicePath \"\"" Sep 17 14:10:00.221868 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.221865 2558 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e0417d03-deb9-4a36-928d-604c37111cdf-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-129-36.ec2.internal\" DevicePath \"\"" Sep 17 14:10:00.222197 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.221874 2558 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e0417d03-deb9-4a36-928d-604c37111cdf-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-129-36.ec2.internal\" DevicePath \"\"" Sep 17 14:10:00.222197 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.221882 2558 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e0417d03-deb9-4a36-928d-604c37111cdf-config-out\") on node \"ip-10-0-129-36.ec2.internal\" DevicePath \"\"" Sep 17 14:10:00.222197 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.221890 2558 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e0417d03-deb9-4a36-928d-604c37111cdf-secret-prometheus-k8s-tls\") on node \"ip-10-0-129-36.ec2.internal\" DevicePath \"\"" Sep 17 14:10:00.222197 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.221898 2558 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e0417d03-deb9-4a36-928d-604c37111cdf-secret-kube-rbac-proxy\") on node \"ip-10-0-129-36.ec2.internal\" DevicePath \"\"" Sep 17 14:10:00.532195 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.532120 2558 generic.go:356] "Generic (PLEG): container finished" podID="e0417d03-deb9-4a36-928d-604c37111cdf" containerID="f4dc837fa14d92900b567667e783175f704de86246420816c637e27430ed7be4" exitCode=0 Sep 17 14:10:00.532195 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.532144 2558 generic.go:356] "Generic (PLEG): container finished" podID="e0417d03-deb9-4a36-928d-604c37111cdf" containerID="e99a166e2ff703e5ef3b8577a255bdd170c34b6738f5a78d4e1abc12e6d71376" exitCode=0 Sep 17 14:10:00.532195 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.532151 2558 generic.go:356] "Generic (PLEG): container finished" podID="e0417d03-deb9-4a36-928d-604c37111cdf" containerID="752b569a14161cbf36f59fc015452fb1db1e291ba2ea23a5109d3fd0f8286232" exitCode=0 Sep 17 14:10:00.532195 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.532157 2558 generic.go:356] "Generic (PLEG): container finished" podID="e0417d03-deb9-4a36-928d-604c37111cdf" containerID="b6f092d5475b8a488ad46181730b0f8ec82dc716ac7d71adfb0021a2e352f2ef" exitCode=0 Sep 17 14:10:00.532195 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.532162 2558 generic.go:356] "Generic (PLEG): container finished" podID="e0417d03-deb9-4a36-928d-604c37111cdf" containerID="27a24bee905634b2ecf773a085cfc6e794494518196b4975161cd59bf06a46f8" exitCode=0 Sep 17 14:10:00.532195 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.532167 2558 generic.go:356] "Generic (PLEG): container finished" podID="e0417d03-deb9-4a36-928d-604c37111cdf" containerID="d8df93f37813c872543a609e522a728635415cb9bcb4dcf7250c0dfe2d6134dc" exitCode=0 Sep 17 14:10:00.532874 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.532195 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e0417d03-deb9-4a36-928d-604c37111cdf","Type":"ContainerDied","Data":"f4dc837fa14d92900b567667e783175f704de86246420816c637e27430ed7be4"} Sep 17 14:10:00.532874 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.532209 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:10:00.532874 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.532260 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e0417d03-deb9-4a36-928d-604c37111cdf","Type":"ContainerDied","Data":"e99a166e2ff703e5ef3b8577a255bdd170c34b6738f5a78d4e1abc12e6d71376"} Sep 17 14:10:00.532874 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.532287 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e0417d03-deb9-4a36-928d-604c37111cdf","Type":"ContainerDied","Data":"752b569a14161cbf36f59fc015452fb1db1e291ba2ea23a5109d3fd0f8286232"} Sep 17 14:10:00.532874 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.532314 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e0417d03-deb9-4a36-928d-604c37111cdf","Type":"ContainerDied","Data":"b6f092d5475b8a488ad46181730b0f8ec82dc716ac7d71adfb0021a2e352f2ef"} Sep 17 14:10:00.532874 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.532326 2558 scope.go:117] "RemoveContainer" containerID="f4dc837fa14d92900b567667e783175f704de86246420816c637e27430ed7be4" Sep 17 14:10:00.532874 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.532354 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e0417d03-deb9-4a36-928d-604c37111cdf","Type":"ContainerDied","Data":"27a24bee905634b2ecf773a085cfc6e794494518196b4975161cd59bf06a46f8"} Sep 17 14:10:00.532874 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.532394 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e0417d03-deb9-4a36-928d-604c37111cdf","Type":"ContainerDied","Data":"d8df93f37813c872543a609e522a728635415cb9bcb4dcf7250c0dfe2d6134dc"} Sep 17 14:10:00.532874 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.532431 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e0417d03-deb9-4a36-928d-604c37111cdf","Type":"ContainerDied","Data":"5044b80352733cf587b9bb9e1263780217a5d230ec28b72f8c54b4f2fc50546f"} Sep 17 14:10:00.540578 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.540555 2558 scope.go:117] "RemoveContainer" containerID="e99a166e2ff703e5ef3b8577a255bdd170c34b6738f5a78d4e1abc12e6d71376" Sep 17 14:10:00.547013 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.546999 2558 scope.go:117] "RemoveContainer" containerID="752b569a14161cbf36f59fc015452fb1db1e291ba2ea23a5109d3fd0f8286232" Sep 17 14:10:00.553273 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.553255 2558 scope.go:117] "RemoveContainer" containerID="b6f092d5475b8a488ad46181730b0f8ec82dc716ac7d71adfb0021a2e352f2ef" Sep 17 14:10:00.559863 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.559847 2558 scope.go:117] "RemoveContainer" containerID="27a24bee905634b2ecf773a085cfc6e794494518196b4975161cd59bf06a46f8" Sep 17 14:10:00.562126 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.562107 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 17 14:10:00.566719 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.566706 2558 scope.go:117] "RemoveContainer" containerID="d8df93f37813c872543a609e522a728635415cb9bcb4dcf7250c0dfe2d6134dc" Sep 17 14:10:00.573542 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.573529 2558 scope.go:117] "RemoveContainer" containerID="0aaaba82584e0578c4dd3e427f644be32d28a4ed608434eefb122a511ac2b3d6" Sep 17 14:10:00.579016 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.578995 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 17 14:10:00.580807 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.580792 2558 scope.go:117] "RemoveContainer" containerID="f4dc837fa14d92900b567667e783175f704de86246420816c637e27430ed7be4" Sep 17 14:10:00.581080 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:10:00.581062 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f4dc837fa14d92900b567667e783175f704de86246420816c637e27430ed7be4\": container with ID starting with f4dc837fa14d92900b567667e783175f704de86246420816c637e27430ed7be4 not found: ID does not exist" containerID="f4dc837fa14d92900b567667e783175f704de86246420816c637e27430ed7be4" Sep 17 14:10:00.581126 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.581086 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f4dc837fa14d92900b567667e783175f704de86246420816c637e27430ed7be4"} err="failed to get container status \"f4dc837fa14d92900b567667e783175f704de86246420816c637e27430ed7be4\": rpc error: code = NotFound desc = could not find container \"f4dc837fa14d92900b567667e783175f704de86246420816c637e27430ed7be4\": container with ID starting with f4dc837fa14d92900b567667e783175f704de86246420816c637e27430ed7be4 not found: ID does not exist" Sep 17 14:10:00.581126 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.581102 2558 scope.go:117] "RemoveContainer" containerID="e99a166e2ff703e5ef3b8577a255bdd170c34b6738f5a78d4e1abc12e6d71376" Sep 17 14:10:00.581340 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:10:00.581324 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e99a166e2ff703e5ef3b8577a255bdd170c34b6738f5a78d4e1abc12e6d71376\": container with ID starting with e99a166e2ff703e5ef3b8577a255bdd170c34b6738f5a78d4e1abc12e6d71376 not found: ID does not exist" containerID="e99a166e2ff703e5ef3b8577a255bdd170c34b6738f5a78d4e1abc12e6d71376" Sep 17 14:10:00.581397 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.581349 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e99a166e2ff703e5ef3b8577a255bdd170c34b6738f5a78d4e1abc12e6d71376"} err="failed to get container status \"e99a166e2ff703e5ef3b8577a255bdd170c34b6738f5a78d4e1abc12e6d71376\": rpc error: code = NotFound desc = could not find container \"e99a166e2ff703e5ef3b8577a255bdd170c34b6738f5a78d4e1abc12e6d71376\": container with ID starting with e99a166e2ff703e5ef3b8577a255bdd170c34b6738f5a78d4e1abc12e6d71376 not found: ID does not exist" Sep 17 14:10:00.581397 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.581371 2558 scope.go:117] "RemoveContainer" containerID="752b569a14161cbf36f59fc015452fb1db1e291ba2ea23a5109d3fd0f8286232" Sep 17 14:10:00.581664 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:10:00.581647 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"752b569a14161cbf36f59fc015452fb1db1e291ba2ea23a5109d3fd0f8286232\": container with ID starting with 752b569a14161cbf36f59fc015452fb1db1e291ba2ea23a5109d3fd0f8286232 not found: ID does not exist" containerID="752b569a14161cbf36f59fc015452fb1db1e291ba2ea23a5109d3fd0f8286232" Sep 17 14:10:00.581708 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.581670 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"752b569a14161cbf36f59fc015452fb1db1e291ba2ea23a5109d3fd0f8286232"} err="failed to get container status \"752b569a14161cbf36f59fc015452fb1db1e291ba2ea23a5109d3fd0f8286232\": rpc error: code = NotFound desc = could not find container \"752b569a14161cbf36f59fc015452fb1db1e291ba2ea23a5109d3fd0f8286232\": container with ID starting with 752b569a14161cbf36f59fc015452fb1db1e291ba2ea23a5109d3fd0f8286232 not found: ID does not exist" Sep 17 14:10:00.581708 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.581685 2558 scope.go:117] "RemoveContainer" containerID="b6f092d5475b8a488ad46181730b0f8ec82dc716ac7d71adfb0021a2e352f2ef" Sep 17 14:10:00.581909 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:10:00.581891 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b6f092d5475b8a488ad46181730b0f8ec82dc716ac7d71adfb0021a2e352f2ef\": container with ID starting with b6f092d5475b8a488ad46181730b0f8ec82dc716ac7d71adfb0021a2e352f2ef not found: ID does not exist" containerID="b6f092d5475b8a488ad46181730b0f8ec82dc716ac7d71adfb0021a2e352f2ef" Sep 17 14:10:00.581952 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.581918 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6f092d5475b8a488ad46181730b0f8ec82dc716ac7d71adfb0021a2e352f2ef"} err="failed to get container status \"b6f092d5475b8a488ad46181730b0f8ec82dc716ac7d71adfb0021a2e352f2ef\": rpc error: code = NotFound desc = could not find container \"b6f092d5475b8a488ad46181730b0f8ec82dc716ac7d71adfb0021a2e352f2ef\": container with ID starting with b6f092d5475b8a488ad46181730b0f8ec82dc716ac7d71adfb0021a2e352f2ef not found: ID does not exist" Sep 17 14:10:00.581952 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.581934 2558 scope.go:117] "RemoveContainer" containerID="27a24bee905634b2ecf773a085cfc6e794494518196b4975161cd59bf06a46f8" Sep 17 14:10:00.582154 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:10:00.582139 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"27a24bee905634b2ecf773a085cfc6e794494518196b4975161cd59bf06a46f8\": container with ID starting with 27a24bee905634b2ecf773a085cfc6e794494518196b4975161cd59bf06a46f8 not found: ID does not exist" containerID="27a24bee905634b2ecf773a085cfc6e794494518196b4975161cd59bf06a46f8" Sep 17 14:10:00.582214 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.582163 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"27a24bee905634b2ecf773a085cfc6e794494518196b4975161cd59bf06a46f8"} err="failed to get container status \"27a24bee905634b2ecf773a085cfc6e794494518196b4975161cd59bf06a46f8\": rpc error: code = NotFound desc = could not find container \"27a24bee905634b2ecf773a085cfc6e794494518196b4975161cd59bf06a46f8\": container with ID starting with 27a24bee905634b2ecf773a085cfc6e794494518196b4975161cd59bf06a46f8 not found: ID does not exist" Sep 17 14:10:00.582214 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.582182 2558 scope.go:117] "RemoveContainer" containerID="d8df93f37813c872543a609e522a728635415cb9bcb4dcf7250c0dfe2d6134dc" Sep 17 14:10:00.582400 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:10:00.582385 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d8df93f37813c872543a609e522a728635415cb9bcb4dcf7250c0dfe2d6134dc\": container with ID starting with d8df93f37813c872543a609e522a728635415cb9bcb4dcf7250c0dfe2d6134dc not found: ID does not exist" containerID="d8df93f37813c872543a609e522a728635415cb9bcb4dcf7250c0dfe2d6134dc" Sep 17 14:10:00.582441 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.582403 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d8df93f37813c872543a609e522a728635415cb9bcb4dcf7250c0dfe2d6134dc"} err="failed to get container status \"d8df93f37813c872543a609e522a728635415cb9bcb4dcf7250c0dfe2d6134dc\": rpc error: code = NotFound desc = could not find container \"d8df93f37813c872543a609e522a728635415cb9bcb4dcf7250c0dfe2d6134dc\": container with ID starting with d8df93f37813c872543a609e522a728635415cb9bcb4dcf7250c0dfe2d6134dc not found: ID does not exist" Sep 17 14:10:00.582441 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.582416 2558 scope.go:117] "RemoveContainer" containerID="0aaaba82584e0578c4dd3e427f644be32d28a4ed608434eefb122a511ac2b3d6" Sep 17 14:10:00.582675 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:10:00.582656 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0aaaba82584e0578c4dd3e427f644be32d28a4ed608434eefb122a511ac2b3d6\": container with ID starting with 0aaaba82584e0578c4dd3e427f644be32d28a4ed608434eefb122a511ac2b3d6 not found: ID does not exist" containerID="0aaaba82584e0578c4dd3e427f644be32d28a4ed608434eefb122a511ac2b3d6" Sep 17 14:10:00.582732 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.582679 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0aaaba82584e0578c4dd3e427f644be32d28a4ed608434eefb122a511ac2b3d6"} err="failed to get container status \"0aaaba82584e0578c4dd3e427f644be32d28a4ed608434eefb122a511ac2b3d6\": rpc error: code = NotFound desc = could not find container \"0aaaba82584e0578c4dd3e427f644be32d28a4ed608434eefb122a511ac2b3d6\": container with ID starting with 0aaaba82584e0578c4dd3e427f644be32d28a4ed608434eefb122a511ac2b3d6 not found: ID does not exist" Sep 17 14:10:00.582732 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.582694 2558 scope.go:117] "RemoveContainer" containerID="f4dc837fa14d92900b567667e783175f704de86246420816c637e27430ed7be4" Sep 17 14:10:00.582937 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.582920 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f4dc837fa14d92900b567667e783175f704de86246420816c637e27430ed7be4"} err="failed to get container status \"f4dc837fa14d92900b567667e783175f704de86246420816c637e27430ed7be4\": rpc error: code = NotFound desc = could not find container \"f4dc837fa14d92900b567667e783175f704de86246420816c637e27430ed7be4\": container with ID starting with f4dc837fa14d92900b567667e783175f704de86246420816c637e27430ed7be4 not found: ID does not exist" Sep 17 14:10:00.582977 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.582937 2558 scope.go:117] "RemoveContainer" containerID="e99a166e2ff703e5ef3b8577a255bdd170c34b6738f5a78d4e1abc12e6d71376" Sep 17 14:10:00.583156 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.583139 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e99a166e2ff703e5ef3b8577a255bdd170c34b6738f5a78d4e1abc12e6d71376"} err="failed to get container status \"e99a166e2ff703e5ef3b8577a255bdd170c34b6738f5a78d4e1abc12e6d71376\": rpc error: code = NotFound desc = could not find container \"e99a166e2ff703e5ef3b8577a255bdd170c34b6738f5a78d4e1abc12e6d71376\": container with ID starting with e99a166e2ff703e5ef3b8577a255bdd170c34b6738f5a78d4e1abc12e6d71376 not found: ID does not exist" Sep 17 14:10:00.583200 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.583157 2558 scope.go:117] "RemoveContainer" containerID="752b569a14161cbf36f59fc015452fb1db1e291ba2ea23a5109d3fd0f8286232" Sep 17 14:10:00.583384 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.583369 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"752b569a14161cbf36f59fc015452fb1db1e291ba2ea23a5109d3fd0f8286232"} err="failed to get container status \"752b569a14161cbf36f59fc015452fb1db1e291ba2ea23a5109d3fd0f8286232\": rpc error: code = NotFound desc = could not find container \"752b569a14161cbf36f59fc015452fb1db1e291ba2ea23a5109d3fd0f8286232\": container with ID starting with 752b569a14161cbf36f59fc015452fb1db1e291ba2ea23a5109d3fd0f8286232 not found: ID does not exist" Sep 17 14:10:00.583428 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.583384 2558 scope.go:117] "RemoveContainer" containerID="b6f092d5475b8a488ad46181730b0f8ec82dc716ac7d71adfb0021a2e352f2ef" Sep 17 14:10:00.583603 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.583589 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6f092d5475b8a488ad46181730b0f8ec82dc716ac7d71adfb0021a2e352f2ef"} err="failed to get container status \"b6f092d5475b8a488ad46181730b0f8ec82dc716ac7d71adfb0021a2e352f2ef\": rpc error: code = NotFound desc = could not find container \"b6f092d5475b8a488ad46181730b0f8ec82dc716ac7d71adfb0021a2e352f2ef\": container with ID starting with b6f092d5475b8a488ad46181730b0f8ec82dc716ac7d71adfb0021a2e352f2ef not found: ID does not exist" Sep 17 14:10:00.583603 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.583603 2558 scope.go:117] "RemoveContainer" containerID="27a24bee905634b2ecf773a085cfc6e794494518196b4975161cd59bf06a46f8" Sep 17 14:10:00.583833 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.583816 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"27a24bee905634b2ecf773a085cfc6e794494518196b4975161cd59bf06a46f8"} err="failed to get container status \"27a24bee905634b2ecf773a085cfc6e794494518196b4975161cd59bf06a46f8\": rpc error: code = NotFound desc = could not find container \"27a24bee905634b2ecf773a085cfc6e794494518196b4975161cd59bf06a46f8\": container with ID starting with 27a24bee905634b2ecf773a085cfc6e794494518196b4975161cd59bf06a46f8 not found: ID does not exist" Sep 17 14:10:00.583833 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.583833 2558 scope.go:117] "RemoveContainer" containerID="d8df93f37813c872543a609e522a728635415cb9bcb4dcf7250c0dfe2d6134dc" Sep 17 14:10:00.584059 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.584040 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d8df93f37813c872543a609e522a728635415cb9bcb4dcf7250c0dfe2d6134dc"} err="failed to get container status \"d8df93f37813c872543a609e522a728635415cb9bcb4dcf7250c0dfe2d6134dc\": rpc error: code = NotFound desc = could not find container \"d8df93f37813c872543a609e522a728635415cb9bcb4dcf7250c0dfe2d6134dc\": container with ID starting with d8df93f37813c872543a609e522a728635415cb9bcb4dcf7250c0dfe2d6134dc not found: ID does not exist" Sep 17 14:10:00.584111 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.584061 2558 scope.go:117] "RemoveContainer" containerID="0aaaba82584e0578c4dd3e427f644be32d28a4ed608434eefb122a511ac2b3d6" Sep 17 14:10:00.584282 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.584266 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0aaaba82584e0578c4dd3e427f644be32d28a4ed608434eefb122a511ac2b3d6"} err="failed to get container status \"0aaaba82584e0578c4dd3e427f644be32d28a4ed608434eefb122a511ac2b3d6\": rpc error: code = NotFound desc = could not find container \"0aaaba82584e0578c4dd3e427f644be32d28a4ed608434eefb122a511ac2b3d6\": container with ID starting with 0aaaba82584e0578c4dd3e427f644be32d28a4ed608434eefb122a511ac2b3d6 not found: ID does not exist" Sep 17 14:10:00.584328 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.584282 2558 scope.go:117] "RemoveContainer" containerID="f4dc837fa14d92900b567667e783175f704de86246420816c637e27430ed7be4" Sep 17 14:10:00.584480 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.584464 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f4dc837fa14d92900b567667e783175f704de86246420816c637e27430ed7be4"} err="failed to get container status \"f4dc837fa14d92900b567667e783175f704de86246420816c637e27430ed7be4\": rpc error: code = NotFound desc = could not find container \"f4dc837fa14d92900b567667e783175f704de86246420816c637e27430ed7be4\": container with ID starting with f4dc837fa14d92900b567667e783175f704de86246420816c637e27430ed7be4 not found: ID does not exist" Sep 17 14:10:00.584574 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.584480 2558 scope.go:117] "RemoveContainer" containerID="e99a166e2ff703e5ef3b8577a255bdd170c34b6738f5a78d4e1abc12e6d71376" Sep 17 14:10:00.584698 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.584681 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e99a166e2ff703e5ef3b8577a255bdd170c34b6738f5a78d4e1abc12e6d71376"} err="failed to get container status \"e99a166e2ff703e5ef3b8577a255bdd170c34b6738f5a78d4e1abc12e6d71376\": rpc error: code = NotFound desc = could not find container \"e99a166e2ff703e5ef3b8577a255bdd170c34b6738f5a78d4e1abc12e6d71376\": container with ID starting with e99a166e2ff703e5ef3b8577a255bdd170c34b6738f5a78d4e1abc12e6d71376 not found: ID does not exist" Sep 17 14:10:00.584734 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.584699 2558 scope.go:117] "RemoveContainer" containerID="752b569a14161cbf36f59fc015452fb1db1e291ba2ea23a5109d3fd0f8286232" Sep 17 14:10:00.584902 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.584881 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"752b569a14161cbf36f59fc015452fb1db1e291ba2ea23a5109d3fd0f8286232"} err="failed to get container status \"752b569a14161cbf36f59fc015452fb1db1e291ba2ea23a5109d3fd0f8286232\": rpc error: code = NotFound desc = could not find container \"752b569a14161cbf36f59fc015452fb1db1e291ba2ea23a5109d3fd0f8286232\": container with ID starting with 752b569a14161cbf36f59fc015452fb1db1e291ba2ea23a5109d3fd0f8286232 not found: ID does not exist" Sep 17 14:10:00.584941 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.584903 2558 scope.go:117] "RemoveContainer" containerID="b6f092d5475b8a488ad46181730b0f8ec82dc716ac7d71adfb0021a2e352f2ef" Sep 17 14:10:00.585103 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.585084 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6f092d5475b8a488ad46181730b0f8ec82dc716ac7d71adfb0021a2e352f2ef"} err="failed to get container status \"b6f092d5475b8a488ad46181730b0f8ec82dc716ac7d71adfb0021a2e352f2ef\": rpc error: code = NotFound desc = could not find container \"b6f092d5475b8a488ad46181730b0f8ec82dc716ac7d71adfb0021a2e352f2ef\": container with ID starting with b6f092d5475b8a488ad46181730b0f8ec82dc716ac7d71adfb0021a2e352f2ef not found: ID does not exist" Sep 17 14:10:00.585146 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.585104 2558 scope.go:117] "RemoveContainer" containerID="27a24bee905634b2ecf773a085cfc6e794494518196b4975161cd59bf06a46f8" Sep 17 14:10:00.585282 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.585267 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"27a24bee905634b2ecf773a085cfc6e794494518196b4975161cd59bf06a46f8"} err="failed to get container status \"27a24bee905634b2ecf773a085cfc6e794494518196b4975161cd59bf06a46f8\": rpc error: code = NotFound desc = could not find container \"27a24bee905634b2ecf773a085cfc6e794494518196b4975161cd59bf06a46f8\": container with ID starting with 27a24bee905634b2ecf773a085cfc6e794494518196b4975161cd59bf06a46f8 not found: ID does not exist" Sep 17 14:10:00.585319 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.585281 2558 scope.go:117] "RemoveContainer" containerID="d8df93f37813c872543a609e522a728635415cb9bcb4dcf7250c0dfe2d6134dc" Sep 17 14:10:00.585458 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.585443 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d8df93f37813c872543a609e522a728635415cb9bcb4dcf7250c0dfe2d6134dc"} err="failed to get container status \"d8df93f37813c872543a609e522a728635415cb9bcb4dcf7250c0dfe2d6134dc\": rpc error: code = NotFound desc = could not find container \"d8df93f37813c872543a609e522a728635415cb9bcb4dcf7250c0dfe2d6134dc\": container with ID starting with d8df93f37813c872543a609e522a728635415cb9bcb4dcf7250c0dfe2d6134dc not found: ID does not exist" Sep 17 14:10:00.585520 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.585458 2558 scope.go:117] "RemoveContainer" containerID="0aaaba82584e0578c4dd3e427f644be32d28a4ed608434eefb122a511ac2b3d6" Sep 17 14:10:00.585706 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.585684 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0aaaba82584e0578c4dd3e427f644be32d28a4ed608434eefb122a511ac2b3d6"} err="failed to get container status \"0aaaba82584e0578c4dd3e427f644be32d28a4ed608434eefb122a511ac2b3d6\": rpc error: code = NotFound desc = could not find container \"0aaaba82584e0578c4dd3e427f644be32d28a4ed608434eefb122a511ac2b3d6\": container with ID starting with 0aaaba82584e0578c4dd3e427f644be32d28a4ed608434eefb122a511ac2b3d6 not found: ID does not exist" Sep 17 14:10:00.585750 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.585707 2558 scope.go:117] "RemoveContainer" containerID="f4dc837fa14d92900b567667e783175f704de86246420816c637e27430ed7be4" Sep 17 14:10:00.585934 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.585920 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f4dc837fa14d92900b567667e783175f704de86246420816c637e27430ed7be4"} err="failed to get container status \"f4dc837fa14d92900b567667e783175f704de86246420816c637e27430ed7be4\": rpc error: code = NotFound desc = could not find container \"f4dc837fa14d92900b567667e783175f704de86246420816c637e27430ed7be4\": container with ID starting with f4dc837fa14d92900b567667e783175f704de86246420816c637e27430ed7be4 not found: ID does not exist" Sep 17 14:10:00.585978 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.585935 2558 scope.go:117] "RemoveContainer" containerID="e99a166e2ff703e5ef3b8577a255bdd170c34b6738f5a78d4e1abc12e6d71376" Sep 17 14:10:00.586145 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.586118 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e99a166e2ff703e5ef3b8577a255bdd170c34b6738f5a78d4e1abc12e6d71376"} err="failed to get container status \"e99a166e2ff703e5ef3b8577a255bdd170c34b6738f5a78d4e1abc12e6d71376\": rpc error: code = NotFound desc = could not find container \"e99a166e2ff703e5ef3b8577a255bdd170c34b6738f5a78d4e1abc12e6d71376\": container with ID starting with e99a166e2ff703e5ef3b8577a255bdd170c34b6738f5a78d4e1abc12e6d71376 not found: ID does not exist" Sep 17 14:10:00.586145 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.586143 2558 scope.go:117] "RemoveContainer" containerID="752b569a14161cbf36f59fc015452fb1db1e291ba2ea23a5109d3fd0f8286232" Sep 17 14:10:00.586343 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.586327 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"752b569a14161cbf36f59fc015452fb1db1e291ba2ea23a5109d3fd0f8286232"} err="failed to get container status \"752b569a14161cbf36f59fc015452fb1db1e291ba2ea23a5109d3fd0f8286232\": rpc error: code = NotFound desc = could not find container \"752b569a14161cbf36f59fc015452fb1db1e291ba2ea23a5109d3fd0f8286232\": container with ID starting with 752b569a14161cbf36f59fc015452fb1db1e291ba2ea23a5109d3fd0f8286232 not found: ID does not exist" Sep 17 14:10:00.586343 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.586342 2558 scope.go:117] "RemoveContainer" containerID="b6f092d5475b8a488ad46181730b0f8ec82dc716ac7d71adfb0021a2e352f2ef" Sep 17 14:10:00.586612 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.586590 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6f092d5475b8a488ad46181730b0f8ec82dc716ac7d71adfb0021a2e352f2ef"} err="failed to get container status \"b6f092d5475b8a488ad46181730b0f8ec82dc716ac7d71adfb0021a2e352f2ef\": rpc error: code = NotFound desc = could not find container \"b6f092d5475b8a488ad46181730b0f8ec82dc716ac7d71adfb0021a2e352f2ef\": container with ID starting with b6f092d5475b8a488ad46181730b0f8ec82dc716ac7d71adfb0021a2e352f2ef not found: ID does not exist" Sep 17 14:10:00.586681 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.586613 2558 scope.go:117] "RemoveContainer" containerID="27a24bee905634b2ecf773a085cfc6e794494518196b4975161cd59bf06a46f8" Sep 17 14:10:00.586855 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.586835 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"27a24bee905634b2ecf773a085cfc6e794494518196b4975161cd59bf06a46f8"} err="failed to get container status \"27a24bee905634b2ecf773a085cfc6e794494518196b4975161cd59bf06a46f8\": rpc error: code = NotFound desc = could not find container \"27a24bee905634b2ecf773a085cfc6e794494518196b4975161cd59bf06a46f8\": container with ID starting with 27a24bee905634b2ecf773a085cfc6e794494518196b4975161cd59bf06a46f8 not found: ID does not exist" Sep 17 14:10:00.586899 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.586855 2558 scope.go:117] "RemoveContainer" containerID="d8df93f37813c872543a609e522a728635415cb9bcb4dcf7250c0dfe2d6134dc" Sep 17 14:10:00.587083 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.587066 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d8df93f37813c872543a609e522a728635415cb9bcb4dcf7250c0dfe2d6134dc"} err="failed to get container status \"d8df93f37813c872543a609e522a728635415cb9bcb4dcf7250c0dfe2d6134dc\": rpc error: code = NotFound desc = could not find container \"d8df93f37813c872543a609e522a728635415cb9bcb4dcf7250c0dfe2d6134dc\": container with ID starting with d8df93f37813c872543a609e522a728635415cb9bcb4dcf7250c0dfe2d6134dc not found: ID does not exist" Sep 17 14:10:00.587159 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.587085 2558 scope.go:117] "RemoveContainer" containerID="0aaaba82584e0578c4dd3e427f644be32d28a4ed608434eefb122a511ac2b3d6" Sep 17 14:10:00.587338 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.587321 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0aaaba82584e0578c4dd3e427f644be32d28a4ed608434eefb122a511ac2b3d6"} err="failed to get container status \"0aaaba82584e0578c4dd3e427f644be32d28a4ed608434eefb122a511ac2b3d6\": rpc error: code = NotFound desc = could not find container \"0aaaba82584e0578c4dd3e427f644be32d28a4ed608434eefb122a511ac2b3d6\": container with ID starting with 0aaaba82584e0578c4dd3e427f644be32d28a4ed608434eefb122a511ac2b3d6 not found: ID does not exist" Sep 17 14:10:00.587386 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.587338 2558 scope.go:117] "RemoveContainer" containerID="f4dc837fa14d92900b567667e783175f704de86246420816c637e27430ed7be4" Sep 17 14:10:00.587556 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.587541 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f4dc837fa14d92900b567667e783175f704de86246420816c637e27430ed7be4"} err="failed to get container status \"f4dc837fa14d92900b567667e783175f704de86246420816c637e27430ed7be4\": rpc error: code = NotFound desc = could not find container \"f4dc837fa14d92900b567667e783175f704de86246420816c637e27430ed7be4\": container with ID starting with f4dc837fa14d92900b567667e783175f704de86246420816c637e27430ed7be4 not found: ID does not exist" Sep 17 14:10:00.587608 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.587556 2558 scope.go:117] "RemoveContainer" containerID="e99a166e2ff703e5ef3b8577a255bdd170c34b6738f5a78d4e1abc12e6d71376" Sep 17 14:10:00.587781 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.587766 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e99a166e2ff703e5ef3b8577a255bdd170c34b6738f5a78d4e1abc12e6d71376"} err="failed to get container status \"e99a166e2ff703e5ef3b8577a255bdd170c34b6738f5a78d4e1abc12e6d71376\": rpc error: code = NotFound desc = could not find container \"e99a166e2ff703e5ef3b8577a255bdd170c34b6738f5a78d4e1abc12e6d71376\": container with ID starting with e99a166e2ff703e5ef3b8577a255bdd170c34b6738f5a78d4e1abc12e6d71376 not found: ID does not exist" Sep 17 14:10:00.587781 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.587780 2558 scope.go:117] "RemoveContainer" containerID="752b569a14161cbf36f59fc015452fb1db1e291ba2ea23a5109d3fd0f8286232" Sep 17 14:10:00.587981 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.587964 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"752b569a14161cbf36f59fc015452fb1db1e291ba2ea23a5109d3fd0f8286232"} err="failed to get container status \"752b569a14161cbf36f59fc015452fb1db1e291ba2ea23a5109d3fd0f8286232\": rpc error: code = NotFound desc = could not find container \"752b569a14161cbf36f59fc015452fb1db1e291ba2ea23a5109d3fd0f8286232\": container with ID starting with 752b569a14161cbf36f59fc015452fb1db1e291ba2ea23a5109d3fd0f8286232 not found: ID does not exist" Sep 17 14:10:00.588031 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.587982 2558 scope.go:117] "RemoveContainer" containerID="b6f092d5475b8a488ad46181730b0f8ec82dc716ac7d71adfb0021a2e352f2ef" Sep 17 14:10:00.588207 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.588189 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6f092d5475b8a488ad46181730b0f8ec82dc716ac7d71adfb0021a2e352f2ef"} err="failed to get container status \"b6f092d5475b8a488ad46181730b0f8ec82dc716ac7d71adfb0021a2e352f2ef\": rpc error: code = NotFound desc = could not find container \"b6f092d5475b8a488ad46181730b0f8ec82dc716ac7d71adfb0021a2e352f2ef\": container with ID starting with b6f092d5475b8a488ad46181730b0f8ec82dc716ac7d71adfb0021a2e352f2ef not found: ID does not exist" Sep 17 14:10:00.588278 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.588210 2558 scope.go:117] "RemoveContainer" containerID="27a24bee905634b2ecf773a085cfc6e794494518196b4975161cd59bf06a46f8" Sep 17 14:10:00.588478 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.588461 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"27a24bee905634b2ecf773a085cfc6e794494518196b4975161cd59bf06a46f8"} err="failed to get container status \"27a24bee905634b2ecf773a085cfc6e794494518196b4975161cd59bf06a46f8\": rpc error: code = NotFound desc = could not find container \"27a24bee905634b2ecf773a085cfc6e794494518196b4975161cd59bf06a46f8\": container with ID starting with 27a24bee905634b2ecf773a085cfc6e794494518196b4975161cd59bf06a46f8 not found: ID does not exist" Sep 17 14:10:00.588552 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.588479 2558 scope.go:117] "RemoveContainer" containerID="d8df93f37813c872543a609e522a728635415cb9bcb4dcf7250c0dfe2d6134dc" Sep 17 14:10:00.588711 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.588694 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d8df93f37813c872543a609e522a728635415cb9bcb4dcf7250c0dfe2d6134dc"} err="failed to get container status \"d8df93f37813c872543a609e522a728635415cb9bcb4dcf7250c0dfe2d6134dc\": rpc error: code = NotFound desc = could not find container \"d8df93f37813c872543a609e522a728635415cb9bcb4dcf7250c0dfe2d6134dc\": container with ID starting with d8df93f37813c872543a609e522a728635415cb9bcb4dcf7250c0dfe2d6134dc not found: ID does not exist" Sep 17 14:10:00.588753 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.588711 2558 scope.go:117] "RemoveContainer" containerID="0aaaba82584e0578c4dd3e427f644be32d28a4ed608434eefb122a511ac2b3d6" Sep 17 14:10:00.588904 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.588883 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0aaaba82584e0578c4dd3e427f644be32d28a4ed608434eefb122a511ac2b3d6"} err="failed to get container status \"0aaaba82584e0578c4dd3e427f644be32d28a4ed608434eefb122a511ac2b3d6\": rpc error: code = NotFound desc = could not find container \"0aaaba82584e0578c4dd3e427f644be32d28a4ed608434eefb122a511ac2b3d6\": container with ID starting with 0aaaba82584e0578c4dd3e427f644be32d28a4ed608434eefb122a511ac2b3d6 not found: ID does not exist" Sep 17 14:10:00.588955 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.588904 2558 scope.go:117] "RemoveContainer" containerID="f4dc837fa14d92900b567667e783175f704de86246420816c637e27430ed7be4" Sep 17 14:10:00.589104 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.589087 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f4dc837fa14d92900b567667e783175f704de86246420816c637e27430ed7be4"} err="failed to get container status \"f4dc837fa14d92900b567667e783175f704de86246420816c637e27430ed7be4\": rpc error: code = NotFound desc = could not find container \"f4dc837fa14d92900b567667e783175f704de86246420816c637e27430ed7be4\": container with ID starting with f4dc837fa14d92900b567667e783175f704de86246420816c637e27430ed7be4 not found: ID does not exist" Sep 17 14:10:00.589145 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.589104 2558 scope.go:117] "RemoveContainer" containerID="e99a166e2ff703e5ef3b8577a255bdd170c34b6738f5a78d4e1abc12e6d71376" Sep 17 14:10:00.589290 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.589276 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e99a166e2ff703e5ef3b8577a255bdd170c34b6738f5a78d4e1abc12e6d71376"} err="failed to get container status \"e99a166e2ff703e5ef3b8577a255bdd170c34b6738f5a78d4e1abc12e6d71376\": rpc error: code = NotFound desc = could not find container \"e99a166e2ff703e5ef3b8577a255bdd170c34b6738f5a78d4e1abc12e6d71376\": container with ID starting with e99a166e2ff703e5ef3b8577a255bdd170c34b6738f5a78d4e1abc12e6d71376 not found: ID does not exist" Sep 17 14:10:00.589332 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.589291 2558 scope.go:117] "RemoveContainer" containerID="752b569a14161cbf36f59fc015452fb1db1e291ba2ea23a5109d3fd0f8286232" Sep 17 14:10:00.589467 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.589453 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"752b569a14161cbf36f59fc015452fb1db1e291ba2ea23a5109d3fd0f8286232"} err="failed to get container status \"752b569a14161cbf36f59fc015452fb1db1e291ba2ea23a5109d3fd0f8286232\": rpc error: code = NotFound desc = could not find container \"752b569a14161cbf36f59fc015452fb1db1e291ba2ea23a5109d3fd0f8286232\": container with ID starting with 752b569a14161cbf36f59fc015452fb1db1e291ba2ea23a5109d3fd0f8286232 not found: ID does not exist" Sep 17 14:10:00.589526 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.589468 2558 scope.go:117] "RemoveContainer" containerID="b6f092d5475b8a488ad46181730b0f8ec82dc716ac7d71adfb0021a2e352f2ef" Sep 17 14:10:00.589732 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.589716 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6f092d5475b8a488ad46181730b0f8ec82dc716ac7d71adfb0021a2e352f2ef"} err="failed to get container status \"b6f092d5475b8a488ad46181730b0f8ec82dc716ac7d71adfb0021a2e352f2ef\": rpc error: code = NotFound desc = could not find container \"b6f092d5475b8a488ad46181730b0f8ec82dc716ac7d71adfb0021a2e352f2ef\": container with ID starting with b6f092d5475b8a488ad46181730b0f8ec82dc716ac7d71adfb0021a2e352f2ef not found: ID does not exist" Sep 17 14:10:00.589799 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.589735 2558 scope.go:117] "RemoveContainer" containerID="27a24bee905634b2ecf773a085cfc6e794494518196b4975161cd59bf06a46f8" Sep 17 14:10:00.589967 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.589953 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"27a24bee905634b2ecf773a085cfc6e794494518196b4975161cd59bf06a46f8"} err="failed to get container status \"27a24bee905634b2ecf773a085cfc6e794494518196b4975161cd59bf06a46f8\": rpc error: code = NotFound desc = could not find container \"27a24bee905634b2ecf773a085cfc6e794494518196b4975161cd59bf06a46f8\": container with ID starting with 27a24bee905634b2ecf773a085cfc6e794494518196b4975161cd59bf06a46f8 not found: ID does not exist" Sep 17 14:10:00.590009 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.589967 2558 scope.go:117] "RemoveContainer" containerID="d8df93f37813c872543a609e522a728635415cb9bcb4dcf7250c0dfe2d6134dc" Sep 17 14:10:00.590194 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.590175 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d8df93f37813c872543a609e522a728635415cb9bcb4dcf7250c0dfe2d6134dc"} err="failed to get container status \"d8df93f37813c872543a609e522a728635415cb9bcb4dcf7250c0dfe2d6134dc\": rpc error: code = NotFound desc = could not find container \"d8df93f37813c872543a609e522a728635415cb9bcb4dcf7250c0dfe2d6134dc\": container with ID starting with d8df93f37813c872543a609e522a728635415cb9bcb4dcf7250c0dfe2d6134dc not found: ID does not exist" Sep 17 14:10:00.590275 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.590194 2558 scope.go:117] "RemoveContainer" containerID="0aaaba82584e0578c4dd3e427f644be32d28a4ed608434eefb122a511ac2b3d6" Sep 17 14:10:00.590410 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.590395 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0aaaba82584e0578c4dd3e427f644be32d28a4ed608434eefb122a511ac2b3d6"} err="failed to get container status \"0aaaba82584e0578c4dd3e427f644be32d28a4ed608434eefb122a511ac2b3d6\": rpc error: code = NotFound desc = could not find container \"0aaaba82584e0578c4dd3e427f644be32d28a4ed608434eefb122a511ac2b3d6\": container with ID starting with 0aaaba82584e0578c4dd3e427f644be32d28a4ed608434eefb122a511ac2b3d6 not found: ID does not exist" Sep 17 14:10:00.614152 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.614127 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 17 14:10:00.614398 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.614387 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="455ca95c-b3b6-4aab-94c1-64f728c758a6" containerName="prom-label-proxy" Sep 17 14:10:00.614434 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.614400 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="455ca95c-b3b6-4aab-94c1-64f728c758a6" containerName="prom-label-proxy" Sep 17 14:10:00.614434 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.614411 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0417d03-deb9-4a36-928d-604c37111cdf" containerName="init-config-reloader" Sep 17 14:10:00.614434 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.614416 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0417d03-deb9-4a36-928d-604c37111cdf" containerName="init-config-reloader" Sep 17 14:10:00.614434 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.614423 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0417d03-deb9-4a36-928d-604c37111cdf" containerName="thanos-sidecar" Sep 17 14:10:00.614434 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.614428 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0417d03-deb9-4a36-928d-604c37111cdf" containerName="thanos-sidecar" Sep 17 14:10:00.614607 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.614436 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eadd0df5-d39a-4715-8128-697c0e1812c7" containerName="console" Sep 17 14:10:00.614607 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.614442 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="eadd0df5-d39a-4715-8128-697c0e1812c7" containerName="console" Sep 17 14:10:00.614607 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.614448 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="455ca95c-b3b6-4aab-94c1-64f728c758a6" containerName="kube-rbac-proxy" Sep 17 14:10:00.614607 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.614453 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="455ca95c-b3b6-4aab-94c1-64f728c758a6" containerName="kube-rbac-proxy" Sep 17 14:10:00.614607 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.614458 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="455ca95c-b3b6-4aab-94c1-64f728c758a6" containerName="kube-rbac-proxy-metric" Sep 17 14:10:00.614607 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.614463 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="455ca95c-b3b6-4aab-94c1-64f728c758a6" containerName="kube-rbac-proxy-metric" Sep 17 14:10:00.614607 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.614470 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="455ca95c-b3b6-4aab-94c1-64f728c758a6" containerName="alertmanager" Sep 17 14:10:00.614607 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.614475 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="455ca95c-b3b6-4aab-94c1-64f728c758a6" containerName="alertmanager" Sep 17 14:10:00.614607 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.614481 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="455ca95c-b3b6-4aab-94c1-64f728c758a6" containerName="kube-rbac-proxy-web" Sep 17 14:10:00.614607 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.614486 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="455ca95c-b3b6-4aab-94c1-64f728c758a6" containerName="kube-rbac-proxy-web" Sep 17 14:10:00.614607 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.614508 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="455ca95c-b3b6-4aab-94c1-64f728c758a6" containerName="init-config-reloader" Sep 17 14:10:00.614607 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.614515 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="455ca95c-b3b6-4aab-94c1-64f728c758a6" containerName="init-config-reloader" Sep 17 14:10:00.614607 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.614534 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0417d03-deb9-4a36-928d-604c37111cdf" containerName="kube-rbac-proxy-web" Sep 17 14:10:00.614607 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.614541 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0417d03-deb9-4a36-928d-604c37111cdf" containerName="kube-rbac-proxy-web" Sep 17 14:10:00.614607 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.614547 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0417d03-deb9-4a36-928d-604c37111cdf" containerName="kube-rbac-proxy-thanos" Sep 17 14:10:00.614607 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.614552 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0417d03-deb9-4a36-928d-604c37111cdf" containerName="kube-rbac-proxy-thanos" Sep 17 14:10:00.614607 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.614559 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="455ca95c-b3b6-4aab-94c1-64f728c758a6" containerName="config-reloader" Sep 17 14:10:00.614607 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.614563 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="455ca95c-b3b6-4aab-94c1-64f728c758a6" containerName="config-reloader" Sep 17 14:10:00.614607 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.614568 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0417d03-deb9-4a36-928d-604c37111cdf" containerName="kube-rbac-proxy" Sep 17 14:10:00.614607 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.614573 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0417d03-deb9-4a36-928d-604c37111cdf" containerName="kube-rbac-proxy" Sep 17 14:10:00.614607 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.614580 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0417d03-deb9-4a36-928d-604c37111cdf" containerName="config-reloader" Sep 17 14:10:00.614607 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.614585 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0417d03-deb9-4a36-928d-604c37111cdf" containerName="config-reloader" Sep 17 14:10:00.614607 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.614590 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0417d03-deb9-4a36-928d-604c37111cdf" containerName="prometheus" Sep 17 14:10:00.614607 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.614597 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0417d03-deb9-4a36-928d-604c37111cdf" containerName="prometheus" Sep 17 14:10:00.615234 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.614643 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="e0417d03-deb9-4a36-928d-604c37111cdf" containerName="kube-rbac-proxy-web" Sep 17 14:10:00.615234 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.614651 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="e0417d03-deb9-4a36-928d-604c37111cdf" containerName="config-reloader" Sep 17 14:10:00.615234 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.614657 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="455ca95c-b3b6-4aab-94c1-64f728c758a6" containerName="prom-label-proxy" Sep 17 14:10:00.615234 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.614662 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="455ca95c-b3b6-4aab-94c1-64f728c758a6" containerName="alertmanager" Sep 17 14:10:00.615234 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.614667 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="e0417d03-deb9-4a36-928d-604c37111cdf" containerName="kube-rbac-proxy-thanos" Sep 17 14:10:00.615234 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.614673 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="e0417d03-deb9-4a36-928d-604c37111cdf" containerName="prometheus" Sep 17 14:10:00.615234 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.614678 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="e0417d03-deb9-4a36-928d-604c37111cdf" containerName="kube-rbac-proxy" Sep 17 14:10:00.615234 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.614683 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="eadd0df5-d39a-4715-8128-697c0e1812c7" containerName="console" Sep 17 14:10:00.615234 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.614687 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="e0417d03-deb9-4a36-928d-604c37111cdf" containerName="thanos-sidecar" Sep 17 14:10:00.615234 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.614693 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="455ca95c-b3b6-4aab-94c1-64f728c758a6" containerName="config-reloader" Sep 17 14:10:00.615234 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.614698 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="455ca95c-b3b6-4aab-94c1-64f728c758a6" containerName="kube-rbac-proxy-web" Sep 17 14:10:00.615234 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.614703 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="455ca95c-b3b6-4aab-94c1-64f728c758a6" containerName="kube-rbac-proxy" Sep 17 14:10:00.615234 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.614709 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="455ca95c-b3b6-4aab-94c1-64f728c758a6" containerName="kube-rbac-proxy-metric" Sep 17 14:10:00.618260 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.618246 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:10:00.622959 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.622941 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Sep 17 14:10:00.623044 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.622956 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Sep 17 14:10:00.623469 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.623452 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-e4a07916lrmdd\"" Sep 17 14:10:00.623690 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.623674 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Sep 17 14:10:00.623919 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.623898 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Sep 17 14:10:00.624165 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.624145 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Sep 17 14:10:00.624266 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.624230 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Sep 17 14:10:00.624592 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.624567 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Sep 17 14:10:00.626433 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.626415 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Sep 17 14:10:00.626534 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.626425 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-kzg4t\"" Sep 17 14:10:00.626534 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.626461 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Sep 17 14:10:00.627646 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.627625 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Sep 17 14:10:00.627712 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.627672 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Sep 17 14:10:00.627812 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.627797 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Sep 17 14:10:00.628079 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.628040 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Sep 17 14:10:00.630518 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.630486 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Sep 17 14:10:00.634838 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.634823 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Sep 17 14:10:00.641991 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.641973 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 17 14:10:00.724636 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.724609 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/cd591012-3144-43d8-8798-18aff1a697c5-config-out\") pod \"prometheus-k8s-0\" (UID: \"cd591012-3144-43d8-8798-18aff1a697c5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:10:00.724787 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.724640 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/cd591012-3144-43d8-8798-18aff1a697c5-web-config\") pod \"prometheus-k8s-0\" (UID: \"cd591012-3144-43d8-8798-18aff1a697c5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:10:00.724787 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.724661 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/cd591012-3144-43d8-8798-18aff1a697c5-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"cd591012-3144-43d8-8798-18aff1a697c5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:10:00.724787 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.724689 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/cd591012-3144-43d8-8798-18aff1a697c5-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"cd591012-3144-43d8-8798-18aff1a697c5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:10:00.724787 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.724714 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/cd591012-3144-43d8-8798-18aff1a697c5-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"cd591012-3144-43d8-8798-18aff1a697c5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:10:00.724787 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.724742 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd591012-3144-43d8-8798-18aff1a697c5-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"cd591012-3144-43d8-8798-18aff1a697c5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:10:00.724787 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.724761 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cd591012-3144-43d8-8798-18aff1a697c5-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"cd591012-3144-43d8-8798-18aff1a697c5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:10:00.724972 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.724811 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cd591012-3144-43d8-8798-18aff1a697c5-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"cd591012-3144-43d8-8798-18aff1a697c5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:10:00.724972 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.724840 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/cd591012-3144-43d8-8798-18aff1a697c5-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"cd591012-3144-43d8-8798-18aff1a697c5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:10:00.724972 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.724861 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/cd591012-3144-43d8-8798-18aff1a697c5-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"cd591012-3144-43d8-8798-18aff1a697c5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:10:00.724972 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.724879 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/cd591012-3144-43d8-8798-18aff1a697c5-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"cd591012-3144-43d8-8798-18aff1a697c5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:10:00.724972 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.724902 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/cd591012-3144-43d8-8798-18aff1a697c5-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"cd591012-3144-43d8-8798-18aff1a697c5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:10:00.724972 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.724956 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd591012-3144-43d8-8798-18aff1a697c5-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"cd591012-3144-43d8-8798-18aff1a697c5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:10:00.725142 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.725000 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/cd591012-3144-43d8-8798-18aff1a697c5-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"cd591012-3144-43d8-8798-18aff1a697c5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:10:00.725142 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.725018 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cd591012-3144-43d8-8798-18aff1a697c5-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"cd591012-3144-43d8-8798-18aff1a697c5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:10:00.725142 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.725033 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/cd591012-3144-43d8-8798-18aff1a697c5-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"cd591012-3144-43d8-8798-18aff1a697c5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:10:00.725142 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.725050 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/cd591012-3144-43d8-8798-18aff1a697c5-config\") pod \"prometheus-k8s-0\" (UID: \"cd591012-3144-43d8-8798-18aff1a697c5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:10:00.725142 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.725070 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd591012-3144-43d8-8798-18aff1a697c5-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"cd591012-3144-43d8-8798-18aff1a697c5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:10:00.725142 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.725085 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/cd591012-3144-43d8-8798-18aff1a697c5-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"cd591012-3144-43d8-8798-18aff1a697c5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:10:00.725142 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.725099 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nx7hk\" (UniqueName: \"kubernetes.io/projected/cd591012-3144-43d8-8798-18aff1a697c5-kube-api-access-nx7hk\") pod \"prometheus-k8s-0\" (UID: \"cd591012-3144-43d8-8798-18aff1a697c5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:10:00.825383 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.825361 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/cd591012-3144-43d8-8798-18aff1a697c5-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"cd591012-3144-43d8-8798-18aff1a697c5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:10:00.825520 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.825392 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/cd591012-3144-43d8-8798-18aff1a697c5-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"cd591012-3144-43d8-8798-18aff1a697c5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:10:00.825520 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.825423 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd591012-3144-43d8-8798-18aff1a697c5-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"cd591012-3144-43d8-8798-18aff1a697c5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:10:00.825520 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.825444 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cd591012-3144-43d8-8798-18aff1a697c5-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"cd591012-3144-43d8-8798-18aff1a697c5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:10:00.825520 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.825467 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cd591012-3144-43d8-8798-18aff1a697c5-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"cd591012-3144-43d8-8798-18aff1a697c5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:10:00.825520 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.825485 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/cd591012-3144-43d8-8798-18aff1a697c5-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"cd591012-3144-43d8-8798-18aff1a697c5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:10:00.825739 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.825527 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/cd591012-3144-43d8-8798-18aff1a697c5-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"cd591012-3144-43d8-8798-18aff1a697c5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:10:00.825739 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.825560 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/cd591012-3144-43d8-8798-18aff1a697c5-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"cd591012-3144-43d8-8798-18aff1a697c5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:10:00.825739 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.825585 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/cd591012-3144-43d8-8798-18aff1a697c5-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"cd591012-3144-43d8-8798-18aff1a697c5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:10:00.825739 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.825616 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd591012-3144-43d8-8798-18aff1a697c5-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"cd591012-3144-43d8-8798-18aff1a697c5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:10:00.825739 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.825646 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/cd591012-3144-43d8-8798-18aff1a697c5-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"cd591012-3144-43d8-8798-18aff1a697c5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:10:00.825739 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.825674 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cd591012-3144-43d8-8798-18aff1a697c5-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"cd591012-3144-43d8-8798-18aff1a697c5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:10:00.825739 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.825691 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/cd591012-3144-43d8-8798-18aff1a697c5-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"cd591012-3144-43d8-8798-18aff1a697c5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:10:00.825739 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.825713 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/cd591012-3144-43d8-8798-18aff1a697c5-config\") pod \"prometheus-k8s-0\" (UID: \"cd591012-3144-43d8-8798-18aff1a697c5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:10:00.825739 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.825733 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd591012-3144-43d8-8798-18aff1a697c5-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"cd591012-3144-43d8-8798-18aff1a697c5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:10:00.826230 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.825753 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/cd591012-3144-43d8-8798-18aff1a697c5-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"cd591012-3144-43d8-8798-18aff1a697c5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:10:00.826230 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.825775 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nx7hk\" (UniqueName: \"kubernetes.io/projected/cd591012-3144-43d8-8798-18aff1a697c5-kube-api-access-nx7hk\") pod \"prometheus-k8s-0\" (UID: \"cd591012-3144-43d8-8798-18aff1a697c5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:10:00.826230 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.825801 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/cd591012-3144-43d8-8798-18aff1a697c5-config-out\") pod \"prometheus-k8s-0\" (UID: \"cd591012-3144-43d8-8798-18aff1a697c5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:10:00.826230 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.825833 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/cd591012-3144-43d8-8798-18aff1a697c5-web-config\") pod \"prometheus-k8s-0\" (UID: \"cd591012-3144-43d8-8798-18aff1a697c5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:10:00.826230 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.825860 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/cd591012-3144-43d8-8798-18aff1a697c5-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"cd591012-3144-43d8-8798-18aff1a697c5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:10:00.826230 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.826222 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd591012-3144-43d8-8798-18aff1a697c5-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"cd591012-3144-43d8-8798-18aff1a697c5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:10:00.826559 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.826407 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/cd591012-3144-43d8-8798-18aff1a697c5-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"cd591012-3144-43d8-8798-18aff1a697c5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:10:00.829069 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.828626 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cd591012-3144-43d8-8798-18aff1a697c5-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"cd591012-3144-43d8-8798-18aff1a697c5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:10:00.829069 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.828742 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/cd591012-3144-43d8-8798-18aff1a697c5-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"cd591012-3144-43d8-8798-18aff1a697c5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:10:00.829069 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.828772 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cd591012-3144-43d8-8798-18aff1a697c5-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"cd591012-3144-43d8-8798-18aff1a697c5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:10:00.829069 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.828932 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/cd591012-3144-43d8-8798-18aff1a697c5-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"cd591012-3144-43d8-8798-18aff1a697c5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:10:00.829069 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.828948 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/cd591012-3144-43d8-8798-18aff1a697c5-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"cd591012-3144-43d8-8798-18aff1a697c5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:10:00.829375 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.829185 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/cd591012-3144-43d8-8798-18aff1a697c5-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"cd591012-3144-43d8-8798-18aff1a697c5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:10:00.829974 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.829522 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/cd591012-3144-43d8-8798-18aff1a697c5-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"cd591012-3144-43d8-8798-18aff1a697c5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:10:00.829974 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.829641 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/cd591012-3144-43d8-8798-18aff1a697c5-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"cd591012-3144-43d8-8798-18aff1a697c5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:10:00.829974 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.829879 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd591012-3144-43d8-8798-18aff1a697c5-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"cd591012-3144-43d8-8798-18aff1a697c5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:10:00.829974 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.829913 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/cd591012-3144-43d8-8798-18aff1a697c5-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"cd591012-3144-43d8-8798-18aff1a697c5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:10:00.829974 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.829914 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd591012-3144-43d8-8798-18aff1a697c5-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"cd591012-3144-43d8-8798-18aff1a697c5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:10:00.830270 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.830126 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cd591012-3144-43d8-8798-18aff1a697c5-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"cd591012-3144-43d8-8798-18aff1a697c5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:10:00.830369 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.830345 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/cd591012-3144-43d8-8798-18aff1a697c5-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"cd591012-3144-43d8-8798-18aff1a697c5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:10:00.831201 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.831172 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/cd591012-3144-43d8-8798-18aff1a697c5-config\") pod \"prometheus-k8s-0\" (UID: \"cd591012-3144-43d8-8798-18aff1a697c5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:10:00.831534 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.831514 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/cd591012-3144-43d8-8798-18aff1a697c5-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"cd591012-3144-43d8-8798-18aff1a697c5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:10:00.831620 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.831534 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/cd591012-3144-43d8-8798-18aff1a697c5-web-config\") pod \"prometheus-k8s-0\" (UID: \"cd591012-3144-43d8-8798-18aff1a697c5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:10:00.831620 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.831581 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/cd591012-3144-43d8-8798-18aff1a697c5-config-out\") pod \"prometheus-k8s-0\" (UID: \"cd591012-3144-43d8-8798-18aff1a697c5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:10:00.848568 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.848544 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nx7hk\" (UniqueName: \"kubernetes.io/projected/cd591012-3144-43d8-8798-18aff1a697c5-kube-api-access-nx7hk\") pod \"prometheus-k8s-0\" (UID: \"cd591012-3144-43d8-8798-18aff1a697c5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:10:00.928363 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:00.928341 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:10:01.222829 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:01.222647 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 17 14:10:01.225427 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:10:01.225398 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd591012_3144_43d8_8798_18aff1a697c5.slice/crio-32243c9fecaf129b76519ab6818d873e39c185fa33c389116dbcbc2521fb7603 WatchSource:0}: Error finding container 32243c9fecaf129b76519ab6818d873e39c185fa33c389116dbcbc2521fb7603: Status 404 returned error can't find the container with id 32243c9fecaf129b76519ab6818d873e39c185fa33c389116dbcbc2521fb7603 Sep 17 14:10:01.531783 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:01.531706 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e0417d03-deb9-4a36-928d-604c37111cdf" path="/var/lib/kubelet/pods/e0417d03-deb9-4a36-928d-604c37111cdf/volumes" Sep 17 14:10:01.538578 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:01.538551 2558 generic.go:356] "Generic (PLEG): container finished" podID="cd591012-3144-43d8-8798-18aff1a697c5" containerID="8006f7e93a8b120667fb997da3831b7c6392775f2ebfc52bb54cee8ace6b9e56" exitCode=0 Sep 17 14:10:01.538897 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:01.538627 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cd591012-3144-43d8-8798-18aff1a697c5","Type":"ContainerDied","Data":"8006f7e93a8b120667fb997da3831b7c6392775f2ebfc52bb54cee8ace6b9e56"} Sep 17 14:10:01.538897 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:01.538691 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cd591012-3144-43d8-8798-18aff1a697c5","Type":"ContainerStarted","Data":"32243c9fecaf129b76519ab6818d873e39c185fa33c389116dbcbc2521fb7603"} Sep 17 14:10:02.546096 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:02.546062 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cd591012-3144-43d8-8798-18aff1a697c5","Type":"ContainerStarted","Data":"041a618ab1ccfcdc9bb20c27f12f29f2ec50494e97058bc6ae561ccb7b26a6ca"} Sep 17 14:10:02.546456 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:02.546120 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cd591012-3144-43d8-8798-18aff1a697c5","Type":"ContainerStarted","Data":"230c7675a90a8c43f386c7c5766f927a6b2e118b8cb561b4b9b865149ecde653"} Sep 17 14:10:02.546456 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:02.546149 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cd591012-3144-43d8-8798-18aff1a697c5","Type":"ContainerStarted","Data":"41b3b8bf707ca182f254ce5deabba46df09a2a75ea8553be957f696796c48d4c"} Sep 17 14:10:02.546456 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:02.546175 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cd591012-3144-43d8-8798-18aff1a697c5","Type":"ContainerStarted","Data":"cf92090ab64ddb3de6fd9e463fd405c74c4708ab6eba1a28bcdfdbdb72c4c156"} Sep 17 14:10:02.546456 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:02.546197 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cd591012-3144-43d8-8798-18aff1a697c5","Type":"ContainerStarted","Data":"fd8f1605a4ebdbb36761a32c8e34c779501e684248b847c5c97561eea53f43a3"} Sep 17 14:10:02.546456 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:02.546219 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cd591012-3144-43d8-8798-18aff1a697c5","Type":"ContainerStarted","Data":"a79070f94d18a30ae39fb2c625b3b5ada89a79a4ee71ce2fa116bfee53f1941e"} Sep 17 14:10:02.576233 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:02.576162 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.555717711 podStartE2EDuration="2.576144546s" totalImagesPullingTime="0s" totalInitContainerRuntime="20.426835ms" isStatefulPod=false podCreationTimestamp="2026-09-17 14:10:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:10:02.573586945 +0000 UTC m=+171.532606453" watchObservedRunningTime="2026-09-17 14:10:02.576144546 +0000 UTC m=+171.535164054" Sep 17 14:10:05.929036 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:10:05.928954 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:11:00.929075 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:11:00.929040 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:11:00.944229 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:11:00.944205 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:11:01.777673 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:11:01.777649 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:12:11.408935 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:12:11.408909 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-d6h6t_c723f8fb-19bb-4b1a-952b-90698d5605f0/console-operator/1.log" Sep 17 14:12:11.413264 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:12:11.413241 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-d6h6t_c723f8fb-19bb-4b1a-952b-90698d5605f0/console-operator/1.log" Sep 17 14:12:11.419685 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:12:11.419662 2558 kubelet.go:1648] "Image garbage collection succeeded" Sep 17 14:13:05.245798 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:13:05.245726 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["trainer-operator-system/trainer-operator-controller-manager-6d5c67cb5d-x8sg5"] Sep 17 14:13:05.248025 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:13:05.248004 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="trainer-operator-system/trainer-operator-controller-manager-6d5c67cb5d-x8sg5" Sep 17 14:13:05.251224 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:13:05.251197 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"trainer-operator-system\"/\"trainer-operator-metrics-tls\"" Sep 17 14:13:05.251331 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:13:05.251228 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"trainer-operator-system\"/\"trainer-operator-controller-manager-dockercfg-jwdqx\"" Sep 17 14:13:05.251331 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:13:05.251247 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"trainer-operator-system\"/\"openshift-service-ca.crt\"" Sep 17 14:13:05.251462 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:13:05.251197 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"trainer-operator-system\"/\"kube-root-ca.crt\"" Sep 17 14:13:05.259345 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:13:05.259327 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["trainer-operator-system/trainer-operator-controller-manager-6d5c67cb5d-x8sg5"] Sep 17 14:13:05.351987 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:13:05.351961 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/616bd4b0-9991-4c3b-b99a-d4828135bf19-metrics-certs\") pod \"trainer-operator-controller-manager-6d5c67cb5d-x8sg5\" (UID: \"616bd4b0-9991-4c3b-b99a-d4828135bf19\") " pod="trainer-operator-system/trainer-operator-controller-manager-6d5c67cb5d-x8sg5" Sep 17 14:13:05.352105 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:13:05.352003 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests-work\" (UniqueName: \"kubernetes.io/empty-dir/616bd4b0-9991-4c3b-b99a-d4828135bf19-manifests-work\") pod \"trainer-operator-controller-manager-6d5c67cb5d-x8sg5\" (UID: \"616bd4b0-9991-4c3b-b99a-d4828135bf19\") " pod="trainer-operator-system/trainer-operator-controller-manager-6d5c67cb5d-x8sg5" Sep 17 14:13:05.352105 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:13:05.352058 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-257rs\" (UniqueName: \"kubernetes.io/projected/616bd4b0-9991-4c3b-b99a-d4828135bf19-kube-api-access-257rs\") pod \"trainer-operator-controller-manager-6d5c67cb5d-x8sg5\" (UID: \"616bd4b0-9991-4c3b-b99a-d4828135bf19\") " pod="trainer-operator-system/trainer-operator-controller-manager-6d5c67cb5d-x8sg5" Sep 17 14:13:05.352181 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:13:05.352132 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/616bd4b0-9991-4c3b-b99a-d4828135bf19-tmp\") pod \"trainer-operator-controller-manager-6d5c67cb5d-x8sg5\" (UID: \"616bd4b0-9991-4c3b-b99a-d4828135bf19\") " pod="trainer-operator-system/trainer-operator-controller-manager-6d5c67cb5d-x8sg5" Sep 17 14:13:05.453349 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:13:05.453317 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests-work\" (UniqueName: \"kubernetes.io/empty-dir/616bd4b0-9991-4c3b-b99a-d4828135bf19-manifests-work\") pod \"trainer-operator-controller-manager-6d5c67cb5d-x8sg5\" (UID: \"616bd4b0-9991-4c3b-b99a-d4828135bf19\") " pod="trainer-operator-system/trainer-operator-controller-manager-6d5c67cb5d-x8sg5" Sep 17 14:13:05.453488 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:13:05.453368 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-257rs\" (UniqueName: \"kubernetes.io/projected/616bd4b0-9991-4c3b-b99a-d4828135bf19-kube-api-access-257rs\") pod \"trainer-operator-controller-manager-6d5c67cb5d-x8sg5\" (UID: \"616bd4b0-9991-4c3b-b99a-d4828135bf19\") " pod="trainer-operator-system/trainer-operator-controller-manager-6d5c67cb5d-x8sg5" Sep 17 14:13:05.453488 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:13:05.453414 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/616bd4b0-9991-4c3b-b99a-d4828135bf19-tmp\") pod \"trainer-operator-controller-manager-6d5c67cb5d-x8sg5\" (UID: \"616bd4b0-9991-4c3b-b99a-d4828135bf19\") " pod="trainer-operator-system/trainer-operator-controller-manager-6d5c67cb5d-x8sg5" Sep 17 14:13:05.453488 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:13:05.453456 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/616bd4b0-9991-4c3b-b99a-d4828135bf19-metrics-certs\") pod \"trainer-operator-controller-manager-6d5c67cb5d-x8sg5\" (UID: \"616bd4b0-9991-4c3b-b99a-d4828135bf19\") " pod="trainer-operator-system/trainer-operator-controller-manager-6d5c67cb5d-x8sg5" Sep 17 14:13:05.453812 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:13:05.453787 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests-work\" (UniqueName: \"kubernetes.io/empty-dir/616bd4b0-9991-4c3b-b99a-d4828135bf19-manifests-work\") pod \"trainer-operator-controller-manager-6d5c67cb5d-x8sg5\" (UID: \"616bd4b0-9991-4c3b-b99a-d4828135bf19\") " pod="trainer-operator-system/trainer-operator-controller-manager-6d5c67cb5d-x8sg5" Sep 17 14:13:05.453852 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:13:05.453792 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/616bd4b0-9991-4c3b-b99a-d4828135bf19-tmp\") pod \"trainer-operator-controller-manager-6d5c67cb5d-x8sg5\" (UID: \"616bd4b0-9991-4c3b-b99a-d4828135bf19\") " pod="trainer-operator-system/trainer-operator-controller-manager-6d5c67cb5d-x8sg5" Sep 17 14:13:05.455777 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:13:05.455761 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/616bd4b0-9991-4c3b-b99a-d4828135bf19-metrics-certs\") pod \"trainer-operator-controller-manager-6d5c67cb5d-x8sg5\" (UID: \"616bd4b0-9991-4c3b-b99a-d4828135bf19\") " pod="trainer-operator-system/trainer-operator-controller-manager-6d5c67cb5d-x8sg5" Sep 17 14:13:05.462319 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:13:05.462298 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-257rs\" (UniqueName: \"kubernetes.io/projected/616bd4b0-9991-4c3b-b99a-d4828135bf19-kube-api-access-257rs\") pod \"trainer-operator-controller-manager-6d5c67cb5d-x8sg5\" (UID: \"616bd4b0-9991-4c3b-b99a-d4828135bf19\") " pod="trainer-operator-system/trainer-operator-controller-manager-6d5c67cb5d-x8sg5" Sep 17 14:13:05.558234 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:13:05.558157 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="trainer-operator-system/trainer-operator-controller-manager-6d5c67cb5d-x8sg5" Sep 17 14:13:05.829806 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:13:05.829627 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["trainer-operator-system/trainer-operator-controller-manager-6d5c67cb5d-x8sg5"] Sep 17 14:13:05.832524 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:13:05.832465 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod616bd4b0_9991_4c3b_b99a_d4828135bf19.slice/crio-e7d98dd47a395ca69e4aae011ff94e14d58e4fc343595be1f193fba24d4182cd WatchSource:0}: Error finding container e7d98dd47a395ca69e4aae011ff94e14d58e4fc343595be1f193fba24d4182cd: Status 404 returned error can't find the container with id e7d98dd47a395ca69e4aae011ff94e14d58e4fc343595be1f193fba24d4182cd Sep 17 14:13:05.834558 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:13:05.834543 2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 17 14:13:06.243712 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:13:06.243631 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="trainer-operator-system/trainer-operator-controller-manager-6d5c67cb5d-x8sg5" event={"ID":"616bd4b0-9991-4c3b-b99a-d4828135bf19","Type":"ContainerStarted","Data":"e7d98dd47a395ca69e4aae011ff94e14d58e4fc343595be1f193fba24d4182cd"} Sep 17 14:13:09.256602 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:13:09.256565 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="trainer-operator-system/trainer-operator-controller-manager-6d5c67cb5d-x8sg5" event={"ID":"616bd4b0-9991-4c3b-b99a-d4828135bf19","Type":"ContainerStarted","Data":"eeb9ee97a762713a603ed10ae33868c0f106d161f11c8c8415f362e5417b8535"} Sep 17 14:13:09.257064 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:13:09.256689 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="trainer-operator-system/trainer-operator-controller-manager-6d5c67cb5d-x8sg5" Sep 17 14:13:09.276055 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:13:09.276012 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="trainer-operator-system/trainer-operator-controller-manager-6d5c67cb5d-x8sg5" podStartSLOduration=1.862970706 podStartE2EDuration="4.275998622s" totalImagesPullingTime="2.413027916s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:13:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:13:09.274650583 +0000 UTC m=+358.233670091" watchObservedRunningTime="2026-09-17 14:13:09.275998622 +0000 UTC m=+358.235018130" Sep 17 14:13:20.262966 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:13:20.262934 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="trainer-operator-system/trainer-operator-controller-manager-6d5c67cb5d-x8sg5" Sep 17 14:14:05.933575 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:14:05.933541 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-7f9b886978-4nx7k"] Sep 17 14:14:05.936727 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:14:05.936704 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-7f9b886978-4nx7k" Sep 17 14:14:05.941804 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:14:05.941780 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Sep 17 14:14:05.941964 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:14:05.941929 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kubeflow-trainer-config\"" Sep 17 14:14:05.946462 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:14:05.946434 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kubeflow-trainer-webhook-cert\"" Sep 17 14:14:05.946711 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:14:05.946694 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Sep 17 14:14:05.947340 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:14:05.947326 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kubeflow-trainer-controller-manager-dockercfg-6xgjr\"" Sep 17 14:14:05.951487 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:14:05.951458 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-7f9b886978-4nx7k"] Sep 17 14:14:06.015024 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:14:06.014992 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j9ks9\" (UniqueName: \"kubernetes.io/projected/dcf99732-34cf-4cb8-a68c-46102a1ac7bd-kube-api-access-j9ks9\") pod \"kubeflow-trainer-controller-manager-7f9b886978-4nx7k\" (UID: \"dcf99732-34cf-4cb8-a68c-46102a1ac7bd\") " pod="opendatahub/kubeflow-trainer-controller-manager-7f9b886978-4nx7k" Sep 17 14:14:06.015149 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:14:06.015044 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/dcf99732-34cf-4cb8-a68c-46102a1ac7bd-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-7f9b886978-4nx7k\" (UID: \"dcf99732-34cf-4cb8-a68c-46102a1ac7bd\") " pod="opendatahub/kubeflow-trainer-controller-manager-7f9b886978-4nx7k" Sep 17 14:14:06.015149 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:14:06.015111 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dcf99732-34cf-4cb8-a68c-46102a1ac7bd-cert\") pod \"kubeflow-trainer-controller-manager-7f9b886978-4nx7k\" (UID: \"dcf99732-34cf-4cb8-a68c-46102a1ac7bd\") " pod="opendatahub/kubeflow-trainer-controller-manager-7f9b886978-4nx7k" Sep 17 14:14:06.115980 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:14:06.115947 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9ks9\" (UniqueName: \"kubernetes.io/projected/dcf99732-34cf-4cb8-a68c-46102a1ac7bd-kube-api-access-j9ks9\") pod \"kubeflow-trainer-controller-manager-7f9b886978-4nx7k\" (UID: \"dcf99732-34cf-4cb8-a68c-46102a1ac7bd\") " pod="opendatahub/kubeflow-trainer-controller-manager-7f9b886978-4nx7k" Sep 17 14:14:06.116131 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:14:06.115992 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/dcf99732-34cf-4cb8-a68c-46102a1ac7bd-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-7f9b886978-4nx7k\" (UID: \"dcf99732-34cf-4cb8-a68c-46102a1ac7bd\") " pod="opendatahub/kubeflow-trainer-controller-manager-7f9b886978-4nx7k" Sep 17 14:14:06.116131 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:14:06.116033 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dcf99732-34cf-4cb8-a68c-46102a1ac7bd-cert\") pod \"kubeflow-trainer-controller-manager-7f9b886978-4nx7k\" (UID: \"dcf99732-34cf-4cb8-a68c-46102a1ac7bd\") " pod="opendatahub/kubeflow-trainer-controller-manager-7f9b886978-4nx7k" Sep 17 14:14:06.116733 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:14:06.116709 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/dcf99732-34cf-4cb8-a68c-46102a1ac7bd-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-7f9b886978-4nx7k\" (UID: \"dcf99732-34cf-4cb8-a68c-46102a1ac7bd\") " pod="opendatahub/kubeflow-trainer-controller-manager-7f9b886978-4nx7k" Sep 17 14:14:06.118337 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:14:06.118320 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dcf99732-34cf-4cb8-a68c-46102a1ac7bd-cert\") pod \"kubeflow-trainer-controller-manager-7f9b886978-4nx7k\" (UID: \"dcf99732-34cf-4cb8-a68c-46102a1ac7bd\") " pod="opendatahub/kubeflow-trainer-controller-manager-7f9b886978-4nx7k" Sep 17 14:14:06.129482 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:14:06.129458 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9ks9\" (UniqueName: \"kubernetes.io/projected/dcf99732-34cf-4cb8-a68c-46102a1ac7bd-kube-api-access-j9ks9\") pod \"kubeflow-trainer-controller-manager-7f9b886978-4nx7k\" (UID: \"dcf99732-34cf-4cb8-a68c-46102a1ac7bd\") " pod="opendatahub/kubeflow-trainer-controller-manager-7f9b886978-4nx7k" Sep 17 14:14:06.255420 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:14:06.255359 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-7f9b886978-4nx7k" Sep 17 14:14:06.524028 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:14:06.524004 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-7f9b886978-4nx7k"] Sep 17 14:14:06.526861 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:14:06.526827 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddcf99732_34cf_4cb8_a68c_46102a1ac7bd.slice/crio-9ca76fa2d210bc6e0d2b479d442c23c283ac6c7337a2467f2f5a64064267d8fc WatchSource:0}: Error finding container 9ca76fa2d210bc6e0d2b479d442c23c283ac6c7337a2467f2f5a64064267d8fc: Status 404 returned error can't find the container with id 9ca76fa2d210bc6e0d2b479d442c23c283ac6c7337a2467f2f5a64064267d8fc Sep 17 14:14:07.484367 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:14:07.484327 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-7f9b886978-4nx7k" event={"ID":"dcf99732-34cf-4cb8-a68c-46102a1ac7bd","Type":"ContainerStarted","Data":"9ca76fa2d210bc6e0d2b479d442c23c283ac6c7337a2467f2f5a64064267d8fc"} Sep 17 14:14:09.493894 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:14:09.493858 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-7f9b886978-4nx7k" event={"ID":"dcf99732-34cf-4cb8-a68c-46102a1ac7bd","Type":"ContainerStarted","Data":"318f4ff28066c9ea436827308049e1b52641c9c0b6c20dd2d950f1ef4efea3b6"} Sep 17 14:14:09.494257 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:14:09.493923 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kubeflow-trainer-controller-manager-7f9b886978-4nx7k" Sep 17 14:14:09.512856 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:14:09.512805 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kubeflow-trainer-controller-manager-7f9b886978-4nx7k" podStartSLOduration=2.3664884170000002 podStartE2EDuration="4.51278855s" totalImagesPullingTime="2.146300133s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:14:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:14:09.512229992 +0000 UTC m=+418.471249501" watchObservedRunningTime="2026-09-17 14:14:09.51278855 +0000 UTC m=+418.471808060" Sep 17 14:14:25.504481 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:14:25.504451 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kubeflow-trainer-controller-manager-7f9b886978-4nx7k" Sep 17 14:14:27.184726 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:14:27.184684 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-trainjob-workflow-node-0-0-ljlnm"] Sep 17 14:14:27.190576 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:14:27.190553 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-trainjob-workflow-node-0-0-ljlnm" Sep 17 14:14:27.192858 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:14:27.192842 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-csqrt\"" Sep 17 14:14:27.199411 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:14:27.199386 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-trainjob-workflow-node-0-0-ljlnm"] Sep 17 14:14:27.295264 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:14:27.295237 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qwklw\" (UniqueName: \"kubernetes.io/projected/e7436b8f-5cd2-49f8-8aa6-605c9fa545f9-kube-api-access-qwklw\") pod \"test-trainjob-workflow-node-0-0-ljlnm\" (UID: \"e7436b8f-5cd2-49f8-8aa6-605c9fa545f9\") " pod="opendatahub/test-trainjob-workflow-node-0-0-ljlnm" Sep 17 14:14:27.396484 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:14:27.396452 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qwklw\" (UniqueName: \"kubernetes.io/projected/e7436b8f-5cd2-49f8-8aa6-605c9fa545f9-kube-api-access-qwklw\") pod \"test-trainjob-workflow-node-0-0-ljlnm\" (UID: \"e7436b8f-5cd2-49f8-8aa6-605c9fa545f9\") " pod="opendatahub/test-trainjob-workflow-node-0-0-ljlnm" Sep 17 14:14:27.405246 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:14:27.405226 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qwklw\" (UniqueName: \"kubernetes.io/projected/e7436b8f-5cd2-49f8-8aa6-605c9fa545f9-kube-api-access-qwklw\") pod \"test-trainjob-workflow-node-0-0-ljlnm\" (UID: \"e7436b8f-5cd2-49f8-8aa6-605c9fa545f9\") " pod="opendatahub/test-trainjob-workflow-node-0-0-ljlnm" Sep 17 14:14:27.500292 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:14:27.500233 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-trainjob-workflow-node-0-0-ljlnm" Sep 17 14:14:27.771158 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:14:27.771122 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-trainjob-workflow-node-0-0-ljlnm"] Sep 17 14:14:27.773523 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:14:27.773466 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode7436b8f_5cd2_49f8_8aa6_605c9fa545f9.slice/crio-fb80f7a478a905035d7cca2180b15326c81fc1549354abda9bbef2b18b1f75fa WatchSource:0}: Error finding container fb80f7a478a905035d7cca2180b15326c81fc1549354abda9bbef2b18b1f75fa: Status 404 returned error can't find the container with id fb80f7a478a905035d7cca2180b15326c81fc1549354abda9bbef2b18b1f75fa Sep 17 14:14:28.576401 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:14:28.576158 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-trainjob-workflow-node-0-0-ljlnm" event={"ID":"e7436b8f-5cd2-49f8-8aa6-605c9fa545f9","Type":"ContainerStarted","Data":"fb80f7a478a905035d7cca2180b15326c81fc1549354abda9bbef2b18b1f75fa"} Sep 17 14:15:37.916744 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:15:37.916699 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-trainjob-workflow-node-0-0-ljlnm" event={"ID":"e7436b8f-5cd2-49f8-8aa6-605c9fa545f9","Type":"ContainerStarted","Data":"8674485650d20eebf1c96cfdbfce7b1bb23c3c552d0f743562221a944a62c96d"} Sep 17 14:15:37.951756 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:15:37.951703 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-trainjob-workflow-node-0-0-ljlnm" podStartSLOduration=1.768999824 podStartE2EDuration="1m10.951687005s" totalImagesPullingTime="1m9.182687181s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:14:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:15:37.949607793 +0000 UTC m=+506.908627301" watchObservedRunningTime="2026-09-17 14:15:37.951687005 +0000 UTC m=+506.910706512" Sep 17 14:15:39.925549 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:15:39.925516 2558 generic.go:356] "Generic (PLEG): container finished" podID="e7436b8f-5cd2-49f8-8aa6-605c9fa545f9" containerID="8674485650d20eebf1c96cfdbfce7b1bb23c3c552d0f743562221a944a62c96d" exitCode=0 Sep 17 14:15:39.925902 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:15:39.925548 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-trainjob-workflow-node-0-0-ljlnm" event={"ID":"e7436b8f-5cd2-49f8-8aa6-605c9fa545f9","Type":"ContainerDied","Data":"8674485650d20eebf1c96cfdbfce7b1bb23c3c552d0f743562221a944a62c96d"} Sep 17 14:15:41.113046 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:15:41.113020 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-trainjob-workflow-node-0-0-ljlnm" Sep 17 14:15:41.173836 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:15:41.173813 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qwklw\" (UniqueName: \"kubernetes.io/projected/e7436b8f-5cd2-49f8-8aa6-605c9fa545f9-kube-api-access-qwklw\") pod \"e7436b8f-5cd2-49f8-8aa6-605c9fa545f9\" (UID: \"e7436b8f-5cd2-49f8-8aa6-605c9fa545f9\") " Sep 17 14:15:41.175897 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:15:41.175874 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e7436b8f-5cd2-49f8-8aa6-605c9fa545f9-kube-api-access-qwklw" (OuterVolumeSpecName: "kube-api-access-qwklw") pod "e7436b8f-5cd2-49f8-8aa6-605c9fa545f9" (UID: "e7436b8f-5cd2-49f8-8aa6-605c9fa545f9"). InnerVolumeSpecName "kube-api-access-qwklw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 14:15:41.274825 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:15:41.274799 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qwklw\" (UniqueName: \"kubernetes.io/projected/e7436b8f-5cd2-49f8-8aa6-605c9fa545f9-kube-api-access-qwklw\") on node \"ip-10-0-129-36.ec2.internal\" DevicePath \"\"" Sep 17 14:15:41.936608 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:15:41.936570 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-trainjob-workflow-node-0-0-ljlnm" event={"ID":"e7436b8f-5cd2-49f8-8aa6-605c9fa545f9","Type":"ContainerDied","Data":"fb80f7a478a905035d7cca2180b15326c81fc1549354abda9bbef2b18b1f75fa"} Sep 17 14:15:41.936608 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:15:41.936607 2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fb80f7a478a905035d7cca2180b15326c81fc1549354abda9bbef2b18b1f75fa" Sep 17 14:15:41.936608 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:15:41.936583 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-trainjob-workflow-node-0-0-ljlnm" Sep 17 14:15:42.518665 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:15:42.518634 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-trainjob-workflow-node-0-0-ljlnm"] Sep 17 14:15:42.522129 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:15:42.522108 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-trainjob-workflow-node-0-0-ljlnm"] Sep 17 14:15:42.789698 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:15:42.789626 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-7f9b886978-4nx7k"] Sep 17 14:15:42.789847 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:15:42.789798 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/kubeflow-trainer-controller-manager-7f9b886978-4nx7k" podUID="dcf99732-34cf-4cb8-a68c-46102a1ac7bd" containerName="manager" containerID="cri-o://318f4ff28066c9ea436827308049e1b52641c9c0b6c20dd2d950f1ef4efea3b6" gracePeriod=30 Sep 17 14:15:42.942666 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:15:42.942638 2558 generic.go:356] "Generic (PLEG): container finished" podID="dcf99732-34cf-4cb8-a68c-46102a1ac7bd" containerID="318f4ff28066c9ea436827308049e1b52641c9c0b6c20dd2d950f1ef4efea3b6" exitCode=0 Sep 17 14:15:42.942811 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:15:42.942669 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-7f9b886978-4nx7k" event={"ID":"dcf99732-34cf-4cb8-a68c-46102a1ac7bd","Type":"ContainerDied","Data":"318f4ff28066c9ea436827308049e1b52641c9c0b6c20dd2d950f1ef4efea3b6"} Sep 17 14:15:43.077967 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:15:43.077944 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-7f9b886978-4nx7k" Sep 17 14:15:43.189539 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:15:43.189485 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/dcf99732-34cf-4cb8-a68c-46102a1ac7bd-kubeflow-trainer-config\") pod \"dcf99732-34cf-4cb8-a68c-46102a1ac7bd\" (UID: \"dcf99732-34cf-4cb8-a68c-46102a1ac7bd\") " Sep 17 14:15:43.189724 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:15:43.189548 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j9ks9\" (UniqueName: \"kubernetes.io/projected/dcf99732-34cf-4cb8-a68c-46102a1ac7bd-kube-api-access-j9ks9\") pod \"dcf99732-34cf-4cb8-a68c-46102a1ac7bd\" (UID: \"dcf99732-34cf-4cb8-a68c-46102a1ac7bd\") " Sep 17 14:15:43.189724 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:15:43.189638 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dcf99732-34cf-4cb8-a68c-46102a1ac7bd-cert\") pod \"dcf99732-34cf-4cb8-a68c-46102a1ac7bd\" (UID: \"dcf99732-34cf-4cb8-a68c-46102a1ac7bd\") " Sep 17 14:15:43.191645 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:15:43.191610 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dcf99732-34cf-4cb8-a68c-46102a1ac7bd-kube-api-access-j9ks9" (OuterVolumeSpecName: "kube-api-access-j9ks9") pod "dcf99732-34cf-4cb8-a68c-46102a1ac7bd" (UID: "dcf99732-34cf-4cb8-a68c-46102a1ac7bd"). InnerVolumeSpecName "kube-api-access-j9ks9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 14:15:43.191645 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:15:43.191624 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dcf99732-34cf-4cb8-a68c-46102a1ac7bd-cert" (OuterVolumeSpecName: "cert") pod "dcf99732-34cf-4cb8-a68c-46102a1ac7bd" (UID: "dcf99732-34cf-4cb8-a68c-46102a1ac7bd"). InnerVolumeSpecName "cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 14:15:43.194045 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:15:43.194017 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dcf99732-34cf-4cb8-a68c-46102a1ac7bd-kubeflow-trainer-config" (OuterVolumeSpecName: "kubeflow-trainer-config") pod "dcf99732-34cf-4cb8-a68c-46102a1ac7bd" (UID: "dcf99732-34cf-4cb8-a68c-46102a1ac7bd"). InnerVolumeSpecName "kubeflow-trainer-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 14:15:43.290553 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:15:43.290489 2558 reconciler_common.go:299] "Volume detached for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dcf99732-34cf-4cb8-a68c-46102a1ac7bd-cert\") on node \"ip-10-0-129-36.ec2.internal\" DevicePath \"\"" Sep 17 14:15:43.290553 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:15:43.290525 2558 reconciler_common.go:299] "Volume detached for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/dcf99732-34cf-4cb8-a68c-46102a1ac7bd-kubeflow-trainer-config\") on node \"ip-10-0-129-36.ec2.internal\" DevicePath \"\"" Sep 17 14:15:43.290553 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:15:43.290535 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j9ks9\" (UniqueName: \"kubernetes.io/projected/dcf99732-34cf-4cb8-a68c-46102a1ac7bd-kube-api-access-j9ks9\") on node \"ip-10-0-129-36.ec2.internal\" DevicePath \"\"" Sep 17 14:15:43.532765 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:15:43.532731 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e7436b8f-5cd2-49f8-8aa6-605c9fa545f9" path="/var/lib/kubelet/pods/e7436b8f-5cd2-49f8-8aa6-605c9fa545f9/volumes" Sep 17 14:15:43.948426 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:15:43.948398 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-7f9b886978-4nx7k" Sep 17 14:15:43.948710 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:15:43.948402 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-7f9b886978-4nx7k" event={"ID":"dcf99732-34cf-4cb8-a68c-46102a1ac7bd","Type":"ContainerDied","Data":"9ca76fa2d210bc6e0d2b479d442c23c283ac6c7337a2467f2f5a64064267d8fc"} Sep 17 14:15:43.948710 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:15:43.948541 2558 scope.go:117] "RemoveContainer" containerID="318f4ff28066c9ea436827308049e1b52641c9c0b6c20dd2d950f1ef4efea3b6" Sep 17 14:15:43.973666 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:15:43.973641 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-7f9b886978-4nx7k"] Sep 17 14:15:43.979953 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:15:43.979933 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-7f9b886978-4nx7k"] Sep 17 14:15:44.481628 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:15:44.481596 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-f4s85/must-gather-bp6bx"] Sep 17 14:15:44.481938 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:15:44.481924 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dcf99732-34cf-4cb8-a68c-46102a1ac7bd" containerName="manager" Sep 17 14:15:44.481991 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:15:44.481940 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="dcf99732-34cf-4cb8-a68c-46102a1ac7bd" containerName="manager" Sep 17 14:15:44.481991 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:15:44.481952 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e7436b8f-5cd2-49f8-8aa6-605c9fa545f9" containerName="node" Sep 17 14:15:44.481991 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:15:44.481960 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="e7436b8f-5cd2-49f8-8aa6-605c9fa545f9" containerName="node" Sep 17 14:15:44.482081 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:15:44.482034 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="dcf99732-34cf-4cb8-a68c-46102a1ac7bd" containerName="manager" Sep 17 14:15:44.482081 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:15:44.482046 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="e7436b8f-5cd2-49f8-8aa6-605c9fa545f9" containerName="node" Sep 17 14:15:44.515902 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:15:44.515868 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-f4s85/must-gather-bp6bx"] Sep 17 14:15:44.516063 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:15:44.515980 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-f4s85/must-gather-bp6bx" Sep 17 14:15:44.519085 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:15:44.519061 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-f4s85\"/\"openshift-service-ca.crt\"" Sep 17 14:15:44.519214 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:15:44.519087 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-f4s85\"/\"kube-root-ca.crt\"" Sep 17 14:15:44.519214 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:15:44.519066 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-f4s85\"/\"default-dockercfg-jjfv6\"" Sep 17 14:15:44.602036 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:15:44.602001 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hj8r8\" (UniqueName: \"kubernetes.io/projected/91127f03-d216-4c22-a672-3a8965ff6681-kube-api-access-hj8r8\") pod \"must-gather-bp6bx\" (UID: \"91127f03-d216-4c22-a672-3a8965ff6681\") " pod="openshift-must-gather-f4s85/must-gather-bp6bx" Sep 17 14:15:44.602408 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:15:44.602118 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/91127f03-d216-4c22-a672-3a8965ff6681-must-gather-output\") pod \"must-gather-bp6bx\" (UID: \"91127f03-d216-4c22-a672-3a8965ff6681\") " pod="openshift-must-gather-f4s85/must-gather-bp6bx" Sep 17 14:15:44.702616 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:15:44.702556 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hj8r8\" (UniqueName: \"kubernetes.io/projected/91127f03-d216-4c22-a672-3a8965ff6681-kube-api-access-hj8r8\") pod \"must-gather-bp6bx\" (UID: \"91127f03-d216-4c22-a672-3a8965ff6681\") " pod="openshift-must-gather-f4s85/must-gather-bp6bx" Sep 17 14:15:44.702804 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:15:44.702622 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/91127f03-d216-4c22-a672-3a8965ff6681-must-gather-output\") pod \"must-gather-bp6bx\" (UID: \"91127f03-d216-4c22-a672-3a8965ff6681\") " pod="openshift-must-gather-f4s85/must-gather-bp6bx" Sep 17 14:15:44.703005 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:15:44.702982 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/91127f03-d216-4c22-a672-3a8965ff6681-must-gather-output\") pod \"must-gather-bp6bx\" (UID: \"91127f03-d216-4c22-a672-3a8965ff6681\") " pod="openshift-must-gather-f4s85/must-gather-bp6bx" Sep 17 14:15:44.711016 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:15:44.710988 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hj8r8\" (UniqueName: \"kubernetes.io/projected/91127f03-d216-4c22-a672-3a8965ff6681-kube-api-access-hj8r8\") pod \"must-gather-bp6bx\" (UID: \"91127f03-d216-4c22-a672-3a8965ff6681\") " pod="openshift-must-gather-f4s85/must-gather-bp6bx" Sep 17 14:15:44.839682 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:15:44.839655 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-f4s85/must-gather-bp6bx" Sep 17 14:15:45.149489 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:15:45.149429 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-f4s85/must-gather-bp6bx"] Sep 17 14:15:45.151764 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:15:45.151734 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod91127f03_d216_4c22_a672_3a8965ff6681.slice/crio-4afb8153e5b48448ad9ab030e34b6a27d31f335e8ec4d52f2d3b805b5dbe4727 WatchSource:0}: Error finding container 4afb8153e5b48448ad9ab030e34b6a27d31f335e8ec4d52f2d3b805b5dbe4727: Status 404 returned error can't find the container with id 4afb8153e5b48448ad9ab030e34b6a27d31f335e8ec4d52f2d3b805b5dbe4727 Sep 17 14:15:45.532020 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:15:45.531951 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dcf99732-34cf-4cb8-a68c-46102a1ac7bd" path="/var/lib/kubelet/pods/dcf99732-34cf-4cb8-a68c-46102a1ac7bd/volumes" Sep 17 14:15:45.960684 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:15:45.960609 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-f4s85/must-gather-bp6bx" event={"ID":"91127f03-d216-4c22-a672-3a8965ff6681","Type":"ContainerStarted","Data":"4afb8153e5b48448ad9ab030e34b6a27d31f335e8ec4d52f2d3b805b5dbe4727"} Sep 17 14:15:53.002951 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:15:53.002908 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-f4s85/must-gather-bp6bx" event={"ID":"91127f03-d216-4c22-a672-3a8965ff6681","Type":"ContainerStarted","Data":"137d9a88d6ea12adcec78edcc60d44791405383367f38685be8ccd61a3f4e783"} Sep 17 14:15:53.002951 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:15:53.002956 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-f4s85/must-gather-bp6bx" event={"ID":"91127f03-d216-4c22-a672-3a8965ff6681","Type":"ContainerStarted","Data":"c14d2c13196c480561edd00cd47ea9e30478309ef38d7bb0f86b8c61f9ec4a53"} Sep 17 14:15:53.024156 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:15:53.024112 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-f4s85/must-gather-bp6bx" podStartSLOduration=1.542806796 podStartE2EDuration="9.024096735s" totalImagesPullingTime="7.481289939s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:15:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:15:53.023197215 +0000 UTC m=+521.982216733" watchObservedRunningTime="2026-09-17 14:15:53.024096735 +0000 UTC m=+521.983116243" Sep 17 14:16:43.233185 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:16:43.233149 2558 generic.go:356] "Generic (PLEG): container finished" podID="91127f03-d216-4c22-a672-3a8965ff6681" containerID="c14d2c13196c480561edd00cd47ea9e30478309ef38d7bb0f86b8c61f9ec4a53" exitCode=0 Sep 17 14:16:43.233637 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:16:43.233220 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-f4s85/must-gather-bp6bx" event={"ID":"91127f03-d216-4c22-a672-3a8965ff6681","Type":"ContainerDied","Data":"c14d2c13196c480561edd00cd47ea9e30478309ef38d7bb0f86b8c61f9ec4a53"} Sep 17 14:16:43.233637 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:16:43.233553 2558 scope.go:117] "RemoveContainer" containerID="c14d2c13196c480561edd00cd47ea9e30478309ef38d7bb0f86b8c61f9ec4a53" Sep 17 14:16:43.418031 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:16:43.417967 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-f4s85_must-gather-bp6bx_91127f03-d216-4c22-a672-3a8965ff6681/gather/0.log" Sep 17 14:16:47.372448 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:16:47.372416 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-9jk57_78551199-0cec-4921-b8a1-0858742751f4/global-pull-secret-syncer/0.log" Sep 17 14:16:47.765130 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:16:47.765054 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-r9gxb_ad60e34b-b278-428d-bedc-005487e24b27/konnectivity-agent/0.log" Sep 17 14:16:47.833402 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:16:47.833375 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-129-36.ec2.internal_88a7a62367d3ac850bfa7c5bf5f45309/haproxy/0.log" Sep 17 14:16:48.841466 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:16:48.841439 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-f4s85/must-gather-bp6bx"] Sep 17 14:16:48.841929 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:16:48.841722 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-must-gather-f4s85/must-gather-bp6bx" podUID="91127f03-d216-4c22-a672-3a8965ff6681" containerName="copy" containerID="cri-o://137d9a88d6ea12adcec78edcc60d44791405383367f38685be8ccd61a3f4e783" gracePeriod=2 Sep 17 14:16:48.843634 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:16:48.843610 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-f4s85/must-gather-bp6bx"] Sep 17 14:16:48.849278 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:16:48.849248 2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-bp6bx\" is forbidden: User \"system:node:ip-10-0-129-36.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-f4s85\": no relationship found between node 'ip-10-0-129-36.ec2.internal' and this object" podUID="91127f03-d216-4c22-a672-3a8965ff6681" pod="openshift-must-gather-f4s85/must-gather-bp6bx" Sep 17 14:16:49.090589 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:16:49.090562 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-f4s85_must-gather-bp6bx_91127f03-d216-4c22-a672-3a8965ff6681/copy/0.log" Sep 17 14:16:49.093242 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:16:49.093197 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-f4s85/must-gather-bp6bx" Sep 17 14:16:49.108793 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:16:49.108761 2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-bp6bx\" is forbidden: User \"system:node:ip-10-0-129-36.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-f4s85\": no relationship found between node 'ip-10-0-129-36.ec2.internal' and this object" podUID="91127f03-d216-4c22-a672-3a8965ff6681" pod="openshift-must-gather-f4s85/must-gather-bp6bx" Sep 17 14:16:49.255722 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:16:49.255690 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/91127f03-d216-4c22-a672-3a8965ff6681-must-gather-output\") pod \"91127f03-d216-4c22-a672-3a8965ff6681\" (UID: \"91127f03-d216-4c22-a672-3a8965ff6681\") " Sep 17 14:16:49.255881 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:16:49.255753 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hj8r8\" (UniqueName: \"kubernetes.io/projected/91127f03-d216-4c22-a672-3a8965ff6681-kube-api-access-hj8r8\") pod \"91127f03-d216-4c22-a672-3a8965ff6681\" (UID: \"91127f03-d216-4c22-a672-3a8965ff6681\") " Sep 17 14:16:49.256895 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:16:49.256866 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/91127f03-d216-4c22-a672-3a8965ff6681-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "91127f03-d216-4c22-a672-3a8965ff6681" (UID: "91127f03-d216-4c22-a672-3a8965ff6681"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 17 14:16:49.257011 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:16:49.256958 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-f4s85_must-gather-bp6bx_91127f03-d216-4c22-a672-3a8965ff6681/copy/0.log" Sep 17 14:16:49.257372 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:16:49.257348 2558 generic.go:356] "Generic (PLEG): container finished" podID="91127f03-d216-4c22-a672-3a8965ff6681" containerID="137d9a88d6ea12adcec78edcc60d44791405383367f38685be8ccd61a3f4e783" exitCode=143 Sep 17 14:16:49.257484 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:16:49.257393 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-f4s85/must-gather-bp6bx" Sep 17 14:16:49.257484 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:16:49.257425 2558 scope.go:117] "RemoveContainer" containerID="137d9a88d6ea12adcec78edcc60d44791405383367f38685be8ccd61a3f4e783" Sep 17 14:16:49.258235 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:16:49.258209 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/91127f03-d216-4c22-a672-3a8965ff6681-kube-api-access-hj8r8" (OuterVolumeSpecName: "kube-api-access-hj8r8") pod "91127f03-d216-4c22-a672-3a8965ff6681" (UID: "91127f03-d216-4c22-a672-3a8965ff6681"). InnerVolumeSpecName "kube-api-access-hj8r8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 14:16:49.266145 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:16:49.266118 2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-bp6bx\" is forbidden: User \"system:node:ip-10-0-129-36.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-f4s85\": no relationship found between node 'ip-10-0-129-36.ec2.internal' and this object" podUID="91127f03-d216-4c22-a672-3a8965ff6681" pod="openshift-must-gather-f4s85/must-gather-bp6bx" Sep 17 14:16:49.267168 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:16:49.267155 2558 scope.go:117] "RemoveContainer" containerID="c14d2c13196c480561edd00cd47ea9e30478309ef38d7bb0f86b8c61f9ec4a53" Sep 17 14:16:49.279068 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:16:49.279052 2558 scope.go:117] "RemoveContainer" containerID="137d9a88d6ea12adcec78edcc60d44791405383367f38685be8ccd61a3f4e783" Sep 17 14:16:49.279345 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:16:49.279327 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"137d9a88d6ea12adcec78edcc60d44791405383367f38685be8ccd61a3f4e783\": container with ID starting with 137d9a88d6ea12adcec78edcc60d44791405383367f38685be8ccd61a3f4e783 not found: ID does not exist" containerID="137d9a88d6ea12adcec78edcc60d44791405383367f38685be8ccd61a3f4e783" Sep 17 14:16:49.279413 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:16:49.279355 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"137d9a88d6ea12adcec78edcc60d44791405383367f38685be8ccd61a3f4e783"} err="failed to get container status \"137d9a88d6ea12adcec78edcc60d44791405383367f38685be8ccd61a3f4e783\": rpc error: code = NotFound desc = could not find container \"137d9a88d6ea12adcec78edcc60d44791405383367f38685be8ccd61a3f4e783\": container with ID starting with 137d9a88d6ea12adcec78edcc60d44791405383367f38685be8ccd61a3f4e783 not found: ID does not exist" Sep 17 14:16:49.279413 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:16:49.279376 2558 scope.go:117] "RemoveContainer" containerID="c14d2c13196c480561edd00cd47ea9e30478309ef38d7bb0f86b8c61f9ec4a53" Sep 17 14:16:49.279633 ip-10-0-129-36 kubenswrapper[2558]: E0917 14:16:49.279612 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c14d2c13196c480561edd00cd47ea9e30478309ef38d7bb0f86b8c61f9ec4a53\": container with ID starting with c14d2c13196c480561edd00cd47ea9e30478309ef38d7bb0f86b8c61f9ec4a53 not found: ID does not exist" containerID="c14d2c13196c480561edd00cd47ea9e30478309ef38d7bb0f86b8c61f9ec4a53" Sep 17 14:16:49.279684 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:16:49.279641 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c14d2c13196c480561edd00cd47ea9e30478309ef38d7bb0f86b8c61f9ec4a53"} err="failed to get container status \"c14d2c13196c480561edd00cd47ea9e30478309ef38d7bb0f86b8c61f9ec4a53\": rpc error: code = NotFound desc = could not find container \"c14d2c13196c480561edd00cd47ea9e30478309ef38d7bb0f86b8c61f9ec4a53\": container with ID starting with c14d2c13196c480561edd00cd47ea9e30478309ef38d7bb0f86b8c61f9ec4a53 not found: ID does not exist" Sep 17 14:16:49.357230 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:16:49.357166 2558 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/91127f03-d216-4c22-a672-3a8965ff6681-must-gather-output\") on node \"ip-10-0-129-36.ec2.internal\" DevicePath \"\"" Sep 17 14:16:49.357230 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:16:49.357187 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hj8r8\" (UniqueName: \"kubernetes.io/projected/91127f03-d216-4c22-a672-3a8965ff6681-kube-api-access-hj8r8\") on node \"ip-10-0-129-36.ec2.internal\" DevicePath \"\"" Sep 17 14:16:49.532212 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:16:49.532183 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="91127f03-d216-4c22-a672-3a8965ff6681" path="/var/lib/kubelet/pods/91127f03-d216-4c22-a672-3a8965ff6681/volumes" Sep 17 14:16:52.110443 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:16:52.110416 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6cd954b897-q4dh5_7e32a93a-9533-4d08-a4a4-b17a74a3c0f6/cluster-monitoring-operator/0.log" Sep 17 14:16:52.188578 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:16:52.188554 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-b89qd_cd52454b-212b-4ead-8178-8a0f439b66de/kube-state-metrics/0.log" Sep 17 14:16:52.293882 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:16:52.293859 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-b89qd_cd52454b-212b-4ead-8178-8a0f439b66de/kube-rbac-proxy-main/0.log" Sep 17 14:16:52.349330 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:16:52.349303 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-b89qd_cd52454b-212b-4ead-8178-8a0f439b66de/kube-rbac-proxy-self/0.log" Sep 17 14:16:52.439062 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:16:52.438997 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5d85778b9d-cvgxn_1fca741e-577d-45b0-acfe-68f066585082/monitoring-plugin/0.log" Sep 17 14:16:52.659244 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:16:52.659221 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5phpk_78dd496d-c4d0-4b08-9d80-48a098851103/node-exporter/0.log" Sep 17 14:16:52.722553 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:16:52.722468 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5phpk_78dd496d-c4d0-4b08-9d80-48a098851103/kube-rbac-proxy/0.log" Sep 17 14:16:52.814338 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:16:52.814314 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5phpk_78dd496d-c4d0-4b08-9d80-48a098851103/init-textfile/0.log" Sep 17 14:16:53.192790 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:16:53.192763 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-bhd5q_177d2a1f-db87-4340-b6db-9a53277f0310/kube-rbac-proxy-main/0.log" Sep 17 14:16:53.244996 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:16:53.244933 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-bhd5q_177d2a1f-db87-4340-b6db-9a53277f0310/kube-rbac-proxy-self/0.log" Sep 17 14:16:53.291540 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:16:53.291523 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-bhd5q_177d2a1f-db87-4340-b6db-9a53277f0310/openshift-state-metrics/0.log" Sep 17 14:16:53.346170 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:16:53.346150 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_cd591012-3144-43d8-8798-18aff1a697c5/prometheus/0.log" Sep 17 14:16:53.379182 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:16:53.379160 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_cd591012-3144-43d8-8798-18aff1a697c5/config-reloader/0.log" Sep 17 14:16:53.424300 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:16:53.424283 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_cd591012-3144-43d8-8798-18aff1a697c5/thanos-sidecar/0.log" Sep 17 14:16:53.480357 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:16:53.480338 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_cd591012-3144-43d8-8798-18aff1a697c5/kube-rbac-proxy-web/0.log" Sep 17 14:16:53.531659 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:16:53.531605 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_cd591012-3144-43d8-8798-18aff1a697c5/kube-rbac-proxy/0.log" Sep 17 14:16:53.593456 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:16:53.593438 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_cd591012-3144-43d8-8798-18aff1a697c5/kube-rbac-proxy-thanos/0.log" Sep 17 14:16:53.644081 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:16:53.644061 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_cd591012-3144-43d8-8798-18aff1a697c5/init-config-reloader/0.log" Sep 17 14:16:53.721741 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:16:53.721703 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-68bcd7f987-m64vh_4c8c001e-8382-49fa-a771-cf911ded2e0a/prometheus-operator/0.log" Sep 17 14:16:53.774246 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:16:53.774224 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-68bcd7f987-m64vh_4c8c001e-8382-49fa-a771-cf911ded2e0a/kube-rbac-proxy/0.log" Sep 17 14:16:53.832493 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:16:53.832461 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5864cd99d7-ksq9z_60fde3c5-7af2-4841-83ea-1b57b12ffdd4/prometheus-operator-admission-webhook/0.log" Sep 17 14:16:55.038541 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:16:55.038491 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-fh67x/perf-node-gather-daemonset-zjzmr"] Sep 17 14:16:55.038948 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:16:55.038901 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91127f03-d216-4c22-a672-3a8965ff6681" containerName="gather" Sep 17 14:16:55.038948 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:16:55.038914 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="91127f03-d216-4c22-a672-3a8965ff6681" containerName="gather" Sep 17 14:16:55.038948 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:16:55.038939 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91127f03-d216-4c22-a672-3a8965ff6681" containerName="copy" Sep 17 14:16:55.038948 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:16:55.038944 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="91127f03-d216-4c22-a672-3a8965ff6681" containerName="copy" Sep 17 14:16:55.039063 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:16:55.038992 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="91127f03-d216-4c22-a672-3a8965ff6681" containerName="copy" Sep 17 14:16:55.039063 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:16:55.039002 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="91127f03-d216-4c22-a672-3a8965ff6681" containerName="gather" Sep 17 14:16:55.043948 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:16:55.043930 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-fh67x/perf-node-gather-daemonset-zjzmr" Sep 17 14:16:55.047675 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:16:55.047656 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-fh67x\"/\"kube-root-ca.crt\"" Sep 17 14:16:55.048048 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:16:55.048032 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-fh67x\"/\"default-dockercfg-dxvxt\"" Sep 17 14:16:55.048362 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:16:55.048344 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-fh67x\"/\"openshift-service-ca.crt\"" Sep 17 14:16:55.061654 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:16:55.061621 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-fh67x/perf-node-gather-daemonset-zjzmr"] Sep 17 14:16:55.198210 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:16:55.198177 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fpplv\" (UniqueName: \"kubernetes.io/projected/04ab4643-bdaa-4780-9d06-1c67e7834e09-kube-api-access-fpplv\") pod \"perf-node-gather-daemonset-zjzmr\" (UID: \"04ab4643-bdaa-4780-9d06-1c67e7834e09\") " pod="openshift-must-gather-fh67x/perf-node-gather-daemonset-zjzmr" Sep 17 14:16:55.198360 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:16:55.198223 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/04ab4643-bdaa-4780-9d06-1c67e7834e09-sys\") pod \"perf-node-gather-daemonset-zjzmr\" (UID: \"04ab4643-bdaa-4780-9d06-1c67e7834e09\") " pod="openshift-must-gather-fh67x/perf-node-gather-daemonset-zjzmr" Sep 17 14:16:55.198360 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:16:55.198240 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/04ab4643-bdaa-4780-9d06-1c67e7834e09-proc\") pod \"perf-node-gather-daemonset-zjzmr\" (UID: \"04ab4643-bdaa-4780-9d06-1c67e7834e09\") " pod="openshift-must-gather-fh67x/perf-node-gather-daemonset-zjzmr" Sep 17 14:16:55.198360 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:16:55.198285 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/04ab4643-bdaa-4780-9d06-1c67e7834e09-podres\") pod \"perf-node-gather-daemonset-zjzmr\" (UID: \"04ab4643-bdaa-4780-9d06-1c67e7834e09\") " pod="openshift-must-gather-fh67x/perf-node-gather-daemonset-zjzmr" Sep 17 14:16:55.198360 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:16:55.198342 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/04ab4643-bdaa-4780-9d06-1c67e7834e09-lib-modules\") pod \"perf-node-gather-daemonset-zjzmr\" (UID: \"04ab4643-bdaa-4780-9d06-1c67e7834e09\") " pod="openshift-must-gather-fh67x/perf-node-gather-daemonset-zjzmr" Sep 17 14:16:55.299365 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:16:55.299297 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fpplv\" (UniqueName: \"kubernetes.io/projected/04ab4643-bdaa-4780-9d06-1c67e7834e09-kube-api-access-fpplv\") pod \"perf-node-gather-daemonset-zjzmr\" (UID: \"04ab4643-bdaa-4780-9d06-1c67e7834e09\") " pod="openshift-must-gather-fh67x/perf-node-gather-daemonset-zjzmr" Sep 17 14:16:55.299365 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:16:55.299332 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/04ab4643-bdaa-4780-9d06-1c67e7834e09-sys\") pod \"perf-node-gather-daemonset-zjzmr\" (UID: \"04ab4643-bdaa-4780-9d06-1c67e7834e09\") " pod="openshift-must-gather-fh67x/perf-node-gather-daemonset-zjzmr" Sep 17 14:16:55.299365 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:16:55.299348 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/04ab4643-bdaa-4780-9d06-1c67e7834e09-proc\") pod \"perf-node-gather-daemonset-zjzmr\" (UID: \"04ab4643-bdaa-4780-9d06-1c67e7834e09\") " pod="openshift-must-gather-fh67x/perf-node-gather-daemonset-zjzmr" Sep 17 14:16:55.299365 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:16:55.299364 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/04ab4643-bdaa-4780-9d06-1c67e7834e09-podres\") pod \"perf-node-gather-daemonset-zjzmr\" (UID: \"04ab4643-bdaa-4780-9d06-1c67e7834e09\") " pod="openshift-must-gather-fh67x/perf-node-gather-daemonset-zjzmr" Sep 17 14:16:55.299600 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:16:55.299389 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/04ab4643-bdaa-4780-9d06-1c67e7834e09-lib-modules\") pod \"perf-node-gather-daemonset-zjzmr\" (UID: \"04ab4643-bdaa-4780-9d06-1c67e7834e09\") " pod="openshift-must-gather-fh67x/perf-node-gather-daemonset-zjzmr" Sep 17 14:16:55.299600 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:16:55.299436 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/04ab4643-bdaa-4780-9d06-1c67e7834e09-sys\") pod \"perf-node-gather-daemonset-zjzmr\" (UID: \"04ab4643-bdaa-4780-9d06-1c67e7834e09\") " pod="openshift-must-gather-fh67x/perf-node-gather-daemonset-zjzmr" Sep 17 14:16:55.299600 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:16:55.299445 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/04ab4643-bdaa-4780-9d06-1c67e7834e09-proc\") pod \"perf-node-gather-daemonset-zjzmr\" (UID: \"04ab4643-bdaa-4780-9d06-1c67e7834e09\") " pod="openshift-must-gather-fh67x/perf-node-gather-daemonset-zjzmr" Sep 17 14:16:55.299600 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:16:55.299538 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/04ab4643-bdaa-4780-9d06-1c67e7834e09-lib-modules\") pod \"perf-node-gather-daemonset-zjzmr\" (UID: \"04ab4643-bdaa-4780-9d06-1c67e7834e09\") " pod="openshift-must-gather-fh67x/perf-node-gather-daemonset-zjzmr" Sep 17 14:16:55.299600 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:16:55.299538 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/04ab4643-bdaa-4780-9d06-1c67e7834e09-podres\") pod \"perf-node-gather-daemonset-zjzmr\" (UID: \"04ab4643-bdaa-4780-9d06-1c67e7834e09\") " pod="openshift-must-gather-fh67x/perf-node-gather-daemonset-zjzmr" Sep 17 14:16:55.314678 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:16:55.314657 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fpplv\" (UniqueName: \"kubernetes.io/projected/04ab4643-bdaa-4780-9d06-1c67e7834e09-kube-api-access-fpplv\") pod \"perf-node-gather-daemonset-zjzmr\" (UID: \"04ab4643-bdaa-4780-9d06-1c67e7834e09\") " pod="openshift-must-gather-fh67x/perf-node-gather-daemonset-zjzmr" Sep 17 14:16:55.353447 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:16:55.353424 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-fh67x/perf-node-gather-daemonset-zjzmr" Sep 17 14:16:55.640998 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:16:55.640968 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-fh67x/perf-node-gather-daemonset-zjzmr"] Sep 17 14:16:55.642614 ip-10-0-129-36 kubenswrapper[2558]: W0917 14:16:55.642588 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod04ab4643_bdaa_4780_9d06_1c67e7834e09.slice/crio-8bccdd0e73e56442ecabd9ff9d737dfbde82fb3a49a4e6f029ddf454d334d538 WatchSource:0}: Error finding container 8bccdd0e73e56442ecabd9ff9d737dfbde82fb3a49a4e6f029ddf454d334d538: Status 404 returned error can't find the container with id 8bccdd0e73e56442ecabd9ff9d737dfbde82fb3a49a4e6f029ddf454d334d538 Sep 17 14:16:56.075972 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:16:56.075946 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-d6h6t_c723f8fb-19bb-4b1a-952b-90698d5605f0/console-operator/1.log" Sep 17 14:16:56.081184 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:16:56.081162 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-d6h6t_c723f8fb-19bb-4b1a-952b-90698d5605f0/console-operator/2.log" Sep 17 14:16:56.289086 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:16:56.289048 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fh67x/perf-node-gather-daemonset-zjzmr" event={"ID":"04ab4643-bdaa-4780-9d06-1c67e7834e09","Type":"ContainerStarted","Data":"2d1b0596fbc0ff26a9441064a183c24d2f997835d84399f6a1ba462c28cd0045"} Sep 17 14:16:56.289279 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:16:56.289109 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fh67x/perf-node-gather-daemonset-zjzmr" event={"ID":"04ab4643-bdaa-4780-9d06-1c67e7834e09","Type":"ContainerStarted","Data":"8bccdd0e73e56442ecabd9ff9d737dfbde82fb3a49a4e6f029ddf454d334d538"} Sep 17 14:16:56.289279 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:16:56.289179 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-fh67x/perf-node-gather-daemonset-zjzmr" Sep 17 14:16:56.314066 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:16:56.314026 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-fh67x/perf-node-gather-daemonset-zjzmr" podStartSLOduration=1.314012982 podStartE2EDuration="1.314012982s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 14:16:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:16:56.311683279 +0000 UTC m=+585.270702798" watchObservedRunningTime="2026-09-17 14:16:56.314012982 +0000 UTC m=+585.273032532" Sep 17 14:16:56.576144 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:16:56.576118 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-76f99584f4-9wcnk_14f67a3c-fb51-46e1-a7f7-f693c6310088/download-server/0.log" Sep 17 14:16:58.482317 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:16:58.482291 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-gjjjg_288ba618-7808-4554-946b-8a4ed475131a/dns/0.log" Sep 17 14:16:58.517281 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:16:58.517256 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-gjjjg_288ba618-7808-4554-946b-8a4ed475131a/kube-rbac-proxy/0.log" Sep 17 14:16:58.654600 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:16:58.654579 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-kjm5t_0f675bf6-8f81-470f-b259-a9b21ddf230f/dns-node-resolver/0.log" Sep 17 14:16:59.324241 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:16:59.324222 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wxv7s_29942cdd-392c-45cc-94ad-e0e570e04856/node-ca/0.log" Sep 17 14:17:00.562419 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:17:00.562383 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-78f666855d-9dpdw_63f7b6df-18e8-435a-a4eb-488c23b60007/router/0.log" Sep 17 14:17:01.143887 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:17:01.143858 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-dgk98_77b443e6-d1b4-4737-b928-32ade7a07259/serve-healthcheck-canary/0.log" Sep 17 14:17:02.187702 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:17:02.187674 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zvgd2_57f41982-5828-4481-986b-59808cc7c372/kube-rbac-proxy/0.log" Sep 17 14:17:02.230097 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:17:02.230064 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zvgd2_57f41982-5828-4481-986b-59808cc7c372/exporter/0.log" Sep 17 14:17:02.257981 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:17:02.257945 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zvgd2_57f41982-5828-4481-986b-59808cc7c372/extractor/0.log" Sep 17 14:17:02.302952 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:17:02.302929 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-fh67x/perf-node-gather-daemonset-zjzmr" Sep 17 14:17:11.431750 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:17:11.431721 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-g2rvj_04e96b35-1239-43a4-92fb-ade601f5358e/kube-multus-additional-cni-plugins/0.log" Sep 17 14:17:11.435473 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:17:11.435453 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-d6h6t_c723f8fb-19bb-4b1a-952b-90698d5605f0/console-operator/1.log" Sep 17 14:17:11.438101 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:17:11.438079 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-d6h6t_c723f8fb-19bb-4b1a-952b-90698d5605f0/console-operator/1.log" Sep 17 14:17:11.465430 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:17:11.465409 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-g2rvj_04e96b35-1239-43a4-92fb-ade601f5358e/egress-router-binary-copy/0.log" Sep 17 14:17:11.500731 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:17:11.500711 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-g2rvj_04e96b35-1239-43a4-92fb-ade601f5358e/cni-plugins/0.log" Sep 17 14:17:11.537686 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:17:11.537667 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-g2rvj_04e96b35-1239-43a4-92fb-ade601f5358e/bond-cni-plugin/0.log" Sep 17 14:17:11.575144 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:17:11.575122 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-g2rvj_04e96b35-1239-43a4-92fb-ade601f5358e/routeoverride-cni/0.log" Sep 17 14:17:11.624012 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:17:11.623991 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-g2rvj_04e96b35-1239-43a4-92fb-ade601f5358e/whereabouts-cni-bincopy/0.log" Sep 17 14:17:11.655750 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:17:11.655700 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-g2rvj_04e96b35-1239-43a4-92fb-ade601f5358e/whereabouts-cni/0.log" Sep 17 14:17:11.918425 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:17:11.918364 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-f4grz_90708755-5dda-47a7-8c9d-aab17778d946/kube-multus/0.log" Sep 17 14:17:12.098144 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:17:12.098118 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-8qrmx_345f5575-9f8c-486b-9d57-7570a932d5a4/network-metrics-daemon/0.log" Sep 17 14:17:12.147677 ip-10-0-129-36 kubenswrapper[2558]: I0917 14:17:12.147653 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-8qrmx_345f5575-9f8c-486b-9d57-7570a932d5a4/kube-rbac-proxy/0.log"