Sep 08 02:38:38.546124 ip-10-0-137-161 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Sep 08 02:38:38.546137 ip-10-0-137-161 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Sep 08 02:38:38.546144 ip-10-0-137-161 systemd[1]: kubelet.service: Failed with result 'resources'. Sep 08 02:38:38.546364 ip-10-0-137-161 systemd[1]: Failed to start Kubernetes Kubelet. Sep 08 02:38:48.076231 ip-10-0-137-161 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Sep 08 02:38:48.076247 ip-10-0-137-161 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 4932421360e5428d872df9f9b83d403a -- Sep 08 02:40:34.080434 ip-10-0-137-161 systemd[1]: Starting Kubernetes Kubelet... Sep 08 02:40:34.536281 ip-10-0-137-161 kubenswrapper[2564]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 08 02:40:34.536281 ip-10-0-137-161 kubenswrapper[2564]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 08 02:40:34.536281 ip-10-0-137-161 kubenswrapper[2564]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 08 02:40:34.536281 ip-10-0-137-161 kubenswrapper[2564]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 08 02:40:34.536281 ip-10-0-137-161 kubenswrapper[2564]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 08 02:40:34.540194 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.540114 2564 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 08 02:40:34.542874 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.542858 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 08 02:40:34.542874 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.542875 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 08 02:40:34.542939 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.542879 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 08 02:40:34.542939 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.542882 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 08 02:40:34.542939 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.542885 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 08 02:40:34.542939 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.542889 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 08 02:40:34.542939 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.542892 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 08 02:40:34.542939 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.542895 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 08 02:40:34.542939 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.542898 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 08 02:40:34.542939 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.542901 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 08 02:40:34.542939 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.542904 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 08 02:40:34.542939 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.542907 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 08 02:40:34.542939 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.542910 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 08 02:40:34.542939 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.542915 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 08 02:40:34.542939 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.542919 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 08 02:40:34.542939 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.542922 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 08 02:40:34.542939 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.542925 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 08 02:40:34.542939 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.542928 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 08 02:40:34.542939 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.542931 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 08 02:40:34.542939 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.542934 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 08 02:40:34.542939 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.542937 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 08 02:40:34.543417 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.542940 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 08 02:40:34.543417 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.542943 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 08 02:40:34.543417 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.542946 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 08 02:40:34.543417 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.542949 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 08 02:40:34.543417 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.542952 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 08 02:40:34.543417 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.542956 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 08 02:40:34.543417 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.542960 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 08 02:40:34.543417 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.542963 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 08 02:40:34.543417 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.542966 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 08 02:40:34.543417 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.542969 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 08 02:40:34.543417 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.542972 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 08 02:40:34.543417 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.542974 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 08 02:40:34.543417 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.542977 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 08 02:40:34.543417 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.542980 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 08 02:40:34.543417 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.542982 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 08 02:40:34.543417 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.542985 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 08 02:40:34.543417 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.542987 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 08 02:40:34.543417 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.542989 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 08 02:40:34.543417 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.542992 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 08 02:40:34.543924 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.542995 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 08 02:40:34.543924 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.542997 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 08 02:40:34.543924 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.543000 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 08 02:40:34.543924 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.543003 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 08 02:40:34.543924 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.543005 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 08 02:40:34.543924 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.543008 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 08 02:40:34.543924 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.543010 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 08 02:40:34.543924 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.543013 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 08 02:40:34.543924 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.543015 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 08 02:40:34.543924 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.543018 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 08 02:40:34.543924 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.543020 2564 feature_gate.go:328] unrecognized feature gate: Example2 Sep 08 02:40:34.543924 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.543023 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 08 02:40:34.543924 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.543025 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 08 02:40:34.543924 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.543028 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 08 02:40:34.543924 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.543031 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 08 02:40:34.543924 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.543034 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 08 02:40:34.543924 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.543037 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 08 02:40:34.543924 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.543039 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 08 02:40:34.543924 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.543042 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 08 02:40:34.543924 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.543045 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 08 02:40:34.544434 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.543047 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 08 02:40:34.544434 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.543051 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 08 02:40:34.544434 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.543053 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 08 02:40:34.544434 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.543057 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 08 02:40:34.544434 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.543060 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 08 02:40:34.544434 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.543063 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 08 02:40:34.544434 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.543065 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 08 02:40:34.544434 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.543068 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 08 02:40:34.544434 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.543071 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 08 02:40:34.544434 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.543073 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 08 02:40:34.544434 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.543076 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 08 02:40:34.544434 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.543079 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 08 02:40:34.544434 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.543081 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 08 02:40:34.544434 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.543083 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 08 02:40:34.544434 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.543099 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 08 02:40:34.544434 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.543102 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 08 02:40:34.544434 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.543105 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 08 02:40:34.544434 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.543109 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 08 02:40:34.544434 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.543113 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 08 02:40:34.544904 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.543116 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 08 02:40:34.544904 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.543119 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 08 02:40:34.544904 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.543122 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 08 02:40:34.544904 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.543125 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 08 02:40:34.544904 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.543128 2564 feature_gate.go:328] unrecognized feature gate: Example Sep 08 02:40:34.544904 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.543131 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 08 02:40:34.544904 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.543134 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 08 02:40:34.544904 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.543137 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 08 02:40:34.544904 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.543140 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 08 02:40:34.544904 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.543144 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 08 02:40:34.544904 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.543146 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 08 02:40:34.544904 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.543150 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 08 02:40:34.544904 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.543153 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 08 02:40:34.544904 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.543156 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 08 02:40:34.544904 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.543160 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 08 02:40:34.544904 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.543162 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 08 02:40:34.544904 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.543165 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 08 02:40:34.544904 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.543168 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 08 02:40:34.544904 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.543171 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 08 02:40:34.544904 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.543174 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 08 02:40:34.547540 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.547517 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 08 02:40:34.547540 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.547533 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 08 02:40:34.547540 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.547537 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 08 02:40:34.547540 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.547541 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 08 02:40:34.547540 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.547544 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 08 02:40:34.547540 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.547546 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 08 02:40:34.547540 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.547550 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 08 02:40:34.547540 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.547552 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 08 02:40:34.547846 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.547563 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 08 02:40:34.547846 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.547569 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 08 02:40:34.547846 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.547573 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 08 02:40:34.547846 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.547576 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 08 02:40:34.547846 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.547579 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 08 02:40:34.547846 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.547582 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 08 02:40:34.547846 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.547584 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 08 02:40:34.547846 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.547587 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 08 02:40:34.547846 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.547590 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 08 02:40:34.547846 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.547593 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 08 02:40:34.547846 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.547596 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 08 02:40:34.547846 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.547598 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 08 02:40:34.547846 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.547601 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 08 02:40:34.547846 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.547603 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 08 02:40:34.547846 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.547606 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 08 02:40:34.547846 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.547608 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 08 02:40:34.547846 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.547611 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 08 02:40:34.547846 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.547614 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 08 02:40:34.547846 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.547616 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 08 02:40:34.548353 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.547619 2564 feature_gate.go:328] unrecognized feature gate: Example Sep 08 02:40:34.548353 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.547621 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 08 02:40:34.548353 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.547624 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 08 02:40:34.548353 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.547626 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 08 02:40:34.548353 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.547628 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 08 02:40:34.548353 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.547637 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 08 02:40:34.548353 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.547639 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 08 02:40:34.548353 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.547642 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 08 02:40:34.548353 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.547645 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 08 02:40:34.548353 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.547647 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 08 02:40:34.548353 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.547650 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 08 02:40:34.548353 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.547652 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 08 02:40:34.548353 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.547655 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 08 02:40:34.548353 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.547657 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 08 02:40:34.548353 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.547661 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 08 02:40:34.548353 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.547664 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 08 02:40:34.548353 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.547667 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 08 02:40:34.548353 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.547669 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 08 02:40:34.548353 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.547672 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 08 02:40:34.548353 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.547674 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 08 02:40:34.548917 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.547677 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 08 02:40:34.548917 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.547681 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 08 02:40:34.548917 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.547683 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 08 02:40:34.548917 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.547686 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 08 02:40:34.548917 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.547689 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 08 02:40:34.548917 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.547691 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 08 02:40:34.548917 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.547694 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 08 02:40:34.548917 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.547697 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 08 02:40:34.548917 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.547702 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 08 02:40:34.548917 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.547706 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 08 02:40:34.548917 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.547709 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 08 02:40:34.548917 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.547712 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 08 02:40:34.548917 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.547715 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 08 02:40:34.548917 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.547719 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 08 02:40:34.548917 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.547722 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 08 02:40:34.548917 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.547725 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 08 02:40:34.548917 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.547728 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 08 02:40:34.548917 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.547730 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 08 02:40:34.548917 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.547733 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 08 02:40:34.549429 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.547736 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 08 02:40:34.549429 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.547739 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 08 02:40:34.549429 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.547742 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 08 02:40:34.549429 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.547744 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 08 02:40:34.549429 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.547747 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 08 02:40:34.549429 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.547749 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 08 02:40:34.549429 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.547753 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 08 02:40:34.549429 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.547756 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 08 02:40:34.549429 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.547759 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 08 02:40:34.549429 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.547761 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 08 02:40:34.549429 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.547764 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 08 02:40:34.549429 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.547766 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 08 02:40:34.549429 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.547769 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 08 02:40:34.549429 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.547772 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 08 02:40:34.549429 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.547775 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 08 02:40:34.549429 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.547778 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 08 02:40:34.549429 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.547780 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 08 02:40:34.549429 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.547784 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 08 02:40:34.549429 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.547786 2564 feature_gate.go:328] unrecognized feature gate: Example2 Sep 08 02:40:34.549429 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.547789 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 08 02:40:34.549932 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.547792 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 08 02:40:34.549932 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.547794 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 08 02:40:34.549932 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.547797 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 08 02:40:34.549932 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.547799 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 08 02:40:34.549932 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.547802 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 08 02:40:34.549932 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.547805 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 08 02:40:34.549932 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.547807 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 08 02:40:34.549932 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.547810 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 08 02:40:34.549932 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.547812 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 08 02:40:34.549932 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.547815 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 08 02:40:34.549932 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.547817 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 08 02:40:34.549932 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.547820 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 08 02:40:34.549932 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.547822 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 08 02:40:34.549932 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.548227 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 08 02:40:34.549932 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.548233 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 08 02:40:34.549932 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.548236 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 08 02:40:34.549932 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.548239 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 08 02:40:34.549932 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.548241 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 08 02:40:34.549932 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.548244 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 08 02:40:34.549932 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.548247 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 08 02:40:34.550449 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.548250 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 08 02:40:34.550449 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.548253 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 08 02:40:34.550449 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.548255 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 08 02:40:34.550449 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.548258 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 08 02:40:34.550449 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.548260 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 08 02:40:34.550449 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.548263 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 08 02:40:34.550449 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.548266 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 08 02:40:34.550449 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.548269 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 08 02:40:34.550449 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.548271 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 08 02:40:34.550449 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.548275 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 08 02:40:34.550449 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.548277 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 08 02:40:34.550449 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.548280 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 08 02:40:34.550449 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.548283 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 08 02:40:34.550449 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.548285 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 08 02:40:34.550449 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.548287 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 08 02:40:34.550449 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.548291 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 08 02:40:34.550449 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.548295 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 08 02:40:34.550449 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.548297 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 08 02:40:34.550449 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.548300 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 08 02:40:34.550919 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.548302 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 08 02:40:34.550919 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.548305 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 08 02:40:34.550919 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.548307 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 08 02:40:34.550919 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.548310 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 08 02:40:34.550919 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.548313 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 08 02:40:34.550919 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.548316 2564 feature_gate.go:328] unrecognized feature gate: Example Sep 08 02:40:34.550919 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.548319 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 08 02:40:34.550919 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.548322 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 08 02:40:34.550919 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.548324 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 08 02:40:34.550919 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.548327 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 08 02:40:34.550919 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.548330 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 08 02:40:34.550919 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.548332 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 08 02:40:34.550919 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.548335 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 08 02:40:34.550919 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.548337 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 08 02:40:34.550919 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.548340 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 08 02:40:34.550919 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.548344 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 08 02:40:34.550919 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.548348 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 08 02:40:34.550919 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.548351 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 08 02:40:34.550919 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.548354 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 08 02:40:34.551436 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.548357 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 08 02:40:34.551436 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.548360 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 08 02:40:34.551436 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.548363 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 08 02:40:34.551436 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.548367 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 08 02:40:34.551436 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.548370 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 08 02:40:34.551436 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.548374 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 08 02:40:34.551436 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.548377 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 08 02:40:34.551436 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.548379 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 08 02:40:34.551436 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.548383 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 08 02:40:34.551436 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.548386 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 08 02:40:34.551436 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.548388 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 08 02:40:34.551436 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.548391 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 08 02:40:34.551436 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.548394 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 08 02:40:34.551436 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.548397 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 08 02:40:34.551436 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.548399 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 08 02:40:34.551436 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.548402 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 08 02:40:34.551436 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.548404 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 08 02:40:34.551436 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.548407 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 08 02:40:34.551436 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.548409 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 08 02:40:34.551436 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.548412 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 08 02:40:34.551943 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.548415 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 08 02:40:34.551943 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.548418 2564 feature_gate.go:328] unrecognized feature gate: Example2 Sep 08 02:40:34.551943 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.548420 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 08 02:40:34.551943 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.548422 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 08 02:40:34.551943 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.548425 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 08 02:40:34.551943 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.548428 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 08 02:40:34.551943 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.548430 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 08 02:40:34.551943 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.548433 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 08 02:40:34.551943 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.548435 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 08 02:40:34.551943 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.548437 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 08 02:40:34.551943 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.548440 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 08 02:40:34.551943 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.548442 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 08 02:40:34.551943 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.548446 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 08 02:40:34.551943 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.548448 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 08 02:40:34.551943 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.548451 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 08 02:40:34.551943 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.548453 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 08 02:40:34.551943 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.548456 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 08 02:40:34.551943 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.548459 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 08 02:40:34.551943 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.548462 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 08 02:40:34.551943 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.548465 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 08 02:40:34.552532 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.548468 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 08 02:40:34.552532 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.548470 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 08 02:40:34.552532 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.548472 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 08 02:40:34.552532 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.548475 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 08 02:40:34.552532 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.548477 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 08 02:40:34.552532 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.548480 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 08 02:40:34.552532 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.548482 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 08 02:40:34.552532 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.548485 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 08 02:40:34.552532 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.548487 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 08 02:40:34.552532 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.548490 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 08 02:40:34.552532 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.548492 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 08 02:40:34.552532 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.548495 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 08 02:40:34.552532 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.548497 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 08 02:40:34.552532 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.548500 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 08 02:40:34.552532 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.548579 2564 flags.go:64] FLAG: --address="0.0.0.0" Sep 08 02:40:34.552532 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.548616 2564 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 08 02:40:34.552532 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.548622 2564 flags.go:64] FLAG: --anonymous-auth="true" Sep 08 02:40:34.552532 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.548627 2564 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 08 02:40:34.552532 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.548631 2564 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 08 02:40:34.552532 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.548635 2564 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 08 02:40:34.552532 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.548639 2564 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 08 02:40:34.553050 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.548644 2564 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 08 02:40:34.553050 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.548647 2564 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 08 02:40:34.553050 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.548650 2564 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 08 02:40:34.553050 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.548654 2564 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 08 02:40:34.553050 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.548657 2564 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 08 02:40:34.553050 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.548661 2564 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 08 02:40:34.553050 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.548663 2564 flags.go:64] FLAG: --cgroup-root="" Sep 08 02:40:34.553050 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.548666 2564 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 08 02:40:34.553050 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.548669 2564 flags.go:64] FLAG: --client-ca-file="" Sep 08 02:40:34.553050 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.548673 2564 flags.go:64] FLAG: --cloud-provider="external" Sep 08 02:40:34.553050 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.548676 2564 flags.go:64] FLAG: --cluster-dns="[]" Sep 08 02:40:34.553050 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.548681 2564 flags.go:64] FLAG: --cluster-domain="" Sep 08 02:40:34.553050 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.548683 2564 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 08 02:40:34.553050 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.548686 2564 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 08 02:40:34.553050 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.548689 2564 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 08 02:40:34.553050 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.548693 2564 flags.go:64] FLAG: --container-log-max-files="5" Sep 08 02:40:34.553050 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.548696 2564 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 08 02:40:34.553050 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.548699 2564 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 08 02:40:34.553050 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.548702 2564 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 08 02:40:34.553050 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.548705 2564 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 08 02:40:34.553050 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.548708 2564 flags.go:64] FLAG: --contention-profiling="false" Sep 08 02:40:34.553050 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.548711 2564 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 08 02:40:34.553050 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.548715 2564 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 08 02:40:34.553050 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.548718 2564 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 08 02:40:34.553688 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.548721 2564 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 08 02:40:34.553688 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.548730 2564 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 08 02:40:34.553688 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.548733 2564 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 08 02:40:34.553688 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.548736 2564 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 08 02:40:34.553688 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.548739 2564 flags.go:64] FLAG: --enable-load-reader="false" Sep 08 02:40:34.553688 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.548742 2564 flags.go:64] FLAG: --enable-server="true" Sep 08 02:40:34.553688 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.548744 2564 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 08 02:40:34.553688 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.548749 2564 flags.go:64] FLAG: --event-burst="100" Sep 08 02:40:34.553688 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.548752 2564 flags.go:64] FLAG: --event-qps="50" Sep 08 02:40:34.553688 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.548755 2564 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 08 02:40:34.553688 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.548758 2564 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 08 02:40:34.553688 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.548761 2564 flags.go:64] FLAG: --eviction-hard="" Sep 08 02:40:34.553688 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.548764 2564 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 08 02:40:34.553688 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.548767 2564 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 08 02:40:34.553688 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.548770 2564 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 08 02:40:34.553688 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.548773 2564 flags.go:64] FLAG: --eviction-soft="" Sep 08 02:40:34.553688 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.548776 2564 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 08 02:40:34.553688 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.548779 2564 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 08 02:40:34.553688 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.548786 2564 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 08 02:40:34.553688 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.548789 2564 flags.go:64] FLAG: --experimental-mounter-path="" Sep 08 02:40:34.553688 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.548792 2564 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 08 02:40:34.553688 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.548794 2564 flags.go:64] FLAG: --fail-swap-on="true" Sep 08 02:40:34.553688 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.548797 2564 flags.go:64] FLAG: --feature-gates="" Sep 08 02:40:34.553688 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.548801 2564 flags.go:64] FLAG: --file-check-frequency="20s" Sep 08 02:40:34.553688 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.548804 2564 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 08 02:40:34.554380 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.548807 2564 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 08 02:40:34.554380 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.548810 2564 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 08 02:40:34.554380 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.548813 2564 flags.go:64] FLAG: --healthz-port="10248" Sep 08 02:40:34.554380 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.548816 2564 flags.go:64] FLAG: --help="false" Sep 08 02:40:34.554380 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.548818 2564 flags.go:64] FLAG: --hostname-override="ip-10-0-137-161.ec2.internal" Sep 08 02:40:34.554380 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.548822 2564 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 08 02:40:34.554380 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.548825 2564 flags.go:64] FLAG: --http-check-frequency="20s" Sep 08 02:40:34.554380 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.548827 2564 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 08 02:40:34.554380 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.548831 2564 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 08 02:40:34.554380 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.548834 2564 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 08 02:40:34.554380 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.548837 2564 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 08 02:40:34.554380 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.548840 2564 flags.go:64] FLAG: --image-service-endpoint="" Sep 08 02:40:34.554380 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.548842 2564 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 08 02:40:34.554380 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.548845 2564 flags.go:64] FLAG: --kube-api-burst="100" Sep 08 02:40:34.554380 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.548848 2564 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 08 02:40:34.554380 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.548851 2564 flags.go:64] FLAG: --kube-api-qps="50" Sep 08 02:40:34.554380 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.548854 2564 flags.go:64] FLAG: --kube-reserved="" Sep 08 02:40:34.554380 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.548857 2564 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 08 02:40:34.554380 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.548860 2564 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 08 02:40:34.554380 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.548863 2564 flags.go:64] FLAG: --kubelet-cgroups="" Sep 08 02:40:34.554380 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.548866 2564 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 08 02:40:34.554380 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.548868 2564 flags.go:64] FLAG: --lock-file="" Sep 08 02:40:34.554380 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.548871 2564 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 08 02:40:34.554380 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.548874 2564 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 08 02:40:34.554968 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.548877 2564 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 08 02:40:34.554968 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.548884 2564 flags.go:64] FLAG: --log-json-split-stream="false" Sep 08 02:40:34.554968 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.548887 2564 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 08 02:40:34.554968 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.548890 2564 flags.go:64] FLAG: --log-text-split-stream="false" Sep 08 02:40:34.554968 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.548893 2564 flags.go:64] FLAG: --logging-format="text" Sep 08 02:40:34.554968 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.548895 2564 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 08 02:40:34.554968 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.548899 2564 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 08 02:40:34.554968 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.548901 2564 flags.go:64] FLAG: --manifest-url="" Sep 08 02:40:34.554968 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.548904 2564 flags.go:64] FLAG: --manifest-url-header="" Sep 08 02:40:34.554968 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.548908 2564 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 08 02:40:34.554968 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.548911 2564 flags.go:64] FLAG: --max-open-files="1000000" Sep 08 02:40:34.554968 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.548916 2564 flags.go:64] FLAG: --max-pods="110" Sep 08 02:40:34.554968 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.548919 2564 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 08 02:40:34.554968 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.548922 2564 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 08 02:40:34.554968 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.548927 2564 flags.go:64] FLAG: --memory-manager-policy="None" Sep 08 02:40:34.554968 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.548930 2564 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 08 02:40:34.554968 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.548933 2564 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 08 02:40:34.554968 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.548936 2564 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 08 02:40:34.554968 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.548939 2564 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 08 02:40:34.554968 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.548946 2564 flags.go:64] FLAG: --node-status-max-images="50" Sep 08 02:40:34.554968 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.548949 2564 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 08 02:40:34.554968 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.548953 2564 flags.go:64] FLAG: --oom-score-adj="-999" Sep 08 02:40:34.554968 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.548956 2564 flags.go:64] FLAG: --pod-cidr="" Sep 08 02:40:34.555576 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.548959 2564 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1" Sep 08 02:40:34.555576 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.548964 2564 flags.go:64] FLAG: --pod-manifest-path="" Sep 08 02:40:34.555576 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.548967 2564 flags.go:64] FLAG: --pod-max-pids="-1" Sep 08 02:40:34.555576 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.548970 2564 flags.go:64] FLAG: --pods-per-core="0" Sep 08 02:40:34.555576 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.548973 2564 flags.go:64] FLAG: --port="10250" Sep 08 02:40:34.555576 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.548976 2564 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 08 02:40:34.555576 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.548979 2564 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0f79c00a0850fcbad" Sep 08 02:40:34.555576 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.548982 2564 flags.go:64] FLAG: --qos-reserved="" Sep 08 02:40:34.555576 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.548984 2564 flags.go:64] FLAG: --read-only-port="10255" Sep 08 02:40:34.555576 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.548987 2564 flags.go:64] FLAG: --register-node="true" Sep 08 02:40:34.555576 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.548991 2564 flags.go:64] FLAG: --register-with-taints="" Sep 08 02:40:34.555576 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.548995 2564 flags.go:64] FLAG: --registry-burst="10" Sep 08 02:40:34.555576 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.548999 2564 flags.go:64] FLAG: --registry-qps="5" Sep 08 02:40:34.555576 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.549002 2564 flags.go:64] FLAG: --reserved-cpus="" Sep 08 02:40:34.555576 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.549005 2564 flags.go:64] FLAG: --reserved-memory="" Sep 08 02:40:34.555576 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.549009 2564 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 08 02:40:34.555576 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.549012 2564 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 08 02:40:34.555576 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.549015 2564 flags.go:64] FLAG: --rotate-certificates="false" Sep 08 02:40:34.555576 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.549018 2564 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 08 02:40:34.555576 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.549020 2564 flags.go:64] FLAG: --runonce="false" Sep 08 02:40:34.555576 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.549023 2564 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 08 02:40:34.555576 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.549026 2564 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 08 02:40:34.555576 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.549029 2564 flags.go:64] FLAG: --seccomp-default="false" Sep 08 02:40:34.555576 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.549032 2564 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 08 02:40:34.555576 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.549036 2564 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 08 02:40:34.556211 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.549039 2564 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 08 02:40:34.556211 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.549042 2564 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 08 02:40:34.556211 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.549045 2564 flags.go:64] FLAG: --storage-driver-password="root" Sep 08 02:40:34.556211 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.549048 2564 flags.go:64] FLAG: --storage-driver-secure="false" Sep 08 02:40:34.556211 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.549050 2564 flags.go:64] FLAG: --storage-driver-table="stats" Sep 08 02:40:34.556211 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.549053 2564 flags.go:64] FLAG: --storage-driver-user="root" Sep 08 02:40:34.556211 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.549056 2564 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 08 02:40:34.556211 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.549059 2564 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 08 02:40:34.556211 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.549062 2564 flags.go:64] FLAG: --system-cgroups="" Sep 08 02:40:34.556211 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.549065 2564 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 08 02:40:34.556211 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.549070 2564 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 08 02:40:34.556211 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.549072 2564 flags.go:64] FLAG: --tls-cert-file="" Sep 08 02:40:34.556211 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.549075 2564 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 08 02:40:34.556211 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.549081 2564 flags.go:64] FLAG: --tls-min-version="" Sep 08 02:40:34.556211 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.549084 2564 flags.go:64] FLAG: --tls-private-key-file="" Sep 08 02:40:34.556211 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.549101 2564 flags.go:64] FLAG: --topology-manager-policy="none" Sep 08 02:40:34.556211 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.549104 2564 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 08 02:40:34.556211 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.549108 2564 flags.go:64] FLAG: --topology-manager-scope="container" Sep 08 02:40:34.556211 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.549111 2564 flags.go:64] FLAG: --v="2" Sep 08 02:40:34.556211 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.549115 2564 flags.go:64] FLAG: --version="false" Sep 08 02:40:34.556211 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.549120 2564 flags.go:64] FLAG: --vmodule="" Sep 08 02:40:34.556211 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.549124 2564 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 08 02:40:34.556211 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.549127 2564 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 08 02:40:34.556211 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.549242 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 08 02:40:34.556211 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.549246 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 08 02:40:34.556844 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.549249 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 08 02:40:34.556844 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.549251 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 08 02:40:34.556844 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.549255 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 08 02:40:34.556844 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.549258 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 08 02:40:34.556844 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.549261 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 08 02:40:34.556844 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.549263 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 08 02:40:34.556844 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.549267 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 08 02:40:34.556844 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.549270 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 08 02:40:34.556844 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.549273 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 08 02:40:34.556844 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.549276 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 08 02:40:34.556844 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.549279 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 08 02:40:34.556844 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.549281 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 08 02:40:34.556844 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.549284 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 08 02:40:34.556844 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.549288 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 08 02:40:34.556844 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.549291 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 08 02:40:34.556844 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.549294 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 08 02:40:34.556844 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.549298 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 08 02:40:34.556844 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.549300 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 08 02:40:34.556844 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.549303 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 08 02:40:34.556844 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.549306 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 08 02:40:34.557371 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.549309 2564 feature_gate.go:328] unrecognized feature gate: Example2 Sep 08 02:40:34.557371 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.549312 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 08 02:40:34.557371 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.549314 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 08 02:40:34.557371 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.549317 2564 feature_gate.go:328] unrecognized feature gate: Example Sep 08 02:40:34.557371 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.549321 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 08 02:40:34.557371 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.549324 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 08 02:40:34.557371 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.549327 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 08 02:40:34.557371 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.549329 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 08 02:40:34.557371 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.549335 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 08 02:40:34.557371 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.549338 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 08 02:40:34.557371 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.549341 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 08 02:40:34.557371 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.549343 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 08 02:40:34.557371 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.549345 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 08 02:40:34.557371 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.549348 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 08 02:40:34.557371 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.549351 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 08 02:40:34.557371 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.549353 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 08 02:40:34.557371 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.549356 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 08 02:40:34.557371 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.549358 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 08 02:40:34.557371 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.549364 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 08 02:40:34.557371 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.549367 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 08 02:40:34.557371 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.549369 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 08 02:40:34.557891 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.549372 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 08 02:40:34.557891 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.549374 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 08 02:40:34.557891 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.549377 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 08 02:40:34.557891 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.549379 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 08 02:40:34.557891 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.549383 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 08 02:40:34.557891 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.549385 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 08 02:40:34.557891 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.549388 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 08 02:40:34.557891 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.549390 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 08 02:40:34.557891 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.549393 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 08 02:40:34.557891 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.549396 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 08 02:40:34.557891 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.549398 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 08 02:40:34.557891 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.549401 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 08 02:40:34.557891 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.549403 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 08 02:40:34.557891 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.549406 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 08 02:40:34.557891 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.549408 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 08 02:40:34.557891 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.549412 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 08 02:40:34.557891 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.549415 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 08 02:40:34.557891 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.549417 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 08 02:40:34.557891 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.549420 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 08 02:40:34.558451 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.549422 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 08 02:40:34.558451 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.549425 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 08 02:40:34.558451 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.549428 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 08 02:40:34.558451 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.549431 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 08 02:40:34.558451 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.549433 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 08 02:40:34.558451 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.549436 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 08 02:40:34.558451 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.549439 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 08 02:40:34.558451 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.549442 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 08 02:40:34.558451 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.549444 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 08 02:40:34.558451 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.549447 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 08 02:40:34.558451 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.549450 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 08 02:40:34.558451 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.549453 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 08 02:40:34.558451 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.549456 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 08 02:40:34.558451 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.549458 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 08 02:40:34.558451 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.549461 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 08 02:40:34.558451 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.549464 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 08 02:40:34.558451 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.549466 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 08 02:40:34.558451 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.549470 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 08 02:40:34.558451 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.549473 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 08 02:40:34.558451 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.549476 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 08 02:40:34.558937 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.549479 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 08 02:40:34.558937 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.549481 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 08 02:40:34.558937 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.549484 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 08 02:40:34.558937 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.549487 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 08 02:40:34.558937 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.549489 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 08 02:40:34.558937 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.549492 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 08 02:40:34.558937 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.549494 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 08 02:40:34.558937 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.549497 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 08 02:40:34.558937 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.549501 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 08 02:40:34.558937 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.549503 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 08 02:40:34.558937 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.549507 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 08 02:40:34.558937 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.549511 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 08 02:40:34.558937 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.549513 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 08 02:40:34.558937 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.549516 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 08 02:40:34.558937 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.549520 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 08 02:40:34.558937 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.549523 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 08 02:40:34.558937 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.549525 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 08 02:40:34.559418 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.550154 2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 08 02:40:34.559418 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.556835 2564 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 08 02:40:34.559418 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.556850 2564 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 08 02:40:34.559418 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.556867 2564 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 08 02:40:34.559418 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.556876 2564 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 08 02:40:34.559418 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.556931 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 08 02:40:34.559418 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.556936 2564 feature_gate.go:328] unrecognized feature gate: Example Sep 08 02:40:34.559418 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.556939 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 08 02:40:34.559418 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.556942 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 08 02:40:34.559418 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.556945 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 08 02:40:34.559418 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.556949 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 08 02:40:34.559418 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.556952 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 08 02:40:34.559418 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.556955 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 08 02:40:34.559418 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.556958 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 08 02:40:34.559418 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.556961 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 08 02:40:34.559806 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.556963 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 08 02:40:34.559806 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.556966 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 08 02:40:34.559806 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.556969 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 08 02:40:34.559806 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.556971 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 08 02:40:34.559806 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.556974 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 08 02:40:34.559806 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.556977 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 08 02:40:34.559806 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.556980 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 08 02:40:34.559806 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.556982 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 08 02:40:34.559806 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.556984 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 08 02:40:34.559806 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.556987 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 08 02:40:34.559806 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.556989 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 08 02:40:34.559806 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.556992 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 08 02:40:34.559806 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.556995 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 08 02:40:34.559806 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.556998 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 08 02:40:34.559806 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557001 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 08 02:40:34.559806 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557004 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 08 02:40:34.559806 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557007 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 08 02:40:34.559806 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557010 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 08 02:40:34.559806 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557012 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 08 02:40:34.559806 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557015 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 08 02:40:34.560315 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557018 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 08 02:40:34.560315 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557021 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 08 02:40:34.560315 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557024 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 08 02:40:34.560315 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557026 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 08 02:40:34.560315 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557029 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 08 02:40:34.560315 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557032 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 08 02:40:34.560315 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557034 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 08 02:40:34.560315 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557037 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 08 02:40:34.560315 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557039 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 08 02:40:34.560315 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557043 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 08 02:40:34.560315 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557047 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 08 02:40:34.560315 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557050 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 08 02:40:34.560315 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557053 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 08 02:40:34.560315 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557056 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 08 02:40:34.560315 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557059 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 08 02:40:34.560315 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557062 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 08 02:40:34.560315 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557065 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 08 02:40:34.560315 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557068 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 08 02:40:34.560315 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557070 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 08 02:40:34.560779 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557073 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 08 02:40:34.560779 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557076 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 08 02:40:34.560779 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557078 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 08 02:40:34.560779 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557081 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 08 02:40:34.560779 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557083 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 08 02:40:34.560779 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557086 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 08 02:40:34.560779 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557103 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 08 02:40:34.560779 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557107 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 08 02:40:34.560779 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557110 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 08 02:40:34.560779 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557113 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 08 02:40:34.560779 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557116 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 08 02:40:34.560779 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557119 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 08 02:40:34.560779 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557122 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 08 02:40:34.560779 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557125 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 08 02:40:34.560779 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557128 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 08 02:40:34.560779 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557130 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 08 02:40:34.560779 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557133 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 08 02:40:34.560779 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557137 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 08 02:40:34.560779 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557141 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 08 02:40:34.560779 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557144 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 08 02:40:34.561294 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557146 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 08 02:40:34.561294 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557149 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 08 02:40:34.561294 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557151 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 08 02:40:34.561294 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557154 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 08 02:40:34.561294 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557156 2564 feature_gate.go:328] unrecognized feature gate: Example2 Sep 08 02:40:34.561294 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557159 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 08 02:40:34.561294 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557161 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 08 02:40:34.561294 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557164 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 08 02:40:34.561294 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557166 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 08 02:40:34.561294 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557168 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 08 02:40:34.561294 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557171 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 08 02:40:34.561294 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557174 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 08 02:40:34.561294 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557176 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 08 02:40:34.561294 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557179 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 08 02:40:34.561294 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557182 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 08 02:40:34.561294 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557184 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 08 02:40:34.561294 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557186 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 08 02:40:34.561294 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557189 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 08 02:40:34.561294 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557192 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 08 02:40:34.561294 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557194 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 08 02:40:34.561812 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557198 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 08 02:40:34.561812 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557202 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 08 02:40:34.561812 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557205 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 08 02:40:34.561812 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557208 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 08 02:40:34.561812 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557211 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 08 02:40:34.561812 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557214 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 08 02:40:34.561812 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557216 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 08 02:40:34.561812 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557219 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 08 02:40:34.561812 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557221 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 08 02:40:34.561812 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557224 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 08 02:40:34.561812 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.557229 2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 08 02:40:34.561812 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557344 2564 feature_gate.go:328] unrecognized feature gate: Example2 Sep 08 02:40:34.561812 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557348 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 08 02:40:34.561812 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557351 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 08 02:40:34.561812 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557354 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 08 02:40:34.562324 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557357 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 08 02:40:34.562324 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557360 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 08 02:40:34.562324 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557363 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 08 02:40:34.562324 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557366 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 08 02:40:34.562324 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557369 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 08 02:40:34.562324 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557372 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 08 02:40:34.562324 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557376 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 08 02:40:34.562324 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557380 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 08 02:40:34.562324 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557383 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 08 02:40:34.562324 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557386 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 08 02:40:34.562324 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557389 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 08 02:40:34.562324 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557392 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 08 02:40:34.562324 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557395 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 08 02:40:34.562324 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557398 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 08 02:40:34.562324 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557400 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 08 02:40:34.562324 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557403 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 08 02:40:34.562324 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557406 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 08 02:40:34.562324 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557408 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 08 02:40:34.562324 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557411 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 08 02:40:34.562788 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557414 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 08 02:40:34.562788 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557416 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 08 02:40:34.562788 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557419 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 08 02:40:34.562788 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557422 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 08 02:40:34.562788 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557424 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 08 02:40:34.562788 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557426 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 08 02:40:34.562788 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557429 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 08 02:40:34.562788 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557431 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 08 02:40:34.562788 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557434 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 08 02:40:34.562788 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557436 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 08 02:40:34.562788 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557439 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 08 02:40:34.562788 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557441 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 08 02:40:34.562788 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557443 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 08 02:40:34.562788 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557446 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 08 02:40:34.562788 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557448 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 08 02:40:34.562788 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557452 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 08 02:40:34.562788 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557455 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 08 02:40:34.562788 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557457 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 08 02:40:34.562788 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557460 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 08 02:40:34.563268 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557462 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 08 02:40:34.563268 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557465 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 08 02:40:34.563268 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557467 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 08 02:40:34.563268 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557469 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 08 02:40:34.563268 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557472 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 08 02:40:34.563268 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557474 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 08 02:40:34.563268 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557477 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 08 02:40:34.563268 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557479 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 08 02:40:34.563268 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557482 2564 feature_gate.go:328] unrecognized feature gate: Example Sep 08 02:40:34.563268 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557484 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 08 02:40:34.563268 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557487 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 08 02:40:34.563268 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557489 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 08 02:40:34.563268 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557492 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 08 02:40:34.563268 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557494 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 08 02:40:34.563268 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557497 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 08 02:40:34.563268 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557500 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 08 02:40:34.563268 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557502 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 08 02:40:34.563268 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557505 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 08 02:40:34.563268 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557507 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 08 02:40:34.563268 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557510 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 08 02:40:34.563772 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557512 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 08 02:40:34.563772 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557515 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 08 02:40:34.563772 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557517 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 08 02:40:34.563772 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557520 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 08 02:40:34.563772 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557522 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 08 02:40:34.563772 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557525 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 08 02:40:34.563772 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557527 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 08 02:40:34.563772 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557530 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 08 02:40:34.563772 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557532 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 08 02:40:34.563772 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557535 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 08 02:40:34.563772 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557539 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 08 02:40:34.563772 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557542 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 08 02:40:34.563772 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557545 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 08 02:40:34.563772 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557548 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 08 02:40:34.563772 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557550 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 08 02:40:34.563772 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557553 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 08 02:40:34.563772 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557556 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 08 02:40:34.563772 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557558 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 08 02:40:34.563772 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557561 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 08 02:40:34.563772 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557563 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 08 02:40:34.564263 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557566 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 08 02:40:34.564263 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557568 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 08 02:40:34.564263 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557571 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 08 02:40:34.564263 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557574 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 08 02:40:34.564263 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557577 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 08 02:40:34.564263 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557579 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 08 02:40:34.564263 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557582 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 08 02:40:34.564263 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557585 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 08 02:40:34.564263 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557588 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 08 02:40:34.564263 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557590 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 08 02:40:34.564263 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557593 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 08 02:40:34.564263 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557595 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 08 02:40:34.564263 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557598 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 08 02:40:34.564263 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557600 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 08 02:40:34.564263 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557602 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 08 02:40:34.564263 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557605 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 08 02:40:34.564263 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:34.557607 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 08 02:40:34.564677 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.557612 2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 08 02:40:34.564677 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.557713 2564 server.go:962] "Client rotation is on, will bootstrap in background" Sep 08 02:40:34.564677 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.560004 2564 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 08 02:40:34.564677 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.561067 2564 server.go:1019] "Starting client certificate rotation" Sep 08 02:40:34.564677 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.561183 2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 08 02:40:34.564677 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.561222 2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 08 02:40:34.567719 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.567705 2564 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 08 02:40:34.568957 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.568940 2564 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 08 02:40:34.582837 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.582820 2564 log.go:25] "Validated CRI v1 runtime API" Sep 08 02:40:34.586392 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.586374 2564 log.go:25] "Validated CRI v1 image API" Sep 08 02:40:34.588816 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.588802 2564 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 08 02:40:34.590717 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.590698 2564 fs.go:135] Filesystem UUIDs: map[7425a64a-7eed-4b33-885f-680c28a6f094:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 e69ab389-4624-4f42-8fc4-f28c3d07c712:/dev/nvme0n1p4] Sep 08 02:40:34.590790 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.590716 2564 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 08 02:40:34.595584 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.595566 2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 08 02:40:34.596267 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.596156 2564 manager.go:216] Machine: {Timestamp:2026-09-08 02:40:34.595035394 +0000 UTC m=+0.396270137 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3114749 MemoryCapacity:33164484608 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec21a10908a51e8354d7a6d749618359 SystemUUID:ec21a109-08a5-1e83-54d7-a6d749618359 BootID:49324213-60e5-428d-872d-f9f9b83d403a Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:50:d0:76:5b:f7 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:50:d0:76:5b:f7 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:b6:b7:c1:d5:6d:e0 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164484608 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 08 02:40:34.596267 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.596263 2564 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 08 02:40:34.596367 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.596343 2564 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 08 02:40:34.599920 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.599892 2564 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 08 02:40:34.600067 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.599923 2564 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-137-161.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 08 02:40:34.600564 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.600553 2564 topology_manager.go:138] "Creating topology manager with none policy" Sep 08 02:40:34.600601 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.600566 2564 container_manager_linux.go:309] "Creating device plugin manager" Sep 08 02:40:34.600601 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.600574 2564 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 08 02:40:34.601827 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.601815 2564 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 08 02:40:34.603118 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.603107 2564 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 08 02:40:34.606895 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.606880 2564 state_mem.go:36] "Initialized new in-memory state store" Sep 08 02:40:34.607014 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.607004 2564 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 08 02:40:34.607054 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.607040 2564 kubelet.go:486] "Attempting to sync node with API server" Sep 08 02:40:34.607115 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.607056 2564 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 08 02:40:34.607115 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.607081 2564 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 08 02:40:34.607115 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.607107 2564 kubelet.go:398] "Adding apiserver pod source" Sep 08 02:40:34.607251 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.607124 2564 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 08 02:40:34.607492 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.607469 2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 08 02:40:34.607540 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.607500 2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 08 02:40:34.609725 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.609701 2564 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1" Sep 08 02:40:34.611836 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.611821 2564 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 08 02:40:34.611904 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.611857 2564 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 08 02:40:34.612704 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.612689 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 08 02:40:34.612774 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.612709 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 08 02:40:34.612774 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.612715 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 08 02:40:34.612774 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.612721 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 08 02:40:34.612774 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.612729 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 08 02:40:34.612774 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.612735 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 08 02:40:34.612774 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.612748 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 08 02:40:34.612774 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.612753 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 08 02:40:34.612774 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.612765 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 08 02:40:34.612774 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.612774 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 08 02:40:34.613015 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.612786 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 08 02:40:34.613015 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.612795 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 08 02:40:34.613394 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.613384 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 08 02:40:34.613426 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.613395 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 08 02:40:34.617461 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.617435 2564 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-137-161.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Sep 08 02:40:34.617593 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:40:34.617567 2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Sep 08 02:40:34.617675 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:40:34.617652 2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-137-161.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 08 02:40:34.617835 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.617824 2564 server.go:1268] "Started kubelet" Sep 08 02:40:34.617947 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.617919 2564 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 08 02:40:34.618044 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.617976 2564 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 08 02:40:34.618115 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.618062 2564 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 08 02:40:34.618665 ip-10-0-137-161 systemd[1]: Started Kubernetes Kubelet. Sep 08 02:40:34.621918 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.621896 2564 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 08 02:40:34.623384 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.623368 2564 server.go:310] "Adding debug handlers to kubelet server" Sep 08 02:40:34.625400 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:40:34.625385 2564 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 08 02:40:34.627150 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:40:34.625793 2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-161.ec2.internal.18d3382b111893dc default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-161.ec2.internal,UID:ip-10-0-137-161.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-137-161.ec2.internal,},FirstTimestamp:2026-09-08 02:40:34.617791452 +0000 UTC m=+0.419026194,LastTimestamp:2026-09-08 02:40:34.617791452 +0000 UTC m=+0.419026194,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-161.ec2.internal,}" Sep 08 02:40:34.629395 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.629377 2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 08 02:40:34.630145 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.630128 2564 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 08 02:40:34.630474 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:40:34.630450 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-161.ec2.internal\" not found" Sep 08 02:40:34.630885 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.630870 2564 factory.go:55] Registering systemd factory Sep 08 02:40:34.630885 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.630886 2564 factory.go:223] Registration of the systemd container factory successfully Sep 08 02:40:34.630992 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.630966 2564 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 08 02:40:34.630992 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.630981 2564 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 08 02:40:34.631084 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.630965 2564 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 08 02:40:34.631084 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.631042 2564 reconstruct.go:97] "Volume reconstruction finished" Sep 08 02:40:34.631084 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.631050 2564 reconciler.go:29] "Reconciler: start to sync state" Sep 08 02:40:34.631246 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.631119 2564 factory.go:153] Registering CRI-O factory Sep 08 02:40:34.631246 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.631132 2564 factory.go:223] Registration of the crio container factory successfully Sep 08 02:40:34.631246 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.631183 2564 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 08 02:40:34.631246 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.631199 2564 factory.go:103] Registering Raw factory Sep 08 02:40:34.631246 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.631213 2564 manager.go:1196] Started watching for new ooms in manager Sep 08 02:40:34.631583 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.631548 2564 manager.go:349] Starting recovery of all containers Sep 08 02:40:34.632400 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:40:34.632374 2564 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-137-161.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Sep 08 02:40:34.632512 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:40:34.632493 2564 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Sep 08 02:40:34.641245 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.641220 2564 manager.go:354] Recovery completed Sep 08 02:40:34.646200 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.645229 2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-gc4pp" Sep 08 02:40:34.646200 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.645983 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 08 02:40:34.649772 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.649741 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-161.ec2.internal" event="NodeHasSufficientMemory" Sep 08 02:40:34.649772 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.649768 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-161.ec2.internal" event="NodeHasNoDiskPressure" Sep 08 02:40:34.649913 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.649792 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-161.ec2.internal" event="NodeHasSufficientPID" Sep 08 02:40:34.650599 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.650585 2564 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 08 02:40:34.650599 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.650598 2564 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 08 02:40:34.650744 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.650603 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 08 02:40:34.650744 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.650615 2564 state_mem.go:36] "Initialized new in-memory state store" Sep 08 02:40:34.651032 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.651012 2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-gc4pp" Sep 08 02:40:34.651448 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.651435 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-161.ec2.internal" event="NodeHasSufficientMemory" Sep 08 02:40:34.651505 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.651459 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-161.ec2.internal" event="NodeHasNoDiskPressure" Sep 08 02:40:34.651505 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.651469 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-161.ec2.internal" event="NodeHasSufficientPID" Sep 08 02:40:34.652895 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.652880 2564 policy_none.go:49] "None policy: Start" Sep 08 02:40:34.652974 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.652898 2564 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 08 02:40:34.652974 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.652911 2564 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 08 02:40:34.654869 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.654855 2564 policy_none.go:47] "Start" Sep 08 02:40:34.686663 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.686642 2564 manager.go:337] "Starting Device Plugin manager" Sep 08 02:40:34.712556 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:40:34.686684 2564 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 08 02:40:34.712556 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.686697 2564 server.go:87] "Starting device plugin registration server" Sep 08 02:40:34.712556 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.687043 2564 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 08 02:40:34.712556 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.687055 2564 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 08 02:40:34.712556 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.687232 2564 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 08 02:40:34.712556 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.687318 2564 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 08 02:40:34.712556 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.687329 2564 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 08 02:40:34.712556 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:40:34.687915 2564 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 08 02:40:34.712556 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:40:34.687965 2564 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-137-161.ec2.internal\" not found" Sep 08 02:40:34.732799 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.732771 2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 08 02:40:34.734051 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.734025 2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 08 02:40:34.734162 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.734105 2564 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 08 02:40:34.734162 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.734129 2564 kubelet.go:2448] "Starting kubelet main sync loop" Sep 08 02:40:34.734259 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:40:34.734175 2564 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Sep 08 02:40:34.736338 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.736318 2564 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 08 02:40:34.788064 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.787974 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 08 02:40:34.788978 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.788963 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-161.ec2.internal" event="NodeHasSufficientMemory" Sep 08 02:40:34.789044 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.788994 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-161.ec2.internal" event="NodeHasNoDiskPressure" Sep 08 02:40:34.789044 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.789005 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-161.ec2.internal" event="NodeHasSufficientPID" Sep 08 02:40:34.789044 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.789027 2564 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-137-161.ec2.internal" Sep 08 02:40:34.796953 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.796939 2564 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-137-161.ec2.internal" Sep 08 02:40:34.796997 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:40:34.796964 2564 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-137-161.ec2.internal\": node \"ip-10-0-137-161.ec2.internal\" not found" Sep 08 02:40:34.820700 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:40:34.820672 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-161.ec2.internal\" not found" Sep 08 02:40:34.835154 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.835127 2564 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-161.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-137-161.ec2.internal"] Sep 08 02:40:34.835225 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.835195 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 08 02:40:34.836566 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.836543 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-161.ec2.internal" event="NodeHasSufficientMemory" Sep 08 02:40:34.836665 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.836577 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-161.ec2.internal" event="NodeHasNoDiskPressure" Sep 08 02:40:34.836665 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.836588 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-161.ec2.internal" event="NodeHasSufficientPID" Sep 08 02:40:34.838618 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.838606 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 08 02:40:34.838746 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.838731 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-161.ec2.internal" Sep 08 02:40:34.838792 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.838765 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 08 02:40:34.839378 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.839362 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-161.ec2.internal" event="NodeHasSufficientMemory" Sep 08 02:40:34.839471 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.839380 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-161.ec2.internal" event="NodeHasSufficientMemory" Sep 08 02:40:34.839471 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.839406 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-161.ec2.internal" event="NodeHasNoDiskPressure" Sep 08 02:40:34.839471 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.839416 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-161.ec2.internal" event="NodeHasSufficientPID" Sep 08 02:40:34.839471 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.839388 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-161.ec2.internal" event="NodeHasNoDiskPressure" Sep 08 02:40:34.839471 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.839469 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-161.ec2.internal" event="NodeHasSufficientPID" Sep 08 02:40:34.841415 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.841397 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-161.ec2.internal" Sep 08 02:40:34.841484 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.841429 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 08 02:40:34.842125 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.842108 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-161.ec2.internal" event="NodeHasSufficientMemory" Sep 08 02:40:34.842179 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.842141 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-161.ec2.internal" event="NodeHasNoDiskPressure" Sep 08 02:40:34.842179 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.842161 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-161.ec2.internal" event="NodeHasSufficientPID" Sep 08 02:40:34.861717 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:40:34.861693 2564 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-161.ec2.internal\" not found" node="ip-10-0-137-161.ec2.internal" Sep 08 02:40:34.865938 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:40:34.865917 2564 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-161.ec2.internal\" not found" node="ip-10-0-137-161.ec2.internal" Sep 08 02:40:34.920980 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:40:34.920953 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-161.ec2.internal\" not found" Sep 08 02:40:34.932261 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.932234 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/aa6fe60e9885cbd28d9981be20d797a8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-161.ec2.internal\" (UID: \"aa6fe60e9885cbd28d9981be20d797a8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-161.ec2.internal" Sep 08 02:40:34.932380 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.932266 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/aa6fe60e9885cbd28d9981be20d797a8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-161.ec2.internal\" (UID: \"aa6fe60e9885cbd28d9981be20d797a8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-161.ec2.internal" Sep 08 02:40:34.932380 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:34.932283 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7548266a78d2e5528caa994a0756154a-config\") pod \"kube-apiserver-proxy-ip-10-0-137-161.ec2.internal\" (UID: \"7548266a78d2e5528caa994a0756154a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-161.ec2.internal" Sep 08 02:40:35.021431 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:40:35.021389 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-161.ec2.internal\" not found" Sep 08 02:40:35.032791 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:35.032760 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/aa6fe60e9885cbd28d9981be20d797a8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-161.ec2.internal\" (UID: \"aa6fe60e9885cbd28d9981be20d797a8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-161.ec2.internal" Sep 08 02:40:35.032791 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:35.032790 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/aa6fe60e9885cbd28d9981be20d797a8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-161.ec2.internal\" (UID: \"aa6fe60e9885cbd28d9981be20d797a8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-161.ec2.internal" Sep 08 02:40:35.032953 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:35.032809 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7548266a78d2e5528caa994a0756154a-config\") pod \"kube-apiserver-proxy-ip-10-0-137-161.ec2.internal\" (UID: \"7548266a78d2e5528caa994a0756154a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-161.ec2.internal" Sep 08 02:40:35.032953 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:35.032859 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/aa6fe60e9885cbd28d9981be20d797a8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-161.ec2.internal\" (UID: \"aa6fe60e9885cbd28d9981be20d797a8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-161.ec2.internal" Sep 08 02:40:35.032953 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:35.032874 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7548266a78d2e5528caa994a0756154a-config\") pod \"kube-apiserver-proxy-ip-10-0-137-161.ec2.internal\" (UID: \"7548266a78d2e5528caa994a0756154a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-161.ec2.internal" Sep 08 02:40:35.032953 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:35.032862 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/aa6fe60e9885cbd28d9981be20d797a8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-161.ec2.internal\" (UID: \"aa6fe60e9885cbd28d9981be20d797a8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-161.ec2.internal" Sep 08 02:40:35.122311 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:40:35.122209 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-161.ec2.internal\" not found" Sep 08 02:40:35.164729 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:35.164688 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-161.ec2.internal" Sep 08 02:40:35.169714 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:35.169692 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-161.ec2.internal" Sep 08 02:40:35.222701 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:40:35.222659 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-161.ec2.internal\" not found" Sep 08 02:40:36.689547 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:40:36.689501 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-161.ec2.internal\" not found" Sep 08 02:40:36.790031 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:40:36.789973 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-161.ec2.internal\" not found" Sep 08 02:40:36.890599 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:40:36.890566 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-161.ec2.internal\" not found" Sep 08 02:40:36.927081 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:36.927056 2564 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 08 02:40:36.927476 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:36.927211 2564 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 08 02:40:36.951525 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:36.951494 2564 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 08 02:40:36.991287 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:40:36.991260 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-161.ec2.internal\" not found" Sep 08 02:40:37.020899 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:37.020858 2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-07 02:35:36 +0000 UTC" deadline="2028-02-26 06:49:57.510949902 +0000 UTC" Sep 08 02:40:37.020899 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:37.020893 2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12868h9m20.490060015s" Sep 08 02:40:37.092257 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:40:37.092184 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-161.ec2.internal\" not found" Sep 08 02:40:37.139903 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:37.139863 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7548266a78d2e5528caa994a0756154a.slice/crio-fe076637a97e66f4cf15f15ee139b3b69e45346d453b57271d12f42f44fdcf0a WatchSource:0}: Error finding container fe076637a97e66f4cf15f15ee139b3b69e45346d453b57271d12f42f44fdcf0a: Status 404 returned error can't find the container with id fe076637a97e66f4cf15f15ee139b3b69e45346d453b57271d12f42f44fdcf0a Sep 08 02:40:37.140119 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:37.140097 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa6fe60e9885cbd28d9981be20d797a8.slice/crio-14ba628058b06c3df524b9422ab3705b874eae59380a52c35b962b5e7fc0b47c WatchSource:0}: Error finding container 14ba628058b06c3df524b9422ab3705b874eae59380a52c35b962b5e7fc0b47c: Status 404 returned error can't find the container with id 14ba628058b06c3df524b9422ab3705b874eae59380a52c35b962b5e7fc0b47c Sep 08 02:40:37.144869 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:37.144847 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 08 02:40:37.189955 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:37.189926 2564 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 08 02:40:37.192697 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:40:37.192682 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-161.ec2.internal\" not found" Sep 08 02:40:37.293216 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:40:37.293187 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-161.ec2.internal\" not found" Sep 08 02:40:37.393776 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:40:37.393695 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-161.ec2.internal\" not found" Sep 08 02:40:37.445038 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:37.445009 2564 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 08 02:40:37.497393 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:37.497225 2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-161.ec2.internal" Sep 08 02:40:37.513272 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:37.513252 2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 08 02:40:37.514200 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:37.514186 2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-161.ec2.internal" Sep 08 02:40:37.522596 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:37.522581 2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 08 02:40:37.974883 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:37.974845 2564 apiserver.go:52] "Watching apiserver" Sep 08 02:40:37.985658 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:37.985264 2564 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 08 02:40:37.986521 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:37.986482 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-161.ec2.internal","openshift-multus/network-metrics-daemon-ckt96","openshift-network-diagnostics/network-check-target-s7mcq","openshift-network-operator/iptables-alerter-cncrx","kube-system/global-pull-secret-syncer-s6jbs","kube-system/konnectivity-agent-j8s84","kube-system/kube-apiserver-proxy-ip-10-0-137-161.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8fvvh","openshift-dns/node-resolver-2667g","openshift-multus/multus-additional-cni-plugins-9w5n9","openshift-multus/multus-qj94z","openshift-ovn-kubernetes/ovnkube-node-srkh5","openshift-cluster-node-tuning-operator/tuned-8tddq","openshift-image-registry/node-ca-njl2b"] Sep 08 02:40:37.989382 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:37.989335 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-9w5n9" Sep 08 02:40:37.991216 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:37.991196 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8tddq" Sep 08 02:40:37.992826 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:37.992760 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 08 02:40:37.993115 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:37.993090 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 08 02:40:37.993297 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:37.993282 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 08 02:40:37.993488 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:37.993473 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 08 02:40:37.993825 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:37.993801 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-q688m\"" Sep 08 02:40:37.993998 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:37.993985 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 08 02:40:37.995283 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:37.995259 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 08 02:40:37.995393 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:37.995337 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 08 02:40:37.995462 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:37.995439 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-f62hb\"" Sep 08 02:40:37.995543 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:37.995525 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s7mcq" Sep 08 02:40:37.995634 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:40:37.995601 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s7mcq" podUID="f47c576f-2537-4625-be1f-fb82cbb3694e" Sep 08 02:40:37.997339 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:37.997315 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-cncrx" Sep 08 02:40:37.997779 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:37.997759 2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 08 02:40:37.998494 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:37.998478 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s6jbs" Sep 08 02:40:37.998576 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:40:37.998534 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s6jbs" podUID="ce406489-045e-4ba5-baa6-337a983d5466" Sep 08 02:40:38.000316 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.000294 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-jmmk7\"" Sep 08 02:40:38.000607 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.000592 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 08 02:40:38.000784 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.000769 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 08 02:40:38.000963 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.000948 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 08 02:40:38.001391 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.001375 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-j8s84" Sep 08 02:40:38.003423 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.003406 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-2667g" Sep 08 02:40:38.004588 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.004570 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-8tzvx\"" Sep 08 02:40:38.004808 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.004791 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 08 02:40:38.005115 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.005097 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 08 02:40:38.006263 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.006244 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-njl2b" Sep 08 02:40:38.007446 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.007426 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 08 02:40:38.007560 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.007541 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 08 02:40:38.007617 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.007574 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/846f41ef-3791-446b-b3e8-e05c195b7085-etc-sysctl-d\") pod \"tuned-8tddq\" (UID: \"846f41ef-3791-446b-b3e8-e05c195b7085\") " pod="openshift-cluster-node-tuning-operator/tuned-8tddq" Sep 08 02:40:38.007617 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.007585 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-5pqz4\"" Sep 08 02:40:38.007617 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.007606 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/846f41ef-3791-446b-b3e8-e05c195b7085-var-lib-kubelet\") pod \"tuned-8tddq\" (UID: \"846f41ef-3791-446b-b3e8-e05c195b7085\") " pod="openshift-cluster-node-tuning-operator/tuned-8tddq" Sep 08 02:40:38.007758 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.007635 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/846f41ef-3791-446b-b3e8-e05c195b7085-host\") pod \"tuned-8tddq\" (UID: \"846f41ef-3791-446b-b3e8-e05c195b7085\") " pod="openshift-cluster-node-tuning-operator/tuned-8tddq" Sep 08 02:40:38.007758 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.007662 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/846f41ef-3791-446b-b3e8-e05c195b7085-etc-tuned\") pod \"tuned-8tddq\" (UID: \"846f41ef-3791-446b-b3e8-e05c195b7085\") " pod="openshift-cluster-node-tuning-operator/tuned-8tddq" Sep 08 02:40:38.007758 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.007684 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/22f90f96-0ae6-459f-bd10-15f4c72e0935-cnibin\") pod \"multus-additional-cni-plugins-9w5n9\" (UID: \"22f90f96-0ae6-459f-bd10-15f4c72e0935\") " pod="openshift-multus/multus-additional-cni-plugins-9w5n9" Sep 08 02:40:38.007758 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.007705 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/22f90f96-0ae6-459f-bd10-15f4c72e0935-cni-binary-copy\") pod \"multus-additional-cni-plugins-9w5n9\" (UID: \"22f90f96-0ae6-459f-bd10-15f4c72e0935\") " pod="openshift-multus/multus-additional-cni-plugins-9w5n9" Sep 08 02:40:38.007758 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.007736 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6kfkg\" (UniqueName: \"kubernetes.io/projected/22f90f96-0ae6-459f-bd10-15f4c72e0935-kube-api-access-6kfkg\") pod \"multus-additional-cni-plugins-9w5n9\" (UID: \"22f90f96-0ae6-459f-bd10-15f4c72e0935\") " pod="openshift-multus/multus-additional-cni-plugins-9w5n9" Sep 08 02:40:38.007995 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.007775 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/22f90f96-0ae6-459f-bd10-15f4c72e0935-system-cni-dir\") pod \"multus-additional-cni-plugins-9w5n9\" (UID: \"22f90f96-0ae6-459f-bd10-15f4c72e0935\") " pod="openshift-multus/multus-additional-cni-plugins-9w5n9" Sep 08 02:40:38.007995 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.007808 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/846f41ef-3791-446b-b3e8-e05c195b7085-etc-systemd\") pod \"tuned-8tddq\" (UID: \"846f41ef-3791-446b-b3e8-e05c195b7085\") " pod="openshift-cluster-node-tuning-operator/tuned-8tddq" Sep 08 02:40:38.007995 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.007832 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/846f41ef-3791-446b-b3e8-e05c195b7085-run\") pod \"tuned-8tddq\" (UID: \"846f41ef-3791-446b-b3e8-e05c195b7085\") " pod="openshift-cluster-node-tuning-operator/tuned-8tddq" Sep 08 02:40:38.007995 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.007856 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p6rtt\" (UniqueName: \"kubernetes.io/projected/f47c576f-2537-4625-be1f-fb82cbb3694e-kube-api-access-p6rtt\") pod \"network-check-target-s7mcq\" (UID: \"f47c576f-2537-4625-be1f-fb82cbb3694e\") " pod="openshift-network-diagnostics/network-check-target-s7mcq" Sep 08 02:40:38.007995 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.007883 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/29ec0f1b-c020-42c6-a505-15aad11faa83-iptables-alerter-script\") pod \"iptables-alerter-cncrx\" (UID: \"29ec0f1b-c020-42c6-a505-15aad11faa83\") " pod="openshift-network-operator/iptables-alerter-cncrx" Sep 08 02:40:38.007995 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.007906 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/22f90f96-0ae6-459f-bd10-15f4c72e0935-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9w5n9\" (UID: \"22f90f96-0ae6-459f-bd10-15f4c72e0935\") " pod="openshift-multus/multus-additional-cni-plugins-9w5n9" Sep 08 02:40:38.007995 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.007930 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/846f41ef-3791-446b-b3e8-e05c195b7085-etc-sysconfig\") pod \"tuned-8tddq\" (UID: \"846f41ef-3791-446b-b3e8-e05c195b7085\") " pod="openshift-cluster-node-tuning-operator/tuned-8tddq" Sep 08 02:40:38.007995 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.007953 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/846f41ef-3791-446b-b3e8-e05c195b7085-etc-kubernetes\") pod \"tuned-8tddq\" (UID: \"846f41ef-3791-446b-b3e8-e05c195b7085\") " pod="openshift-cluster-node-tuning-operator/tuned-8tddq" Sep 08 02:40:38.007995 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.007988 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/846f41ef-3791-446b-b3e8-e05c195b7085-etc-sysctl-conf\") pod \"tuned-8tddq\" (UID: \"846f41ef-3791-446b-b3e8-e05c195b7085\") " pod="openshift-cluster-node-tuning-operator/tuned-8tddq" Sep 08 02:40:38.008431 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.008023 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/29ec0f1b-c020-42c6-a505-15aad11faa83-host-slash\") pod \"iptables-alerter-cncrx\" (UID: \"29ec0f1b-c020-42c6-a505-15aad11faa83\") " pod="openshift-network-operator/iptables-alerter-cncrx" Sep 08 02:40:38.008431 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.008053 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ce406489-045e-4ba5-baa6-337a983d5466-original-pull-secret\") pod \"global-pull-secret-syncer-s6jbs\" (UID: \"ce406489-045e-4ba5-baa6-337a983d5466\") " pod="kube-system/global-pull-secret-syncer-s6jbs" Sep 08 02:40:38.008431 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.008076 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/846f41ef-3791-446b-b3e8-e05c195b7085-tmp\") pod \"tuned-8tddq\" (UID: \"846f41ef-3791-446b-b3e8-e05c195b7085\") " pod="openshift-cluster-node-tuning-operator/tuned-8tddq" Sep 08 02:40:38.008431 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.008099 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/846f41ef-3791-446b-b3e8-e05c195b7085-etc-modprobe-d\") pod \"tuned-8tddq\" (UID: \"846f41ef-3791-446b-b3e8-e05c195b7085\") " pod="openshift-cluster-node-tuning-operator/tuned-8tddq" Sep 08 02:40:38.008431 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.008122 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ce406489-045e-4ba5-baa6-337a983d5466-kubelet-config\") pod \"global-pull-secret-syncer-s6jbs\" (UID: \"ce406489-045e-4ba5-baa6-337a983d5466\") " pod="kube-system/global-pull-secret-syncer-s6jbs" Sep 08 02:40:38.008431 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.008167 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/22f90f96-0ae6-459f-bd10-15f4c72e0935-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9w5n9\" (UID: \"22f90f96-0ae6-459f-bd10-15f4c72e0935\") " pod="openshift-multus/multus-additional-cni-plugins-9w5n9" Sep 08 02:40:38.008431 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.008198 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ce406489-045e-4ba5-baa6-337a983d5466-dbus\") pod \"global-pull-secret-syncer-s6jbs\" (UID: \"ce406489-045e-4ba5-baa6-337a983d5466\") " pod="kube-system/global-pull-secret-syncer-s6jbs" Sep 08 02:40:38.008431 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.008220 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/846f41ef-3791-446b-b3e8-e05c195b7085-sys\") pod \"tuned-8tddq\" (UID: \"846f41ef-3791-446b-b3e8-e05c195b7085\") " pod="openshift-cluster-node-tuning-operator/tuned-8tddq" Sep 08 02:40:38.008431 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.008432 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ckt96" Sep 08 02:40:38.008835 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:40:38.008499 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ckt96" podUID="e0a56211-24ee-40c8-be53-d5e518a5342b" Sep 08 02:40:38.008835 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.008555 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/846f41ef-3791-446b-b3e8-e05c195b7085-lib-modules\") pod \"tuned-8tddq\" (UID: \"846f41ef-3791-446b-b3e8-e05c195b7085\") " pod="openshift-cluster-node-tuning-operator/tuned-8tddq" Sep 08 02:40:38.008835 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.008606 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/22f90f96-0ae6-459f-bd10-15f4c72e0935-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9w5n9\" (UID: \"22f90f96-0ae6-459f-bd10-15f4c72e0935\") " pod="openshift-multus/multus-additional-cni-plugins-9w5n9" Sep 08 02:40:38.008835 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.008629 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cxfrf\" (UniqueName: \"kubernetes.io/projected/846f41ef-3791-446b-b3e8-e05c195b7085-kube-api-access-cxfrf\") pod \"tuned-8tddq\" (UID: \"846f41ef-3791-446b-b3e8-e05c195b7085\") " pod="openshift-cluster-node-tuning-operator/tuned-8tddq" Sep 08 02:40:38.008835 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.008650 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6b8d2\" (UniqueName: \"kubernetes.io/projected/29ec0f1b-c020-42c6-a505-15aad11faa83-kube-api-access-6b8d2\") pod \"iptables-alerter-cncrx\" (UID: \"29ec0f1b-c020-42c6-a505-15aad11faa83\") " pod="openshift-network-operator/iptables-alerter-cncrx" Sep 08 02:40:38.009287 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.009265 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 08 02:40:38.009377 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.009322 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 08 02:40:38.009585 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.009569 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 08 02:40:38.010248 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.010231 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-v27hl\"" Sep 08 02:40:38.011097 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.011069 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8fvvh" Sep 08 02:40:38.011973 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.011953 2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 08 02:40:38.013662 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.013642 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 08 02:40:38.013936 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.013919 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-qj94z" Sep 08 02:40:38.014176 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.014156 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 08 02:40:38.014393 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.014377 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-5xwh9\"" Sep 08 02:40:38.014460 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.014448 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 08 02:40:38.016251 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.016231 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 08 02:40:38.016337 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.016301 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-ttc9s\"" Sep 08 02:40:38.017132 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.017109 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-srkh5" Sep 08 02:40:38.023659 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.020367 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 08 02:40:38.023928 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.023910 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 08 02:40:38.024133 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.024118 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 08 02:40:38.024342 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.024327 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 08 02:40:38.024684 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.024668 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 08 02:40:38.024944 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.024924 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 08 02:40:38.025182 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.025166 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-tnrm5\"" Sep 08 02:40:38.031794 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.031770 2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-xff6b" Sep 08 02:40:38.038607 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.038584 2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-xff6b" Sep 08 02:40:38.098261 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.098213 2564 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 08 02:40:38.105788 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.105737 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-161.ec2.internal" event={"ID":"7548266a78d2e5528caa994a0756154a","Type":"ContainerStarted","Data":"fe076637a97e66f4cf15f15ee139b3b69e45346d453b57271d12f42f44fdcf0a"} Sep 08 02:40:38.107313 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.107286 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-161.ec2.internal" event={"ID":"aa6fe60e9885cbd28d9981be20d797a8","Type":"ContainerStarted","Data":"14ba628058b06c3df524b9422ab3705b874eae59380a52c35b962b5e7fc0b47c"} Sep 08 02:40:38.109652 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.109629 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/22f90f96-0ae6-459f-bd10-15f4c72e0935-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9w5n9\" (UID: \"22f90f96-0ae6-459f-bd10-15f4c72e0935\") " pod="openshift-multus/multus-additional-cni-plugins-9w5n9" Sep 08 02:40:38.109750 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.109668 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cxfrf\" (UniqueName: \"kubernetes.io/projected/846f41ef-3791-446b-b3e8-e05c195b7085-kube-api-access-cxfrf\") pod \"tuned-8tddq\" (UID: \"846f41ef-3791-446b-b3e8-e05c195b7085\") " pod="openshift-cluster-node-tuning-operator/tuned-8tddq" Sep 08 02:40:38.109750 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.109698 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6b8d2\" (UniqueName: \"kubernetes.io/projected/29ec0f1b-c020-42c6-a505-15aad11faa83-kube-api-access-6b8d2\") pod \"iptables-alerter-cncrx\" (UID: \"29ec0f1b-c020-42c6-a505-15aad11faa83\") " pod="openshift-network-operator/iptables-alerter-cncrx" Sep 08 02:40:38.109750 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.109725 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3d2ae2a6-8064-42ae-b0ac-a19fb610c368-multus-cni-dir\") pod \"multus-qj94z\" (UID: \"3d2ae2a6-8064-42ae-b0ac-a19fb610c368\") " pod="openshift-multus/multus-qj94z" Sep 08 02:40:38.109914 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.109749 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/846f41ef-3791-446b-b3e8-e05c195b7085-var-lib-kubelet\") pod \"tuned-8tddq\" (UID: \"846f41ef-3791-446b-b3e8-e05c195b7085\") " pod="openshift-cluster-node-tuning-operator/tuned-8tddq" Sep 08 02:40:38.109914 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.109772 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/846f41ef-3791-446b-b3e8-e05c195b7085-host\") pod \"tuned-8tddq\" (UID: \"846f41ef-3791-446b-b3e8-e05c195b7085\") " pod="openshift-cluster-node-tuning-operator/tuned-8tddq" Sep 08 02:40:38.109914 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.109799 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/22f90f96-0ae6-459f-bd10-15f4c72e0935-cnibin\") pod \"multus-additional-cni-plugins-9w5n9\" (UID: \"22f90f96-0ae6-459f-bd10-15f4c72e0935\") " pod="openshift-multus/multus-additional-cni-plugins-9w5n9" Sep 08 02:40:38.109914 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.109830 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/22f90f96-0ae6-459f-bd10-15f4c72e0935-cni-binary-copy\") pod \"multus-additional-cni-plugins-9w5n9\" (UID: \"22f90f96-0ae6-459f-bd10-15f4c72e0935\") " pod="openshift-multus/multus-additional-cni-plugins-9w5n9" Sep 08 02:40:38.109914 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.109857 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6kfkg\" (UniqueName: \"kubernetes.io/projected/22f90f96-0ae6-459f-bd10-15f4c72e0935-kube-api-access-6kfkg\") pod \"multus-additional-cni-plugins-9w5n9\" (UID: \"22f90f96-0ae6-459f-bd10-15f4c72e0935\") " pod="openshift-multus/multus-additional-cni-plugins-9w5n9" Sep 08 02:40:38.109914 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.109883 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k45lm\" (UniqueName: \"kubernetes.io/projected/e0a56211-24ee-40c8-be53-d5e518a5342b-kube-api-access-k45lm\") pod \"network-metrics-daemon-ckt96\" (UID: \"e0a56211-24ee-40c8-be53-d5e518a5342b\") " pod="openshift-multus/network-metrics-daemon-ckt96" Sep 08 02:40:38.109914 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.109907 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/53b75799-2383-445c-9d14-57322844c559-host-run-netns\") pod \"ovnkube-node-srkh5\" (UID: \"53b75799-2383-445c-9d14-57322844c559\") " pod="openshift-ovn-kubernetes/ovnkube-node-srkh5" Sep 08 02:40:38.110239 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.109931 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/50d2c5c2-28aa-4ce1-9ad9-50b2493d3129-tmp-dir\") pod \"node-resolver-2667g\" (UID: \"50d2c5c2-28aa-4ce1-9ad9-50b2493d3129\") " pod="openshift-dns/node-resolver-2667g" Sep 08 02:40:38.110239 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.109955 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/22f90f96-0ae6-459f-bd10-15f4c72e0935-system-cni-dir\") pod \"multus-additional-cni-plugins-9w5n9\" (UID: \"22f90f96-0ae6-459f-bd10-15f4c72e0935\") " pod="openshift-multus/multus-additional-cni-plugins-9w5n9" Sep 08 02:40:38.110239 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.109979 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/846f41ef-3791-446b-b3e8-e05c195b7085-etc-systemd\") pod \"tuned-8tddq\" (UID: \"846f41ef-3791-446b-b3e8-e05c195b7085\") " pod="openshift-cluster-node-tuning-operator/tuned-8tddq" Sep 08 02:40:38.110239 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.110016 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/846f41ef-3791-446b-b3e8-e05c195b7085-run\") pod \"tuned-8tddq\" (UID: \"846f41ef-3791-446b-b3e8-e05c195b7085\") " pod="openshift-cluster-node-tuning-operator/tuned-8tddq" Sep 08 02:40:38.110239 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.110040 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/29ec0f1b-c020-42c6-a505-15aad11faa83-iptables-alerter-script\") pod \"iptables-alerter-cncrx\" (UID: \"29ec0f1b-c020-42c6-a505-15aad11faa83\") " pod="openshift-network-operator/iptables-alerter-cncrx" Sep 08 02:40:38.110239 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.110063 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ba1b8aaf-174d-4dbb-b7a2-af66170d03b0-host\") pod \"node-ca-njl2b\" (UID: \"ba1b8aaf-174d-4dbb-b7a2-af66170d03b0\") " pod="openshift-image-registry/node-ca-njl2b" Sep 08 02:40:38.110239 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.110095 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ba1b8aaf-174d-4dbb-b7a2-af66170d03b0-serviceca\") pod \"node-ca-njl2b\" (UID: \"ba1b8aaf-174d-4dbb-b7a2-af66170d03b0\") " pod="openshift-image-registry/node-ca-njl2b" Sep 08 02:40:38.110239 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.110128 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e0a56211-24ee-40c8-be53-d5e518a5342b-metrics-certs\") pod \"network-metrics-daemon-ckt96\" (UID: \"e0a56211-24ee-40c8-be53-d5e518a5342b\") " pod="openshift-multus/network-metrics-daemon-ckt96" Sep 08 02:40:38.110239 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.110150 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/53b75799-2383-445c-9d14-57322844c559-host-cni-bin\") pod \"ovnkube-node-srkh5\" (UID: \"53b75799-2383-445c-9d14-57322844c559\") " pod="openshift-ovn-kubernetes/ovnkube-node-srkh5" Sep 08 02:40:38.110239 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.110175 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/22f90f96-0ae6-459f-bd10-15f4c72e0935-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9w5n9\" (UID: \"22f90f96-0ae6-459f-bd10-15f4c72e0935\") " pod="openshift-multus/multus-additional-cni-plugins-9w5n9" Sep 08 02:40:38.110239 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.110197 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/846f41ef-3791-446b-b3e8-e05c195b7085-etc-sysconfig\") pod \"tuned-8tddq\" (UID: \"846f41ef-3791-446b-b3e8-e05c195b7085\") " pod="openshift-cluster-node-tuning-operator/tuned-8tddq" Sep 08 02:40:38.110239 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.110232 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/53b75799-2383-445c-9d14-57322844c559-host-kubelet\") pod \"ovnkube-node-srkh5\" (UID: \"53b75799-2383-445c-9d14-57322844c559\") " pod="openshift-ovn-kubernetes/ovnkube-node-srkh5" Sep 08 02:40:38.110782 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.110255 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/53b75799-2383-445c-9d14-57322844c559-etc-openvswitch\") pod \"ovnkube-node-srkh5\" (UID: \"53b75799-2383-445c-9d14-57322844c559\") " pod="openshift-ovn-kubernetes/ovnkube-node-srkh5" Sep 08 02:40:38.110782 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.110268 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/22f90f96-0ae6-459f-bd10-15f4c72e0935-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9w5n9\" (UID: \"22f90f96-0ae6-459f-bd10-15f4c72e0935\") " pod="openshift-multus/multus-additional-cni-plugins-9w5n9" Sep 08 02:40:38.110782 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.110278 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/53b75799-2383-445c-9d14-57322844c559-host-cni-netd\") pod \"ovnkube-node-srkh5\" (UID: \"53b75799-2383-445c-9d14-57322844c559\") " pod="openshift-ovn-kubernetes/ovnkube-node-srkh5" Sep 08 02:40:38.110782 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.110306 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/53b75799-2383-445c-9d14-57322844c559-ovn-node-metrics-cert\") pod \"ovnkube-node-srkh5\" (UID: \"53b75799-2383-445c-9d14-57322844c559\") " pod="openshift-ovn-kubernetes/ovnkube-node-srkh5" Sep 08 02:40:38.110782 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.110332 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vvqmr\" (UniqueName: \"kubernetes.io/projected/e093be54-1d5e-4af7-9417-37cfa9965bde-kube-api-access-vvqmr\") pod \"aws-ebs-csi-driver-node-8fvvh\" (UID: \"e093be54-1d5e-4af7-9417-37cfa9965bde\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8fvvh" Sep 08 02:40:38.110782 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.110381 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/22f90f96-0ae6-459f-bd10-15f4c72e0935-system-cni-dir\") pod \"multus-additional-cni-plugins-9w5n9\" (UID: \"22f90f96-0ae6-459f-bd10-15f4c72e0935\") " pod="openshift-multus/multus-additional-cni-plugins-9w5n9" Sep 08 02:40:38.110782 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.110391 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/75f73d39-6aff-4777-a417-4d6ac2f786ff-agent-certs\") pod \"konnectivity-agent-j8s84\" (UID: \"75f73d39-6aff-4777-a417-4d6ac2f786ff\") " pod="kube-system/konnectivity-agent-j8s84" Sep 08 02:40:38.110782 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.110428 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/75f73d39-6aff-4777-a417-4d6ac2f786ff-konnectivity-ca\") pod \"konnectivity-agent-j8s84\" (UID: \"75f73d39-6aff-4777-a417-4d6ac2f786ff\") " pod="kube-system/konnectivity-agent-j8s84" Sep 08 02:40:38.110782 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.110540 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/846f41ef-3791-446b-b3e8-e05c195b7085-etc-systemd\") pod \"tuned-8tddq\" (UID: \"846f41ef-3791-446b-b3e8-e05c195b7085\") " pod="openshift-cluster-node-tuning-operator/tuned-8tddq" Sep 08 02:40:38.110782 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.110653 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/846f41ef-3791-446b-b3e8-e05c195b7085-run\") pod \"tuned-8tddq\" (UID: \"846f41ef-3791-446b-b3e8-e05c195b7085\") " pod="openshift-cluster-node-tuning-operator/tuned-8tddq" Sep 08 02:40:38.110782 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.110685 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3d2ae2a6-8064-42ae-b0ac-a19fb610c368-multus-daemon-config\") pod \"multus-qj94z\" (UID: \"3d2ae2a6-8064-42ae-b0ac-a19fb610c368\") " pod="openshift-multus/multus-qj94z" Sep 08 02:40:38.110782 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.110711 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/50d2c5c2-28aa-4ce1-9ad9-50b2493d3129-hosts-file\") pod \"node-resolver-2667g\" (UID: \"50d2c5c2-28aa-4ce1-9ad9-50b2493d3129\") " pod="openshift-dns/node-resolver-2667g" Sep 08 02:40:38.110782 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.110739 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e093be54-1d5e-4af7-9417-37cfa9965bde-etc-selinux\") pod \"aws-ebs-csi-driver-node-8fvvh\" (UID: \"e093be54-1d5e-4af7-9417-37cfa9965bde\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8fvvh" Sep 08 02:40:38.110782 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.110767 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3d2ae2a6-8064-42ae-b0ac-a19fb610c368-host-var-lib-cni-multus\") pod \"multus-qj94z\" (UID: \"3d2ae2a6-8064-42ae-b0ac-a19fb610c368\") " pod="openshift-multus/multus-qj94z" Sep 08 02:40:38.111532 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.110792 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3d2ae2a6-8064-42ae-b0ac-a19fb610c368-host-run-multus-certs\") pod \"multus-qj94z\" (UID: \"3d2ae2a6-8064-42ae-b0ac-a19fb610c368\") " pod="openshift-multus/multus-qj94z" Sep 08 02:40:38.111532 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.110818 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/846f41ef-3791-446b-b3e8-e05c195b7085-tmp\") pod \"tuned-8tddq\" (UID: \"846f41ef-3791-446b-b3e8-e05c195b7085\") " pod="openshift-cluster-node-tuning-operator/tuned-8tddq" Sep 08 02:40:38.111532 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.110846 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ce406489-045e-4ba5-baa6-337a983d5466-kubelet-config\") pod \"global-pull-secret-syncer-s6jbs\" (UID: \"ce406489-045e-4ba5-baa6-337a983d5466\") " pod="kube-system/global-pull-secret-syncer-s6jbs" Sep 08 02:40:38.111532 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.110875 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/22f90f96-0ae6-459f-bd10-15f4c72e0935-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9w5n9\" (UID: \"22f90f96-0ae6-459f-bd10-15f4c72e0935\") " pod="openshift-multus/multus-additional-cni-plugins-9w5n9" Sep 08 02:40:38.111532 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.110901 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3d2ae2a6-8064-42ae-b0ac-a19fb610c368-multus-socket-dir-parent\") pod \"multus-qj94z\" (UID: \"3d2ae2a6-8064-42ae-b0ac-a19fb610c368\") " pod="openshift-multus/multus-qj94z" Sep 08 02:40:38.111532 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.110929 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3d2ae2a6-8064-42ae-b0ac-a19fb610c368-host-run-netns\") pod \"multus-qj94z\" (UID: \"3d2ae2a6-8064-42ae-b0ac-a19fb610c368\") " pod="openshift-multus/multus-qj94z" Sep 08 02:40:38.111532 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.110955 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3d2ae2a6-8064-42ae-b0ac-a19fb610c368-hostroot\") pod \"multus-qj94z\" (UID: \"3d2ae2a6-8064-42ae-b0ac-a19fb610c368\") " pod="openshift-multus/multus-qj94z" Sep 08 02:40:38.111532 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.110977 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/53b75799-2383-445c-9d14-57322844c559-host-slash\") pod \"ovnkube-node-srkh5\" (UID: \"53b75799-2383-445c-9d14-57322844c559\") " pod="openshift-ovn-kubernetes/ovnkube-node-srkh5" Sep 08 02:40:38.111532 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.111000 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/53b75799-2383-445c-9d14-57322844c559-node-log\") pod \"ovnkube-node-srkh5\" (UID: \"53b75799-2383-445c-9d14-57322844c559\") " pod="openshift-ovn-kubernetes/ovnkube-node-srkh5" Sep 08 02:40:38.111532 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.111024 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/53b75799-2383-445c-9d14-57322844c559-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-srkh5\" (UID: \"53b75799-2383-445c-9d14-57322844c559\") " pod="openshift-ovn-kubernetes/ovnkube-node-srkh5" Sep 08 02:40:38.111532 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.111050 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/53b75799-2383-445c-9d14-57322844c559-env-overrides\") pod \"ovnkube-node-srkh5\" (UID: \"53b75799-2383-445c-9d14-57322844c559\") " pod="openshift-ovn-kubernetes/ovnkube-node-srkh5" Sep 08 02:40:38.111532 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.111075 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/53b75799-2383-445c-9d14-57322844c559-ovnkube-script-lib\") pod \"ovnkube-node-srkh5\" (UID: \"53b75799-2383-445c-9d14-57322844c559\") " pod="openshift-ovn-kubernetes/ovnkube-node-srkh5" Sep 08 02:40:38.111532 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.111114 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3d2ae2a6-8064-42ae-b0ac-a19fb610c368-cni-binary-copy\") pod \"multus-qj94z\" (UID: \"3d2ae2a6-8064-42ae-b0ac-a19fb610c368\") " pod="openshift-multus/multus-qj94z" Sep 08 02:40:38.111532 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.111151 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/53b75799-2383-445c-9d14-57322844c559-var-lib-openvswitch\") pod \"ovnkube-node-srkh5\" (UID: \"53b75799-2383-445c-9d14-57322844c559\") " pod="openshift-ovn-kubernetes/ovnkube-node-srkh5" Sep 08 02:40:38.111532 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.111175 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e093be54-1d5e-4af7-9417-37cfa9965bde-device-dir\") pod \"aws-ebs-csi-driver-node-8fvvh\" (UID: \"e093be54-1d5e-4af7-9417-37cfa9965bde\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8fvvh" Sep 08 02:40:38.111532 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.111177 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/22f90f96-0ae6-459f-bd10-15f4c72e0935-cni-binary-copy\") pod \"multus-additional-cni-plugins-9w5n9\" (UID: \"22f90f96-0ae6-459f-bd10-15f4c72e0935\") " pod="openshift-multus/multus-additional-cni-plugins-9w5n9" Sep 08 02:40:38.111532 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.111200 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/846f41ef-3791-446b-b3e8-e05c195b7085-etc-sysctl-d\") pod \"tuned-8tddq\" (UID: \"846f41ef-3791-446b-b3e8-e05c195b7085\") " pod="openshift-cluster-node-tuning-operator/tuned-8tddq" Sep 08 02:40:38.112336 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.111226 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/846f41ef-3791-446b-b3e8-e05c195b7085-etc-tuned\") pod \"tuned-8tddq\" (UID: \"846f41ef-3791-446b-b3e8-e05c195b7085\") " pod="openshift-cluster-node-tuning-operator/tuned-8tddq" Sep 08 02:40:38.112336 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.111250 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/53b75799-2383-445c-9d14-57322844c559-log-socket\") pod \"ovnkube-node-srkh5\" (UID: \"53b75799-2383-445c-9d14-57322844c559\") " pod="openshift-ovn-kubernetes/ovnkube-node-srkh5" Sep 08 02:40:38.112336 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.111277 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e093be54-1d5e-4af7-9417-37cfa9965bde-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8fvvh\" (UID: \"e093be54-1d5e-4af7-9417-37cfa9965bde\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8fvvh" Sep 08 02:40:38.112336 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.111304 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6rtt\" (UniqueName: \"kubernetes.io/projected/f47c576f-2537-4625-be1f-fb82cbb3694e-kube-api-access-p6rtt\") pod \"network-check-target-s7mcq\" (UID: \"f47c576f-2537-4625-be1f-fb82cbb3694e\") " pod="openshift-network-diagnostics/network-check-target-s7mcq" Sep 08 02:40:38.112336 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.111329 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qtmvt\" (UniqueName: \"kubernetes.io/projected/ba1b8aaf-174d-4dbb-b7a2-af66170d03b0-kube-api-access-qtmvt\") pod \"node-ca-njl2b\" (UID: \"ba1b8aaf-174d-4dbb-b7a2-af66170d03b0\") " pod="openshift-image-registry/node-ca-njl2b" Sep 08 02:40:38.112336 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.111371 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3d2ae2a6-8064-42ae-b0ac-a19fb610c368-host-var-lib-kubelet\") pod \"multus-qj94z\" (UID: \"3d2ae2a6-8064-42ae-b0ac-a19fb610c368\") " pod="openshift-multus/multus-qj94z" Sep 08 02:40:38.112336 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.111407 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4qmgr\" (UniqueName: \"kubernetes.io/projected/3d2ae2a6-8064-42ae-b0ac-a19fb610c368-kube-api-access-4qmgr\") pod \"multus-qj94z\" (UID: \"3d2ae2a6-8064-42ae-b0ac-a19fb610c368\") " pod="openshift-multus/multus-qj94z" Sep 08 02:40:38.112336 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.111433 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e093be54-1d5e-4af7-9417-37cfa9965bde-socket-dir\") pod \"aws-ebs-csi-driver-node-8fvvh\" (UID: \"e093be54-1d5e-4af7-9417-37cfa9965bde\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8fvvh" Sep 08 02:40:38.112336 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.111457 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/53b75799-2383-445c-9d14-57322844c559-systemd-units\") pod \"ovnkube-node-srkh5\" (UID: \"53b75799-2383-445c-9d14-57322844c559\") " pod="openshift-ovn-kubernetes/ovnkube-node-srkh5" Sep 08 02:40:38.112336 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.111487 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/846f41ef-3791-446b-b3e8-e05c195b7085-etc-kubernetes\") pod \"tuned-8tddq\" (UID: \"846f41ef-3791-446b-b3e8-e05c195b7085\") " pod="openshift-cluster-node-tuning-operator/tuned-8tddq" Sep 08 02:40:38.112336 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.111513 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/846f41ef-3791-446b-b3e8-e05c195b7085-etc-sysctl-conf\") pod \"tuned-8tddq\" (UID: \"846f41ef-3791-446b-b3e8-e05c195b7085\") " pod="openshift-cluster-node-tuning-operator/tuned-8tddq" Sep 08 02:40:38.112336 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.111537 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/29ec0f1b-c020-42c6-a505-15aad11faa83-host-slash\") pod \"iptables-alerter-cncrx\" (UID: \"29ec0f1b-c020-42c6-a505-15aad11faa83\") " pod="openshift-network-operator/iptables-alerter-cncrx" Sep 08 02:40:38.112336 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.111560 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/53b75799-2383-445c-9d14-57322844c559-run-openvswitch\") pod \"ovnkube-node-srkh5\" (UID: \"53b75799-2383-445c-9d14-57322844c559\") " pod="openshift-ovn-kubernetes/ovnkube-node-srkh5" Sep 08 02:40:38.112336 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.111588 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ce406489-045e-4ba5-baa6-337a983d5466-original-pull-secret\") pod \"global-pull-secret-syncer-s6jbs\" (UID: \"ce406489-045e-4ba5-baa6-337a983d5466\") " pod="kube-system/global-pull-secret-syncer-s6jbs" Sep 08 02:40:38.112336 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.111614 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3d2ae2a6-8064-42ae-b0ac-a19fb610c368-system-cni-dir\") pod \"multus-qj94z\" (UID: \"3d2ae2a6-8064-42ae-b0ac-a19fb610c368\") " pod="openshift-multus/multus-qj94z" Sep 08 02:40:38.112336 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.111639 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3d2ae2a6-8064-42ae-b0ac-a19fb610c368-etc-kubernetes\") pod \"multus-qj94z\" (UID: \"3d2ae2a6-8064-42ae-b0ac-a19fb610c368\") " pod="openshift-multus/multus-qj94z" Sep 08 02:40:38.112336 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.111665 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/53b75799-2383-445c-9d14-57322844c559-host-run-ovn-kubernetes\") pod \"ovnkube-node-srkh5\" (UID: \"53b75799-2383-445c-9d14-57322844c559\") " pod="openshift-ovn-kubernetes/ovnkube-node-srkh5" Sep 08 02:40:38.113124 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.111682 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/29ec0f1b-c020-42c6-a505-15aad11faa83-iptables-alerter-script\") pod \"iptables-alerter-cncrx\" (UID: \"29ec0f1b-c020-42c6-a505-15aad11faa83\") " pod="openshift-network-operator/iptables-alerter-cncrx" Sep 08 02:40:38.113124 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.111698 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dhs4t\" (UniqueName: \"kubernetes.io/projected/50d2c5c2-28aa-4ce1-9ad9-50b2493d3129-kube-api-access-dhs4t\") pod \"node-resolver-2667g\" (UID: \"50d2c5c2-28aa-4ce1-9ad9-50b2493d3129\") " pod="openshift-dns/node-resolver-2667g" Sep 08 02:40:38.113124 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.111725 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e093be54-1d5e-4af7-9417-37cfa9965bde-registration-dir\") pod \"aws-ebs-csi-driver-node-8fvvh\" (UID: \"e093be54-1d5e-4af7-9417-37cfa9965bde\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8fvvh" Sep 08 02:40:38.113124 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.111860 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/846f41ef-3791-446b-b3e8-e05c195b7085-etc-sysctl-d\") pod \"tuned-8tddq\" (UID: \"846f41ef-3791-446b-b3e8-e05c195b7085\") " pod="openshift-cluster-node-tuning-operator/tuned-8tddq" Sep 08 02:40:38.113124 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.112010 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/846f41ef-3791-446b-b3e8-e05c195b7085-etc-modprobe-d\") pod \"tuned-8tddq\" (UID: \"846f41ef-3791-446b-b3e8-e05c195b7085\") " pod="openshift-cluster-node-tuning-operator/tuned-8tddq" Sep 08 02:40:38.113124 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.112114 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/846f41ef-3791-446b-b3e8-e05c195b7085-etc-modprobe-d\") pod \"tuned-8tddq\" (UID: \"846f41ef-3791-446b-b3e8-e05c195b7085\") " pod="openshift-cluster-node-tuning-operator/tuned-8tddq" Sep 08 02:40:38.113124 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:40:38.112159 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 08 02:40:38.113124 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.112179 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/846f41ef-3791-446b-b3e8-e05c195b7085-etc-sysconfig\") pod \"tuned-8tddq\" (UID: \"846f41ef-3791-446b-b3e8-e05c195b7085\") " pod="openshift-cluster-node-tuning-operator/tuned-8tddq" Sep 08 02:40:38.113124 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.112230 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/846f41ef-3791-446b-b3e8-e05c195b7085-var-lib-kubelet\") pod \"tuned-8tddq\" (UID: \"846f41ef-3791-446b-b3e8-e05c195b7085\") " pod="openshift-cluster-node-tuning-operator/tuned-8tddq" Sep 08 02:40:38.113124 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:40:38.112239 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce406489-045e-4ba5-baa6-337a983d5466-original-pull-secret podName:ce406489-045e-4ba5-baa6-337a983d5466 nodeName:}" failed. No retries permitted until 2026-09-08 02:40:38.612199938 +0000 UTC m=+3.047173632 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ce406489-045e-4ba5-baa6-337a983d5466-original-pull-secret") pod "global-pull-secret-syncer-s6jbs" (UID: "ce406489-045e-4ba5-baa6-337a983d5466") : object "kube-system"/"original-pull-secret" not registered Sep 08 02:40:38.113124 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.112275 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/22f90f96-0ae6-459f-bd10-15f4c72e0935-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9w5n9\" (UID: \"22f90f96-0ae6-459f-bd10-15f4c72e0935\") " pod="openshift-multus/multus-additional-cni-plugins-9w5n9" Sep 08 02:40:38.113124 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.112312 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/22f90f96-0ae6-459f-bd10-15f4c72e0935-cnibin\") pod \"multus-additional-cni-plugins-9w5n9\" (UID: \"22f90f96-0ae6-459f-bd10-15f4c72e0935\") " pod="openshift-multus/multus-additional-cni-plugins-9w5n9" Sep 08 02:40:38.113124 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.112369 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/846f41ef-3791-446b-b3e8-e05c195b7085-etc-kubernetes\") pod \"tuned-8tddq\" (UID: \"846f41ef-3791-446b-b3e8-e05c195b7085\") " pod="openshift-cluster-node-tuning-operator/tuned-8tddq" Sep 08 02:40:38.113124 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.112381 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/29ec0f1b-c020-42c6-a505-15aad11faa83-host-slash\") pod \"iptables-alerter-cncrx\" (UID: \"29ec0f1b-c020-42c6-a505-15aad11faa83\") " pod="openshift-network-operator/iptables-alerter-cncrx" Sep 08 02:40:38.113124 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.112401 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/53b75799-2383-445c-9d14-57322844c559-run-systemd\") pod \"ovnkube-node-srkh5\" (UID: \"53b75799-2383-445c-9d14-57322844c559\") " pod="openshift-ovn-kubernetes/ovnkube-node-srkh5" Sep 08 02:40:38.113124 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.112275 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/846f41ef-3791-446b-b3e8-e05c195b7085-host\") pod \"tuned-8tddq\" (UID: \"846f41ef-3791-446b-b3e8-e05c195b7085\") " pod="openshift-cluster-node-tuning-operator/tuned-8tddq" Sep 08 02:40:38.113124 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.112453 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ce406489-045e-4ba5-baa6-337a983d5466-dbus\") pod \"global-pull-secret-syncer-s6jbs\" (UID: \"ce406489-045e-4ba5-baa6-337a983d5466\") " pod="kube-system/global-pull-secret-syncer-s6jbs" Sep 08 02:40:38.113794 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.112480 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3d2ae2a6-8064-42ae-b0ac-a19fb610c368-host-run-k8s-cni-cncf-io\") pod \"multus-qj94z\" (UID: \"3d2ae2a6-8064-42ae-b0ac-a19fb610c368\") " pod="openshift-multus/multus-qj94z" Sep 08 02:40:38.113794 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.112490 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/846f41ef-3791-446b-b3e8-e05c195b7085-etc-sysctl-conf\") pod \"tuned-8tddq\" (UID: \"846f41ef-3791-446b-b3e8-e05c195b7085\") " pod="openshift-cluster-node-tuning-operator/tuned-8tddq" Sep 08 02:40:38.113794 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.112499 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ce406489-045e-4ba5-baa6-337a983d5466-kubelet-config\") pod \"global-pull-secret-syncer-s6jbs\" (UID: \"ce406489-045e-4ba5-baa6-337a983d5466\") " pod="kube-system/global-pull-secret-syncer-s6jbs" Sep 08 02:40:38.113794 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.112527 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3d2ae2a6-8064-42ae-b0ac-a19fb610c368-host-var-lib-cni-bin\") pod \"multus-qj94z\" (UID: \"3d2ae2a6-8064-42ae-b0ac-a19fb610c368\") " pod="openshift-multus/multus-qj94z" Sep 08 02:40:38.113794 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.112550 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ce406489-045e-4ba5-baa6-337a983d5466-dbus\") pod \"global-pull-secret-syncer-s6jbs\" (UID: \"ce406489-045e-4ba5-baa6-337a983d5466\") " pod="kube-system/global-pull-secret-syncer-s6jbs" Sep 08 02:40:38.113794 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.112557 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3d2ae2a6-8064-42ae-b0ac-a19fb610c368-multus-conf-dir\") pod \"multus-qj94z\" (UID: \"3d2ae2a6-8064-42ae-b0ac-a19fb610c368\") " pod="openshift-multus/multus-qj94z" Sep 08 02:40:38.113794 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.112590 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/53b75799-2383-445c-9d14-57322844c559-run-ovn\") pod \"ovnkube-node-srkh5\" (UID: \"53b75799-2383-445c-9d14-57322844c559\") " pod="openshift-ovn-kubernetes/ovnkube-node-srkh5" Sep 08 02:40:38.113794 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.112619 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/53b75799-2383-445c-9d14-57322844c559-ovnkube-config\") pod \"ovnkube-node-srkh5\" (UID: \"53b75799-2383-445c-9d14-57322844c559\") " pod="openshift-ovn-kubernetes/ovnkube-node-srkh5" Sep 08 02:40:38.113794 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.112656 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e093be54-1d5e-4af7-9417-37cfa9965bde-sys-fs\") pod \"aws-ebs-csi-driver-node-8fvvh\" (UID: \"e093be54-1d5e-4af7-9417-37cfa9965bde\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8fvvh" Sep 08 02:40:38.113794 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.112689 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/22f90f96-0ae6-459f-bd10-15f4c72e0935-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9w5n9\" (UID: \"22f90f96-0ae6-459f-bd10-15f4c72e0935\") " pod="openshift-multus/multus-additional-cni-plugins-9w5n9" Sep 08 02:40:38.113794 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.112702 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/846f41ef-3791-446b-b3e8-e05c195b7085-sys\") pod \"tuned-8tddq\" (UID: \"846f41ef-3791-446b-b3e8-e05c195b7085\") " pod="openshift-cluster-node-tuning-operator/tuned-8tddq" Sep 08 02:40:38.113794 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.112735 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/846f41ef-3791-446b-b3e8-e05c195b7085-lib-modules\") pod \"tuned-8tddq\" (UID: \"846f41ef-3791-446b-b3e8-e05c195b7085\") " pod="openshift-cluster-node-tuning-operator/tuned-8tddq" Sep 08 02:40:38.113794 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.112758 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/846f41ef-3791-446b-b3e8-e05c195b7085-sys\") pod \"tuned-8tddq\" (UID: \"846f41ef-3791-446b-b3e8-e05c195b7085\") " pod="openshift-cluster-node-tuning-operator/tuned-8tddq" Sep 08 02:40:38.113794 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.112207 2564 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 08 02:40:38.113794 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.112800 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3d2ae2a6-8064-42ae-b0ac-a19fb610c368-cnibin\") pod \"multus-qj94z\" (UID: \"3d2ae2a6-8064-42ae-b0ac-a19fb610c368\") " pod="openshift-multus/multus-qj94z" Sep 08 02:40:38.113794 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.112827 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q5mxm\" (UniqueName: \"kubernetes.io/projected/53b75799-2383-445c-9d14-57322844c559-kube-api-access-q5mxm\") pod \"ovnkube-node-srkh5\" (UID: \"53b75799-2383-445c-9d14-57322844c559\") " pod="openshift-ovn-kubernetes/ovnkube-node-srkh5" Sep 08 02:40:38.113794 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.112959 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/846f41ef-3791-446b-b3e8-e05c195b7085-lib-modules\") pod \"tuned-8tddq\" (UID: \"846f41ef-3791-446b-b3e8-e05c195b7085\") " pod="openshift-cluster-node-tuning-operator/tuned-8tddq" Sep 08 02:40:38.117796 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:40:38.117773 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 08 02:40:38.117910 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:40:38.117801 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 08 02:40:38.117910 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:40:38.117823 2564 projected.go:196] Error preparing data for projected volume kube-api-access-p6rtt for pod openshift-network-diagnostics/network-check-target-s7mcq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 02:40:38.117910 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:40:38.117886 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f47c576f-2537-4625-be1f-fb82cbb3694e-kube-api-access-p6rtt podName:f47c576f-2537-4625-be1f-fb82cbb3694e nodeName:}" failed. No retries permitted until 2026-09-08 02:40:38.617868647 +0000 UTC m=+3.052842322 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-p6rtt" (UniqueName: "kubernetes.io/projected/f47c576f-2537-4625-be1f-fb82cbb3694e-kube-api-access-p6rtt") pod "network-check-target-s7mcq" (UID: "f47c576f-2537-4625-be1f-fb82cbb3694e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 02:40:38.119155 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.119129 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6kfkg\" (UniqueName: \"kubernetes.io/projected/22f90f96-0ae6-459f-bd10-15f4c72e0935-kube-api-access-6kfkg\") pod \"multus-additional-cni-plugins-9w5n9\" (UID: \"22f90f96-0ae6-459f-bd10-15f4c72e0935\") " pod="openshift-multus/multus-additional-cni-plugins-9w5n9" Sep 08 02:40:38.119754 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.119685 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/846f41ef-3791-446b-b3e8-e05c195b7085-etc-tuned\") pod \"tuned-8tddq\" (UID: \"846f41ef-3791-446b-b3e8-e05c195b7085\") " pod="openshift-cluster-node-tuning-operator/tuned-8tddq" Sep 08 02:40:38.120159 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.120136 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cxfrf\" (UniqueName: \"kubernetes.io/projected/846f41ef-3791-446b-b3e8-e05c195b7085-kube-api-access-cxfrf\") pod \"tuned-8tddq\" (UID: \"846f41ef-3791-446b-b3e8-e05c195b7085\") " pod="openshift-cluster-node-tuning-operator/tuned-8tddq" Sep 08 02:40:38.122146 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.122105 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6b8d2\" (UniqueName: \"kubernetes.io/projected/29ec0f1b-c020-42c6-a505-15aad11faa83-kube-api-access-6b8d2\") pod \"iptables-alerter-cncrx\" (UID: \"29ec0f1b-c020-42c6-a505-15aad11faa83\") " pod="openshift-network-operator/iptables-alerter-cncrx" Sep 08 02:40:38.123177 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.123136 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/846f41ef-3791-446b-b3e8-e05c195b7085-tmp\") pod \"tuned-8tddq\" (UID: \"846f41ef-3791-446b-b3e8-e05c195b7085\") " pod="openshift-cluster-node-tuning-operator/tuned-8tddq" Sep 08 02:40:38.191734 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.191703 2564 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 08 02:40:38.213104 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.213068 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k45lm\" (UniqueName: \"kubernetes.io/projected/e0a56211-24ee-40c8-be53-d5e518a5342b-kube-api-access-k45lm\") pod \"network-metrics-daemon-ckt96\" (UID: \"e0a56211-24ee-40c8-be53-d5e518a5342b\") " pod="openshift-multus/network-metrics-daemon-ckt96" Sep 08 02:40:38.213104 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.213108 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/53b75799-2383-445c-9d14-57322844c559-host-run-netns\") pod \"ovnkube-node-srkh5\" (UID: \"53b75799-2383-445c-9d14-57322844c559\") " pod="openshift-ovn-kubernetes/ovnkube-node-srkh5" Sep 08 02:40:38.213344 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.213133 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/50d2c5c2-28aa-4ce1-9ad9-50b2493d3129-tmp-dir\") pod \"node-resolver-2667g\" (UID: \"50d2c5c2-28aa-4ce1-9ad9-50b2493d3129\") " pod="openshift-dns/node-resolver-2667g" Sep 08 02:40:38.213344 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.213153 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ba1b8aaf-174d-4dbb-b7a2-af66170d03b0-host\") pod \"node-ca-njl2b\" (UID: \"ba1b8aaf-174d-4dbb-b7a2-af66170d03b0\") " pod="openshift-image-registry/node-ca-njl2b" Sep 08 02:40:38.213344 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.213174 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ba1b8aaf-174d-4dbb-b7a2-af66170d03b0-serviceca\") pod \"node-ca-njl2b\" (UID: \"ba1b8aaf-174d-4dbb-b7a2-af66170d03b0\") " pod="openshift-image-registry/node-ca-njl2b" Sep 08 02:40:38.213344 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.213198 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e0a56211-24ee-40c8-be53-d5e518a5342b-metrics-certs\") pod \"network-metrics-daemon-ckt96\" (UID: \"e0a56211-24ee-40c8-be53-d5e518a5342b\") " pod="openshift-multus/network-metrics-daemon-ckt96" Sep 08 02:40:38.213344 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.213220 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/53b75799-2383-445c-9d14-57322844c559-host-cni-bin\") pod \"ovnkube-node-srkh5\" (UID: \"53b75799-2383-445c-9d14-57322844c559\") " pod="openshift-ovn-kubernetes/ovnkube-node-srkh5" Sep 08 02:40:38.213344 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.213244 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/53b75799-2383-445c-9d14-57322844c559-host-kubelet\") pod \"ovnkube-node-srkh5\" (UID: \"53b75799-2383-445c-9d14-57322844c559\") " pod="openshift-ovn-kubernetes/ovnkube-node-srkh5" Sep 08 02:40:38.213344 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.213267 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/53b75799-2383-445c-9d14-57322844c559-etc-openvswitch\") pod \"ovnkube-node-srkh5\" (UID: \"53b75799-2383-445c-9d14-57322844c559\") " pod="openshift-ovn-kubernetes/ovnkube-node-srkh5" Sep 08 02:40:38.213344 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.213288 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/53b75799-2383-445c-9d14-57322844c559-host-cni-netd\") pod \"ovnkube-node-srkh5\" (UID: \"53b75799-2383-445c-9d14-57322844c559\") " pod="openshift-ovn-kubernetes/ovnkube-node-srkh5" Sep 08 02:40:38.213344 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.213310 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/53b75799-2383-445c-9d14-57322844c559-ovn-node-metrics-cert\") pod \"ovnkube-node-srkh5\" (UID: \"53b75799-2383-445c-9d14-57322844c559\") " pod="openshift-ovn-kubernetes/ovnkube-node-srkh5" Sep 08 02:40:38.213344 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.213333 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vvqmr\" (UniqueName: \"kubernetes.io/projected/e093be54-1d5e-4af7-9417-37cfa9965bde-kube-api-access-vvqmr\") pod \"aws-ebs-csi-driver-node-8fvvh\" (UID: \"e093be54-1d5e-4af7-9417-37cfa9965bde\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8fvvh" Sep 08 02:40:38.213867 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.213371 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/75f73d39-6aff-4777-a417-4d6ac2f786ff-agent-certs\") pod \"konnectivity-agent-j8s84\" (UID: \"75f73d39-6aff-4777-a417-4d6ac2f786ff\") " pod="kube-system/konnectivity-agent-j8s84" Sep 08 02:40:38.213867 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.213394 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/75f73d39-6aff-4777-a417-4d6ac2f786ff-konnectivity-ca\") pod \"konnectivity-agent-j8s84\" (UID: \"75f73d39-6aff-4777-a417-4d6ac2f786ff\") " pod="kube-system/konnectivity-agent-j8s84" Sep 08 02:40:38.213867 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.213416 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3d2ae2a6-8064-42ae-b0ac-a19fb610c368-multus-daemon-config\") pod \"multus-qj94z\" (UID: \"3d2ae2a6-8064-42ae-b0ac-a19fb610c368\") " pod="openshift-multus/multus-qj94z" Sep 08 02:40:38.213867 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.213440 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/50d2c5c2-28aa-4ce1-9ad9-50b2493d3129-hosts-file\") pod \"node-resolver-2667g\" (UID: \"50d2c5c2-28aa-4ce1-9ad9-50b2493d3129\") " pod="openshift-dns/node-resolver-2667g" Sep 08 02:40:38.213867 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.213461 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e093be54-1d5e-4af7-9417-37cfa9965bde-etc-selinux\") pod \"aws-ebs-csi-driver-node-8fvvh\" (UID: \"e093be54-1d5e-4af7-9417-37cfa9965bde\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8fvvh" Sep 08 02:40:38.213867 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.213483 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3d2ae2a6-8064-42ae-b0ac-a19fb610c368-host-var-lib-cni-multus\") pod \"multus-qj94z\" (UID: \"3d2ae2a6-8064-42ae-b0ac-a19fb610c368\") " pod="openshift-multus/multus-qj94z" Sep 08 02:40:38.213867 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.213505 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3d2ae2a6-8064-42ae-b0ac-a19fb610c368-host-run-multus-certs\") pod \"multus-qj94z\" (UID: \"3d2ae2a6-8064-42ae-b0ac-a19fb610c368\") " pod="openshift-multus/multus-qj94z" Sep 08 02:40:38.213867 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.213523 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3d2ae2a6-8064-42ae-b0ac-a19fb610c368-multus-socket-dir-parent\") pod \"multus-qj94z\" (UID: \"3d2ae2a6-8064-42ae-b0ac-a19fb610c368\") " pod="openshift-multus/multus-qj94z" Sep 08 02:40:38.213867 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.213540 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3d2ae2a6-8064-42ae-b0ac-a19fb610c368-host-run-netns\") pod \"multus-qj94z\" (UID: \"3d2ae2a6-8064-42ae-b0ac-a19fb610c368\") " pod="openshift-multus/multus-qj94z" Sep 08 02:40:38.213867 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.213562 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3d2ae2a6-8064-42ae-b0ac-a19fb610c368-hostroot\") pod \"multus-qj94z\" (UID: \"3d2ae2a6-8064-42ae-b0ac-a19fb610c368\") " pod="openshift-multus/multus-qj94z" Sep 08 02:40:38.213867 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.213589 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/53b75799-2383-445c-9d14-57322844c559-host-slash\") pod \"ovnkube-node-srkh5\" (UID: \"53b75799-2383-445c-9d14-57322844c559\") " pod="openshift-ovn-kubernetes/ovnkube-node-srkh5" Sep 08 02:40:38.213867 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.213611 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/53b75799-2383-445c-9d14-57322844c559-node-log\") pod \"ovnkube-node-srkh5\" (UID: \"53b75799-2383-445c-9d14-57322844c559\") " pod="openshift-ovn-kubernetes/ovnkube-node-srkh5" Sep 08 02:40:38.213867 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.213635 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/53b75799-2383-445c-9d14-57322844c559-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-srkh5\" (UID: \"53b75799-2383-445c-9d14-57322844c559\") " pod="openshift-ovn-kubernetes/ovnkube-node-srkh5" Sep 08 02:40:38.213867 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.213659 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/53b75799-2383-445c-9d14-57322844c559-env-overrides\") pod \"ovnkube-node-srkh5\" (UID: \"53b75799-2383-445c-9d14-57322844c559\") " pod="openshift-ovn-kubernetes/ovnkube-node-srkh5" Sep 08 02:40:38.213867 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.213679 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/53b75799-2383-445c-9d14-57322844c559-ovnkube-script-lib\") pod \"ovnkube-node-srkh5\" (UID: \"53b75799-2383-445c-9d14-57322844c559\") " pod="openshift-ovn-kubernetes/ovnkube-node-srkh5" Sep 08 02:40:38.213867 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.213699 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3d2ae2a6-8064-42ae-b0ac-a19fb610c368-cni-binary-copy\") pod \"multus-qj94z\" (UID: \"3d2ae2a6-8064-42ae-b0ac-a19fb610c368\") " pod="openshift-multus/multus-qj94z" Sep 08 02:40:38.213867 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.213719 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/53b75799-2383-445c-9d14-57322844c559-var-lib-openvswitch\") pod \"ovnkube-node-srkh5\" (UID: \"53b75799-2383-445c-9d14-57322844c559\") " pod="openshift-ovn-kubernetes/ovnkube-node-srkh5" Sep 08 02:40:38.214669 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.213738 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e093be54-1d5e-4af7-9417-37cfa9965bde-device-dir\") pod \"aws-ebs-csi-driver-node-8fvvh\" (UID: \"e093be54-1d5e-4af7-9417-37cfa9965bde\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8fvvh" Sep 08 02:40:38.214669 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.213761 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/53b75799-2383-445c-9d14-57322844c559-log-socket\") pod \"ovnkube-node-srkh5\" (UID: \"53b75799-2383-445c-9d14-57322844c559\") " pod="openshift-ovn-kubernetes/ovnkube-node-srkh5" Sep 08 02:40:38.214669 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.213786 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e093be54-1d5e-4af7-9417-37cfa9965bde-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8fvvh\" (UID: \"e093be54-1d5e-4af7-9417-37cfa9965bde\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8fvvh" Sep 08 02:40:38.214669 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.213838 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qtmvt\" (UniqueName: \"kubernetes.io/projected/ba1b8aaf-174d-4dbb-b7a2-af66170d03b0-kube-api-access-qtmvt\") pod \"node-ca-njl2b\" (UID: \"ba1b8aaf-174d-4dbb-b7a2-af66170d03b0\") " pod="openshift-image-registry/node-ca-njl2b" Sep 08 02:40:38.214669 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.213864 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3d2ae2a6-8064-42ae-b0ac-a19fb610c368-host-var-lib-kubelet\") pod \"multus-qj94z\" (UID: \"3d2ae2a6-8064-42ae-b0ac-a19fb610c368\") " pod="openshift-multus/multus-qj94z" Sep 08 02:40:38.214669 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.213887 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4qmgr\" (UniqueName: \"kubernetes.io/projected/3d2ae2a6-8064-42ae-b0ac-a19fb610c368-kube-api-access-4qmgr\") pod \"multus-qj94z\" (UID: \"3d2ae2a6-8064-42ae-b0ac-a19fb610c368\") " pod="openshift-multus/multus-qj94z" Sep 08 02:40:38.214669 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.213912 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e093be54-1d5e-4af7-9417-37cfa9965bde-socket-dir\") pod \"aws-ebs-csi-driver-node-8fvvh\" (UID: \"e093be54-1d5e-4af7-9417-37cfa9965bde\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8fvvh" Sep 08 02:40:38.214669 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.213935 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/53b75799-2383-445c-9d14-57322844c559-systemd-units\") pod \"ovnkube-node-srkh5\" (UID: \"53b75799-2383-445c-9d14-57322844c559\") " pod="openshift-ovn-kubernetes/ovnkube-node-srkh5" Sep 08 02:40:38.214669 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.213963 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/53b75799-2383-445c-9d14-57322844c559-run-openvswitch\") pod \"ovnkube-node-srkh5\" (UID: \"53b75799-2383-445c-9d14-57322844c559\") " pod="openshift-ovn-kubernetes/ovnkube-node-srkh5" Sep 08 02:40:38.214669 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.213998 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3d2ae2a6-8064-42ae-b0ac-a19fb610c368-system-cni-dir\") pod \"multus-qj94z\" (UID: \"3d2ae2a6-8064-42ae-b0ac-a19fb610c368\") " pod="openshift-multus/multus-qj94z" Sep 08 02:40:38.214669 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.214021 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3d2ae2a6-8064-42ae-b0ac-a19fb610c368-etc-kubernetes\") pod \"multus-qj94z\" (UID: \"3d2ae2a6-8064-42ae-b0ac-a19fb610c368\") " pod="openshift-multus/multus-qj94z" Sep 08 02:40:38.214669 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.214047 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/53b75799-2383-445c-9d14-57322844c559-host-run-ovn-kubernetes\") pod \"ovnkube-node-srkh5\" (UID: \"53b75799-2383-445c-9d14-57322844c559\") " pod="openshift-ovn-kubernetes/ovnkube-node-srkh5" Sep 08 02:40:38.214669 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.214071 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dhs4t\" (UniqueName: \"kubernetes.io/projected/50d2c5c2-28aa-4ce1-9ad9-50b2493d3129-kube-api-access-dhs4t\") pod \"node-resolver-2667g\" (UID: \"50d2c5c2-28aa-4ce1-9ad9-50b2493d3129\") " pod="openshift-dns/node-resolver-2667g" Sep 08 02:40:38.214669 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.214095 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e093be54-1d5e-4af7-9417-37cfa9965bde-registration-dir\") pod \"aws-ebs-csi-driver-node-8fvvh\" (UID: \"e093be54-1d5e-4af7-9417-37cfa9965bde\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8fvvh" Sep 08 02:40:38.214669 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.214120 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/53b75799-2383-445c-9d14-57322844c559-run-systemd\") pod \"ovnkube-node-srkh5\" (UID: \"53b75799-2383-445c-9d14-57322844c559\") " pod="openshift-ovn-kubernetes/ovnkube-node-srkh5" Sep 08 02:40:38.214669 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.214148 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3d2ae2a6-8064-42ae-b0ac-a19fb610c368-host-run-k8s-cni-cncf-io\") pod \"multus-qj94z\" (UID: \"3d2ae2a6-8064-42ae-b0ac-a19fb610c368\") " pod="openshift-multus/multus-qj94z" Sep 08 02:40:38.214669 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.214172 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3d2ae2a6-8064-42ae-b0ac-a19fb610c368-host-var-lib-cni-bin\") pod \"multus-qj94z\" (UID: \"3d2ae2a6-8064-42ae-b0ac-a19fb610c368\") " pod="openshift-multus/multus-qj94z" Sep 08 02:40:38.215496 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.214195 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3d2ae2a6-8064-42ae-b0ac-a19fb610c368-multus-conf-dir\") pod \"multus-qj94z\" (UID: \"3d2ae2a6-8064-42ae-b0ac-a19fb610c368\") " pod="openshift-multus/multus-qj94z" Sep 08 02:40:38.215496 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.214219 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/53b75799-2383-445c-9d14-57322844c559-run-ovn\") pod \"ovnkube-node-srkh5\" (UID: \"53b75799-2383-445c-9d14-57322844c559\") " pod="openshift-ovn-kubernetes/ovnkube-node-srkh5" Sep 08 02:40:38.215496 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.214242 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/53b75799-2383-445c-9d14-57322844c559-ovnkube-config\") pod \"ovnkube-node-srkh5\" (UID: \"53b75799-2383-445c-9d14-57322844c559\") " pod="openshift-ovn-kubernetes/ovnkube-node-srkh5" Sep 08 02:40:38.215496 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.214266 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e093be54-1d5e-4af7-9417-37cfa9965bde-sys-fs\") pod \"aws-ebs-csi-driver-node-8fvvh\" (UID: \"e093be54-1d5e-4af7-9417-37cfa9965bde\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8fvvh" Sep 08 02:40:38.215496 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.214291 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3d2ae2a6-8064-42ae-b0ac-a19fb610c368-cnibin\") pod \"multus-qj94z\" (UID: \"3d2ae2a6-8064-42ae-b0ac-a19fb610c368\") " pod="openshift-multus/multus-qj94z" Sep 08 02:40:38.215496 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.214315 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q5mxm\" (UniqueName: \"kubernetes.io/projected/53b75799-2383-445c-9d14-57322844c559-kube-api-access-q5mxm\") pod \"ovnkube-node-srkh5\" (UID: \"53b75799-2383-445c-9d14-57322844c559\") " pod="openshift-ovn-kubernetes/ovnkube-node-srkh5" Sep 08 02:40:38.215496 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.214342 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3d2ae2a6-8064-42ae-b0ac-a19fb610c368-multus-cni-dir\") pod \"multus-qj94z\" (UID: \"3d2ae2a6-8064-42ae-b0ac-a19fb610c368\") " pod="openshift-multus/multus-qj94z" Sep 08 02:40:38.215496 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.214479 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3d2ae2a6-8064-42ae-b0ac-a19fb610c368-multus-cni-dir\") pod \"multus-qj94z\" (UID: \"3d2ae2a6-8064-42ae-b0ac-a19fb610c368\") " pod="openshift-multus/multus-qj94z" Sep 08 02:40:38.215496 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.214748 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/53b75799-2383-445c-9d14-57322844c559-host-run-netns\") pod \"ovnkube-node-srkh5\" (UID: \"53b75799-2383-445c-9d14-57322844c559\") " pod="openshift-ovn-kubernetes/ovnkube-node-srkh5" Sep 08 02:40:38.215496 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.215047 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/50d2c5c2-28aa-4ce1-9ad9-50b2493d3129-tmp-dir\") pod \"node-resolver-2667g\" (UID: \"50d2c5c2-28aa-4ce1-9ad9-50b2493d3129\") " pod="openshift-dns/node-resolver-2667g" Sep 08 02:40:38.215496 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.215100 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ba1b8aaf-174d-4dbb-b7a2-af66170d03b0-host\") pod \"node-ca-njl2b\" (UID: \"ba1b8aaf-174d-4dbb-b7a2-af66170d03b0\") " pod="openshift-image-registry/node-ca-njl2b" Sep 08 02:40:38.215496 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.215465 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ba1b8aaf-174d-4dbb-b7a2-af66170d03b0-serviceca\") pod \"node-ca-njl2b\" (UID: \"ba1b8aaf-174d-4dbb-b7a2-af66170d03b0\") " pod="openshift-image-registry/node-ca-njl2b" Sep 08 02:40:38.216071 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:40:38.215556 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 02:40:38.216071 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:40:38.215608 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0a56211-24ee-40c8-be53-d5e518a5342b-metrics-certs podName:e0a56211-24ee-40c8-be53-d5e518a5342b nodeName:}" failed. No retries permitted until 2026-09-08 02:40:38.715591426 +0000 UTC m=+3.150565096 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e0a56211-24ee-40c8-be53-d5e518a5342b-metrics-certs") pod "network-metrics-daemon-ckt96" (UID: "e0a56211-24ee-40c8-be53-d5e518a5342b") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 02:40:38.216071 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.215801 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/53b75799-2383-445c-9d14-57322844c559-host-cni-bin\") pod \"ovnkube-node-srkh5\" (UID: \"53b75799-2383-445c-9d14-57322844c559\") " pod="openshift-ovn-kubernetes/ovnkube-node-srkh5" Sep 08 02:40:38.216071 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.215845 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/53b75799-2383-445c-9d14-57322844c559-host-kubelet\") pod \"ovnkube-node-srkh5\" (UID: \"53b75799-2383-445c-9d14-57322844c559\") " pod="openshift-ovn-kubernetes/ovnkube-node-srkh5" Sep 08 02:40:38.216071 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.215879 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/53b75799-2383-445c-9d14-57322844c559-etc-openvswitch\") pod \"ovnkube-node-srkh5\" (UID: \"53b75799-2383-445c-9d14-57322844c559\") " pod="openshift-ovn-kubernetes/ovnkube-node-srkh5" Sep 08 02:40:38.216071 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.215922 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/53b75799-2383-445c-9d14-57322844c559-host-cni-netd\") pod \"ovnkube-node-srkh5\" (UID: \"53b75799-2383-445c-9d14-57322844c559\") " pod="openshift-ovn-kubernetes/ovnkube-node-srkh5" Sep 08 02:40:38.216071 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.216027 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3d2ae2a6-8064-42ae-b0ac-a19fb610c368-host-run-netns\") pod \"multus-qj94z\" (UID: \"3d2ae2a6-8064-42ae-b0ac-a19fb610c368\") " pod="openshift-multus/multus-qj94z" Sep 08 02:40:38.216071 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.216047 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3d2ae2a6-8064-42ae-b0ac-a19fb610c368-hostroot\") pod \"multus-qj94z\" (UID: \"3d2ae2a6-8064-42ae-b0ac-a19fb610c368\") " pod="openshift-multus/multus-qj94z" Sep 08 02:40:38.216507 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.216081 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e093be54-1d5e-4af7-9417-37cfa9965bde-registration-dir\") pod \"aws-ebs-csi-driver-node-8fvvh\" (UID: \"e093be54-1d5e-4af7-9417-37cfa9965bde\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8fvvh" Sep 08 02:40:38.216507 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.216090 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/53b75799-2383-445c-9d14-57322844c559-host-slash\") pod \"ovnkube-node-srkh5\" (UID: \"53b75799-2383-445c-9d14-57322844c559\") " pod="openshift-ovn-kubernetes/ovnkube-node-srkh5" Sep 08 02:40:38.216507 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.216153 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/53b75799-2383-445c-9d14-57322844c559-node-log\") pod \"ovnkube-node-srkh5\" (UID: \"53b75799-2383-445c-9d14-57322844c559\") " pod="openshift-ovn-kubernetes/ovnkube-node-srkh5" Sep 08 02:40:38.216507 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.216193 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/53b75799-2383-445c-9d14-57322844c559-var-lib-openvswitch\") pod \"ovnkube-node-srkh5\" (UID: \"53b75799-2383-445c-9d14-57322844c559\") " pod="openshift-ovn-kubernetes/ovnkube-node-srkh5" Sep 08 02:40:38.216507 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.216384 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3d2ae2a6-8064-42ae-b0ac-a19fb610c368-host-var-lib-kubelet\") pod \"multus-qj94z\" (UID: \"3d2ae2a6-8064-42ae-b0ac-a19fb610c368\") " pod="openshift-multus/multus-qj94z" Sep 08 02:40:38.216507 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.216433 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/53b75799-2383-445c-9d14-57322844c559-run-ovn\") pod \"ovnkube-node-srkh5\" (UID: \"53b75799-2383-445c-9d14-57322844c559\") " pod="openshift-ovn-kubernetes/ovnkube-node-srkh5" Sep 08 02:40:38.216507 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.216442 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/53b75799-2383-445c-9d14-57322844c559-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-srkh5\" (UID: \"53b75799-2383-445c-9d14-57322844c559\") " pod="openshift-ovn-kubernetes/ovnkube-node-srkh5" Sep 08 02:40:38.216873 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.216507 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3d2ae2a6-8064-42ae-b0ac-a19fb610c368-host-run-k8s-cni-cncf-io\") pod \"multus-qj94z\" (UID: \"3d2ae2a6-8064-42ae-b0ac-a19fb610c368\") " pod="openshift-multus/multus-qj94z" Sep 08 02:40:38.216873 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.216512 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/53b75799-2383-445c-9d14-57322844c559-run-systemd\") pod \"ovnkube-node-srkh5\" (UID: \"53b75799-2383-445c-9d14-57322844c559\") " pod="openshift-ovn-kubernetes/ovnkube-node-srkh5" Sep 08 02:40:38.216873 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.216573 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3d2ae2a6-8064-42ae-b0ac-a19fb610c368-system-cni-dir\") pod \"multus-qj94z\" (UID: \"3d2ae2a6-8064-42ae-b0ac-a19fb610c368\") " pod="openshift-multus/multus-qj94z" Sep 08 02:40:38.216873 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.216597 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3d2ae2a6-8064-42ae-b0ac-a19fb610c368-etc-kubernetes\") pod \"multus-qj94z\" (UID: \"3d2ae2a6-8064-42ae-b0ac-a19fb610c368\") " pod="openshift-multus/multus-qj94z" Sep 08 02:40:38.216873 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.216643 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3d2ae2a6-8064-42ae-b0ac-a19fb610c368-cni-binary-copy\") pod \"multus-qj94z\" (UID: \"3d2ae2a6-8064-42ae-b0ac-a19fb610c368\") " pod="openshift-multus/multus-qj94z" Sep 08 02:40:38.216873 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.216661 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/53b75799-2383-445c-9d14-57322844c559-host-run-ovn-kubernetes\") pod \"ovnkube-node-srkh5\" (UID: \"53b75799-2383-445c-9d14-57322844c559\") " pod="openshift-ovn-kubernetes/ovnkube-node-srkh5" Sep 08 02:40:38.216873 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.216675 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/53b75799-2383-445c-9d14-57322844c559-ovnkube-script-lib\") pod \"ovnkube-node-srkh5\" (UID: \"53b75799-2383-445c-9d14-57322844c559\") " pod="openshift-ovn-kubernetes/ovnkube-node-srkh5" Sep 08 02:40:38.216873 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.216699 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/53b75799-2383-445c-9d14-57322844c559-log-socket\") pod \"ovnkube-node-srkh5\" (UID: \"53b75799-2383-445c-9d14-57322844c559\") " pod="openshift-ovn-kubernetes/ovnkube-node-srkh5" Sep 08 02:40:38.216873 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.216700 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e093be54-1d5e-4af7-9417-37cfa9965bde-socket-dir\") pod \"aws-ebs-csi-driver-node-8fvvh\" (UID: \"e093be54-1d5e-4af7-9417-37cfa9965bde\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8fvvh" Sep 08 02:40:38.216873 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.216711 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/75f73d39-6aff-4777-a417-4d6ac2f786ff-konnectivity-ca\") pod \"konnectivity-agent-j8s84\" (UID: \"75f73d39-6aff-4777-a417-4d6ac2f786ff\") " pod="kube-system/konnectivity-agent-j8s84" Sep 08 02:40:38.216873 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.216735 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e093be54-1d5e-4af7-9417-37cfa9965bde-device-dir\") pod \"aws-ebs-csi-driver-node-8fvvh\" (UID: \"e093be54-1d5e-4af7-9417-37cfa9965bde\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8fvvh" Sep 08 02:40:38.216873 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.216766 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3d2ae2a6-8064-42ae-b0ac-a19fb610c368-host-var-lib-cni-multus\") pod \"multus-qj94z\" (UID: \"3d2ae2a6-8064-42ae-b0ac-a19fb610c368\") " pod="openshift-multus/multus-qj94z" Sep 08 02:40:38.216873 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.216792 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3d2ae2a6-8064-42ae-b0ac-a19fb610c368-multus-socket-dir-parent\") pod \"multus-qj94z\" (UID: \"3d2ae2a6-8064-42ae-b0ac-a19fb610c368\") " pod="openshift-multus/multus-qj94z" Sep 08 02:40:38.216873 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.216810 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e093be54-1d5e-4af7-9417-37cfa9965bde-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8fvvh\" (UID: \"e093be54-1d5e-4af7-9417-37cfa9965bde\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8fvvh" Sep 08 02:40:38.216873 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.216837 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3d2ae2a6-8064-42ae-b0ac-a19fb610c368-host-run-multus-certs\") pod \"multus-qj94z\" (UID: \"3d2ae2a6-8064-42ae-b0ac-a19fb610c368\") " pod="openshift-multus/multus-qj94z" Sep 08 02:40:38.216873 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.216836 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e093be54-1d5e-4af7-9417-37cfa9965bde-etc-selinux\") pod \"aws-ebs-csi-driver-node-8fvvh\" (UID: \"e093be54-1d5e-4af7-9417-37cfa9965bde\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8fvvh" Sep 08 02:40:38.216873 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.216877 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/53b75799-2383-445c-9d14-57322844c559-env-overrides\") pod \"ovnkube-node-srkh5\" (UID: \"53b75799-2383-445c-9d14-57322844c559\") " pod="openshift-ovn-kubernetes/ovnkube-node-srkh5" Sep 08 02:40:38.217736 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.216892 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3d2ae2a6-8064-42ae-b0ac-a19fb610c368-cnibin\") pod \"multus-qj94z\" (UID: \"3d2ae2a6-8064-42ae-b0ac-a19fb610c368\") " pod="openshift-multus/multus-qj94z" Sep 08 02:40:38.217736 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.216738 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/53b75799-2383-445c-9d14-57322844c559-systemd-units\") pod \"ovnkube-node-srkh5\" (UID: \"53b75799-2383-445c-9d14-57322844c559\") " pod="openshift-ovn-kubernetes/ovnkube-node-srkh5" Sep 08 02:40:38.217736 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.216910 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e093be54-1d5e-4af7-9417-37cfa9965bde-sys-fs\") pod \"aws-ebs-csi-driver-node-8fvvh\" (UID: \"e093be54-1d5e-4af7-9417-37cfa9965bde\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8fvvh" Sep 08 02:40:38.217736 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.216947 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3d2ae2a6-8064-42ae-b0ac-a19fb610c368-host-var-lib-cni-bin\") pod \"multus-qj94z\" (UID: \"3d2ae2a6-8064-42ae-b0ac-a19fb610c368\") " pod="openshift-multus/multus-qj94z" Sep 08 02:40:38.217736 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.216984 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/53b75799-2383-445c-9d14-57322844c559-run-openvswitch\") pod \"ovnkube-node-srkh5\" (UID: \"53b75799-2383-445c-9d14-57322844c559\") " pod="openshift-ovn-kubernetes/ovnkube-node-srkh5" Sep 08 02:40:38.217736 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.216994 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3d2ae2a6-8064-42ae-b0ac-a19fb610c368-multus-conf-dir\") pod \"multus-qj94z\" (UID: \"3d2ae2a6-8064-42ae-b0ac-a19fb610c368\") " pod="openshift-multus/multus-qj94z" Sep 08 02:40:38.217736 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.217029 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/50d2c5c2-28aa-4ce1-9ad9-50b2493d3129-hosts-file\") pod \"node-resolver-2667g\" (UID: \"50d2c5c2-28aa-4ce1-9ad9-50b2493d3129\") " pod="openshift-dns/node-resolver-2667g" Sep 08 02:40:38.217736 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.217149 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3d2ae2a6-8064-42ae-b0ac-a19fb610c368-multus-daemon-config\") pod \"multus-qj94z\" (UID: \"3d2ae2a6-8064-42ae-b0ac-a19fb610c368\") " pod="openshift-multus/multus-qj94z" Sep 08 02:40:38.217736 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.217306 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/53b75799-2383-445c-9d14-57322844c559-ovnkube-config\") pod \"ovnkube-node-srkh5\" (UID: \"53b75799-2383-445c-9d14-57322844c559\") " pod="openshift-ovn-kubernetes/ovnkube-node-srkh5" Sep 08 02:40:38.219450 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.219427 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/53b75799-2383-445c-9d14-57322844c559-ovn-node-metrics-cert\") pod \"ovnkube-node-srkh5\" (UID: \"53b75799-2383-445c-9d14-57322844c559\") " pod="openshift-ovn-kubernetes/ovnkube-node-srkh5" Sep 08 02:40:38.219875 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.219855 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/75f73d39-6aff-4777-a417-4d6ac2f786ff-agent-certs\") pod \"konnectivity-agent-j8s84\" (UID: \"75f73d39-6aff-4777-a417-4d6ac2f786ff\") " pod="kube-system/konnectivity-agent-j8s84" Sep 08 02:40:38.224720 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.224673 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k45lm\" (UniqueName: \"kubernetes.io/projected/e0a56211-24ee-40c8-be53-d5e518a5342b-kube-api-access-k45lm\") pod \"network-metrics-daemon-ckt96\" (UID: \"e0a56211-24ee-40c8-be53-d5e518a5342b\") " pod="openshift-multus/network-metrics-daemon-ckt96" Sep 08 02:40:38.225395 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.225293 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qtmvt\" (UniqueName: \"kubernetes.io/projected/ba1b8aaf-174d-4dbb-b7a2-af66170d03b0-kube-api-access-qtmvt\") pod \"node-ca-njl2b\" (UID: \"ba1b8aaf-174d-4dbb-b7a2-af66170d03b0\") " pod="openshift-image-registry/node-ca-njl2b" Sep 08 02:40:38.225836 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.225802 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4qmgr\" (UniqueName: \"kubernetes.io/projected/3d2ae2a6-8064-42ae-b0ac-a19fb610c368-kube-api-access-4qmgr\") pod \"multus-qj94z\" (UID: \"3d2ae2a6-8064-42ae-b0ac-a19fb610c368\") " pod="openshift-multus/multus-qj94z" Sep 08 02:40:38.226294 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.226271 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q5mxm\" (UniqueName: \"kubernetes.io/projected/53b75799-2383-445c-9d14-57322844c559-kube-api-access-q5mxm\") pod \"ovnkube-node-srkh5\" (UID: \"53b75799-2383-445c-9d14-57322844c559\") " pod="openshift-ovn-kubernetes/ovnkube-node-srkh5" Sep 08 02:40:38.226793 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.226769 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dhs4t\" (UniqueName: \"kubernetes.io/projected/50d2c5c2-28aa-4ce1-9ad9-50b2493d3129-kube-api-access-dhs4t\") pod \"node-resolver-2667g\" (UID: \"50d2c5c2-28aa-4ce1-9ad9-50b2493d3129\") " pod="openshift-dns/node-resolver-2667g" Sep 08 02:40:38.227066 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.227044 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vvqmr\" (UniqueName: \"kubernetes.io/projected/e093be54-1d5e-4af7-9417-37cfa9965bde-kube-api-access-vvqmr\") pod \"aws-ebs-csi-driver-node-8fvvh\" (UID: \"e093be54-1d5e-4af7-9417-37cfa9965bde\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8fvvh" Sep 08 02:40:38.310270 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.310240 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-9w5n9" Sep 08 02:40:38.325244 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.325219 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8tddq" Sep 08 02:40:38.336864 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.336843 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-cncrx" Sep 08 02:40:38.346638 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.346610 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-j8s84" Sep 08 02:40:38.354365 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.354321 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-2667g" Sep 08 02:40:38.361127 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.361105 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-njl2b" Sep 08 02:40:38.369861 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.369839 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8fvvh" Sep 08 02:40:38.375555 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.375530 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-qj94z" Sep 08 02:40:38.383205 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.383186 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-srkh5" Sep 08 02:40:38.617541 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.617454 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ce406489-045e-4ba5-baa6-337a983d5466-original-pull-secret\") pod \"global-pull-secret-syncer-s6jbs\" (UID: \"ce406489-045e-4ba5-baa6-337a983d5466\") " pod="kube-system/global-pull-secret-syncer-s6jbs" Sep 08 02:40:38.617698 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:40:38.617563 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 08 02:40:38.617698 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:40:38.617632 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce406489-045e-4ba5-baa6-337a983d5466-original-pull-secret podName:ce406489-045e-4ba5-baa6-337a983d5466 nodeName:}" failed. No retries permitted until 2026-09-08 02:40:39.617608306 +0000 UTC m=+4.052581990 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ce406489-045e-4ba5-baa6-337a983d5466-original-pull-secret") pod "global-pull-secret-syncer-s6jbs" (UID: "ce406489-045e-4ba5-baa6-337a983d5466") : object "kube-system"/"original-pull-secret" not registered Sep 08 02:40:38.718614 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.718588 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e0a56211-24ee-40c8-be53-d5e518a5342b-metrics-certs\") pod \"network-metrics-daemon-ckt96\" (UID: \"e0a56211-24ee-40c8-be53-d5e518a5342b\") " pod="openshift-multus/network-metrics-daemon-ckt96" Sep 08 02:40:38.718785 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:38.718629 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6rtt\" (UniqueName: \"kubernetes.io/projected/f47c576f-2537-4625-be1f-fb82cbb3694e-kube-api-access-p6rtt\") pod \"network-check-target-s7mcq\" (UID: \"f47c576f-2537-4625-be1f-fb82cbb3694e\") " pod="openshift-network-diagnostics/network-check-target-s7mcq" Sep 08 02:40:38.718785 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:40:38.718735 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 02:40:38.718896 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:40:38.718810 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0a56211-24ee-40c8-be53-d5e518a5342b-metrics-certs podName:e0a56211-24ee-40c8-be53-d5e518a5342b nodeName:}" failed. No retries permitted until 2026-09-08 02:40:39.718788712 +0000 UTC m=+4.153762393 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e0a56211-24ee-40c8-be53-d5e518a5342b-metrics-certs") pod "network-metrics-daemon-ckt96" (UID: "e0a56211-24ee-40c8-be53-d5e518a5342b") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 02:40:38.718896 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:40:38.718741 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 08 02:40:38.718896 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:40:38.718837 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 08 02:40:38.718896 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:40:38.718845 2564 projected.go:196] Error preparing data for projected volume kube-api-access-p6rtt for pod openshift-network-diagnostics/network-check-target-s7mcq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 02:40:38.718896 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:40:38.718887 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f47c576f-2537-4625-be1f-fb82cbb3694e-kube-api-access-p6rtt podName:f47c576f-2537-4625-be1f-fb82cbb3694e nodeName:}" failed. No retries permitted until 2026-09-08 02:40:39.718874657 +0000 UTC m=+4.153848325 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-p6rtt" (UniqueName: "kubernetes.io/projected/f47c576f-2537-4625-be1f-fb82cbb3694e-kube-api-access-p6rtt") pod "network-check-target-s7mcq" (UID: "f47c576f-2537-4625-be1f-fb82cbb3694e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 02:40:39.042338 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:39.042266 2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-07 02:35:38 +0000 UTC" deadline="2028-02-02 08:36:09.257737099 +0000 UTC" Sep 08 02:40:39.042338 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:39.042296 2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12293h55m30.215443768s" Sep 08 02:40:39.061974 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:39.061949 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode093be54_1d5e_4af7_9417_37cfa9965bde.slice/crio-f1e7e4a006a1da59683579c52701d897b7da87f3e2aaa1366fd3ddcae54f4e37 WatchSource:0}: Error finding container f1e7e4a006a1da59683579c52701d897b7da87f3e2aaa1366fd3ddcae54f4e37: Status 404 returned error can't find the container with id f1e7e4a006a1da59683579c52701d897b7da87f3e2aaa1366fd3ddcae54f4e37 Sep 08 02:40:39.082809 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:39.082787 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29ec0f1b_c020_42c6_a505_15aad11faa83.slice/crio-7d33eefb857135d197c2d67fe72f9d9f86cbb8a7af671d6b4c297193ac0e1f7a WatchSource:0}: Error finding container 7d33eefb857135d197c2d67fe72f9d9f86cbb8a7af671d6b4c297193ac0e1f7a: Status 404 returned error can't find the container with id 7d33eefb857135d197c2d67fe72f9d9f86cbb8a7af671d6b4c297193ac0e1f7a Sep 08 02:40:39.083977 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:39.083954 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba1b8aaf_174d_4dbb_b7a2_af66170d03b0.slice/crio-baea2d704bc8b597d5174d721a6e196ec4de6b6a05016253288b3c40d76f5430 WatchSource:0}: Error finding container baea2d704bc8b597d5174d721a6e196ec4de6b6a05016253288b3c40d76f5430: Status 404 returned error can't find the container with id baea2d704bc8b597d5174d721a6e196ec4de6b6a05016253288b3c40d76f5430 Sep 08 02:40:39.084666 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:39.084648 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d2ae2a6_8064_42ae_b0ac_a19fb610c368.slice/crio-f6afc34acda35887aaaa7036a6aba6275d75e9ed31b6128299e4b24a0b806dde WatchSource:0}: Error finding container f6afc34acda35887aaaa7036a6aba6275d75e9ed31b6128299e4b24a0b806dde: Status 404 returned error can't find the container with id f6afc34acda35887aaaa7036a6aba6275d75e9ed31b6128299e4b24a0b806dde Sep 08 02:40:39.087084 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:39.087065 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50d2c5c2_28aa_4ce1_9ad9_50b2493d3129.slice/crio-fedc1014428f7f9cdd7aae6f0db3a17bbb24eb3121b2e847c091181bf1f35cba WatchSource:0}: Error finding container fedc1014428f7f9cdd7aae6f0db3a17bbb24eb3121b2e847c091181bf1f35cba: Status 404 returned error can't find the container with id fedc1014428f7f9cdd7aae6f0db3a17bbb24eb3121b2e847c091181bf1f35cba Sep 08 02:40:39.092578 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:39.092555 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod846f41ef_3791_446b_b3e8_e05c195b7085.slice/crio-b8b7c4c5884e35dee0a3cb136915eeb574566a000dfec1204060efa21ac3aabd WatchSource:0}: Error finding container b8b7c4c5884e35dee0a3cb136915eeb574566a000dfec1204060efa21ac3aabd: Status 404 returned error can't find the container with id b8b7c4c5884e35dee0a3cb136915eeb574566a000dfec1204060efa21ac3aabd Sep 08 02:40:39.093900 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:39.093876 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53b75799_2383_445c_9d14_57322844c559.slice/crio-c3ae5ff6139ad05a23e6ddcb0075205ad175613163240d580d803feac098d43b WatchSource:0}: Error finding container c3ae5ff6139ad05a23e6ddcb0075205ad175613163240d580d803feac098d43b: Status 404 returned error can't find the container with id c3ae5ff6139ad05a23e6ddcb0075205ad175613163240d580d803feac098d43b Sep 08 02:40:39.094939 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:39.094825 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75f73d39_6aff_4777_a417_4d6ac2f786ff.slice/crio-6bb7299dc39c3f13db0a06d2f9cfe30e0abcea3d970bb73551c622863da9f3ec WatchSource:0}: Error finding container 6bb7299dc39c3f13db0a06d2f9cfe30e0abcea3d970bb73551c622863da9f3ec: Status 404 returned error can't find the container with id 6bb7299dc39c3f13db0a06d2f9cfe30e0abcea3d970bb73551c622863da9f3ec Sep 08 02:40:39.096834 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:40:39.096666 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22f90f96_0ae6_459f_bd10_15f4c72e0935.slice/crio-35530e9b2ef251e8d57927ca956154c3a81b375082c3ef7d733e67d8e2fafadd WatchSource:0}: Error finding container 35530e9b2ef251e8d57927ca956154c3a81b375082c3ef7d733e67d8e2fafadd: Status 404 returned error can't find the container with id 35530e9b2ef251e8d57927ca956154c3a81b375082c3ef7d733e67d8e2fafadd Sep 08 02:40:39.100966 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:39.100860 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ckt96" Sep 08 02:40:39.100966 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:39.100860 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s6jbs" Sep 08 02:40:39.101080 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:40:39.100990 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ckt96" podUID="e0a56211-24ee-40c8-be53-d5e518a5342b" Sep 08 02:40:39.101138 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:40:39.101069 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s6jbs" podUID="ce406489-045e-4ba5-baa6-337a983d5466" Sep 08 02:40:39.109554 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:39.109519 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-j8s84" event={"ID":"75f73d39-6aff-4777-a417-4d6ac2f786ff","Type":"ContainerStarted","Data":"6bb7299dc39c3f13db0a06d2f9cfe30e0abcea3d970bb73551c622863da9f3ec"} Sep 08 02:40:39.110900 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:39.110876 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-qj94z" event={"ID":"3d2ae2a6-8064-42ae-b0ac-a19fb610c368","Type":"ContainerStarted","Data":"f6afc34acda35887aaaa7036a6aba6275d75e9ed31b6128299e4b24a0b806dde"} Sep 08 02:40:39.112113 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:39.112087 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8fvvh" event={"ID":"e093be54-1d5e-4af7-9417-37cfa9965bde","Type":"ContainerStarted","Data":"f1e7e4a006a1da59683579c52701d897b7da87f3e2aaa1366fd3ddcae54f4e37"} Sep 08 02:40:39.113465 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:39.113437 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-srkh5" event={"ID":"53b75799-2383-445c-9d14-57322844c559","Type":"ContainerStarted","Data":"c3ae5ff6139ad05a23e6ddcb0075205ad175613163240d580d803feac098d43b"} Sep 08 02:40:39.114816 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:39.114799 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8tddq" event={"ID":"846f41ef-3791-446b-b3e8-e05c195b7085","Type":"ContainerStarted","Data":"b8b7c4c5884e35dee0a3cb136915eeb574566a000dfec1204060efa21ac3aabd"} Sep 08 02:40:39.115835 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:39.115818 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-2667g" event={"ID":"50d2c5c2-28aa-4ce1-9ad9-50b2493d3129","Type":"ContainerStarted","Data":"fedc1014428f7f9cdd7aae6f0db3a17bbb24eb3121b2e847c091181bf1f35cba"} Sep 08 02:40:39.116852 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:39.116825 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-njl2b" event={"ID":"ba1b8aaf-174d-4dbb-b7a2-af66170d03b0","Type":"ContainerStarted","Data":"baea2d704bc8b597d5174d721a6e196ec4de6b6a05016253288b3c40d76f5430"} Sep 08 02:40:39.117953 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:39.117923 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-cncrx" event={"ID":"29ec0f1b-c020-42c6-a505-15aad11faa83","Type":"ContainerStarted","Data":"7d33eefb857135d197c2d67fe72f9d9f86cbb8a7af671d6b4c297193ac0e1f7a"} Sep 08 02:40:39.119022 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:39.118998 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9w5n9" event={"ID":"22f90f96-0ae6-459f-bd10-15f4c72e0935","Type":"ContainerStarted","Data":"35530e9b2ef251e8d57927ca956154c3a81b375082c3ef7d733e67d8e2fafadd"} Sep 08 02:40:39.626263 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:39.626175 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ce406489-045e-4ba5-baa6-337a983d5466-original-pull-secret\") pod \"global-pull-secret-syncer-s6jbs\" (UID: \"ce406489-045e-4ba5-baa6-337a983d5466\") " pod="kube-system/global-pull-secret-syncer-s6jbs" Sep 08 02:40:39.626447 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:40:39.626318 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 08 02:40:39.626447 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:40:39.626395 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce406489-045e-4ba5-baa6-337a983d5466-original-pull-secret podName:ce406489-045e-4ba5-baa6-337a983d5466 nodeName:}" failed. No retries permitted until 2026-09-08 02:40:41.626377521 +0000 UTC m=+6.061351214 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ce406489-045e-4ba5-baa6-337a983d5466-original-pull-secret") pod "global-pull-secret-syncer-s6jbs" (UID: "ce406489-045e-4ba5-baa6-337a983d5466") : object "kube-system"/"original-pull-secret" not registered Sep 08 02:40:39.726877 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:39.726836 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e0a56211-24ee-40c8-be53-d5e518a5342b-metrics-certs\") pod \"network-metrics-daemon-ckt96\" (UID: \"e0a56211-24ee-40c8-be53-d5e518a5342b\") " pod="openshift-multus/network-metrics-daemon-ckt96" Sep 08 02:40:39.727097 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:39.726906 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6rtt\" (UniqueName: \"kubernetes.io/projected/f47c576f-2537-4625-be1f-fb82cbb3694e-kube-api-access-p6rtt\") pod \"network-check-target-s7mcq\" (UID: \"f47c576f-2537-4625-be1f-fb82cbb3694e\") " pod="openshift-network-diagnostics/network-check-target-s7mcq" Sep 08 02:40:39.727097 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:40:39.727060 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 08 02:40:39.727097 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:40:39.727084 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 08 02:40:39.727256 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:40:39.727105 2564 projected.go:196] Error preparing data for projected volume kube-api-access-p6rtt for pod openshift-network-diagnostics/network-check-target-s7mcq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 02:40:39.727256 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:40:39.727167 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f47c576f-2537-4625-be1f-fb82cbb3694e-kube-api-access-p6rtt podName:f47c576f-2537-4625-be1f-fb82cbb3694e nodeName:}" failed. No retries permitted until 2026-09-08 02:40:41.727148785 +0000 UTC m=+6.162122459 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-p6rtt" (UniqueName: "kubernetes.io/projected/f47c576f-2537-4625-be1f-fb82cbb3694e-kube-api-access-p6rtt") pod "network-check-target-s7mcq" (UID: "f47c576f-2537-4625-be1f-fb82cbb3694e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 02:40:39.727584 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:40:39.727566 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 02:40:39.727675 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:40:39.727619 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0a56211-24ee-40c8-be53-d5e518a5342b-metrics-certs podName:e0a56211-24ee-40c8-be53-d5e518a5342b nodeName:}" failed. No retries permitted until 2026-09-08 02:40:41.727604809 +0000 UTC m=+6.162578483 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e0a56211-24ee-40c8-be53-d5e518a5342b-metrics-certs") pod "network-metrics-daemon-ckt96" (UID: "e0a56211-24ee-40c8-be53-d5e518a5342b") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 02:40:40.043091 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:40.043023 2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-07 02:35:38 +0000 UTC" deadline="2028-02-12 10:57:57.801573707 +0000 UTC" Sep 08 02:40:40.043091 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:40.043087 2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12536h17m17.75849022s" Sep 08 02:40:40.103875 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:40.103336 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s7mcq" Sep 08 02:40:40.103875 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:40:40.103476 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s7mcq" podUID="f47c576f-2537-4625-be1f-fb82cbb3694e" Sep 08 02:40:40.143629 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:40.143587 2564 generic.go:356] "Generic (PLEG): container finished" podID="aa6fe60e9885cbd28d9981be20d797a8" containerID="c15aa33d571cd95d43ee93601e7bbdff8a83ea4e1e8d0ba2cf8f3d16b88cfcc3" exitCode=0 Sep 08 02:40:40.143788 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:40.143681 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-161.ec2.internal" event={"ID":"aa6fe60e9885cbd28d9981be20d797a8","Type":"ContainerDied","Data":"c15aa33d571cd95d43ee93601e7bbdff8a83ea4e1e8d0ba2cf8f3d16b88cfcc3"} Sep 08 02:40:40.168057 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:40.167991 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-161.ec2.internal" event={"ID":"7548266a78d2e5528caa994a0756154a","Type":"ContainerStarted","Data":"ea17ff9b6797af97aa0583069af374e693797a3529af347488b78a9124d0f0b1"} Sep 08 02:40:40.181923 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:40.181874 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-161.ec2.internal" podStartSLOduration=3.181854462 podStartE2EDuration="3.181854462s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 02:40:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 02:40:40.181786181 +0000 UTC m=+4.616759873" watchObservedRunningTime="2026-09-08 02:40:40.181854462 +0000 UTC m=+4.616828154" Sep 08 02:40:41.101331 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:41.100659 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s6jbs" Sep 08 02:40:41.101331 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:40:41.100797 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s6jbs" podUID="ce406489-045e-4ba5-baa6-337a983d5466" Sep 08 02:40:41.101331 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:41.101178 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ckt96" Sep 08 02:40:41.101331 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:40:41.101276 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ckt96" podUID="e0a56211-24ee-40c8-be53-d5e518a5342b" Sep 08 02:40:41.179187 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:41.179106 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-161.ec2.internal" event={"ID":"aa6fe60e9885cbd28d9981be20d797a8","Type":"ContainerStarted","Data":"ba1cd924ba7ccc045bc17d8b278c385b477cd9d707c3ceb37bd4462e6e9151a6"} Sep 08 02:40:41.193900 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:41.193639 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-161.ec2.internal" podStartSLOduration=4.193616712 podStartE2EDuration="4.193616712s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 02:40:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 02:40:41.193575925 +0000 UTC m=+5.628549616" watchObservedRunningTime="2026-09-08 02:40:41.193616712 +0000 UTC m=+5.628590405" Sep 08 02:40:41.644768 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:41.644439 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ce406489-045e-4ba5-baa6-337a983d5466-original-pull-secret\") pod \"global-pull-secret-syncer-s6jbs\" (UID: \"ce406489-045e-4ba5-baa6-337a983d5466\") " pod="kube-system/global-pull-secret-syncer-s6jbs" Sep 08 02:40:41.644768 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:40:41.644621 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 08 02:40:41.645025 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:40:41.644811 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce406489-045e-4ba5-baa6-337a983d5466-original-pull-secret podName:ce406489-045e-4ba5-baa6-337a983d5466 nodeName:}" failed. No retries permitted until 2026-09-08 02:40:45.644780008 +0000 UTC m=+10.079753681 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ce406489-045e-4ba5-baa6-337a983d5466-original-pull-secret") pod "global-pull-secret-syncer-s6jbs" (UID: "ce406489-045e-4ba5-baa6-337a983d5466") : object "kube-system"/"original-pull-secret" not registered Sep 08 02:40:41.746920 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:41.746004 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6rtt\" (UniqueName: \"kubernetes.io/projected/f47c576f-2537-4625-be1f-fb82cbb3694e-kube-api-access-p6rtt\") pod \"network-check-target-s7mcq\" (UID: \"f47c576f-2537-4625-be1f-fb82cbb3694e\") " pod="openshift-network-diagnostics/network-check-target-s7mcq" Sep 08 02:40:41.746920 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:41.746095 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e0a56211-24ee-40c8-be53-d5e518a5342b-metrics-certs\") pod \"network-metrics-daemon-ckt96\" (UID: \"e0a56211-24ee-40c8-be53-d5e518a5342b\") " pod="openshift-multus/network-metrics-daemon-ckt96" Sep 08 02:40:41.746920 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:40:41.746235 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 02:40:41.746920 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:40:41.746302 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0a56211-24ee-40c8-be53-d5e518a5342b-metrics-certs podName:e0a56211-24ee-40c8-be53-d5e518a5342b nodeName:}" failed. No retries permitted until 2026-09-08 02:40:45.74628249 +0000 UTC m=+10.181256181 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e0a56211-24ee-40c8-be53-d5e518a5342b-metrics-certs") pod "network-metrics-daemon-ckt96" (UID: "e0a56211-24ee-40c8-be53-d5e518a5342b") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 02:40:41.746920 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:40:41.746758 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 08 02:40:41.746920 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:40:41.746778 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 08 02:40:41.746920 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:40:41.746792 2564 projected.go:196] Error preparing data for projected volume kube-api-access-p6rtt for pod openshift-network-diagnostics/network-check-target-s7mcq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 02:40:41.746920 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:40:41.746841 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f47c576f-2537-4625-be1f-fb82cbb3694e-kube-api-access-p6rtt podName:f47c576f-2537-4625-be1f-fb82cbb3694e nodeName:}" failed. No retries permitted until 2026-09-08 02:40:45.746825723 +0000 UTC m=+10.181799406 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-p6rtt" (UniqueName: "kubernetes.io/projected/f47c576f-2537-4625-be1f-fb82cbb3694e-kube-api-access-p6rtt") pod "network-check-target-s7mcq" (UID: "f47c576f-2537-4625-be1f-fb82cbb3694e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 02:40:42.101313 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:42.101281 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s7mcq" Sep 08 02:40:42.101517 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:40:42.101432 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s7mcq" podUID="f47c576f-2537-4625-be1f-fb82cbb3694e" Sep 08 02:40:43.101634 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:43.101592 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ckt96" Sep 08 02:40:43.102099 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:40:43.101748 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ckt96" podUID="e0a56211-24ee-40c8-be53-d5e518a5342b" Sep 08 02:40:43.102099 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:43.101832 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s6jbs" Sep 08 02:40:43.102099 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:40:43.101961 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s6jbs" podUID="ce406489-045e-4ba5-baa6-337a983d5466" Sep 08 02:40:44.100835 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:44.100793 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s7mcq" Sep 08 02:40:44.101035 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:40:44.100932 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s7mcq" podUID="f47c576f-2537-4625-be1f-fb82cbb3694e" Sep 08 02:40:45.101741 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:45.101306 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s6jbs" Sep 08 02:40:45.101741 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:40:45.101440 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s6jbs" podUID="ce406489-045e-4ba5-baa6-337a983d5466" Sep 08 02:40:45.101741 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:45.101575 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ckt96" Sep 08 02:40:45.101741 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:40:45.101694 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ckt96" podUID="e0a56211-24ee-40c8-be53-d5e518a5342b" Sep 08 02:40:45.679873 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:45.679829 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ce406489-045e-4ba5-baa6-337a983d5466-original-pull-secret\") pod \"global-pull-secret-syncer-s6jbs\" (UID: \"ce406489-045e-4ba5-baa6-337a983d5466\") " pod="kube-system/global-pull-secret-syncer-s6jbs" Sep 08 02:40:45.680048 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:40:45.679979 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 08 02:40:45.680048 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:40:45.680041 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce406489-045e-4ba5-baa6-337a983d5466-original-pull-secret podName:ce406489-045e-4ba5-baa6-337a983d5466 nodeName:}" failed. No retries permitted until 2026-09-08 02:40:53.680022307 +0000 UTC m=+18.114995978 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ce406489-045e-4ba5-baa6-337a983d5466-original-pull-secret") pod "global-pull-secret-syncer-s6jbs" (UID: "ce406489-045e-4ba5-baa6-337a983d5466") : object "kube-system"/"original-pull-secret" not registered Sep 08 02:40:45.780636 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:45.780293 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e0a56211-24ee-40c8-be53-d5e518a5342b-metrics-certs\") pod \"network-metrics-daemon-ckt96\" (UID: \"e0a56211-24ee-40c8-be53-d5e518a5342b\") " pod="openshift-multus/network-metrics-daemon-ckt96" Sep 08 02:40:45.780636 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:45.780380 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6rtt\" (UniqueName: \"kubernetes.io/projected/f47c576f-2537-4625-be1f-fb82cbb3694e-kube-api-access-p6rtt\") pod \"network-check-target-s7mcq\" (UID: \"f47c576f-2537-4625-be1f-fb82cbb3694e\") " pod="openshift-network-diagnostics/network-check-target-s7mcq" Sep 08 02:40:45.780636 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:40:45.780535 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 02:40:45.780636 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:40:45.780549 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 08 02:40:45.780636 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:40:45.780566 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 08 02:40:45.780636 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:40:45.780581 2564 projected.go:196] Error preparing data for projected volume kube-api-access-p6rtt for pod openshift-network-diagnostics/network-check-target-s7mcq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 02:40:45.780636 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:40:45.780621 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0a56211-24ee-40c8-be53-d5e518a5342b-metrics-certs podName:e0a56211-24ee-40c8-be53-d5e518a5342b nodeName:}" failed. No retries permitted until 2026-09-08 02:40:53.78060231 +0000 UTC m=+18.215575980 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e0a56211-24ee-40c8-be53-d5e518a5342b-metrics-certs") pod "network-metrics-daemon-ckt96" (UID: "e0a56211-24ee-40c8-be53-d5e518a5342b") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 02:40:45.780636 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:40:45.780639 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f47c576f-2537-4625-be1f-fb82cbb3694e-kube-api-access-p6rtt podName:f47c576f-2537-4625-be1f-fb82cbb3694e nodeName:}" failed. No retries permitted until 2026-09-08 02:40:53.780631664 +0000 UTC m=+18.215605333 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-p6rtt" (UniqueName: "kubernetes.io/projected/f47c576f-2537-4625-be1f-fb82cbb3694e-kube-api-access-p6rtt") pod "network-check-target-s7mcq" (UID: "f47c576f-2537-4625-be1f-fb82cbb3694e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 02:40:46.104800 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:46.104771 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s7mcq" Sep 08 02:40:46.105233 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:40:46.104885 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s7mcq" podUID="f47c576f-2537-4625-be1f-fb82cbb3694e" Sep 08 02:40:47.101235 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:47.101196 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ckt96" Sep 08 02:40:47.101235 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:47.101224 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s6jbs" Sep 08 02:40:47.101472 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:40:47.101379 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ckt96" podUID="e0a56211-24ee-40c8-be53-d5e518a5342b" Sep 08 02:40:47.101532 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:40:47.101489 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s6jbs" podUID="ce406489-045e-4ba5-baa6-337a983d5466" Sep 08 02:40:48.101011 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:48.100977 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s7mcq" Sep 08 02:40:48.101425 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:40:48.101112 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s7mcq" podUID="f47c576f-2537-4625-be1f-fb82cbb3694e" Sep 08 02:40:49.100931 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:49.100895 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s6jbs" Sep 08 02:40:49.101116 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:40:49.101016 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s6jbs" podUID="ce406489-045e-4ba5-baa6-337a983d5466" Sep 08 02:40:49.101116 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:49.101074 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ckt96" Sep 08 02:40:49.101543 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:40:49.101203 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ckt96" podUID="e0a56211-24ee-40c8-be53-d5e518a5342b" Sep 08 02:40:50.104931 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:50.104903 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s7mcq" Sep 08 02:40:50.105324 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:40:50.105011 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s7mcq" podUID="f47c576f-2537-4625-be1f-fb82cbb3694e" Sep 08 02:40:51.101282 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:51.101247 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s6jbs" Sep 08 02:40:51.101494 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:51.101293 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ckt96" Sep 08 02:40:51.101494 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:40:51.101394 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s6jbs" podUID="ce406489-045e-4ba5-baa6-337a983d5466" Sep 08 02:40:51.101596 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:40:51.101528 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ckt96" podUID="e0a56211-24ee-40c8-be53-d5e518a5342b" Sep 08 02:40:52.101450 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:52.101411 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s7mcq" Sep 08 02:40:52.101857 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:40:52.101555 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s7mcq" podUID="f47c576f-2537-4625-be1f-fb82cbb3694e" Sep 08 02:40:53.101174 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:53.101127 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ckt96" Sep 08 02:40:53.101468 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:40:53.101267 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ckt96" podUID="e0a56211-24ee-40c8-be53-d5e518a5342b" Sep 08 02:40:53.101468 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:53.101331 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s6jbs" Sep 08 02:40:53.101856 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:40:53.101464 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s6jbs" podUID="ce406489-045e-4ba5-baa6-337a983d5466" Sep 08 02:40:53.739193 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:53.739158 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ce406489-045e-4ba5-baa6-337a983d5466-original-pull-secret\") pod \"global-pull-secret-syncer-s6jbs\" (UID: \"ce406489-045e-4ba5-baa6-337a983d5466\") " pod="kube-system/global-pull-secret-syncer-s6jbs" Sep 08 02:40:53.739390 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:40:53.739287 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 08 02:40:53.739390 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:40:53.739345 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce406489-045e-4ba5-baa6-337a983d5466-original-pull-secret podName:ce406489-045e-4ba5-baa6-337a983d5466 nodeName:}" failed. No retries permitted until 2026-09-08 02:41:09.739326 +0000 UTC m=+34.174299670 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ce406489-045e-4ba5-baa6-337a983d5466-original-pull-secret") pod "global-pull-secret-syncer-s6jbs" (UID: "ce406489-045e-4ba5-baa6-337a983d5466") : object "kube-system"/"original-pull-secret" not registered Sep 08 02:40:53.840211 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:53.840179 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e0a56211-24ee-40c8-be53-d5e518a5342b-metrics-certs\") pod \"network-metrics-daemon-ckt96\" (UID: \"e0a56211-24ee-40c8-be53-d5e518a5342b\") " pod="openshift-multus/network-metrics-daemon-ckt96" Sep 08 02:40:53.840435 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:53.840231 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6rtt\" (UniqueName: \"kubernetes.io/projected/f47c576f-2537-4625-be1f-fb82cbb3694e-kube-api-access-p6rtt\") pod \"network-check-target-s7mcq\" (UID: \"f47c576f-2537-4625-be1f-fb82cbb3694e\") " pod="openshift-network-diagnostics/network-check-target-s7mcq" Sep 08 02:40:53.840435 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:40:53.840344 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 02:40:53.840435 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:40:53.840431 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0a56211-24ee-40c8-be53-d5e518a5342b-metrics-certs podName:e0a56211-24ee-40c8-be53-d5e518a5342b nodeName:}" failed. No retries permitted until 2026-09-08 02:41:09.840411085 +0000 UTC m=+34.275384766 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e0a56211-24ee-40c8-be53-d5e518a5342b-metrics-certs") pod "network-metrics-daemon-ckt96" (UID: "e0a56211-24ee-40c8-be53-d5e518a5342b") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 02:40:53.840605 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:40:53.840451 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 08 02:40:53.840605 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:40:53.840468 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 08 02:40:53.840605 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:40:53.840480 2564 projected.go:196] Error preparing data for projected volume kube-api-access-p6rtt for pod openshift-network-diagnostics/network-check-target-s7mcq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 02:40:53.840605 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:40:53.840529 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f47c576f-2537-4625-be1f-fb82cbb3694e-kube-api-access-p6rtt podName:f47c576f-2537-4625-be1f-fb82cbb3694e nodeName:}" failed. No retries permitted until 2026-09-08 02:41:09.840514421 +0000 UTC m=+34.275488089 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-p6rtt" (UniqueName: "kubernetes.io/projected/f47c576f-2537-4625-be1f-fb82cbb3694e-kube-api-access-p6rtt") pod "network-check-target-s7mcq" (UID: "f47c576f-2537-4625-be1f-fb82cbb3694e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 02:40:54.101734 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:54.101652 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s7mcq" Sep 08 02:40:54.102182 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:40:54.101781 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s7mcq" podUID="f47c576f-2537-4625-be1f-fb82cbb3694e" Sep 08 02:40:55.101424 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:55.101386 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ckt96" Sep 08 02:40:55.101611 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:55.101385 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s6jbs" Sep 08 02:40:55.101611 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:40:55.101535 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ckt96" podUID="e0a56211-24ee-40c8-be53-d5e518a5342b" Sep 08 02:40:55.101611 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:40:55.101573 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s6jbs" podUID="ce406489-045e-4ba5-baa6-337a983d5466" Sep 08 02:40:56.101503 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:56.101464 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s7mcq" Sep 08 02:40:56.101960 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:40:56.101571 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s7mcq" podUID="f47c576f-2537-4625-be1f-fb82cbb3694e" Sep 08 02:40:57.100886 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:57.100742 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ckt96" Sep 08 02:40:57.100994 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:57.100768 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s6jbs" Sep 08 02:40:57.100994 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:40:57.100974 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ckt96" podUID="e0a56211-24ee-40c8-be53-d5e518a5342b" Sep 08 02:40:57.101124 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:40:57.101017 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s6jbs" podUID="ce406489-045e-4ba5-baa6-337a983d5466" Sep 08 02:40:57.215544 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:57.215514 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-srkh5" event={"ID":"53b75799-2383-445c-9d14-57322844c559","Type":"ContainerStarted","Data":"edf25978e66e31d3413fbc51d508c9a44b8dea7ed69e9c2de630f97f7e384c96"} Sep 08 02:40:57.216375 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:57.215608 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-srkh5" event={"ID":"53b75799-2383-445c-9d14-57322844c559","Type":"ContainerStarted","Data":"c197c0f38460032276e8c9a83af332a95a4eee7d6a91993e4054b7a149127564"} Sep 08 02:40:57.216375 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:57.215660 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-srkh5" event={"ID":"53b75799-2383-445c-9d14-57322844c559","Type":"ContainerStarted","Data":"958ff8204d7f3cebf4b66e17bcdf054c525da03341dad2feea054b1810f0423c"} Sep 08 02:40:57.217239 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:57.217215 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8tddq" event={"ID":"846f41ef-3791-446b-b3e8-e05c195b7085","Type":"ContainerStarted","Data":"542a286f9d0dc1df2e69c08b089e1e425f71c6a7b3d76218b00b83dbd37700ed"} Sep 08 02:40:57.219077 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:57.219049 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-2667g" event={"ID":"50d2c5c2-28aa-4ce1-9ad9-50b2493d3129","Type":"ContainerStarted","Data":"67751d2e2fbe77f85a8aeaf146d49ea828213aa154021494c9939b921a3f4ff7"} Sep 08 02:40:57.221123 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:57.221100 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-njl2b" event={"ID":"ba1b8aaf-174d-4dbb-b7a2-af66170d03b0","Type":"ContainerStarted","Data":"9e70e261061c2fb41ae12746501a7e31074ad2bd1cb26ba3a99b01c14dbc65c4"} Sep 08 02:40:57.222708 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:57.222686 2564 generic.go:356] "Generic (PLEG): container finished" podID="22f90f96-0ae6-459f-bd10-15f4c72e0935" containerID="a1e8c768837632648cdbd4c0ae4dd45d727a28749b9bb482afd20fc11a174b7c" exitCode=0 Sep 08 02:40:57.222794 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:57.222755 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9w5n9" event={"ID":"22f90f96-0ae6-459f-bd10-15f4c72e0935","Type":"ContainerDied","Data":"a1e8c768837632648cdbd4c0ae4dd45d727a28749b9bb482afd20fc11a174b7c"} Sep 08 02:40:57.225660 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:57.225626 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-j8s84" event={"ID":"75f73d39-6aff-4777-a417-4d6ac2f786ff","Type":"ContainerStarted","Data":"c72666b8acb7fde3baac3f98f375c492ab5dc8147e79ec94addf4ff0ac020134"} Sep 08 02:40:57.227275 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:57.227258 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-qj94z" event={"ID":"3d2ae2a6-8064-42ae-b0ac-a19fb610c368","Type":"ContainerStarted","Data":"1996248f3875a53a6c851c7e4d621b1d82961f7cb590750026584e465d26d55b"} Sep 08 02:40:57.228879 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:57.228861 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8fvvh" event={"ID":"e093be54-1d5e-4af7-9417-37cfa9965bde","Type":"ContainerStarted","Data":"58838cc0a45f4ce4b9192124a528b30d9261d7c8b4276190e62fda408084e7e2"} Sep 08 02:40:57.233457 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:57.233421 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-8tddq" podStartSLOduration=3.560183173 podStartE2EDuration="21.233409332s" totalImagesPullingTime="17.673226159s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 02:40:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 02:40:57.232984524 +0000 UTC m=+21.667958216" watchObservedRunningTime="2026-09-08 02:40:57.233409332 +0000 UTC m=+21.668383022" Sep 08 02:40:57.296558 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:57.296510 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-njl2b" podStartSLOduration=3.616478018 podStartE2EDuration="21.296495278s" totalImagesPullingTime="17.68001726s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 02:40:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 02:40:57.279543048 +0000 UTC m=+21.714516738" watchObservedRunningTime="2026-09-08 02:40:57.296495278 +0000 UTC m=+21.731468968" Sep 08 02:40:57.311952 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:57.311912 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-j8s84" podStartSLOduration=11.126935559 podStartE2EDuration="21.311895957s" totalImagesPullingTime="10.184960398s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 02:40:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 02:40:57.311714415 +0000 UTC m=+21.746688104" watchObservedRunningTime="2026-09-08 02:40:57.311895957 +0000 UTC m=+21.746869646" Sep 08 02:40:57.312243 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:57.312213 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-qj94z" podStartSLOduration=3.495115867 podStartE2EDuration="21.312201571s" totalImagesPullingTime="17.817085704s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 02:40:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 02:40:57.29680314 +0000 UTC m=+21.731776830" watchObservedRunningTime="2026-09-08 02:40:57.312201571 +0000 UTC m=+21.747175260" Sep 08 02:40:57.327924 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:57.327886 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-2667g" podStartSLOduration=3.653374368 podStartE2EDuration="21.32787226s" totalImagesPullingTime="17.674497892s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 02:40:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 02:40:57.327845303 +0000 UTC m=+21.762818993" watchObservedRunningTime="2026-09-08 02:40:57.32787226 +0000 UTC m=+21.762845950" Sep 08 02:40:58.101634 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:58.101556 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s7mcq" Sep 08 02:40:58.101824 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:40:58.101667 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s7mcq" podUID="f47c576f-2537-4625-be1f-fb82cbb3694e" Sep 08 02:40:58.235532 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:58.235482 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-srkh5" event={"ID":"53b75799-2383-445c-9d14-57322844c559","Type":"ContainerStarted","Data":"78f4cdfdce0b0e453523f75322aacc0377183b5ddb47d7e432ec14331327437c"} Sep 08 02:40:58.236000 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:58.235575 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-srkh5" event={"ID":"53b75799-2383-445c-9d14-57322844c559","Type":"ContainerStarted","Data":"02b8a5c628943c06af4460359e6bfe25befa1bb986a7c0aa0674e266e3c12784"} Sep 08 02:40:58.236000 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:58.235619 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-srkh5" event={"ID":"53b75799-2383-445c-9d14-57322844c559","Type":"ContainerStarted","Data":"f94ec745f7534a86105d52e6f02478816b423dc9e9975ce8ffa89fc4007f70d4"} Sep 08 02:40:58.387105 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:58.386967 2564 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 08 02:40:59.069966 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:59.069855 2564 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-08T02:40:58.387099294Z","UUID":"eb24cc0f-2761-443c-b24c-9d3919692f81","Handler":null,"Name":"","Endpoint":""} Sep 08 02:40:59.072201 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:59.072174 2564 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 08 02:40:59.072324 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:59.072213 2564 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 08 02:40:59.101603 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:59.101571 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ckt96" Sep 08 02:40:59.101781 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:59.101577 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s6jbs" Sep 08 02:40:59.101781 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:40:59.101705 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ckt96" podUID="e0a56211-24ee-40c8-be53-d5e518a5342b" Sep 08 02:40:59.101904 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:40:59.101777 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s6jbs" podUID="ce406489-045e-4ba5-baa6-337a983d5466" Sep 08 02:40:59.239626 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:59.239589 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-cncrx" event={"ID":"29ec0f1b-c020-42c6-a505-15aad11faa83","Type":"ContainerStarted","Data":"cf1e2f4683b92f6d74bba0e2386256af6cf1bd5cc62b2e06380bafd93ea0ed14"} Sep 08 02:40:59.241991 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:59.241959 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8fvvh" event={"ID":"e093be54-1d5e-4af7-9417-37cfa9965bde","Type":"ContainerStarted","Data":"04c012462475f9a2043b191ecd0933d0368cf2b5c6119e0560ed2375b502b8f6"} Sep 08 02:40:59.254781 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:59.254723 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-cncrx" podStartSLOduration=5.574672201 podStartE2EDuration="23.254703332s" totalImagesPullingTime="17.680031131s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 02:40:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 02:40:59.253986747 +0000 UTC m=+23.688960438" watchObservedRunningTime="2026-09-08 02:40:59.254703332 +0000 UTC m=+23.689677026" Sep 08 02:40:59.910228 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:40:59.910146 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-j8s84" Sep 08 02:41:00.101182 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:00.101152 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s7mcq" Sep 08 02:41:00.101385 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:41:00.101265 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s7mcq" podUID="f47c576f-2537-4625-be1f-fb82cbb3694e" Sep 08 02:41:00.246307 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:00.246266 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8fvvh" event={"ID":"e093be54-1d5e-4af7-9417-37cfa9965bde","Type":"ContainerStarted","Data":"02f90866b30ccc1821cd11c4bb6d69eacbdedd4bec11a96946356938a9cfa77e"} Sep 08 02:41:00.249509 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:00.249481 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-srkh5" event={"ID":"53b75799-2383-445c-9d14-57322844c559","Type":"ContainerStarted","Data":"11f9897f69779c55ede1af83248fd0afba1d611040b6b575f5cf329dff28e81a"} Sep 08 02:41:00.263467 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:00.263418 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8fvvh" podStartSLOduration=4.217081224 podStartE2EDuration="24.263402332s" totalImagesPullingTime="20.046321108s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 02:40:36 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 02:41:00.263304758 +0000 UTC m=+24.698278448" watchObservedRunningTime="2026-09-08 02:41:00.263402332 +0000 UTC m=+24.698376023" Sep 08 02:41:01.101156 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:01.101120 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ckt96" Sep 08 02:41:01.101393 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:01.101170 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s6jbs" Sep 08 02:41:01.101393 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:41:01.101253 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ckt96" podUID="e0a56211-24ee-40c8-be53-d5e518a5342b" Sep 08 02:41:01.101516 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:41:01.101404 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s6jbs" podUID="ce406489-045e-4ba5-baa6-337a983d5466" Sep 08 02:41:02.071324 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:02.071249 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-j8s84" Sep 08 02:41:02.071998 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:02.071777 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-j8s84" Sep 08 02:41:02.104768 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:02.104673 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s7mcq" Sep 08 02:41:02.104815 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:41:02.104773 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s7mcq" podUID="f47c576f-2537-4625-be1f-fb82cbb3694e" Sep 08 02:41:02.258091 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:02.258054 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-srkh5" event={"ID":"53b75799-2383-445c-9d14-57322844c559","Type":"ContainerStarted","Data":"595aaac9286afc39990f2c87ecd03092368c48f1bee2ee5713ef2ac878df6847"} Sep 08 02:41:02.258330 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:02.258285 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-srkh5" Sep 08 02:41:02.258440 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:02.258378 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-srkh5" Sep 08 02:41:02.258440 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:02.258431 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-srkh5" Sep 08 02:41:02.260285 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:02.260259 2564 generic.go:356] "Generic (PLEG): container finished" podID="22f90f96-0ae6-459f-bd10-15f4c72e0935" containerID="6bbeb41eafd21acee307d55ee0fa73cfe761f12eeecbda73f9bc39239e2e6fc2" exitCode=0 Sep 08 02:41:02.260393 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:02.260304 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9w5n9" event={"ID":"22f90f96-0ae6-459f-bd10-15f4c72e0935","Type":"ContainerDied","Data":"6bbeb41eafd21acee307d55ee0fa73cfe761f12eeecbda73f9bc39239e2e6fc2"} Sep 08 02:41:02.261051 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:02.260996 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-j8s84" Sep 08 02:41:02.274258 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:02.274226 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-srkh5" Sep 08 02:41:02.275205 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:02.275190 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-srkh5" Sep 08 02:41:02.284870 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:02.284833 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-srkh5" podStartSLOduration=8.596602387 podStartE2EDuration="26.284819737s" totalImagesPullingTime="17.68821735s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 02:40:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 02:41:02.283414899 +0000 UTC m=+26.718388589" watchObservedRunningTime="2026-09-08 02:41:02.284819737 +0000 UTC m=+26.719793441" Sep 08 02:41:03.101247 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:03.101211 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ckt96" Sep 08 02:41:03.101886 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:03.101224 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s6jbs" Sep 08 02:41:03.101886 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:41:03.101401 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ckt96" podUID="e0a56211-24ee-40c8-be53-d5e518a5342b" Sep 08 02:41:03.101886 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:41:03.101487 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s6jbs" podUID="ce406489-045e-4ba5-baa6-337a983d5466" Sep 08 02:41:03.929646 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:03.929563 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-ckt96"] Sep 08 02:41:03.929833 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:03.929720 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ckt96" Sep 08 02:41:03.929833 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:41:03.929818 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ckt96" podUID="e0a56211-24ee-40c8-be53-d5e518a5342b" Sep 08 02:41:03.934333 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:03.934301 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-s6jbs"] Sep 08 02:41:03.934484 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:03.934448 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s6jbs" Sep 08 02:41:03.934580 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:41:03.934553 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s6jbs" podUID="ce406489-045e-4ba5-baa6-337a983d5466" Sep 08 02:41:03.934938 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:03.934916 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-s7mcq"] Sep 08 02:41:03.935015 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:03.935008 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s7mcq" Sep 08 02:41:03.935088 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:41:03.935073 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s7mcq" podUID="f47c576f-2537-4625-be1f-fb82cbb3694e" Sep 08 02:41:04.269887 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:04.269707 2564 generic.go:356] "Generic (PLEG): container finished" podID="22f90f96-0ae6-459f-bd10-15f4c72e0935" containerID="e9a42aa08e1fc5502a222e99f33ac83451915089838b39c30830d1c663cec59b" exitCode=0 Sep 08 02:41:04.270277 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:04.269790 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9w5n9" event={"ID":"22f90f96-0ae6-459f-bd10-15f4c72e0935","Type":"ContainerDied","Data":"e9a42aa08e1fc5502a222e99f33ac83451915089838b39c30830d1c663cec59b"} Sep 08 02:41:05.101392 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:05.101336 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s6jbs" Sep 08 02:41:05.101556 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:05.101415 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s7mcq" Sep 08 02:41:05.101556 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:41:05.101500 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s6jbs" podUID="ce406489-045e-4ba5-baa6-337a983d5466" Sep 08 02:41:05.101638 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:41:05.101616 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s7mcq" podUID="f47c576f-2537-4625-be1f-fb82cbb3694e" Sep 08 02:41:06.105314 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:06.105285 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ckt96" Sep 08 02:41:06.105794 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:41:06.105416 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ckt96" podUID="e0a56211-24ee-40c8-be53-d5e518a5342b" Sep 08 02:41:06.276928 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:06.276889 2564 generic.go:356] "Generic (PLEG): container finished" podID="22f90f96-0ae6-459f-bd10-15f4c72e0935" containerID="664f51fd2243c4eb02b4d9267e2e15fd1c01a0df95ce85bce5ba488f784f5c1d" exitCode=0 Sep 08 02:41:06.277060 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:06.276965 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9w5n9" event={"ID":"22f90f96-0ae6-459f-bd10-15f4c72e0935","Type":"ContainerDied","Data":"664f51fd2243c4eb02b4d9267e2e15fd1c01a0df95ce85bce5ba488f784f5c1d"} Sep 08 02:41:07.100825 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:07.100791 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s6jbs" Sep 08 02:41:07.101026 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:07.100791 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s7mcq" Sep 08 02:41:07.101026 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:41:07.100911 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s6jbs" podUID="ce406489-045e-4ba5-baa6-337a983d5466" Sep 08 02:41:07.101148 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:41:07.101023 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s7mcq" podUID="f47c576f-2537-4625-be1f-fb82cbb3694e" Sep 08 02:41:08.100931 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:08.100894 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ckt96" Sep 08 02:41:08.101383 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:41:08.101035 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ckt96" podUID="e0a56211-24ee-40c8-be53-d5e518a5342b" Sep 08 02:41:09.100964 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:09.100926 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s6jbs" Sep 08 02:41:09.101501 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:09.100927 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s7mcq" Sep 08 02:41:09.101501 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:41:09.101056 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s6jbs" podUID="ce406489-045e-4ba5-baa6-337a983d5466" Sep 08 02:41:09.101501 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:41:09.101112 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s7mcq" podUID="f47c576f-2537-4625-be1f-fb82cbb3694e" Sep 08 02:41:09.755202 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:09.755158 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ce406489-045e-4ba5-baa6-337a983d5466-original-pull-secret\") pod \"global-pull-secret-syncer-s6jbs\" (UID: \"ce406489-045e-4ba5-baa6-337a983d5466\") " pod="kube-system/global-pull-secret-syncer-s6jbs" Sep 08 02:41:09.755397 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:41:09.755322 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 08 02:41:09.755453 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:41:09.755418 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce406489-045e-4ba5-baa6-337a983d5466-original-pull-secret podName:ce406489-045e-4ba5-baa6-337a983d5466 nodeName:}" failed. No retries permitted until 2026-09-08 02:41:41.755400149 +0000 UTC m=+66.190373817 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ce406489-045e-4ba5-baa6-337a983d5466-original-pull-secret") pod "global-pull-secret-syncer-s6jbs" (UID: "ce406489-045e-4ba5-baa6-337a983d5466") : object "kube-system"/"original-pull-secret" not registered Sep 08 02:41:09.855875 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:09.855837 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6rtt\" (UniqueName: \"kubernetes.io/projected/f47c576f-2537-4625-be1f-fb82cbb3694e-kube-api-access-p6rtt\") pod \"network-check-target-s7mcq\" (UID: \"f47c576f-2537-4625-be1f-fb82cbb3694e\") " pod="openshift-network-diagnostics/network-check-target-s7mcq" Sep 08 02:41:09.856057 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:09.855917 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e0a56211-24ee-40c8-be53-d5e518a5342b-metrics-certs\") pod \"network-metrics-daemon-ckt96\" (UID: \"e0a56211-24ee-40c8-be53-d5e518a5342b\") " pod="openshift-multus/network-metrics-daemon-ckt96" Sep 08 02:41:09.856057 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:41:09.856019 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 08 02:41:09.856057 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:41:09.856035 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 02:41:09.856057 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:41:09.856047 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 08 02:41:09.856261 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:41:09.856065 2564 projected.go:196] Error preparing data for projected volume kube-api-access-p6rtt for pod openshift-network-diagnostics/network-check-target-s7mcq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 02:41:09.856261 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:41:09.856107 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0a56211-24ee-40c8-be53-d5e518a5342b-metrics-certs podName:e0a56211-24ee-40c8-be53-d5e518a5342b nodeName:}" failed. No retries permitted until 2026-09-08 02:41:41.856085776 +0000 UTC m=+66.291059444 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e0a56211-24ee-40c8-be53-d5e518a5342b-metrics-certs") pod "network-metrics-daemon-ckt96" (UID: "e0a56211-24ee-40c8-be53-d5e518a5342b") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 02:41:09.856261 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:41:09.856127 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f47c576f-2537-4625-be1f-fb82cbb3694e-kube-api-access-p6rtt podName:f47c576f-2537-4625-be1f-fb82cbb3694e nodeName:}" failed. No retries permitted until 2026-09-08 02:41:41.856116399 +0000 UTC m=+66.291090072 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-p6rtt" (UniqueName: "kubernetes.io/projected/f47c576f-2537-4625-be1f-fb82cbb3694e-kube-api-access-p6rtt") pod "network-check-target-s7mcq" (UID: "f47c576f-2537-4625-be1f-fb82cbb3694e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 02:41:09.884286 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:09.884251 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-161.ec2.internal" event="NodeReady" Sep 08 02:41:09.884444 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:09.884411 2564 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 08 02:41:09.916938 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:09.916905 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-65c9b7fd44-s9n6g"] Sep 08 02:41:09.921066 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:09.921044 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-65c9b7fd44-s9n6g" Sep 08 02:41:09.923769 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:09.923651 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Sep 08 02:41:09.923894 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:09.923783 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Sep 08 02:41:09.923894 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:09.923836 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Sep 08 02:41:09.923894 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:09.923869 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-nt5df\"" Sep 08 02:41:09.929855 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:09.929647 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Sep 08 02:41:09.929855 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:09.929794 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-h62hl"] Sep 08 02:41:09.934453 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:09.934423 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-zkxnl"] Sep 08 02:41:09.935006 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:09.934984 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-h62hl" Sep 08 02:41:09.937822 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:09.937624 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 08 02:41:09.937822 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:09.937686 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-j9gxl\"" Sep 08 02:41:09.937822 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:09.937628 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 08 02:41:09.939004 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:09.938982 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-65c9b7fd44-s9n6g"] Sep 08 02:41:09.939108 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:09.939085 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-zkxnl" Sep 08 02:41:09.941607 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:09.941586 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 08 02:41:09.941976 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:09.941958 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-cfktk\"" Sep 08 02:41:09.942290 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:09.942198 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 08 02:41:09.942430 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:09.942414 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 08 02:41:09.942495 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:09.942481 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-h62hl"] Sep 08 02:41:09.946746 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:09.945753 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-zkxnl"] Sep 08 02:41:10.057644 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:10.057544 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c3751a7d-8eae-4e66-a492-b676988ca6ec-bound-sa-token\") pod \"image-registry-65c9b7fd44-s9n6g\" (UID: \"c3751a7d-8eae-4e66-a492-b676988ca6ec\") " pod="openshift-image-registry/image-registry-65c9b7fd44-s9n6g" Sep 08 02:41:10.057644 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:10.057590 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c3751a7d-8eae-4e66-a492-b676988ca6ec-ca-trust-extracted\") pod \"image-registry-65c9b7fd44-s9n6g\" (UID: \"c3751a7d-8eae-4e66-a492-b676988ca6ec\") " pod="openshift-image-registry/image-registry-65c9b7fd44-s9n6g" Sep 08 02:41:10.057873 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:10.057672 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x8m4n\" (UniqueName: \"kubernetes.io/projected/c3751a7d-8eae-4e66-a492-b676988ca6ec-kube-api-access-x8m4n\") pod \"image-registry-65c9b7fd44-s9n6g\" (UID: \"c3751a7d-8eae-4e66-a492-b676988ca6ec\") " pod="openshift-image-registry/image-registry-65c9b7fd44-s9n6g" Sep 08 02:41:10.057873 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:10.057756 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c3751a7d-8eae-4e66-a492-b676988ca6ec-registry-certificates\") pod \"image-registry-65c9b7fd44-s9n6g\" (UID: \"c3751a7d-8eae-4e66-a492-b676988ca6ec\") " pod="openshift-image-registry/image-registry-65c9b7fd44-s9n6g" Sep 08 02:41:10.057873 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:10.057790 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mxxhq\" (UniqueName: \"kubernetes.io/projected/829fed37-98de-4e8c-be35-d3e13ea6bc3b-kube-api-access-mxxhq\") pod \"ingress-canary-zkxnl\" (UID: \"829fed37-98de-4e8c-be35-d3e13ea6bc3b\") " pod="openshift-ingress-canary/ingress-canary-zkxnl" Sep 08 02:41:10.057873 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:10.057839 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/635bc747-a5b6-4c49-aa00-fab4bef8f003-metrics-tls\") pod \"dns-default-h62hl\" (UID: \"635bc747-a5b6-4c49-aa00-fab4bef8f003\") " pod="openshift-dns/dns-default-h62hl" Sep 08 02:41:10.057873 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:10.057859 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lnd9f\" (UniqueName: \"kubernetes.io/projected/635bc747-a5b6-4c49-aa00-fab4bef8f003-kube-api-access-lnd9f\") pod \"dns-default-h62hl\" (UID: \"635bc747-a5b6-4c49-aa00-fab4bef8f003\") " pod="openshift-dns/dns-default-h62hl" Sep 08 02:41:10.058121 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:10.057903 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/635bc747-a5b6-4c49-aa00-fab4bef8f003-config-volume\") pod \"dns-default-h62hl\" (UID: \"635bc747-a5b6-4c49-aa00-fab4bef8f003\") " pod="openshift-dns/dns-default-h62hl" Sep 08 02:41:10.058121 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:10.057939 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/829fed37-98de-4e8c-be35-d3e13ea6bc3b-cert\") pod \"ingress-canary-zkxnl\" (UID: \"829fed37-98de-4e8c-be35-d3e13ea6bc3b\") " pod="openshift-ingress-canary/ingress-canary-zkxnl" Sep 08 02:41:10.058121 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:10.057974 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c3751a7d-8eae-4e66-a492-b676988ca6ec-image-registry-private-configuration\") pod \"image-registry-65c9b7fd44-s9n6g\" (UID: \"c3751a7d-8eae-4e66-a492-b676988ca6ec\") " pod="openshift-image-registry/image-registry-65c9b7fd44-s9n6g" Sep 08 02:41:10.058121 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:10.058013 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/635bc747-a5b6-4c49-aa00-fab4bef8f003-tmp-dir\") pod \"dns-default-h62hl\" (UID: \"635bc747-a5b6-4c49-aa00-fab4bef8f003\") " pod="openshift-dns/dns-default-h62hl" Sep 08 02:41:10.058121 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:10.058100 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c3751a7d-8eae-4e66-a492-b676988ca6ec-registry-tls\") pod \"image-registry-65c9b7fd44-s9n6g\" (UID: \"c3751a7d-8eae-4e66-a492-b676988ca6ec\") " pod="openshift-image-registry/image-registry-65c9b7fd44-s9n6g" Sep 08 02:41:10.058315 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:10.058131 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c3751a7d-8eae-4e66-a492-b676988ca6ec-installation-pull-secrets\") pod \"image-registry-65c9b7fd44-s9n6g\" (UID: \"c3751a7d-8eae-4e66-a492-b676988ca6ec\") " pod="openshift-image-registry/image-registry-65c9b7fd44-s9n6g" Sep 08 02:41:10.058315 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:10.058177 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c3751a7d-8eae-4e66-a492-b676988ca6ec-trusted-ca\") pod \"image-registry-65c9b7fd44-s9n6g\" (UID: \"c3751a7d-8eae-4e66-a492-b676988ca6ec\") " pod="openshift-image-registry/image-registry-65c9b7fd44-s9n6g" Sep 08 02:41:10.101064 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:10.101024 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ckt96" Sep 08 02:41:10.104124 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:10.104095 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 08 02:41:10.104278 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:10.104147 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-9xqbz\"" Sep 08 02:41:10.158999 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:10.158960 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c3751a7d-8eae-4e66-a492-b676988ca6ec-registry-tls\") pod \"image-registry-65c9b7fd44-s9n6g\" (UID: \"c3751a7d-8eae-4e66-a492-b676988ca6ec\") " pod="openshift-image-registry/image-registry-65c9b7fd44-s9n6g" Sep 08 02:41:10.158999 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:10.158998 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c3751a7d-8eae-4e66-a492-b676988ca6ec-installation-pull-secrets\") pod \"image-registry-65c9b7fd44-s9n6g\" (UID: \"c3751a7d-8eae-4e66-a492-b676988ca6ec\") " pod="openshift-image-registry/image-registry-65c9b7fd44-s9n6g" Sep 08 02:41:10.159240 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:41:10.159105 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 08 02:41:10.159240 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:41:10.159125 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65c9b7fd44-s9n6g: secret "image-registry-tls" not found Sep 08 02:41:10.159240 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:10.159129 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c3751a7d-8eae-4e66-a492-b676988ca6ec-trusted-ca\") pod \"image-registry-65c9b7fd44-s9n6g\" (UID: \"c3751a7d-8eae-4e66-a492-b676988ca6ec\") " pod="openshift-image-registry/image-registry-65c9b7fd44-s9n6g" Sep 08 02:41:10.159240 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:10.159173 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c3751a7d-8eae-4e66-a492-b676988ca6ec-bound-sa-token\") pod \"image-registry-65c9b7fd44-s9n6g\" (UID: \"c3751a7d-8eae-4e66-a492-b676988ca6ec\") " pod="openshift-image-registry/image-registry-65c9b7fd44-s9n6g" Sep 08 02:41:10.159240 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:41:10.159185 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c3751a7d-8eae-4e66-a492-b676988ca6ec-registry-tls podName:c3751a7d-8eae-4e66-a492-b676988ca6ec nodeName:}" failed. No retries permitted until 2026-09-08 02:41:10.659169388 +0000 UTC m=+35.094143077 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c3751a7d-8eae-4e66-a492-b676988ca6ec-registry-tls") pod "image-registry-65c9b7fd44-s9n6g" (UID: "c3751a7d-8eae-4e66-a492-b676988ca6ec") : secret "image-registry-tls" not found Sep 08 02:41:10.159528 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:10.159243 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c3751a7d-8eae-4e66-a492-b676988ca6ec-ca-trust-extracted\") pod \"image-registry-65c9b7fd44-s9n6g\" (UID: \"c3751a7d-8eae-4e66-a492-b676988ca6ec\") " pod="openshift-image-registry/image-registry-65c9b7fd44-s9n6g" Sep 08 02:41:10.159528 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:10.159315 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x8m4n\" (UniqueName: \"kubernetes.io/projected/c3751a7d-8eae-4e66-a492-b676988ca6ec-kube-api-access-x8m4n\") pod \"image-registry-65c9b7fd44-s9n6g\" (UID: \"c3751a7d-8eae-4e66-a492-b676988ca6ec\") " pod="openshift-image-registry/image-registry-65c9b7fd44-s9n6g" Sep 08 02:41:10.159528 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:10.159344 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c3751a7d-8eae-4e66-a492-b676988ca6ec-registry-certificates\") pod \"image-registry-65c9b7fd44-s9n6g\" (UID: \"c3751a7d-8eae-4e66-a492-b676988ca6ec\") " pod="openshift-image-registry/image-registry-65c9b7fd44-s9n6g" Sep 08 02:41:10.159528 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:10.159382 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mxxhq\" (UniqueName: \"kubernetes.io/projected/829fed37-98de-4e8c-be35-d3e13ea6bc3b-kube-api-access-mxxhq\") pod \"ingress-canary-zkxnl\" (UID: \"829fed37-98de-4e8c-be35-d3e13ea6bc3b\") " pod="openshift-ingress-canary/ingress-canary-zkxnl" Sep 08 02:41:10.159528 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:10.159423 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/635bc747-a5b6-4c49-aa00-fab4bef8f003-metrics-tls\") pod \"dns-default-h62hl\" (UID: \"635bc747-a5b6-4c49-aa00-fab4bef8f003\") " pod="openshift-dns/dns-default-h62hl" Sep 08 02:41:10.159528 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:10.159444 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lnd9f\" (UniqueName: \"kubernetes.io/projected/635bc747-a5b6-4c49-aa00-fab4bef8f003-kube-api-access-lnd9f\") pod \"dns-default-h62hl\" (UID: \"635bc747-a5b6-4c49-aa00-fab4bef8f003\") " pod="openshift-dns/dns-default-h62hl" Sep 08 02:41:10.159528 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:10.159464 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/635bc747-a5b6-4c49-aa00-fab4bef8f003-config-volume\") pod \"dns-default-h62hl\" (UID: \"635bc747-a5b6-4c49-aa00-fab4bef8f003\") " pod="openshift-dns/dns-default-h62hl" Sep 08 02:41:10.159528 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:10.159482 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/829fed37-98de-4e8c-be35-d3e13ea6bc3b-cert\") pod \"ingress-canary-zkxnl\" (UID: \"829fed37-98de-4e8c-be35-d3e13ea6bc3b\") " pod="openshift-ingress-canary/ingress-canary-zkxnl" Sep 08 02:41:10.159528 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:10.159509 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c3751a7d-8eae-4e66-a492-b676988ca6ec-image-registry-private-configuration\") pod \"image-registry-65c9b7fd44-s9n6g\" (UID: \"c3751a7d-8eae-4e66-a492-b676988ca6ec\") " pod="openshift-image-registry/image-registry-65c9b7fd44-s9n6g" Sep 08 02:41:10.159528 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:41:10.159523 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 08 02:41:10.159963 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:41:10.159581 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/635bc747-a5b6-4c49-aa00-fab4bef8f003-metrics-tls podName:635bc747-a5b6-4c49-aa00-fab4bef8f003 nodeName:}" failed. No retries permitted until 2026-09-08 02:41:10.659562423 +0000 UTC m=+35.094536123 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/635bc747-a5b6-4c49-aa00-fab4bef8f003-metrics-tls") pod "dns-default-h62hl" (UID: "635bc747-a5b6-4c49-aa00-fab4bef8f003") : secret "dns-default-metrics-tls" not found Sep 08 02:41:10.159963 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:10.159529 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/635bc747-a5b6-4c49-aa00-fab4bef8f003-tmp-dir\") pod \"dns-default-h62hl\" (UID: \"635bc747-a5b6-4c49-aa00-fab4bef8f003\") " pod="openshift-dns/dns-default-h62hl" Sep 08 02:41:10.159963 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:10.159748 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c3751a7d-8eae-4e66-a492-b676988ca6ec-ca-trust-extracted\") pod \"image-registry-65c9b7fd44-s9n6g\" (UID: \"c3751a7d-8eae-4e66-a492-b676988ca6ec\") " pod="openshift-image-registry/image-registry-65c9b7fd44-s9n6g" Sep 08 02:41:10.159963 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:10.159795 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/635bc747-a5b6-4c49-aa00-fab4bef8f003-tmp-dir\") pod \"dns-default-h62hl\" (UID: \"635bc747-a5b6-4c49-aa00-fab4bef8f003\") " pod="openshift-dns/dns-default-h62hl" Sep 08 02:41:10.160239 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:10.160222 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c3751a7d-8eae-4e66-a492-b676988ca6ec-trusted-ca\") pod \"image-registry-65c9b7fd44-s9n6g\" (UID: \"c3751a7d-8eae-4e66-a492-b676988ca6ec\") " pod="openshift-image-registry/image-registry-65c9b7fd44-s9n6g" Sep 08 02:41:10.160290 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:10.160220 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/635bc747-a5b6-4c49-aa00-fab4bef8f003-config-volume\") pod \"dns-default-h62hl\" (UID: \"635bc747-a5b6-4c49-aa00-fab4bef8f003\") " pod="openshift-dns/dns-default-h62hl" Sep 08 02:41:10.160583 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:10.160398 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c3751a7d-8eae-4e66-a492-b676988ca6ec-registry-certificates\") pod \"image-registry-65c9b7fd44-s9n6g\" (UID: \"c3751a7d-8eae-4e66-a492-b676988ca6ec\") " pod="openshift-image-registry/image-registry-65c9b7fd44-s9n6g" Sep 08 02:41:10.163269 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:10.163247 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c3751a7d-8eae-4e66-a492-b676988ca6ec-image-registry-private-configuration\") pod \"image-registry-65c9b7fd44-s9n6g\" (UID: \"c3751a7d-8eae-4e66-a492-b676988ca6ec\") " pod="openshift-image-registry/image-registry-65c9b7fd44-s9n6g" Sep 08 02:41:10.163402 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:10.163279 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/829fed37-98de-4e8c-be35-d3e13ea6bc3b-cert\") pod \"ingress-canary-zkxnl\" (UID: \"829fed37-98de-4e8c-be35-d3e13ea6bc3b\") " pod="openshift-ingress-canary/ingress-canary-zkxnl" Sep 08 02:41:10.163402 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:10.163311 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c3751a7d-8eae-4e66-a492-b676988ca6ec-installation-pull-secrets\") pod \"image-registry-65c9b7fd44-s9n6g\" (UID: \"c3751a7d-8eae-4e66-a492-b676988ca6ec\") " pod="openshift-image-registry/image-registry-65c9b7fd44-s9n6g" Sep 08 02:41:10.168243 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:10.168123 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x8m4n\" (UniqueName: \"kubernetes.io/projected/c3751a7d-8eae-4e66-a492-b676988ca6ec-kube-api-access-x8m4n\") pod \"image-registry-65c9b7fd44-s9n6g\" (UID: \"c3751a7d-8eae-4e66-a492-b676988ca6ec\") " pod="openshift-image-registry/image-registry-65c9b7fd44-s9n6g" Sep 08 02:41:10.168364 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:10.168275 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mxxhq\" (UniqueName: \"kubernetes.io/projected/829fed37-98de-4e8c-be35-d3e13ea6bc3b-kube-api-access-mxxhq\") pod \"ingress-canary-zkxnl\" (UID: \"829fed37-98de-4e8c-be35-d3e13ea6bc3b\") " pod="openshift-ingress-canary/ingress-canary-zkxnl" Sep 08 02:41:10.168364 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:10.168286 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c3751a7d-8eae-4e66-a492-b676988ca6ec-bound-sa-token\") pod \"image-registry-65c9b7fd44-s9n6g\" (UID: \"c3751a7d-8eae-4e66-a492-b676988ca6ec\") " pod="openshift-image-registry/image-registry-65c9b7fd44-s9n6g" Sep 08 02:41:10.168663 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:10.168644 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lnd9f\" (UniqueName: \"kubernetes.io/projected/635bc747-a5b6-4c49-aa00-fab4bef8f003-kube-api-access-lnd9f\") pod \"dns-default-h62hl\" (UID: \"635bc747-a5b6-4c49-aa00-fab4bef8f003\") " pod="openshift-dns/dns-default-h62hl" Sep 08 02:41:10.253867 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:10.253839 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-zkxnl" Sep 08 02:41:10.541172 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:10.541095 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-zkxnl"] Sep 08 02:41:10.544406 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:41:10.544373 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod829fed37_98de_4e8c_be35_d3e13ea6bc3b.slice/crio-2b989b60008b179537edbfe17d15f759b7669de17de97bc6ec73c76074d390d3 WatchSource:0}: Error finding container 2b989b60008b179537edbfe17d15f759b7669de17de97bc6ec73c76074d390d3: Status 404 returned error can't find the container with id 2b989b60008b179537edbfe17d15f759b7669de17de97bc6ec73c76074d390d3 Sep 08 02:41:10.663600 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:10.663552 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c3751a7d-8eae-4e66-a492-b676988ca6ec-registry-tls\") pod \"image-registry-65c9b7fd44-s9n6g\" (UID: \"c3751a7d-8eae-4e66-a492-b676988ca6ec\") " pod="openshift-image-registry/image-registry-65c9b7fd44-s9n6g" Sep 08 02:41:10.663813 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:10.663632 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/635bc747-a5b6-4c49-aa00-fab4bef8f003-metrics-tls\") pod \"dns-default-h62hl\" (UID: \"635bc747-a5b6-4c49-aa00-fab4bef8f003\") " pod="openshift-dns/dns-default-h62hl" Sep 08 02:41:10.663813 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:41:10.663718 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 08 02:41:10.663813 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:41:10.663733 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 08 02:41:10.663813 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:41:10.663756 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65c9b7fd44-s9n6g: secret "image-registry-tls" not found Sep 08 02:41:10.663813 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:41:10.663769 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/635bc747-a5b6-4c49-aa00-fab4bef8f003-metrics-tls podName:635bc747-a5b6-4c49-aa00-fab4bef8f003 nodeName:}" failed. No retries permitted until 2026-09-08 02:41:11.663755415 +0000 UTC m=+36.098729087 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/635bc747-a5b6-4c49-aa00-fab4bef8f003-metrics-tls") pod "dns-default-h62hl" (UID: "635bc747-a5b6-4c49-aa00-fab4bef8f003") : secret "dns-default-metrics-tls" not found Sep 08 02:41:10.663813 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:41:10.663808 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c3751a7d-8eae-4e66-a492-b676988ca6ec-registry-tls podName:c3751a7d-8eae-4e66-a492-b676988ca6ec nodeName:}" failed. No retries permitted until 2026-09-08 02:41:11.663791471 +0000 UTC m=+36.098765150 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c3751a7d-8eae-4e66-a492-b676988ca6ec-registry-tls") pod "image-registry-65c9b7fd44-s9n6g" (UID: "c3751a7d-8eae-4e66-a492-b676988ca6ec") : secret "image-registry-tls" not found Sep 08 02:41:11.101170 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:11.101135 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s6jbs" Sep 08 02:41:11.101900 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:11.101137 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s7mcq" Sep 08 02:41:11.103638 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:11.103616 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 08 02:41:11.103781 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:11.103649 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-jvzd6\"" Sep 08 02:41:11.103781 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:11.103623 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 08 02:41:11.104466 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:11.104448 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 08 02:41:11.291089 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:11.291034 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-zkxnl" event={"ID":"829fed37-98de-4e8c-be35-d3e13ea6bc3b","Type":"ContainerStarted","Data":"2b989b60008b179537edbfe17d15f759b7669de17de97bc6ec73c76074d390d3"} Sep 08 02:41:11.294432 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:11.294403 2564 generic.go:356] "Generic (PLEG): container finished" podID="22f90f96-0ae6-459f-bd10-15f4c72e0935" containerID="919d68a841ab2c822497546487d7dc085918f1d75b83518894bb90939763e82f" exitCode=0 Sep 08 02:41:11.294590 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:11.294444 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9w5n9" event={"ID":"22f90f96-0ae6-459f-bd10-15f4c72e0935","Type":"ContainerDied","Data":"919d68a841ab2c822497546487d7dc085918f1d75b83518894bb90939763e82f"} Sep 08 02:41:11.670767 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:11.670673 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/635bc747-a5b6-4c49-aa00-fab4bef8f003-metrics-tls\") pod \"dns-default-h62hl\" (UID: \"635bc747-a5b6-4c49-aa00-fab4bef8f003\") " pod="openshift-dns/dns-default-h62hl" Sep 08 02:41:11.670767 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:11.670739 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c3751a7d-8eae-4e66-a492-b676988ca6ec-registry-tls\") pod \"image-registry-65c9b7fd44-s9n6g\" (UID: \"c3751a7d-8eae-4e66-a492-b676988ca6ec\") " pod="openshift-image-registry/image-registry-65c9b7fd44-s9n6g" Sep 08 02:41:11.670949 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:41:11.670826 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 08 02:41:11.670949 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:41:11.670853 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 08 02:41:11.670949 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:41:11.670866 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65c9b7fd44-s9n6g: secret "image-registry-tls" not found Sep 08 02:41:11.670949 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:41:11.670897 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/635bc747-a5b6-4c49-aa00-fab4bef8f003-metrics-tls podName:635bc747-a5b6-4c49-aa00-fab4bef8f003 nodeName:}" failed. No retries permitted until 2026-09-08 02:41:13.670880458 +0000 UTC m=+38.105854125 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/635bc747-a5b6-4c49-aa00-fab4bef8f003-metrics-tls") pod "dns-default-h62hl" (UID: "635bc747-a5b6-4c49-aa00-fab4bef8f003") : secret "dns-default-metrics-tls" not found Sep 08 02:41:11.670949 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:41:11.670912 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c3751a7d-8eae-4e66-a492-b676988ca6ec-registry-tls podName:c3751a7d-8eae-4e66-a492-b676988ca6ec nodeName:}" failed. No retries permitted until 2026-09-08 02:41:13.670905991 +0000 UTC m=+38.105879659 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c3751a7d-8eae-4e66-a492-b676988ca6ec-registry-tls") pod "image-registry-65c9b7fd44-s9n6g" (UID: "c3751a7d-8eae-4e66-a492-b676988ca6ec") : secret "image-registry-tls" not found Sep 08 02:41:12.301290 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:12.301103 2564 generic.go:356] "Generic (PLEG): container finished" podID="22f90f96-0ae6-459f-bd10-15f4c72e0935" containerID="dc9f53d3dd639e9be63a3932e919afea7a6a7a174e81dbc7da30bcadf305b0ba" exitCode=0 Sep 08 02:41:12.301745 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:12.301183 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9w5n9" event={"ID":"22f90f96-0ae6-459f-bd10-15f4c72e0935","Type":"ContainerDied","Data":"dc9f53d3dd639e9be63a3932e919afea7a6a7a174e81dbc7da30bcadf305b0ba"} Sep 08 02:41:13.307040 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:13.307014 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9w5n9" event={"ID":"22f90f96-0ae6-459f-bd10-15f4c72e0935","Type":"ContainerStarted","Data":"cccaf45b4fcd1ed15032ab7ba99e467cfdcb7b1c3cc45482714ea8cc3d6bf3f4"} Sep 08 02:41:13.333899 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:13.333846 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-9w5n9" podStartSLOduration=8.677914617999999 podStartE2EDuration="37.333830143s" totalImagesPullingTime="28.655915525s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 02:40:36 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 02:41:13.3326044 +0000 UTC m=+37.767578090" watchObservedRunningTime="2026-09-08 02:41:13.333830143 +0000 UTC m=+37.768803869" Sep 08 02:41:13.687655 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:13.687556 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/635bc747-a5b6-4c49-aa00-fab4bef8f003-metrics-tls\") pod \"dns-default-h62hl\" (UID: \"635bc747-a5b6-4c49-aa00-fab4bef8f003\") " pod="openshift-dns/dns-default-h62hl" Sep 08 02:41:13.687655 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:13.687612 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c3751a7d-8eae-4e66-a492-b676988ca6ec-registry-tls\") pod \"image-registry-65c9b7fd44-s9n6g\" (UID: \"c3751a7d-8eae-4e66-a492-b676988ca6ec\") " pod="openshift-image-registry/image-registry-65c9b7fd44-s9n6g" Sep 08 02:41:13.687927 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:41:13.687715 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 08 02:41:13.687927 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:41:13.687776 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/635bc747-a5b6-4c49-aa00-fab4bef8f003-metrics-tls podName:635bc747-a5b6-4c49-aa00-fab4bef8f003 nodeName:}" failed. No retries permitted until 2026-09-08 02:41:17.687760767 +0000 UTC m=+42.122734451 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/635bc747-a5b6-4c49-aa00-fab4bef8f003-metrics-tls") pod "dns-default-h62hl" (UID: "635bc747-a5b6-4c49-aa00-fab4bef8f003") : secret "dns-default-metrics-tls" not found Sep 08 02:41:13.687927 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:41:13.687809 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 08 02:41:13.687927 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:41:13.687827 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65c9b7fd44-s9n6g: secret "image-registry-tls" not found Sep 08 02:41:13.687927 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:41:13.687867 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c3751a7d-8eae-4e66-a492-b676988ca6ec-registry-tls podName:c3751a7d-8eae-4e66-a492-b676988ca6ec nodeName:}" failed. No retries permitted until 2026-09-08 02:41:17.687856066 +0000 UTC m=+42.122829734 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c3751a7d-8eae-4e66-a492-b676988ca6ec-registry-tls") pod "image-registry-65c9b7fd44-s9n6g" (UID: "c3751a7d-8eae-4e66-a492-b676988ca6ec") : secret "image-registry-tls" not found Sep 08 02:41:14.310748 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:14.310711 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-zkxnl" event={"ID":"829fed37-98de-4e8c-be35-d3e13ea6bc3b","Type":"ContainerStarted","Data":"39bd8236f41b787dc6f34c627f62b0685b37a2c2987be2b379525391345a46c0"} Sep 08 02:41:14.327614 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:14.327568 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-zkxnl" podStartSLOduration=2.5992365729999998 podStartE2EDuration="5.327552035s" totalImagesPullingTime="2.728315462s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 02:41:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 02:41:14.326635718 +0000 UTC m=+38.761609408" watchObservedRunningTime="2026-09-08 02:41:14.327552035 +0000 UTC m=+38.762525716" Sep 08 02:41:17.716190 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:17.716146 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/635bc747-a5b6-4c49-aa00-fab4bef8f003-metrics-tls\") pod \"dns-default-h62hl\" (UID: \"635bc747-a5b6-4c49-aa00-fab4bef8f003\") " pod="openshift-dns/dns-default-h62hl" Sep 08 02:41:17.716190 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:17.716200 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c3751a7d-8eae-4e66-a492-b676988ca6ec-registry-tls\") pod \"image-registry-65c9b7fd44-s9n6g\" (UID: \"c3751a7d-8eae-4e66-a492-b676988ca6ec\") " pod="openshift-image-registry/image-registry-65c9b7fd44-s9n6g" Sep 08 02:41:17.716647 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:41:17.716296 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 08 02:41:17.716647 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:41:17.716305 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 08 02:41:17.716647 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:41:17.716389 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/635bc747-a5b6-4c49-aa00-fab4bef8f003-metrics-tls podName:635bc747-a5b6-4c49-aa00-fab4bef8f003 nodeName:}" failed. No retries permitted until 2026-09-08 02:41:25.716371972 +0000 UTC m=+50.151345653 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/635bc747-a5b6-4c49-aa00-fab4bef8f003-metrics-tls") pod "dns-default-h62hl" (UID: "635bc747-a5b6-4c49-aa00-fab4bef8f003") : secret "dns-default-metrics-tls" not found Sep 08 02:41:17.716647 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:41:17.716310 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65c9b7fd44-s9n6g: secret "image-registry-tls" not found Sep 08 02:41:17.716647 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:41:17.716442 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c3751a7d-8eae-4e66-a492-b676988ca6ec-registry-tls podName:c3751a7d-8eae-4e66-a492-b676988ca6ec nodeName:}" failed. No retries permitted until 2026-09-08 02:41:25.716428704 +0000 UTC m=+50.151402376 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c3751a7d-8eae-4e66-a492-b676988ca6ec-registry-tls") pod "image-registry-65c9b7fd44-s9n6g" (UID: "c3751a7d-8eae-4e66-a492-b676988ca6ec") : secret "image-registry-tls" not found Sep 08 02:41:25.775845 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:25.775800 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c3751a7d-8eae-4e66-a492-b676988ca6ec-registry-tls\") pod \"image-registry-65c9b7fd44-s9n6g\" (UID: \"c3751a7d-8eae-4e66-a492-b676988ca6ec\") " pod="openshift-image-registry/image-registry-65c9b7fd44-s9n6g" Sep 08 02:41:25.776265 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:25.775876 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/635bc747-a5b6-4c49-aa00-fab4bef8f003-metrics-tls\") pod \"dns-default-h62hl\" (UID: \"635bc747-a5b6-4c49-aa00-fab4bef8f003\") " pod="openshift-dns/dns-default-h62hl" Sep 08 02:41:25.776265 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:41:25.775964 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 08 02:41:25.776265 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:41:25.775972 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 08 02:41:25.776265 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:41:25.775998 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65c9b7fd44-s9n6g: secret "image-registry-tls" not found Sep 08 02:41:25.776265 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:41:25.776025 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/635bc747-a5b6-4c49-aa00-fab4bef8f003-metrics-tls podName:635bc747-a5b6-4c49-aa00-fab4bef8f003 nodeName:}" failed. No retries permitted until 2026-09-08 02:41:41.776010776 +0000 UTC m=+66.210984443 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/635bc747-a5b6-4c49-aa00-fab4bef8f003-metrics-tls") pod "dns-default-h62hl" (UID: "635bc747-a5b6-4c49-aa00-fab4bef8f003") : secret "dns-default-metrics-tls" not found Sep 08 02:41:25.776265 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:41:25.776049 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c3751a7d-8eae-4e66-a492-b676988ca6ec-registry-tls podName:c3751a7d-8eae-4e66-a492-b676988ca6ec nodeName:}" failed. No retries permitted until 2026-09-08 02:41:41.77603529 +0000 UTC m=+66.211008958 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c3751a7d-8eae-4e66-a492-b676988ca6ec-registry-tls") pod "image-registry-65c9b7fd44-s9n6g" (UID: "c3751a7d-8eae-4e66-a492-b676988ca6ec") : secret "image-registry-tls" not found Sep 08 02:41:34.290699 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:34.290668 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-srkh5" Sep 08 02:41:36.357680 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:36.357646 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-2842s"] Sep 08 02:41:36.360193 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:36.360162 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-76bcd6ccf5-2842s" Sep 08 02:41:36.362633 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:36.362612 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Sep 08 02:41:36.362855 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:36.362837 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Sep 08 02:41:36.363008 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:36.362990 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-4h7gx\"" Sep 08 02:41:36.363752 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:36.363735 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 08 02:41:36.363817 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:36.363755 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 08 02:41:36.367934 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:36.367918 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Sep 08 02:41:36.376254 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:36.376234 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-2842s"] Sep 08 02:41:36.457441 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:36.457393 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v7mbm\" (UniqueName: \"kubernetes.io/projected/6b2ac5ed-3b3c-44a6-afe9-25d6c8bfb4da-kube-api-access-v7mbm\") pod \"insights-operator-76bcd6ccf5-2842s\" (UID: \"6b2ac5ed-3b3c-44a6-afe9-25d6c8bfb4da\") " pod="openshift-insights/insights-operator-76bcd6ccf5-2842s" Sep 08 02:41:36.457441 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:36.457443 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6b2ac5ed-3b3c-44a6-afe9-25d6c8bfb4da-tmp\") pod \"insights-operator-76bcd6ccf5-2842s\" (UID: \"6b2ac5ed-3b3c-44a6-afe9-25d6c8bfb4da\") " pod="openshift-insights/insights-operator-76bcd6ccf5-2842s" Sep 08 02:41:36.457690 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:36.457473 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/6b2ac5ed-3b3c-44a6-afe9-25d6c8bfb4da-snapshots\") pod \"insights-operator-76bcd6ccf5-2842s\" (UID: \"6b2ac5ed-3b3c-44a6-afe9-25d6c8bfb4da\") " pod="openshift-insights/insights-operator-76bcd6ccf5-2842s" Sep 08 02:41:36.457690 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:36.457498 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b2ac5ed-3b3c-44a6-afe9-25d6c8bfb4da-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-2842s\" (UID: \"6b2ac5ed-3b3c-44a6-afe9-25d6c8bfb4da\") " pod="openshift-insights/insights-operator-76bcd6ccf5-2842s" Sep 08 02:41:36.457690 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:36.457582 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b2ac5ed-3b3c-44a6-afe9-25d6c8bfb4da-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-2842s\" (UID: \"6b2ac5ed-3b3c-44a6-afe9-25d6c8bfb4da\") " pod="openshift-insights/insights-operator-76bcd6ccf5-2842s" Sep 08 02:41:36.457690 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:36.457638 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6b2ac5ed-3b3c-44a6-afe9-25d6c8bfb4da-serving-cert\") pod \"insights-operator-76bcd6ccf5-2842s\" (UID: \"6b2ac5ed-3b3c-44a6-afe9-25d6c8bfb4da\") " pod="openshift-insights/insights-operator-76bcd6ccf5-2842s" Sep 08 02:41:36.558002 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:36.557962 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v7mbm\" (UniqueName: \"kubernetes.io/projected/6b2ac5ed-3b3c-44a6-afe9-25d6c8bfb4da-kube-api-access-v7mbm\") pod \"insights-operator-76bcd6ccf5-2842s\" (UID: \"6b2ac5ed-3b3c-44a6-afe9-25d6c8bfb4da\") " pod="openshift-insights/insights-operator-76bcd6ccf5-2842s" Sep 08 02:41:36.558002 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:36.558001 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6b2ac5ed-3b3c-44a6-afe9-25d6c8bfb4da-tmp\") pod \"insights-operator-76bcd6ccf5-2842s\" (UID: \"6b2ac5ed-3b3c-44a6-afe9-25d6c8bfb4da\") " pod="openshift-insights/insights-operator-76bcd6ccf5-2842s" Sep 08 02:41:36.558229 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:36.558017 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/6b2ac5ed-3b3c-44a6-afe9-25d6c8bfb4da-snapshots\") pod \"insights-operator-76bcd6ccf5-2842s\" (UID: \"6b2ac5ed-3b3c-44a6-afe9-25d6c8bfb4da\") " pod="openshift-insights/insights-operator-76bcd6ccf5-2842s" Sep 08 02:41:36.558229 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:36.558146 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b2ac5ed-3b3c-44a6-afe9-25d6c8bfb4da-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-2842s\" (UID: \"6b2ac5ed-3b3c-44a6-afe9-25d6c8bfb4da\") " pod="openshift-insights/insights-operator-76bcd6ccf5-2842s" Sep 08 02:41:36.558229 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:36.558201 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b2ac5ed-3b3c-44a6-afe9-25d6c8bfb4da-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-2842s\" (UID: \"6b2ac5ed-3b3c-44a6-afe9-25d6c8bfb4da\") " pod="openshift-insights/insights-operator-76bcd6ccf5-2842s" Sep 08 02:41:36.558421 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:36.558244 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6b2ac5ed-3b3c-44a6-afe9-25d6c8bfb4da-serving-cert\") pod \"insights-operator-76bcd6ccf5-2842s\" (UID: \"6b2ac5ed-3b3c-44a6-afe9-25d6c8bfb4da\") " pod="openshift-insights/insights-operator-76bcd6ccf5-2842s" Sep 08 02:41:36.558613 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:36.558591 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6b2ac5ed-3b3c-44a6-afe9-25d6c8bfb4da-tmp\") pod \"insights-operator-76bcd6ccf5-2842s\" (UID: \"6b2ac5ed-3b3c-44a6-afe9-25d6c8bfb4da\") " pod="openshift-insights/insights-operator-76bcd6ccf5-2842s" Sep 08 02:41:36.558692 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:36.558668 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/6b2ac5ed-3b3c-44a6-afe9-25d6c8bfb4da-snapshots\") pod \"insights-operator-76bcd6ccf5-2842s\" (UID: \"6b2ac5ed-3b3c-44a6-afe9-25d6c8bfb4da\") " pod="openshift-insights/insights-operator-76bcd6ccf5-2842s" Sep 08 02:41:36.558842 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:36.558819 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b2ac5ed-3b3c-44a6-afe9-25d6c8bfb4da-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-2842s\" (UID: \"6b2ac5ed-3b3c-44a6-afe9-25d6c8bfb4da\") " pod="openshift-insights/insights-operator-76bcd6ccf5-2842s" Sep 08 02:41:36.559034 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:36.559011 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b2ac5ed-3b3c-44a6-afe9-25d6c8bfb4da-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-2842s\" (UID: \"6b2ac5ed-3b3c-44a6-afe9-25d6c8bfb4da\") " pod="openshift-insights/insights-operator-76bcd6ccf5-2842s" Sep 08 02:41:36.561252 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:36.561234 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6b2ac5ed-3b3c-44a6-afe9-25d6c8bfb4da-serving-cert\") pod \"insights-operator-76bcd6ccf5-2842s\" (UID: \"6b2ac5ed-3b3c-44a6-afe9-25d6c8bfb4da\") " pod="openshift-insights/insights-operator-76bcd6ccf5-2842s" Sep 08 02:41:36.566130 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:36.566104 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v7mbm\" (UniqueName: \"kubernetes.io/projected/6b2ac5ed-3b3c-44a6-afe9-25d6c8bfb4da-kube-api-access-v7mbm\") pod \"insights-operator-76bcd6ccf5-2842s\" (UID: \"6b2ac5ed-3b3c-44a6-afe9-25d6c8bfb4da\") " pod="openshift-insights/insights-operator-76bcd6ccf5-2842s" Sep 08 02:41:36.668755 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:36.668656 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-76bcd6ccf5-2842s" Sep 08 02:41:36.934240 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:36.934160 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-2842s"] Sep 08 02:41:36.937785 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:41:36.937746 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b2ac5ed_3b3c_44a6_afe9_25d6c8bfb4da.slice/crio-959e03d2db81d545d128fa5b27ebf8d9b3a85ddcc3c2f7033d5c599cc01e927b WatchSource:0}: Error finding container 959e03d2db81d545d128fa5b27ebf8d9b3a85ddcc3c2f7033d5c599cc01e927b: Status 404 returned error can't find the container with id 959e03d2db81d545d128fa5b27ebf8d9b3a85ddcc3c2f7033d5c599cc01e927b Sep 08 02:41:37.363742 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:37.363704 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-2842s" event={"ID":"6b2ac5ed-3b3c-44a6-afe9-25d6c8bfb4da","Type":"ContainerStarted","Data":"959e03d2db81d545d128fa5b27ebf8d9b3a85ddcc3c2f7033d5c599cc01e927b"} Sep 08 02:41:39.369805 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:39.369763 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-2842s" event={"ID":"6b2ac5ed-3b3c-44a6-afe9-25d6c8bfb4da","Type":"ContainerStarted","Data":"5c0076fb4a1dc8fb226c96706585e3de94d549bb70a5f2be7aaca543f27d647d"} Sep 08 02:41:39.386834 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:39.386780 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-76bcd6ccf5-2842s" podStartSLOduration=1.636471009 podStartE2EDuration="3.386767008s" totalImagesPullingTime="1.750295999s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 02:41:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 02:41:39.385229947 +0000 UTC m=+63.820203636" watchObservedRunningTime="2026-09-08 02:41:39.386767008 +0000 UTC m=+63.821740698" Sep 08 02:41:40.088021 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:40.087976 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-9srg4"] Sep 08 02:41:40.111027 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:40.111000 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-9srg4" Sep 08 02:41:40.114826 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:40.114691 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-2f8pk\"" Sep 08 02:41:40.114968 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:40.114946 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 08 02:41:40.115044 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:40.114947 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 08 02:41:40.117721 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:40.117388 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-9srg4"] Sep 08 02:41:40.185949 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:40.185905 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7481ac35-8d64-4777-8985-384f3cf98fda-data-volume\") pod \"insights-runtime-extractor-9srg4\" (UID: \"7481ac35-8d64-4777-8985-384f3cf98fda\") " pod="openshift-insights/insights-runtime-extractor-9srg4" Sep 08 02:41:40.185949 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:40.185950 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7481ac35-8d64-4777-8985-384f3cf98fda-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9srg4\" (UID: \"7481ac35-8d64-4777-8985-384f3cf98fda\") " pod="openshift-insights/insights-runtime-extractor-9srg4" Sep 08 02:41:40.186164 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:40.185979 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zfcfx\" (UniqueName: \"kubernetes.io/projected/7481ac35-8d64-4777-8985-384f3cf98fda-kube-api-access-zfcfx\") pod \"insights-runtime-extractor-9srg4\" (UID: \"7481ac35-8d64-4777-8985-384f3cf98fda\") " pod="openshift-insights/insights-runtime-extractor-9srg4" Sep 08 02:41:40.186164 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:40.186109 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7481ac35-8d64-4777-8985-384f3cf98fda-crio-socket\") pod \"insights-runtime-extractor-9srg4\" (UID: \"7481ac35-8d64-4777-8985-384f3cf98fda\") " pod="openshift-insights/insights-runtime-extractor-9srg4" Sep 08 02:41:40.186232 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:40.186184 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7481ac35-8d64-4777-8985-384f3cf98fda-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9srg4\" (UID: \"7481ac35-8d64-4777-8985-384f3cf98fda\") " pod="openshift-insights/insights-runtime-extractor-9srg4" Sep 08 02:41:40.286691 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:40.286656 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7481ac35-8d64-4777-8985-384f3cf98fda-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9srg4\" (UID: \"7481ac35-8d64-4777-8985-384f3cf98fda\") " pod="openshift-insights/insights-runtime-extractor-9srg4" Sep 08 02:41:40.286691 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:40.286699 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7481ac35-8d64-4777-8985-384f3cf98fda-data-volume\") pod \"insights-runtime-extractor-9srg4\" (UID: \"7481ac35-8d64-4777-8985-384f3cf98fda\") " pod="openshift-insights/insights-runtime-extractor-9srg4" Sep 08 02:41:40.286934 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:40.286718 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7481ac35-8d64-4777-8985-384f3cf98fda-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9srg4\" (UID: \"7481ac35-8d64-4777-8985-384f3cf98fda\") " pod="openshift-insights/insights-runtime-extractor-9srg4" Sep 08 02:41:40.286934 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:40.286744 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zfcfx\" (UniqueName: \"kubernetes.io/projected/7481ac35-8d64-4777-8985-384f3cf98fda-kube-api-access-zfcfx\") pod \"insights-runtime-extractor-9srg4\" (UID: \"7481ac35-8d64-4777-8985-384f3cf98fda\") " pod="openshift-insights/insights-runtime-extractor-9srg4" Sep 08 02:41:40.286934 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:41:40.286805 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 08 02:41:40.286934 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:41:40.286836 2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 08 02:41:40.286934 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:40.286813 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7481ac35-8d64-4777-8985-384f3cf98fda-crio-socket\") pod \"insights-runtime-extractor-9srg4\" (UID: \"7481ac35-8d64-4777-8985-384f3cf98fda\") " pod="openshift-insights/insights-runtime-extractor-9srg4" Sep 08 02:41:40.286934 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:41:40.286870 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7481ac35-8d64-4777-8985-384f3cf98fda-insights-runtime-extractor-tls podName:7481ac35-8d64-4777-8985-384f3cf98fda nodeName:}" failed. No retries permitted until 2026-09-08 02:41:40.786853175 +0000 UTC m=+65.221826843 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7481ac35-8d64-4777-8985-384f3cf98fda-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9srg4" (UID: "7481ac35-8d64-4777-8985-384f3cf98fda") : secret "insights-runtime-extractor-tls" not found Sep 08 02:41:40.287233 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:40.286868 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7481ac35-8d64-4777-8985-384f3cf98fda-crio-socket\") pod \"insights-runtime-extractor-9srg4\" (UID: \"7481ac35-8d64-4777-8985-384f3cf98fda\") " pod="openshift-insights/insights-runtime-extractor-9srg4" Sep 08 02:41:40.287233 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:41:40.286945 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7481ac35-8d64-4777-8985-384f3cf98fda-kube-rbac-proxy-cm podName:7481ac35-8d64-4777-8985-384f3cf98fda nodeName:}" failed. No retries permitted until 2026-09-08 02:41:40.786919726 +0000 UTC m=+65.221893402 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7481ac35-8d64-4777-8985-384f3cf98fda-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9srg4" (UID: "7481ac35-8d64-4777-8985-384f3cf98fda") : configmap "kube-rbac-proxy" not found Sep 08 02:41:40.287233 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:40.287034 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7481ac35-8d64-4777-8985-384f3cf98fda-data-volume\") pod \"insights-runtime-extractor-9srg4\" (UID: \"7481ac35-8d64-4777-8985-384f3cf98fda\") " pod="openshift-insights/insights-runtime-extractor-9srg4" Sep 08 02:41:40.298268 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:40.298230 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zfcfx\" (UniqueName: \"kubernetes.io/projected/7481ac35-8d64-4777-8985-384f3cf98fda-kube-api-access-zfcfx\") pod \"insights-runtime-extractor-9srg4\" (UID: \"7481ac35-8d64-4777-8985-384f3cf98fda\") " pod="openshift-insights/insights-runtime-extractor-9srg4" Sep 08 02:41:40.790870 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:40.790827 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7481ac35-8d64-4777-8985-384f3cf98fda-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9srg4\" (UID: \"7481ac35-8d64-4777-8985-384f3cf98fda\") " pod="openshift-insights/insights-runtime-extractor-9srg4" Sep 08 02:41:40.790870 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:40.790875 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7481ac35-8d64-4777-8985-384f3cf98fda-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9srg4\" (UID: \"7481ac35-8d64-4777-8985-384f3cf98fda\") " pod="openshift-insights/insights-runtime-extractor-9srg4" Sep 08 02:41:40.791289 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:41:40.790949 2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 08 02:41:40.791289 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:41:40.790979 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 08 02:41:40.791289 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:41:40.791007 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7481ac35-8d64-4777-8985-384f3cf98fda-kube-rbac-proxy-cm podName:7481ac35-8d64-4777-8985-384f3cf98fda nodeName:}" failed. No retries permitted until 2026-09-08 02:41:41.790993109 +0000 UTC m=+66.225966778 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7481ac35-8d64-4777-8985-384f3cf98fda-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9srg4" (UID: "7481ac35-8d64-4777-8985-384f3cf98fda") : configmap "kube-rbac-proxy" not found Sep 08 02:41:40.791289 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:41:40.791032 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7481ac35-8d64-4777-8985-384f3cf98fda-insights-runtime-extractor-tls podName:7481ac35-8d64-4777-8985-384f3cf98fda nodeName:}" failed. No retries permitted until 2026-09-08 02:41:41.791019144 +0000 UTC m=+66.225992812 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7481ac35-8d64-4777-8985-384f3cf98fda-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9srg4" (UID: "7481ac35-8d64-4777-8985-384f3cf98fda") : secret "insights-runtime-extractor-tls" not found Sep 08 02:41:41.606790 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:41.606756 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-fdbb8fdff-vjkwf"] Sep 08 02:41:41.608787 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:41.608769 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-vjkwf" Sep 08 02:41:41.611109 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:41.611085 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Sep 08 02:41:41.611236 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:41.611132 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Sep 08 02:41:41.612003 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:41.611982 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-pcht4\"" Sep 08 02:41:41.617076 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:41.617054 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-fdbb8fdff-vjkwf"] Sep 08 02:41:41.697811 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:41.697771 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wffkq\" (UniqueName: \"kubernetes.io/projected/de8e8fb0-069d-4b2c-a74e-082cea9d33aa-kube-api-access-wffkq\") pod \"migrator-fdbb8fdff-vjkwf\" (UID: \"de8e8fb0-069d-4b2c-a74e-082cea9d33aa\") " pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-vjkwf" Sep 08 02:41:41.798607 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:41.798567 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/635bc747-a5b6-4c49-aa00-fab4bef8f003-metrics-tls\") pod \"dns-default-h62hl\" (UID: \"635bc747-a5b6-4c49-aa00-fab4bef8f003\") " pod="openshift-dns/dns-default-h62hl" Sep 08 02:41:41.798995 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:41.798621 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c3751a7d-8eae-4e66-a492-b676988ca6ec-registry-tls\") pod \"image-registry-65c9b7fd44-s9n6g\" (UID: \"c3751a7d-8eae-4e66-a492-b676988ca6ec\") " pod="openshift-image-registry/image-registry-65c9b7fd44-s9n6g" Sep 08 02:41:41.798995 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:41.798639 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7481ac35-8d64-4777-8985-384f3cf98fda-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9srg4\" (UID: \"7481ac35-8d64-4777-8985-384f3cf98fda\") " pod="openshift-insights/insights-runtime-extractor-9srg4" Sep 08 02:41:41.798995 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:41.798662 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wffkq\" (UniqueName: \"kubernetes.io/projected/de8e8fb0-069d-4b2c-a74e-082cea9d33aa-kube-api-access-wffkq\") pod \"migrator-fdbb8fdff-vjkwf\" (UID: \"de8e8fb0-069d-4b2c-a74e-082cea9d33aa\") " pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-vjkwf" Sep 08 02:41:41.798995 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:41:41.798742 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 08 02:41:41.798995 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:41.798772 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ce406489-045e-4ba5-baa6-337a983d5466-original-pull-secret\") pod \"global-pull-secret-syncer-s6jbs\" (UID: \"ce406489-045e-4ba5-baa6-337a983d5466\") " pod="kube-system/global-pull-secret-syncer-s6jbs" Sep 08 02:41:41.798995 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:41:41.798807 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/635bc747-a5b6-4c49-aa00-fab4bef8f003-metrics-tls podName:635bc747-a5b6-4c49-aa00-fab4bef8f003 nodeName:}" failed. No retries permitted until 2026-09-08 02:42:13.798791954 +0000 UTC m=+98.233765622 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/635bc747-a5b6-4c49-aa00-fab4bef8f003-metrics-tls") pod "dns-default-h62hl" (UID: "635bc747-a5b6-4c49-aa00-fab4bef8f003") : secret "dns-default-metrics-tls" not found Sep 08 02:41:41.798995 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:41:41.798747 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 08 02:41:41.798995 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:41:41.798837 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65c9b7fd44-s9n6g: secret "image-registry-tls" not found Sep 08 02:41:41.798995 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:41.798853 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7481ac35-8d64-4777-8985-384f3cf98fda-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9srg4\" (UID: \"7481ac35-8d64-4777-8985-384f3cf98fda\") " pod="openshift-insights/insights-runtime-extractor-9srg4" Sep 08 02:41:41.798995 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:41:41.798752 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 08 02:41:41.798995 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:41:41.798883 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c3751a7d-8eae-4e66-a492-b676988ca6ec-registry-tls podName:c3751a7d-8eae-4e66-a492-b676988ca6ec nodeName:}" failed. No retries permitted until 2026-09-08 02:42:13.798871209 +0000 UTC m=+98.233844891 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c3751a7d-8eae-4e66-a492-b676988ca6ec-registry-tls") pod "image-registry-65c9b7fd44-s9n6g" (UID: "c3751a7d-8eae-4e66-a492-b676988ca6ec") : secret "image-registry-tls" not found Sep 08 02:41:41.798995 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:41:41.798907 2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 08 02:41:41.798995 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:41:41.798924 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7481ac35-8d64-4777-8985-384f3cf98fda-insights-runtime-extractor-tls podName:7481ac35-8d64-4777-8985-384f3cf98fda nodeName:}" failed. No retries permitted until 2026-09-08 02:41:43.798907732 +0000 UTC m=+68.233881423 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7481ac35-8d64-4777-8985-384f3cf98fda-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9srg4" (UID: "7481ac35-8d64-4777-8985-384f3cf98fda") : secret "insights-runtime-extractor-tls" not found Sep 08 02:41:41.798995 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:41:41.798946 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7481ac35-8d64-4777-8985-384f3cf98fda-kube-rbac-proxy-cm podName:7481ac35-8d64-4777-8985-384f3cf98fda nodeName:}" failed. No retries permitted until 2026-09-08 02:41:43.798937019 +0000 UTC m=+68.233910687 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7481ac35-8d64-4777-8985-384f3cf98fda-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9srg4" (UID: "7481ac35-8d64-4777-8985-384f3cf98fda") : configmap "kube-rbac-proxy" not found Sep 08 02:41:41.801041 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:41.801025 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 08 02:41:41.806773 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:41.806754 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wffkq\" (UniqueName: \"kubernetes.io/projected/de8e8fb0-069d-4b2c-a74e-082cea9d33aa-kube-api-access-wffkq\") pod \"migrator-fdbb8fdff-vjkwf\" (UID: \"de8e8fb0-069d-4b2c-a74e-082cea9d33aa\") " pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-vjkwf" Sep 08 02:41:41.811016 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:41.810990 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ce406489-045e-4ba5-baa6-337a983d5466-original-pull-secret\") pod \"global-pull-secret-syncer-s6jbs\" (UID: \"ce406489-045e-4ba5-baa6-337a983d5466\") " pod="kube-system/global-pull-secret-syncer-s6jbs" Sep 08 02:41:41.837546 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:41.837514 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-2667g_50d2c5c2-28aa-4ce1-9ad9-50b2493d3129/dns-node-resolver/0.log" Sep 08 02:41:41.899718 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:41.899618 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e0a56211-24ee-40c8-be53-d5e518a5342b-metrics-certs\") pod \"network-metrics-daemon-ckt96\" (UID: \"e0a56211-24ee-40c8-be53-d5e518a5342b\") " pod="openshift-multus/network-metrics-daemon-ckt96" Sep 08 02:41:41.899718 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:41.899692 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6rtt\" (UniqueName: \"kubernetes.io/projected/f47c576f-2537-4625-be1f-fb82cbb3694e-kube-api-access-p6rtt\") pod \"network-check-target-s7mcq\" (UID: \"f47c576f-2537-4625-be1f-fb82cbb3694e\") " pod="openshift-network-diagnostics/network-check-target-s7mcq" Sep 08 02:41:41.902104 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:41.902084 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 08 02:41:41.902211 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:41.902192 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 08 02:41:41.910061 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:41:41.910039 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 08 02:41:41.910126 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:41:41.910113 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0a56211-24ee-40c8-be53-d5e518a5342b-metrics-certs podName:e0a56211-24ee-40c8-be53-d5e518a5342b nodeName:}" failed. No retries permitted until 2026-09-08 02:42:45.910090002 +0000 UTC m=+130.345063684 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e0a56211-24ee-40c8-be53-d5e518a5342b-metrics-certs") pod "network-metrics-daemon-ckt96" (UID: "e0a56211-24ee-40c8-be53-d5e518a5342b") : secret "metrics-daemon-secret" not found Sep 08 02:41:41.911804 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:41.911786 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 08 02:41:41.919125 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:41.919109 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-vjkwf" Sep 08 02:41:41.922806 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:41.922780 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p6rtt\" (UniqueName: \"kubernetes.io/projected/f47c576f-2537-4625-be1f-fb82cbb3694e-kube-api-access-p6rtt\") pod \"network-check-target-s7mcq\" (UID: \"f47c576f-2537-4625-be1f-fb82cbb3694e\") " pod="openshift-network-diagnostics/network-check-target-s7mcq" Sep 08 02:41:42.011023 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:42.010990 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s6jbs" Sep 08 02:41:42.017777 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:42.017722 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-jvzd6\"" Sep 08 02:41:42.025669 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:42.025647 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s7mcq" Sep 08 02:41:42.183713 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:42.183609 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-fdbb8fdff-vjkwf"] Sep 08 02:41:42.186940 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:41:42.186915 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde8e8fb0_069d_4b2c_a74e_082cea9d33aa.slice/crio-5a664aab523a694c71c24298b5f2682c36852f6aca7f231ea625df8130b56980 WatchSource:0}: Error finding container 5a664aab523a694c71c24298b5f2682c36852f6aca7f231ea625df8130b56980: Status 404 returned error can't find the container with id 5a664aab523a694c71c24298b5f2682c36852f6aca7f231ea625df8130b56980 Sep 08 02:41:42.279491 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:42.279459 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-s6jbs"] Sep 08 02:41:42.283232 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:41:42.283205 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce406489_045e_4ba5_baa6_337a983d5466.slice/crio-1133718c009590736db73fdf2f99a8e7b0309390964a085750fb33e4578a723b WatchSource:0}: Error finding container 1133718c009590736db73fdf2f99a8e7b0309390964a085750fb33e4578a723b: Status 404 returned error can't find the container with id 1133718c009590736db73fdf2f99a8e7b0309390964a085750fb33e4578a723b Sep 08 02:41:42.297994 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:42.297830 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-s7mcq"] Sep 08 02:41:42.300280 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:41:42.300255 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf47c576f_2537_4625_be1f_fb82cbb3694e.slice/crio-43e282635220f0ac7b0e4f58b0b26008f72b671ab5c54dc94a14b8325c649e93 WatchSource:0}: Error finding container 43e282635220f0ac7b0e4f58b0b26008f72b671ab5c54dc94a14b8325c649e93: Status 404 returned error can't find the container with id 43e282635220f0ac7b0e4f58b0b26008f72b671ab5c54dc94a14b8325c649e93 Sep 08 02:41:42.378145 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:42.378099 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-s7mcq" event={"ID":"f47c576f-2537-4625-be1f-fb82cbb3694e","Type":"ContainerStarted","Data":"43e282635220f0ac7b0e4f58b0b26008f72b671ab5c54dc94a14b8325c649e93"} Sep 08 02:41:42.379234 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:42.379209 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-s6jbs" event={"ID":"ce406489-045e-4ba5-baa6-337a983d5466","Type":"ContainerStarted","Data":"1133718c009590736db73fdf2f99a8e7b0309390964a085750fb33e4578a723b"} Sep 08 02:41:42.380189 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:42.380170 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-vjkwf" event={"ID":"de8e8fb0-069d-4b2c-a74e-082cea9d33aa","Type":"ContainerStarted","Data":"5a664aab523a694c71c24298b5f2682c36852f6aca7f231ea625df8130b56980"} Sep 08 02:41:43.237703 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:43.237668 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-njl2b_ba1b8aaf-174d-4dbb-b7a2-af66170d03b0/node-ca/0.log" Sep 08 02:41:43.708734 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:43.708633 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-75d99c484-nls5p"] Sep 08 02:41:43.711597 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:43.711566 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-75d99c484-nls5p" Sep 08 02:41:43.714146 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:43.714123 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-n252v\"" Sep 08 02:41:43.714615 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:43.714432 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Sep 08 02:41:43.715515 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:43.715126 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Sep 08 02:41:43.715515 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:43.715371 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Sep 08 02:41:43.715515 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:43.715456 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Sep 08 02:41:43.719052 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:43.718979 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-75d99c484-nls5p"] Sep 08 02:41:43.814646 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:43.814610 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/7a48575c-1a63-4521-80db-3e982c93a5b6-signing-key\") pod \"service-ca-75d99c484-nls5p\" (UID: \"7a48575c-1a63-4521-80db-3e982c93a5b6\") " pod="openshift-service-ca/service-ca-75d99c484-nls5p" Sep 08 02:41:43.814777 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:43.814709 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7481ac35-8d64-4777-8985-384f3cf98fda-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9srg4\" (UID: \"7481ac35-8d64-4777-8985-384f3cf98fda\") " pod="openshift-insights/insights-runtime-extractor-9srg4" Sep 08 02:41:43.814777 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:43.814757 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/7a48575c-1a63-4521-80db-3e982c93a5b6-signing-cabundle\") pod \"service-ca-75d99c484-nls5p\" (UID: \"7a48575c-1a63-4521-80db-3e982c93a5b6\") " pod="openshift-service-ca/service-ca-75d99c484-nls5p" Sep 08 02:41:43.814893 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:41:43.814777 2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 08 02:41:43.814893 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:43.814836 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7481ac35-8d64-4777-8985-384f3cf98fda-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9srg4\" (UID: \"7481ac35-8d64-4777-8985-384f3cf98fda\") " pod="openshift-insights/insights-runtime-extractor-9srg4" Sep 08 02:41:43.814893 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:43.814881 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zg2l9\" (UniqueName: \"kubernetes.io/projected/7a48575c-1a63-4521-80db-3e982c93a5b6-kube-api-access-zg2l9\") pod \"service-ca-75d99c484-nls5p\" (UID: \"7a48575c-1a63-4521-80db-3e982c93a5b6\") " pod="openshift-service-ca/service-ca-75d99c484-nls5p" Sep 08 02:41:43.815075 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:41:43.815052 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 08 02:41:43.815180 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:41:43.815101 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7481ac35-8d64-4777-8985-384f3cf98fda-kube-rbac-proxy-cm podName:7481ac35-8d64-4777-8985-384f3cf98fda nodeName:}" failed. No retries permitted until 2026-09-08 02:41:47.815060863 +0000 UTC m=+72.250034546 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7481ac35-8d64-4777-8985-384f3cf98fda-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9srg4" (UID: "7481ac35-8d64-4777-8985-384f3cf98fda") : configmap "kube-rbac-proxy" not found Sep 08 02:41:43.815257 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:41:43.815205 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7481ac35-8d64-4777-8985-384f3cf98fda-insights-runtime-extractor-tls podName:7481ac35-8d64-4777-8985-384f3cf98fda nodeName:}" failed. No retries permitted until 2026-09-08 02:41:47.815181415 +0000 UTC m=+72.250155097 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7481ac35-8d64-4777-8985-384f3cf98fda-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9srg4" (UID: "7481ac35-8d64-4777-8985-384f3cf98fda") : secret "insights-runtime-extractor-tls" not found Sep 08 02:41:43.916149 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:43.915546 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/7a48575c-1a63-4521-80db-3e982c93a5b6-signing-cabundle\") pod \"service-ca-75d99c484-nls5p\" (UID: \"7a48575c-1a63-4521-80db-3e982c93a5b6\") " pod="openshift-service-ca/service-ca-75d99c484-nls5p" Sep 08 02:41:43.916149 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:43.915649 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zg2l9\" (UniqueName: \"kubernetes.io/projected/7a48575c-1a63-4521-80db-3e982c93a5b6-kube-api-access-zg2l9\") pod \"service-ca-75d99c484-nls5p\" (UID: \"7a48575c-1a63-4521-80db-3e982c93a5b6\") " pod="openshift-service-ca/service-ca-75d99c484-nls5p" Sep 08 02:41:43.916149 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:43.915717 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/7a48575c-1a63-4521-80db-3e982c93a5b6-signing-key\") pod \"service-ca-75d99c484-nls5p\" (UID: \"7a48575c-1a63-4521-80db-3e982c93a5b6\") " pod="openshift-service-ca/service-ca-75d99c484-nls5p" Sep 08 02:41:43.916927 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:43.916865 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/7a48575c-1a63-4521-80db-3e982c93a5b6-signing-cabundle\") pod \"service-ca-75d99c484-nls5p\" (UID: \"7a48575c-1a63-4521-80db-3e982c93a5b6\") " pod="openshift-service-ca/service-ca-75d99c484-nls5p" Sep 08 02:41:43.918975 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:43.918951 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/7a48575c-1a63-4521-80db-3e982c93a5b6-signing-key\") pod \"service-ca-75d99c484-nls5p\" (UID: \"7a48575c-1a63-4521-80db-3e982c93a5b6\") " pod="openshift-service-ca/service-ca-75d99c484-nls5p" Sep 08 02:41:43.924718 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:43.924697 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zg2l9\" (UniqueName: \"kubernetes.io/projected/7a48575c-1a63-4521-80db-3e982c93a5b6-kube-api-access-zg2l9\") pod \"service-ca-75d99c484-nls5p\" (UID: \"7a48575c-1a63-4521-80db-3e982c93a5b6\") " pod="openshift-service-ca/service-ca-75d99c484-nls5p" Sep 08 02:41:44.025313 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:44.025276 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-75d99c484-nls5p" Sep 08 02:41:44.038108 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:44.038081 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-zkxnl_829fed37-98de-4e8c-be35-d3e13ea6bc3b/serve-healthcheck-canary/0.log" Sep 08 02:41:44.317740 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:44.317661 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-75d99c484-nls5p"] Sep 08 02:41:44.390848 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:44.390804 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-vjkwf" event={"ID":"de8e8fb0-069d-4b2c-a74e-082cea9d33aa","Type":"ContainerStarted","Data":"0a23f165ac2f4eedfe8da55b032bbceb7784339f56da4cdae068c1d1b2217376"} Sep 08 02:41:44.391014 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:44.390871 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-vjkwf" event={"ID":"de8e8fb0-069d-4b2c-a74e-082cea9d33aa","Type":"ContainerStarted","Data":"d296b078685e03c20c4371e986c990436a0d35987741f6165c132861bb47a901"} Sep 08 02:41:44.408568 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:44.408516 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-vjkwf" podStartSLOduration=1.7957216900000001 podStartE2EDuration="3.408500591s" totalImagesPullingTime="1.612778901s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 02:41:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 02:41:44.407488444 +0000 UTC m=+68.842462134" watchObservedRunningTime="2026-09-08 02:41:44.408500591 +0000 UTC m=+68.843474281" Sep 08 02:41:45.233314 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:41:45.233283 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a48575c_1a63_4521_80db_3e982c93a5b6.slice/crio-feae0d653275edc9739cbfe51439fe862eb6e5be0461bf56a45e9049472a9c02 WatchSource:0}: Error finding container feae0d653275edc9739cbfe51439fe862eb6e5be0461bf56a45e9049472a9c02: Status 404 returned error can't find the container with id feae0d653275edc9739cbfe51439fe862eb6e5be0461bf56a45e9049472a9c02 Sep 08 02:41:45.395049 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:45.395009 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-75d99c484-nls5p" event={"ID":"7a48575c-1a63-4521-80db-3e982c93a5b6","Type":"ContainerStarted","Data":"feae0d653275edc9739cbfe51439fe862eb6e5be0461bf56a45e9049472a9c02"} Sep 08 02:41:47.405478 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:47.405436 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-s7mcq" event={"ID":"f47c576f-2537-4625-be1f-fb82cbb3694e","Type":"ContainerStarted","Data":"f658906072ab848d8e6543e16adbc7794f6c78cc311bcc030f53dd455c3ef73e"} Sep 08 02:41:47.406258 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:47.405610 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-s7mcq" Sep 08 02:41:47.407288 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:47.407261 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-s6jbs" event={"ID":"ce406489-045e-4ba5-baa6-337a983d5466","Type":"ContainerStarted","Data":"4087f1873985ecb02e02c0b1754a97784b6765fe62ede566581ae74ff5ec2b6d"} Sep 08 02:41:47.420716 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:47.420669 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-s7mcq" podStartSLOduration=67.063001166 podStartE2EDuration="1m11.420650458s" totalImagesPullingTime="4.357649292s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 02:40:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 02:41:47.419073599 +0000 UTC m=+71.854047282" watchObservedRunningTime="2026-09-08 02:41:47.420650458 +0000 UTC m=+71.855624142" Sep 08 02:41:47.437094 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:47.437040 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-s6jbs" podStartSLOduration=67.057889239 podStartE2EDuration="1m11.437025757s" totalImagesPullingTime="4.379136518s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 02:40:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 02:41:47.436287892 +0000 UTC m=+71.871261585" watchObservedRunningTime="2026-09-08 02:41:47.437025757 +0000 UTC m=+71.871999447" Sep 08 02:41:47.846154 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:47.846118 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7481ac35-8d64-4777-8985-384f3cf98fda-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9srg4\" (UID: \"7481ac35-8d64-4777-8985-384f3cf98fda\") " pod="openshift-insights/insights-runtime-extractor-9srg4" Sep 08 02:41:47.846340 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:41:47.846252 2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 08 02:41:47.846340 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:47.846271 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7481ac35-8d64-4777-8985-384f3cf98fda-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9srg4\" (UID: \"7481ac35-8d64-4777-8985-384f3cf98fda\") " pod="openshift-insights/insights-runtime-extractor-9srg4" Sep 08 02:41:47.846340 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:41:47.846315 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7481ac35-8d64-4777-8985-384f3cf98fda-kube-rbac-proxy-cm podName:7481ac35-8d64-4777-8985-384f3cf98fda nodeName:}" failed. No retries permitted until 2026-09-08 02:41:55.846298613 +0000 UTC m=+80.281272303 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7481ac35-8d64-4777-8985-384f3cf98fda-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9srg4" (UID: "7481ac35-8d64-4777-8985-384f3cf98fda") : configmap "kube-rbac-proxy" not found Sep 08 02:41:47.846520 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:41:47.846416 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 08 02:41:47.846520 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:41:47.846459 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7481ac35-8d64-4777-8985-384f3cf98fda-insights-runtime-extractor-tls podName:7481ac35-8d64-4777-8985-384f3cf98fda nodeName:}" failed. No retries permitted until 2026-09-08 02:41:55.846446875 +0000 UTC m=+80.281420542 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7481ac35-8d64-4777-8985-384f3cf98fda-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9srg4" (UID: "7481ac35-8d64-4777-8985-384f3cf98fda") : secret "insights-runtime-extractor-tls" not found Sep 08 02:41:48.412110 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:48.412008 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-75d99c484-nls5p" event={"ID":"7a48575c-1a63-4521-80db-3e982c93a5b6","Type":"ContainerStarted","Data":"79aeed044e830e8482731571401676be0ec41efe58da88dd15e858c6a18bad3f"} Sep 08 02:41:48.426115 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:48.426063 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-75d99c484-nls5p" podStartSLOduration=2.603509492 podStartE2EDuration="5.426047235s" totalImagesPullingTime="2.822537743s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 02:41:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 02:41:48.424857723 +0000 UTC m=+72.859831414" watchObservedRunningTime="2026-09-08 02:41:48.426047235 +0000 UTC m=+72.861020924" Sep 08 02:41:55.913668 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:55.913627 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7481ac35-8d64-4777-8985-384f3cf98fda-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9srg4\" (UID: \"7481ac35-8d64-4777-8985-384f3cf98fda\") " pod="openshift-insights/insights-runtime-extractor-9srg4" Sep 08 02:41:55.914251 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:55.913731 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7481ac35-8d64-4777-8985-384f3cf98fda-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9srg4\" (UID: \"7481ac35-8d64-4777-8985-384f3cf98fda\") " pod="openshift-insights/insights-runtime-extractor-9srg4" Sep 08 02:41:55.914251 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:41:55.913802 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 08 02:41:55.914251 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:41:55.913880 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7481ac35-8d64-4777-8985-384f3cf98fda-insights-runtime-extractor-tls podName:7481ac35-8d64-4777-8985-384f3cf98fda nodeName:}" failed. No retries permitted until 2026-09-08 02:42:11.913865159 +0000 UTC m=+96.348838827 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7481ac35-8d64-4777-8985-384f3cf98fda-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9srg4" (UID: "7481ac35-8d64-4777-8985-384f3cf98fda") : secret "insights-runtime-extractor-tls" not found Sep 08 02:41:55.914466 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:41:55.914418 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7481ac35-8d64-4777-8985-384f3cf98fda-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9srg4\" (UID: \"7481ac35-8d64-4777-8985-384f3cf98fda\") " pod="openshift-insights/insights-runtime-extractor-9srg4" Sep 08 02:42:03.579116 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:03.579003 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6f9bdc445d-wtdf7"] Sep 08 02:42:03.582075 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:03.582056 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6f9bdc445d-wtdf7" Sep 08 02:42:03.585525 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:03.585501 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Sep 08 02:42:03.586473 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:03.586453 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Sep 08 02:42:03.586600 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:03.586473 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Sep 08 02:42:03.586600 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:03.586515 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-7mkgn\"" Sep 08 02:42:03.586600 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:03.586572 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Sep 08 02:42:03.594526 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:03.594498 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6f9bdc445d-wtdf7"] Sep 08 02:42:03.674877 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:03.674841 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c4dd9cc0-5d83-4820-bb73-55da3b00522b-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6f9bdc445d-wtdf7\" (UID: \"c4dd9cc0-5d83-4820-bb73-55da3b00522b\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6f9bdc445d-wtdf7" Sep 08 02:42:03.675065 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:03.674930 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hrf6j\" (UniqueName: \"kubernetes.io/projected/c4dd9cc0-5d83-4820-bb73-55da3b00522b-kube-api-access-hrf6j\") pod \"managed-serviceaccount-addon-agent-6f9bdc445d-wtdf7\" (UID: \"c4dd9cc0-5d83-4820-bb73-55da3b00522b\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6f9bdc445d-wtdf7" Sep 08 02:42:03.681665 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:03.681634 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-85d98c998f-lw2t4"] Sep 08 02:42:03.684549 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:03.684534 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-85d98c998f-lw2t4" Sep 08 02:42:03.686763 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:03.686742 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Sep 08 02:42:03.686884 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:03.686769 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-72p52\"" Sep 08 02:42:03.686884 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:03.686807 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Sep 08 02:42:03.694999 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:03.694978 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-85d98c998f-lw2t4"] Sep 08 02:42:03.776228 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:03.776189 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c4dd9cc0-5d83-4820-bb73-55da3b00522b-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6f9bdc445d-wtdf7\" (UID: \"c4dd9cc0-5d83-4820-bb73-55da3b00522b\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6f9bdc445d-wtdf7" Sep 08 02:42:03.776446 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:03.776264 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrf6j\" (UniqueName: \"kubernetes.io/projected/c4dd9cc0-5d83-4820-bb73-55da3b00522b-kube-api-access-hrf6j\") pod \"managed-serviceaccount-addon-agent-6f9bdc445d-wtdf7\" (UID: \"c4dd9cc0-5d83-4820-bb73-55da3b00522b\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6f9bdc445d-wtdf7" Sep 08 02:42:03.776446 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:03.776298 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hq5cz\" (UniqueName: \"kubernetes.io/projected/5ae7a553-d702-4b33-a05e-8afa348133fa-kube-api-access-hq5cz\") pod \"downloads-85d98c998f-lw2t4\" (UID: \"5ae7a553-d702-4b33-a05e-8afa348133fa\") " pod="openshift-console/downloads-85d98c998f-lw2t4" Sep 08 02:42:03.779229 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:03.779205 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c4dd9cc0-5d83-4820-bb73-55da3b00522b-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6f9bdc445d-wtdf7\" (UID: \"c4dd9cc0-5d83-4820-bb73-55da3b00522b\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6f9bdc445d-wtdf7" Sep 08 02:42:03.788281 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:03.788248 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hrf6j\" (UniqueName: \"kubernetes.io/projected/c4dd9cc0-5d83-4820-bb73-55da3b00522b-kube-api-access-hrf6j\") pod \"managed-serviceaccount-addon-agent-6f9bdc445d-wtdf7\" (UID: \"c4dd9cc0-5d83-4820-bb73-55da3b00522b\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6f9bdc445d-wtdf7" Sep 08 02:42:03.877488 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:03.877392 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hq5cz\" (UniqueName: \"kubernetes.io/projected/5ae7a553-d702-4b33-a05e-8afa348133fa-kube-api-access-hq5cz\") pod \"downloads-85d98c998f-lw2t4\" (UID: \"5ae7a553-d702-4b33-a05e-8afa348133fa\") " pod="openshift-console/downloads-85d98c998f-lw2t4" Sep 08 02:42:03.885326 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:03.885293 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hq5cz\" (UniqueName: \"kubernetes.io/projected/5ae7a553-d702-4b33-a05e-8afa348133fa-kube-api-access-hq5cz\") pod \"downloads-85d98c998f-lw2t4\" (UID: \"5ae7a553-d702-4b33-a05e-8afa348133fa\") " pod="openshift-console/downloads-85d98c998f-lw2t4" Sep 08 02:42:03.904115 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:03.904087 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6f9bdc445d-wtdf7" Sep 08 02:42:03.992950 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:03.992916 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-85d98c998f-lw2t4" Sep 08 02:42:04.176552 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:04.176471 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6f9bdc445d-wtdf7"] Sep 08 02:42:04.179396 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:42:04.179345 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc4dd9cc0_5d83_4820_bb73_55da3b00522b.slice/crio-9582b9b8cfbfab4118fc103adf9d5836a58060f471bcab21d53fe92439728258 WatchSource:0}: Error finding container 9582b9b8cfbfab4118fc103adf9d5836a58060f471bcab21d53fe92439728258: Status 404 returned error can't find the container with id 9582b9b8cfbfab4118fc103adf9d5836a58060f471bcab21d53fe92439728258 Sep 08 02:42:04.278717 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:04.278683 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-85d98c998f-lw2t4"] Sep 08 02:42:04.282488 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:42:04.282460 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ae7a553_d702_4b33_a05e_8afa348133fa.slice/crio-2767462a71d5e3e3f0fe0f9aecc79db6d13e4a06291baff4d67019a792303856 WatchSource:0}: Error finding container 2767462a71d5e3e3f0fe0f9aecc79db6d13e4a06291baff4d67019a792303856: Status 404 returned error can't find the container with id 2767462a71d5e3e3f0fe0f9aecc79db6d13e4a06291baff4d67019a792303856 Sep 08 02:42:04.459998 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:04.459964 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-85d98c998f-lw2t4" event={"ID":"5ae7a553-d702-4b33-a05e-8afa348133fa","Type":"ContainerStarted","Data":"2767462a71d5e3e3f0fe0f9aecc79db6d13e4a06291baff4d67019a792303856"} Sep 08 02:42:04.461066 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:04.461043 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6f9bdc445d-wtdf7" event={"ID":"c4dd9cc0-5d83-4820-bb73-55da3b00522b","Type":"ContainerStarted","Data":"9582b9b8cfbfab4118fc103adf9d5836a58060f471bcab21d53fe92439728258"} Sep 08 02:42:07.478980 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:07.478941 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6f9bdc445d-wtdf7" event={"ID":"c4dd9cc0-5d83-4820-bb73-55da3b00522b","Type":"ContainerStarted","Data":"1f6eef6aab1be2da7c32788142f37cc8cc8b16d33c843605e68737577bfd253c"} Sep 08 02:42:07.495158 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:07.495106 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6f9bdc445d-wtdf7" podStartSLOduration=2.101405916 podStartE2EDuration="4.4950907s" totalImagesPullingTime="2.393684784s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 02:42:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 02:42:07.493729581 +0000 UTC m=+91.928703286" watchObservedRunningTime="2026-09-08 02:42:07.4950907 +0000 UTC m=+91.930064390" Sep 08 02:42:11.132977 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:11.132943 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-dpr4j"] Sep 08 02:42:11.140104 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:11.140064 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-dpr4j" Sep 08 02:42:11.142521 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:11.142495 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Sep 08 02:42:11.142646 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:11.142556 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-h6qxz\"" Sep 08 02:42:11.145869 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:11.145834 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-dpr4j"] Sep 08 02:42:11.237410 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:11.237373 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/1564024f-3314-452e-818c-76a24b230709-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-dpr4j\" (UID: \"1564024f-3314-452e-818c-76a24b230709\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-dpr4j" Sep 08 02:42:11.337819 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:11.337780 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/1564024f-3314-452e-818c-76a24b230709-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-dpr4j\" (UID: \"1564024f-3314-452e-818c-76a24b230709\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-dpr4j" Sep 08 02:42:11.337996 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:42:11.337946 2564 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Sep 08 02:42:11.338054 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:42:11.338011 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1564024f-3314-452e-818c-76a24b230709-tls-certificates podName:1564024f-3314-452e-818c-76a24b230709 nodeName:}" failed. No retries permitted until 2026-09-08 02:42:11.837989067 +0000 UTC m=+96.272962738 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/1564024f-3314-452e-818c-76a24b230709-tls-certificates") pod "prometheus-operator-admission-webhook-78f599db79-dpr4j" (UID: "1564024f-3314-452e-818c-76a24b230709") : secret "prometheus-operator-admission-webhook-tls" not found Sep 08 02:42:11.843025 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:11.842985 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/1564024f-3314-452e-818c-76a24b230709-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-dpr4j\" (UID: \"1564024f-3314-452e-818c-76a24b230709\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-dpr4j" Sep 08 02:42:11.845911 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:11.845880 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/1564024f-3314-452e-818c-76a24b230709-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-dpr4j\" (UID: \"1564024f-3314-452e-818c-76a24b230709\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-dpr4j" Sep 08 02:42:11.944446 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:11.944407 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7481ac35-8d64-4777-8985-384f3cf98fda-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9srg4\" (UID: \"7481ac35-8d64-4777-8985-384f3cf98fda\") " pod="openshift-insights/insights-runtime-extractor-9srg4" Sep 08 02:42:11.946967 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:11.946936 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7481ac35-8d64-4777-8985-384f3cf98fda-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9srg4\" (UID: \"7481ac35-8d64-4777-8985-384f3cf98fda\") " pod="openshift-insights/insights-runtime-extractor-9srg4" Sep 08 02:42:12.052086 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:12.052048 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-dpr4j" Sep 08 02:42:12.223278 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:12.223240 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-9srg4" Sep 08 02:42:12.325866 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:12.325833 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-dpr4j"] Sep 08 02:42:12.329052 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:42:12.329016 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1564024f_3314_452e_818c_76a24b230709.slice/crio-9036a2b48f5b01c833971ad08ba86aaed4069e34f935db52ee755128952c1f49 WatchSource:0}: Error finding container 9036a2b48f5b01c833971ad08ba86aaed4069e34f935db52ee755128952c1f49: Status 404 returned error can't find the container with id 9036a2b48f5b01c833971ad08ba86aaed4069e34f935db52ee755128952c1f49 Sep 08 02:42:12.499609 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:12.499559 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-dpr4j" event={"ID":"1564024f-3314-452e-818c-76a24b230709","Type":"ContainerStarted","Data":"9036a2b48f5b01c833971ad08ba86aaed4069e34f935db52ee755128952c1f49"} Sep 08 02:42:12.501306 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:12.501275 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-9srg4"] Sep 08 02:42:12.504526 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:42:12.504493 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7481ac35_8d64_4777_8985_384f3cf98fda.slice/crio-97eee6cbc899839be52d0a6e796cccce4b2ed7cd58f289e08b0b49c2b5f24c47 WatchSource:0}: Error finding container 97eee6cbc899839be52d0a6e796cccce4b2ed7cd58f289e08b0b49c2b5f24c47: Status 404 returned error can't find the container with id 97eee6cbc899839be52d0a6e796cccce4b2ed7cd58f289e08b0b49c2b5f24c47 Sep 08 02:42:13.505158 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:13.505124 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9srg4" event={"ID":"7481ac35-8d64-4777-8985-384f3cf98fda","Type":"ContainerStarted","Data":"71e5d38fa4417196b5381762af1ce7ec40c79ce50c186d61e63ada6c4f531113"} Sep 08 02:42:13.505632 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:13.505182 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9srg4" event={"ID":"7481ac35-8d64-4777-8985-384f3cf98fda","Type":"ContainerStarted","Data":"97eee6cbc899839be52d0a6e796cccce4b2ed7cd58f289e08b0b49c2b5f24c47"} Sep 08 02:42:13.862519 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:13.862440 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c3751a7d-8eae-4e66-a492-b676988ca6ec-registry-tls\") pod \"image-registry-65c9b7fd44-s9n6g\" (UID: \"c3751a7d-8eae-4e66-a492-b676988ca6ec\") " pod="openshift-image-registry/image-registry-65c9b7fd44-s9n6g" Sep 08 02:42:13.862519 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:13.862510 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/635bc747-a5b6-4c49-aa00-fab4bef8f003-metrics-tls\") pod \"dns-default-h62hl\" (UID: \"635bc747-a5b6-4c49-aa00-fab4bef8f003\") " pod="openshift-dns/dns-default-h62hl" Sep 08 02:42:13.865159 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:13.865129 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/635bc747-a5b6-4c49-aa00-fab4bef8f003-metrics-tls\") pod \"dns-default-h62hl\" (UID: \"635bc747-a5b6-4c49-aa00-fab4bef8f003\") " pod="openshift-dns/dns-default-h62hl" Sep 08 02:42:13.865480 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:13.865453 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c3751a7d-8eae-4e66-a492-b676988ca6ec-registry-tls\") pod \"image-registry-65c9b7fd44-s9n6g\" (UID: \"c3751a7d-8eae-4e66-a492-b676988ca6ec\") " pod="openshift-image-registry/image-registry-65c9b7fd44-s9n6g" Sep 08 02:42:14.135091 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:14.135008 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-nt5df\"" Sep 08 02:42:14.143041 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:14.143013 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-65c9b7fd44-s9n6g" Sep 08 02:42:14.150490 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:14.150470 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-j9gxl\"" Sep 08 02:42:14.158433 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:14.158401 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-h62hl" Sep 08 02:42:14.510914 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:14.510877 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-dpr4j" event={"ID":"1564024f-3314-452e-818c-76a24b230709","Type":"ContainerStarted","Data":"e6570c382aeb172ddda919c833989832df72841fff1a8f275c6469c21209131e"} Sep 08 02:42:14.511399 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:14.510987 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-dpr4j" Sep 08 02:42:14.513230 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:14.513193 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9srg4" event={"ID":"7481ac35-8d64-4777-8985-384f3cf98fda","Type":"ContainerStarted","Data":"24f36f25bd7417e67121aff173ecd897cfaadac784a02b0453ceeaca1b651199"} Sep 08 02:42:14.516780 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:14.516736 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-dpr4j" Sep 08 02:42:14.524786 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:14.524728 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-dpr4j" podStartSLOduration=2.332720039 podStartE2EDuration="3.524709716s" totalImagesPullingTime="1.191989677s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 02:42:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 02:42:14.523930104 +0000 UTC m=+98.958903794" watchObservedRunningTime="2026-09-08 02:42:14.524709716 +0000 UTC m=+98.959683535" Sep 08 02:42:18.414984 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:18.414949 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-s7mcq" Sep 08 02:42:20.525790 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:20.525750 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-rpnbl"] Sep 08 02:42:20.541763 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:20.541731 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-rpnbl" Sep 08 02:42:20.546615 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:20.546055 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Sep 08 02:42:20.546615 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:20.546280 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 08 02:42:20.546615 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:20.546484 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-lc2ks\"" Sep 08 02:42:20.548065 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:20.546724 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-rpnbl"] Sep 08 02:42:20.548065 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:20.547165 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 08 02:42:20.548065 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:20.547389 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 08 02:42:20.548065 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:20.547578 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Sep 08 02:42:20.558813 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:20.558123 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-jbz4j"] Sep 08 02:42:20.578824 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:20.578377 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-jbz4j" Sep 08 02:42:20.583428 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:20.581502 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 08 02:42:20.583428 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:20.581830 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 08 02:42:20.583428 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:20.582015 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-ltrns\"" Sep 08 02:42:20.583428 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:20.582208 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 08 02:42:20.620516 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:20.620473 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d527f051-5bdd-47ee-98f6-e4a6116d832e-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-rpnbl\" (UID: \"d527f051-5bdd-47ee-98f6-e4a6116d832e\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-rpnbl" Sep 08 02:42:20.620655 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:20.620569 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d527f051-5bdd-47ee-98f6-e4a6116d832e-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-rpnbl\" (UID: \"d527f051-5bdd-47ee-98f6-e4a6116d832e\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-rpnbl" Sep 08 02:42:20.620655 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:20.620647 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d527f051-5bdd-47ee-98f6-e4a6116d832e-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-rpnbl\" (UID: \"d527f051-5bdd-47ee-98f6-e4a6116d832e\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-rpnbl" Sep 08 02:42:20.620759 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:20.620686 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9p6mg\" (UniqueName: \"kubernetes.io/projected/d527f051-5bdd-47ee-98f6-e4a6116d832e-kube-api-access-9p6mg\") pod \"openshift-state-metrics-657fd6c54-rpnbl\" (UID: \"d527f051-5bdd-47ee-98f6-e4a6116d832e\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-rpnbl" Sep 08 02:42:20.721254 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:20.721209 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d527f051-5bdd-47ee-98f6-e4a6116d832e-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-rpnbl\" (UID: \"d527f051-5bdd-47ee-98f6-e4a6116d832e\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-rpnbl" Sep 08 02:42:20.721467 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:20.721267 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/95b583ca-8a12-442b-b8b6-0cf2d7b39bee-metrics-client-ca\") pod \"node-exporter-jbz4j\" (UID: \"95b583ca-8a12-442b-b8b6-0cf2d7b39bee\") " pod="openshift-monitoring/node-exporter-jbz4j" Sep 08 02:42:20.721467 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:20.721300 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/95b583ca-8a12-442b-b8b6-0cf2d7b39bee-node-exporter-accelerators-collector-config\") pod \"node-exporter-jbz4j\" (UID: \"95b583ca-8a12-442b-b8b6-0cf2d7b39bee\") " pod="openshift-monitoring/node-exporter-jbz4j" Sep 08 02:42:20.721467 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:20.721328 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9p6mg\" (UniqueName: \"kubernetes.io/projected/d527f051-5bdd-47ee-98f6-e4a6116d832e-kube-api-access-9p6mg\") pod \"openshift-state-metrics-657fd6c54-rpnbl\" (UID: \"d527f051-5bdd-47ee-98f6-e4a6116d832e\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-rpnbl" Sep 08 02:42:20.721467 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:20.721375 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/95b583ca-8a12-442b-b8b6-0cf2d7b39bee-node-exporter-tls\") pod \"node-exporter-jbz4j\" (UID: \"95b583ca-8a12-442b-b8b6-0cf2d7b39bee\") " pod="openshift-monitoring/node-exporter-jbz4j" Sep 08 02:42:20.721673 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:20.721507 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c5b4h\" (UniqueName: \"kubernetes.io/projected/95b583ca-8a12-442b-b8b6-0cf2d7b39bee-kube-api-access-c5b4h\") pod \"node-exporter-jbz4j\" (UID: \"95b583ca-8a12-442b-b8b6-0cf2d7b39bee\") " pod="openshift-monitoring/node-exporter-jbz4j" Sep 08 02:42:20.721673 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:20.721558 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d527f051-5bdd-47ee-98f6-e4a6116d832e-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-rpnbl\" (UID: \"d527f051-5bdd-47ee-98f6-e4a6116d832e\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-rpnbl" Sep 08 02:42:20.721673 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:20.721592 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/95b583ca-8a12-442b-b8b6-0cf2d7b39bee-node-exporter-textfile\") pod \"node-exporter-jbz4j\" (UID: \"95b583ca-8a12-442b-b8b6-0cf2d7b39bee\") " pod="openshift-monitoring/node-exporter-jbz4j" Sep 08 02:42:20.721673 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:20.721624 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/95b583ca-8a12-442b-b8b6-0cf2d7b39bee-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jbz4j\" (UID: \"95b583ca-8a12-442b-b8b6-0cf2d7b39bee\") " pod="openshift-monitoring/node-exporter-jbz4j" Sep 08 02:42:20.721673 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:20.721653 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/95b583ca-8a12-442b-b8b6-0cf2d7b39bee-node-exporter-wtmp\") pod \"node-exporter-jbz4j\" (UID: \"95b583ca-8a12-442b-b8b6-0cf2d7b39bee\") " pod="openshift-monitoring/node-exporter-jbz4j" Sep 08 02:42:20.721917 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:20.721725 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/95b583ca-8a12-442b-b8b6-0cf2d7b39bee-sys\") pod \"node-exporter-jbz4j\" (UID: \"95b583ca-8a12-442b-b8b6-0cf2d7b39bee\") " pod="openshift-monitoring/node-exporter-jbz4j" Sep 08 02:42:20.721917 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:20.721749 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/95b583ca-8a12-442b-b8b6-0cf2d7b39bee-root\") pod \"node-exporter-jbz4j\" (UID: \"95b583ca-8a12-442b-b8b6-0cf2d7b39bee\") " pod="openshift-monitoring/node-exporter-jbz4j" Sep 08 02:42:20.721917 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:20.721848 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d527f051-5bdd-47ee-98f6-e4a6116d832e-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-rpnbl\" (UID: \"d527f051-5bdd-47ee-98f6-e4a6116d832e\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-rpnbl" Sep 08 02:42:20.722528 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:20.722506 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d527f051-5bdd-47ee-98f6-e4a6116d832e-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-rpnbl\" (UID: \"d527f051-5bdd-47ee-98f6-e4a6116d832e\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-rpnbl" Sep 08 02:42:20.723765 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:20.723742 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d527f051-5bdd-47ee-98f6-e4a6116d832e-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-rpnbl\" (UID: \"d527f051-5bdd-47ee-98f6-e4a6116d832e\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-rpnbl" Sep 08 02:42:20.724222 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:20.724202 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d527f051-5bdd-47ee-98f6-e4a6116d832e-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-rpnbl\" (UID: \"d527f051-5bdd-47ee-98f6-e4a6116d832e\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-rpnbl" Sep 08 02:42:20.729717 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:20.729687 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9p6mg\" (UniqueName: \"kubernetes.io/projected/d527f051-5bdd-47ee-98f6-e4a6116d832e-kube-api-access-9p6mg\") pod \"openshift-state-metrics-657fd6c54-rpnbl\" (UID: \"d527f051-5bdd-47ee-98f6-e4a6116d832e\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-rpnbl" Sep 08 02:42:20.823075 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:20.823044 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/95b583ca-8a12-442b-b8b6-0cf2d7b39bee-node-exporter-tls\") pod \"node-exporter-jbz4j\" (UID: \"95b583ca-8a12-442b-b8b6-0cf2d7b39bee\") " pod="openshift-monitoring/node-exporter-jbz4j" Sep 08 02:42:20.823177 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:20.823089 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c5b4h\" (UniqueName: \"kubernetes.io/projected/95b583ca-8a12-442b-b8b6-0cf2d7b39bee-kube-api-access-c5b4h\") pod \"node-exporter-jbz4j\" (UID: \"95b583ca-8a12-442b-b8b6-0cf2d7b39bee\") " pod="openshift-monitoring/node-exporter-jbz4j" Sep 08 02:42:20.823177 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:20.823118 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/95b583ca-8a12-442b-b8b6-0cf2d7b39bee-node-exporter-textfile\") pod \"node-exporter-jbz4j\" (UID: \"95b583ca-8a12-442b-b8b6-0cf2d7b39bee\") " pod="openshift-monitoring/node-exporter-jbz4j" Sep 08 02:42:20.823177 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:20.823147 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/95b583ca-8a12-442b-b8b6-0cf2d7b39bee-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jbz4j\" (UID: \"95b583ca-8a12-442b-b8b6-0cf2d7b39bee\") " pod="openshift-monitoring/node-exporter-jbz4j" Sep 08 02:42:20.823177 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:20.823171 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/95b583ca-8a12-442b-b8b6-0cf2d7b39bee-node-exporter-wtmp\") pod \"node-exporter-jbz4j\" (UID: \"95b583ca-8a12-442b-b8b6-0cf2d7b39bee\") " pod="openshift-monitoring/node-exporter-jbz4j" Sep 08 02:42:20.823413 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:20.823202 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/95b583ca-8a12-442b-b8b6-0cf2d7b39bee-sys\") pod \"node-exporter-jbz4j\" (UID: \"95b583ca-8a12-442b-b8b6-0cf2d7b39bee\") " pod="openshift-monitoring/node-exporter-jbz4j" Sep 08 02:42:20.823413 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:20.823222 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/95b583ca-8a12-442b-b8b6-0cf2d7b39bee-root\") pod \"node-exporter-jbz4j\" (UID: \"95b583ca-8a12-442b-b8b6-0cf2d7b39bee\") " pod="openshift-monitoring/node-exporter-jbz4j" Sep 08 02:42:20.823413 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:20.823309 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/95b583ca-8a12-442b-b8b6-0cf2d7b39bee-metrics-client-ca\") pod \"node-exporter-jbz4j\" (UID: \"95b583ca-8a12-442b-b8b6-0cf2d7b39bee\") " pod="openshift-monitoring/node-exporter-jbz4j" Sep 08 02:42:20.823413 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:20.823343 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/95b583ca-8a12-442b-b8b6-0cf2d7b39bee-node-exporter-accelerators-collector-config\") pod \"node-exporter-jbz4j\" (UID: \"95b583ca-8a12-442b-b8b6-0cf2d7b39bee\") " pod="openshift-monitoring/node-exporter-jbz4j" Sep 08 02:42:20.823800 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:42:20.823770 2564 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Sep 08 02:42:20.823914 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:42:20.823846 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95b583ca-8a12-442b-b8b6-0cf2d7b39bee-node-exporter-tls podName:95b583ca-8a12-442b-b8b6-0cf2d7b39bee nodeName:}" failed. No retries permitted until 2026-09-08 02:42:21.323826985 +0000 UTC m=+105.758800666 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/95b583ca-8a12-442b-b8b6-0cf2d7b39bee-node-exporter-tls") pod "node-exporter-jbz4j" (UID: "95b583ca-8a12-442b-b8b6-0cf2d7b39bee") : secret "node-exporter-tls" not found Sep 08 02:42:20.823994 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:20.823929 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/95b583ca-8a12-442b-b8b6-0cf2d7b39bee-node-exporter-accelerators-collector-config\") pod \"node-exporter-jbz4j\" (UID: \"95b583ca-8a12-442b-b8b6-0cf2d7b39bee\") " pod="openshift-monitoring/node-exporter-jbz4j" Sep 08 02:42:20.824051 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:20.824002 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/95b583ca-8a12-442b-b8b6-0cf2d7b39bee-sys\") pod \"node-exporter-jbz4j\" (UID: \"95b583ca-8a12-442b-b8b6-0cf2d7b39bee\") " pod="openshift-monitoring/node-exporter-jbz4j" Sep 08 02:42:20.824297 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:20.824208 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/95b583ca-8a12-442b-b8b6-0cf2d7b39bee-node-exporter-textfile\") pod \"node-exporter-jbz4j\" (UID: \"95b583ca-8a12-442b-b8b6-0cf2d7b39bee\") " pod="openshift-monitoring/node-exporter-jbz4j" Sep 08 02:42:20.824297 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:20.824273 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/95b583ca-8a12-442b-b8b6-0cf2d7b39bee-root\") pod \"node-exporter-jbz4j\" (UID: \"95b583ca-8a12-442b-b8b6-0cf2d7b39bee\") " pod="openshift-monitoring/node-exporter-jbz4j" Sep 08 02:42:20.824477 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:20.824329 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/95b583ca-8a12-442b-b8b6-0cf2d7b39bee-node-exporter-wtmp\") pod \"node-exporter-jbz4j\" (UID: \"95b583ca-8a12-442b-b8b6-0cf2d7b39bee\") " pod="openshift-monitoring/node-exporter-jbz4j" Sep 08 02:42:20.825050 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:20.825024 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/95b583ca-8a12-442b-b8b6-0cf2d7b39bee-metrics-client-ca\") pod \"node-exporter-jbz4j\" (UID: \"95b583ca-8a12-442b-b8b6-0cf2d7b39bee\") " pod="openshift-monitoring/node-exporter-jbz4j" Sep 08 02:42:20.826979 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:20.826926 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/95b583ca-8a12-442b-b8b6-0cf2d7b39bee-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jbz4j\" (UID: \"95b583ca-8a12-442b-b8b6-0cf2d7b39bee\") " pod="openshift-monitoring/node-exporter-jbz4j" Sep 08 02:42:20.832373 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:20.832332 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c5b4h\" (UniqueName: \"kubernetes.io/projected/95b583ca-8a12-442b-b8b6-0cf2d7b39bee-kube-api-access-c5b4h\") pod \"node-exporter-jbz4j\" (UID: \"95b583ca-8a12-442b-b8b6-0cf2d7b39bee\") " pod="openshift-monitoring/node-exporter-jbz4j" Sep 08 02:42:20.840950 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:20.840925 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-h62hl"] Sep 08 02:42:20.844434 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:42:20.844400 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod635bc747_a5b6_4c49_aa00_fab4bef8f003.slice/crio-3f2d70b6873ead80c609d6305d3af2aac8a8c4eda7318e7c9068626f7443d932 WatchSource:0}: Error finding container 3f2d70b6873ead80c609d6305d3af2aac8a8c4eda7318e7c9068626f7443d932: Status 404 returned error can't find the container with id 3f2d70b6873ead80c609d6305d3af2aac8a8c4eda7318e7c9068626f7443d932 Sep 08 02:42:20.859705 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:20.859681 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-rpnbl" Sep 08 02:42:20.871167 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:20.871140 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-65c9b7fd44-s9n6g"] Sep 08 02:42:20.873907 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:42:20.873883 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3751a7d_8eae_4e66_a492_b676988ca6ec.slice/crio-97d037d254cf877bc4a0b5c8b88d50003ec29374f8060a232501069e32717978 WatchSource:0}: Error finding container 97d037d254cf877bc4a0b5c8b88d50003ec29374f8060a232501069e32717978: Status 404 returned error can't find the container with id 97d037d254cf877bc4a0b5c8b88d50003ec29374f8060a232501069e32717978 Sep 08 02:42:21.168671 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:21.168395 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-rpnbl"] Sep 08 02:42:21.335336 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:21.334708 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/95b583ca-8a12-442b-b8b6-0cf2d7b39bee-node-exporter-tls\") pod \"node-exporter-jbz4j\" (UID: \"95b583ca-8a12-442b-b8b6-0cf2d7b39bee\") " pod="openshift-monitoring/node-exporter-jbz4j" Sep 08 02:42:21.335336 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:42:21.334921 2564 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Sep 08 02:42:21.335336 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:42:21.334987 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95b583ca-8a12-442b-b8b6-0cf2d7b39bee-node-exporter-tls podName:95b583ca-8a12-442b-b8b6-0cf2d7b39bee nodeName:}" failed. No retries permitted until 2026-09-08 02:42:22.334967645 +0000 UTC m=+106.769941338 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/95b583ca-8a12-442b-b8b6-0cf2d7b39bee-node-exporter-tls") pod "node-exporter-jbz4j" (UID: "95b583ca-8a12-442b-b8b6-0cf2d7b39bee") : secret "node-exporter-tls" not found Sep 08 02:42:21.545769 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:21.543432 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-h62hl" event={"ID":"635bc747-a5b6-4c49-aa00-fab4bef8f003","Type":"ContainerStarted","Data":"3f2d70b6873ead80c609d6305d3af2aac8a8c4eda7318e7c9068626f7443d932"} Sep 08 02:42:21.546283 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:21.546207 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-85d98c998f-lw2t4" event={"ID":"5ae7a553-d702-4b33-a05e-8afa348133fa","Type":"ContainerStarted","Data":"6feccb10e6a08291e2931db8a9b9a71b93e5de2abfc82ad4976f181c22825282"} Sep 08 02:42:21.548968 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:21.548508 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-85d98c998f-lw2t4" Sep 08 02:42:21.551812 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:21.551785 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-rpnbl" event={"ID":"d527f051-5bdd-47ee-98f6-e4a6116d832e","Type":"ContainerStarted","Data":"3bfab5f87b37b963b29df7623440a0ef940aaabde223a34990f2a09ec2b02e71"} Sep 08 02:42:21.551992 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:21.551839 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-rpnbl" event={"ID":"d527f051-5bdd-47ee-98f6-e4a6116d832e","Type":"ContainerStarted","Data":"5ca669a549f9e43d0363ec338264a4d5c09d3dab7e005ab2d5686f7eea8cd1b8"} Sep 08 02:42:21.551992 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:21.551868 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-rpnbl" event={"ID":"d527f051-5bdd-47ee-98f6-e4a6116d832e","Type":"ContainerStarted","Data":"e10649d3f705dde9f3497e7be35dc1f62adb54b6d44dffcb5d6ded5b1f440451"} Sep 08 02:42:21.554095 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:21.553931 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-65c9b7fd44-s9n6g" event={"ID":"c3751a7d-8eae-4e66-a492-b676988ca6ec","Type":"ContainerStarted","Data":"04d6d01f162bb9e79e371b4a5bc3ac158b187dde228d7b850bc110c09eecdb79"} Sep 08 02:42:21.554095 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:21.553987 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-65c9b7fd44-s9n6g" event={"ID":"c3751a7d-8eae-4e66-a492-b676988ca6ec","Type":"ContainerStarted","Data":"97d037d254cf877bc4a0b5c8b88d50003ec29374f8060a232501069e32717978"} Sep 08 02:42:21.554260 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:21.554115 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-65c9b7fd44-s9n6g" Sep 08 02:42:21.557799 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:21.557747 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-85d98c998f-lw2t4" Sep 08 02:42:21.566734 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:21.566071 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-85d98c998f-lw2t4" podStartSLOduration=2.059423098 podStartE2EDuration="18.566052771s" totalImagesPullingTime="16.506629673s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 02:42:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 02:42:21.564849124 +0000 UTC m=+105.999822816" watchObservedRunningTime="2026-09-08 02:42:21.566052771 +0000 UTC m=+106.001026464" Sep 08 02:42:21.618906 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:21.618837 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-65c9b7fd44-s9n6g" podStartSLOduration=105.618812453 podStartE2EDuration="1m45.618812453s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 02:40:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 02:42:21.617552868 +0000 UTC m=+106.052526574" watchObservedRunningTime="2026-09-08 02:42:21.618812453 +0000 UTC m=+106.053786145" Sep 08 02:42:21.715118 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:21.715082 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 08 02:42:21.741043 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:21.741014 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 08 02:42:21.741227 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:21.741169 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 08 02:42:21.745238 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:21.743766 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Sep 08 02:42:21.745238 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:21.744085 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Sep 08 02:42:21.745238 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:21.744299 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Sep 08 02:42:21.745238 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:21.744721 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Sep 08 02:42:21.745238 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:21.744921 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Sep 08 02:42:21.745238 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:21.745104 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Sep 08 02:42:21.745673 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:21.745269 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-675ms\"" Sep 08 02:42:21.745673 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:21.745527 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Sep 08 02:42:21.745772 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:21.745717 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Sep 08 02:42:21.746538 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:21.745857 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Sep 08 02:42:21.840071 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:21.839969 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b003111f-3df4-4cb2-bb11-fdb90e882604-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"b003111f-3df4-4cb2-bb11-fdb90e882604\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 02:42:21.840071 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:21.840016 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b003111f-3df4-4cb2-bb11-fdb90e882604-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b003111f-3df4-4cb2-bb11-fdb90e882604\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 02:42:21.840071 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:21.840048 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b003111f-3df4-4cb2-bb11-fdb90e882604-config-out\") pod \"alertmanager-main-0\" (UID: \"b003111f-3df4-4cb2-bb11-fdb90e882604\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 02:42:21.840071 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:21.840073 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f7c62\" (UniqueName: \"kubernetes.io/projected/b003111f-3df4-4cb2-bb11-fdb90e882604-kube-api-access-f7c62\") pod \"alertmanager-main-0\" (UID: \"b003111f-3df4-4cb2-bb11-fdb90e882604\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 02:42:21.840450 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:21.840128 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b003111f-3df4-4cb2-bb11-fdb90e882604-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"b003111f-3df4-4cb2-bb11-fdb90e882604\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 02:42:21.840450 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:21.840158 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b003111f-3df4-4cb2-bb11-fdb90e882604-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"b003111f-3df4-4cb2-bb11-fdb90e882604\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 02:42:21.840450 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:21.840184 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b003111f-3df4-4cb2-bb11-fdb90e882604-tls-assets\") pod \"alertmanager-main-0\" (UID: \"b003111f-3df4-4cb2-bb11-fdb90e882604\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 02:42:21.840450 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:21.840210 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b003111f-3df4-4cb2-bb11-fdb90e882604-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b003111f-3df4-4cb2-bb11-fdb90e882604\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 02:42:21.840450 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:21.840253 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b003111f-3df4-4cb2-bb11-fdb90e882604-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"b003111f-3df4-4cb2-bb11-fdb90e882604\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 02:42:21.840450 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:21.840289 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b003111f-3df4-4cb2-bb11-fdb90e882604-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"b003111f-3df4-4cb2-bb11-fdb90e882604\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 02:42:21.840450 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:21.840375 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b003111f-3df4-4cb2-bb11-fdb90e882604-config-volume\") pod \"alertmanager-main-0\" (UID: \"b003111f-3df4-4cb2-bb11-fdb90e882604\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 02:42:21.840450 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:21.840431 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b003111f-3df4-4cb2-bb11-fdb90e882604-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"b003111f-3df4-4cb2-bb11-fdb90e882604\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 02:42:21.840713 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:21.840458 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b003111f-3df4-4cb2-bb11-fdb90e882604-web-config\") pod \"alertmanager-main-0\" (UID: \"b003111f-3df4-4cb2-bb11-fdb90e882604\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 02:42:21.943236 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:21.941740 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b003111f-3df4-4cb2-bb11-fdb90e882604-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"b003111f-3df4-4cb2-bb11-fdb90e882604\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 02:42:21.943236 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:21.941913 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b003111f-3df4-4cb2-bb11-fdb90e882604-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"b003111f-3df4-4cb2-bb11-fdb90e882604\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 02:42:21.943236 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:21.942031 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b003111f-3df4-4cb2-bb11-fdb90e882604-tls-assets\") pod \"alertmanager-main-0\" (UID: \"b003111f-3df4-4cb2-bb11-fdb90e882604\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 02:42:21.943236 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:21.942066 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b003111f-3df4-4cb2-bb11-fdb90e882604-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b003111f-3df4-4cb2-bb11-fdb90e882604\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 02:42:21.943236 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:21.942111 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b003111f-3df4-4cb2-bb11-fdb90e882604-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"b003111f-3df4-4cb2-bb11-fdb90e882604\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 02:42:21.943236 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:21.942143 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b003111f-3df4-4cb2-bb11-fdb90e882604-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"b003111f-3df4-4cb2-bb11-fdb90e882604\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 02:42:21.943236 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:21.942209 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b003111f-3df4-4cb2-bb11-fdb90e882604-config-volume\") pod \"alertmanager-main-0\" (UID: \"b003111f-3df4-4cb2-bb11-fdb90e882604\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 02:42:21.943236 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:21.942262 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b003111f-3df4-4cb2-bb11-fdb90e882604-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"b003111f-3df4-4cb2-bb11-fdb90e882604\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 02:42:21.943236 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:21.942289 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b003111f-3df4-4cb2-bb11-fdb90e882604-web-config\") pod \"alertmanager-main-0\" (UID: \"b003111f-3df4-4cb2-bb11-fdb90e882604\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 02:42:21.943236 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:21.942327 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b003111f-3df4-4cb2-bb11-fdb90e882604-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"b003111f-3df4-4cb2-bb11-fdb90e882604\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 02:42:21.943236 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:21.942368 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b003111f-3df4-4cb2-bb11-fdb90e882604-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b003111f-3df4-4cb2-bb11-fdb90e882604\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 02:42:21.943236 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:21.942398 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b003111f-3df4-4cb2-bb11-fdb90e882604-config-out\") pod \"alertmanager-main-0\" (UID: \"b003111f-3df4-4cb2-bb11-fdb90e882604\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 02:42:21.943236 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:21.942428 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f7c62\" (UniqueName: \"kubernetes.io/projected/b003111f-3df4-4cb2-bb11-fdb90e882604-kube-api-access-f7c62\") pod \"alertmanager-main-0\" (UID: \"b003111f-3df4-4cb2-bb11-fdb90e882604\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 02:42:21.944662 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:21.944629 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b003111f-3df4-4cb2-bb11-fdb90e882604-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"b003111f-3df4-4cb2-bb11-fdb90e882604\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 02:42:21.944662 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:21.944656 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b003111f-3df4-4cb2-bb11-fdb90e882604-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"b003111f-3df4-4cb2-bb11-fdb90e882604\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 02:42:21.945541 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:21.945512 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b003111f-3df4-4cb2-bb11-fdb90e882604-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b003111f-3df4-4cb2-bb11-fdb90e882604\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 02:42:21.945844 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:21.945816 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b003111f-3df4-4cb2-bb11-fdb90e882604-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"b003111f-3df4-4cb2-bb11-fdb90e882604\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 02:42:21.969558 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:21.955021 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f7c62\" (UniqueName: \"kubernetes.io/projected/b003111f-3df4-4cb2-bb11-fdb90e882604-kube-api-access-f7c62\") pod \"alertmanager-main-0\" (UID: \"b003111f-3df4-4cb2-bb11-fdb90e882604\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 02:42:21.969558 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:21.960901 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b003111f-3df4-4cb2-bb11-fdb90e882604-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"b003111f-3df4-4cb2-bb11-fdb90e882604\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 02:42:21.969558 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:21.963479 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b003111f-3df4-4cb2-bb11-fdb90e882604-config-out\") pod \"alertmanager-main-0\" (UID: \"b003111f-3df4-4cb2-bb11-fdb90e882604\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 02:42:21.969558 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:21.969146 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b003111f-3df4-4cb2-bb11-fdb90e882604-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b003111f-3df4-4cb2-bb11-fdb90e882604\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 02:42:21.971122 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:21.971025 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b003111f-3df4-4cb2-bb11-fdb90e882604-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"b003111f-3df4-4cb2-bb11-fdb90e882604\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 02:42:21.971122 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:21.971088 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b003111f-3df4-4cb2-bb11-fdb90e882604-tls-assets\") pod \"alertmanager-main-0\" (UID: \"b003111f-3df4-4cb2-bb11-fdb90e882604\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 02:42:21.972484 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:21.972460 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b003111f-3df4-4cb2-bb11-fdb90e882604-config-volume\") pod \"alertmanager-main-0\" (UID: \"b003111f-3df4-4cb2-bb11-fdb90e882604\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 02:42:21.976552 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:21.976497 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b003111f-3df4-4cb2-bb11-fdb90e882604-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"b003111f-3df4-4cb2-bb11-fdb90e882604\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 02:42:21.977851 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:21.977822 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b003111f-3df4-4cb2-bb11-fdb90e882604-web-config\") pod \"alertmanager-main-0\" (UID: \"b003111f-3df4-4cb2-bb11-fdb90e882604\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 02:42:22.058489 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:22.058228 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 08 02:42:22.346938 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:22.346431 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/95b583ca-8a12-442b-b8b6-0cf2d7b39bee-node-exporter-tls\") pod \"node-exporter-jbz4j\" (UID: \"95b583ca-8a12-442b-b8b6-0cf2d7b39bee\") " pod="openshift-monitoring/node-exporter-jbz4j" Sep 08 02:42:22.350090 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:22.350026 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/95b583ca-8a12-442b-b8b6-0cf2d7b39bee-node-exporter-tls\") pod \"node-exporter-jbz4j\" (UID: \"95b583ca-8a12-442b-b8b6-0cf2d7b39bee\") " pod="openshift-monitoring/node-exporter-jbz4j" Sep 08 02:42:22.397031 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:22.396806 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-jbz4j" Sep 08 02:42:24.216860 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:42:24.216824 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95b583ca_8a12_442b_b8b6_0cf2d7b39bee.slice/crio-24802b6d3470e4fbc88fa5c1ced20ba7c28f7c43e29cdce2189265b4ea75facc WatchSource:0}: Error finding container 24802b6d3470e4fbc88fa5c1ced20ba7c28f7c43e29cdce2189265b4ea75facc: Status 404 returned error can't find the container with id 24802b6d3470e4fbc88fa5c1ced20ba7c28f7c43e29cdce2189265b4ea75facc Sep 08 02:42:24.498757 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:24.498678 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 08 02:42:24.503013 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:42:24.502984 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb003111f_3df4_4cb2_bb11_fdb90e882604.slice/crio-9e2aa427a9e169d83863a1e7ac9f1636fce43a5b402724aa39922a748010fc23 WatchSource:0}: Error finding container 9e2aa427a9e169d83863a1e7ac9f1636fce43a5b402724aa39922a748010fc23: Status 404 returned error can't find the container with id 9e2aa427a9e169d83863a1e7ac9f1636fce43a5b402724aa39922a748010fc23 Sep 08 02:42:24.570711 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:24.570668 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-rpnbl" event={"ID":"d527f051-5bdd-47ee-98f6-e4a6116d832e","Type":"ContainerStarted","Data":"1f2714e8263594270d9f61c2480a0fdbf4d9513be1ff3ebc6585c0e9efc14a30"} Sep 08 02:42:24.572820 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:24.572783 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b003111f-3df4-4cb2-bb11-fdb90e882604","Type":"ContainerStarted","Data":"9e2aa427a9e169d83863a1e7ac9f1636fce43a5b402724aa39922a748010fc23"} Sep 08 02:42:24.575492 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:24.575459 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9srg4" event={"ID":"7481ac35-8d64-4777-8985-384f3cf98fda","Type":"ContainerStarted","Data":"5d166c00f7bd28da7774d371b64443ef4ecb2f67b11491bc580c896ddf7b8a51"} Sep 08 02:42:24.577646 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:24.577617 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-h62hl" event={"ID":"635bc747-a5b6-4c49-aa00-fab4bef8f003","Type":"ContainerStarted","Data":"a0e1e17230b76f1d56e9dc7b8f245a88edbeaf573594a66aa51d9fbdbb9f028b"} Sep 08 02:42:24.577770 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:24.577670 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-h62hl" event={"ID":"635bc747-a5b6-4c49-aa00-fab4bef8f003","Type":"ContainerStarted","Data":"9c4256c6dda002225ea06cb6df2fdd0ac28b5c822be8487746da96395b49fa1f"} Sep 08 02:42:24.577770 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:24.577701 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-h62hl" Sep 08 02:42:24.579151 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:24.579128 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jbz4j" event={"ID":"95b583ca-8a12-442b-b8b6-0cf2d7b39bee","Type":"ContainerStarted","Data":"24802b6d3470e4fbc88fa5c1ced20ba7c28f7c43e29cdce2189265b4ea75facc"} Sep 08 02:42:24.590974 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:24.590911 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-rpnbl" podStartSLOduration=1.778310981 podStartE2EDuration="4.590890461s" totalImagesPullingTime="2.81257948s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 02:42:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 02:42:24.588562927 +0000 UTC m=+109.023536621" watchObservedRunningTime="2026-09-08 02:42:24.590890461 +0000 UTC m=+109.025864153" Sep 08 02:42:24.606017 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:24.605956 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-h62hl" podStartSLOduration=72.236426715 podStartE2EDuration="1m15.605906108s" totalImagesPullingTime="3.369479393s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 02:41:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 02:42:24.604481265 +0000 UTC m=+109.039454955" watchObservedRunningTime="2026-09-08 02:42:24.605906108 +0000 UTC m=+109.040879794" Sep 08 02:42:24.624777 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:24.624712 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-9srg4" podStartSLOduration=33.050883096 podStartE2EDuration="44.624693669s" totalImagesPullingTime="11.573810573s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 02:41:40 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 02:42:24.624126297 +0000 UTC m=+109.059100011" watchObservedRunningTime="2026-09-08 02:42:24.624693669 +0000 UTC m=+109.059667359" Sep 08 02:42:24.878700 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:24.878614 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-5bcbf954f-v87md"] Sep 08 02:42:24.896140 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:24.896088 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5bcbf954f-v87md"] Sep 08 02:42:24.896811 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:24.896207 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5bcbf954f-v87md" Sep 08 02:42:24.901162 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:24.900999 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Sep 08 02:42:24.902160 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:24.902138 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-lxtbs\"" Sep 08 02:42:24.902446 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:24.902430 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Sep 08 02:42:24.902688 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:24.902672 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-d39spdpi4d0lh\"" Sep 08 02:42:24.902852 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:24.902840 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Sep 08 02:42:24.903655 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:24.903635 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Sep 08 02:42:25.073378 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:25.072499 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8910b80c-cfcf-4f9b-bccd-150c285d1cb6-client-ca-bundle\") pod \"metrics-server-5bcbf954f-v87md\" (UID: \"8910b80c-cfcf-4f9b-bccd-150c285d1cb6\") " pod="openshift-monitoring/metrics-server-5bcbf954f-v87md" Sep 08 02:42:25.073378 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:25.072553 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8910b80c-cfcf-4f9b-bccd-150c285d1cb6-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5bcbf954f-v87md\" (UID: \"8910b80c-cfcf-4f9b-bccd-150c285d1cb6\") " pod="openshift-monitoring/metrics-server-5bcbf954f-v87md" Sep 08 02:42:25.073378 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:25.072645 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/8910b80c-cfcf-4f9b-bccd-150c285d1cb6-audit-log\") pod \"metrics-server-5bcbf954f-v87md\" (UID: \"8910b80c-cfcf-4f9b-bccd-150c285d1cb6\") " pod="openshift-monitoring/metrics-server-5bcbf954f-v87md" Sep 08 02:42:25.073378 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:25.072675 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/8910b80c-cfcf-4f9b-bccd-150c285d1cb6-metrics-server-audit-profiles\") pod \"metrics-server-5bcbf954f-v87md\" (UID: \"8910b80c-cfcf-4f9b-bccd-150c285d1cb6\") " pod="openshift-monitoring/metrics-server-5bcbf954f-v87md" Sep 08 02:42:25.073378 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:25.072706 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/8910b80c-cfcf-4f9b-bccd-150c285d1cb6-secret-metrics-server-tls\") pod \"metrics-server-5bcbf954f-v87md\" (UID: \"8910b80c-cfcf-4f9b-bccd-150c285d1cb6\") " pod="openshift-monitoring/metrics-server-5bcbf954f-v87md" Sep 08 02:42:25.073378 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:25.072760 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/8910b80c-cfcf-4f9b-bccd-150c285d1cb6-secret-metrics-server-client-certs\") pod \"metrics-server-5bcbf954f-v87md\" (UID: \"8910b80c-cfcf-4f9b-bccd-150c285d1cb6\") " pod="openshift-monitoring/metrics-server-5bcbf954f-v87md" Sep 08 02:42:25.073378 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:25.072789 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pflnj\" (UniqueName: \"kubernetes.io/projected/8910b80c-cfcf-4f9b-bccd-150c285d1cb6-kube-api-access-pflnj\") pod \"metrics-server-5bcbf954f-v87md\" (UID: \"8910b80c-cfcf-4f9b-bccd-150c285d1cb6\") " pod="openshift-monitoring/metrics-server-5bcbf954f-v87md" Sep 08 02:42:25.174012 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:25.173915 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/8910b80c-cfcf-4f9b-bccd-150c285d1cb6-audit-log\") pod \"metrics-server-5bcbf954f-v87md\" (UID: \"8910b80c-cfcf-4f9b-bccd-150c285d1cb6\") " pod="openshift-monitoring/metrics-server-5bcbf954f-v87md" Sep 08 02:42:25.174012 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:25.173987 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/8910b80c-cfcf-4f9b-bccd-150c285d1cb6-metrics-server-audit-profiles\") pod \"metrics-server-5bcbf954f-v87md\" (UID: \"8910b80c-cfcf-4f9b-bccd-150c285d1cb6\") " pod="openshift-monitoring/metrics-server-5bcbf954f-v87md" Sep 08 02:42:25.174465 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:25.174018 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/8910b80c-cfcf-4f9b-bccd-150c285d1cb6-secret-metrics-server-tls\") pod \"metrics-server-5bcbf954f-v87md\" (UID: \"8910b80c-cfcf-4f9b-bccd-150c285d1cb6\") " pod="openshift-monitoring/metrics-server-5bcbf954f-v87md" Sep 08 02:42:25.174465 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:25.174074 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/8910b80c-cfcf-4f9b-bccd-150c285d1cb6-secret-metrics-server-client-certs\") pod \"metrics-server-5bcbf954f-v87md\" (UID: \"8910b80c-cfcf-4f9b-bccd-150c285d1cb6\") " pod="openshift-monitoring/metrics-server-5bcbf954f-v87md" Sep 08 02:42:25.174465 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:25.174103 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pflnj\" (UniqueName: \"kubernetes.io/projected/8910b80c-cfcf-4f9b-bccd-150c285d1cb6-kube-api-access-pflnj\") pod \"metrics-server-5bcbf954f-v87md\" (UID: \"8910b80c-cfcf-4f9b-bccd-150c285d1cb6\") " pod="openshift-monitoring/metrics-server-5bcbf954f-v87md" Sep 08 02:42:25.174465 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:25.174136 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8910b80c-cfcf-4f9b-bccd-150c285d1cb6-client-ca-bundle\") pod \"metrics-server-5bcbf954f-v87md\" (UID: \"8910b80c-cfcf-4f9b-bccd-150c285d1cb6\") " pod="openshift-monitoring/metrics-server-5bcbf954f-v87md" Sep 08 02:42:25.174465 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:25.174168 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8910b80c-cfcf-4f9b-bccd-150c285d1cb6-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5bcbf954f-v87md\" (UID: \"8910b80c-cfcf-4f9b-bccd-150c285d1cb6\") " pod="openshift-monitoring/metrics-server-5bcbf954f-v87md" Sep 08 02:42:25.174987 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:25.174928 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8910b80c-cfcf-4f9b-bccd-150c285d1cb6-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5bcbf954f-v87md\" (UID: \"8910b80c-cfcf-4f9b-bccd-150c285d1cb6\") " pod="openshift-monitoring/metrics-server-5bcbf954f-v87md" Sep 08 02:42:25.175567 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:25.175505 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/8910b80c-cfcf-4f9b-bccd-150c285d1cb6-audit-log\") pod \"metrics-server-5bcbf954f-v87md\" (UID: \"8910b80c-cfcf-4f9b-bccd-150c285d1cb6\") " pod="openshift-monitoring/metrics-server-5bcbf954f-v87md" Sep 08 02:42:25.175870 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:25.175845 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/8910b80c-cfcf-4f9b-bccd-150c285d1cb6-metrics-server-audit-profiles\") pod \"metrics-server-5bcbf954f-v87md\" (UID: \"8910b80c-cfcf-4f9b-bccd-150c285d1cb6\") " pod="openshift-monitoring/metrics-server-5bcbf954f-v87md" Sep 08 02:42:25.178678 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:25.178650 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/8910b80c-cfcf-4f9b-bccd-150c285d1cb6-secret-metrics-server-tls\") pod \"metrics-server-5bcbf954f-v87md\" (UID: \"8910b80c-cfcf-4f9b-bccd-150c285d1cb6\") " pod="openshift-monitoring/metrics-server-5bcbf954f-v87md" Sep 08 02:42:25.179209 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:25.178866 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/8910b80c-cfcf-4f9b-bccd-150c285d1cb6-secret-metrics-server-client-certs\") pod \"metrics-server-5bcbf954f-v87md\" (UID: \"8910b80c-cfcf-4f9b-bccd-150c285d1cb6\") " pod="openshift-monitoring/metrics-server-5bcbf954f-v87md" Sep 08 02:42:25.180743 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:25.180700 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8910b80c-cfcf-4f9b-bccd-150c285d1cb6-client-ca-bundle\") pod \"metrics-server-5bcbf954f-v87md\" (UID: \"8910b80c-cfcf-4f9b-bccd-150c285d1cb6\") " pod="openshift-monitoring/metrics-server-5bcbf954f-v87md" Sep 08 02:42:25.183951 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:25.183892 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pflnj\" (UniqueName: \"kubernetes.io/projected/8910b80c-cfcf-4f9b-bccd-150c285d1cb6-kube-api-access-pflnj\") pod \"metrics-server-5bcbf954f-v87md\" (UID: \"8910b80c-cfcf-4f9b-bccd-150c285d1cb6\") " pod="openshift-monitoring/metrics-server-5bcbf954f-v87md" Sep 08 02:42:25.211605 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:25.211482 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5bcbf954f-v87md" Sep 08 02:42:25.340859 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:25.340817 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-xxswc"] Sep 08 02:42:25.355210 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:25.354225 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-xxswc"] Sep 08 02:42:25.355210 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:25.354345 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-xxswc" Sep 08 02:42:25.358494 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:25.358469 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-c5p8j\"" Sep 08 02:42:25.358950 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:25.358782 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Sep 08 02:42:25.478961 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:25.478884 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3e00f71c-ee93-4821-8c42-707e62e92162-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-xxswc\" (UID: \"3e00f71c-ee93-4821-8c42-707e62e92162\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-xxswc" Sep 08 02:42:25.479222 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:25.478982 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-88sqs\" (UniqueName: \"kubernetes.io/projected/3e00f71c-ee93-4821-8c42-707e62e92162-kube-api-access-88sqs\") pod \"monitoring-plugin-85bbbbbf4-xxswc\" (UID: \"3e00f71c-ee93-4821-8c42-707e62e92162\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-xxswc" Sep 08 02:42:25.543608 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:25.543566 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-65c9b7fd44-s9n6g"] Sep 08 02:42:25.579655 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:25.579615 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3e00f71c-ee93-4821-8c42-707e62e92162-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-xxswc\" (UID: \"3e00f71c-ee93-4821-8c42-707e62e92162\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-xxswc" Sep 08 02:42:25.579856 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:25.579686 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-88sqs\" (UniqueName: \"kubernetes.io/projected/3e00f71c-ee93-4821-8c42-707e62e92162-kube-api-access-88sqs\") pod \"monitoring-plugin-85bbbbbf4-xxswc\" (UID: \"3e00f71c-ee93-4821-8c42-707e62e92162\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-xxswc" Sep 08 02:42:25.579856 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:42:25.579812 2564 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Sep 08 02:42:25.579973 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:42:25.579881 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e00f71c-ee93-4821-8c42-707e62e92162-monitoring-plugin-cert podName:3e00f71c-ee93-4821-8c42-707e62e92162 nodeName:}" failed. No retries permitted until 2026-09-08 02:42:26.079862486 +0000 UTC m=+110.514836168 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/3e00f71c-ee93-4821-8c42-707e62e92162-monitoring-plugin-cert") pod "monitoring-plugin-85bbbbbf4-xxswc" (UID: "3e00f71c-ee93-4821-8c42-707e62e92162") : secret "monitoring-plugin-cert" not found Sep 08 02:42:25.601107 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:25.601074 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-88sqs\" (UniqueName: \"kubernetes.io/projected/3e00f71c-ee93-4821-8c42-707e62e92162-kube-api-access-88sqs\") pod \"monitoring-plugin-85bbbbbf4-xxswc\" (UID: \"3e00f71c-ee93-4821-8c42-707e62e92162\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-xxswc" Sep 08 02:42:26.085179 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:26.085056 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3e00f71c-ee93-4821-8c42-707e62e92162-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-xxswc\" (UID: \"3e00f71c-ee93-4821-8c42-707e62e92162\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-xxswc" Sep 08 02:42:26.087981 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:26.087953 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3e00f71c-ee93-4821-8c42-707e62e92162-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-xxswc\" (UID: \"3e00f71c-ee93-4821-8c42-707e62e92162\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-xxswc" Sep 08 02:42:26.268978 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:26.268936 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-xxswc" Sep 08 02:42:26.591280 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:26.591240 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jbz4j" event={"ID":"95b583ca-8a12-442b-b8b6-0cf2d7b39bee","Type":"ContainerStarted","Data":"1a7868c7d17642281c827f7a66927fec234d2d48f0eb1c9b43e1975728da0852"} Sep 08 02:42:26.593144 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:26.592533 2564 generic.go:356] "Generic (PLEG): container finished" podID="b003111f-3df4-4cb2-bb11-fdb90e882604" containerID="f7cd46297471ab9e7e5f768bb02a54420a88cf4cc5f8441eceeff4092d74b19f" exitCode=0 Sep 08 02:42:26.593144 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:26.592612 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b003111f-3df4-4cb2-bb11-fdb90e882604","Type":"ContainerDied","Data":"f7cd46297471ab9e7e5f768bb02a54420a88cf4cc5f8441eceeff4092d74b19f"} Sep 08 02:42:26.665552 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:26.665512 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5bcbf954f-v87md"] Sep 08 02:42:26.668517 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:26.668489 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-xxswc"] Sep 08 02:42:26.674547 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:42:26.674514 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e00f71c_ee93_4821_8c42_707e62e92162.slice/crio-e6e1afc166a4f7d435c1d532358d48c58d1145f5a7e8f1eeff99c687303ed40d WatchSource:0}: Error finding container e6e1afc166a4f7d435c1d532358d48c58d1145f5a7e8f1eeff99c687303ed40d: Status 404 returned error can't find the container with id e6e1afc166a4f7d435c1d532358d48c58d1145f5a7e8f1eeff99c687303ed40d Sep 08 02:42:26.674769 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:42:26.674739 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8910b80c_cfcf_4f9b_bccd_150c285d1cb6.slice/crio-59ec29df946341af7a63cb4c187dc1198edefec35eb5701216afb9cfcd3e5b1c WatchSource:0}: Error finding container 59ec29df946341af7a63cb4c187dc1198edefec35eb5701216afb9cfcd3e5b1c: Status 404 returned error can't find the container with id 59ec29df946341af7a63cb4c187dc1198edefec35eb5701216afb9cfcd3e5b1c Sep 08 02:42:26.757150 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:26.757113 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 08 02:42:26.778476 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:26.778444 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 08 02:42:26.778756 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:26.778614 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 08 02:42:26.781297 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:26.781260 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Sep 08 02:42:26.781297 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:26.781278 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-eonu8bq26jcef\"" Sep 08 02:42:26.781584 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:26.781565 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Sep 08 02:42:26.781808 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:26.781787 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Sep 08 02:42:26.782034 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:26.782017 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Sep 08 02:42:26.782162 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:26.782143 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Sep 08 02:42:26.782567 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:26.782546 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Sep 08 02:42:26.782789 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:26.782565 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Sep 08 02:42:26.782789 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:26.782568 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Sep 08 02:42:26.782932 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:26.782607 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Sep 08 02:42:26.783296 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:26.783177 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Sep 08 02:42:26.783296 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:26.783181 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Sep 08 02:42:26.783471 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:26.783371 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Sep 08 02:42:26.783670 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:26.783652 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Sep 08 02:42:26.783801 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:26.783697 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-h657v\"" Sep 08 02:42:26.786040 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:26.786016 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Sep 08 02:42:26.789926 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:26.789901 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/55d5a280-e46f-4a42-94d7-d512b1434da3-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"55d5a280-e46f-4a42-94d7-d512b1434da3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 02:42:26.790052 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:26.789970 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/55d5a280-e46f-4a42-94d7-d512b1434da3-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"55d5a280-e46f-4a42-94d7-d512b1434da3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 02:42:26.790052 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:26.789996 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/55d5a280-e46f-4a42-94d7-d512b1434da3-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"55d5a280-e46f-4a42-94d7-d512b1434da3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 02:42:26.790052 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:26.790036 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/55d5a280-e46f-4a42-94d7-d512b1434da3-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"55d5a280-e46f-4a42-94d7-d512b1434da3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 02:42:26.790318 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:26.790077 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/55d5a280-e46f-4a42-94d7-d512b1434da3-config-out\") pod \"prometheus-k8s-0\" (UID: \"55d5a280-e46f-4a42-94d7-d512b1434da3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 02:42:26.790318 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:26.790103 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/55d5a280-e46f-4a42-94d7-d512b1434da3-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"55d5a280-e46f-4a42-94d7-d512b1434da3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 02:42:26.790318 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:26.790133 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/55d5a280-e46f-4a42-94d7-d512b1434da3-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"55d5a280-e46f-4a42-94d7-d512b1434da3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 02:42:26.790318 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:26.790213 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/55d5a280-e46f-4a42-94d7-d512b1434da3-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"55d5a280-e46f-4a42-94d7-d512b1434da3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 02:42:26.790318 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:26.790238 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ts8fq\" (UniqueName: \"kubernetes.io/projected/55d5a280-e46f-4a42-94d7-d512b1434da3-kube-api-access-ts8fq\") pod \"prometheus-k8s-0\" (UID: \"55d5a280-e46f-4a42-94d7-d512b1434da3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 02:42:26.790318 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:26.790271 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/55d5a280-e46f-4a42-94d7-d512b1434da3-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"55d5a280-e46f-4a42-94d7-d512b1434da3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 02:42:26.790606 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:26.790379 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/55d5a280-e46f-4a42-94d7-d512b1434da3-config\") pod \"prometheus-k8s-0\" (UID: \"55d5a280-e46f-4a42-94d7-d512b1434da3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 02:42:26.790606 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:26.790403 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/55d5a280-e46f-4a42-94d7-d512b1434da3-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"55d5a280-e46f-4a42-94d7-d512b1434da3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 02:42:26.790606 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:26.790435 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/55d5a280-e46f-4a42-94d7-d512b1434da3-web-config\") pod \"prometheus-k8s-0\" (UID: \"55d5a280-e46f-4a42-94d7-d512b1434da3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 02:42:26.790606 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:26.790464 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/55d5a280-e46f-4a42-94d7-d512b1434da3-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"55d5a280-e46f-4a42-94d7-d512b1434da3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 02:42:26.790606 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:26.790543 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/55d5a280-e46f-4a42-94d7-d512b1434da3-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"55d5a280-e46f-4a42-94d7-d512b1434da3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 02:42:26.790606 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:26.790597 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/55d5a280-e46f-4a42-94d7-d512b1434da3-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"55d5a280-e46f-4a42-94d7-d512b1434da3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 02:42:26.790908 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:26.790623 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/55d5a280-e46f-4a42-94d7-d512b1434da3-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"55d5a280-e46f-4a42-94d7-d512b1434da3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 02:42:26.790908 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:26.790652 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/55d5a280-e46f-4a42-94d7-d512b1434da3-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"55d5a280-e46f-4a42-94d7-d512b1434da3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 02:42:26.790908 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:26.790675 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/55d5a280-e46f-4a42-94d7-d512b1434da3-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"55d5a280-e46f-4a42-94d7-d512b1434da3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 02:42:26.790908 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:26.790749 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/55d5a280-e46f-4a42-94d7-d512b1434da3-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"55d5a280-e46f-4a42-94d7-d512b1434da3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 02:42:26.892024 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:26.891932 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/55d5a280-e46f-4a42-94d7-d512b1434da3-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"55d5a280-e46f-4a42-94d7-d512b1434da3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 02:42:26.892024 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:26.892002 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/55d5a280-e46f-4a42-94d7-d512b1434da3-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"55d5a280-e46f-4a42-94d7-d512b1434da3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 02:42:26.892287 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:26.892034 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/55d5a280-e46f-4a42-94d7-d512b1434da3-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"55d5a280-e46f-4a42-94d7-d512b1434da3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 02:42:26.892287 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:26.892064 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/55d5a280-e46f-4a42-94d7-d512b1434da3-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"55d5a280-e46f-4a42-94d7-d512b1434da3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 02:42:26.892287 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:26.892090 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/55d5a280-e46f-4a42-94d7-d512b1434da3-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"55d5a280-e46f-4a42-94d7-d512b1434da3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 02:42:26.892287 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:26.892117 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/55d5a280-e46f-4a42-94d7-d512b1434da3-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"55d5a280-e46f-4a42-94d7-d512b1434da3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 02:42:26.892287 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:26.892154 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/55d5a280-e46f-4a42-94d7-d512b1434da3-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"55d5a280-e46f-4a42-94d7-d512b1434da3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 02:42:26.892287 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:26.892211 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/55d5a280-e46f-4a42-94d7-d512b1434da3-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"55d5a280-e46f-4a42-94d7-d512b1434da3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 02:42:26.892287 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:26.892235 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/55d5a280-e46f-4a42-94d7-d512b1434da3-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"55d5a280-e46f-4a42-94d7-d512b1434da3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 02:42:26.892287 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:26.892276 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/55d5a280-e46f-4a42-94d7-d512b1434da3-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"55d5a280-e46f-4a42-94d7-d512b1434da3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 02:42:26.892699 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:26.892301 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/55d5a280-e46f-4a42-94d7-d512b1434da3-config-out\") pod \"prometheus-k8s-0\" (UID: \"55d5a280-e46f-4a42-94d7-d512b1434da3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 02:42:26.892699 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:26.892330 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/55d5a280-e46f-4a42-94d7-d512b1434da3-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"55d5a280-e46f-4a42-94d7-d512b1434da3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 02:42:26.892699 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:26.892377 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/55d5a280-e46f-4a42-94d7-d512b1434da3-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"55d5a280-e46f-4a42-94d7-d512b1434da3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 02:42:26.892699 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:26.892422 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/55d5a280-e46f-4a42-94d7-d512b1434da3-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"55d5a280-e46f-4a42-94d7-d512b1434da3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 02:42:26.892699 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:26.892447 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ts8fq\" (UniqueName: \"kubernetes.io/projected/55d5a280-e46f-4a42-94d7-d512b1434da3-kube-api-access-ts8fq\") pod \"prometheus-k8s-0\" (UID: \"55d5a280-e46f-4a42-94d7-d512b1434da3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 02:42:26.892699 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:26.892481 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/55d5a280-e46f-4a42-94d7-d512b1434da3-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"55d5a280-e46f-4a42-94d7-d512b1434da3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 02:42:26.892699 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:26.892523 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/55d5a280-e46f-4a42-94d7-d512b1434da3-config\") pod \"prometheus-k8s-0\" (UID: \"55d5a280-e46f-4a42-94d7-d512b1434da3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 02:42:26.892699 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:26.892549 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/55d5a280-e46f-4a42-94d7-d512b1434da3-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"55d5a280-e46f-4a42-94d7-d512b1434da3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 02:42:26.892699 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:26.892572 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/55d5a280-e46f-4a42-94d7-d512b1434da3-web-config\") pod \"prometheus-k8s-0\" (UID: \"55d5a280-e46f-4a42-94d7-d512b1434da3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 02:42:26.892699 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:26.892602 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/55d5a280-e46f-4a42-94d7-d512b1434da3-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"55d5a280-e46f-4a42-94d7-d512b1434da3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 02:42:26.893213 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:26.892713 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/55d5a280-e46f-4a42-94d7-d512b1434da3-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"55d5a280-e46f-4a42-94d7-d512b1434da3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 02:42:26.893213 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:26.892811 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/55d5a280-e46f-4a42-94d7-d512b1434da3-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"55d5a280-e46f-4a42-94d7-d512b1434da3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 02:42:26.893213 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:26.892884 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/55d5a280-e46f-4a42-94d7-d512b1434da3-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"55d5a280-e46f-4a42-94d7-d512b1434da3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 02:42:26.893213 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:26.892899 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/55d5a280-e46f-4a42-94d7-d512b1434da3-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"55d5a280-e46f-4a42-94d7-d512b1434da3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 02:42:26.894495 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:26.894140 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/55d5a280-e46f-4a42-94d7-d512b1434da3-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"55d5a280-e46f-4a42-94d7-d512b1434da3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 02:42:26.896482 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:26.895858 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/55d5a280-e46f-4a42-94d7-d512b1434da3-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"55d5a280-e46f-4a42-94d7-d512b1434da3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 02:42:26.896482 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:26.895971 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/55d5a280-e46f-4a42-94d7-d512b1434da3-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"55d5a280-e46f-4a42-94d7-d512b1434da3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 02:42:26.896742 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:26.896717 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/55d5a280-e46f-4a42-94d7-d512b1434da3-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"55d5a280-e46f-4a42-94d7-d512b1434da3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 02:42:26.897152 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:26.897127 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/55d5a280-e46f-4a42-94d7-d512b1434da3-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"55d5a280-e46f-4a42-94d7-d512b1434da3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 02:42:26.897406 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:26.897318 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/55d5a280-e46f-4a42-94d7-d512b1434da3-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"55d5a280-e46f-4a42-94d7-d512b1434da3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 02:42:26.897649 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:26.897531 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/55d5a280-e46f-4a42-94d7-d512b1434da3-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"55d5a280-e46f-4a42-94d7-d512b1434da3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 02:42:26.897932 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:26.897891 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/55d5a280-e46f-4a42-94d7-d512b1434da3-config\") pod \"prometheus-k8s-0\" (UID: \"55d5a280-e46f-4a42-94d7-d512b1434da3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 02:42:26.898243 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:26.898220 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/55d5a280-e46f-4a42-94d7-d512b1434da3-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"55d5a280-e46f-4a42-94d7-d512b1434da3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 02:42:26.898847 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:26.898826 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/55d5a280-e46f-4a42-94d7-d512b1434da3-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"55d5a280-e46f-4a42-94d7-d512b1434da3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 02:42:26.898993 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:26.898945 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/55d5a280-e46f-4a42-94d7-d512b1434da3-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"55d5a280-e46f-4a42-94d7-d512b1434da3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 02:42:26.899209 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:26.899186 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/55d5a280-e46f-4a42-94d7-d512b1434da3-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"55d5a280-e46f-4a42-94d7-d512b1434da3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 02:42:26.899541 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:26.899520 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/55d5a280-e46f-4a42-94d7-d512b1434da3-config-out\") pod \"prometheus-k8s-0\" (UID: \"55d5a280-e46f-4a42-94d7-d512b1434da3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 02:42:26.900368 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:26.900325 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/55d5a280-e46f-4a42-94d7-d512b1434da3-web-config\") pod \"prometheus-k8s-0\" (UID: \"55d5a280-e46f-4a42-94d7-d512b1434da3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 02:42:26.901126 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:26.901098 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/55d5a280-e46f-4a42-94d7-d512b1434da3-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"55d5a280-e46f-4a42-94d7-d512b1434da3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 02:42:26.901239 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:26.901217 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ts8fq\" (UniqueName: \"kubernetes.io/projected/55d5a280-e46f-4a42-94d7-d512b1434da3-kube-api-access-ts8fq\") pod \"prometheus-k8s-0\" (UID: \"55d5a280-e46f-4a42-94d7-d512b1434da3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 02:42:27.092434 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:27.092395 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 08 02:42:27.400484 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:27.400310 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 08 02:42:27.418288 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:42:27.418207 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55d5a280_e46f_4a42_94d7_d512b1434da3.slice/crio-23432bcf03565e9c70c6749bb932349ab0c59d3b2f0a23eda46a6d22dbdba0eb WatchSource:0}: Error finding container 23432bcf03565e9c70c6749bb932349ab0c59d3b2f0a23eda46a6d22dbdba0eb: Status 404 returned error can't find the container with id 23432bcf03565e9c70c6749bb932349ab0c59d3b2f0a23eda46a6d22dbdba0eb Sep 08 02:42:27.604329 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:27.604292 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5bcbf954f-v87md" event={"ID":"8910b80c-cfcf-4f9b-bccd-150c285d1cb6","Type":"ContainerStarted","Data":"59ec29df946341af7a63cb4c187dc1198edefec35eb5701216afb9cfcd3e5b1c"} Sep 08 02:42:27.608659 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:27.607289 2564 generic.go:356] "Generic (PLEG): container finished" podID="95b583ca-8a12-442b-b8b6-0cf2d7b39bee" containerID="1a7868c7d17642281c827f7a66927fec234d2d48f0eb1c9b43e1975728da0852" exitCode=0 Sep 08 02:42:27.608659 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:27.607382 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jbz4j" event={"ID":"95b583ca-8a12-442b-b8b6-0cf2d7b39bee","Type":"ContainerDied","Data":"1a7868c7d17642281c827f7a66927fec234d2d48f0eb1c9b43e1975728da0852"} Sep 08 02:42:27.609783 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:27.609707 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-xxswc" event={"ID":"3e00f71c-ee93-4821-8c42-707e62e92162","Type":"ContainerStarted","Data":"e6e1afc166a4f7d435c1d532358d48c58d1145f5a7e8f1eeff99c687303ed40d"} Sep 08 02:42:27.613072 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:27.612961 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"55d5a280-e46f-4a42-94d7-d512b1434da3","Type":"ContainerStarted","Data":"093c69c60ec2e3db4d897bed5cc320582182710f78cdd57ad9f68f65a18cac53"} Sep 08 02:42:27.613072 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:27.613022 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"55d5a280-e46f-4a42-94d7-d512b1434da3","Type":"ContainerStarted","Data":"23432bcf03565e9c70c6749bb932349ab0c59d3b2f0a23eda46a6d22dbdba0eb"} Sep 08 02:42:28.625790 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:28.625751 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jbz4j" event={"ID":"95b583ca-8a12-442b-b8b6-0cf2d7b39bee","Type":"ContainerStarted","Data":"947bc27deff74ba74da46ff54ed432cc50d1e6a8d76fad52a164df033d1d27e2"} Sep 08 02:42:28.626410 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:28.625815 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jbz4j" event={"ID":"95b583ca-8a12-442b-b8b6-0cf2d7b39bee","Type":"ContainerStarted","Data":"76543cf057a60df0ded2bd364ffe2fa3c1b653ce201c7e18a4c9431b0a6eacc4"} Sep 08 02:42:28.628057 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:28.628026 2564 generic.go:356] "Generic (PLEG): container finished" podID="55d5a280-e46f-4a42-94d7-d512b1434da3" containerID="093c69c60ec2e3db4d897bed5cc320582182710f78cdd57ad9f68f65a18cac53" exitCode=0 Sep 08 02:42:28.628207 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:28.628080 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"55d5a280-e46f-4a42-94d7-d512b1434da3","Type":"ContainerDied","Data":"093c69c60ec2e3db4d897bed5cc320582182710f78cdd57ad9f68f65a18cac53"} Sep 08 02:42:28.647220 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:28.647164 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-jbz4j" podStartSLOduration=6.386693542 podStartE2EDuration="8.647144517s" totalImagesPullingTime="2.162556808s" totalInitContainerRuntime="97.894167ms" isStatefulPod=true podCreationTimestamp="2026-09-08 02:42:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 02:42:28.644127731 +0000 UTC m=+113.079101447" watchObservedRunningTime="2026-09-08 02:42:28.647144517 +0000 UTC m=+113.082118214" Sep 08 02:42:30.640761 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:30.640723 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b003111f-3df4-4cb2-bb11-fdb90e882604","Type":"ContainerStarted","Data":"c02701a5be43c762d12cb9758afcbdd60f8df76c5a37831cb5413f5150a22f30"} Sep 08 02:42:30.641143 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:30.640831 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b003111f-3df4-4cb2-bb11-fdb90e882604","Type":"ContainerStarted","Data":"2076d2f15cc4b9c9a00355e2cd516e27130911a8d10504b5548051c21bf99118"} Sep 08 02:42:30.641143 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:30.640876 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b003111f-3df4-4cb2-bb11-fdb90e882604","Type":"ContainerStarted","Data":"96738486a8beb6145d495b716efa5d69d2b6310e6f774857db2a30fe15fee0c1"} Sep 08 02:42:30.641143 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:30.640913 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b003111f-3df4-4cb2-bb11-fdb90e882604","Type":"ContainerStarted","Data":"5c372f2431aee6f127c96992763c0aeaec19160b2e79b653c8cdab91ae6ecc92"} Sep 08 02:42:30.642893 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:30.642865 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5bcbf954f-v87md" event={"ID":"8910b80c-cfcf-4f9b-bccd-150c285d1cb6","Type":"ContainerStarted","Data":"a9d5a25a4e40bbf1d1a2375f5d1a363f0647178bd9446c77ec2538ea6246e0fc"} Sep 08 02:42:30.644642 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:30.644582 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-xxswc" event={"ID":"3e00f71c-ee93-4821-8c42-707e62e92162","Type":"ContainerStarted","Data":"f209fbb9d17b19b278c657c6190390bf72c3813c4fa4b0deb96658e6d48e9a1a"} Sep 08 02:42:30.645185 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:30.644935 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-xxswc" Sep 08 02:42:30.650532 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:30.650492 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-xxswc" Sep 08 02:42:30.662471 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:30.662328 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-5bcbf954f-v87md" podStartSLOduration=3.334861227 podStartE2EDuration="6.662312237s" totalImagesPullingTime="3.32745101s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 02:42:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 02:42:30.660755077 +0000 UTC m=+115.095728780" watchObservedRunningTime="2026-09-08 02:42:30.662312237 +0000 UTC m=+115.097285927" Sep 08 02:42:30.677045 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:30.676994 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-xxswc" podStartSLOduration=2.3533201630000002 podStartE2EDuration="5.676975797s" totalImagesPullingTime="3.323655634s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 02:42:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 02:42:30.675464024 +0000 UTC m=+115.110437716" watchObservedRunningTime="2026-09-08 02:42:30.676975797 +0000 UTC m=+115.111949488" Sep 08 02:42:31.653630 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:31.653590 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b003111f-3df4-4cb2-bb11-fdb90e882604","Type":"ContainerStarted","Data":"b2e6f0a3956bb1d18dce49253c65faf2a7542e5dfcd573503a9262738cb7755c"} Sep 08 02:42:33.665135 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:33.665039 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b003111f-3df4-4cb2-bb11-fdb90e882604","Type":"ContainerStarted","Data":"6281b04d317c31b6c1d30d709ca506c9a5fa994a712e338b8f2509ecbb73a307"} Sep 08 02:42:33.667160 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:33.667139 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"55d5a280-e46f-4a42-94d7-d512b1434da3","Type":"ContainerStarted","Data":"7c5888b2e4d937e374d54d42b081d6067f3fa843e02d959fbc2677ac653296f5"} Sep 08 02:42:33.667279 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:33.667202 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"55d5a280-e46f-4a42-94d7-d512b1434da3","Type":"ContainerStarted","Data":"b222f983dc769c7d509c490899ba81310e3cc19d2a72c79d8dc069b6f439b9f7"} Sep 08 02:42:33.692938 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:33.692860 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=4.983588504 podStartE2EDuration="12.692843445s" totalImagesPullingTime="7.694968221s" totalInitContainerRuntime="14.28672ms" isStatefulPod=false podCreationTimestamp="2026-09-08 02:42:21 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 02:42:33.690748125 +0000 UTC m=+118.125721818" watchObservedRunningTime="2026-09-08 02:42:33.692843445 +0000 UTC m=+118.127817135" Sep 08 02:42:34.586793 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:34.586761 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-h62hl" Sep 08 02:42:35.550026 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:35.549997 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-65c9b7fd44-s9n6g" Sep 08 02:42:36.681913 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:36.681872 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"55d5a280-e46f-4a42-94d7-d512b1434da3","Type":"ContainerStarted","Data":"3b36c43053bcbd0488baf3bbd17c0d2c911d5185e0c3173d403915f47704dff4"} Sep 08 02:42:36.682323 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:36.681944 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"55d5a280-e46f-4a42-94d7-d512b1434da3","Type":"ContainerStarted","Data":"9ace9835b21cec80779b48de7192400a65cb4b60f49d30cd80c7b82a121aff1d"} Sep 08 02:42:36.682323 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:36.681980 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"55d5a280-e46f-4a42-94d7-d512b1434da3","Type":"ContainerStarted","Data":"da876fca8c03452edcb2f4fb513dc0407d145286eb01181915f7013a872ef778"} Sep 08 02:42:36.682323 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:36.682007 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"55d5a280-e46f-4a42-94d7-d512b1434da3","Type":"ContainerStarted","Data":"d4af86f9980e743132f77815ce59613574cd77ae56f6f7a365470e31faa5ec45"} Sep 08 02:42:36.743259 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:36.743178 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.971630526 podStartE2EDuration="10.74315871s" totalImagesPullingTime="6.736522968s" totalInitContainerRuntime="35.005216ms" isStatefulPod=false podCreationTimestamp="2026-09-08 02:42:26 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 02:42:36.741965997 +0000 UTC m=+121.176939680" watchObservedRunningTime="2026-09-08 02:42:36.74315871 +0000 UTC m=+121.178132412" Sep 08 02:42:37.092622 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:37.092579 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 08 02:42:45.211708 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:45.211662 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-5bcbf954f-v87md" Sep 08 02:42:45.212219 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:45.211759 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-5bcbf954f-v87md" Sep 08 02:42:45.973875 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:45.973836 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e0a56211-24ee-40c8-be53-d5e518a5342b-metrics-certs\") pod \"network-metrics-daemon-ckt96\" (UID: \"e0a56211-24ee-40c8-be53-d5e518a5342b\") " pod="openshift-multus/network-metrics-daemon-ckt96" Sep 08 02:42:45.976123 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:45.976096 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e0a56211-24ee-40c8-be53-d5e518a5342b-metrics-certs\") pod \"network-metrics-daemon-ckt96\" (UID: \"e0a56211-24ee-40c8-be53-d5e518a5342b\") " pod="openshift-multus/network-metrics-daemon-ckt96" Sep 08 02:42:46.113961 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:46.113924 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-9xqbz\"" Sep 08 02:42:46.122722 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:46.122702 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ckt96" Sep 08 02:42:46.421285 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:46.421204 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-ckt96"] Sep 08 02:42:46.424135 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:42:46.424098 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0a56211_24ee_40c8_be53_d5e518a5342b.slice/crio-bf55c8fd6cf124065d9146403920c55d4d676dd51ac77bc556480cce2e6523f4 WatchSource:0}: Error finding container bf55c8fd6cf124065d9146403920c55d4d676dd51ac77bc556480cce2e6523f4: Status 404 returned error can't find the container with id bf55c8fd6cf124065d9146403920c55d4d676dd51ac77bc556480cce2e6523f4 Sep 08 02:42:46.725515 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:46.725472 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ckt96" event={"ID":"e0a56211-24ee-40c8-be53-d5e518a5342b","Type":"ContainerStarted","Data":"bf55c8fd6cf124065d9146403920c55d4d676dd51ac77bc556480cce2e6523f4"} Sep 08 02:42:48.736027 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:48.735988 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ckt96" event={"ID":"e0a56211-24ee-40c8-be53-d5e518a5342b","Type":"ContainerStarted","Data":"88b63189849d9d7de3675fdc3035d63215f633cf4dc5ee80cebcf2c472b155b8"} Sep 08 02:42:48.736611 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:48.736056 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ckt96" event={"ID":"e0a56211-24ee-40c8-be53-d5e518a5342b","Type":"ContainerStarted","Data":"d124ccf4ec27b107e0892c21f4f898f0b2f1deaa03ea03a1b10a1bc23f21991a"} Sep 08 02:42:48.751507 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:48.751462 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-ckt96" podStartSLOduration=131.252331015 podStartE2EDuration="2m12.751446861s" totalImagesPullingTime="1.499115846s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 02:40:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 02:42:48.750395687 +0000 UTC m=+133.185369376" watchObservedRunningTime="2026-09-08 02:42:48.751446861 +0000 UTC m=+133.186420551" Sep 08 02:42:50.567242 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:50.567202 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-65c9b7fd44-s9n6g" podUID="c3751a7d-8eae-4e66-a492-b676988ca6ec" containerName="registry" containerID="cri-o://04d6d01f162bb9e79e371b4a5bc3ac158b187dde228d7b850bc110c09eecdb79" gracePeriod=30 Sep 08 02:42:50.747088 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:50.747061 2564 generic.go:356] "Generic (PLEG): container finished" podID="c3751a7d-8eae-4e66-a492-b676988ca6ec" containerID="04d6d01f162bb9e79e371b4a5bc3ac158b187dde228d7b850bc110c09eecdb79" exitCode=0 Sep 08 02:42:50.747232 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:50.747134 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-65c9b7fd44-s9n6g" event={"ID":"c3751a7d-8eae-4e66-a492-b676988ca6ec","Type":"ContainerDied","Data":"04d6d01f162bb9e79e371b4a5bc3ac158b187dde228d7b850bc110c09eecdb79"} Sep 08 02:42:50.804541 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:50.804516 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-65c9b7fd44-s9n6g" Sep 08 02:42:50.918772 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:50.918669 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c3751a7d-8eae-4e66-a492-b676988ca6ec-ca-trust-extracted\") pod \"c3751a7d-8eae-4e66-a492-b676988ca6ec\" (UID: \"c3751a7d-8eae-4e66-a492-b676988ca6ec\") " Sep 08 02:42:50.918772 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:50.918749 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c3751a7d-8eae-4e66-a492-b676988ca6ec-installation-pull-secrets\") pod \"c3751a7d-8eae-4e66-a492-b676988ca6ec\" (UID: \"c3751a7d-8eae-4e66-a492-b676988ca6ec\") " Sep 08 02:42:50.918994 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:50.918856 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c3751a7d-8eae-4e66-a492-b676988ca6ec-trusted-ca\") pod \"c3751a7d-8eae-4e66-a492-b676988ca6ec\" (UID: \"c3751a7d-8eae-4e66-a492-b676988ca6ec\") " Sep 08 02:42:50.918994 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:50.918912 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c3751a7d-8eae-4e66-a492-b676988ca6ec-image-registry-private-configuration\") pod \"c3751a7d-8eae-4e66-a492-b676988ca6ec\" (UID: \"c3751a7d-8eae-4e66-a492-b676988ca6ec\") " Sep 08 02:42:50.918994 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:50.918973 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c3751a7d-8eae-4e66-a492-b676988ca6ec-bound-sa-token\") pod \"c3751a7d-8eae-4e66-a492-b676988ca6ec\" (UID: \"c3751a7d-8eae-4e66-a492-b676988ca6ec\") " Sep 08 02:42:50.919106 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:50.919011 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c3751a7d-8eae-4e66-a492-b676988ca6ec-registry-tls\") pod \"c3751a7d-8eae-4e66-a492-b676988ca6ec\" (UID: \"c3751a7d-8eae-4e66-a492-b676988ca6ec\") " Sep 08 02:42:50.919106 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:50.919046 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x8m4n\" (UniqueName: \"kubernetes.io/projected/c3751a7d-8eae-4e66-a492-b676988ca6ec-kube-api-access-x8m4n\") pod \"c3751a7d-8eae-4e66-a492-b676988ca6ec\" (UID: \"c3751a7d-8eae-4e66-a492-b676988ca6ec\") " Sep 08 02:42:50.919106 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:50.919073 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c3751a7d-8eae-4e66-a492-b676988ca6ec-registry-certificates\") pod \"c3751a7d-8eae-4e66-a492-b676988ca6ec\" (UID: \"c3751a7d-8eae-4e66-a492-b676988ca6ec\") " Sep 08 02:42:50.919248 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:50.919184 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c3751a7d-8eae-4e66-a492-b676988ca6ec-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "c3751a7d-8eae-4e66-a492-b676988ca6ec" (UID: "c3751a7d-8eae-4e66-a492-b676988ca6ec"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 08 02:42:50.919594 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:50.919568 2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c3751a7d-8eae-4e66-a492-b676988ca6ec-trusted-ca\") on node \"ip-10-0-137-161.ec2.internal\" DevicePath \"\"" Sep 08 02:42:50.919723 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:50.919567 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c3751a7d-8eae-4e66-a492-b676988ca6ec-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "c3751a7d-8eae-4e66-a492-b676988ca6ec" (UID: "c3751a7d-8eae-4e66-a492-b676988ca6ec"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 08 02:42:50.921794 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:50.921759 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c3751a7d-8eae-4e66-a492-b676988ca6ec-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "c3751a7d-8eae-4e66-a492-b676988ca6ec" (UID: "c3751a7d-8eae-4e66-a492-b676988ca6ec"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 02:42:50.921794 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:50.921764 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c3751a7d-8eae-4e66-a492-b676988ca6ec-kube-api-access-x8m4n" (OuterVolumeSpecName: "kube-api-access-x8m4n") pod "c3751a7d-8eae-4e66-a492-b676988ca6ec" (UID: "c3751a7d-8eae-4e66-a492-b676988ca6ec"). InnerVolumeSpecName "kube-api-access-x8m4n". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 08 02:42:50.921965 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:50.921834 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c3751a7d-8eae-4e66-a492-b676988ca6ec-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "c3751a7d-8eae-4e66-a492-b676988ca6ec" (UID: "c3751a7d-8eae-4e66-a492-b676988ca6ec"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 08 02:42:50.921965 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:50.921851 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c3751a7d-8eae-4e66-a492-b676988ca6ec-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "c3751a7d-8eae-4e66-a492-b676988ca6ec" (UID: "c3751a7d-8eae-4e66-a492-b676988ca6ec"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 08 02:42:50.921965 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:50.921879 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c3751a7d-8eae-4e66-a492-b676988ca6ec-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "c3751a7d-8eae-4e66-a492-b676988ca6ec" (UID: "c3751a7d-8eae-4e66-a492-b676988ca6ec"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 02:42:50.928168 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:50.928139 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3751a7d-8eae-4e66-a492-b676988ca6ec-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "c3751a7d-8eae-4e66-a492-b676988ca6ec" (UID: "c3751a7d-8eae-4e66-a492-b676988ca6ec"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 08 02:42:51.020708 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:51.020665 2564 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c3751a7d-8eae-4e66-a492-b676988ca6ec-registry-tls\") on node \"ip-10-0-137-161.ec2.internal\" DevicePath \"\"" Sep 08 02:42:51.020708 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:51.020700 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x8m4n\" (UniqueName: \"kubernetes.io/projected/c3751a7d-8eae-4e66-a492-b676988ca6ec-kube-api-access-x8m4n\") on node \"ip-10-0-137-161.ec2.internal\" DevicePath \"\"" Sep 08 02:42:51.020708 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:51.020710 2564 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c3751a7d-8eae-4e66-a492-b676988ca6ec-registry-certificates\") on node \"ip-10-0-137-161.ec2.internal\" DevicePath \"\"" Sep 08 02:42:51.020708 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:51.020719 2564 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c3751a7d-8eae-4e66-a492-b676988ca6ec-ca-trust-extracted\") on node \"ip-10-0-137-161.ec2.internal\" DevicePath \"\"" Sep 08 02:42:51.020960 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:51.020728 2564 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c3751a7d-8eae-4e66-a492-b676988ca6ec-installation-pull-secrets\") on node \"ip-10-0-137-161.ec2.internal\" DevicePath \"\"" Sep 08 02:42:51.020960 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:51.020740 2564 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c3751a7d-8eae-4e66-a492-b676988ca6ec-image-registry-private-configuration\") on node \"ip-10-0-137-161.ec2.internal\" DevicePath \"\"" Sep 08 02:42:51.020960 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:51.020750 2564 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c3751a7d-8eae-4e66-a492-b676988ca6ec-bound-sa-token\") on node \"ip-10-0-137-161.ec2.internal\" DevicePath \"\"" Sep 08 02:42:51.752378 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:51.752338 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-65c9b7fd44-s9n6g" Sep 08 02:42:51.752772 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:51.752334 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-65c9b7fd44-s9n6g" event={"ID":"c3751a7d-8eae-4e66-a492-b676988ca6ec","Type":"ContainerDied","Data":"97d037d254cf877bc4a0b5c8b88d50003ec29374f8060a232501069e32717978"} Sep 08 02:42:51.752772 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:51.752479 2564 scope.go:117] "RemoveContainer" containerID="04d6d01f162bb9e79e371b4a5bc3ac158b187dde228d7b850bc110c09eecdb79" Sep 08 02:42:51.773854 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:51.773826 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-65c9b7fd44-s9n6g"] Sep 08 02:42:51.780682 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:51.780657 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-65c9b7fd44-s9n6g"] Sep 08 02:42:52.105827 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:42:52.105753 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c3751a7d-8eae-4e66-a492-b676988ca6ec" path="/var/lib/kubelet/pods/c3751a7d-8eae-4e66-a492-b676988ca6ec/volumes" Sep 08 02:43:05.217137 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:05.217102 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-5bcbf954f-v87md" Sep 08 02:43:05.224199 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:05.224162 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-5bcbf954f-v87md" Sep 08 02:43:14.849202 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:14.849169 2564 generic.go:356] "Generic (PLEG): container finished" podID="6b2ac5ed-3b3c-44a6-afe9-25d6c8bfb4da" containerID="5c0076fb4a1dc8fb226c96706585e3de94d549bb70a5f2be7aaca543f27d647d" exitCode=0 Sep 08 02:43:14.849598 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:14.849243 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-2842s" event={"ID":"6b2ac5ed-3b3c-44a6-afe9-25d6c8bfb4da","Type":"ContainerDied","Data":"5c0076fb4a1dc8fb226c96706585e3de94d549bb70a5f2be7aaca543f27d647d"} Sep 08 02:43:14.849652 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:14.849611 2564 scope.go:117] "RemoveContainer" containerID="5c0076fb4a1dc8fb226c96706585e3de94d549bb70a5f2be7aaca543f27d647d" Sep 08 02:43:15.855066 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:15.855031 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-2842s" event={"ID":"6b2ac5ed-3b3c-44a6-afe9-25d6c8bfb4da","Type":"ContainerStarted","Data":"5c571560cbede984b6219e939d8b8596475862252e0da3a735de192b8e25e17c"} Sep 08 02:43:27.094451 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:27.092884 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Sep 08 02:43:27.125064 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:27.125030 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Sep 08 02:43:27.926008 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:27.921808 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 08 02:43:40.787058 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:40.787018 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 08 02:43:40.787480 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:40.787292 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="b003111f-3df4-4cb2-bb11-fdb90e882604" containerName="alertmanager" containerID="cri-o://5c372f2431aee6f127c96992763c0aeaec19160b2e79b653c8cdab91ae6ecc92" gracePeriod=120 Sep 08 02:43:40.787480 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:40.787400 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="b003111f-3df4-4cb2-bb11-fdb90e882604" containerName="kube-rbac-proxy-metric" containerID="cri-o://b2e6f0a3956bb1d18dce49253c65faf2a7542e5dfcd573503a9262738cb7755c" gracePeriod=120 Sep 08 02:43:40.787480 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:40.787429 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="b003111f-3df4-4cb2-bb11-fdb90e882604" containerName="prom-label-proxy" containerID="cri-o://6281b04d317c31b6c1d30d709ca506c9a5fa994a712e338b8f2509ecbb73a307" gracePeriod=120 Sep 08 02:43:40.787675 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:40.787462 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="b003111f-3df4-4cb2-bb11-fdb90e882604" containerName="kube-rbac-proxy-web" containerID="cri-o://2076d2f15cc4b9c9a00355e2cd516e27130911a8d10504b5548051c21bf99118" gracePeriod=120 Sep 08 02:43:40.787675 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:40.787490 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="b003111f-3df4-4cb2-bb11-fdb90e882604" containerName="config-reloader" containerID="cri-o://96738486a8beb6145d495b716efa5d69d2b6310e6f774857db2a30fe15fee0c1" gracePeriod=120 Sep 08 02:43:40.787675 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:40.787495 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="b003111f-3df4-4cb2-bb11-fdb90e882604" containerName="kube-rbac-proxy" containerID="cri-o://c02701a5be43c762d12cb9758afcbdd60f8df76c5a37831cb5413f5150a22f30" gracePeriod=120 Sep 08 02:43:40.956314 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:40.956285 2564 generic.go:356] "Generic (PLEG): container finished" podID="b003111f-3df4-4cb2-bb11-fdb90e882604" containerID="6281b04d317c31b6c1d30d709ca506c9a5fa994a712e338b8f2509ecbb73a307" exitCode=0 Sep 08 02:43:40.956314 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:40.956307 2564 generic.go:356] "Generic (PLEG): container finished" podID="b003111f-3df4-4cb2-bb11-fdb90e882604" containerID="b2e6f0a3956bb1d18dce49253c65faf2a7542e5dfcd573503a9262738cb7755c" exitCode=0 Sep 08 02:43:40.956314 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:40.956314 2564 generic.go:356] "Generic (PLEG): container finished" podID="b003111f-3df4-4cb2-bb11-fdb90e882604" containerID="c02701a5be43c762d12cb9758afcbdd60f8df76c5a37831cb5413f5150a22f30" exitCode=0 Sep 08 02:43:40.956314 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:40.956319 2564 generic.go:356] "Generic (PLEG): container finished" podID="b003111f-3df4-4cb2-bb11-fdb90e882604" containerID="96738486a8beb6145d495b716efa5d69d2b6310e6f774857db2a30fe15fee0c1" exitCode=0 Sep 08 02:43:40.956314 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:40.956325 2564 generic.go:356] "Generic (PLEG): container finished" podID="b003111f-3df4-4cb2-bb11-fdb90e882604" containerID="5c372f2431aee6f127c96992763c0aeaec19160b2e79b653c8cdab91ae6ecc92" exitCode=0 Sep 08 02:43:40.956625 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:40.956371 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b003111f-3df4-4cb2-bb11-fdb90e882604","Type":"ContainerDied","Data":"6281b04d317c31b6c1d30d709ca506c9a5fa994a712e338b8f2509ecbb73a307"} Sep 08 02:43:40.956625 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:40.956426 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b003111f-3df4-4cb2-bb11-fdb90e882604","Type":"ContainerDied","Data":"b2e6f0a3956bb1d18dce49253c65faf2a7542e5dfcd573503a9262738cb7755c"} Sep 08 02:43:40.956625 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:40.956451 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b003111f-3df4-4cb2-bb11-fdb90e882604","Type":"ContainerDied","Data":"c02701a5be43c762d12cb9758afcbdd60f8df76c5a37831cb5413f5150a22f30"} Sep 08 02:43:40.956625 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:40.956475 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b003111f-3df4-4cb2-bb11-fdb90e882604","Type":"ContainerDied","Data":"96738486a8beb6145d495b716efa5d69d2b6310e6f774857db2a30fe15fee0c1"} Sep 08 02:43:40.956625 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:40.956497 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b003111f-3df4-4cb2-bb11-fdb90e882604","Type":"ContainerDied","Data":"5c372f2431aee6f127c96992763c0aeaec19160b2e79b653c8cdab91ae6ecc92"} Sep 08 02:43:41.965136 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:41.965103 2564 generic.go:356] "Generic (PLEG): container finished" podID="b003111f-3df4-4cb2-bb11-fdb90e882604" containerID="2076d2f15cc4b9c9a00355e2cd516e27130911a8d10504b5548051c21bf99118" exitCode=0 Sep 08 02:43:41.965489 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:41.965166 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b003111f-3df4-4cb2-bb11-fdb90e882604","Type":"ContainerDied","Data":"2076d2f15cc4b9c9a00355e2cd516e27130911a8d10504b5548051c21bf99118"} Sep 08 02:43:42.034574 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:42.034546 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 08 02:43:42.172304 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:42.172223 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b003111f-3df4-4cb2-bb11-fdb90e882604-secret-alertmanager-kube-rbac-proxy\") pod \"b003111f-3df4-4cb2-bb11-fdb90e882604\" (UID: \"b003111f-3df4-4cb2-bb11-fdb90e882604\") " Sep 08 02:43:42.172304 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:42.172256 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b003111f-3df4-4cb2-bb11-fdb90e882604-secret-alertmanager-kube-rbac-proxy-web\") pod \"b003111f-3df4-4cb2-bb11-fdb90e882604\" (UID: \"b003111f-3df4-4cb2-bb11-fdb90e882604\") " Sep 08 02:43:42.172304 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:42.172284 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b003111f-3df4-4cb2-bb11-fdb90e882604-config-volume\") pod \"b003111f-3df4-4cb2-bb11-fdb90e882604\" (UID: \"b003111f-3df4-4cb2-bb11-fdb90e882604\") " Sep 08 02:43:42.172611 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:42.172310 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b003111f-3df4-4cb2-bb11-fdb90e882604-tls-assets\") pod \"b003111f-3df4-4cb2-bb11-fdb90e882604\" (UID: \"b003111f-3df4-4cb2-bb11-fdb90e882604\") " Sep 08 02:43:42.172611 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:42.172361 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b003111f-3df4-4cb2-bb11-fdb90e882604-secret-alertmanager-main-tls\") pod \"b003111f-3df4-4cb2-bb11-fdb90e882604\" (UID: \"b003111f-3df4-4cb2-bb11-fdb90e882604\") " Sep 08 02:43:42.172611 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:42.172420 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f7c62\" (UniqueName: \"kubernetes.io/projected/b003111f-3df4-4cb2-bb11-fdb90e882604-kube-api-access-f7c62\") pod \"b003111f-3df4-4cb2-bb11-fdb90e882604\" (UID: \"b003111f-3df4-4cb2-bb11-fdb90e882604\") " Sep 08 02:43:42.172611 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:42.172458 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b003111f-3df4-4cb2-bb11-fdb90e882604-alertmanager-main-db\") pod \"b003111f-3df4-4cb2-bb11-fdb90e882604\" (UID: \"b003111f-3df4-4cb2-bb11-fdb90e882604\") " Sep 08 02:43:42.172611 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:42.172491 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b003111f-3df4-4cb2-bb11-fdb90e882604-cluster-tls-config\") pod \"b003111f-3df4-4cb2-bb11-fdb90e882604\" (UID: \"b003111f-3df4-4cb2-bb11-fdb90e882604\") " Sep 08 02:43:42.172611 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:42.172538 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b003111f-3df4-4cb2-bb11-fdb90e882604-web-config\") pod \"b003111f-3df4-4cb2-bb11-fdb90e882604\" (UID: \"b003111f-3df4-4cb2-bb11-fdb90e882604\") " Sep 08 02:43:42.172611 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:42.172563 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b003111f-3df4-4cb2-bb11-fdb90e882604-config-out\") pod \"b003111f-3df4-4cb2-bb11-fdb90e882604\" (UID: \"b003111f-3df4-4cb2-bb11-fdb90e882604\") " Sep 08 02:43:42.172611 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:42.172599 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b003111f-3df4-4cb2-bb11-fdb90e882604-metrics-client-ca\") pod \"b003111f-3df4-4cb2-bb11-fdb90e882604\" (UID: \"b003111f-3df4-4cb2-bb11-fdb90e882604\") " Sep 08 02:43:42.173012 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:42.172629 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b003111f-3df4-4cb2-bb11-fdb90e882604-alertmanager-trusted-ca-bundle\") pod \"b003111f-3df4-4cb2-bb11-fdb90e882604\" (UID: \"b003111f-3df4-4cb2-bb11-fdb90e882604\") " Sep 08 02:43:42.173012 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:42.172667 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b003111f-3df4-4cb2-bb11-fdb90e882604-secret-alertmanager-kube-rbac-proxy-metric\") pod \"b003111f-3df4-4cb2-bb11-fdb90e882604\" (UID: \"b003111f-3df4-4cb2-bb11-fdb90e882604\") " Sep 08 02:43:42.173651 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:42.173210 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b003111f-3df4-4cb2-bb11-fdb90e882604-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "b003111f-3df4-4cb2-bb11-fdb90e882604" (UID: "b003111f-3df4-4cb2-bb11-fdb90e882604"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 08 02:43:42.173651 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:42.173515 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b003111f-3df4-4cb2-bb11-fdb90e882604-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "b003111f-3df4-4cb2-bb11-fdb90e882604" (UID: "b003111f-3df4-4cb2-bb11-fdb90e882604"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 08 02:43:42.173651 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:42.173616 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b003111f-3df4-4cb2-bb11-fdb90e882604-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "b003111f-3df4-4cb2-bb11-fdb90e882604" (UID: "b003111f-3df4-4cb2-bb11-fdb90e882604"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 08 02:43:42.175414 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:42.175223 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b003111f-3df4-4cb2-bb11-fdb90e882604-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "b003111f-3df4-4cb2-bb11-fdb90e882604" (UID: "b003111f-3df4-4cb2-bb11-fdb90e882604"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 02:43:42.175414 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:42.175340 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b003111f-3df4-4cb2-bb11-fdb90e882604-config-volume" (OuterVolumeSpecName: "config-volume") pod "b003111f-3df4-4cb2-bb11-fdb90e882604" (UID: "b003111f-3df4-4cb2-bb11-fdb90e882604"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 02:43:42.175594 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:42.175431 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b003111f-3df4-4cb2-bb11-fdb90e882604-kube-api-access-f7c62" (OuterVolumeSpecName: "kube-api-access-f7c62") pod "b003111f-3df4-4cb2-bb11-fdb90e882604" (UID: "b003111f-3df4-4cb2-bb11-fdb90e882604"). InnerVolumeSpecName "kube-api-access-f7c62". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 08 02:43:42.175594 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:42.175459 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b003111f-3df4-4cb2-bb11-fdb90e882604-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "b003111f-3df4-4cb2-bb11-fdb90e882604" (UID: "b003111f-3df4-4cb2-bb11-fdb90e882604"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 02:43:42.175953 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:42.175929 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b003111f-3df4-4cb2-bb11-fdb90e882604-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "b003111f-3df4-4cb2-bb11-fdb90e882604" (UID: "b003111f-3df4-4cb2-bb11-fdb90e882604"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 02:43:42.176370 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:42.176319 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b003111f-3df4-4cb2-bb11-fdb90e882604-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "b003111f-3df4-4cb2-bb11-fdb90e882604" (UID: "b003111f-3df4-4cb2-bb11-fdb90e882604"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 02:43:42.176463 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:42.176383 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b003111f-3df4-4cb2-bb11-fdb90e882604-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "b003111f-3df4-4cb2-bb11-fdb90e882604" (UID: "b003111f-3df4-4cb2-bb11-fdb90e882604"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 08 02:43:42.176750 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:42.176730 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b003111f-3df4-4cb2-bb11-fdb90e882604-config-out" (OuterVolumeSpecName: "config-out") pod "b003111f-3df4-4cb2-bb11-fdb90e882604" (UID: "b003111f-3df4-4cb2-bb11-fdb90e882604"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 08 02:43:42.181051 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:42.181029 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b003111f-3df4-4cb2-bb11-fdb90e882604-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "b003111f-3df4-4cb2-bb11-fdb90e882604" (UID: "b003111f-3df4-4cb2-bb11-fdb90e882604"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 02:43:42.187162 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:42.187139 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b003111f-3df4-4cb2-bb11-fdb90e882604-web-config" (OuterVolumeSpecName: "web-config") pod "b003111f-3df4-4cb2-bb11-fdb90e882604" (UID: "b003111f-3df4-4cb2-bb11-fdb90e882604"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 02:43:42.273734 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:42.273700 2564 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b003111f-3df4-4cb2-bb11-fdb90e882604-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-137-161.ec2.internal\" DevicePath \"\"" Sep 08 02:43:42.273734 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:42.273734 2564 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b003111f-3df4-4cb2-bb11-fdb90e882604-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-137-161.ec2.internal\" DevicePath \"\"" Sep 08 02:43:42.273958 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:42.273753 2564 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b003111f-3df4-4cb2-bb11-fdb90e882604-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-137-161.ec2.internal\" DevicePath \"\"" Sep 08 02:43:42.273958 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:42.273762 2564 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b003111f-3df4-4cb2-bb11-fdb90e882604-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-137-161.ec2.internal\" DevicePath \"\"" Sep 08 02:43:42.273958 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:42.273772 2564 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b003111f-3df4-4cb2-bb11-fdb90e882604-config-volume\") on node \"ip-10-0-137-161.ec2.internal\" DevicePath \"\"" Sep 08 02:43:42.273958 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:42.273781 2564 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b003111f-3df4-4cb2-bb11-fdb90e882604-tls-assets\") on node \"ip-10-0-137-161.ec2.internal\" DevicePath \"\"" Sep 08 02:43:42.273958 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:42.273792 2564 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b003111f-3df4-4cb2-bb11-fdb90e882604-secret-alertmanager-main-tls\") on node \"ip-10-0-137-161.ec2.internal\" DevicePath \"\"" Sep 08 02:43:42.273958 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:42.273805 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f7c62\" (UniqueName: \"kubernetes.io/projected/b003111f-3df4-4cb2-bb11-fdb90e882604-kube-api-access-f7c62\") on node \"ip-10-0-137-161.ec2.internal\" DevicePath \"\"" Sep 08 02:43:42.273958 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:42.273819 2564 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b003111f-3df4-4cb2-bb11-fdb90e882604-alertmanager-main-db\") on node \"ip-10-0-137-161.ec2.internal\" DevicePath \"\"" Sep 08 02:43:42.273958 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:42.273830 2564 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b003111f-3df4-4cb2-bb11-fdb90e882604-cluster-tls-config\") on node \"ip-10-0-137-161.ec2.internal\" DevicePath \"\"" Sep 08 02:43:42.273958 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:42.273838 2564 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b003111f-3df4-4cb2-bb11-fdb90e882604-web-config\") on node \"ip-10-0-137-161.ec2.internal\" DevicePath \"\"" Sep 08 02:43:42.273958 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:42.273846 2564 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b003111f-3df4-4cb2-bb11-fdb90e882604-config-out\") on node \"ip-10-0-137-161.ec2.internal\" DevicePath \"\"" Sep 08 02:43:42.273958 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:42.273855 2564 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b003111f-3df4-4cb2-bb11-fdb90e882604-metrics-client-ca\") on node \"ip-10-0-137-161.ec2.internal\" DevicePath \"\"" Sep 08 02:43:42.975065 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:42.975038 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 08 02:43:42.975518 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:42.975038 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b003111f-3df4-4cb2-bb11-fdb90e882604","Type":"ContainerDied","Data":"9e2aa427a9e169d83863a1e7ac9f1636fce43a5b402724aa39922a748010fc23"} Sep 08 02:43:42.975518 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:42.975206 2564 scope.go:117] "RemoveContainer" containerID="6281b04d317c31b6c1d30d709ca506c9a5fa994a712e338b8f2509ecbb73a307" Sep 08 02:43:42.983341 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:42.983319 2564 scope.go:117] "RemoveContainer" containerID="b2e6f0a3956bb1d18dce49253c65faf2a7542e5dfcd573503a9262738cb7755c" Sep 08 02:43:42.990192 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:42.990169 2564 scope.go:117] "RemoveContainer" containerID="c02701a5be43c762d12cb9758afcbdd60f8df76c5a37831cb5413f5150a22f30" Sep 08 02:43:42.997249 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:42.997229 2564 scope.go:117] "RemoveContainer" containerID="2076d2f15cc4b9c9a00355e2cd516e27130911a8d10504b5548051c21bf99118" Sep 08 02:43:42.998497 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:42.998473 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 08 02:43:43.002794 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:43.002775 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 08 02:43:43.005214 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:43.005194 2564 scope.go:117] "RemoveContainer" containerID="96738486a8beb6145d495b716efa5d69d2b6310e6f774857db2a30fe15fee0c1" Sep 08 02:43:43.011914 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:43.011896 2564 scope.go:117] "RemoveContainer" containerID="5c372f2431aee6f127c96992763c0aeaec19160b2e79b653c8cdab91ae6ecc92" Sep 08 02:43:43.018747 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:43.018724 2564 scope.go:117] "RemoveContainer" containerID="f7cd46297471ab9e7e5f768bb02a54420a88cf4cc5f8441eceeff4092d74b19f" Sep 08 02:43:43.027927 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:43.027902 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 08 02:43:43.028305 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:43.028288 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3751a7d-8eae-4e66-a492-b676988ca6ec" containerName="registry" Sep 08 02:43:43.028402 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:43.028307 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3751a7d-8eae-4e66-a492-b676988ca6ec" containerName="registry" Sep 08 02:43:43.028402 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:43.028319 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b003111f-3df4-4cb2-bb11-fdb90e882604" containerName="config-reloader" Sep 08 02:43:43.028402 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:43.028327 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="b003111f-3df4-4cb2-bb11-fdb90e882604" containerName="config-reloader" Sep 08 02:43:43.028402 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:43.028336 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b003111f-3df4-4cb2-bb11-fdb90e882604" containerName="kube-rbac-proxy-web" Sep 08 02:43:43.028402 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:43.028344 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="b003111f-3df4-4cb2-bb11-fdb90e882604" containerName="kube-rbac-proxy-web" Sep 08 02:43:43.028402 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:43.028378 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b003111f-3df4-4cb2-bb11-fdb90e882604" containerName="init-config-reloader" Sep 08 02:43:43.028402 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:43.028387 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="b003111f-3df4-4cb2-bb11-fdb90e882604" containerName="init-config-reloader" Sep 08 02:43:43.028402 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:43.028395 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b003111f-3df4-4cb2-bb11-fdb90e882604" containerName="kube-rbac-proxy-metric" Sep 08 02:43:43.028402 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:43.028402 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="b003111f-3df4-4cb2-bb11-fdb90e882604" containerName="kube-rbac-proxy-metric" Sep 08 02:43:43.028817 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:43.028423 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b003111f-3df4-4cb2-bb11-fdb90e882604" containerName="alertmanager" Sep 08 02:43:43.028817 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:43.028432 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="b003111f-3df4-4cb2-bb11-fdb90e882604" containerName="alertmanager" Sep 08 02:43:43.028817 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:43.028441 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b003111f-3df4-4cb2-bb11-fdb90e882604" containerName="prom-label-proxy" Sep 08 02:43:43.028817 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:43.028449 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="b003111f-3df4-4cb2-bb11-fdb90e882604" containerName="prom-label-proxy" Sep 08 02:43:43.028817 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:43.028462 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b003111f-3df4-4cb2-bb11-fdb90e882604" containerName="kube-rbac-proxy" Sep 08 02:43:43.028817 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:43.028471 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="b003111f-3df4-4cb2-bb11-fdb90e882604" containerName="kube-rbac-proxy" Sep 08 02:43:43.028817 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:43.028534 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="c3751a7d-8eae-4e66-a492-b676988ca6ec" containerName="registry" Sep 08 02:43:43.028817 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:43.028545 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="b003111f-3df4-4cb2-bb11-fdb90e882604" containerName="alertmanager" Sep 08 02:43:43.028817 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:43.028555 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="b003111f-3df4-4cb2-bb11-fdb90e882604" containerName="prom-label-proxy" Sep 08 02:43:43.028817 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:43.028565 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="b003111f-3df4-4cb2-bb11-fdb90e882604" containerName="kube-rbac-proxy" Sep 08 02:43:43.028817 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:43.028572 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="b003111f-3df4-4cb2-bb11-fdb90e882604" containerName="config-reloader" Sep 08 02:43:43.028817 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:43.028580 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="b003111f-3df4-4cb2-bb11-fdb90e882604" containerName="kube-rbac-proxy-web" Sep 08 02:43:43.028817 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:43.028591 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="b003111f-3df4-4cb2-bb11-fdb90e882604" containerName="kube-rbac-proxy-metric" Sep 08 02:43:43.051402 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:43.051371 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 08 02:43:43.051584 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:43.051494 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 08 02:43:43.055222 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:43.055191 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Sep 08 02:43:43.055379 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:43.055237 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Sep 08 02:43:43.055379 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:43.055197 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Sep 08 02:43:43.055510 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:43.055399 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-675ms\"" Sep 08 02:43:43.055563 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:43.055529 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Sep 08 02:43:43.055563 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:43.055544 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Sep 08 02:43:43.055882 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:43.055860 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Sep 08 02:43:43.055882 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:43.055869 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Sep 08 02:43:43.056056 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:43.056039 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Sep 08 02:43:43.071881 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:43.071856 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Sep 08 02:43:43.180991 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:43.180884 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e5cb7c2c-af0b-442d-b4c2-3a1b7ddbda20-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e5cb7c2c-af0b-442d-b4c2-3a1b7ddbda20\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 02:43:43.180991 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:43.180938 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e5cb7c2c-af0b-442d-b4c2-3a1b7ddbda20-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e5cb7c2c-af0b-442d-b4c2-3a1b7ddbda20\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 02:43:43.180991 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:43.180996 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e5cb7c2c-af0b-442d-b4c2-3a1b7ddbda20-web-config\") pod \"alertmanager-main-0\" (UID: \"e5cb7c2c-af0b-442d-b4c2-3a1b7ddbda20\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 02:43:43.181236 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:43.181029 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e5cb7c2c-af0b-442d-b4c2-3a1b7ddbda20-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e5cb7c2c-af0b-442d-b4c2-3a1b7ddbda20\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 02:43:43.181236 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:43.181048 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e5cb7c2c-af0b-442d-b4c2-3a1b7ddbda20-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e5cb7c2c-af0b-442d-b4c2-3a1b7ddbda20\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 02:43:43.181236 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:43.181078 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2n94n\" (UniqueName: \"kubernetes.io/projected/e5cb7c2c-af0b-442d-b4c2-3a1b7ddbda20-kube-api-access-2n94n\") pod \"alertmanager-main-0\" (UID: \"e5cb7c2c-af0b-442d-b4c2-3a1b7ddbda20\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 02:43:43.181236 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:43.181104 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e5cb7c2c-af0b-442d-b4c2-3a1b7ddbda20-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e5cb7c2c-af0b-442d-b4c2-3a1b7ddbda20\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 02:43:43.181236 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:43.181136 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e5cb7c2c-af0b-442d-b4c2-3a1b7ddbda20-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e5cb7c2c-af0b-442d-b4c2-3a1b7ddbda20\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 02:43:43.181236 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:43.181162 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e5cb7c2c-af0b-442d-b4c2-3a1b7ddbda20-config-volume\") pod \"alertmanager-main-0\" (UID: \"e5cb7c2c-af0b-442d-b4c2-3a1b7ddbda20\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 02:43:43.181236 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:43.181200 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e5cb7c2c-af0b-442d-b4c2-3a1b7ddbda20-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e5cb7c2c-af0b-442d-b4c2-3a1b7ddbda20\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 02:43:43.181236 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:43.181223 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e5cb7c2c-af0b-442d-b4c2-3a1b7ddbda20-config-out\") pod \"alertmanager-main-0\" (UID: \"e5cb7c2c-af0b-442d-b4c2-3a1b7ddbda20\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 02:43:43.181499 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:43.181245 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e5cb7c2c-af0b-442d-b4c2-3a1b7ddbda20-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e5cb7c2c-af0b-442d-b4c2-3a1b7ddbda20\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 02:43:43.181499 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:43.181282 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e5cb7c2c-af0b-442d-b4c2-3a1b7ddbda20-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e5cb7c2c-af0b-442d-b4c2-3a1b7ddbda20\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 02:43:43.282228 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:43.282183 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e5cb7c2c-af0b-442d-b4c2-3a1b7ddbda20-config-out\") pod \"alertmanager-main-0\" (UID: \"e5cb7c2c-af0b-442d-b4c2-3a1b7ddbda20\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 02:43:43.282228 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:43.282227 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e5cb7c2c-af0b-442d-b4c2-3a1b7ddbda20-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e5cb7c2c-af0b-442d-b4c2-3a1b7ddbda20\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 02:43:43.282501 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:43.282246 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e5cb7c2c-af0b-442d-b4c2-3a1b7ddbda20-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e5cb7c2c-af0b-442d-b4c2-3a1b7ddbda20\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 02:43:43.282501 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:43.282274 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e5cb7c2c-af0b-442d-b4c2-3a1b7ddbda20-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e5cb7c2c-af0b-442d-b4c2-3a1b7ddbda20\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 02:43:43.282501 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:43.282303 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e5cb7c2c-af0b-442d-b4c2-3a1b7ddbda20-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e5cb7c2c-af0b-442d-b4c2-3a1b7ddbda20\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 02:43:43.282501 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:43.282333 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e5cb7c2c-af0b-442d-b4c2-3a1b7ddbda20-web-config\") pod \"alertmanager-main-0\" (UID: \"e5cb7c2c-af0b-442d-b4c2-3a1b7ddbda20\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 02:43:43.282501 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:43.282389 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e5cb7c2c-af0b-442d-b4c2-3a1b7ddbda20-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e5cb7c2c-af0b-442d-b4c2-3a1b7ddbda20\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 02:43:43.282501 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:43.282419 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e5cb7c2c-af0b-442d-b4c2-3a1b7ddbda20-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e5cb7c2c-af0b-442d-b4c2-3a1b7ddbda20\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 02:43:43.283396 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:43.283368 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e5cb7c2c-af0b-442d-b4c2-3a1b7ddbda20-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e5cb7c2c-af0b-442d-b4c2-3a1b7ddbda20\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 02:43:43.283600 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:43.283580 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2n94n\" (UniqueName: \"kubernetes.io/projected/e5cb7c2c-af0b-442d-b4c2-3a1b7ddbda20-kube-api-access-2n94n\") pod \"alertmanager-main-0\" (UID: \"e5cb7c2c-af0b-442d-b4c2-3a1b7ddbda20\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 02:43:43.283727 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:43.283709 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e5cb7c2c-af0b-442d-b4c2-3a1b7ddbda20-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e5cb7c2c-af0b-442d-b4c2-3a1b7ddbda20\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 02:43:43.283847 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:43.283832 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e5cb7c2c-af0b-442d-b4c2-3a1b7ddbda20-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e5cb7c2c-af0b-442d-b4c2-3a1b7ddbda20\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 02:43:43.283971 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:43.283606 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e5cb7c2c-af0b-442d-b4c2-3a1b7ddbda20-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e5cb7c2c-af0b-442d-b4c2-3a1b7ddbda20\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 02:43:43.284140 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:43.283962 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e5cb7c2c-af0b-442d-b4c2-3a1b7ddbda20-config-volume\") pod \"alertmanager-main-0\" (UID: \"e5cb7c2c-af0b-442d-b4c2-3a1b7ddbda20\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 02:43:43.284274 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:43.284254 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e5cb7c2c-af0b-442d-b4c2-3a1b7ddbda20-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e5cb7c2c-af0b-442d-b4c2-3a1b7ddbda20\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 02:43:43.285558 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:43.285528 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e5cb7c2c-af0b-442d-b4c2-3a1b7ddbda20-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e5cb7c2c-af0b-442d-b4c2-3a1b7ddbda20\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 02:43:43.285663 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:43.285595 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e5cb7c2c-af0b-442d-b4c2-3a1b7ddbda20-web-config\") pod \"alertmanager-main-0\" (UID: \"e5cb7c2c-af0b-442d-b4c2-3a1b7ddbda20\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 02:43:43.285663 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:43.285616 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e5cb7c2c-af0b-442d-b4c2-3a1b7ddbda20-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e5cb7c2c-af0b-442d-b4c2-3a1b7ddbda20\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 02:43:43.285779 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:43.285684 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e5cb7c2c-af0b-442d-b4c2-3a1b7ddbda20-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e5cb7c2c-af0b-442d-b4c2-3a1b7ddbda20\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 02:43:43.285878 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:43.285854 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e5cb7c2c-af0b-442d-b4c2-3a1b7ddbda20-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e5cb7c2c-af0b-442d-b4c2-3a1b7ddbda20\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 02:43:43.285941 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:43.285898 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e5cb7c2c-af0b-442d-b4c2-3a1b7ddbda20-config-out\") pod \"alertmanager-main-0\" (UID: \"e5cb7c2c-af0b-442d-b4c2-3a1b7ddbda20\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 02:43:43.286279 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:43.286261 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e5cb7c2c-af0b-442d-b4c2-3a1b7ddbda20-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e5cb7c2c-af0b-442d-b4c2-3a1b7ddbda20\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 02:43:43.286439 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:43.286421 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e5cb7c2c-af0b-442d-b4c2-3a1b7ddbda20-config-volume\") pod \"alertmanager-main-0\" (UID: \"e5cb7c2c-af0b-442d-b4c2-3a1b7ddbda20\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 02:43:43.286863 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:43.286846 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e5cb7c2c-af0b-442d-b4c2-3a1b7ddbda20-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e5cb7c2c-af0b-442d-b4c2-3a1b7ddbda20\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 02:43:43.287563 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:43.287543 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e5cb7c2c-af0b-442d-b4c2-3a1b7ddbda20-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e5cb7c2c-af0b-442d-b4c2-3a1b7ddbda20\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 02:43:43.291767 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:43.291746 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2n94n\" (UniqueName: \"kubernetes.io/projected/e5cb7c2c-af0b-442d-b4c2-3a1b7ddbda20-kube-api-access-2n94n\") pod \"alertmanager-main-0\" (UID: \"e5cb7c2c-af0b-442d-b4c2-3a1b7ddbda20\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 02:43:43.372891 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:43.372838 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 08 02:43:43.651711 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:43.651685 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 08 02:43:43.652955 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:43:43.652928 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5cb7c2c_af0b_442d_b4c2_3a1b7ddbda20.slice/crio-6cad4f7e772e20ad592ba85b56c436ec99c2d3181138dc3f56f8c75a1889c63c WatchSource:0}: Error finding container 6cad4f7e772e20ad592ba85b56c436ec99c2d3181138dc3f56f8c75a1889c63c: Status 404 returned error can't find the container with id 6cad4f7e772e20ad592ba85b56c436ec99c2d3181138dc3f56f8c75a1889c63c Sep 08 02:43:43.980485 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:43.980453 2564 generic.go:356] "Generic (PLEG): container finished" podID="e5cb7c2c-af0b-442d-b4c2-3a1b7ddbda20" containerID="bbc8f4093257e8d9acccda27b855c2d2ccf9614d98c03d4b4801ef97858373de" exitCode=0 Sep 08 02:43:43.980908 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:43.980544 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e5cb7c2c-af0b-442d-b4c2-3a1b7ddbda20","Type":"ContainerDied","Data":"bbc8f4093257e8d9acccda27b855c2d2ccf9614d98c03d4b4801ef97858373de"} Sep 08 02:43:43.980908 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:43.980633 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e5cb7c2c-af0b-442d-b4c2-3a1b7ddbda20","Type":"ContainerStarted","Data":"6cad4f7e772e20ad592ba85b56c436ec99c2d3181138dc3f56f8c75a1889c63c"} Sep 08 02:43:44.106070 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:44.106044 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b003111f-3df4-4cb2-bb11-fdb90e882604" path="/var/lib/kubelet/pods/b003111f-3df4-4cb2-bb11-fdb90e882604/volumes" Sep 08 02:43:44.813585 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:44.813548 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-6799d75bf-zzb6j"] Sep 08 02:43:44.815880 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:44.815864 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6799d75bf-zzb6j" Sep 08 02:43:44.818276 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:44.818252 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Sep 08 02:43:44.818454 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:44.818437 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Sep 08 02:43:44.818699 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:44.818683 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Sep 08 02:43:44.818765 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:44.818710 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Sep 08 02:43:44.818822 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:44.818764 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-wbf94\"" Sep 08 02:43:44.818822 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:44.818780 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Sep 08 02:43:44.823635 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:44.823616 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Sep 08 02:43:44.829366 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:44.829332 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6799d75bf-zzb6j"] Sep 08 02:43:44.898106 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:44.898067 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eb3bd1cc-6a72-470c-bfd3-5917aaf42767-serving-certs-ca-bundle\") pod \"telemeter-client-6799d75bf-zzb6j\" (UID: \"eb3bd1cc-6a72-470c-bfd3-5917aaf42767\") " pod="openshift-monitoring/telemeter-client-6799d75bf-zzb6j" Sep 08 02:43:44.898246 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:44.898111 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/eb3bd1cc-6a72-470c-bfd3-5917aaf42767-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6799d75bf-zzb6j\" (UID: \"eb3bd1cc-6a72-470c-bfd3-5917aaf42767\") " pod="openshift-monitoring/telemeter-client-6799d75bf-zzb6j" Sep 08 02:43:44.898246 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:44.898143 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/eb3bd1cc-6a72-470c-bfd3-5917aaf42767-telemeter-client-tls\") pod \"telemeter-client-6799d75bf-zzb6j\" (UID: \"eb3bd1cc-6a72-470c-bfd3-5917aaf42767\") " pod="openshift-monitoring/telemeter-client-6799d75bf-zzb6j" Sep 08 02:43:44.898246 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:44.898198 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/eb3bd1cc-6a72-470c-bfd3-5917aaf42767-secret-telemeter-client\") pod \"telemeter-client-6799d75bf-zzb6j\" (UID: \"eb3bd1cc-6a72-470c-bfd3-5917aaf42767\") " pod="openshift-monitoring/telemeter-client-6799d75bf-zzb6j" Sep 08 02:43:44.898246 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:44.898219 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vsvdh\" (UniqueName: \"kubernetes.io/projected/eb3bd1cc-6a72-470c-bfd3-5917aaf42767-kube-api-access-vsvdh\") pod \"telemeter-client-6799d75bf-zzb6j\" (UID: \"eb3bd1cc-6a72-470c-bfd3-5917aaf42767\") " pod="openshift-monitoring/telemeter-client-6799d75bf-zzb6j" Sep 08 02:43:44.898438 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:44.898265 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/eb3bd1cc-6a72-470c-bfd3-5917aaf42767-federate-client-tls\") pod \"telemeter-client-6799d75bf-zzb6j\" (UID: \"eb3bd1cc-6a72-470c-bfd3-5917aaf42767\") " pod="openshift-monitoring/telemeter-client-6799d75bf-zzb6j" Sep 08 02:43:44.898438 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:44.898283 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eb3bd1cc-6a72-470c-bfd3-5917aaf42767-metrics-client-ca\") pod \"telemeter-client-6799d75bf-zzb6j\" (UID: \"eb3bd1cc-6a72-470c-bfd3-5917aaf42767\") " pod="openshift-monitoring/telemeter-client-6799d75bf-zzb6j" Sep 08 02:43:44.898438 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:44.898308 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eb3bd1cc-6a72-470c-bfd3-5917aaf42767-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6799d75bf-zzb6j\" (UID: \"eb3bd1cc-6a72-470c-bfd3-5917aaf42767\") " pod="openshift-monitoring/telemeter-client-6799d75bf-zzb6j" Sep 08 02:43:44.989009 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:44.988968 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e5cb7c2c-af0b-442d-b4c2-3a1b7ddbda20","Type":"ContainerStarted","Data":"66e245deed9855e0f1aad4fc3a2336452af78e742d7b90340e09e3b2dc9f8807"} Sep 08 02:43:44.989420 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:44.989032 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e5cb7c2c-af0b-442d-b4c2-3a1b7ddbda20","Type":"ContainerStarted","Data":"22da836acbad07ffe475138d5fce1be33266d4a921914419cd6750de68a6fffe"} Sep 08 02:43:44.989420 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:44.989057 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e5cb7c2c-af0b-442d-b4c2-3a1b7ddbda20","Type":"ContainerStarted","Data":"82e99cdfe85812813a49c6faebc02b17761887d015fe67b2bae5d32ed12c1a4b"} Sep 08 02:43:44.989420 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:44.989083 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e5cb7c2c-af0b-442d-b4c2-3a1b7ddbda20","Type":"ContainerStarted","Data":"d40ff544eb946144622583a78f135c4039adbec08a9e09e65809a532a807434d"} Sep 08 02:43:44.989420 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:44.989111 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e5cb7c2c-af0b-442d-b4c2-3a1b7ddbda20","Type":"ContainerStarted","Data":"730372fd40364d0d414e7ff75133fc16fa5008ecfa0fb42f86b66ef2db5978a0"} Sep 08 02:43:44.989420 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:44.989132 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e5cb7c2c-af0b-442d-b4c2-3a1b7ddbda20","Type":"ContainerStarted","Data":"4523b14e54fd70a3e5a4fa3e5de6c08f87c747c54df674ec6b10bb05da23551e"} Sep 08 02:43:44.998684 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:44.998652 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/eb3bd1cc-6a72-470c-bfd3-5917aaf42767-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6799d75bf-zzb6j\" (UID: \"eb3bd1cc-6a72-470c-bfd3-5917aaf42767\") " pod="openshift-monitoring/telemeter-client-6799d75bf-zzb6j" Sep 08 02:43:44.998758 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:44.998696 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/eb3bd1cc-6a72-470c-bfd3-5917aaf42767-telemeter-client-tls\") pod \"telemeter-client-6799d75bf-zzb6j\" (UID: \"eb3bd1cc-6a72-470c-bfd3-5917aaf42767\") " pod="openshift-monitoring/telemeter-client-6799d75bf-zzb6j" Sep 08 02:43:44.998758 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:44.998739 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/eb3bd1cc-6a72-470c-bfd3-5917aaf42767-secret-telemeter-client\") pod \"telemeter-client-6799d75bf-zzb6j\" (UID: \"eb3bd1cc-6a72-470c-bfd3-5917aaf42767\") " pod="openshift-monitoring/telemeter-client-6799d75bf-zzb6j" Sep 08 02:43:44.998830 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:44.998760 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vsvdh\" (UniqueName: \"kubernetes.io/projected/eb3bd1cc-6a72-470c-bfd3-5917aaf42767-kube-api-access-vsvdh\") pod \"telemeter-client-6799d75bf-zzb6j\" (UID: \"eb3bd1cc-6a72-470c-bfd3-5917aaf42767\") " pod="openshift-monitoring/telemeter-client-6799d75bf-zzb6j" Sep 08 02:43:44.998830 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:44.998790 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/eb3bd1cc-6a72-470c-bfd3-5917aaf42767-federate-client-tls\") pod \"telemeter-client-6799d75bf-zzb6j\" (UID: \"eb3bd1cc-6a72-470c-bfd3-5917aaf42767\") " pod="openshift-monitoring/telemeter-client-6799d75bf-zzb6j" Sep 08 02:43:44.998928 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:44.998861 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eb3bd1cc-6a72-470c-bfd3-5917aaf42767-metrics-client-ca\") pod \"telemeter-client-6799d75bf-zzb6j\" (UID: \"eb3bd1cc-6a72-470c-bfd3-5917aaf42767\") " pod="openshift-monitoring/telemeter-client-6799d75bf-zzb6j" Sep 08 02:43:44.998967 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:44.998921 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eb3bd1cc-6a72-470c-bfd3-5917aaf42767-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6799d75bf-zzb6j\" (UID: \"eb3bd1cc-6a72-470c-bfd3-5917aaf42767\") " pod="openshift-monitoring/telemeter-client-6799d75bf-zzb6j" Sep 08 02:43:44.999025 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:44.998977 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eb3bd1cc-6a72-470c-bfd3-5917aaf42767-serving-certs-ca-bundle\") pod \"telemeter-client-6799d75bf-zzb6j\" (UID: \"eb3bd1cc-6a72-470c-bfd3-5917aaf42767\") " pod="openshift-monitoring/telemeter-client-6799d75bf-zzb6j" Sep 08 02:43:44.999604 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:44.999581 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eb3bd1cc-6a72-470c-bfd3-5917aaf42767-metrics-client-ca\") pod \"telemeter-client-6799d75bf-zzb6j\" (UID: \"eb3bd1cc-6a72-470c-bfd3-5917aaf42767\") " pod="openshift-monitoring/telemeter-client-6799d75bf-zzb6j" Sep 08 02:43:44.999742 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:44.999687 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eb3bd1cc-6a72-470c-bfd3-5917aaf42767-serving-certs-ca-bundle\") pod \"telemeter-client-6799d75bf-zzb6j\" (UID: \"eb3bd1cc-6a72-470c-bfd3-5917aaf42767\") " pod="openshift-monitoring/telemeter-client-6799d75bf-zzb6j" Sep 08 02:43:44.999873 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:44.999849 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eb3bd1cc-6a72-470c-bfd3-5917aaf42767-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6799d75bf-zzb6j\" (UID: \"eb3bd1cc-6a72-470c-bfd3-5917aaf42767\") " pod="openshift-monitoring/telemeter-client-6799d75bf-zzb6j" Sep 08 02:43:45.001377 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:45.001322 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/eb3bd1cc-6a72-470c-bfd3-5917aaf42767-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6799d75bf-zzb6j\" (UID: \"eb3bd1cc-6a72-470c-bfd3-5917aaf42767\") " pod="openshift-monitoring/telemeter-client-6799d75bf-zzb6j" Sep 08 02:43:45.001377 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:45.001373 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/eb3bd1cc-6a72-470c-bfd3-5917aaf42767-secret-telemeter-client\") pod \"telemeter-client-6799d75bf-zzb6j\" (UID: \"eb3bd1cc-6a72-470c-bfd3-5917aaf42767\") " pod="openshift-monitoring/telemeter-client-6799d75bf-zzb6j" Sep 08 02:43:45.001526 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:45.001430 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/eb3bd1cc-6a72-470c-bfd3-5917aaf42767-federate-client-tls\") pod \"telemeter-client-6799d75bf-zzb6j\" (UID: \"eb3bd1cc-6a72-470c-bfd3-5917aaf42767\") " pod="openshift-monitoring/telemeter-client-6799d75bf-zzb6j" Sep 08 02:43:45.001755 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:45.001729 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/eb3bd1cc-6a72-470c-bfd3-5917aaf42767-telemeter-client-tls\") pod \"telemeter-client-6799d75bf-zzb6j\" (UID: \"eb3bd1cc-6a72-470c-bfd3-5917aaf42767\") " pod="openshift-monitoring/telemeter-client-6799d75bf-zzb6j" Sep 08 02:43:45.006233 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:45.006209 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vsvdh\" (UniqueName: \"kubernetes.io/projected/eb3bd1cc-6a72-470c-bfd3-5917aaf42767-kube-api-access-vsvdh\") pod \"telemeter-client-6799d75bf-zzb6j\" (UID: \"eb3bd1cc-6a72-470c-bfd3-5917aaf42767\") " pod="openshift-monitoring/telemeter-client-6799d75bf-zzb6j" Sep 08 02:43:45.015853 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:45.015810 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=1.9956981379999998 podStartE2EDuration="2.015796696s" totalImagesPullingTime="0s" totalInitContainerRuntime="20.098558ms" isStatefulPod=false podCreationTimestamp="2026-09-08 02:43:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 02:43:45.013565605 +0000 UTC m=+189.448539325" watchObservedRunningTime="2026-09-08 02:43:45.015796696 +0000 UTC m=+189.450770385" Sep 08 02:43:45.099590 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:45.099488 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 08 02:43:45.099806 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:45.099775 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="55d5a280-e46f-4a42-94d7-d512b1434da3" containerName="prometheus" containerID="cri-o://b222f983dc769c7d509c490899ba81310e3cc19d2a72c79d8dc069b6f439b9f7" gracePeriod=600 Sep 08 02:43:45.100074 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:45.099798 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="55d5a280-e46f-4a42-94d7-d512b1434da3" containerName="thanos-sidecar" containerID="cri-o://d4af86f9980e743132f77815ce59613574cd77ae56f6f7a365470e31faa5ec45" gracePeriod=600 Sep 08 02:43:45.100195 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:45.099809 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="55d5a280-e46f-4a42-94d7-d512b1434da3" containerName="kube-rbac-proxy-web" containerID="cri-o://da876fca8c03452edcb2f4fb513dc0407d145286eb01181915f7013a872ef778" gracePeriod=600 Sep 08 02:43:45.100266 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:45.099816 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="55d5a280-e46f-4a42-94d7-d512b1434da3" containerName="kube-rbac-proxy-thanos" containerID="cri-o://3b36c43053bcbd0488baf3bbd17c0d2c911d5185e0c3173d403915f47704dff4" gracePeriod=600 Sep 08 02:43:45.100266 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:45.099816 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="55d5a280-e46f-4a42-94d7-d512b1434da3" containerName="config-reloader" containerID="cri-o://7c5888b2e4d937e374d54d42b081d6067f3fa843e02d959fbc2677ac653296f5" gracePeriod=600 Sep 08 02:43:45.100400 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:45.099830 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="55d5a280-e46f-4a42-94d7-d512b1434da3" containerName="kube-rbac-proxy" containerID="cri-o://9ace9835b21cec80779b48de7192400a65cb4b60f49d30cd80c7b82a121aff1d" gracePeriod=600 Sep 08 02:43:45.125283 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:45.125252 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6799d75bf-zzb6j" Sep 08 02:43:45.400791 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:45.400719 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6799d75bf-zzb6j"] Sep 08 02:43:45.402939 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:43:45.402905 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb3bd1cc_6a72_470c_bfd3_5917aaf42767.slice/crio-21eddbd6e67c4e958a45014468ef24d6b84dabb62bf40de13528dba9b47a2754 WatchSource:0}: Error finding container 21eddbd6e67c4e958a45014468ef24d6b84dabb62bf40de13528dba9b47a2754: Status 404 returned error can't find the container with id 21eddbd6e67c4e958a45014468ef24d6b84dabb62bf40de13528dba9b47a2754 Sep 08 02:43:45.998071 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:45.998035 2564 generic.go:356] "Generic (PLEG): container finished" podID="55d5a280-e46f-4a42-94d7-d512b1434da3" containerID="3b36c43053bcbd0488baf3bbd17c0d2c911d5185e0c3173d403915f47704dff4" exitCode=0 Sep 08 02:43:45.998071 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:45.998064 2564 generic.go:356] "Generic (PLEG): container finished" podID="55d5a280-e46f-4a42-94d7-d512b1434da3" containerID="9ace9835b21cec80779b48de7192400a65cb4b60f49d30cd80c7b82a121aff1d" exitCode=0 Sep 08 02:43:45.998071 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:45.998074 2564 generic.go:356] "Generic (PLEG): container finished" podID="55d5a280-e46f-4a42-94d7-d512b1434da3" containerID="d4af86f9980e743132f77815ce59613574cd77ae56f6f7a365470e31faa5ec45" exitCode=0 Sep 08 02:43:45.998071 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:45.998083 2564 generic.go:356] "Generic (PLEG): container finished" podID="55d5a280-e46f-4a42-94d7-d512b1434da3" containerID="7c5888b2e4d937e374d54d42b081d6067f3fa843e02d959fbc2677ac653296f5" exitCode=0 Sep 08 02:43:45.998071 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:45.998091 2564 generic.go:356] "Generic (PLEG): container finished" podID="55d5a280-e46f-4a42-94d7-d512b1434da3" containerID="b222f983dc769c7d509c490899ba81310e3cc19d2a72c79d8dc069b6f439b9f7" exitCode=0 Sep 08 02:43:45.998756 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:45.998115 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"55d5a280-e46f-4a42-94d7-d512b1434da3","Type":"ContainerDied","Data":"3b36c43053bcbd0488baf3bbd17c0d2c911d5185e0c3173d403915f47704dff4"} Sep 08 02:43:45.998756 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:45.998213 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"55d5a280-e46f-4a42-94d7-d512b1434da3","Type":"ContainerDied","Data":"9ace9835b21cec80779b48de7192400a65cb4b60f49d30cd80c7b82a121aff1d"} Sep 08 02:43:45.998756 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:45.998258 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"55d5a280-e46f-4a42-94d7-d512b1434da3","Type":"ContainerDied","Data":"d4af86f9980e743132f77815ce59613574cd77ae56f6f7a365470e31faa5ec45"} Sep 08 02:43:45.998756 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:45.998299 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"55d5a280-e46f-4a42-94d7-d512b1434da3","Type":"ContainerDied","Data":"7c5888b2e4d937e374d54d42b081d6067f3fa843e02d959fbc2677ac653296f5"} Sep 08 02:43:45.998756 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:45.998340 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"55d5a280-e46f-4a42-94d7-d512b1434da3","Type":"ContainerDied","Data":"b222f983dc769c7d509c490899ba81310e3cc19d2a72c79d8dc069b6f439b9f7"} Sep 08 02:43:45.999471 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:45.999445 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6799d75bf-zzb6j" event={"ID":"eb3bd1cc-6a72-470c-bfd3-5917aaf42767","Type":"ContainerStarted","Data":"21eddbd6e67c4e958a45014468ef24d6b84dabb62bf40de13528dba9b47a2754"} Sep 08 02:43:46.370080 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:46.370049 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 08 02:43:46.513591 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:46.513555 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/55d5a280-e46f-4a42-94d7-d512b1434da3-configmap-metrics-client-ca\") pod \"55d5a280-e46f-4a42-94d7-d512b1434da3\" (UID: \"55d5a280-e46f-4a42-94d7-d512b1434da3\") " Sep 08 02:43:46.513796 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:46.513604 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ts8fq\" (UniqueName: \"kubernetes.io/projected/55d5a280-e46f-4a42-94d7-d512b1434da3-kube-api-access-ts8fq\") pod \"55d5a280-e46f-4a42-94d7-d512b1434da3\" (UID: \"55d5a280-e46f-4a42-94d7-d512b1434da3\") " Sep 08 02:43:46.513796 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:46.513634 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/55d5a280-e46f-4a42-94d7-d512b1434da3-configmap-kubelet-serving-ca-bundle\") pod \"55d5a280-e46f-4a42-94d7-d512b1434da3\" (UID: \"55d5a280-e46f-4a42-94d7-d512b1434da3\") " Sep 08 02:43:46.513796 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:46.513671 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/55d5a280-e46f-4a42-94d7-d512b1434da3-prometheus-k8s-rulefiles-1\") pod \"55d5a280-e46f-4a42-94d7-d512b1434da3\" (UID: \"55d5a280-e46f-4a42-94d7-d512b1434da3\") " Sep 08 02:43:46.513796 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:46.513698 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/55d5a280-e46f-4a42-94d7-d512b1434da3-config-out\") pod \"55d5a280-e46f-4a42-94d7-d512b1434da3\" (UID: \"55d5a280-e46f-4a42-94d7-d512b1434da3\") " Sep 08 02:43:46.513796 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:46.513725 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/55d5a280-e46f-4a42-94d7-d512b1434da3-prometheus-k8s-rulefiles-0\") pod \"55d5a280-e46f-4a42-94d7-d512b1434da3\" (UID: \"55d5a280-e46f-4a42-94d7-d512b1434da3\") " Sep 08 02:43:46.513796 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:46.513760 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/55d5a280-e46f-4a42-94d7-d512b1434da3-secret-kube-rbac-proxy\") pod \"55d5a280-e46f-4a42-94d7-d512b1434da3\" (UID: \"55d5a280-e46f-4a42-94d7-d512b1434da3\") " Sep 08 02:43:46.513796 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:46.513786 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/55d5a280-e46f-4a42-94d7-d512b1434da3-secret-metrics-client-certs\") pod \"55d5a280-e46f-4a42-94d7-d512b1434da3\" (UID: \"55d5a280-e46f-4a42-94d7-d512b1434da3\") " Sep 08 02:43:46.514151 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:46.513812 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/55d5a280-e46f-4a42-94d7-d512b1434da3-secret-prometheus-k8s-tls\") pod \"55d5a280-e46f-4a42-94d7-d512b1434da3\" (UID: \"55d5a280-e46f-4a42-94d7-d512b1434da3\") " Sep 08 02:43:46.514151 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:46.513840 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/55d5a280-e46f-4a42-94d7-d512b1434da3-prometheus-trusted-ca-bundle\") pod \"55d5a280-e46f-4a42-94d7-d512b1434da3\" (UID: \"55d5a280-e46f-4a42-94d7-d512b1434da3\") " Sep 08 02:43:46.514151 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:46.513863 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/55d5a280-e46f-4a42-94d7-d512b1434da3-config\") pod \"55d5a280-e46f-4a42-94d7-d512b1434da3\" (UID: \"55d5a280-e46f-4a42-94d7-d512b1434da3\") " Sep 08 02:43:46.514151 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:46.513886 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/55d5a280-e46f-4a42-94d7-d512b1434da3-tls-assets\") pod \"55d5a280-e46f-4a42-94d7-d512b1434da3\" (UID: \"55d5a280-e46f-4a42-94d7-d512b1434da3\") " Sep 08 02:43:46.514151 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:46.513923 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/55d5a280-e46f-4a42-94d7-d512b1434da3-prometheus-k8s-db\") pod \"55d5a280-e46f-4a42-94d7-d512b1434da3\" (UID: \"55d5a280-e46f-4a42-94d7-d512b1434da3\") " Sep 08 02:43:46.514151 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:46.513972 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/55d5a280-e46f-4a42-94d7-d512b1434da3-secret-grpc-tls\") pod \"55d5a280-e46f-4a42-94d7-d512b1434da3\" (UID: \"55d5a280-e46f-4a42-94d7-d512b1434da3\") " Sep 08 02:43:46.514151 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:46.513999 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/55d5a280-e46f-4a42-94d7-d512b1434da3-configmap-serving-certs-ca-bundle\") pod \"55d5a280-e46f-4a42-94d7-d512b1434da3\" (UID: \"55d5a280-e46f-4a42-94d7-d512b1434da3\") " Sep 08 02:43:46.514151 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:46.514038 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/55d5a280-e46f-4a42-94d7-d512b1434da3-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"55d5a280-e46f-4a42-94d7-d512b1434da3\" (UID: \"55d5a280-e46f-4a42-94d7-d512b1434da3\") " Sep 08 02:43:46.514151 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:46.514064 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/55d5a280-e46f-4a42-94d7-d512b1434da3-thanos-prometheus-http-client-file\") pod \"55d5a280-e46f-4a42-94d7-d512b1434da3\" (UID: \"55d5a280-e46f-4a42-94d7-d512b1434da3\") " Sep 08 02:43:46.514151 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:46.514101 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/55d5a280-e46f-4a42-94d7-d512b1434da3-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"55d5a280-e46f-4a42-94d7-d512b1434da3\" (UID: \"55d5a280-e46f-4a42-94d7-d512b1434da3\") " Sep 08 02:43:46.514151 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:46.514148 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/55d5a280-e46f-4a42-94d7-d512b1434da3-prometheus-k8s-rulefiles-2\") pod \"55d5a280-e46f-4a42-94d7-d512b1434da3\" (UID: \"55d5a280-e46f-4a42-94d7-d512b1434da3\") " Sep 08 02:43:46.514686 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:46.514173 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/55d5a280-e46f-4a42-94d7-d512b1434da3-web-config\") pod \"55d5a280-e46f-4a42-94d7-d512b1434da3\" (UID: \"55d5a280-e46f-4a42-94d7-d512b1434da3\") " Sep 08 02:43:46.514686 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:46.514169 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/55d5a280-e46f-4a42-94d7-d512b1434da3-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "55d5a280-e46f-4a42-94d7-d512b1434da3" (UID: "55d5a280-e46f-4a42-94d7-d512b1434da3"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 08 02:43:46.514686 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:46.514202 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/55d5a280-e46f-4a42-94d7-d512b1434da3-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "55d5a280-e46f-4a42-94d7-d512b1434da3" (UID: "55d5a280-e46f-4a42-94d7-d512b1434da3"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 08 02:43:46.514686 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:46.514243 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/55d5a280-e46f-4a42-94d7-d512b1434da3-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "55d5a280-e46f-4a42-94d7-d512b1434da3" (UID: "55d5a280-e46f-4a42-94d7-d512b1434da3"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 08 02:43:46.514686 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:46.514458 2564 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/55d5a280-e46f-4a42-94d7-d512b1434da3-configmap-metrics-client-ca\") on node \"ip-10-0-137-161.ec2.internal\" DevicePath \"\"" Sep 08 02:43:46.514686 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:46.514480 2564 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/55d5a280-e46f-4a42-94d7-d512b1434da3-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-137-161.ec2.internal\" DevicePath \"\"" Sep 08 02:43:46.514686 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:46.514495 2564 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/55d5a280-e46f-4a42-94d7-d512b1434da3-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-137-161.ec2.internal\" DevicePath \"\"" Sep 08 02:43:46.515961 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:46.515535 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/55d5a280-e46f-4a42-94d7-d512b1434da3-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "55d5a280-e46f-4a42-94d7-d512b1434da3" (UID: "55d5a280-e46f-4a42-94d7-d512b1434da3"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 08 02:43:46.516526 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:46.516235 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/55d5a280-e46f-4a42-94d7-d512b1434da3-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "55d5a280-e46f-4a42-94d7-d512b1434da3" (UID: "55d5a280-e46f-4a42-94d7-d512b1434da3"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 08 02:43:46.518218 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:46.518190 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/55d5a280-e46f-4a42-94d7-d512b1434da3-kube-api-access-ts8fq" (OuterVolumeSpecName: "kube-api-access-ts8fq") pod "55d5a280-e46f-4a42-94d7-d512b1434da3" (UID: "55d5a280-e46f-4a42-94d7-d512b1434da3"). InnerVolumeSpecName "kube-api-access-ts8fq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 08 02:43:46.518305 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:46.518237 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/55d5a280-e46f-4a42-94d7-d512b1434da3-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "55d5a280-e46f-4a42-94d7-d512b1434da3" (UID: "55d5a280-e46f-4a42-94d7-d512b1434da3"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 08 02:43:46.518305 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:46.518247 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/55d5a280-e46f-4a42-94d7-d512b1434da3-config" (OuterVolumeSpecName: "config") pod "55d5a280-e46f-4a42-94d7-d512b1434da3" (UID: "55d5a280-e46f-4a42-94d7-d512b1434da3"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 02:43:46.518450 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:46.518299 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/55d5a280-e46f-4a42-94d7-d512b1434da3-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "55d5a280-e46f-4a42-94d7-d512b1434da3" (UID: "55d5a280-e46f-4a42-94d7-d512b1434da3"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 02:43:46.518450 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:46.518434 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/55d5a280-e46f-4a42-94d7-d512b1434da3-config-out" (OuterVolumeSpecName: "config-out") pod "55d5a280-e46f-4a42-94d7-d512b1434da3" (UID: "55d5a280-e46f-4a42-94d7-d512b1434da3"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 08 02:43:46.518765 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:46.518736 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/55d5a280-e46f-4a42-94d7-d512b1434da3-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "55d5a280-e46f-4a42-94d7-d512b1434da3" (UID: "55d5a280-e46f-4a42-94d7-d512b1434da3"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 08 02:43:46.518835 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:46.518784 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/55d5a280-e46f-4a42-94d7-d512b1434da3-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "55d5a280-e46f-4a42-94d7-d512b1434da3" (UID: "55d5a280-e46f-4a42-94d7-d512b1434da3"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 08 02:43:46.518897 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:46.518872 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/55d5a280-e46f-4a42-94d7-d512b1434da3-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "55d5a280-e46f-4a42-94d7-d512b1434da3" (UID: "55d5a280-e46f-4a42-94d7-d512b1434da3"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 02:43:46.519080 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:46.519042 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/55d5a280-e46f-4a42-94d7-d512b1434da3-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "55d5a280-e46f-4a42-94d7-d512b1434da3" (UID: "55d5a280-e46f-4a42-94d7-d512b1434da3"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 02:43:46.519477 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:46.519448 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/55d5a280-e46f-4a42-94d7-d512b1434da3-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "55d5a280-e46f-4a42-94d7-d512b1434da3" (UID: "55d5a280-e46f-4a42-94d7-d512b1434da3"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 02:43:46.520045 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:46.519972 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/55d5a280-e46f-4a42-94d7-d512b1434da3-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "55d5a280-e46f-4a42-94d7-d512b1434da3" (UID: "55d5a280-e46f-4a42-94d7-d512b1434da3"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 08 02:43:46.520295 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:46.520273 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/55d5a280-e46f-4a42-94d7-d512b1434da3-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "55d5a280-e46f-4a42-94d7-d512b1434da3" (UID: "55d5a280-e46f-4a42-94d7-d512b1434da3"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 02:43:46.520797 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:46.520769 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/55d5a280-e46f-4a42-94d7-d512b1434da3-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "55d5a280-e46f-4a42-94d7-d512b1434da3" (UID: "55d5a280-e46f-4a42-94d7-d512b1434da3"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 02:43:46.521062 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:46.521046 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/55d5a280-e46f-4a42-94d7-d512b1434da3-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "55d5a280-e46f-4a42-94d7-d512b1434da3" (UID: "55d5a280-e46f-4a42-94d7-d512b1434da3"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 02:43:46.531891 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:46.531842 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/55d5a280-e46f-4a42-94d7-d512b1434da3-web-config" (OuterVolumeSpecName: "web-config") pod "55d5a280-e46f-4a42-94d7-d512b1434da3" (UID: "55d5a280-e46f-4a42-94d7-d512b1434da3"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 02:43:46.615342 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:46.615300 2564 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/55d5a280-e46f-4a42-94d7-d512b1434da3-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-137-161.ec2.internal\" DevicePath \"\"" Sep 08 02:43:46.615342 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:46.615341 2564 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/55d5a280-e46f-4a42-94d7-d512b1434da3-secret-kube-rbac-proxy\") on node \"ip-10-0-137-161.ec2.internal\" DevicePath \"\"" Sep 08 02:43:46.615569 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:46.615373 2564 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/55d5a280-e46f-4a42-94d7-d512b1434da3-secret-metrics-client-certs\") on node \"ip-10-0-137-161.ec2.internal\" DevicePath \"\"" Sep 08 02:43:46.615569 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:46.615390 2564 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/55d5a280-e46f-4a42-94d7-d512b1434da3-secret-prometheus-k8s-tls\") on node \"ip-10-0-137-161.ec2.internal\" DevicePath \"\"" Sep 08 02:43:46.615569 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:46.615399 2564 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/55d5a280-e46f-4a42-94d7-d512b1434da3-prometheus-trusted-ca-bundle\") on node \"ip-10-0-137-161.ec2.internal\" DevicePath \"\"" Sep 08 02:43:46.615569 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:46.615410 2564 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/55d5a280-e46f-4a42-94d7-d512b1434da3-config\") on node \"ip-10-0-137-161.ec2.internal\" DevicePath \"\"" Sep 08 02:43:46.615569 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:46.615418 2564 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/55d5a280-e46f-4a42-94d7-d512b1434da3-tls-assets\") on node \"ip-10-0-137-161.ec2.internal\" DevicePath \"\"" Sep 08 02:43:46.615569 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:46.615428 2564 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/55d5a280-e46f-4a42-94d7-d512b1434da3-prometheus-k8s-db\") on node \"ip-10-0-137-161.ec2.internal\" DevicePath \"\"" Sep 08 02:43:46.615569 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:46.615436 2564 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/55d5a280-e46f-4a42-94d7-d512b1434da3-secret-grpc-tls\") on node \"ip-10-0-137-161.ec2.internal\" DevicePath \"\"" Sep 08 02:43:46.615569 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:46.615449 2564 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/55d5a280-e46f-4a42-94d7-d512b1434da3-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-137-161.ec2.internal\" DevicePath \"\"" Sep 08 02:43:46.615569 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:46.615464 2564 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/55d5a280-e46f-4a42-94d7-d512b1434da3-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-137-161.ec2.internal\" DevicePath \"\"" Sep 08 02:43:46.615569 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:46.615479 2564 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/55d5a280-e46f-4a42-94d7-d512b1434da3-thanos-prometheus-http-client-file\") on node \"ip-10-0-137-161.ec2.internal\" DevicePath \"\"" Sep 08 02:43:46.615569 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:46.615490 2564 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/55d5a280-e46f-4a42-94d7-d512b1434da3-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-137-161.ec2.internal\" DevicePath \"\"" Sep 08 02:43:46.615569 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:46.615502 2564 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/55d5a280-e46f-4a42-94d7-d512b1434da3-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-137-161.ec2.internal\" DevicePath \"\"" Sep 08 02:43:46.615569 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:46.615515 2564 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/55d5a280-e46f-4a42-94d7-d512b1434da3-web-config\") on node \"ip-10-0-137-161.ec2.internal\" DevicePath \"\"" Sep 08 02:43:46.615569 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:46.615528 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ts8fq\" (UniqueName: \"kubernetes.io/projected/55d5a280-e46f-4a42-94d7-d512b1434da3-kube-api-access-ts8fq\") on node \"ip-10-0-137-161.ec2.internal\" DevicePath \"\"" Sep 08 02:43:46.615569 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:46.615541 2564 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/55d5a280-e46f-4a42-94d7-d512b1434da3-config-out\") on node \"ip-10-0-137-161.ec2.internal\" DevicePath \"\"" Sep 08 02:43:47.006089 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:47.006059 2564 generic.go:356] "Generic (PLEG): container finished" podID="55d5a280-e46f-4a42-94d7-d512b1434da3" containerID="da876fca8c03452edcb2f4fb513dc0407d145286eb01181915f7013a872ef778" exitCode=0 Sep 08 02:43:47.006532 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:47.006125 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"55d5a280-e46f-4a42-94d7-d512b1434da3","Type":"ContainerDied","Data":"da876fca8c03452edcb2f4fb513dc0407d145286eb01181915f7013a872ef778"} Sep 08 02:43:47.006532 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:47.006143 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 08 02:43:47.006532 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:47.006198 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"55d5a280-e46f-4a42-94d7-d512b1434da3","Type":"ContainerDied","Data":"23432bcf03565e9c70c6749bb932349ab0c59d3b2f0a23eda46a6d22dbdba0eb"} Sep 08 02:43:47.006532 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:47.006245 2564 scope.go:117] "RemoveContainer" containerID="3b36c43053bcbd0488baf3bbd17c0d2c911d5185e0c3173d403915f47704dff4" Sep 08 02:43:47.015137 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:47.015120 2564 scope.go:117] "RemoveContainer" containerID="9ace9835b21cec80779b48de7192400a65cb4b60f49d30cd80c7b82a121aff1d" Sep 08 02:43:47.032441 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:47.032420 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 08 02:43:47.037202 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:47.037091 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 08 02:43:47.037261 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:47.037219 2564 scope.go:117] "RemoveContainer" containerID="da876fca8c03452edcb2f4fb513dc0407d145286eb01181915f7013a872ef778" Sep 08 02:43:47.045267 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:47.045245 2564 scope.go:117] "RemoveContainer" containerID="d4af86f9980e743132f77815ce59613574cd77ae56f6f7a365470e31faa5ec45" Sep 08 02:43:47.052416 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:47.052344 2564 scope.go:117] "RemoveContainer" containerID="7c5888b2e4d937e374d54d42b081d6067f3fa843e02d959fbc2677ac653296f5" Sep 08 02:43:47.062885 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:47.062862 2564 scope.go:117] "RemoveContainer" containerID="b222f983dc769c7d509c490899ba81310e3cc19d2a72c79d8dc069b6f439b9f7" Sep 08 02:43:47.063294 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:47.063268 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 08 02:43:47.063720 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:47.063702 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="55d5a280-e46f-4a42-94d7-d512b1434da3" containerName="prometheus" Sep 08 02:43:47.063802 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:47.063724 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="55d5a280-e46f-4a42-94d7-d512b1434da3" containerName="prometheus" Sep 08 02:43:47.063802 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:47.063740 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="55d5a280-e46f-4a42-94d7-d512b1434da3" containerName="config-reloader" Sep 08 02:43:47.063802 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:47.063750 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="55d5a280-e46f-4a42-94d7-d512b1434da3" containerName="config-reloader" Sep 08 02:43:47.063802 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:47.063775 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="55d5a280-e46f-4a42-94d7-d512b1434da3" containerName="init-config-reloader" Sep 08 02:43:47.063802 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:47.063784 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="55d5a280-e46f-4a42-94d7-d512b1434da3" containerName="init-config-reloader" Sep 08 02:43:47.063802 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:47.063793 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="55d5a280-e46f-4a42-94d7-d512b1434da3" containerName="thanos-sidecar" Sep 08 02:43:47.063802 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:47.063801 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="55d5a280-e46f-4a42-94d7-d512b1434da3" containerName="thanos-sidecar" Sep 08 02:43:47.064039 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:47.063813 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="55d5a280-e46f-4a42-94d7-d512b1434da3" containerName="kube-rbac-proxy-web" Sep 08 02:43:47.064039 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:47.063822 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="55d5a280-e46f-4a42-94d7-d512b1434da3" containerName="kube-rbac-proxy-web" Sep 08 02:43:47.064039 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:47.063834 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="55d5a280-e46f-4a42-94d7-d512b1434da3" containerName="kube-rbac-proxy" Sep 08 02:43:47.064039 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:47.063842 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="55d5a280-e46f-4a42-94d7-d512b1434da3" containerName="kube-rbac-proxy" Sep 08 02:43:47.064039 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:47.063853 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="55d5a280-e46f-4a42-94d7-d512b1434da3" containerName="kube-rbac-proxy-thanos" Sep 08 02:43:47.064039 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:47.063861 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="55d5a280-e46f-4a42-94d7-d512b1434da3" containerName="kube-rbac-proxy-thanos" Sep 08 02:43:47.064039 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:47.063934 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="55d5a280-e46f-4a42-94d7-d512b1434da3" containerName="prometheus" Sep 08 02:43:47.064039 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:47.063946 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="55d5a280-e46f-4a42-94d7-d512b1434da3" containerName="kube-rbac-proxy" Sep 08 02:43:47.064039 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:47.063958 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="55d5a280-e46f-4a42-94d7-d512b1434da3" containerName="kube-rbac-proxy-thanos" Sep 08 02:43:47.064039 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:47.063968 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="55d5a280-e46f-4a42-94d7-d512b1434da3" containerName="thanos-sidecar" Sep 08 02:43:47.064039 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:47.063977 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="55d5a280-e46f-4a42-94d7-d512b1434da3" containerName="kube-rbac-proxy-web" Sep 08 02:43:47.064039 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:47.063986 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="55d5a280-e46f-4a42-94d7-d512b1434da3" containerName="config-reloader" Sep 08 02:43:47.067556 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:47.067533 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 08 02:43:47.070035 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:47.069991 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Sep 08 02:43:47.070165 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:47.070044 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Sep 08 02:43:47.070744 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:47.070721 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Sep 08 02:43:47.070945 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:47.070926 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-eonu8bq26jcef\"" Sep 08 02:43:47.077617 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:47.071020 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-h657v\"" Sep 08 02:43:47.077617 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:47.070812 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Sep 08 02:43:47.077815 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:47.077800 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Sep 08 02:43:47.077875 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:47.077813 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Sep 08 02:43:47.077978 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:47.077947 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Sep 08 02:43:47.078089 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:47.078000 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Sep 08 02:43:47.079102 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:47.078948 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Sep 08 02:43:47.082755 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:47.082733 2564 scope.go:117] "RemoveContainer" containerID="093c69c60ec2e3db4d897bed5cc320582182710f78cdd57ad9f68f65a18cac53" Sep 08 02:43:47.082960 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:47.082943 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Sep 08 02:43:47.083131 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:47.082979 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Sep 08 02:43:47.083321 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:47.083300 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 08 02:43:47.083509 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:47.083021 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Sep 08 02:43:47.084278 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:47.084260 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Sep 08 02:43:47.085625 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:47.085599 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Sep 08 02:43:47.097344 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:47.097327 2564 scope.go:117] "RemoveContainer" containerID="3b36c43053bcbd0488baf3bbd17c0d2c911d5185e0c3173d403915f47704dff4" Sep 08 02:43:47.097720 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:43:47.097693 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3b36c43053bcbd0488baf3bbd17c0d2c911d5185e0c3173d403915f47704dff4\": container with ID starting with 3b36c43053bcbd0488baf3bbd17c0d2c911d5185e0c3173d403915f47704dff4 not found: ID does not exist" containerID="3b36c43053bcbd0488baf3bbd17c0d2c911d5185e0c3173d403915f47704dff4" Sep 08 02:43:47.097838 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:47.097729 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b36c43053bcbd0488baf3bbd17c0d2c911d5185e0c3173d403915f47704dff4"} err="failed to get container status \"3b36c43053bcbd0488baf3bbd17c0d2c911d5185e0c3173d403915f47704dff4\": rpc error: code = NotFound desc = could not find container \"3b36c43053bcbd0488baf3bbd17c0d2c911d5185e0c3173d403915f47704dff4\": container with ID starting with 3b36c43053bcbd0488baf3bbd17c0d2c911d5185e0c3173d403915f47704dff4 not found: ID does not exist" Sep 08 02:43:47.097838 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:47.097795 2564 scope.go:117] "RemoveContainer" containerID="9ace9835b21cec80779b48de7192400a65cb4b60f49d30cd80c7b82a121aff1d" Sep 08 02:43:47.098102 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:43:47.098082 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9ace9835b21cec80779b48de7192400a65cb4b60f49d30cd80c7b82a121aff1d\": container with ID starting with 9ace9835b21cec80779b48de7192400a65cb4b60f49d30cd80c7b82a121aff1d not found: ID does not exist" containerID="9ace9835b21cec80779b48de7192400a65cb4b60f49d30cd80c7b82a121aff1d" Sep 08 02:43:47.098182 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:47.098105 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9ace9835b21cec80779b48de7192400a65cb4b60f49d30cd80c7b82a121aff1d"} err="failed to get container status \"9ace9835b21cec80779b48de7192400a65cb4b60f49d30cd80c7b82a121aff1d\": rpc error: code = NotFound desc = could not find container \"9ace9835b21cec80779b48de7192400a65cb4b60f49d30cd80c7b82a121aff1d\": container with ID starting with 9ace9835b21cec80779b48de7192400a65cb4b60f49d30cd80c7b82a121aff1d not found: ID does not exist" Sep 08 02:43:47.098182 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:47.098120 2564 scope.go:117] "RemoveContainer" containerID="da876fca8c03452edcb2f4fb513dc0407d145286eb01181915f7013a872ef778" Sep 08 02:43:47.098409 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:43:47.098386 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"da876fca8c03452edcb2f4fb513dc0407d145286eb01181915f7013a872ef778\": container with ID starting with da876fca8c03452edcb2f4fb513dc0407d145286eb01181915f7013a872ef778 not found: ID does not exist" containerID="da876fca8c03452edcb2f4fb513dc0407d145286eb01181915f7013a872ef778" Sep 08 02:43:47.098486 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:47.098417 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da876fca8c03452edcb2f4fb513dc0407d145286eb01181915f7013a872ef778"} err="failed to get container status \"da876fca8c03452edcb2f4fb513dc0407d145286eb01181915f7013a872ef778\": rpc error: code = NotFound desc = could not find container \"da876fca8c03452edcb2f4fb513dc0407d145286eb01181915f7013a872ef778\": container with ID starting with da876fca8c03452edcb2f4fb513dc0407d145286eb01181915f7013a872ef778 not found: ID does not exist" Sep 08 02:43:47.098486 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:47.098434 2564 scope.go:117] "RemoveContainer" containerID="d4af86f9980e743132f77815ce59613574cd77ae56f6f7a365470e31faa5ec45" Sep 08 02:43:47.098715 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:43:47.098695 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d4af86f9980e743132f77815ce59613574cd77ae56f6f7a365470e31faa5ec45\": container with ID starting with d4af86f9980e743132f77815ce59613574cd77ae56f6f7a365470e31faa5ec45 not found: ID does not exist" containerID="d4af86f9980e743132f77815ce59613574cd77ae56f6f7a365470e31faa5ec45" Sep 08 02:43:47.098773 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:47.098720 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d4af86f9980e743132f77815ce59613574cd77ae56f6f7a365470e31faa5ec45"} err="failed to get container status \"d4af86f9980e743132f77815ce59613574cd77ae56f6f7a365470e31faa5ec45\": rpc error: code = NotFound desc = could not find container \"d4af86f9980e743132f77815ce59613574cd77ae56f6f7a365470e31faa5ec45\": container with ID starting with d4af86f9980e743132f77815ce59613574cd77ae56f6f7a365470e31faa5ec45 not found: ID does not exist" Sep 08 02:43:47.098773 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:47.098736 2564 scope.go:117] "RemoveContainer" containerID="7c5888b2e4d937e374d54d42b081d6067f3fa843e02d959fbc2677ac653296f5" Sep 08 02:43:47.099000 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:43:47.098981 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7c5888b2e4d937e374d54d42b081d6067f3fa843e02d959fbc2677ac653296f5\": container with ID starting with 7c5888b2e4d937e374d54d42b081d6067f3fa843e02d959fbc2677ac653296f5 not found: ID does not exist" containerID="7c5888b2e4d937e374d54d42b081d6067f3fa843e02d959fbc2677ac653296f5" Sep 08 02:43:47.099065 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:47.099003 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c5888b2e4d937e374d54d42b081d6067f3fa843e02d959fbc2677ac653296f5"} err="failed to get container status \"7c5888b2e4d937e374d54d42b081d6067f3fa843e02d959fbc2677ac653296f5\": rpc error: code = NotFound desc = could not find container \"7c5888b2e4d937e374d54d42b081d6067f3fa843e02d959fbc2677ac653296f5\": container with ID starting with 7c5888b2e4d937e374d54d42b081d6067f3fa843e02d959fbc2677ac653296f5 not found: ID does not exist" Sep 08 02:43:47.099065 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:47.099018 2564 scope.go:117] "RemoveContainer" containerID="b222f983dc769c7d509c490899ba81310e3cc19d2a72c79d8dc069b6f439b9f7" Sep 08 02:43:47.099322 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:43:47.099297 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b222f983dc769c7d509c490899ba81310e3cc19d2a72c79d8dc069b6f439b9f7\": container with ID starting with b222f983dc769c7d509c490899ba81310e3cc19d2a72c79d8dc069b6f439b9f7 not found: ID does not exist" containerID="b222f983dc769c7d509c490899ba81310e3cc19d2a72c79d8dc069b6f439b9f7" Sep 08 02:43:47.099428 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:47.099325 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b222f983dc769c7d509c490899ba81310e3cc19d2a72c79d8dc069b6f439b9f7"} err="failed to get container status \"b222f983dc769c7d509c490899ba81310e3cc19d2a72c79d8dc069b6f439b9f7\": rpc error: code = NotFound desc = could not find container \"b222f983dc769c7d509c490899ba81310e3cc19d2a72c79d8dc069b6f439b9f7\": container with ID starting with b222f983dc769c7d509c490899ba81310e3cc19d2a72c79d8dc069b6f439b9f7 not found: ID does not exist" Sep 08 02:43:47.099428 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:47.099344 2564 scope.go:117] "RemoveContainer" containerID="093c69c60ec2e3db4d897bed5cc320582182710f78cdd57ad9f68f65a18cac53" Sep 08 02:43:47.099647 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:43:47.099622 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"093c69c60ec2e3db4d897bed5cc320582182710f78cdd57ad9f68f65a18cac53\": container with ID starting with 093c69c60ec2e3db4d897bed5cc320582182710f78cdd57ad9f68f65a18cac53 not found: ID does not exist" containerID="093c69c60ec2e3db4d897bed5cc320582182710f78cdd57ad9f68f65a18cac53" Sep 08 02:43:47.099687 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:47.099652 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"093c69c60ec2e3db4d897bed5cc320582182710f78cdd57ad9f68f65a18cac53"} err="failed to get container status \"093c69c60ec2e3db4d897bed5cc320582182710f78cdd57ad9f68f65a18cac53\": rpc error: code = NotFound desc = could not find container \"093c69c60ec2e3db4d897bed5cc320582182710f78cdd57ad9f68f65a18cac53\": container with ID starting with 093c69c60ec2e3db4d897bed5cc320582182710f78cdd57ad9f68f65a18cac53 not found: ID does not exist" Sep 08 02:43:47.219944 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:47.219905 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/403f64a1-3ff3-4b4c-baae-28b295cf1707-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"403f64a1-3ff3-4b4c-baae-28b295cf1707\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 02:43:47.220121 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:47.219959 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/403f64a1-3ff3-4b4c-baae-28b295cf1707-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"403f64a1-3ff3-4b4c-baae-28b295cf1707\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 02:43:47.220121 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:47.219986 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/403f64a1-3ff3-4b4c-baae-28b295cf1707-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"403f64a1-3ff3-4b4c-baae-28b295cf1707\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 02:43:47.220121 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:47.220009 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/403f64a1-3ff3-4b4c-baae-28b295cf1707-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"403f64a1-3ff3-4b4c-baae-28b295cf1707\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 02:43:47.220121 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:47.220026 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/403f64a1-3ff3-4b4c-baae-28b295cf1707-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"403f64a1-3ff3-4b4c-baae-28b295cf1707\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 02:43:47.220121 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:47.220058 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/403f64a1-3ff3-4b4c-baae-28b295cf1707-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"403f64a1-3ff3-4b4c-baae-28b295cf1707\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 02:43:47.220330 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:47.220223 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/403f64a1-3ff3-4b4c-baae-28b295cf1707-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"403f64a1-3ff3-4b4c-baae-28b295cf1707\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 02:43:47.220330 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:47.220265 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5ltq9\" (UniqueName: \"kubernetes.io/projected/403f64a1-3ff3-4b4c-baae-28b295cf1707-kube-api-access-5ltq9\") pod \"prometheus-k8s-0\" (UID: \"403f64a1-3ff3-4b4c-baae-28b295cf1707\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 02:43:47.220330 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:47.220295 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/403f64a1-3ff3-4b4c-baae-28b295cf1707-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"403f64a1-3ff3-4b4c-baae-28b295cf1707\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 02:43:47.220330 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:47.220319 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/403f64a1-3ff3-4b4c-baae-28b295cf1707-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"403f64a1-3ff3-4b4c-baae-28b295cf1707\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 02:43:47.220517 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:47.220346 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/403f64a1-3ff3-4b4c-baae-28b295cf1707-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"403f64a1-3ff3-4b4c-baae-28b295cf1707\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 02:43:47.220517 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:47.220439 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/403f64a1-3ff3-4b4c-baae-28b295cf1707-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"403f64a1-3ff3-4b4c-baae-28b295cf1707\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 02:43:47.220517 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:47.220473 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/403f64a1-3ff3-4b4c-baae-28b295cf1707-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"403f64a1-3ff3-4b4c-baae-28b295cf1707\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 02:43:47.220517 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:47.220492 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/403f64a1-3ff3-4b4c-baae-28b295cf1707-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"403f64a1-3ff3-4b4c-baae-28b295cf1707\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 02:43:47.220658 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:47.220528 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/403f64a1-3ff3-4b4c-baae-28b295cf1707-config-out\") pod \"prometheus-k8s-0\" (UID: \"403f64a1-3ff3-4b4c-baae-28b295cf1707\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 02:43:47.220658 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:47.220577 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/403f64a1-3ff3-4b4c-baae-28b295cf1707-config\") pod \"prometheus-k8s-0\" (UID: \"403f64a1-3ff3-4b4c-baae-28b295cf1707\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 02:43:47.220658 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:47.220599 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/403f64a1-3ff3-4b4c-baae-28b295cf1707-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"403f64a1-3ff3-4b4c-baae-28b295cf1707\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 02:43:47.220658 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:47.220621 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/403f64a1-3ff3-4b4c-baae-28b295cf1707-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"403f64a1-3ff3-4b4c-baae-28b295cf1707\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 02:43:47.220796 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:47.220700 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/403f64a1-3ff3-4b4c-baae-28b295cf1707-web-config\") pod \"prometheus-k8s-0\" (UID: \"403f64a1-3ff3-4b4c-baae-28b295cf1707\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 02:43:47.220796 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:47.220738 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/403f64a1-3ff3-4b4c-baae-28b295cf1707-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"403f64a1-3ff3-4b4c-baae-28b295cf1707\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 02:43:47.321215 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:47.321172 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/403f64a1-3ff3-4b4c-baae-28b295cf1707-config\") pod \"prometheus-k8s-0\" (UID: \"403f64a1-3ff3-4b4c-baae-28b295cf1707\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 02:43:47.321215 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:47.321207 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/403f64a1-3ff3-4b4c-baae-28b295cf1707-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"403f64a1-3ff3-4b4c-baae-28b295cf1707\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 02:43:47.321417 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:47.321230 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/403f64a1-3ff3-4b4c-baae-28b295cf1707-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"403f64a1-3ff3-4b4c-baae-28b295cf1707\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 02:43:47.321417 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:47.321266 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/403f64a1-3ff3-4b4c-baae-28b295cf1707-web-config\") pod \"prometheus-k8s-0\" (UID: \"403f64a1-3ff3-4b4c-baae-28b295cf1707\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 02:43:47.321417 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:47.321294 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/403f64a1-3ff3-4b4c-baae-28b295cf1707-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"403f64a1-3ff3-4b4c-baae-28b295cf1707\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 02:43:47.321417 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:47.321324 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/403f64a1-3ff3-4b4c-baae-28b295cf1707-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"403f64a1-3ff3-4b4c-baae-28b295cf1707\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 02:43:47.321417 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:47.321378 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/403f64a1-3ff3-4b4c-baae-28b295cf1707-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"403f64a1-3ff3-4b4c-baae-28b295cf1707\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 02:43:47.321417 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:47.321402 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/403f64a1-3ff3-4b4c-baae-28b295cf1707-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"403f64a1-3ff3-4b4c-baae-28b295cf1707\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 02:43:47.321684 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:47.321596 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/403f64a1-3ff3-4b4c-baae-28b295cf1707-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"403f64a1-3ff3-4b4c-baae-28b295cf1707\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 02:43:47.321684 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:47.321638 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/403f64a1-3ff3-4b4c-baae-28b295cf1707-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"403f64a1-3ff3-4b4c-baae-28b295cf1707\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 02:43:47.321684 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:47.321680 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/403f64a1-3ff3-4b4c-baae-28b295cf1707-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"403f64a1-3ff3-4b4c-baae-28b295cf1707\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 02:43:47.321865 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:47.321707 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/403f64a1-3ff3-4b4c-baae-28b295cf1707-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"403f64a1-3ff3-4b4c-baae-28b295cf1707\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 02:43:47.321865 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:47.321740 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5ltq9\" (UniqueName: \"kubernetes.io/projected/403f64a1-3ff3-4b4c-baae-28b295cf1707-kube-api-access-5ltq9\") pod \"prometheus-k8s-0\" (UID: \"403f64a1-3ff3-4b4c-baae-28b295cf1707\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 02:43:47.321865 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:47.321775 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/403f64a1-3ff3-4b4c-baae-28b295cf1707-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"403f64a1-3ff3-4b4c-baae-28b295cf1707\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 02:43:47.321865 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:47.321798 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/403f64a1-3ff3-4b4c-baae-28b295cf1707-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"403f64a1-3ff3-4b4c-baae-28b295cf1707\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 02:43:47.321865 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:47.321836 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/403f64a1-3ff3-4b4c-baae-28b295cf1707-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"403f64a1-3ff3-4b4c-baae-28b295cf1707\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 02:43:47.322130 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:47.321881 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/403f64a1-3ff3-4b4c-baae-28b295cf1707-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"403f64a1-3ff3-4b4c-baae-28b295cf1707\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 02:43:47.322130 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:47.321922 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/403f64a1-3ff3-4b4c-baae-28b295cf1707-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"403f64a1-3ff3-4b4c-baae-28b295cf1707\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 02:43:47.322130 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:47.321952 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/403f64a1-3ff3-4b4c-baae-28b295cf1707-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"403f64a1-3ff3-4b4c-baae-28b295cf1707\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 02:43:47.322130 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:47.321977 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/403f64a1-3ff3-4b4c-baae-28b295cf1707-config-out\") pod \"prometheus-k8s-0\" (UID: \"403f64a1-3ff3-4b4c-baae-28b295cf1707\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 02:43:47.322130 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:47.322095 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/403f64a1-3ff3-4b4c-baae-28b295cf1707-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"403f64a1-3ff3-4b4c-baae-28b295cf1707\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 02:43:47.324490 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:47.324462 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/403f64a1-3ff3-4b4c-baae-28b295cf1707-config-out\") pod \"prometheus-k8s-0\" (UID: \"403f64a1-3ff3-4b4c-baae-28b295cf1707\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 02:43:47.324661 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:47.324637 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/403f64a1-3ff3-4b4c-baae-28b295cf1707-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"403f64a1-3ff3-4b4c-baae-28b295cf1707\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 02:43:47.324791 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:47.324765 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/403f64a1-3ff3-4b4c-baae-28b295cf1707-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"403f64a1-3ff3-4b4c-baae-28b295cf1707\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 02:43:47.325045 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:47.325022 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/403f64a1-3ff3-4b4c-baae-28b295cf1707-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"403f64a1-3ff3-4b4c-baae-28b295cf1707\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 02:43:47.325126 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:47.325107 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/403f64a1-3ff3-4b4c-baae-28b295cf1707-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"403f64a1-3ff3-4b4c-baae-28b295cf1707\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 02:43:47.325751 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:47.325315 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/403f64a1-3ff3-4b4c-baae-28b295cf1707-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"403f64a1-3ff3-4b4c-baae-28b295cf1707\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 02:43:47.325751 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:47.325507 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/403f64a1-3ff3-4b4c-baae-28b295cf1707-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"403f64a1-3ff3-4b4c-baae-28b295cf1707\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 02:43:47.325751 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:47.325620 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/403f64a1-3ff3-4b4c-baae-28b295cf1707-config\") pod \"prometheus-k8s-0\" (UID: \"403f64a1-3ff3-4b4c-baae-28b295cf1707\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 02:43:47.325949 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:47.325756 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/403f64a1-3ff3-4b4c-baae-28b295cf1707-web-config\") pod \"prometheus-k8s-0\" (UID: \"403f64a1-3ff3-4b4c-baae-28b295cf1707\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 02:43:47.326400 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:47.326132 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/403f64a1-3ff3-4b4c-baae-28b295cf1707-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"403f64a1-3ff3-4b4c-baae-28b295cf1707\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 02:43:47.326400 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:47.326193 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/403f64a1-3ff3-4b4c-baae-28b295cf1707-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"403f64a1-3ff3-4b4c-baae-28b295cf1707\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 02:43:47.326400 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:47.326316 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/403f64a1-3ff3-4b4c-baae-28b295cf1707-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"403f64a1-3ff3-4b4c-baae-28b295cf1707\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 02:43:47.326400 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:47.326345 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/403f64a1-3ff3-4b4c-baae-28b295cf1707-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"403f64a1-3ff3-4b4c-baae-28b295cf1707\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 02:43:47.326666 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:47.326633 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/403f64a1-3ff3-4b4c-baae-28b295cf1707-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"403f64a1-3ff3-4b4c-baae-28b295cf1707\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 02:43:47.327005 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:47.326981 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/403f64a1-3ff3-4b4c-baae-28b295cf1707-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"403f64a1-3ff3-4b4c-baae-28b295cf1707\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 02:43:47.327087 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:47.327040 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/403f64a1-3ff3-4b4c-baae-28b295cf1707-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"403f64a1-3ff3-4b4c-baae-28b295cf1707\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 02:43:47.327953 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:47.327934 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/403f64a1-3ff3-4b4c-baae-28b295cf1707-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"403f64a1-3ff3-4b4c-baae-28b295cf1707\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 02:43:47.328023 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:47.328000 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/403f64a1-3ff3-4b4c-baae-28b295cf1707-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"403f64a1-3ff3-4b4c-baae-28b295cf1707\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 02:43:47.334322 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:47.334301 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5ltq9\" (UniqueName: \"kubernetes.io/projected/403f64a1-3ff3-4b4c-baae-28b295cf1707-kube-api-access-5ltq9\") pod \"prometheus-k8s-0\" (UID: \"403f64a1-3ff3-4b4c-baae-28b295cf1707\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 02:43:47.399381 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:47.399279 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 08 02:43:47.676238 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:47.676211 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 08 02:43:47.678173 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:43:47.678138 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod403f64a1_3ff3_4b4c_baae_28b295cf1707.slice/crio-2bd89d1ffa513170129508e507c6f97747ed89d06a895203451a40458e42e725 WatchSource:0}: Error finding container 2bd89d1ffa513170129508e507c6f97747ed89d06a895203451a40458e42e725: Status 404 returned error can't find the container with id 2bd89d1ffa513170129508e507c6f97747ed89d06a895203451a40458e42e725 Sep 08 02:43:48.013998 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:48.013955 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6799d75bf-zzb6j" event={"ID":"eb3bd1cc-6a72-470c-bfd3-5917aaf42767","Type":"ContainerStarted","Data":"7cf26904e21cb5586ae5425229228624308a15d2cd3b815ea7f48ce0dcd5174c"} Sep 08 02:43:48.014491 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:48.014031 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6799d75bf-zzb6j" event={"ID":"eb3bd1cc-6a72-470c-bfd3-5917aaf42767","Type":"ContainerStarted","Data":"4430e64f79fb7bd580111cdc1f591d2ef37043eafba65865bad39bace63206a2"} Sep 08 02:43:48.014491 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:48.014067 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6799d75bf-zzb6j" event={"ID":"eb3bd1cc-6a72-470c-bfd3-5917aaf42767","Type":"ContainerStarted","Data":"ff8f953fff41adbd604f1eeea0380215ef2a2a0b082c5c428e5542464ae5352c"} Sep 08 02:43:48.015486 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:48.015465 2564 generic.go:356] "Generic (PLEG): container finished" podID="403f64a1-3ff3-4b4c-baae-28b295cf1707" containerID="4cbaf14f6de762a537f29e099bb30fe198de9f73c56490875c47af081a1f7973" exitCode=0 Sep 08 02:43:48.015556 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:48.015500 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"403f64a1-3ff3-4b4c-baae-28b295cf1707","Type":"ContainerDied","Data":"4cbaf14f6de762a537f29e099bb30fe198de9f73c56490875c47af081a1f7973"} Sep 08 02:43:48.015556 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:48.015546 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"403f64a1-3ff3-4b4c-baae-28b295cf1707","Type":"ContainerStarted","Data":"2bd89d1ffa513170129508e507c6f97747ed89d06a895203451a40458e42e725"} Sep 08 02:43:48.034889 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:48.034845 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-6799d75bf-zzb6j" podStartSLOduration=2.462137257 podStartE2EDuration="4.034828194s" totalImagesPullingTime="1.572690937s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 02:43:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 02:43:48.032804185 +0000 UTC m=+192.467777897" watchObservedRunningTime="2026-09-08 02:43:48.034828194 +0000 UTC m=+192.469801884" Sep 08 02:43:48.107031 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:48.107003 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="55d5a280-e46f-4a42-94d7-d512b1434da3" path="/var/lib/kubelet/pods/55d5a280-e46f-4a42-94d7-d512b1434da3/volumes" Sep 08 02:43:49.023759 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:49.023713 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"403f64a1-3ff3-4b4c-baae-28b295cf1707","Type":"ContainerStarted","Data":"d2b23dbcbc9588950b305af71225ccee1af2ac10e9801cbc2638e83a1ba6da52"} Sep 08 02:43:49.024151 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:49.023815 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"403f64a1-3ff3-4b4c-baae-28b295cf1707","Type":"ContainerStarted","Data":"f75f98ad05c8f06ca261986a1785f431291072a07a14c1ec6110aec1920882fb"} Sep 08 02:43:49.024151 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:49.023860 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"403f64a1-3ff3-4b4c-baae-28b295cf1707","Type":"ContainerStarted","Data":"2527f6854d83f7aedd47f1285aec8843f22053e46a7ada0eafa7e060d8bf048c"} Sep 08 02:43:49.024151 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:49.023890 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"403f64a1-3ff3-4b4c-baae-28b295cf1707","Type":"ContainerStarted","Data":"cef061a835c783a48641bd8ef780866d14394bdb2cb2e9b0d6d92fe2c33ff903"} Sep 08 02:43:49.024151 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:49.023916 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"403f64a1-3ff3-4b4c-baae-28b295cf1707","Type":"ContainerStarted","Data":"7b2e6d017dcf53b84a809604b290d1ce5ed1e1d60fb294f0a58a0a449b04b054"} Sep 08 02:43:49.024151 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:49.023952 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"403f64a1-3ff3-4b4c-baae-28b295cf1707","Type":"ContainerStarted","Data":"e65bf691cdcea9cc5610dbbf7f207e45b5aded375ff544a9e56533b3cfa7d5e6"} Sep 08 02:43:49.050895 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:49.050839 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.031819324 podStartE2EDuration="2.050821268s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.001944ms" isStatefulPod=false podCreationTimestamp="2026-09-08 02:43:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 02:43:49.048580689 +0000 UTC m=+193.483554383" watchObservedRunningTime="2026-09-08 02:43:49.050821268 +0000 UTC m=+193.485794958" Sep 08 02:43:52.399817 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:43:52.399762 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 08 02:44:47.400216 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:44:47.400159 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Sep 08 02:44:47.415709 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:44:47.415679 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Sep 08 02:44:48.268711 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:44:48.268683 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 08 02:45:36.030806 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:45:36.030775 2564 kubelet.go:1648] "Image garbage collection succeeded" Sep 08 02:47:14.025302 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:47:14.025263 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-jobset-operator/jobset-operator-5bc45f897-4cq59"] Sep 08 02:47:14.028901 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:47:14.028876 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-operator-5bc45f897-4cq59" Sep 08 02:47:14.031780 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:47:14.031757 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"openshift-service-ca.crt\"" Sep 08 02:47:14.031905 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:47:14.031786 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"kube-root-ca.crt\"" Sep 08 02:47:14.031905 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:47:14.031757 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"jobset-operator-dockercfg-8gfq9\"" Sep 08 02:47:14.037116 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:47:14.037094 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-operator-5bc45f897-4cq59"] Sep 08 02:47:14.173932 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:47:14.173895 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2tzpj\" (UniqueName: \"kubernetes.io/projected/0461e59b-aba8-47ae-bc0d-f01bfa2aff51-kube-api-access-2tzpj\") pod \"jobset-operator-5bc45f897-4cq59\" (UID: \"0461e59b-aba8-47ae-bc0d-f01bfa2aff51\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-4cq59" Sep 08 02:47:14.174123 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:47:14.173951 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0461e59b-aba8-47ae-bc0d-f01bfa2aff51-tmp\") pod \"jobset-operator-5bc45f897-4cq59\" (UID: \"0461e59b-aba8-47ae-bc0d-f01bfa2aff51\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-4cq59" Sep 08 02:47:14.274437 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:47:14.274395 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2tzpj\" (UniqueName: \"kubernetes.io/projected/0461e59b-aba8-47ae-bc0d-f01bfa2aff51-kube-api-access-2tzpj\") pod \"jobset-operator-5bc45f897-4cq59\" (UID: \"0461e59b-aba8-47ae-bc0d-f01bfa2aff51\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-4cq59" Sep 08 02:47:14.274617 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:47:14.274457 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0461e59b-aba8-47ae-bc0d-f01bfa2aff51-tmp\") pod \"jobset-operator-5bc45f897-4cq59\" (UID: \"0461e59b-aba8-47ae-bc0d-f01bfa2aff51\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-4cq59" Sep 08 02:47:14.274864 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:47:14.274844 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0461e59b-aba8-47ae-bc0d-f01bfa2aff51-tmp\") pod \"jobset-operator-5bc45f897-4cq59\" (UID: \"0461e59b-aba8-47ae-bc0d-f01bfa2aff51\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-4cq59" Sep 08 02:47:14.284711 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:47:14.284633 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2tzpj\" (UniqueName: \"kubernetes.io/projected/0461e59b-aba8-47ae-bc0d-f01bfa2aff51-kube-api-access-2tzpj\") pod \"jobset-operator-5bc45f897-4cq59\" (UID: \"0461e59b-aba8-47ae-bc0d-f01bfa2aff51\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-4cq59" Sep 08 02:47:14.338307 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:47:14.338267 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-operator-5bc45f897-4cq59" Sep 08 02:47:14.607596 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:47:14.607566 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-operator-5bc45f897-4cq59"] Sep 08 02:47:14.609767 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:47:14.609737 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0461e59b_aba8_47ae_bc0d_f01bfa2aff51.slice/crio-b4069a2c3c2862171f4464d7d6a5c50a61d495a5af72f3915e808e2984933d70 WatchSource:0}: Error finding container b4069a2c3c2862171f4464d7d6a5c50a61d495a5af72f3915e808e2984933d70: Status 404 returned error can't find the container with id b4069a2c3c2862171f4464d7d6a5c50a61d495a5af72f3915e808e2984933d70 Sep 08 02:47:14.611736 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:47:14.611718 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 08 02:47:14.844820 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:47:14.844780 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-operator-5bc45f897-4cq59" event={"ID":"0461e59b-aba8-47ae-bc0d-f01bfa2aff51","Type":"ContainerStarted","Data":"b4069a2c3c2862171f4464d7d6a5c50a61d495a5af72f3915e808e2984933d70"} Sep 08 02:47:17.860530 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:47:17.860493 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-operator-5bc45f897-4cq59" event={"ID":"0461e59b-aba8-47ae-bc0d-f01bfa2aff51","Type":"ContainerStarted","Data":"f8bfd156f936036b8709e87591a2fd80c5e3e45190c535717e8077a8cf5b09b2"} Sep 08 02:47:17.876215 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:47:17.876165 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-jobset-operator/jobset-operator-5bc45f897-4cq59" podStartSLOduration=1.243277353 podStartE2EDuration="3.876149301s" totalImagesPullingTime="2.632871948s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 02:47:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 02:47:17.875618232 +0000 UTC m=+402.310591924" watchObservedRunningTime="2026-09-08 02:47:17.876149301 +0000 UTC m=+402.311122993" Sep 08 02:47:48.726578 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:47:48.726545 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-7dd48b4b74-gzmpp"] Sep 08 02:47:48.730117 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:47:48.730097 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-7dd48b4b74-gzmpp" Sep 08 02:47:48.732617 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:47:48.732592 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kubeflow-trainer-webhook-cert\"" Sep 08 02:47:48.732721 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:47:48.732658 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kubeflow-trainer-config\"" Sep 08 02:47:48.732721 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:47:48.732662 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kubeflow-trainer-controller-manager-dockercfg-gkdxr\"" Sep 08 02:47:48.733675 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:47:48.733658 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Sep 08 02:47:48.733749 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:47:48.733691 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Sep 08 02:47:48.739231 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:47:48.739207 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-7dd48b4b74-gzmpp"] Sep 08 02:47:48.863668 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:47:48.863629 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cff21064-964f-4f17-a5a2-9e45be99b23e-cert\") pod \"kubeflow-trainer-controller-manager-7dd48b4b74-gzmpp\" (UID: \"cff21064-964f-4f17-a5a2-9e45be99b23e\") " pod="opendatahub/kubeflow-trainer-controller-manager-7dd48b4b74-gzmpp" Sep 08 02:47:48.863835 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:47:48.863680 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/cff21064-964f-4f17-a5a2-9e45be99b23e-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-7dd48b4b74-gzmpp\" (UID: \"cff21064-964f-4f17-a5a2-9e45be99b23e\") " pod="opendatahub/kubeflow-trainer-controller-manager-7dd48b4b74-gzmpp" Sep 08 02:47:48.863835 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:47:48.863771 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d9xt4\" (UniqueName: \"kubernetes.io/projected/cff21064-964f-4f17-a5a2-9e45be99b23e-kube-api-access-d9xt4\") pod \"kubeflow-trainer-controller-manager-7dd48b4b74-gzmpp\" (UID: \"cff21064-964f-4f17-a5a2-9e45be99b23e\") " pod="opendatahub/kubeflow-trainer-controller-manager-7dd48b4b74-gzmpp" Sep 08 02:47:48.965245 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:47:48.965199 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/cff21064-964f-4f17-a5a2-9e45be99b23e-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-7dd48b4b74-gzmpp\" (UID: \"cff21064-964f-4f17-a5a2-9e45be99b23e\") " pod="opendatahub/kubeflow-trainer-controller-manager-7dd48b4b74-gzmpp" Sep 08 02:47:48.965465 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:47:48.965280 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d9xt4\" (UniqueName: \"kubernetes.io/projected/cff21064-964f-4f17-a5a2-9e45be99b23e-kube-api-access-d9xt4\") pod \"kubeflow-trainer-controller-manager-7dd48b4b74-gzmpp\" (UID: \"cff21064-964f-4f17-a5a2-9e45be99b23e\") " pod="opendatahub/kubeflow-trainer-controller-manager-7dd48b4b74-gzmpp" Sep 08 02:47:48.965465 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:47:48.965400 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cff21064-964f-4f17-a5a2-9e45be99b23e-cert\") pod \"kubeflow-trainer-controller-manager-7dd48b4b74-gzmpp\" (UID: \"cff21064-964f-4f17-a5a2-9e45be99b23e\") " pod="opendatahub/kubeflow-trainer-controller-manager-7dd48b4b74-gzmpp" Sep 08 02:47:48.965983 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:47:48.965959 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/cff21064-964f-4f17-a5a2-9e45be99b23e-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-7dd48b4b74-gzmpp\" (UID: \"cff21064-964f-4f17-a5a2-9e45be99b23e\") " pod="opendatahub/kubeflow-trainer-controller-manager-7dd48b4b74-gzmpp" Sep 08 02:47:48.967673 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:47:48.967654 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cff21064-964f-4f17-a5a2-9e45be99b23e-cert\") pod \"kubeflow-trainer-controller-manager-7dd48b4b74-gzmpp\" (UID: \"cff21064-964f-4f17-a5a2-9e45be99b23e\") " pod="opendatahub/kubeflow-trainer-controller-manager-7dd48b4b74-gzmpp" Sep 08 02:47:48.973312 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:47:48.973286 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d9xt4\" (UniqueName: \"kubernetes.io/projected/cff21064-964f-4f17-a5a2-9e45be99b23e-kube-api-access-d9xt4\") pod \"kubeflow-trainer-controller-manager-7dd48b4b74-gzmpp\" (UID: \"cff21064-964f-4f17-a5a2-9e45be99b23e\") " pod="opendatahub/kubeflow-trainer-controller-manager-7dd48b4b74-gzmpp" Sep 08 02:47:49.040050 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:47:49.039964 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-7dd48b4b74-gzmpp" Sep 08 02:47:49.310279 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:47:49.310253 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-7dd48b4b74-gzmpp"] Sep 08 02:47:49.312608 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:47:49.312579 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcff21064_964f_4f17_a5a2_9e45be99b23e.slice/crio-778afc7cd14d1251348ba9296663f47d881fdc4e648f8ff7812d5b9afa7ff650 WatchSource:0}: Error finding container 778afc7cd14d1251348ba9296663f47d881fdc4e648f8ff7812d5b9afa7ff650: Status 404 returned error can't find the container with id 778afc7cd14d1251348ba9296663f47d881fdc4e648f8ff7812d5b9afa7ff650 Sep 08 02:47:49.993643 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:47:49.993602 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-7dd48b4b74-gzmpp" event={"ID":"cff21064-964f-4f17-a5a2-9e45be99b23e","Type":"ContainerStarted","Data":"778afc7cd14d1251348ba9296663f47d881fdc4e648f8ff7812d5b9afa7ff650"} Sep 08 02:47:52.003919 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:47:52.003883 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-7dd48b4b74-gzmpp" event={"ID":"cff21064-964f-4f17-a5a2-9e45be99b23e","Type":"ContainerStarted","Data":"360cc8cb10a9ce69c0e5b45b35676b9af948a17a526f0091939c8f09dc299a22"} Sep 08 02:47:52.004537 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:47:52.003939 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kubeflow-trainer-controller-manager-7dd48b4b74-gzmpp" Sep 08 02:47:52.019010 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:47:52.018939 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kubeflow-trainer-controller-manager-7dd48b4b74-gzmpp" podStartSLOduration=1.744934191 podStartE2EDuration="4.018922007s" totalImagesPullingTime="2.273987816s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 02:47:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 02:47:52.018459501 +0000 UTC m=+436.453433192" watchObservedRunningTime="2026-09-08 02:47:52.018922007 +0000 UTC m=+436.453895699" Sep 08 02:48:08.013670 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:48:08.013579 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kubeflow-trainer-controller-manager-7dd48b4b74-gzmpp" Sep 08 02:49:17.028154 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:49:17.028115 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["rhai-e2e-progression-9m5nh/progression-enabled-node-0-0-tg79m"] Sep 08 02:49:17.031589 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:49:17.031566 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-9m5nh/progression-enabled-node-0-0-tg79m" Sep 08 02:49:17.034558 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:49:17.034526 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-9m5nh\"/\"openshift-service-ca.crt\"" Sep 08 02:49:17.034558 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:49:17.034541 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"rhai-e2e-progression-9m5nh\"/\"default-dockercfg-72h4f\"" Sep 08 02:49:17.035523 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:49:17.035508 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-9m5nh\"/\"kube-root-ca.crt\"" Sep 08 02:49:17.044932 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:49:17.044907 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-9m5nh/progression-enabled-node-0-0-tg79m"] Sep 08 02:49:17.128600 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:49:17.128557 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xk9dc\" (UniqueName: \"kubernetes.io/projected/96c6e0a1-b6ad-4d69-a4be-77b278f16f87-kube-api-access-xk9dc\") pod \"progression-enabled-node-0-0-tg79m\" (UID: \"96c6e0a1-b6ad-4d69-a4be-77b278f16f87\") " pod="rhai-e2e-progression-9m5nh/progression-enabled-node-0-0-tg79m" Sep 08 02:49:17.229505 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:49:17.229462 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xk9dc\" (UniqueName: \"kubernetes.io/projected/96c6e0a1-b6ad-4d69-a4be-77b278f16f87-kube-api-access-xk9dc\") pod \"progression-enabled-node-0-0-tg79m\" (UID: \"96c6e0a1-b6ad-4d69-a4be-77b278f16f87\") " pod="rhai-e2e-progression-9m5nh/progression-enabled-node-0-0-tg79m" Sep 08 02:49:17.238054 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:49:17.238023 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xk9dc\" (UniqueName: \"kubernetes.io/projected/96c6e0a1-b6ad-4d69-a4be-77b278f16f87-kube-api-access-xk9dc\") pod \"progression-enabled-node-0-0-tg79m\" (UID: \"96c6e0a1-b6ad-4d69-a4be-77b278f16f87\") " pod="rhai-e2e-progression-9m5nh/progression-enabled-node-0-0-tg79m" Sep 08 02:49:17.341676 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:49:17.341587 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-9m5nh/progression-enabled-node-0-0-tg79m" Sep 08 02:49:17.610458 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:49:17.610428 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-9m5nh/progression-enabled-node-0-0-tg79m"] Sep 08 02:49:17.612322 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:49:17.612289 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96c6e0a1_b6ad_4d69_a4be_77b278f16f87.slice/crio-ee373c0db08114261af6d30e6cae2d74d01a9202ce701caa92f105fb1bee6678 WatchSource:0}: Error finding container ee373c0db08114261af6d30e6cae2d74d01a9202ce701caa92f105fb1bee6678: Status 404 returned error can't find the container with id ee373c0db08114261af6d30e6cae2d74d01a9202ce701caa92f105fb1bee6678 Sep 08 02:49:18.347451 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:49:18.347344 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-9m5nh/progression-enabled-node-0-0-tg79m" event={"ID":"96c6e0a1-b6ad-4d69-a4be-77b278f16f87","Type":"ContainerStarted","Data":"ee373c0db08114261af6d30e6cae2d74d01a9202ce701caa92f105fb1bee6678"} Sep 08 02:50:56.853187 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:50:56.853146 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-9m5nh/progression-enabled-node-0-0-tg79m" event={"ID":"96c6e0a1-b6ad-4d69-a4be-77b278f16f87","Type":"ContainerStarted","Data":"85fd1b2389a4ab7f85de844b5c756e83ffb034bdad88c3315e0845f3649b3482"} Sep 08 02:50:56.854579 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:50:56.854554 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="rhai-e2e-progression-9m5nh/progression-enabled-node-0-0-tg79m" Sep 08 02:50:56.878077 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:50:56.878021 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="rhai-e2e-progression-9m5nh/progression-enabled-node-0-0-tg79m" podStartSLOduration=2.363432523 podStartE2EDuration="1m40.878003982s" totalImagesPullingTime="1m38.514571459s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 02:49:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 02:50:56.875757147 +0000 UTC m=+621.310730853" watchObservedRunningTime="2026-09-08 02:50:56.878003982 +0000 UTC m=+621.312977720" Sep 08 02:50:58.860719 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:50:58.860634 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="rhai-e2e-progression-9m5nh/progression-enabled-node-0-0-tg79m" Sep 08 02:51:19.858211 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:51:19.858167 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="rhai-e2e-progression-9m5nh/progression-enabled-node-0-0-tg79m" podUID="96c6e0a1-b6ad-4d69-a4be-77b278f16f87" containerName="node" probeResult="failure" output="Get \"http://10.132.0.26:28080/metrics\": dial tcp 10.132.0.26:28080: connect: connection refused" Sep 08 02:51:19.956951 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:51:19.956914 2564 generic.go:356] "Generic (PLEG): container finished" podID="96c6e0a1-b6ad-4d69-a4be-77b278f16f87" containerID="85fd1b2389a4ab7f85de844b5c756e83ffb034bdad88c3315e0845f3649b3482" exitCode=0 Sep 08 02:51:19.957115 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:51:19.956987 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-9m5nh/progression-enabled-node-0-0-tg79m" event={"ID":"96c6e0a1-b6ad-4d69-a4be-77b278f16f87","Type":"ContainerDied","Data":"85fd1b2389a4ab7f85de844b5c756e83ffb034bdad88c3315e0845f3649b3482"} Sep 08 02:51:21.112993 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:51:21.112957 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-9m5nh/progression-enabled-node-0-0-tg79m" Sep 08 02:51:21.259107 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:51:21.259020 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xk9dc\" (UniqueName: \"kubernetes.io/projected/96c6e0a1-b6ad-4d69-a4be-77b278f16f87-kube-api-access-xk9dc\") pod \"96c6e0a1-b6ad-4d69-a4be-77b278f16f87\" (UID: \"96c6e0a1-b6ad-4d69-a4be-77b278f16f87\") " Sep 08 02:51:21.261148 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:51:21.261121 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/96c6e0a1-b6ad-4d69-a4be-77b278f16f87-kube-api-access-xk9dc" (OuterVolumeSpecName: "kube-api-access-xk9dc") pod "96c6e0a1-b6ad-4d69-a4be-77b278f16f87" (UID: "96c6e0a1-b6ad-4d69-a4be-77b278f16f87"). InnerVolumeSpecName "kube-api-access-xk9dc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 08 02:51:21.359796 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:51:21.359761 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xk9dc\" (UniqueName: \"kubernetes.io/projected/96c6e0a1-b6ad-4d69-a4be-77b278f16f87-kube-api-access-xk9dc\") on node \"ip-10-0-137-161.ec2.internal\" DevicePath \"\"" Sep 08 02:51:21.967518 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:51:21.967480 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-9m5nh/progression-enabled-node-0-0-tg79m" event={"ID":"96c6e0a1-b6ad-4d69-a4be-77b278f16f87","Type":"ContainerDied","Data":"ee373c0db08114261af6d30e6cae2d74d01a9202ce701caa92f105fb1bee6678"} Sep 08 02:51:21.967518 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:51:21.967513 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-9m5nh/progression-enabled-node-0-0-tg79m" Sep 08 02:51:21.967729 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:51:21.967539 2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ee373c0db08114261af6d30e6cae2d74d01a9202ce701caa92f105fb1bee6678" Sep 08 02:51:23.437608 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:51:23.437572 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["rhai-e2e-progression-9m5nh/progression-disabled-node-0-0-sw47j"] Sep 08 02:51:23.437995 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:51:23.437899 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96c6e0a1-b6ad-4d69-a4be-77b278f16f87" containerName="node" Sep 08 02:51:23.437995 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:51:23.437911 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="96c6e0a1-b6ad-4d69-a4be-77b278f16f87" containerName="node" Sep 08 02:51:23.437995 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:51:23.437974 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="96c6e0a1-b6ad-4d69-a4be-77b278f16f87" containerName="node" Sep 08 02:51:23.464385 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:51:23.464346 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-9m5nh/progression-disabled-node-0-0-sw47j"] Sep 08 02:51:23.464532 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:51:23.464442 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-9m5nh/progression-disabled-node-0-0-sw47j" Sep 08 02:51:23.466958 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:51:23.466935 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-9m5nh\"/\"kube-root-ca.crt\"" Sep 08 02:51:23.467081 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:51:23.467040 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-9m5nh\"/\"openshift-service-ca.crt\"" Sep 08 02:51:23.467081 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:51:23.467044 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"rhai-e2e-progression-9m5nh\"/\"default-dockercfg-72h4f\"" Sep 08 02:51:23.579303 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:51:23.579269 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9855l\" (UniqueName: \"kubernetes.io/projected/f8d10306-d3b4-41d0-b904-3b53ba698e3d-kube-api-access-9855l\") pod \"progression-disabled-node-0-0-sw47j\" (UID: \"f8d10306-d3b4-41d0-b904-3b53ba698e3d\") " pod="rhai-e2e-progression-9m5nh/progression-disabled-node-0-0-sw47j" Sep 08 02:51:23.680345 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:51:23.680302 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9855l\" (UniqueName: \"kubernetes.io/projected/f8d10306-d3b4-41d0-b904-3b53ba698e3d-kube-api-access-9855l\") pod \"progression-disabled-node-0-0-sw47j\" (UID: \"f8d10306-d3b4-41d0-b904-3b53ba698e3d\") " pod="rhai-e2e-progression-9m5nh/progression-disabled-node-0-0-sw47j" Sep 08 02:51:23.688587 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:51:23.688533 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9855l\" (UniqueName: \"kubernetes.io/projected/f8d10306-d3b4-41d0-b904-3b53ba698e3d-kube-api-access-9855l\") pod \"progression-disabled-node-0-0-sw47j\" (UID: \"f8d10306-d3b4-41d0-b904-3b53ba698e3d\") " pod="rhai-e2e-progression-9m5nh/progression-disabled-node-0-0-sw47j" Sep 08 02:51:23.773999 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:51:23.773958 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-9m5nh/progression-disabled-node-0-0-sw47j" Sep 08 02:51:24.065104 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:51:24.065066 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-9m5nh/progression-disabled-node-0-0-sw47j"] Sep 08 02:51:24.069596 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:51:24.069561 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8d10306_d3b4_41d0_b904_3b53ba698e3d.slice/crio-a58f4c56b1eded401fd7567eb1a616612aadb60a7f549290da2465c2a145ca3d WatchSource:0}: Error finding container a58f4c56b1eded401fd7567eb1a616612aadb60a7f549290da2465c2a145ca3d: Status 404 returned error can't find the container with id a58f4c56b1eded401fd7567eb1a616612aadb60a7f549290da2465c2a145ca3d Sep 08 02:51:24.983144 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:51:24.983111 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-9m5nh/progression-disabled-node-0-0-sw47j" event={"ID":"f8d10306-d3b4-41d0-b904-3b53ba698e3d","Type":"ContainerStarted","Data":"7ada045084c6c0c2f555692a8d719d577560ebc36c239146c4e59956d3b1baad"} Sep 08 02:51:24.983144 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:51:24.983159 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-9m5nh/progression-disabled-node-0-0-sw47j" event={"ID":"f8d10306-d3b4-41d0-b904-3b53ba698e3d","Type":"ContainerStarted","Data":"a58f4c56b1eded401fd7567eb1a616612aadb60a7f549290da2465c2a145ca3d"} Sep 08 02:51:24.983607 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:51:24.983202 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="rhai-e2e-progression-9m5nh/progression-disabled-node-0-0-sw47j" Sep 08 02:51:25.000633 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:51:25.000578 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="rhai-e2e-progression-9m5nh/progression-disabled-node-0-0-sw47j" podStartSLOduration=2.000560858 podStartE2EDuration="2.000560858s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 02:51:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 02:51:24.999648652 +0000 UTC m=+649.434622345" watchObservedRunningTime="2026-09-08 02:51:25.000560858 +0000 UTC m=+649.435534560" Sep 08 02:51:26.990888 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:51:26.990857 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="rhai-e2e-progression-9m5nh/progression-disabled-node-0-0-sw47j" Sep 08 02:51:47.257221 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:51:47.257167 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="rhai-e2e-progression-9m5nh/progression-disabled-node-0-0-sw47j" podUID="f8d10306-d3b4-41d0-b904-3b53ba698e3d" containerName="node" probeResult="failure" output="Get \"http://10.132.0.27:28080/metrics\": read tcp 10.132.0.2:52274->10.132.0.27:28080: read: connection reset by peer" Sep 08 02:51:47.989230 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:51:47.989179 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="rhai-e2e-progression-9m5nh/progression-disabled-node-0-0-sw47j" podUID="f8d10306-d3b4-41d0-b904-3b53ba698e3d" containerName="node" probeResult="failure" output="Get \"http://10.132.0.27:28080/metrics\": dial tcp 10.132.0.27:28080: connect: connection refused" Sep 08 02:51:47.989430 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:51:47.989309 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="rhai-e2e-progression-9m5nh/progression-disabled-node-0-0-sw47j" Sep 08 02:51:47.989771 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:51:47.989745 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="rhai-e2e-progression-9m5nh/progression-disabled-node-0-0-sw47j" podUID="f8d10306-d3b4-41d0-b904-3b53ba698e3d" containerName="node" probeResult="failure" output="Get \"http://10.132.0.27:28080/metrics\": dial tcp 10.132.0.27:28080: connect: connection refused" Sep 08 02:51:48.087023 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:51:48.086985 2564 generic.go:356] "Generic (PLEG): container finished" podID="f8d10306-d3b4-41d0-b904-3b53ba698e3d" containerID="7ada045084c6c0c2f555692a8d719d577560ebc36c239146c4e59956d3b1baad" exitCode=0 Sep 08 02:51:48.087193 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:51:48.087064 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-9m5nh/progression-disabled-node-0-0-sw47j" event={"ID":"f8d10306-d3b4-41d0-b904-3b53ba698e3d","Type":"ContainerDied","Data":"7ada045084c6c0c2f555692a8d719d577560ebc36c239146c4e59956d3b1baad"} Sep 08 02:51:49.218051 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:51:49.218023 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-9m5nh/progression-disabled-node-0-0-sw47j" Sep 08 02:51:49.302342 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:51:49.302298 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9855l\" (UniqueName: \"kubernetes.io/projected/f8d10306-d3b4-41d0-b904-3b53ba698e3d-kube-api-access-9855l\") pod \"f8d10306-d3b4-41d0-b904-3b53ba698e3d\" (UID: \"f8d10306-d3b4-41d0-b904-3b53ba698e3d\") " Sep 08 02:51:49.304389 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:51:49.304343 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f8d10306-d3b4-41d0-b904-3b53ba698e3d-kube-api-access-9855l" (OuterVolumeSpecName: "kube-api-access-9855l") pod "f8d10306-d3b4-41d0-b904-3b53ba698e3d" (UID: "f8d10306-d3b4-41d0-b904-3b53ba698e3d"). InnerVolumeSpecName "kube-api-access-9855l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 08 02:51:49.403272 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:51:49.403175 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9855l\" (UniqueName: \"kubernetes.io/projected/f8d10306-d3b4-41d0-b904-3b53ba698e3d-kube-api-access-9855l\") on node \"ip-10-0-137-161.ec2.internal\" DevicePath \"\"" Sep 08 02:51:50.097655 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:51:50.097613 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-9m5nh/progression-disabled-node-0-0-sw47j" event={"ID":"f8d10306-d3b4-41d0-b904-3b53ba698e3d","Type":"ContainerDied","Data":"a58f4c56b1eded401fd7567eb1a616612aadb60a7f549290da2465c2a145ca3d"} Sep 08 02:51:50.097837 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:51:50.097694 2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a58f4c56b1eded401fd7567eb1a616612aadb60a7f549290da2465c2a145ca3d" Sep 08 02:51:50.097837 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:51:50.097626 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-9m5nh/progression-disabled-node-0-0-sw47j" Sep 08 02:51:58.437842 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:51:58.437795 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["rhai-e2e-progression-9m5nh/progression-invalid-node-0-0-qg64x"] Sep 08 02:51:58.438233 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:51:58.438135 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8d10306-d3b4-41d0-b904-3b53ba698e3d" containerName="node" Sep 08 02:51:58.438233 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:51:58.438147 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8d10306-d3b4-41d0-b904-3b53ba698e3d" containerName="node" Sep 08 02:51:58.438233 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:51:58.438194 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="f8d10306-d3b4-41d0-b904-3b53ba698e3d" containerName="node" Sep 08 02:51:58.440109 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:51:58.440093 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-9m5nh/progression-invalid-node-0-0-qg64x" Sep 08 02:51:58.442961 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:51:58.442938 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-9m5nh\"/\"kube-root-ca.crt\"" Sep 08 02:51:58.443095 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:51:58.442959 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-9m5nh\"/\"openshift-service-ca.crt\"" Sep 08 02:51:58.443095 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:51:58.442938 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"rhai-e2e-progression-9m5nh\"/\"default-dockercfg-72h4f\"" Sep 08 02:51:58.450488 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:51:58.450467 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-9m5nh/progression-invalid-node-0-0-qg64x"] Sep 08 02:51:58.581871 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:51:58.581829 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xg767\" (UniqueName: \"kubernetes.io/projected/7b7a6c36-7bfb-4498-b7dc-d6e26d5f0376-kube-api-access-xg767\") pod \"progression-invalid-node-0-0-qg64x\" (UID: \"7b7a6c36-7bfb-4498-b7dc-d6e26d5f0376\") " pod="rhai-e2e-progression-9m5nh/progression-invalid-node-0-0-qg64x" Sep 08 02:51:58.682320 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:51:58.682279 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xg767\" (UniqueName: \"kubernetes.io/projected/7b7a6c36-7bfb-4498-b7dc-d6e26d5f0376-kube-api-access-xg767\") pod \"progression-invalid-node-0-0-qg64x\" (UID: \"7b7a6c36-7bfb-4498-b7dc-d6e26d5f0376\") " pod="rhai-e2e-progression-9m5nh/progression-invalid-node-0-0-qg64x" Sep 08 02:51:58.691700 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:51:58.691637 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xg767\" (UniqueName: \"kubernetes.io/projected/7b7a6c36-7bfb-4498-b7dc-d6e26d5f0376-kube-api-access-xg767\") pod \"progression-invalid-node-0-0-qg64x\" (UID: \"7b7a6c36-7bfb-4498-b7dc-d6e26d5f0376\") " pod="rhai-e2e-progression-9m5nh/progression-invalid-node-0-0-qg64x" Sep 08 02:51:58.749757 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:51:58.749720 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-9m5nh/progression-invalid-node-0-0-qg64x" Sep 08 02:51:59.018256 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:51:59.018220 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-9m5nh/progression-invalid-node-0-0-qg64x"] Sep 08 02:51:59.021393 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:51:59.021347 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b7a6c36_7bfb_4498_b7dc_d6e26d5f0376.slice/crio-13916cd870a45c88b9d69697b660d039939ea52e35ff5b890780f92bc5fba931 WatchSource:0}: Error finding container 13916cd870a45c88b9d69697b660d039939ea52e35ff5b890780f92bc5fba931: Status 404 returned error can't find the container with id 13916cd870a45c88b9d69697b660d039939ea52e35ff5b890780f92bc5fba931 Sep 08 02:51:59.139086 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:51:59.139047 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-9m5nh/progression-invalid-node-0-0-qg64x" event={"ID":"7b7a6c36-7bfb-4498-b7dc-d6e26d5f0376","Type":"ContainerStarted","Data":"bc20229ce8c68e9818267cf6ac1e838348b5d681f8fd444c78825c33511c51f3"} Sep 08 02:51:59.139255 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:51:59.139103 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-9m5nh/progression-invalid-node-0-0-qg64x" event={"ID":"7b7a6c36-7bfb-4498-b7dc-d6e26d5f0376","Type":"ContainerStarted","Data":"13916cd870a45c88b9d69697b660d039939ea52e35ff5b890780f92bc5fba931"} Sep 08 02:51:59.139255 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:51:59.139212 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="rhai-e2e-progression-9m5nh/progression-invalid-node-0-0-qg64x" Sep 08 02:51:59.156478 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:51:59.156423 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="rhai-e2e-progression-9m5nh/progression-invalid-node-0-0-qg64x" podStartSLOduration=1.156404684 podStartE2EDuration="1.156404684s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 02:51:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 02:51:59.155933882 +0000 UTC m=+683.590907574" watchObservedRunningTime="2026-09-08 02:51:59.156404684 +0000 UTC m=+683.591378374" Sep 08 02:52:01.148535 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:52:01.148503 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="rhai-e2e-progression-9m5nh/progression-invalid-node-0-0-qg64x" Sep 08 02:52:22.195837 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:52:22.195788 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="rhai-e2e-progression-9m5nh/progression-invalid-node-0-0-qg64x" podUID="7b7a6c36-7bfb-4498-b7dc-d6e26d5f0376" containerName="node" probeResult="failure" output="Get \"http://10.132.0.28:28080/metrics\": read tcp 10.132.0.2:48302->10.132.0.28:28080: read: connection reset by peer" Sep 08 02:52:22.254739 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:52:22.254704 2564 generic.go:356] "Generic (PLEG): container finished" podID="7b7a6c36-7bfb-4498-b7dc-d6e26d5f0376" containerID="bc20229ce8c68e9818267cf6ac1e838348b5d681f8fd444c78825c33511c51f3" exitCode=0 Sep 08 02:52:22.254909 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:52:22.254773 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-9m5nh/progression-invalid-node-0-0-qg64x" event={"ID":"7b7a6c36-7bfb-4498-b7dc-d6e26d5f0376","Type":"ContainerDied","Data":"bc20229ce8c68e9818267cf6ac1e838348b5d681f8fd444c78825c33511c51f3"} Sep 08 02:52:23.390950 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:52:23.390919 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-9m5nh/progression-invalid-node-0-0-qg64x" Sep 08 02:52:23.506675 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:52:23.506636 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xg767\" (UniqueName: \"kubernetes.io/projected/7b7a6c36-7bfb-4498-b7dc-d6e26d5f0376-kube-api-access-xg767\") pod \"7b7a6c36-7bfb-4498-b7dc-d6e26d5f0376\" (UID: \"7b7a6c36-7bfb-4498-b7dc-d6e26d5f0376\") " Sep 08 02:52:23.508849 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:52:23.508787 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b7a6c36-7bfb-4498-b7dc-d6e26d5f0376-kube-api-access-xg767" (OuterVolumeSpecName: "kube-api-access-xg767") pod "7b7a6c36-7bfb-4498-b7dc-d6e26d5f0376" (UID: "7b7a6c36-7bfb-4498-b7dc-d6e26d5f0376"). InnerVolumeSpecName "kube-api-access-xg767". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 08 02:52:23.607405 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:52:23.607346 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xg767\" (UniqueName: \"kubernetes.io/projected/7b7a6c36-7bfb-4498-b7dc-d6e26d5f0376-kube-api-access-xg767\") on node \"ip-10-0-137-161.ec2.internal\" DevicePath \"\"" Sep 08 02:52:24.264012 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:52:24.263978 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-9m5nh/progression-invalid-node-0-0-qg64x" event={"ID":"7b7a6c36-7bfb-4498-b7dc-d6e26d5f0376","Type":"ContainerDied","Data":"13916cd870a45c88b9d69697b660d039939ea52e35ff5b890780f92bc5fba931"} Sep 08 02:52:24.264012 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:52:24.263996 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-9m5nh/progression-invalid-node-0-0-qg64x" Sep 08 02:52:24.264012 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:52:24.264022 2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="13916cd870a45c88b9d69697b660d039939ea52e35ff5b890780f92bc5fba931" Sep 08 02:54:04.009285 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:54:04.009198 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["rhai-e2e-progression-9m5nh/progression-no-metrics-node-0-0-z8dwq"] Sep 08 02:54:04.009797 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:54:04.009546 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b7a6c36-7bfb-4498-b7dc-d6e26d5f0376" containerName="node" Sep 08 02:54:04.009797 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:54:04.009557 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b7a6c36-7bfb-4498-b7dc-d6e26d5f0376" containerName="node" Sep 08 02:54:04.009797 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:54:04.009618 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="7b7a6c36-7bfb-4498-b7dc-d6e26d5f0376" containerName="node" Sep 08 02:54:04.011523 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:54:04.011507 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-9m5nh/progression-no-metrics-node-0-0-z8dwq" Sep 08 02:54:04.014561 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:54:04.014538 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"rhai-e2e-progression-9m5nh\"/\"default-dockercfg-72h4f\"" Sep 08 02:54:04.014650 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:54:04.014568 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-9m5nh\"/\"openshift-service-ca.crt\"" Sep 08 02:54:04.015480 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:54:04.015460 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-9m5nh\"/\"kube-root-ca.crt\"" Sep 08 02:54:04.021065 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:54:04.021040 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-9m5nh/progression-no-metrics-node-0-0-z8dwq"] Sep 08 02:54:04.038563 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:54:04.038527 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b6xp4\" (UniqueName: \"kubernetes.io/projected/897d6703-6e92-4529-96b8-131bc49a89b8-kube-api-access-b6xp4\") pod \"progression-no-metrics-node-0-0-z8dwq\" (UID: \"897d6703-6e92-4529-96b8-131bc49a89b8\") " pod="rhai-e2e-progression-9m5nh/progression-no-metrics-node-0-0-z8dwq" Sep 08 02:54:04.139395 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:54:04.139335 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6xp4\" (UniqueName: \"kubernetes.io/projected/897d6703-6e92-4529-96b8-131bc49a89b8-kube-api-access-b6xp4\") pod \"progression-no-metrics-node-0-0-z8dwq\" (UID: \"897d6703-6e92-4529-96b8-131bc49a89b8\") " pod="rhai-e2e-progression-9m5nh/progression-no-metrics-node-0-0-z8dwq" Sep 08 02:54:04.148801 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:54:04.148765 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b6xp4\" (UniqueName: \"kubernetes.io/projected/897d6703-6e92-4529-96b8-131bc49a89b8-kube-api-access-b6xp4\") pod \"progression-no-metrics-node-0-0-z8dwq\" (UID: \"897d6703-6e92-4529-96b8-131bc49a89b8\") " pod="rhai-e2e-progression-9m5nh/progression-no-metrics-node-0-0-z8dwq" Sep 08 02:54:04.321619 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:54:04.321516 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-9m5nh/progression-no-metrics-node-0-0-z8dwq" Sep 08 02:54:04.591644 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:54:04.591539 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-9m5nh/progression-no-metrics-node-0-0-z8dwq"] Sep 08 02:54:04.594075 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:54:04.594047 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod897d6703_6e92_4529_96b8_131bc49a89b8.slice/crio-c3e77279416eba3c9ff3a597498b0b4ef7b5bdefd209794bb0fd87189a9150e2 WatchSource:0}: Error finding container c3e77279416eba3c9ff3a597498b0b4ef7b5bdefd209794bb0fd87189a9150e2: Status 404 returned error can't find the container with id c3e77279416eba3c9ff3a597498b0b4ef7b5bdefd209794bb0fd87189a9150e2 Sep 08 02:54:04.720644 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:54:04.720601 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-9m5nh/progression-no-metrics-node-0-0-z8dwq" event={"ID":"897d6703-6e92-4529-96b8-131bc49a89b8","Type":"ContainerStarted","Data":"77b1340b2608d519763236c2ee83f03d92c534369da51a3fa0f40899c01006c3"} Sep 08 02:54:04.720826 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:54:04.720656 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-9m5nh/progression-no-metrics-node-0-0-z8dwq" event={"ID":"897d6703-6e92-4529-96b8-131bc49a89b8","Type":"ContainerStarted","Data":"c3e77279416eba3c9ff3a597498b0b4ef7b5bdefd209794bb0fd87189a9150e2"} Sep 08 02:54:04.737103 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:54:04.736977 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="rhai-e2e-progression-9m5nh/progression-no-metrics-node-0-0-z8dwq" podStartSLOduration=1.736956841 podStartE2EDuration="1.736956841s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 02:54:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 02:54:04.736477398 +0000 UTC m=+809.171451094" watchObservedRunningTime="2026-09-08 02:54:04.736956841 +0000 UTC m=+809.171930531" Sep 08 02:54:09.745215 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:54:09.745180 2564 generic.go:356] "Generic (PLEG): container finished" podID="897d6703-6e92-4529-96b8-131bc49a89b8" containerID="77b1340b2608d519763236c2ee83f03d92c534369da51a3fa0f40899c01006c3" exitCode=0 Sep 08 02:54:09.745579 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:54:09.745251 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-9m5nh/progression-no-metrics-node-0-0-z8dwq" event={"ID":"897d6703-6e92-4529-96b8-131bc49a89b8","Type":"ContainerDied","Data":"77b1340b2608d519763236c2ee83f03d92c534369da51a3fa0f40899c01006c3"} Sep 08 02:54:10.879283 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:54:10.879253 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-9m5nh/progression-no-metrics-node-0-0-z8dwq" Sep 08 02:54:10.897773 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:54:10.897744 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b6xp4\" (UniqueName: \"kubernetes.io/projected/897d6703-6e92-4529-96b8-131bc49a89b8-kube-api-access-b6xp4\") pod \"897d6703-6e92-4529-96b8-131bc49a89b8\" (UID: \"897d6703-6e92-4529-96b8-131bc49a89b8\") " Sep 08 02:54:10.899960 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:54:10.899934 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/897d6703-6e92-4529-96b8-131bc49a89b8-kube-api-access-b6xp4" (OuterVolumeSpecName: "kube-api-access-b6xp4") pod "897d6703-6e92-4529-96b8-131bc49a89b8" (UID: "897d6703-6e92-4529-96b8-131bc49a89b8"). InnerVolumeSpecName "kube-api-access-b6xp4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 08 02:54:10.999105 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:54:10.999048 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b6xp4\" (UniqueName: \"kubernetes.io/projected/897d6703-6e92-4529-96b8-131bc49a89b8-kube-api-access-b6xp4\") on node \"ip-10-0-137-161.ec2.internal\" DevicePath \"\"" Sep 08 02:54:11.755760 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:54:11.755726 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-9m5nh/progression-no-metrics-node-0-0-z8dwq" Sep 08 02:54:11.755760 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:54:11.755753 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-9m5nh/progression-no-metrics-node-0-0-z8dwq" event={"ID":"897d6703-6e92-4529-96b8-131bc49a89b8","Type":"ContainerDied","Data":"c3e77279416eba3c9ff3a597498b0b4ef7b5bdefd209794bb0fd87189a9150e2"} Sep 08 02:54:11.755983 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:54:11.755798 2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c3e77279416eba3c9ff3a597498b0b4ef7b5bdefd209794bb0fd87189a9150e2" Sep 08 02:54:13.064437 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:54:13.064402 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-gmgk9/must-gather-8cmdp"] Sep 08 02:54:13.064823 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:54:13.064770 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="897d6703-6e92-4529-96b8-131bc49a89b8" containerName="node" Sep 08 02:54:13.064823 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:54:13.064781 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="897d6703-6e92-4529-96b8-131bc49a89b8" containerName="node" Sep 08 02:54:13.064963 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:54:13.064855 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="897d6703-6e92-4529-96b8-131bc49a89b8" containerName="node" Sep 08 02:54:13.067028 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:54:13.067006 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gmgk9/must-gather-8cmdp" Sep 08 02:54:13.069753 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:54:13.069732 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-gmgk9\"/\"openshift-service-ca.crt\"" Sep 08 02:54:13.069856 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:54:13.069731 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-gmgk9\"/\"default-dockercfg-vjsn6\"" Sep 08 02:54:13.070566 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:54:13.070545 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-gmgk9\"/\"kube-root-ca.crt\"" Sep 08 02:54:13.076896 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:54:13.076876 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gmgk9/must-gather-8cmdp"] Sep 08 02:54:13.119462 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:54:13.119240 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/9c5e27d4-5913-4a27-b1f7-8ee70488f4e9-must-gather-output\") pod \"must-gather-8cmdp\" (UID: \"9c5e27d4-5913-4a27-b1f7-8ee70488f4e9\") " pod="openshift-must-gather-gmgk9/must-gather-8cmdp" Sep 08 02:54:13.119462 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:54:13.119307 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tp94j\" (UniqueName: \"kubernetes.io/projected/9c5e27d4-5913-4a27-b1f7-8ee70488f4e9-kube-api-access-tp94j\") pod \"must-gather-8cmdp\" (UID: \"9c5e27d4-5913-4a27-b1f7-8ee70488f4e9\") " pod="openshift-must-gather-gmgk9/must-gather-8cmdp" Sep 08 02:54:13.220207 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:54:13.220157 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/9c5e27d4-5913-4a27-b1f7-8ee70488f4e9-must-gather-output\") pod \"must-gather-8cmdp\" (UID: \"9c5e27d4-5913-4a27-b1f7-8ee70488f4e9\") " pod="openshift-must-gather-gmgk9/must-gather-8cmdp" Sep 08 02:54:13.220207 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:54:13.220213 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tp94j\" (UniqueName: \"kubernetes.io/projected/9c5e27d4-5913-4a27-b1f7-8ee70488f4e9-kube-api-access-tp94j\") pod \"must-gather-8cmdp\" (UID: \"9c5e27d4-5913-4a27-b1f7-8ee70488f4e9\") " pod="openshift-must-gather-gmgk9/must-gather-8cmdp" Sep 08 02:54:13.220559 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:54:13.220535 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/9c5e27d4-5913-4a27-b1f7-8ee70488f4e9-must-gather-output\") pod \"must-gather-8cmdp\" (UID: \"9c5e27d4-5913-4a27-b1f7-8ee70488f4e9\") " pod="openshift-must-gather-gmgk9/must-gather-8cmdp" Sep 08 02:54:13.227920 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:54:13.227895 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tp94j\" (UniqueName: \"kubernetes.io/projected/9c5e27d4-5913-4a27-b1f7-8ee70488f4e9-kube-api-access-tp94j\") pod \"must-gather-8cmdp\" (UID: \"9c5e27d4-5913-4a27-b1f7-8ee70488f4e9\") " pod="openshift-must-gather-gmgk9/must-gather-8cmdp" Sep 08 02:54:13.377242 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:54:13.377137 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gmgk9/must-gather-8cmdp" Sep 08 02:54:13.643956 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:54:13.643928 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gmgk9/must-gather-8cmdp"] Sep 08 02:54:13.646169 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:54:13.646125 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9c5e27d4_5913_4a27_b1f7_8ee70488f4e9.slice/crio-4c68236be980e4ea44ed7e8c6d9a76164f578f74539b9919a9a512f406e4850d WatchSource:0}: Error finding container 4c68236be980e4ea44ed7e8c6d9a76164f578f74539b9919a9a512f406e4850d: Status 404 returned error can't find the container with id 4c68236be980e4ea44ed7e8c6d9a76164f578f74539b9919a9a512f406e4850d Sep 08 02:54:13.648093 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:54:13.648076 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 08 02:54:13.766222 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:54:13.766184 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gmgk9/must-gather-8cmdp" event={"ID":"9c5e27d4-5913-4a27-b1f7-8ee70488f4e9","Type":"ContainerStarted","Data":"4c68236be980e4ea44ed7e8c6d9a76164f578f74539b9919a9a512f406e4850d"} Sep 08 02:54:17.091599 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:54:17.091561 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["rhai-e2e-progression-9m5nh/progression-disabled-node-0-0-sw47j"] Sep 08 02:54:17.095092 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:54:17.095064 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["rhai-e2e-progression-9m5nh/progression-disabled-node-0-0-sw47j"] Sep 08 02:54:17.100076 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:54:17.100044 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["rhai-e2e-progression-9m5nh/progression-enabled-node-0-0-tg79m"] Sep 08 02:54:17.103679 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:54:17.103656 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["rhai-e2e-progression-9m5nh/progression-enabled-node-0-0-tg79m"] Sep 08 02:54:17.108615 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:54:17.108586 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["rhai-e2e-progression-9m5nh/progression-invalid-node-0-0-qg64x"] Sep 08 02:54:17.115534 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:54:17.115499 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["rhai-e2e-progression-9m5nh/progression-invalid-node-0-0-qg64x"] Sep 08 02:54:17.130921 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:54:17.130894 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["rhai-e2e-progression-9m5nh/progression-no-metrics-node-0-0-z8dwq"] Sep 08 02:54:17.134295 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:54:17.134273 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["rhai-e2e-progression-9m5nh/progression-no-metrics-node-0-0-z8dwq"] Sep 08 02:54:18.108192 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:54:18.108161 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7b7a6c36-7bfb-4498-b7dc-d6e26d5f0376" path="/var/lib/kubelet/pods/7b7a6c36-7bfb-4498-b7dc-d6e26d5f0376/volumes" Sep 08 02:54:18.108678 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:54:18.108652 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="897d6703-6e92-4529-96b8-131bc49a89b8" path="/var/lib/kubelet/pods/897d6703-6e92-4529-96b8-131bc49a89b8/volumes" Sep 08 02:54:18.109018 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:54:18.108996 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="96c6e0a1-b6ad-4d69-a4be-77b278f16f87" path="/var/lib/kubelet/pods/96c6e0a1-b6ad-4d69-a4be-77b278f16f87/volumes" Sep 08 02:54:18.109378 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:54:18.109346 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f8d10306-d3b4-41d0-b904-3b53ba698e3d" path="/var/lib/kubelet/pods/f8d10306-d3b4-41d0-b904-3b53ba698e3d/volumes" Sep 08 02:54:19.803045 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:54:19.803012 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gmgk9/must-gather-8cmdp" event={"ID":"9c5e27d4-5913-4a27-b1f7-8ee70488f4e9","Type":"ContainerStarted","Data":"0e9fb56d902c94b91d8d2369d6919b9fb1de7dc3a1dfb9d9ef8846bb04db8956"} Sep 08 02:54:20.812128 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:54:20.812091 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gmgk9/must-gather-8cmdp" event={"ID":"9c5e27d4-5913-4a27-b1f7-8ee70488f4e9","Type":"ContainerStarted","Data":"ec5fac87182a730587689a612c0f69793090eb387396c4d86ce4eae64323413d"} Sep 08 02:54:20.828161 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:54:20.828102 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-gmgk9/must-gather-8cmdp" podStartSLOduration=1.888413528 podStartE2EDuration="7.828084678s" totalImagesPullingTime="5.93967115s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 02:54:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 02:54:20.827416273 +0000 UTC m=+825.262389963" watchObservedRunningTime="2026-09-08 02:54:20.828084678 +0000 UTC m=+825.263058368" Sep 08 02:55:04.044151 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:55:04.044112 2564 generic.go:356] "Generic (PLEG): container finished" podID="9c5e27d4-5913-4a27-b1f7-8ee70488f4e9" containerID="0e9fb56d902c94b91d8d2369d6919b9fb1de7dc3a1dfb9d9ef8846bb04db8956" exitCode=0 Sep 08 02:55:04.044585 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:55:04.044184 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gmgk9/must-gather-8cmdp" event={"ID":"9c5e27d4-5913-4a27-b1f7-8ee70488f4e9","Type":"ContainerDied","Data":"0e9fb56d902c94b91d8d2369d6919b9fb1de7dc3a1dfb9d9ef8846bb04db8956"} Sep 08 02:55:04.044585 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:55:04.044532 2564 scope.go:117] "RemoveContainer" containerID="0e9fb56d902c94b91d8d2369d6919b9fb1de7dc3a1dfb9d9ef8846bb04db8956" Sep 08 02:55:04.305485 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:55:04.305371 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-gmgk9_must-gather-8cmdp_9c5e27d4-5913-4a27-b1f7-8ee70488f4e9/gather/0.log" Sep 08 02:55:07.569107 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:55:07.569076 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-s6jbs_ce406489-045e-4ba5-baa6-337a983d5466/global-pull-secret-syncer/0.log" Sep 08 02:55:07.670910 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:55:07.670875 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-j8s84_75f73d39-6aff-4777-a417-4d6ac2f786ff/konnectivity-agent/0.log" Sep 08 02:55:07.737210 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:55:07.737163 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-137-161.ec2.internal_7548266a78d2e5528caa994a0756154a/haproxy/0.log" Sep 08 02:55:09.620280 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:55:09.620244 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-gmgk9/must-gather-8cmdp"] Sep 08 02:55:09.620694 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:55:09.620471 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-must-gather-gmgk9/must-gather-8cmdp" podUID="9c5e27d4-5913-4a27-b1f7-8ee70488f4e9" containerName="copy" containerID="cri-o://ec5fac87182a730587689a612c0f69793090eb387396c4d86ce4eae64323413d" gracePeriod=2 Sep 08 02:55:09.625609 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:55:09.625584 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-gmgk9/must-gather-8cmdp"] Sep 08 02:55:09.852449 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:55:09.852427 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-gmgk9_must-gather-8cmdp_9c5e27d4-5913-4a27-b1f7-8ee70488f4e9/copy/0.log" Sep 08 02:55:09.855030 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:55:09.855012 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gmgk9/must-gather-8cmdp" Sep 08 02:55:09.856961 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:55:09.856939 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-8cmdp\" is forbidden: User \"system:node:ip-10-0-137-161.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-gmgk9\": no relationship found between node 'ip-10-0-137-161.ec2.internal' and this object" podUID="9c5e27d4-5913-4a27-b1f7-8ee70488f4e9" pod="openshift-must-gather-gmgk9/must-gather-8cmdp" Sep 08 02:55:09.952012 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:55:09.951917 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tp94j\" (UniqueName: \"kubernetes.io/projected/9c5e27d4-5913-4a27-b1f7-8ee70488f4e9-kube-api-access-tp94j\") pod \"9c5e27d4-5913-4a27-b1f7-8ee70488f4e9\" (UID: \"9c5e27d4-5913-4a27-b1f7-8ee70488f4e9\") " Sep 08 02:55:09.952012 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:55:09.952017 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/9c5e27d4-5913-4a27-b1f7-8ee70488f4e9-must-gather-output\") pod \"9c5e27d4-5913-4a27-b1f7-8ee70488f4e9\" (UID: \"9c5e27d4-5913-4a27-b1f7-8ee70488f4e9\") " Sep 08 02:55:09.953269 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:55:09.953239 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c5e27d4-5913-4a27-b1f7-8ee70488f4e9-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "9c5e27d4-5913-4a27-b1f7-8ee70488f4e9" (UID: "9c5e27d4-5913-4a27-b1f7-8ee70488f4e9"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 08 02:55:09.954093 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:55:09.954064 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c5e27d4-5913-4a27-b1f7-8ee70488f4e9-kube-api-access-tp94j" (OuterVolumeSpecName: "kube-api-access-tp94j") pod "9c5e27d4-5913-4a27-b1f7-8ee70488f4e9" (UID: "9c5e27d4-5913-4a27-b1f7-8ee70488f4e9"). InnerVolumeSpecName "kube-api-access-tp94j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 08 02:55:10.052875 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:55:10.052834 2564 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/9c5e27d4-5913-4a27-b1f7-8ee70488f4e9-must-gather-output\") on node \"ip-10-0-137-161.ec2.internal\" DevicePath \"\"" Sep 08 02:55:10.052875 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:55:10.052866 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tp94j\" (UniqueName: \"kubernetes.io/projected/9c5e27d4-5913-4a27-b1f7-8ee70488f4e9-kube-api-access-tp94j\") on node \"ip-10-0-137-161.ec2.internal\" DevicePath \"\"" Sep 08 02:55:10.073075 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:55:10.073051 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-gmgk9_must-gather-8cmdp_9c5e27d4-5913-4a27-b1f7-8ee70488f4e9/copy/0.log" Sep 08 02:55:10.073416 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:55:10.073394 2564 generic.go:356] "Generic (PLEG): container finished" podID="9c5e27d4-5913-4a27-b1f7-8ee70488f4e9" containerID="ec5fac87182a730587689a612c0f69793090eb387396c4d86ce4eae64323413d" exitCode=143 Sep 08 02:55:10.073499 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:55:10.073449 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gmgk9/must-gather-8cmdp" Sep 08 02:55:10.073546 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:55:10.073503 2564 scope.go:117] "RemoveContainer" containerID="ec5fac87182a730587689a612c0f69793090eb387396c4d86ce4eae64323413d" Sep 08 02:55:10.075591 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:55:10.075564 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-8cmdp\" is forbidden: User \"system:node:ip-10-0-137-161.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-gmgk9\": no relationship found between node 'ip-10-0-137-161.ec2.internal' and this object" podUID="9c5e27d4-5913-4a27-b1f7-8ee70488f4e9" pod="openshift-must-gather-gmgk9/must-gather-8cmdp" Sep 08 02:55:10.081586 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:55:10.081568 2564 scope.go:117] "RemoveContainer" containerID="0e9fb56d902c94b91d8d2369d6919b9fb1de7dc3a1dfb9d9ef8846bb04db8956" Sep 08 02:55:10.083443 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:55:10.083420 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-8cmdp\" is forbidden: User \"system:node:ip-10-0-137-161.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-gmgk9\": no relationship found between node 'ip-10-0-137-161.ec2.internal' and this object" podUID="9c5e27d4-5913-4a27-b1f7-8ee70488f4e9" pod="openshift-must-gather-gmgk9/must-gather-8cmdp" Sep 08 02:55:10.093569 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:55:10.093550 2564 scope.go:117] "RemoveContainer" containerID="ec5fac87182a730587689a612c0f69793090eb387396c4d86ce4eae64323413d" Sep 08 02:55:10.093866 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:55:10.093843 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ec5fac87182a730587689a612c0f69793090eb387396c4d86ce4eae64323413d\": container with ID starting with ec5fac87182a730587689a612c0f69793090eb387396c4d86ce4eae64323413d not found: ID does not exist" containerID="ec5fac87182a730587689a612c0f69793090eb387396c4d86ce4eae64323413d" Sep 08 02:55:10.093912 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:55:10.093875 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec5fac87182a730587689a612c0f69793090eb387396c4d86ce4eae64323413d"} err="failed to get container status \"ec5fac87182a730587689a612c0f69793090eb387396c4d86ce4eae64323413d\": rpc error: code = NotFound desc = could not find container \"ec5fac87182a730587689a612c0f69793090eb387396c4d86ce4eae64323413d\": container with ID starting with ec5fac87182a730587689a612c0f69793090eb387396c4d86ce4eae64323413d not found: ID does not exist" Sep 08 02:55:10.093912 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:55:10.093892 2564 scope.go:117] "RemoveContainer" containerID="0e9fb56d902c94b91d8d2369d6919b9fb1de7dc3a1dfb9d9ef8846bb04db8956" Sep 08 02:55:10.094146 ip-10-0-137-161 kubenswrapper[2564]: E0908 02:55:10.094128 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0e9fb56d902c94b91d8d2369d6919b9fb1de7dc3a1dfb9d9ef8846bb04db8956\": container with ID starting with 0e9fb56d902c94b91d8d2369d6919b9fb1de7dc3a1dfb9d9ef8846bb04db8956 not found: ID does not exist" containerID="0e9fb56d902c94b91d8d2369d6919b9fb1de7dc3a1dfb9d9ef8846bb04db8956" Sep 08 02:55:10.094187 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:55:10.094153 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0e9fb56d902c94b91d8d2369d6919b9fb1de7dc3a1dfb9d9ef8846bb04db8956"} err="failed to get container status \"0e9fb56d902c94b91d8d2369d6919b9fb1de7dc3a1dfb9d9ef8846bb04db8956\": rpc error: code = NotFound desc = could not find container \"0e9fb56d902c94b91d8d2369d6919b9fb1de7dc3a1dfb9d9ef8846bb04db8956\": container with ID starting with 0e9fb56d902c94b91d8d2369d6919b9fb1de7dc3a1dfb9d9ef8846bb04db8956 not found: ID does not exist" Sep 08 02:55:10.106233 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:55:10.106209 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9c5e27d4-5913-4a27-b1f7-8ee70488f4e9" path="/var/lib/kubelet/pods/9c5e27d4-5913-4a27-b1f7-8ee70488f4e9/volumes" Sep 08 02:55:11.221115 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:55:11.221088 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e5cb7c2c-af0b-442d-b4c2-3a1b7ddbda20/alertmanager/0.log" Sep 08 02:55:11.257312 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:55:11.257285 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e5cb7c2c-af0b-442d-b4c2-3a1b7ddbda20/config-reloader/0.log" Sep 08 02:55:11.302520 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:55:11.302485 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e5cb7c2c-af0b-442d-b4c2-3a1b7ddbda20/kube-rbac-proxy-web/0.log" Sep 08 02:55:11.335754 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:55:11.335731 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e5cb7c2c-af0b-442d-b4c2-3a1b7ddbda20/kube-rbac-proxy/0.log" Sep 08 02:55:11.370546 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:55:11.370522 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e5cb7c2c-af0b-442d-b4c2-3a1b7ddbda20/kube-rbac-proxy-metric/0.log" Sep 08 02:55:11.403396 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:55:11.403370 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e5cb7c2c-af0b-442d-b4c2-3a1b7ddbda20/prom-label-proxy/0.log" Sep 08 02:55:11.433414 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:55:11.433323 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e5cb7c2c-af0b-442d-b4c2-3a1b7ddbda20/init-config-reloader/0.log" Sep 08 02:55:11.603770 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:55:11.603746 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-5bcbf954f-v87md_8910b80c-cfcf-4f9b-bccd-150c285d1cb6/metrics-server/0.log" Sep 08 02:55:11.636369 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:55:11.636325 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-85bbbbbf4-xxswc_3e00f71c-ee93-4821-8c42-707e62e92162/monitoring-plugin/0.log" Sep 08 02:55:11.839694 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:55:11.839660 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jbz4j_95b583ca-8a12-442b-b8b6-0cf2d7b39bee/node-exporter/0.log" Sep 08 02:55:11.864296 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:55:11.864259 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jbz4j_95b583ca-8a12-442b-b8b6-0cf2d7b39bee/kube-rbac-proxy/0.log" Sep 08 02:55:11.892301 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:55:11.892275 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jbz4j_95b583ca-8a12-442b-b8b6-0cf2d7b39bee/init-textfile/0.log" Sep 08 02:55:11.940647 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:55:11.940620 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-rpnbl_d527f051-5bdd-47ee-98f6-e4a6116d832e/kube-rbac-proxy-main/0.log" Sep 08 02:55:11.965592 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:55:11.965560 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-rpnbl_d527f051-5bdd-47ee-98f6-e4a6116d832e/kube-rbac-proxy-self/0.log" Sep 08 02:55:11.985817 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:55:11.985776 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-rpnbl_d527f051-5bdd-47ee-98f6-e4a6116d832e/openshift-state-metrics/0.log" Sep 08 02:55:12.022929 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:55:12.022901 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_403f64a1-3ff3-4b4c-baae-28b295cf1707/prometheus/0.log" Sep 08 02:55:12.043957 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:55:12.043933 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_403f64a1-3ff3-4b4c-baae-28b295cf1707/config-reloader/0.log" Sep 08 02:55:12.066203 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:55:12.066118 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_403f64a1-3ff3-4b4c-baae-28b295cf1707/thanos-sidecar/0.log" Sep 08 02:55:12.086991 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:55:12.086965 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_403f64a1-3ff3-4b4c-baae-28b295cf1707/kube-rbac-proxy-web/0.log" Sep 08 02:55:12.116092 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:55:12.116070 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_403f64a1-3ff3-4b4c-baae-28b295cf1707/kube-rbac-proxy/0.log" Sep 08 02:55:12.139382 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:55:12.139340 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_403f64a1-3ff3-4b4c-baae-28b295cf1707/kube-rbac-proxy-thanos/0.log" Sep 08 02:55:12.166265 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:55:12.166243 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_403f64a1-3ff3-4b4c-baae-28b295cf1707/init-config-reloader/0.log" Sep 08 02:55:12.250473 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:55:12.250448 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-78f599db79-dpr4j_1564024f-3314-452e-818c-76a24b230709/prometheus-operator-admission-webhook/0.log" Sep 08 02:55:12.282692 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:55:12.282667 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6799d75bf-zzb6j_eb3bd1cc-6a72-470c-bfd3-5917aaf42767/telemeter-client/0.log" Sep 08 02:55:12.306925 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:55:12.306896 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6799d75bf-zzb6j_eb3bd1cc-6a72-470c-bfd3-5917aaf42767/reload/0.log" Sep 08 02:55:12.330664 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:55:12.330573 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6799d75bf-zzb6j_eb3bd1cc-6a72-470c-bfd3-5917aaf42767/kube-rbac-proxy/0.log" Sep 08 02:55:14.631901 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:55:14.631863 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-85d98c998f-lw2t4_5ae7a553-d702-4b33-a05e-8afa348133fa/download-server/0.log" Sep 08 02:55:15.076871 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:55:15.076834 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-zdms6/perf-node-gather-daemonset-9dn59"] Sep 08 02:55:15.077175 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:55:15.077162 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c5e27d4-5913-4a27-b1f7-8ee70488f4e9" containerName="copy" Sep 08 02:55:15.077232 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:55:15.077176 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c5e27d4-5913-4a27-b1f7-8ee70488f4e9" containerName="copy" Sep 08 02:55:15.077232 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:55:15.077202 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c5e27d4-5913-4a27-b1f7-8ee70488f4e9" containerName="gather" Sep 08 02:55:15.077232 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:55:15.077207 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c5e27d4-5913-4a27-b1f7-8ee70488f4e9" containerName="gather" Sep 08 02:55:15.077318 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:55:15.077256 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="9c5e27d4-5913-4a27-b1f7-8ee70488f4e9" containerName="copy" Sep 08 02:55:15.077318 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:55:15.077267 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="9c5e27d4-5913-4a27-b1f7-8ee70488f4e9" containerName="gather" Sep 08 02:55:15.082334 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:55:15.082312 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-zdms6/perf-node-gather-daemonset-9dn59" Sep 08 02:55:15.084639 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:55:15.084615 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-zdms6\"/\"kube-root-ca.crt\"" Sep 08 02:55:15.084745 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:55:15.084621 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-zdms6\"/\"openshift-service-ca.crt\"" Sep 08 02:55:15.085595 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:55:15.085554 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-zdms6\"/\"default-dockercfg-tkzkp\"" Sep 08 02:55:15.087529 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:55:15.087506 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-zdms6/perf-node-gather-daemonset-9dn59"] Sep 08 02:55:15.195231 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:55:15.195196 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fcd8f525-dc72-4941-9691-bdf31eca685c-podres\") pod \"perf-node-gather-daemonset-9dn59\" (UID: \"fcd8f525-dc72-4941-9691-bdf31eca685c\") " pod="openshift-must-gather-zdms6/perf-node-gather-daemonset-9dn59" Sep 08 02:55:15.195231 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:55:15.195238 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2596m\" (UniqueName: \"kubernetes.io/projected/fcd8f525-dc72-4941-9691-bdf31eca685c-kube-api-access-2596m\") pod \"perf-node-gather-daemonset-9dn59\" (UID: \"fcd8f525-dc72-4941-9691-bdf31eca685c\") " pod="openshift-must-gather-zdms6/perf-node-gather-daemonset-9dn59" Sep 08 02:55:15.195484 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:55:15.195334 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fcd8f525-dc72-4941-9691-bdf31eca685c-sys\") pod \"perf-node-gather-daemonset-9dn59\" (UID: \"fcd8f525-dc72-4941-9691-bdf31eca685c\") " pod="openshift-must-gather-zdms6/perf-node-gather-daemonset-9dn59" Sep 08 02:55:15.195484 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:55:15.195385 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fcd8f525-dc72-4941-9691-bdf31eca685c-proc\") pod \"perf-node-gather-daemonset-9dn59\" (UID: \"fcd8f525-dc72-4941-9691-bdf31eca685c\") " pod="openshift-must-gather-zdms6/perf-node-gather-daemonset-9dn59" Sep 08 02:55:15.195484 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:55:15.195411 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fcd8f525-dc72-4941-9691-bdf31eca685c-lib-modules\") pod \"perf-node-gather-daemonset-9dn59\" (UID: \"fcd8f525-dc72-4941-9691-bdf31eca685c\") " pod="openshift-must-gather-zdms6/perf-node-gather-daemonset-9dn59" Sep 08 02:55:15.295853 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:55:15.295814 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fcd8f525-dc72-4941-9691-bdf31eca685c-sys\") pod \"perf-node-gather-daemonset-9dn59\" (UID: \"fcd8f525-dc72-4941-9691-bdf31eca685c\") " pod="openshift-must-gather-zdms6/perf-node-gather-daemonset-9dn59" Sep 08 02:55:15.295853 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:55:15.295855 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fcd8f525-dc72-4941-9691-bdf31eca685c-proc\") pod \"perf-node-gather-daemonset-9dn59\" (UID: \"fcd8f525-dc72-4941-9691-bdf31eca685c\") " pod="openshift-must-gather-zdms6/perf-node-gather-daemonset-9dn59" Sep 08 02:55:15.296053 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:55:15.295877 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fcd8f525-dc72-4941-9691-bdf31eca685c-lib-modules\") pod \"perf-node-gather-daemonset-9dn59\" (UID: \"fcd8f525-dc72-4941-9691-bdf31eca685c\") " pod="openshift-must-gather-zdms6/perf-node-gather-daemonset-9dn59" Sep 08 02:55:15.296053 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:55:15.295926 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fcd8f525-dc72-4941-9691-bdf31eca685c-podres\") pod \"perf-node-gather-daemonset-9dn59\" (UID: \"fcd8f525-dc72-4941-9691-bdf31eca685c\") " pod="openshift-must-gather-zdms6/perf-node-gather-daemonset-9dn59" Sep 08 02:55:15.296053 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:55:15.295946 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2596m\" (UniqueName: \"kubernetes.io/projected/fcd8f525-dc72-4941-9691-bdf31eca685c-kube-api-access-2596m\") pod \"perf-node-gather-daemonset-9dn59\" (UID: \"fcd8f525-dc72-4941-9691-bdf31eca685c\") " pod="openshift-must-gather-zdms6/perf-node-gather-daemonset-9dn59" Sep 08 02:55:15.296053 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:55:15.295947 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fcd8f525-dc72-4941-9691-bdf31eca685c-proc\") pod \"perf-node-gather-daemonset-9dn59\" (UID: \"fcd8f525-dc72-4941-9691-bdf31eca685c\") " pod="openshift-must-gather-zdms6/perf-node-gather-daemonset-9dn59" Sep 08 02:55:15.296053 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:55:15.295947 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fcd8f525-dc72-4941-9691-bdf31eca685c-sys\") pod \"perf-node-gather-daemonset-9dn59\" (UID: \"fcd8f525-dc72-4941-9691-bdf31eca685c\") " pod="openshift-must-gather-zdms6/perf-node-gather-daemonset-9dn59" Sep 08 02:55:15.296053 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:55:15.296032 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fcd8f525-dc72-4941-9691-bdf31eca685c-lib-modules\") pod \"perf-node-gather-daemonset-9dn59\" (UID: \"fcd8f525-dc72-4941-9691-bdf31eca685c\") " pod="openshift-must-gather-zdms6/perf-node-gather-daemonset-9dn59" Sep 08 02:55:15.296239 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:55:15.296064 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fcd8f525-dc72-4941-9691-bdf31eca685c-podres\") pod \"perf-node-gather-daemonset-9dn59\" (UID: \"fcd8f525-dc72-4941-9691-bdf31eca685c\") " pod="openshift-must-gather-zdms6/perf-node-gather-daemonset-9dn59" Sep 08 02:55:15.305450 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:55:15.305428 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2596m\" (UniqueName: \"kubernetes.io/projected/fcd8f525-dc72-4941-9691-bdf31eca685c-kube-api-access-2596m\") pod \"perf-node-gather-daemonset-9dn59\" (UID: \"fcd8f525-dc72-4941-9691-bdf31eca685c\") " pod="openshift-must-gather-zdms6/perf-node-gather-daemonset-9dn59" Sep 08 02:55:15.393268 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:55:15.393166 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-zdms6/perf-node-gather-daemonset-9dn59" Sep 08 02:55:15.667395 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:55:15.667347 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-zdms6/perf-node-gather-daemonset-9dn59"] Sep 08 02:55:15.668933 ip-10-0-137-161 kubenswrapper[2564]: W0908 02:55:15.668906 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podfcd8f525_dc72_4941_9691_bdf31eca685c.slice/crio-5942c47dd592b6e3b8cbc53216446b09f646924e969140a842039ec7a97a6f9d WatchSource:0}: Error finding container 5942c47dd592b6e3b8cbc53216446b09f646924e969140a842039ec7a97a6f9d: Status 404 returned error can't find the container with id 5942c47dd592b6e3b8cbc53216446b09f646924e969140a842039ec7a97a6f9d Sep 08 02:55:15.982852 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:55:15.982825 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-h62hl_635bc747-a5b6-4c49-aa00-fab4bef8f003/dns/0.log" Sep 08 02:55:16.001607 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:55:16.001585 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-h62hl_635bc747-a5b6-4c49-aa00-fab4bef8f003/kube-rbac-proxy/0.log" Sep 08 02:55:16.105435 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:55:16.105399 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-2667g_50d2c5c2-28aa-4ce1-9ad9-50b2493d3129/dns-node-resolver/0.log" Sep 08 02:55:16.109967 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:55:16.109935 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-zdms6/perf-node-gather-daemonset-9dn59" event={"ID":"fcd8f525-dc72-4941-9691-bdf31eca685c","Type":"ContainerStarted","Data":"07e33468ece6c3d7e664e944c7323229ea7562b77fed3bcbc81b0ce69ae088dc"} Sep 08 02:55:16.110119 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:55:16.109982 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-zdms6/perf-node-gather-daemonset-9dn59" event={"ID":"fcd8f525-dc72-4941-9691-bdf31eca685c","Type":"ContainerStarted","Data":"5942c47dd592b6e3b8cbc53216446b09f646924e969140a842039ec7a97a6f9d"} Sep 08 02:55:16.110119 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:55:16.110012 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-zdms6/perf-node-gather-daemonset-9dn59" Sep 08 02:55:16.126251 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:55:16.126204 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-zdms6/perf-node-gather-daemonset-9dn59" podStartSLOduration=1.12618736 podStartE2EDuration="1.12618736s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 02:55:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 02:55:16.124576431 +0000 UTC m=+880.559550124" watchObservedRunningTime="2026-09-08 02:55:16.12618736 +0000 UTC m=+880.561161046" Sep 08 02:55:16.583586 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:55:16.583556 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-njl2b_ba1b8aaf-174d-4dbb-b7a2-af66170d03b0/node-ca/0.log" Sep 08 02:55:17.580014 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:55:17.579985 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-zkxnl_829fed37-98de-4e8c-be35-d3e13ea6bc3b/serve-healthcheck-canary/0.log" Sep 08 02:55:17.889376 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:55:17.889283 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-76bcd6ccf5-2842s_6b2ac5ed-3b3c-44a6-afe9-25d6c8bfb4da/insights-operator/1.log" Sep 08 02:55:17.889900 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:55:17.889879 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-76bcd6ccf5-2842s_6b2ac5ed-3b3c-44a6-afe9-25d6c8bfb4da/insights-operator/0.log" Sep 08 02:55:17.911407 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:55:17.911383 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9srg4_7481ac35-8d64-4777-8985-384f3cf98fda/kube-rbac-proxy/0.log" Sep 08 02:55:17.931054 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:55:17.931026 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9srg4_7481ac35-8d64-4777-8985-384f3cf98fda/exporter/0.log" Sep 08 02:55:17.950169 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:55:17.950144 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9srg4_7481ac35-8d64-4777-8985-384f3cf98fda/extractor/0.log" Sep 08 02:55:19.674334 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:55:19.674304 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-jobset-operator_jobset-operator-5bc45f897-4cq59_0461e59b-aba8-47ae-bc0d-f01bfa2aff51/jobset-operator/0.log" Sep 08 02:55:22.123881 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:55:22.123846 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-zdms6/perf-node-gather-daemonset-9dn59" Sep 08 02:55:22.604193 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:55:22.604165 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-fdbb8fdff-vjkwf_de8e8fb0-069d-4b2c-a74e-082cea9d33aa/migrator/0.log" Sep 08 02:55:22.622881 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:55:22.622856 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-fdbb8fdff-vjkwf_de8e8fb0-069d-4b2c-a74e-082cea9d33aa/graceful-termination/0.log" Sep 08 02:55:23.959608 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:55:23.959584 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9w5n9_22f90f96-0ae6-459f-bd10-15f4c72e0935/kube-multus-additional-cni-plugins/0.log" Sep 08 02:55:23.979882 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:55:23.979861 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9w5n9_22f90f96-0ae6-459f-bd10-15f4c72e0935/egress-router-binary-copy/0.log" Sep 08 02:55:23.999989 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:55:23.999966 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9w5n9_22f90f96-0ae6-459f-bd10-15f4c72e0935/cni-plugins/0.log" Sep 08 02:55:24.022099 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:55:24.022080 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9w5n9_22f90f96-0ae6-459f-bd10-15f4c72e0935/bond-cni-plugin/0.log" Sep 08 02:55:24.044917 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:55:24.044893 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9w5n9_22f90f96-0ae6-459f-bd10-15f4c72e0935/routeoverride-cni/0.log" Sep 08 02:55:24.066716 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:55:24.066688 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9w5n9_22f90f96-0ae6-459f-bd10-15f4c72e0935/whereabouts-cni-bincopy/0.log" Sep 08 02:55:24.093855 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:55:24.093831 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9w5n9_22f90f96-0ae6-459f-bd10-15f4c72e0935/whereabouts-cni/0.log" Sep 08 02:55:24.322774 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:55:24.322750 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-qj94z_3d2ae2a6-8064-42ae-b0ac-a19fb610c368/kube-multus/0.log" Sep 08 02:55:24.369679 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:55:24.369652 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-ckt96_e0a56211-24ee-40c8-be53-d5e518a5342b/network-metrics-daemon/0.log" Sep 08 02:55:24.387698 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:55:24.387673 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-ckt96_e0a56211-24ee-40c8-be53-d5e518a5342b/kube-rbac-proxy/0.log" Sep 08 02:55:25.563040 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:55:25.562985 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-srkh5_53b75799-2383-445c-9d14-57322844c559/ovn-controller/0.log" Sep 08 02:55:25.582494 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:55:25.582468 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-srkh5_53b75799-2383-445c-9d14-57322844c559/ovn-acl-logging/0.log" Sep 08 02:55:25.604519 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:55:25.604484 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-srkh5_53b75799-2383-445c-9d14-57322844c559/kube-rbac-proxy-node/0.log" Sep 08 02:55:25.625674 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:55:25.625647 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-srkh5_53b75799-2383-445c-9d14-57322844c559/kube-rbac-proxy-ovn-metrics/0.log" Sep 08 02:55:25.643641 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:55:25.643616 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-srkh5_53b75799-2383-445c-9d14-57322844c559/northd/0.log" Sep 08 02:55:25.664865 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:55:25.664837 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-srkh5_53b75799-2383-445c-9d14-57322844c559/nbdb/0.log" Sep 08 02:55:25.684839 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:55:25.684812 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-srkh5_53b75799-2383-445c-9d14-57322844c559/sbdb/0.log" Sep 08 02:55:25.721210 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:55:25.721183 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-srkh5_53b75799-2383-445c-9d14-57322844c559/ovnkube-controller/0.log" Sep 08 02:55:26.712423 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:55:26.712392 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-s7mcq_f47c576f-2537-4625-be1f-fb82cbb3694e/network-check-target-container/0.log" Sep 08 02:55:27.604940 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:55:27.604911 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-cncrx_29ec0f1b-c020-42c6-a505-15aad11faa83/iptables-alerter/0.log" Sep 08 02:55:28.189205 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:55:28.189174 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-8tddq_846f41ef-3791-446b-b3e8-e05c195b7085/tuned/0.log" Sep 08 02:55:30.989511 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:55:30.989483 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-service-ca_service-ca-75d99c484-nls5p_7a48575c-1a63-4521-80db-3e982c93a5b6/service-ca-controller/0.log" Sep 08 02:55:31.387043 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:55:31.386970 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-8fvvh_e093be54-1d5e-4af7-9417-37cfa9965bde/csi-driver/0.log" Sep 08 02:55:31.406017 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:55:31.405990 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-8fvvh_e093be54-1d5e-4af7-9417-37cfa9965bde/csi-node-driver-registrar/0.log" Sep 08 02:55:31.425430 ip-10-0-137-161 kubenswrapper[2564]: I0908 02:55:31.425403 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-8fvvh_e093be54-1d5e-4af7-9417-37cfa9965bde/csi-liveness-probe/0.log"