Sep 18 08:07:06.280175 ip-10-0-138-42 systemd[1]: Starting Kubernetes Kubelet... Sep 18 08:07:09.768474 ip-10-0-138-42 kubenswrapper[2585]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 18 08:07:09.768474 ip-10-0-138-42 kubenswrapper[2585]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 18 08:07:09.768474 ip-10-0-138-42 kubenswrapper[2585]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 18 08:07:09.768474 ip-10-0-138-42 kubenswrapper[2585]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 18 08:07:09.768474 ip-10-0-138-42 kubenswrapper[2585]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 18 08:07:09.769185 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.768551 2585 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 18 08:07:09.772883 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.772866 2585 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 18 08:07:09.772883 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.772883 2585 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 18 08:07:09.772950 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.772886 2585 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 18 08:07:09.772950 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.772891 2585 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 18 08:07:09.772950 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.772896 2585 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 18 08:07:09.772950 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.772900 2585 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 18 08:07:09.772950 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.772903 2585 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 18 08:07:09.772950 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.772906 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 18 08:07:09.772950 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.772909 2585 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 18 08:07:09.772950 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.772912 2585 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 18 08:07:09.772950 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.772914 2585 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 18 08:07:09.772950 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.772917 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 18 08:07:09.772950 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.772920 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 18 08:07:09.772950 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.772922 2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 18 08:07:09.772950 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.772925 2585 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 18 08:07:09.772950 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.772934 2585 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 18 08:07:09.772950 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.772936 2585 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 18 08:07:09.772950 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.772939 2585 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 18 08:07:09.772950 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.772941 2585 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 18 08:07:09.772950 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.772944 2585 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 18 08:07:09.772950 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.772947 2585 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 18 08:07:09.773405 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.772949 2585 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 18 08:07:09.773405 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.772952 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 18 08:07:09.773405 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.772955 2585 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 18 08:07:09.773405 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.772958 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 18 08:07:09.773405 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.772961 2585 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 18 08:07:09.773405 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.772964 2585 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 18 08:07:09.773405 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.772966 2585 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 18 08:07:09.773405 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.772969 2585 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 18 08:07:09.773405 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.772971 2585 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 18 08:07:09.773405 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.772973 2585 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 18 08:07:09.773405 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.772976 2585 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 18 08:07:09.773405 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.772978 2585 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 18 08:07:09.773405 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.772981 2585 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 18 08:07:09.773405 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.772984 2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 18 08:07:09.773405 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.772986 2585 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 18 08:07:09.773405 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.772988 2585 feature_gate.go:328] unrecognized feature gate: Example Sep 18 08:07:09.773405 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.772991 2585 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 18 08:07:09.773405 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.772994 2585 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 18 08:07:09.773405 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.772997 2585 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 18 08:07:09.773405 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.772999 2585 feature_gate.go:328] unrecognized feature gate: Example2 Sep 18 08:07:09.773949 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.773001 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 18 08:07:09.773949 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.773004 2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 18 08:07:09.773949 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.773006 2585 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 18 08:07:09.773949 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.773009 2585 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 18 08:07:09.773949 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.773012 2585 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 18 08:07:09.773949 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.773015 2585 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 18 08:07:09.773949 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.773017 2585 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 18 08:07:09.773949 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.773019 2585 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 18 08:07:09.773949 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.773022 2585 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 18 08:07:09.773949 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.773024 2585 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 18 08:07:09.773949 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.773026 2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 18 08:07:09.773949 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.773029 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 18 08:07:09.773949 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.773031 2585 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 18 08:07:09.773949 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.773034 2585 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 18 08:07:09.773949 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.773037 2585 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 18 08:07:09.773949 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.773040 2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 18 08:07:09.773949 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.773042 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 18 08:07:09.773949 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.773045 2585 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 18 08:07:09.773949 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.773047 2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 18 08:07:09.773949 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.773050 2585 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 18 08:07:09.774437 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.773052 2585 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 18 08:07:09.774437 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.773055 2585 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 18 08:07:09.774437 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.773057 2585 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 18 08:07:09.774437 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.773060 2585 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 18 08:07:09.774437 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.773062 2585 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 18 08:07:09.774437 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.773064 2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 18 08:07:09.774437 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.773067 2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 18 08:07:09.774437 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.773069 2585 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 18 08:07:09.774437 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.773072 2585 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 18 08:07:09.774437 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.773074 2585 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 18 08:07:09.774437 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.773082 2585 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 18 08:07:09.774437 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.773085 2585 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 18 08:07:09.774437 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.773087 2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 18 08:07:09.774437 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.773090 2585 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 18 08:07:09.774437 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.773094 2585 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 18 08:07:09.774437 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.773097 2585 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 18 08:07:09.774437 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.773100 2585 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 18 08:07:09.774437 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.773102 2585 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 18 08:07:09.774437 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.773105 2585 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 18 08:07:09.774943 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.773107 2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 18 08:07:09.774943 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.773110 2585 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 18 08:07:09.774943 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.773113 2585 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 18 08:07:09.774943 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.773116 2585 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 18 08:07:09.774943 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.773119 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 18 08:07:09.774943 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.773121 2585 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 18 08:07:09.774943 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.773125 2585 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 18 08:07:09.774943 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.773129 2585 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 18 08:07:09.774943 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.773133 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 18 08:07:09.774943 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.773136 2585 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 18 08:07:09.774943 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.773139 2585 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 18 08:07:09.774943 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.773142 2585 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 18 08:07:09.774943 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.773145 2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 18 08:07:09.774943 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.773148 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 18 08:07:09.774943 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.773151 2585 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 18 08:07:09.774943 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.773153 2585 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 18 08:07:09.774943 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.773156 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 18 08:07:09.774943 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.773158 2585 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 18 08:07:09.774943 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.773161 2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 18 08:07:09.774943 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.773882 2585 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 18 08:07:09.775439 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.773889 2585 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 18 08:07:09.775439 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.773892 2585 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 18 08:07:09.775439 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.773895 2585 feature_gate.go:328] unrecognized feature gate: Example2 Sep 18 08:07:09.775439 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.773897 2585 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 18 08:07:09.775439 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.773901 2585 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 18 08:07:09.775439 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.773906 2585 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 18 08:07:09.775439 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.773910 2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 18 08:07:09.775439 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.773913 2585 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 18 08:07:09.775439 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.773917 2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 18 08:07:09.775439 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.773920 2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 18 08:07:09.775439 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.773922 2585 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 18 08:07:09.775439 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.773926 2585 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 18 08:07:09.775439 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.773930 2585 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 18 08:07:09.775439 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.773933 2585 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 18 08:07:09.775439 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.773937 2585 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 18 08:07:09.775439 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.773940 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 18 08:07:09.775439 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.773944 2585 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 18 08:07:09.775439 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.773947 2585 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 18 08:07:09.775439 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.773952 2585 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 18 08:07:09.775944 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.773955 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 18 08:07:09.775944 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.773959 2585 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 18 08:07:09.775944 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.773961 2585 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 18 08:07:09.775944 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.773964 2585 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 18 08:07:09.775944 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.773967 2585 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 18 08:07:09.775944 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.773969 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 18 08:07:09.775944 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.773972 2585 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 18 08:07:09.775944 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.773975 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 18 08:07:09.775944 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.773977 2585 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 18 08:07:09.775944 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.773980 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 18 08:07:09.775944 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.773982 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 18 08:07:09.775944 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.773985 2585 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 18 08:07:09.775944 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.773988 2585 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 18 08:07:09.775944 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.773990 2585 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 18 08:07:09.775944 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.773994 2585 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 18 08:07:09.775944 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.773997 2585 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 18 08:07:09.775944 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.774000 2585 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 18 08:07:09.775944 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.774003 2585 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 18 08:07:09.775944 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.774006 2585 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 18 08:07:09.776415 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.774009 2585 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 18 08:07:09.776415 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.774012 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 18 08:07:09.776415 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.774015 2585 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 18 08:07:09.776415 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.774018 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 18 08:07:09.776415 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.774021 2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 18 08:07:09.776415 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.774023 2585 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 18 08:07:09.776415 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.774026 2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 18 08:07:09.776415 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.774028 2585 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 18 08:07:09.776415 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.774031 2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 18 08:07:09.776415 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.774033 2585 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 18 08:07:09.776415 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.774036 2585 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 18 08:07:09.776415 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.774039 2585 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 18 08:07:09.776415 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.774043 2585 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 18 08:07:09.776415 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.774046 2585 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 18 08:07:09.776415 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.774049 2585 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 18 08:07:09.776415 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.774051 2585 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 18 08:07:09.776415 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.774054 2585 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 18 08:07:09.776415 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.774056 2585 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 18 08:07:09.776415 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.774059 2585 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 18 08:07:09.776415 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.774061 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 18 08:07:09.776924 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.774064 2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 18 08:07:09.776924 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.774067 2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 18 08:07:09.776924 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.774069 2585 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 18 08:07:09.776924 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.774072 2585 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 18 08:07:09.776924 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.774074 2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 18 08:07:09.776924 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.774077 2585 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 18 08:07:09.776924 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.774079 2585 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 18 08:07:09.776924 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.774083 2585 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 18 08:07:09.776924 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.774085 2585 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 18 08:07:09.776924 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.774088 2585 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 18 08:07:09.776924 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.774090 2585 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 18 08:07:09.776924 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.774093 2585 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 18 08:07:09.776924 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.774099 2585 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 18 08:07:09.776924 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.774102 2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 18 08:07:09.776924 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.774105 2585 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 18 08:07:09.776924 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.774108 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 18 08:07:09.776924 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.774110 2585 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 18 08:07:09.776924 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.774113 2585 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 18 08:07:09.776924 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.774116 2585 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 18 08:07:09.776924 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.774118 2585 feature_gate.go:328] unrecognized feature gate: Example Sep 18 08:07:09.777398 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.774121 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 18 08:07:09.777398 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.774123 2585 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 18 08:07:09.777398 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.774126 2585 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 18 08:07:09.777398 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.774129 2585 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 18 08:07:09.777398 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.774132 2585 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 18 08:07:09.777398 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.774135 2585 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 18 08:07:09.777398 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.774137 2585 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 18 08:07:09.777398 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.774140 2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 18 08:07:09.777398 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.774142 2585 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 18 08:07:09.777398 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.774146 2585 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 18 08:07:09.777398 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.774148 2585 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 18 08:07:09.777398 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.774151 2585 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 18 08:07:09.777398 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.774153 2585 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 18 08:07:09.777398 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.774155 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 18 08:07:09.777398 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.774158 2585 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 18 08:07:09.777398 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.774160 2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 18 08:07:09.777398 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.774163 2585 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 18 08:07:09.777398 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.774165 2585 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 18 08:07:09.777398 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.774168 2585 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 18 08:07:09.777398 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.774170 2585 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 18 08:07:09.777919 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.774555 2585 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 18 08:07:09.777919 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.774559 2585 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 18 08:07:09.777919 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.774562 2585 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 18 08:07:09.777919 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.774565 2585 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 18 08:07:09.777919 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.774568 2585 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 18 08:07:09.777919 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.774571 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 18 08:07:09.777919 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.774573 2585 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 18 08:07:09.777919 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.774576 2585 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 18 08:07:09.777919 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.774579 2585 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 18 08:07:09.777919 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.774581 2585 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 18 08:07:09.777919 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.774584 2585 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 18 08:07:09.777919 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.774586 2585 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 18 08:07:09.777919 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.774589 2585 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 18 08:07:09.777919 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.774591 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 18 08:07:09.777919 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.774594 2585 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 18 08:07:09.777919 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.774597 2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 18 08:07:09.777919 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.774600 2585 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 18 08:07:09.777919 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.774603 2585 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 18 08:07:09.777919 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.774605 2585 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 18 08:07:09.777919 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.774608 2585 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 18 08:07:09.778447 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.774612 2585 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 18 08:07:09.778447 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.774616 2585 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 18 08:07:09.778447 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.774619 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 18 08:07:09.778447 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.774621 2585 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 18 08:07:09.778447 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.774624 2585 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 18 08:07:09.778447 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.774627 2585 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 18 08:07:09.778447 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.774629 2585 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 18 08:07:09.778447 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.774632 2585 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 18 08:07:09.778447 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.774634 2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 18 08:07:09.778447 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.774637 2585 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 18 08:07:09.778447 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.774639 2585 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 18 08:07:09.778447 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.774642 2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 18 08:07:09.778447 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.774644 2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 18 08:07:09.778447 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.774647 2585 feature_gate.go:328] unrecognized feature gate: Example2 Sep 18 08:07:09.778447 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.774650 2585 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 18 08:07:09.778447 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.774652 2585 feature_gate.go:328] unrecognized feature gate: Example Sep 18 08:07:09.778447 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.774654 2585 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 18 08:07:09.778447 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.774657 2585 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 18 08:07:09.778447 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.774660 2585 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 18 08:07:09.778945 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.774662 2585 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 18 08:07:09.778945 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.774664 2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 18 08:07:09.778945 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.774667 2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 18 08:07:09.778945 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.774669 2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 18 08:07:09.778945 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.774672 2585 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 18 08:07:09.778945 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.774675 2585 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 18 08:07:09.778945 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.774677 2585 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 18 08:07:09.778945 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.774680 2585 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 18 08:07:09.778945 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.774682 2585 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 18 08:07:09.778945 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.774685 2585 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 18 08:07:09.778945 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.774688 2585 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 18 08:07:09.778945 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.774692 2585 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 18 08:07:09.778945 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.774695 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 18 08:07:09.778945 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.774698 2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 18 08:07:09.778945 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.774701 2585 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 18 08:07:09.778945 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.774703 2585 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 18 08:07:09.778945 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.774706 2585 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 18 08:07:09.778945 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.774708 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 18 08:07:09.778945 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.774711 2585 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 18 08:07:09.779453 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.774713 2585 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 18 08:07:09.779453 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.774716 2585 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 18 08:07:09.779453 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.774718 2585 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 18 08:07:09.779453 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.774720 2585 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 18 08:07:09.779453 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.774723 2585 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 18 08:07:09.779453 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.774725 2585 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 18 08:07:09.779453 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.774728 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 18 08:07:09.779453 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.774730 2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 18 08:07:09.779453 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.774733 2585 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 18 08:07:09.779453 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.774735 2585 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 18 08:07:09.779453 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.774737 2585 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 18 08:07:09.779453 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.774740 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 18 08:07:09.779453 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.774742 2585 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 18 08:07:09.779453 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.774745 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 18 08:07:09.779453 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.774747 2585 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 18 08:07:09.779453 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.774750 2585 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 18 08:07:09.779453 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.774752 2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 18 08:07:09.779453 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.774754 2585 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 18 08:07:09.779453 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.774757 2585 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 18 08:07:09.779453 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.774759 2585 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 18 08:07:09.779947 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.774763 2585 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 18 08:07:09.779947 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.774768 2585 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 18 08:07:09.779947 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.774771 2585 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 18 08:07:09.779947 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.774775 2585 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 18 08:07:09.779947 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.774777 2585 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 18 08:07:09.779947 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.774780 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 18 08:07:09.779947 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.774783 2585 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 18 08:07:09.779947 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.774785 2585 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 18 08:07:09.779947 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.774787 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 18 08:07:09.779947 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.774790 2585 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 18 08:07:09.779947 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.774793 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 18 08:07:09.779947 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.774795 2585 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 18 08:07:09.779947 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.774798 2585 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 18 08:07:09.779947 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.774800 2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 18 08:07:09.779947 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.774803 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 18 08:07:09.779947 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.774805 2585 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 18 08:07:09.779947 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.774807 2585 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 18 08:07:09.779947 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.774810 2585 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 18 08:07:09.779947 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.774812 2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 18 08:07:09.780403 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.774815 2585 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 18 08:07:09.780403 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.774817 2585 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 18 08:07:09.780403 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.774944 2585 flags.go:64] FLAG: --address="0.0.0.0" Sep 18 08:07:09.780403 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.774978 2585 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 18 08:07:09.780403 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.774984 2585 flags.go:64] FLAG: --anonymous-auth="true" Sep 18 08:07:09.780403 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.774989 2585 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 18 08:07:09.780403 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.774994 2585 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 18 08:07:09.780403 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.774999 2585 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 18 08:07:09.780403 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.775004 2585 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 18 08:07:09.780403 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.775008 2585 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 18 08:07:09.780403 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.775011 2585 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 18 08:07:09.780403 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.775014 2585 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 18 08:07:09.780403 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.775018 2585 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 18 08:07:09.780403 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.775021 2585 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 18 08:07:09.780403 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.775024 2585 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 18 08:07:09.780403 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.775027 2585 flags.go:64] FLAG: --cgroup-root="" Sep 18 08:07:09.780403 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.775030 2585 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 18 08:07:09.780403 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.775033 2585 flags.go:64] FLAG: --client-ca-file="" Sep 18 08:07:09.780403 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.775036 2585 flags.go:64] FLAG: --cloud-provider="external" Sep 18 08:07:09.780403 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.775038 2585 flags.go:64] FLAG: --cluster-dns="[]" Sep 18 08:07:09.780403 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.775043 2585 flags.go:64] FLAG: --cluster-domain="" Sep 18 08:07:09.780403 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.775046 2585 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 18 08:07:09.780403 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.775049 2585 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 18 08:07:09.780996 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.775052 2585 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 18 08:07:09.780996 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.775055 2585 flags.go:64] FLAG: --container-log-max-files="5" Sep 18 08:07:09.780996 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.775059 2585 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 18 08:07:09.780996 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.775062 2585 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 18 08:07:09.780996 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.775065 2585 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 18 08:07:09.780996 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.775070 2585 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 18 08:07:09.780996 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.775073 2585 flags.go:64] FLAG: --contention-profiling="false" Sep 18 08:07:09.780996 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.775076 2585 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 18 08:07:09.780996 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.775079 2585 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 18 08:07:09.780996 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.775082 2585 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 18 08:07:09.780996 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.775085 2585 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 18 08:07:09.780996 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.775089 2585 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 18 08:07:09.780996 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.775092 2585 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 18 08:07:09.780996 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.775095 2585 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 18 08:07:09.780996 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.775097 2585 flags.go:64] FLAG: --enable-load-reader="false" Sep 18 08:07:09.780996 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.775101 2585 flags.go:64] FLAG: --enable-server="true" Sep 18 08:07:09.780996 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.775105 2585 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 18 08:07:09.780996 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.775109 2585 flags.go:64] FLAG: --event-burst="100" Sep 18 08:07:09.780996 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.775112 2585 flags.go:64] FLAG: --event-qps="50" Sep 18 08:07:09.780996 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.775115 2585 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 18 08:07:09.780996 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.775118 2585 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 18 08:07:09.780996 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.775121 2585 flags.go:64] FLAG: --eviction-hard="" Sep 18 08:07:09.780996 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.775124 2585 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 18 08:07:09.780996 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.775127 2585 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 18 08:07:09.781564 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.775130 2585 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 18 08:07:09.781564 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.775133 2585 flags.go:64] FLAG: --eviction-soft="" Sep 18 08:07:09.781564 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.775136 2585 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 18 08:07:09.781564 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.775139 2585 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 18 08:07:09.781564 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.775142 2585 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 18 08:07:09.781564 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.775145 2585 flags.go:64] FLAG: --experimental-mounter-path="" Sep 18 08:07:09.781564 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.775147 2585 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 18 08:07:09.781564 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.775150 2585 flags.go:64] FLAG: --fail-swap-on="true" Sep 18 08:07:09.781564 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.775153 2585 flags.go:64] FLAG: --feature-gates="" Sep 18 08:07:09.781564 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.775157 2585 flags.go:64] FLAG: --file-check-frequency="20s" Sep 18 08:07:09.781564 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.775160 2585 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 18 08:07:09.781564 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.775163 2585 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 18 08:07:09.781564 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.775166 2585 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 18 08:07:09.781564 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.775170 2585 flags.go:64] FLAG: --healthz-port="10248" Sep 18 08:07:09.781564 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.775173 2585 flags.go:64] FLAG: --help="false" Sep 18 08:07:09.781564 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.775176 2585 flags.go:64] FLAG: --hostname-override="ip-10-0-138-42.ec2.internal" Sep 18 08:07:09.781564 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.775179 2585 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 18 08:07:09.781564 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.775182 2585 flags.go:64] FLAG: --http-check-frequency="20s" Sep 18 08:07:09.781564 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.775185 2585 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 18 08:07:09.781564 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.775188 2585 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 18 08:07:09.781564 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.775192 2585 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 18 08:07:09.781564 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.775194 2585 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 18 08:07:09.781564 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.775197 2585 flags.go:64] FLAG: --image-service-endpoint="" Sep 18 08:07:09.782183 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.775200 2585 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 18 08:07:09.782183 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.775204 2585 flags.go:64] FLAG: --kube-api-burst="100" Sep 18 08:07:09.782183 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.775208 2585 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 18 08:07:09.782183 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.775211 2585 flags.go:64] FLAG: --kube-api-qps="50" Sep 18 08:07:09.782183 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.775214 2585 flags.go:64] FLAG: --kube-reserved="" Sep 18 08:07:09.782183 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.775217 2585 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 18 08:07:09.782183 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.775220 2585 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 18 08:07:09.782183 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.775223 2585 flags.go:64] FLAG: --kubelet-cgroups="" Sep 18 08:07:09.782183 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.775225 2585 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 18 08:07:09.782183 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.775228 2585 flags.go:64] FLAG: --lock-file="" Sep 18 08:07:09.782183 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.775231 2585 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 18 08:07:09.782183 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.775234 2585 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 18 08:07:09.782183 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.775236 2585 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 18 08:07:09.782183 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.775242 2585 flags.go:64] FLAG: --log-json-split-stream="false" Sep 18 08:07:09.782183 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.775245 2585 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 18 08:07:09.782183 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.775247 2585 flags.go:64] FLAG: --log-text-split-stream="false" Sep 18 08:07:09.782183 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.775250 2585 flags.go:64] FLAG: --logging-format="text" Sep 18 08:07:09.782183 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.775253 2585 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 18 08:07:09.782183 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.775256 2585 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 18 08:07:09.782183 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.775259 2585 flags.go:64] FLAG: --manifest-url="" Sep 18 08:07:09.782183 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.775262 2585 flags.go:64] FLAG: --manifest-url-header="" Sep 18 08:07:09.782183 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.775265 2585 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 18 08:07:09.782183 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.775269 2585 flags.go:64] FLAG: --max-open-files="1000000" Sep 18 08:07:09.782183 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.775274 2585 flags.go:64] FLAG: --max-pods="110" Sep 18 08:07:09.782183 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.775277 2585 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 18 08:07:09.782836 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.775280 2585 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 18 08:07:09.782836 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.775283 2585 flags.go:64] FLAG: --memory-manager-policy="None" Sep 18 08:07:09.782836 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.775286 2585 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 18 08:07:09.782836 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.775289 2585 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 18 08:07:09.782836 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.775292 2585 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 18 08:07:09.782836 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.775295 2585 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 18 08:07:09.782836 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.775302 2585 flags.go:64] FLAG: --node-status-max-images="50" Sep 18 08:07:09.782836 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.775305 2585 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 18 08:07:09.782836 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.775309 2585 flags.go:64] FLAG: --oom-score-adj="-999" Sep 18 08:07:09.782836 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.775312 2585 flags.go:64] FLAG: --pod-cidr="" Sep 18 08:07:09.782836 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.775315 2585 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a6abe77af61c5f2e3985a83e7d43538aefc38b1b0444127da14ee0e8cf8f76fc" Sep 18 08:07:09.782836 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.775321 2585 flags.go:64] FLAG: --pod-manifest-path="" Sep 18 08:07:09.782836 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.775324 2585 flags.go:64] FLAG: --pod-max-pids="-1" Sep 18 08:07:09.782836 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.775327 2585 flags.go:64] FLAG: --pods-per-core="0" Sep 18 08:07:09.782836 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.775330 2585 flags.go:64] FLAG: --port="10250" Sep 18 08:07:09.782836 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.775332 2585 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 18 08:07:09.782836 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.775335 2585 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0ab2d54900b5d3958" Sep 18 08:07:09.782836 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.775338 2585 flags.go:64] FLAG: --qos-reserved="" Sep 18 08:07:09.782836 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.775341 2585 flags.go:64] FLAG: --read-only-port="10255" Sep 18 08:07:09.782836 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.775344 2585 flags.go:64] FLAG: --register-node="true" Sep 18 08:07:09.782836 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.775347 2585 flags.go:64] FLAG: --register-with-taints="" Sep 18 08:07:09.782836 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.775350 2585 flags.go:64] FLAG: --registry-burst="10" Sep 18 08:07:09.782836 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.775353 2585 flags.go:64] FLAG: --registry-qps="5" Sep 18 08:07:09.782836 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.775356 2585 flags.go:64] FLAG: --reserved-cpus="" Sep 18 08:07:09.783492 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.775359 2585 flags.go:64] FLAG: --reserved-memory="" Sep 18 08:07:09.783492 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.775362 2585 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 18 08:07:09.783492 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.775365 2585 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 18 08:07:09.783492 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.775369 2585 flags.go:64] FLAG: --rotate-certificates="false" Sep 18 08:07:09.783492 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.775372 2585 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 18 08:07:09.783492 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.775376 2585 flags.go:64] FLAG: --runonce="false" Sep 18 08:07:09.783492 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.775379 2585 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 18 08:07:09.783492 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.775382 2585 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 18 08:07:09.783492 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.775385 2585 flags.go:64] FLAG: --seccomp-default="false" Sep 18 08:07:09.783492 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.775388 2585 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 18 08:07:09.783492 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.775390 2585 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 18 08:07:09.783492 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.775393 2585 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 18 08:07:09.783492 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.775396 2585 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 18 08:07:09.783492 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.775399 2585 flags.go:64] FLAG: --storage-driver-password="root" Sep 18 08:07:09.783492 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.775402 2585 flags.go:64] FLAG: --storage-driver-secure="false" Sep 18 08:07:09.783492 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.775405 2585 flags.go:64] FLAG: --storage-driver-table="stats" Sep 18 08:07:09.783492 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.775408 2585 flags.go:64] FLAG: --storage-driver-user="root" Sep 18 08:07:09.783492 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.775411 2585 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 18 08:07:09.783492 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.775415 2585 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 18 08:07:09.783492 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.775418 2585 flags.go:64] FLAG: --system-cgroups="" Sep 18 08:07:09.783492 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.775421 2585 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 18 08:07:09.783492 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.775427 2585 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 18 08:07:09.783492 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.775430 2585 flags.go:64] FLAG: --tls-cert-file="" Sep 18 08:07:09.783492 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.775433 2585 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 18 08:07:09.783492 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.775437 2585 flags.go:64] FLAG: --tls-min-version="" Sep 18 08:07:09.784129 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.775440 2585 flags.go:64] FLAG: --tls-private-key-file="" Sep 18 08:07:09.784129 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.775443 2585 flags.go:64] FLAG: --topology-manager-policy="none" Sep 18 08:07:09.784129 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.775446 2585 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 18 08:07:09.784129 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.775448 2585 flags.go:64] FLAG: --topology-manager-scope="container" Sep 18 08:07:09.784129 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.775451 2585 flags.go:64] FLAG: --v="2" Sep 18 08:07:09.784129 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.775455 2585 flags.go:64] FLAG: --version="false" Sep 18 08:07:09.784129 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.775459 2585 flags.go:64] FLAG: --vmodule="" Sep 18 08:07:09.784129 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.775463 2585 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 18 08:07:09.784129 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.775466 2585 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 18 08:07:09.784129 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.775579 2585 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 18 08:07:09.784129 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.775584 2585 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 18 08:07:09.784129 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.775587 2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 18 08:07:09.784129 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.775591 2585 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 18 08:07:09.784129 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.775594 2585 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 18 08:07:09.784129 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.775597 2585 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 18 08:07:09.784129 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.775600 2585 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 18 08:07:09.784129 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.775603 2585 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 18 08:07:09.784129 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.775606 2585 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 18 08:07:09.784129 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.775608 2585 feature_gate.go:328] unrecognized feature gate: Example2 Sep 18 08:07:09.784129 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.775611 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 18 08:07:09.784129 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.775614 2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 18 08:07:09.784651 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.775617 2585 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 18 08:07:09.784651 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.775620 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 18 08:07:09.784651 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.775623 2585 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 18 08:07:09.784651 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.775627 2585 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 18 08:07:09.784651 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.775629 2585 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 18 08:07:09.784651 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.775632 2585 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 18 08:07:09.784651 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.775635 2585 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 18 08:07:09.784651 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.775637 2585 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 18 08:07:09.784651 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.775640 2585 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 18 08:07:09.784651 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.775643 2585 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 18 08:07:09.784651 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.775646 2585 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 18 08:07:09.784651 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.775648 2585 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 18 08:07:09.784651 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.775651 2585 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 18 08:07:09.784651 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.775653 2585 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 18 08:07:09.784651 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.775656 2585 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 18 08:07:09.784651 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.775658 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 18 08:07:09.784651 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.775661 2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 18 08:07:09.784651 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.775663 2585 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 18 08:07:09.784651 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.775666 2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 18 08:07:09.784651 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.775668 2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 18 08:07:09.785152 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.775671 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 18 08:07:09.785152 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.775674 2585 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 18 08:07:09.785152 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.775677 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 18 08:07:09.785152 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.775681 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 18 08:07:09.785152 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.775683 2585 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 18 08:07:09.785152 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.775686 2585 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 18 08:07:09.785152 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.775689 2585 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 18 08:07:09.785152 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.775691 2585 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 18 08:07:09.785152 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.775694 2585 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 18 08:07:09.785152 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.775696 2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 18 08:07:09.785152 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.775699 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 18 08:07:09.785152 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.775701 2585 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 18 08:07:09.785152 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.775704 2585 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 18 08:07:09.785152 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.775706 2585 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 18 08:07:09.785152 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.775709 2585 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 18 08:07:09.785152 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.775713 2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 18 08:07:09.785152 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.775715 2585 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 18 08:07:09.785152 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.775718 2585 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 18 08:07:09.785152 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.775721 2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 18 08:07:09.785152 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.775724 2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 18 08:07:09.785647 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.775727 2585 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 18 08:07:09.785647 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.775729 2585 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 18 08:07:09.785647 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.775732 2585 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 18 08:07:09.785647 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.775736 2585 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 18 08:07:09.785647 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.775739 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 18 08:07:09.785647 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.775742 2585 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 18 08:07:09.785647 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.775745 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 18 08:07:09.785647 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.775748 2585 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 18 08:07:09.785647 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.775750 2585 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 18 08:07:09.785647 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.775753 2585 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 18 08:07:09.785647 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.775756 2585 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 18 08:07:09.785647 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.775759 2585 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 18 08:07:09.785647 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.775771 2585 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 18 08:07:09.785647 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.775775 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 18 08:07:09.785647 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.775778 2585 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 18 08:07:09.785647 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.775782 2585 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 18 08:07:09.785647 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.775785 2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 18 08:07:09.785647 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.775787 2585 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 18 08:07:09.785647 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.775790 2585 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 18 08:07:09.786350 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.775793 2585 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 18 08:07:09.786350 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.775796 2585 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 18 08:07:09.786350 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.775798 2585 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 18 08:07:09.786350 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.775801 2585 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 18 08:07:09.786350 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.775804 2585 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 18 08:07:09.786350 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.775806 2585 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 18 08:07:09.786350 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.775808 2585 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 18 08:07:09.786350 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.775811 2585 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 18 08:07:09.786350 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.775815 2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 18 08:07:09.786350 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.775817 2585 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 18 08:07:09.786350 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.775820 2585 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 18 08:07:09.786350 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.775822 2585 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 18 08:07:09.786350 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.775825 2585 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 18 08:07:09.786350 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.775828 2585 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 18 08:07:09.786350 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.775831 2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 18 08:07:09.786350 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.775833 2585 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 18 08:07:09.786350 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.775836 2585 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 18 08:07:09.786350 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.775839 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 18 08:07:09.786350 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.775857 2585 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 18 08:07:09.786350 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.775860 2585 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 18 08:07:09.787140 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.775862 2585 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 18 08:07:09.787140 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.775865 2585 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 18 08:07:09.787140 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.775867 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 18 08:07:09.787140 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.775870 2585 feature_gate.go:328] unrecognized feature gate: Example Sep 18 08:07:09.787140 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.775880 2585 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 18 08:07:09.787140 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.775883 2585 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 18 08:07:09.787140 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.775886 2585 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 18 08:07:09.787140 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.775889 2585 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 18 08:07:09.787140 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.776535 2585 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 18 08:07:09.787140 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.784750 2585 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 18 08:07:09.787140 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.784769 2585 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 18 08:07:09.787140 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.784790 2585 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 18 08:07:09.787140 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.784799 2585 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 18 08:07:09.787140 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.784911 2585 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 18 08:07:09.787140 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.784917 2585 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 18 08:07:09.787600 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.784920 2585 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 18 08:07:09.787600 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.784923 2585 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 18 08:07:09.787600 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.784926 2585 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 18 08:07:09.787600 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.784928 2585 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 18 08:07:09.787600 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.784931 2585 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 18 08:07:09.787600 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.784934 2585 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 18 08:07:09.787600 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.784936 2585 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 18 08:07:09.787600 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.784940 2585 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 18 08:07:09.787600 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.784942 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 18 08:07:09.787600 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.784945 2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 18 08:07:09.787600 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.784947 2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 18 08:07:09.787600 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.784950 2585 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 18 08:07:09.787600 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.784952 2585 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 18 08:07:09.787600 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.784955 2585 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 18 08:07:09.787600 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.784957 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 18 08:07:09.787600 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.784960 2585 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 18 08:07:09.787600 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.784963 2585 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 18 08:07:09.787600 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.784966 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 18 08:07:09.787600 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.784968 2585 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 18 08:07:09.787600 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.784971 2585 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 18 08:07:09.788137 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.784973 2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 18 08:07:09.788137 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.784976 2585 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 18 08:07:09.788137 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.784978 2585 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 18 08:07:09.788137 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.784981 2585 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 18 08:07:09.788137 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.784984 2585 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 18 08:07:09.788137 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.784986 2585 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 18 08:07:09.788137 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.784989 2585 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 18 08:07:09.788137 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.784999 2585 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 18 08:07:09.788137 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785004 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 18 08:07:09.788137 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785007 2585 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 18 08:07:09.788137 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785010 2585 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 18 08:07:09.788137 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785013 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 18 08:07:09.788137 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785016 2585 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 18 08:07:09.788137 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785019 2585 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 18 08:07:09.788137 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785022 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 18 08:07:09.788137 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785024 2585 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 18 08:07:09.788137 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785028 2585 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 18 08:07:09.788137 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785031 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 18 08:07:09.788137 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785033 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 18 08:07:09.788585 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785036 2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 18 08:07:09.788585 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785038 2585 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 18 08:07:09.788585 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785041 2585 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 18 08:07:09.788585 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785043 2585 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 18 08:07:09.788585 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785045 2585 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 18 08:07:09.788585 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785048 2585 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 18 08:07:09.788585 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785050 2585 feature_gate.go:328] unrecognized feature gate: Example2 Sep 18 08:07:09.788585 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785053 2585 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 18 08:07:09.788585 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785056 2585 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 18 08:07:09.788585 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785059 2585 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 18 08:07:09.788585 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785063 2585 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 18 08:07:09.788585 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785065 2585 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 18 08:07:09.788585 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785069 2585 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 18 08:07:09.788585 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785072 2585 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 18 08:07:09.788585 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785075 2585 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 18 08:07:09.788585 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785077 2585 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 18 08:07:09.788585 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785080 2585 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 18 08:07:09.788585 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785083 2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 18 08:07:09.788585 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785085 2585 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 18 08:07:09.789220 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785088 2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 18 08:07:09.789220 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785091 2585 feature_gate.go:328] unrecognized feature gate: Example Sep 18 08:07:09.789220 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785102 2585 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 18 08:07:09.789220 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785105 2585 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 18 08:07:09.789220 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785108 2585 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 18 08:07:09.789220 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785110 2585 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 18 08:07:09.789220 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785113 2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 18 08:07:09.789220 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785115 2585 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 18 08:07:09.789220 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785118 2585 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 18 08:07:09.789220 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785121 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 18 08:07:09.789220 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785123 2585 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 18 08:07:09.789220 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785126 2585 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 18 08:07:09.789220 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785128 2585 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 18 08:07:09.789220 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785131 2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 18 08:07:09.789220 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785133 2585 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 18 08:07:09.789220 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785136 2585 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 18 08:07:09.789220 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785139 2585 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 18 08:07:09.789220 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785141 2585 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 18 08:07:09.789220 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785143 2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 18 08:07:09.789220 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785146 2585 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 18 08:07:09.789768 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785148 2585 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 18 08:07:09.789768 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785151 2585 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 18 08:07:09.789768 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785153 2585 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 18 08:07:09.789768 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785156 2585 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 18 08:07:09.789768 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785159 2585 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 18 08:07:09.789768 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785161 2585 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 18 08:07:09.789768 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785164 2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 18 08:07:09.789768 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785167 2585 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 18 08:07:09.789768 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785169 2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 18 08:07:09.789768 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785172 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 18 08:07:09.789768 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785174 2585 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 18 08:07:09.789768 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785177 2585 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 18 08:07:09.789768 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785179 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 18 08:07:09.789768 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785182 2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 18 08:07:09.789768 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785185 2585 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 18 08:07:09.789768 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785194 2585 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 18 08:07:09.789768 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785197 2585 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 18 08:07:09.789768 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785199 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 18 08:07:09.789768 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785202 2585 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 18 08:07:09.790319 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.785207 2585 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 18 08:07:09.790319 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785371 2585 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 18 08:07:09.790319 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785377 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 18 08:07:09.790319 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785381 2585 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 18 08:07:09.790319 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785385 2585 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 18 08:07:09.790319 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785388 2585 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 18 08:07:09.790319 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785391 2585 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 18 08:07:09.790319 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785394 2585 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 18 08:07:09.790319 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785396 2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 18 08:07:09.790319 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785399 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 18 08:07:09.790319 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785401 2585 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 18 08:07:09.790319 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785404 2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 18 08:07:09.790319 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785406 2585 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 18 08:07:09.790319 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785409 2585 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 18 08:07:09.790319 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785411 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 18 08:07:09.790707 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785414 2585 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 18 08:07:09.790707 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785416 2585 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 18 08:07:09.790707 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785419 2585 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 18 08:07:09.790707 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785421 2585 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 18 08:07:09.790707 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785424 2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 18 08:07:09.790707 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785426 2585 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 18 08:07:09.790707 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785428 2585 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 18 08:07:09.790707 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785431 2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 18 08:07:09.790707 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785433 2585 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 18 08:07:09.790707 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785436 2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 18 08:07:09.790707 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785438 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 18 08:07:09.790707 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785442 2585 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 18 08:07:09.790707 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785445 2585 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 18 08:07:09.790707 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785449 2585 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 18 08:07:09.790707 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785458 2585 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 18 08:07:09.790707 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785461 2585 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 18 08:07:09.790707 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785464 2585 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 18 08:07:09.790707 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785467 2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 18 08:07:09.790707 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785470 2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 18 08:07:09.791530 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785473 2585 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 18 08:07:09.791530 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785475 2585 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 18 08:07:09.791530 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785478 2585 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 18 08:07:09.791530 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785481 2585 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 18 08:07:09.791530 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785483 2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 18 08:07:09.791530 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785486 2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 18 08:07:09.791530 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785488 2585 feature_gate.go:328] unrecognized feature gate: Example Sep 18 08:07:09.791530 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785490 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 18 08:07:09.791530 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785493 2585 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 18 08:07:09.791530 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785496 2585 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 18 08:07:09.791530 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785498 2585 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 18 08:07:09.791530 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785500 2585 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 18 08:07:09.791530 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785503 2585 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 18 08:07:09.791530 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785506 2585 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 18 08:07:09.791530 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785508 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 18 08:07:09.791530 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785511 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 18 08:07:09.791530 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785513 2585 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 18 08:07:09.791530 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785516 2585 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 18 08:07:09.791530 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785520 2585 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 18 08:07:09.792297 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785522 2585 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 18 08:07:09.792297 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785525 2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 18 08:07:09.792297 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785527 2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 18 08:07:09.792297 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785530 2585 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 18 08:07:09.792297 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785532 2585 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 18 08:07:09.792297 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785535 2585 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 18 08:07:09.792297 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785538 2585 feature_gate.go:328] unrecognized feature gate: Example2 Sep 18 08:07:09.792297 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785540 2585 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 18 08:07:09.792297 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785543 2585 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 18 08:07:09.792297 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785551 2585 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 18 08:07:09.792297 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785554 2585 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 18 08:07:09.792297 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785556 2585 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 18 08:07:09.792297 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785559 2585 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 18 08:07:09.792297 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785562 2585 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 18 08:07:09.792297 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785564 2585 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 18 08:07:09.792297 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785567 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 18 08:07:09.792297 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785569 2585 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 18 08:07:09.792297 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785571 2585 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 18 08:07:09.792297 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785574 2585 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 18 08:07:09.792297 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785576 2585 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 18 08:07:09.792877 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785579 2585 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 18 08:07:09.792877 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785581 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 18 08:07:09.792877 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785584 2585 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 18 08:07:09.792877 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785586 2585 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 18 08:07:09.792877 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785588 2585 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 18 08:07:09.792877 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785591 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 18 08:07:09.792877 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785593 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 18 08:07:09.792877 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785595 2585 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 18 08:07:09.792877 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785598 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 18 08:07:09.792877 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785600 2585 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 18 08:07:09.792877 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785602 2585 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 18 08:07:09.792877 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785605 2585 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 18 08:07:09.792877 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785607 2585 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 18 08:07:09.792877 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785610 2585 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 18 08:07:09.792877 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785612 2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 18 08:07:09.792877 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785614 2585 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 18 08:07:09.792877 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785617 2585 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 18 08:07:09.792877 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785619 2585 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 18 08:07:09.792877 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785623 2585 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 18 08:07:09.792877 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785625 2585 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 18 08:07:09.793357 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785627 2585 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 18 08:07:09.793357 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785630 2585 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 18 08:07:09.793357 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785638 2585 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 18 08:07:09.793357 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785641 2585 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 18 08:07:09.793357 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785643 2585 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 18 08:07:09.793357 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785646 2585 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 18 08:07:09.793357 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:09.785648 2585 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 18 08:07:09.793357 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.785654 2585 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 18 08:07:09.793357 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.786440 2585 server.go:962] "Client rotation is on, will bootstrap in background" Sep 18 08:07:09.793357 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.788939 2585 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 18 08:07:09.793357 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.789834 2585 server.go:1019] "Starting client certificate rotation" Sep 18 08:07:09.793357 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.789971 2585 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 18 08:07:09.793357 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.790796 2585 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 18 08:07:09.793357 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.792352 2585 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 18 08:07:09.793779 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.793600 2585 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 18 08:07:09.800492 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.800469 2585 log.go:25] "Validated CRI v1 runtime API" Sep 18 08:07:09.802233 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.802216 2585 log.go:25] "Validated CRI v1 image API" Sep 18 08:07:09.803102 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.803089 2585 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 18 08:07:09.806007 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.805976 2585 fs.go:135] Filesystem UUIDs: map[4aeaedec-fd2b-45ca-b29a-5dc41a067553:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 7dc6f7aa-e961-43c1-a163-390bb4273e88:/dev/nvme0n1p4] Sep 18 08:07:09.806080 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.806005 2585 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 18 08:07:09.811803 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.811663 2585 manager.go:216] Machine: {Timestamp:2026-09-18 08:07:09.810342928 +0000 UTC m=+2.080042848 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3105435 MemoryCapacity:32812154880 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec29021527d3ae6b1ee5e288c565fba1 SystemUUID:ec290215-27d3-ae6b-1ee5-e288c565fba1 BootID:4f9407f8-8dcf-4880-a318-7d22e466037a Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562430976 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406077440 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406077440 Type:vfs Inodes:4005390 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:df:31:f1:c3 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:df:31:f1:c3 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:6e:2d:99:22:4b:b0 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812154880 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 18 08:07:09.811803 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.811788 2585 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 18 08:07:09.812013 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.811995 2585 manager.go:232] Version: {KernelVersion:5.14.0-570.141.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260914-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 18 08:07:09.813611 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.813586 2585 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 18 08:07:09.813806 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.813613 2585 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-42.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 18 08:07:09.815297 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.815282 2585 topology_manager.go:138] "Creating topology manager with none policy" Sep 18 08:07:09.815297 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.815304 2585 container_manager_linux.go:309] "Creating device plugin manager" Sep 18 08:07:09.815421 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.815316 2585 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 18 08:07:09.815421 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.815343 2585 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 18 08:07:09.815512 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.815441 2585 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 18 08:07:09.815512 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.815443 2585 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 18 08:07:09.819730 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.819713 2585 state_mem.go:36] "Initialized new in-memory state store" Sep 18 08:07:09.819910 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.819899 2585 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 18 08:07:09.819968 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.819945 2585 kubelet.go:486] "Attempting to sync node with API server" Sep 18 08:07:09.819968 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.819966 2585 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 18 08:07:09.820071 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.819988 2585 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 18 08:07:09.820071 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.820054 2585 kubelet.go:398] "Adding apiserver pod source" Sep 18 08:07:09.820071 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.820067 2585 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 18 08:07:09.820525 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.820509 2585 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 18 08:07:09.820600 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.820567 2585 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 18 08:07:09.824138 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.824051 2585 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.13-6.rhaos4.21.git6253162.el9" apiVersion="v1" Sep 18 08:07:09.827240 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.827220 2585 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 18 08:07:09.827334 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.827260 2585 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 18 08:07:09.828503 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.828479 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 18 08:07:09.828575 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.828508 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 18 08:07:09.828575 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.828521 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 18 08:07:09.828575 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.828528 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 18 08:07:09.828575 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.828537 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 18 08:07:09.828575 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.828542 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 18 08:07:09.828575 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.828555 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 18 08:07:09.828575 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.828560 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 18 08:07:09.828575 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.828567 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 18 08:07:09.828575 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.828573 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 18 08:07:09.828811 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.828581 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 18 08:07:09.828811 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.828586 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 18 08:07:09.828811 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.828616 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 18 08:07:09.828811 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.828624 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 18 08:07:09.829781 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:07:09.829758 2585 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-42.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 18 08:07:09.829781 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:07:09.829772 2585 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Sep 18 08:07:09.830874 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.830857 2585 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-42.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Sep 18 08:07:09.832635 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.832621 2585 server.go:1268] "Started kubelet" Sep 18 08:07:09.832709 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.832678 2585 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 18 08:07:09.832794 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.832732 2585 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 18 08:07:09.832911 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.832818 2585 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 18 08:07:09.833542 ip-10-0-138-42 systemd[1]: Started Kubernetes Kubelet. Sep 18 08:07:09.834017 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.833962 2585 server.go:310] "Adding debug handlers to kubelet server" Sep 18 08:07:09.834419 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.834269 2585 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 18 08:07:09.837692 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:07:09.837674 2585 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 18 08:07:09.841226 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.841207 2585 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 18 08:07:09.841226 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.841219 2585 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 18 08:07:09.841354 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:07:09.841296 2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-42.ec2.internal\" not found" Sep 18 08:07:09.841971 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.841860 2585 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 18 08:07:09.841971 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.841865 2585 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 18 08:07:09.841971 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.841889 2585 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 18 08:07:09.842150 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.842036 2585 reconstruct.go:97] "Volume reconstruction finished" Sep 18 08:07:09.842150 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.842045 2585 reconciler.go:29] "Reconciler: start to sync state" Sep 18 08:07:09.842411 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.842384 2585 factory.go:55] Registering systemd factory Sep 18 08:07:09.842411 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.842400 2585 factory.go:223] Registration of the systemd container factory successfully Sep 18 08:07:09.843442 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.843427 2585 factory.go:153] Registering CRI-O factory Sep 18 08:07:09.843442 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.843444 2585 factory.go:223] Registration of the crio container factory successfully Sep 18 08:07:09.843564 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.843503 2585 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 18 08:07:09.843564 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.843523 2585 factory.go:103] Registering Raw factory Sep 18 08:07:09.843564 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.843538 2585 manager.go:1196] Started watching for new ooms in manager Sep 18 08:07:09.844153 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.844092 2585 manager.go:349] Starting recovery of all containers Sep 18 08:07:09.847344 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.847320 2585 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-xp4nd" Sep 18 08:07:09.849832 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.849787 2585 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 18 08:07:09.854268 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:07:09.854228 2585 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Sep 18 08:07:09.854411 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:07:09.854313 2585 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-138-42.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Sep 18 08:07:09.854487 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.854465 2585 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-xp4nd" Sep 18 08:07:09.855457 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.855443 2585 manager.go:354] Recovery completed Sep 18 08:07:09.862972 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:07:09.862914 2585 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Sep 18 08:07:09.867345 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.867329 2585 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 08:07:09.869412 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.869396 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-42.ec2.internal" event="NodeHasSufficientMemory" Sep 18 08:07:09.869476 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.869427 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-42.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 08:07:09.869476 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.869438 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-42.ec2.internal" event="NodeHasSufficientPID" Sep 18 08:07:09.870026 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.870011 2585 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 18 08:07:09.870124 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.870025 2585 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 08:07:09.870124 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.870030 2585 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 18 08:07:09.870124 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.870063 2585 state_mem.go:36] "Initialized new in-memory state store" Sep 18 08:07:09.870691 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.870676 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-42.ec2.internal" event="NodeHasSufficientMemory" Sep 18 08:07:09.870774 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.870701 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-42.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 08:07:09.870774 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.870711 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-42.ec2.internal" event="NodeHasSufficientPID" Sep 18 08:07:09.871461 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.871448 2585 policy_none.go:49] "None policy: Start" Sep 18 08:07:09.871514 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.871463 2585 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 18 08:07:09.871514 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.871474 2585 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 18 08:07:09.872687 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.872676 2585 policy_none.go:47] "Start" Sep 18 08:07:09.911185 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.907447 2585 manager.go:337] "Starting Device Plugin manager" Sep 18 08:07:09.911185 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:07:09.907678 2585 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 18 08:07:09.911185 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.907689 2585 server.go:87] "Starting device plugin registration server" Sep 18 08:07:09.911185 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.907943 2585 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 18 08:07:09.911185 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.907964 2585 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 18 08:07:09.911185 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.908059 2585 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 18 08:07:09.911185 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.908145 2585 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 18 08:07:09.911185 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.908155 2585 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 18 08:07:09.911185 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:07:09.908751 2585 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 18 08:07:09.911185 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:07:09.908805 2585 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-42.ec2.internal\" not found" Sep 18 08:07:09.937995 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.937974 2585 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 18 08:07:09.938098 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.938023 2585 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 18 08:07:09.938098 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.938049 2585 kubelet.go:2448] "Starting kubelet main sync loop" Sep 18 08:07:09.938098 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:07:09.938085 2585 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Sep 18 08:07:09.939797 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:09.939781 2585 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 18 08:07:10.008263 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:10.008223 2585 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 08:07:10.009184 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:10.009170 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-42.ec2.internal" event="NodeHasSufficientMemory" Sep 18 08:07:10.009262 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:10.009200 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-42.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 08:07:10.009262 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:10.009214 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-42.ec2.internal" event="NodeHasSufficientPID" Sep 18 08:07:10.009262 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:10.009237 2585 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-42.ec2.internal" Sep 18 08:07:10.018150 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:10.018136 2585 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-42.ec2.internal" Sep 18 08:07:10.018215 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:07:10.018158 2585 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-42.ec2.internal\": node \"ip-10-0-138-42.ec2.internal\" not found" Sep 18 08:07:10.035009 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:07:10.034940 2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-42.ec2.internal\" not found" Sep 18 08:07:10.039040 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:10.039015 2585 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-42.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-42.ec2.internal"] Sep 18 08:07:10.039117 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:10.039101 2585 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 08:07:10.040078 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:10.040062 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-42.ec2.internal" event="NodeHasSufficientMemory" Sep 18 08:07:10.040160 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:10.040091 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-42.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 08:07:10.040160 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:10.040101 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-42.ec2.internal" event="NodeHasSufficientPID" Sep 18 08:07:10.041392 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:10.041379 2585 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 08:07:10.041522 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:10.041506 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-42.ec2.internal" Sep 18 08:07:10.041572 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:10.041535 2585 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 08:07:10.042077 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:10.042062 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-42.ec2.internal" event="NodeHasSufficientMemory" Sep 18 08:07:10.042148 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:10.042094 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-42.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 08:07:10.042148 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:10.042102 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-42.ec2.internal" event="NodeHasSufficientMemory" Sep 18 08:07:10.042148 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:10.042120 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-42.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 08:07:10.042148 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:10.042129 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-42.ec2.internal" event="NodeHasSufficientPID" Sep 18 08:07:10.042148 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:10.042104 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-42.ec2.internal" event="NodeHasSufficientPID" Sep 18 08:07:10.043172 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:10.043154 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/841522c3fa8765282e5cd65659c3f206-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-42.ec2.internal\" (UID: \"841522c3fa8765282e5cd65659c3f206\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-42.ec2.internal" Sep 18 08:07:10.043260 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:10.043177 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/841522c3fa8765282e5cd65659c3f206-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-42.ec2.internal\" (UID: \"841522c3fa8765282e5cd65659c3f206\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-42.ec2.internal" Sep 18 08:07:10.043260 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:10.043191 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4d9488aa4884c8db37ce53e0291649d1-config\") pod \"kube-apiserver-proxy-ip-10-0-138-42.ec2.internal\" (UID: \"4d9488aa4884c8db37ce53e0291649d1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-42.ec2.internal" Sep 18 08:07:10.043701 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:10.043689 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-42.ec2.internal" Sep 18 08:07:10.043748 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:10.043711 2585 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 08:07:10.044406 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:10.044390 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-42.ec2.internal" event="NodeHasSufficientMemory" Sep 18 08:07:10.044482 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:10.044420 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-42.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 08:07:10.044482 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:10.044434 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-42.ec2.internal" event="NodeHasSufficientPID" Sep 18 08:07:10.068465 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:07:10.068439 2585 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-42.ec2.internal\" not found" node="ip-10-0-138-42.ec2.internal" Sep 18 08:07:10.072765 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:07:10.072745 2585 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-42.ec2.internal\" not found" node="ip-10-0-138-42.ec2.internal" Sep 18 08:07:10.135582 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:07:10.135555 2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-42.ec2.internal\" not found" Sep 18 08:07:10.144072 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:10.144050 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/841522c3fa8765282e5cd65659c3f206-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-42.ec2.internal\" (UID: \"841522c3fa8765282e5cd65659c3f206\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-42.ec2.internal" Sep 18 08:07:10.144163 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:10.144073 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/841522c3fa8765282e5cd65659c3f206-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-42.ec2.internal\" (UID: \"841522c3fa8765282e5cd65659c3f206\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-42.ec2.internal" Sep 18 08:07:10.144163 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:10.144099 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4d9488aa4884c8db37ce53e0291649d1-config\") pod \"kube-apiserver-proxy-ip-10-0-138-42.ec2.internal\" (UID: \"4d9488aa4884c8db37ce53e0291649d1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-42.ec2.internal" Sep 18 08:07:10.144163 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:10.144124 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4d9488aa4884c8db37ce53e0291649d1-config\") pod \"kube-apiserver-proxy-ip-10-0-138-42.ec2.internal\" (UID: \"4d9488aa4884c8db37ce53e0291649d1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-42.ec2.internal" Sep 18 08:07:10.144163 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:10.144149 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/841522c3fa8765282e5cd65659c3f206-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-42.ec2.internal\" (UID: \"841522c3fa8765282e5cd65659c3f206\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-42.ec2.internal" Sep 18 08:07:10.144287 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:10.144154 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/841522c3fa8765282e5cd65659c3f206-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-42.ec2.internal\" (UID: \"841522c3fa8765282e5cd65659c3f206\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-42.ec2.internal" Sep 18 08:07:10.235819 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:07:10.235772 2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-42.ec2.internal\" not found" Sep 18 08:07:10.336588 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:07:10.336499 2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-42.ec2.internal\" not found" Sep 18 08:07:10.373026 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:10.372998 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-42.ec2.internal" Sep 18 08:07:10.376643 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:10.376617 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-42.ec2.internal" Sep 18 08:07:10.437137 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:07:10.437101 2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-42.ec2.internal\" not found" Sep 18 08:07:10.537630 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:07:10.537586 2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-42.ec2.internal\" not found" Sep 18 08:07:10.638229 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:07:10.638132 2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-42.ec2.internal\" not found" Sep 18 08:07:10.738759 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:07:10.738718 2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-42.ec2.internal\" not found" Sep 18 08:07:10.789279 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:10.789246 2585 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 18 08:07:10.789720 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:10.789402 2585 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 18 08:07:10.839098 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:07:10.839072 2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-42.ec2.internal\" not found" Sep 18 08:07:10.863345 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:10.863307 2585 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-17 08:02:09 +0000 UTC" deadline="2028-05-07 06:18:39.764807746 +0000 UTC" Sep 18 08:07:10.863345 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:10.863343 2585 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14326h11m28.901469767s" Sep 18 08:07:10.865248 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:10.865231 2585 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 18 08:07:10.939818 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:07:10.939732 2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-42.ec2.internal\" not found" Sep 18 08:07:10.983275 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:10.983242 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod841522c3fa8765282e5cd65659c3f206.slice/crio-6e7bed472580502d0cedec3b6e53b44c426dddd67347fb91a5954ed676069c7d WatchSource:0}: Error finding container 6e7bed472580502d0cedec3b6e53b44c426dddd67347fb91a5954ed676069c7d: Status 404 returned error can't find the container with id 6e7bed472580502d0cedec3b6e53b44c426dddd67347fb91a5954ed676069c7d Sep 18 08:07:10.983700 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:10.983681 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d9488aa4884c8db37ce53e0291649d1.slice/crio-618ab245031fa0d091443a918fdb690f3ac87c674ea43887fd0ce41e77dd09b0 WatchSource:0}: Error finding container 618ab245031fa0d091443a918fdb690f3ac87c674ea43887fd0ce41e77dd09b0: Status 404 returned error can't find the container with id 618ab245031fa0d091443a918fdb690f3ac87c674ea43887fd0ce41e77dd09b0 Sep 18 08:07:10.990156 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:10.990143 2585 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 18 08:07:11.040547 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:07:11.040522 2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-42.ec2.internal\" not found" Sep 18 08:07:11.084245 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.084226 2585 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 18 08:07:11.141347 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:07:11.141324 2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-42.ec2.internal\" not found" Sep 18 08:07:11.241887 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:07:11.241827 2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-42.ec2.internal\" not found" Sep 18 08:07:11.342666 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:07:11.342639 2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-42.ec2.internal\" not found" Sep 18 08:07:11.370993 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.370971 2585 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 18 08:07:11.442107 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.442086 2585 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-42.ec2.internal" Sep 18 08:07:11.457646 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.457626 2585 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 18 08:07:11.458765 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.458748 2585 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-42.ec2.internal" Sep 18 08:07:11.473217 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.473196 2585 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 18 08:07:11.767288 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.767216 2585 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 18 08:07:11.821349 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.821313 2585 apiserver.go:52] "Watching apiserver" Sep 18 08:07:11.829484 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.829132 2585 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 18 08:07:11.830335 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.829948 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-dtq72","kube-system/kube-apiserver-proxy-ip-10-0-138-42.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pnp5z","openshift-multus/multus-additional-cni-plugins-dn4s9","openshift-multus/multus-gjb6q","openshift-network-diagnostics/network-check-target-qmmgl","openshift-network-operator/iptables-alerter-wzhkw","openshift-ovn-kubernetes/ovnkube-node-9kn9p","kube-system/global-pull-secret-syncer-6rnbm","openshift-cluster-node-tuning-operator/tuned-hsz4j","openshift-dns/node-resolver-jh2mg","openshift-image-registry/node-ca-nb4q9","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-42.ec2.internal","openshift-multus/network-metrics-daemon-9vz5k"] Sep 18 08:07:11.831946 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.831926 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-wzhkw" Sep 18 08:07:11.833235 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.833211 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-jh2mg" Sep 18 08:07:11.834404 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.834380 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 18 08:07:11.834519 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.834424 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-2kq9c\"" Sep 18 08:07:11.834581 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.834538 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 18 08:07:11.834581 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.834538 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 18 08:07:11.834897 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.834881 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pnp5z" Sep 18 08:07:11.835504 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.835370 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 18 08:07:11.835504 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.835370 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 18 08:07:11.835504 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.835414 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-4zqfw\"" Sep 18 08:07:11.836537 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.836517 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-dn4s9" Sep 18 08:07:11.837113 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.837095 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 18 08:07:11.837201 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.837116 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 18 08:07:11.837201 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.837156 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-gh4rf\"" Sep 18 08:07:11.837309 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.837097 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 18 08:07:11.837865 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.837830 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-gjb6q" Sep 18 08:07:11.839267 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.838943 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 18 08:07:11.839267 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.839023 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 18 08:07:11.839267 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.839104 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 18 08:07:11.839267 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.839029 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 18 08:07:11.839267 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.839126 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-5f5gw\"" Sep 18 08:07:11.839267 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.839162 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 18 08:07:11.839549 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.839331 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qmmgl" Sep 18 08:07:11.839549 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:07:11.839391 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qmmgl" podUID="97cadd54-3234-4e3f-a2bf-c96b134566b1" Sep 18 08:07:11.840118 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.840100 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 18 08:07:11.840261 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.840244 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-2xjfq\"" Sep 18 08:07:11.840937 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.840920 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6rnbm" Sep 18 08:07:11.841023 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:07:11.840978 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6rnbm" podUID="8d257247-8dae-4dce-9c31-62cf736b2b9f" Sep 18 08:07:11.841398 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.841385 2585 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 18 08:07:11.842741 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.842668 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9vz5k" Sep 18 08:07:11.842741 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:07:11.842731 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9vz5k" podUID="b6e0d1e7-a182-4ac0-a484-f174f64ca021" Sep 18 08:07:11.844123 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.844104 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-9kn9p" Sep 18 08:07:11.846055 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.846016 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-hsz4j" Sep 18 08:07:11.846475 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.846458 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 18 08:07:11.846560 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.846477 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 18 08:07:11.846560 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.846532 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 18 08:07:11.846662 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.846627 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 18 08:07:11.846887 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.846869 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-7qbbk\"" Sep 18 08:07:11.848270 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.847423 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 18 08:07:11.848270 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.847531 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 18 08:07:11.848270 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.847699 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-dtq72" Sep 18 08:07:11.848555 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.848534 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 18 08:07:11.848555 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.848562 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 18 08:07:11.848803 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.848787 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-bwvg9\"" Sep 18 08:07:11.849457 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.849434 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-nb4q9" Sep 18 08:07:11.849822 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.849801 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-czdhl\"" Sep 18 08:07:11.849917 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.849903 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 18 08:07:11.850072 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.850052 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 18 08:07:11.852965 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.852944 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 18 08:07:11.853066 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.853046 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 18 08:07:11.853172 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.853067 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-pvwhr\"" Sep 18 08:07:11.853172 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.853047 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 18 08:07:11.854831 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.854809 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9ffad063-9ddb-4986-ab43-8931a4288d24-host-var-lib-cni-bin\") pod \"multus-gjb6q\" (UID: \"9ffad063-9ddb-4986-ab43-8931a4288d24\") " pod="openshift-multus/multus-gjb6q" Sep 18 08:07:11.854943 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.854838 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9ffad063-9ddb-4986-ab43-8931a4288d24-multus-daemon-config\") pod \"multus-gjb6q\" (UID: \"9ffad063-9ddb-4986-ab43-8931a4288d24\") " pod="openshift-multus/multus-gjb6q" Sep 18 08:07:11.854943 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.854887 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c0aaaa41-bdef-4c6a-a828-18de65269b1a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dn4s9\" (UID: \"c0aaaa41-bdef-4c6a-a828-18de65269b1a\") " pod="openshift-multus/multus-additional-cni-plugins-dn4s9" Sep 18 08:07:11.854943 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.854912 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c0aaaa41-bdef-4c6a-a828-18de65269b1a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dn4s9\" (UID: \"c0aaaa41-bdef-4c6a-a828-18de65269b1a\") " pod="openshift-multus/multus-additional-cni-plugins-dn4s9" Sep 18 08:07:11.854943 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.854938 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9ffad063-9ddb-4986-ab43-8931a4288d24-cnibin\") pod \"multus-gjb6q\" (UID: \"9ffad063-9ddb-4986-ab43-8931a4288d24\") " pod="openshift-multus/multus-gjb6q" Sep 18 08:07:11.855171 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.854962 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9ffad063-9ddb-4986-ab43-8931a4288d24-cni-binary-copy\") pod \"multus-gjb6q\" (UID: \"9ffad063-9ddb-4986-ab43-8931a4288d24\") " pod="openshift-multus/multus-gjb6q" Sep 18 08:07:11.855171 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.854985 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d24r9\" (UniqueName: \"kubernetes.io/projected/9ffad063-9ddb-4986-ab43-8931a4288d24-kube-api-access-d24r9\") pod \"multus-gjb6q\" (UID: \"9ffad063-9ddb-4986-ab43-8931a4288d24\") " pod="openshift-multus/multus-gjb6q" Sep 18 08:07:11.855171 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.855011 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kr5cb\" (UniqueName: \"kubernetes.io/projected/b6e0d1e7-a182-4ac0-a484-f174f64ca021-kube-api-access-kr5cb\") pod \"network-metrics-daemon-9vz5k\" (UID: \"b6e0d1e7-a182-4ac0-a484-f174f64ca021\") " pod="openshift-multus/network-metrics-daemon-9vz5k" Sep 18 08:07:11.855171 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.855035 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/44849783-4c3d-4537-9559-5c5d79e76cb4-etc-selinux\") pod \"aws-ebs-csi-driver-node-pnp5z\" (UID: \"44849783-4c3d-4537-9559-5c5d79e76cb4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pnp5z" Sep 18 08:07:11.855171 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.855050 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9ffad063-9ddb-4986-ab43-8931a4288d24-host-run-multus-certs\") pod \"multus-gjb6q\" (UID: \"9ffad063-9ddb-4986-ab43-8931a4288d24\") " pod="openshift-multus/multus-gjb6q" Sep 18 08:07:11.855171 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.855090 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c0aaaa41-bdef-4c6a-a828-18de65269b1a-system-cni-dir\") pod \"multus-additional-cni-plugins-dn4s9\" (UID: \"c0aaaa41-bdef-4c6a-a828-18de65269b1a\") " pod="openshift-multus/multus-additional-cni-plugins-dn4s9" Sep 18 08:07:11.855171 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.855135 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c0aaaa41-bdef-4c6a-a828-18de65269b1a-cni-binary-copy\") pod \"multus-additional-cni-plugins-dn4s9\" (UID: \"c0aaaa41-bdef-4c6a-a828-18de65269b1a\") " pod="openshift-multus/multus-additional-cni-plugins-dn4s9" Sep 18 08:07:11.855519 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.855158 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9ffad063-9ddb-4986-ab43-8931a4288d24-multus-socket-dir-parent\") pod \"multus-gjb6q\" (UID: \"9ffad063-9ddb-4986-ab43-8931a4288d24\") " pod="openshift-multus/multus-gjb6q" Sep 18 08:07:11.855519 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.855199 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/44849783-4c3d-4537-9559-5c5d79e76cb4-socket-dir\") pod \"aws-ebs-csi-driver-node-pnp5z\" (UID: \"44849783-4c3d-4537-9559-5c5d79e76cb4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pnp5z" Sep 18 08:07:11.855519 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.855212 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/44849783-4c3d-4537-9559-5c5d79e76cb4-device-dir\") pod \"aws-ebs-csi-driver-node-pnp5z\" (UID: \"44849783-4c3d-4537-9559-5c5d79e76cb4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pnp5z" Sep 18 08:07:11.855519 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.855233 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/44849783-4c3d-4537-9559-5c5d79e76cb4-sys-fs\") pod \"aws-ebs-csi-driver-node-pnp5z\" (UID: \"44849783-4c3d-4537-9559-5c5d79e76cb4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pnp5z" Sep 18 08:07:11.855519 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.855256 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9ffad063-9ddb-4986-ab43-8931a4288d24-host-var-lib-cni-multus\") pod \"multus-gjb6q\" (UID: \"9ffad063-9ddb-4986-ab43-8931a4288d24\") " pod="openshift-multus/multus-gjb6q" Sep 18 08:07:11.855519 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.855275 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h55b9\" (UniqueName: \"kubernetes.io/projected/97cadd54-3234-4e3f-a2bf-c96b134566b1-kube-api-access-h55b9\") pod \"network-check-target-qmmgl\" (UID: \"97cadd54-3234-4e3f-a2bf-c96b134566b1\") " pod="openshift-network-diagnostics/network-check-target-qmmgl" Sep 18 08:07:11.855519 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.855307 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8d257247-8dae-4dce-9c31-62cf736b2b9f-original-pull-secret\") pod \"global-pull-secret-syncer-6rnbm\" (UID: \"8d257247-8dae-4dce-9c31-62cf736b2b9f\") " pod="kube-system/global-pull-secret-syncer-6rnbm" Sep 18 08:07:11.855519 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.855327 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-crw8f\" (UniqueName: \"kubernetes.io/projected/c0aaaa41-bdef-4c6a-a828-18de65269b1a-kube-api-access-crw8f\") pod \"multus-additional-cni-plugins-dn4s9\" (UID: \"c0aaaa41-bdef-4c6a-a828-18de65269b1a\") " pod="openshift-multus/multus-additional-cni-plugins-dn4s9" Sep 18 08:07:11.855519 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.855346 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3a7d7351-f419-4f97-a1fe-a490512e47ab-host-slash\") pod \"iptables-alerter-wzhkw\" (UID: \"3a7d7351-f419-4f97-a1fe-a490512e47ab\") " pod="openshift-network-operator/iptables-alerter-wzhkw" Sep 18 08:07:11.855519 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.855360 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b6e0d1e7-a182-4ac0-a484-f174f64ca021-metrics-certs\") pod \"network-metrics-daemon-9vz5k\" (UID: \"b6e0d1e7-a182-4ac0-a484-f174f64ca021\") " pod="openshift-multus/network-metrics-daemon-9vz5k" Sep 18 08:07:11.855519 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.855374 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/459b617e-1505-4bf6-9ee4-23d57ea13ddb-hosts-file\") pod \"node-resolver-jh2mg\" (UID: \"459b617e-1505-4bf6-9ee4-23d57ea13ddb\") " pod="openshift-dns/node-resolver-jh2mg" Sep 18 08:07:11.855519 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.855389 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9ffad063-9ddb-4986-ab43-8931a4288d24-etc-kubernetes\") pod \"multus-gjb6q\" (UID: \"9ffad063-9ddb-4986-ab43-8931a4288d24\") " pod="openshift-multus/multus-gjb6q" Sep 18 08:07:11.855519 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.855409 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9ffad063-9ddb-4986-ab43-8931a4288d24-multus-conf-dir\") pod \"multus-gjb6q\" (UID: \"9ffad063-9ddb-4986-ab43-8931a4288d24\") " pod="openshift-multus/multus-gjb6q" Sep 18 08:07:11.855519 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.855431 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2ngpn\" (UniqueName: \"kubernetes.io/projected/3a7d7351-f419-4f97-a1fe-a490512e47ab-kube-api-access-2ngpn\") pod \"iptables-alerter-wzhkw\" (UID: \"3a7d7351-f419-4f97-a1fe-a490512e47ab\") " pod="openshift-network-operator/iptables-alerter-wzhkw" Sep 18 08:07:11.855519 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.855448 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c0aaaa41-bdef-4c6a-a828-18de65269b1a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dn4s9\" (UID: \"c0aaaa41-bdef-4c6a-a828-18de65269b1a\") " pod="openshift-multus/multus-additional-cni-plugins-dn4s9" Sep 18 08:07:11.855519 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.855481 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9ffad063-9ddb-4986-ab43-8931a4288d24-multus-cni-dir\") pod \"multus-gjb6q\" (UID: \"9ffad063-9ddb-4986-ab43-8931a4288d24\") " pod="openshift-multus/multus-gjb6q" Sep 18 08:07:11.856199 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.855538 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9ffad063-9ddb-4986-ab43-8931a4288d24-host-run-netns\") pod \"multus-gjb6q\" (UID: \"9ffad063-9ddb-4986-ab43-8931a4288d24\") " pod="openshift-multus/multus-gjb6q" Sep 18 08:07:11.856199 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.855577 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9ffad063-9ddb-4986-ab43-8931a4288d24-host-var-lib-kubelet\") pod \"multus-gjb6q\" (UID: \"9ffad063-9ddb-4986-ab43-8931a4288d24\") " pod="openshift-multus/multus-gjb6q" Sep 18 08:07:11.856199 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.855593 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9ffad063-9ddb-4986-ab43-8931a4288d24-hostroot\") pod \"multus-gjb6q\" (UID: \"9ffad063-9ddb-4986-ab43-8931a4288d24\") " pod="openshift-multus/multus-gjb6q" Sep 18 08:07:11.856199 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.855624 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9ffad063-9ddb-4986-ab43-8931a4288d24-system-cni-dir\") pod \"multus-gjb6q\" (UID: \"9ffad063-9ddb-4986-ab43-8931a4288d24\") " pod="openshift-multus/multus-gjb6q" Sep 18 08:07:11.856199 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.855644 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8d257247-8dae-4dce-9c31-62cf736b2b9f-kubelet-config\") pod \"global-pull-secret-syncer-6rnbm\" (UID: \"8d257247-8dae-4dce-9c31-62cf736b2b9f\") " pod="kube-system/global-pull-secret-syncer-6rnbm" Sep 18 08:07:11.856199 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.855672 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/459b617e-1505-4bf6-9ee4-23d57ea13ddb-tmp-dir\") pod \"node-resolver-jh2mg\" (UID: \"459b617e-1505-4bf6-9ee4-23d57ea13ddb\") " pod="openshift-dns/node-resolver-jh2mg" Sep 18 08:07:11.856199 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.855704 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dmf74\" (UniqueName: \"kubernetes.io/projected/459b617e-1505-4bf6-9ee4-23d57ea13ddb-kube-api-access-dmf74\") pod \"node-resolver-jh2mg\" (UID: \"459b617e-1505-4bf6-9ee4-23d57ea13ddb\") " pod="openshift-dns/node-resolver-jh2mg" Sep 18 08:07:11.856199 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.855729 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/44849783-4c3d-4537-9559-5c5d79e76cb4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-pnp5z\" (UID: \"44849783-4c3d-4537-9559-5c5d79e76cb4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pnp5z" Sep 18 08:07:11.856199 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.855751 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mn2b7\" (UniqueName: \"kubernetes.io/projected/44849783-4c3d-4537-9559-5c5d79e76cb4-kube-api-access-mn2b7\") pod \"aws-ebs-csi-driver-node-pnp5z\" (UID: \"44849783-4c3d-4537-9559-5c5d79e76cb4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pnp5z" Sep 18 08:07:11.856199 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.855775 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9ffad063-9ddb-4986-ab43-8931a4288d24-host-run-k8s-cni-cncf-io\") pod \"multus-gjb6q\" (UID: \"9ffad063-9ddb-4986-ab43-8931a4288d24\") " pod="openshift-multus/multus-gjb6q" Sep 18 08:07:11.856199 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.855796 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8d257247-8dae-4dce-9c31-62cf736b2b9f-dbus\") pod \"global-pull-secret-syncer-6rnbm\" (UID: \"8d257247-8dae-4dce-9c31-62cf736b2b9f\") " pod="kube-system/global-pull-secret-syncer-6rnbm" Sep 18 08:07:11.856199 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.855827 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/44849783-4c3d-4537-9559-5c5d79e76cb4-registration-dir\") pod \"aws-ebs-csi-driver-node-pnp5z\" (UID: \"44849783-4c3d-4537-9559-5c5d79e76cb4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pnp5z" Sep 18 08:07:11.856199 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.855890 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3a7d7351-f419-4f97-a1fe-a490512e47ab-iptables-alerter-script\") pod \"iptables-alerter-wzhkw\" (UID: \"3a7d7351-f419-4f97-a1fe-a490512e47ab\") " pod="openshift-network-operator/iptables-alerter-wzhkw" Sep 18 08:07:11.856199 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.855920 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c0aaaa41-bdef-4c6a-a828-18de65269b1a-cnibin\") pod \"multus-additional-cni-plugins-dn4s9\" (UID: \"c0aaaa41-bdef-4c6a-a828-18de65269b1a\") " pod="openshift-multus/multus-additional-cni-plugins-dn4s9" Sep 18 08:07:11.859322 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.859304 2585 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 18 08:07:11.902083 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.902065 2585 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-fsl46" Sep 18 08:07:11.915942 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.915923 2585 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-fsl46" Sep 18 08:07:11.942665 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.942646 2585 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 18 08:07:11.943486 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.943439 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-42.ec2.internal" event={"ID":"4d9488aa4884c8db37ce53e0291649d1","Type":"ContainerStarted","Data":"618ab245031fa0d091443a918fdb690f3ac87c674ea43887fd0ce41e77dd09b0"} Sep 18 08:07:11.944634 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.944607 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-42.ec2.internal" event={"ID":"841522c3fa8765282e5cd65659c3f206","Type":"ContainerStarted","Data":"6e7bed472580502d0cedec3b6e53b44c426dddd67347fb91a5954ed676069c7d"} Sep 18 08:07:11.956445 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.956421 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a56b7fed-7af6-4ed5-962d-9bd3f342cd2b-ovnkube-script-lib\") pod \"ovnkube-node-9kn9p\" (UID: \"a56b7fed-7af6-4ed5-962d-9bd3f342cd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kn9p" Sep 18 08:07:11.956542 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.956455 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rnvs4\" (UniqueName: \"kubernetes.io/projected/a56b7fed-7af6-4ed5-962d-9bd3f342cd2b-kube-api-access-rnvs4\") pod \"ovnkube-node-9kn9p\" (UID: \"a56b7fed-7af6-4ed5-962d-9bd3f342cd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kn9p" Sep 18 08:07:11.956542 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.956480 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9ffad063-9ddb-4986-ab43-8931a4288d24-host-run-multus-certs\") pod \"multus-gjb6q\" (UID: \"9ffad063-9ddb-4986-ab43-8931a4288d24\") " pod="openshift-multus/multus-gjb6q" Sep 18 08:07:11.956542 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.956509 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9ffad063-9ddb-4986-ab43-8931a4288d24-multus-socket-dir-parent\") pod \"multus-gjb6q\" (UID: \"9ffad063-9ddb-4986-ab43-8931a4288d24\") " pod="openshift-multus/multus-gjb6q" Sep 18 08:07:11.956697 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.956546 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9ffad063-9ddb-4986-ab43-8931a4288d24-host-run-multus-certs\") pod \"multus-gjb6q\" (UID: \"9ffad063-9ddb-4986-ab43-8931a4288d24\") " pod="openshift-multus/multus-gjb6q" Sep 18 08:07:11.956697 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.956594 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a56b7fed-7af6-4ed5-962d-9bd3f342cd2b-systemd-units\") pod \"ovnkube-node-9kn9p\" (UID: \"a56b7fed-7af6-4ed5-962d-9bd3f342cd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kn9p" Sep 18 08:07:11.956697 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.956631 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9ffad063-9ddb-4986-ab43-8931a4288d24-host-var-lib-cni-multus\") pod \"multus-gjb6q\" (UID: \"9ffad063-9ddb-4986-ab43-8931a4288d24\") " pod="openshift-multus/multus-gjb6q" Sep 18 08:07:11.956697 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.956658 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h55b9\" (UniqueName: \"kubernetes.io/projected/97cadd54-3234-4e3f-a2bf-c96b134566b1-kube-api-access-h55b9\") pod \"network-check-target-qmmgl\" (UID: \"97cadd54-3234-4e3f-a2bf-c96b134566b1\") " pod="openshift-network-diagnostics/network-check-target-qmmgl" Sep 18 08:07:11.956697 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.956663 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9ffad063-9ddb-4986-ab43-8931a4288d24-multus-socket-dir-parent\") pod \"multus-gjb6q\" (UID: \"9ffad063-9ddb-4986-ab43-8931a4288d24\") " pod="openshift-multus/multus-gjb6q" Sep 18 08:07:11.956697 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.956685 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3a7d7351-f419-4f97-a1fe-a490512e47ab-host-slash\") pod \"iptables-alerter-wzhkw\" (UID: \"3a7d7351-f419-4f97-a1fe-a490512e47ab\") " pod="openshift-network-operator/iptables-alerter-wzhkw" Sep 18 08:07:11.956969 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.956695 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9ffad063-9ddb-4986-ab43-8931a4288d24-host-var-lib-cni-multus\") pod \"multus-gjb6q\" (UID: \"9ffad063-9ddb-4986-ab43-8931a4288d24\") " pod="openshift-multus/multus-gjb6q" Sep 18 08:07:11.956969 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.956713 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b6e0d1e7-a182-4ac0-a484-f174f64ca021-metrics-certs\") pod \"network-metrics-daemon-9vz5k\" (UID: \"b6e0d1e7-a182-4ac0-a484-f174f64ca021\") " pod="openshift-multus/network-metrics-daemon-9vz5k" Sep 18 08:07:11.956969 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.956740 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3a7d7351-f419-4f97-a1fe-a490512e47ab-host-slash\") pod \"iptables-alerter-wzhkw\" (UID: \"3a7d7351-f419-4f97-a1fe-a490512e47ab\") " pod="openshift-network-operator/iptables-alerter-wzhkw" Sep 18 08:07:11.956969 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.956757 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/977770b5-c53e-4c76-8946-e76d0663f9fb-run\") pod \"tuned-hsz4j\" (UID: \"977770b5-c53e-4c76-8946-e76d0663f9fb\") " pod="openshift-cluster-node-tuning-operator/tuned-hsz4j" Sep 18 08:07:11.956969 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:07:11.956815 2585 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 08:07:11.956969 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.956830 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a56b7fed-7af6-4ed5-962d-9bd3f342cd2b-var-lib-openvswitch\") pod \"ovnkube-node-9kn9p\" (UID: \"a56b7fed-7af6-4ed5-962d-9bd3f342cd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kn9p" Sep 18 08:07:11.956969 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.956872 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/977770b5-c53e-4c76-8946-e76d0663f9fb-etc-systemd\") pod \"tuned-hsz4j\" (UID: \"977770b5-c53e-4c76-8946-e76d0663f9fb\") " pod="openshift-cluster-node-tuning-operator/tuned-hsz4j" Sep 18 08:07:11.956969 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:07:11.956903 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6e0d1e7-a182-4ac0-a484-f174f64ca021-metrics-certs podName:b6e0d1e7-a182-4ac0-a484-f174f64ca021 nodeName:}" failed. No retries permitted until 2026-09-18 08:07:12.456876202 +0000 UTC m=+4.726576126 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b6e0d1e7-a182-4ac0-a484-f174f64ca021-metrics-certs") pod "network-metrics-daemon-9vz5k" (UID: "b6e0d1e7-a182-4ac0-a484-f174f64ca021") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 08:07:11.957389 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.956980 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9ffad063-9ddb-4986-ab43-8931a4288d24-multus-conf-dir\") pod \"multus-gjb6q\" (UID: \"9ffad063-9ddb-4986-ab43-8931a4288d24\") " pod="openshift-multus/multus-gjb6q" Sep 18 08:07:11.957389 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.957012 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2ngpn\" (UniqueName: \"kubernetes.io/projected/3a7d7351-f419-4f97-a1fe-a490512e47ab-kube-api-access-2ngpn\") pod \"iptables-alerter-wzhkw\" (UID: \"3a7d7351-f419-4f97-a1fe-a490512e47ab\") " pod="openshift-network-operator/iptables-alerter-wzhkw" Sep 18 08:07:11.957389 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.957036 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9ffad063-9ddb-4986-ab43-8931a4288d24-hostroot\") pod \"multus-gjb6q\" (UID: \"9ffad063-9ddb-4986-ab43-8931a4288d24\") " pod="openshift-multus/multus-gjb6q" Sep 18 08:07:11.957389 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.957061 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8d257247-8dae-4dce-9c31-62cf736b2b9f-kubelet-config\") pod \"global-pull-secret-syncer-6rnbm\" (UID: \"8d257247-8dae-4dce-9c31-62cf736b2b9f\") " pod="kube-system/global-pull-secret-syncer-6rnbm" Sep 18 08:07:11.957389 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.957064 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9ffad063-9ddb-4986-ab43-8931a4288d24-multus-conf-dir\") pod \"multus-gjb6q\" (UID: \"9ffad063-9ddb-4986-ab43-8931a4288d24\") " pod="openshift-multus/multus-gjb6q" Sep 18 08:07:11.957389 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.957087 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/977770b5-c53e-4c76-8946-e76d0663f9fb-etc-tuned\") pod \"tuned-hsz4j\" (UID: \"977770b5-c53e-4c76-8946-e76d0663f9fb\") " pod="openshift-cluster-node-tuning-operator/tuned-hsz4j" Sep 18 08:07:11.957389 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.957113 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9ffad063-9ddb-4986-ab43-8931a4288d24-hostroot\") pod \"multus-gjb6q\" (UID: \"9ffad063-9ddb-4986-ab43-8931a4288d24\") " pod="openshift-multus/multus-gjb6q" Sep 18 08:07:11.957389 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.957113 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g9588\" (UniqueName: \"kubernetes.io/projected/977770b5-c53e-4c76-8946-e76d0663f9fb-kube-api-access-g9588\") pod \"tuned-hsz4j\" (UID: \"977770b5-c53e-4c76-8946-e76d0663f9fb\") " pod="openshift-cluster-node-tuning-operator/tuned-hsz4j" Sep 18 08:07:11.957389 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.957125 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8d257247-8dae-4dce-9c31-62cf736b2b9f-kubelet-config\") pod \"global-pull-secret-syncer-6rnbm\" (UID: \"8d257247-8dae-4dce-9c31-62cf736b2b9f\") " pod="kube-system/global-pull-secret-syncer-6rnbm" Sep 18 08:07:11.957389 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.957146 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a56b7fed-7af6-4ed5-962d-9bd3f342cd2b-host-run-netns\") pod \"ovnkube-node-9kn9p\" (UID: \"a56b7fed-7af6-4ed5-962d-9bd3f342cd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kn9p" Sep 18 08:07:11.957389 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.957180 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/44849783-4c3d-4537-9559-5c5d79e76cb4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-pnp5z\" (UID: \"44849783-4c3d-4537-9559-5c5d79e76cb4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pnp5z" Sep 18 08:07:11.957389 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.957216 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/977770b5-c53e-4c76-8946-e76d0663f9fb-etc-sysconfig\") pod \"tuned-hsz4j\" (UID: \"977770b5-c53e-4c76-8946-e76d0663f9fb\") " pod="openshift-cluster-node-tuning-operator/tuned-hsz4j" Sep 18 08:07:11.957389 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.957222 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/44849783-4c3d-4537-9559-5c5d79e76cb4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-pnp5z\" (UID: \"44849783-4c3d-4537-9559-5c5d79e76cb4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pnp5z" Sep 18 08:07:11.957389 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.957236 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a56b7fed-7af6-4ed5-962d-9bd3f342cd2b-etc-openvswitch\") pod \"ovnkube-node-9kn9p\" (UID: \"a56b7fed-7af6-4ed5-962d-9bd3f342cd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kn9p" Sep 18 08:07:11.957389 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.957257 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8d257247-8dae-4dce-9c31-62cf736b2b9f-dbus\") pod \"global-pull-secret-syncer-6rnbm\" (UID: \"8d257247-8dae-4dce-9c31-62cf736b2b9f\") " pod="kube-system/global-pull-secret-syncer-6rnbm" Sep 18 08:07:11.957389 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.957286 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/977770b5-c53e-4c76-8946-e76d0663f9fb-etc-sysctl-d\") pod \"tuned-hsz4j\" (UID: \"977770b5-c53e-4c76-8946-e76d0663f9fb\") " pod="openshift-cluster-node-tuning-operator/tuned-hsz4j" Sep 18 08:07:11.957389 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.957308 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/977770b5-c53e-4c76-8946-e76d0663f9fb-lib-modules\") pod \"tuned-hsz4j\" (UID: \"977770b5-c53e-4c76-8946-e76d0663f9fb\") " pod="openshift-cluster-node-tuning-operator/tuned-hsz4j" Sep 18 08:07:11.958051 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.957330 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a56b7fed-7af6-4ed5-962d-9bd3f342cd2b-env-overrides\") pod \"ovnkube-node-9kn9p\" (UID: \"a56b7fed-7af6-4ed5-962d-9bd3f342cd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kn9p" Sep 18 08:07:11.958051 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.957352 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a56b7fed-7af6-4ed5-962d-9bd3f342cd2b-run-systemd\") pod \"ovnkube-node-9kn9p\" (UID: \"a56b7fed-7af6-4ed5-962d-9bd3f342cd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kn9p" Sep 18 08:07:11.958051 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.957376 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c0aaaa41-bdef-4c6a-a828-18de65269b1a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dn4s9\" (UID: \"c0aaaa41-bdef-4c6a-a828-18de65269b1a\") " pod="openshift-multus/multus-additional-cni-plugins-dn4s9" Sep 18 08:07:11.958051 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.957414 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9ffad063-9ddb-4986-ab43-8931a4288d24-cnibin\") pod \"multus-gjb6q\" (UID: \"9ffad063-9ddb-4986-ab43-8931a4288d24\") " pod="openshift-multus/multus-gjb6q" Sep 18 08:07:11.958051 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.957426 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8d257247-8dae-4dce-9c31-62cf736b2b9f-dbus\") pod \"global-pull-secret-syncer-6rnbm\" (UID: \"8d257247-8dae-4dce-9c31-62cf736b2b9f\") " pod="kube-system/global-pull-secret-syncer-6rnbm" Sep 18 08:07:11.958051 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.957459 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9ffad063-9ddb-4986-ab43-8931a4288d24-cnibin\") pod \"multus-gjb6q\" (UID: \"9ffad063-9ddb-4986-ab43-8931a4288d24\") " pod="openshift-multus/multus-gjb6q" Sep 18 08:07:11.958051 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.957525 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d24r9\" (UniqueName: \"kubernetes.io/projected/9ffad063-9ddb-4986-ab43-8931a4288d24-kube-api-access-d24r9\") pod \"multus-gjb6q\" (UID: \"9ffad063-9ddb-4986-ab43-8931a4288d24\") " pod="openshift-multus/multus-gjb6q" Sep 18 08:07:11.958051 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.957568 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kr5cb\" (UniqueName: \"kubernetes.io/projected/b6e0d1e7-a182-4ac0-a484-f174f64ca021-kube-api-access-kr5cb\") pod \"network-metrics-daemon-9vz5k\" (UID: \"b6e0d1e7-a182-4ac0-a484-f174f64ca021\") " pod="openshift-multus/network-metrics-daemon-9vz5k" Sep 18 08:07:11.958051 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.957594 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/44849783-4c3d-4537-9559-5c5d79e76cb4-etc-selinux\") pod \"aws-ebs-csi-driver-node-pnp5z\" (UID: \"44849783-4c3d-4537-9559-5c5d79e76cb4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pnp5z" Sep 18 08:07:11.958051 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.957627 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/977770b5-c53e-4c76-8946-e76d0663f9fb-tmp\") pod \"tuned-hsz4j\" (UID: \"977770b5-c53e-4c76-8946-e76d0663f9fb\") " pod="openshift-cluster-node-tuning-operator/tuned-hsz4j" Sep 18 08:07:11.958051 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.957642 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3a914598-1705-4865-9bbf-f7e2461c20f0-agent-certs\") pod \"konnectivity-agent-dtq72\" (UID: \"3a914598-1705-4865-9bbf-f7e2461c20f0\") " pod="kube-system/konnectivity-agent-dtq72" Sep 18 08:07:11.958051 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.957664 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a56b7fed-7af6-4ed5-962d-9bd3f342cd2b-log-socket\") pod \"ovnkube-node-9kn9p\" (UID: \"a56b7fed-7af6-4ed5-962d-9bd3f342cd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kn9p" Sep 18 08:07:11.958051 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.957754 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/44849783-4c3d-4537-9559-5c5d79e76cb4-etc-selinux\") pod \"aws-ebs-csi-driver-node-pnp5z\" (UID: \"44849783-4c3d-4537-9559-5c5d79e76cb4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pnp5z" Sep 18 08:07:11.958051 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.957899 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c0aaaa41-bdef-4c6a-a828-18de65269b1a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dn4s9\" (UID: \"c0aaaa41-bdef-4c6a-a828-18de65269b1a\") " pod="openshift-multus/multus-additional-cni-plugins-dn4s9" Sep 18 08:07:11.958051 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.957995 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c0aaaa41-bdef-4c6a-a828-18de65269b1a-system-cni-dir\") pod \"multus-additional-cni-plugins-dn4s9\" (UID: \"c0aaaa41-bdef-4c6a-a828-18de65269b1a\") " pod="openshift-multus/multus-additional-cni-plugins-dn4s9" Sep 18 08:07:11.958051 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.958020 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c0aaaa41-bdef-4c6a-a828-18de65269b1a-cni-binary-copy\") pod \"multus-additional-cni-plugins-dn4s9\" (UID: \"c0aaaa41-bdef-4c6a-a828-18de65269b1a\") " pod="openshift-multus/multus-additional-cni-plugins-dn4s9" Sep 18 08:07:11.958051 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.958042 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/44849783-4c3d-4537-9559-5c5d79e76cb4-socket-dir\") pod \"aws-ebs-csi-driver-node-pnp5z\" (UID: \"44849783-4c3d-4537-9559-5c5d79e76cb4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pnp5z" Sep 18 08:07:11.958644 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.958068 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/44849783-4c3d-4537-9559-5c5d79e76cb4-device-dir\") pod \"aws-ebs-csi-driver-node-pnp5z\" (UID: \"44849783-4c3d-4537-9559-5c5d79e76cb4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pnp5z" Sep 18 08:07:11.958644 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.958092 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/44849783-4c3d-4537-9559-5c5d79e76cb4-sys-fs\") pod \"aws-ebs-csi-driver-node-pnp5z\" (UID: \"44849783-4c3d-4537-9559-5c5d79e76cb4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pnp5z" Sep 18 08:07:11.958644 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.958119 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a56b7fed-7af6-4ed5-962d-9bd3f342cd2b-host-run-ovn-kubernetes\") pod \"ovnkube-node-9kn9p\" (UID: \"a56b7fed-7af6-4ed5-962d-9bd3f342cd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kn9p" Sep 18 08:07:11.958644 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.958120 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c0aaaa41-bdef-4c6a-a828-18de65269b1a-system-cni-dir\") pod \"multus-additional-cni-plugins-dn4s9\" (UID: \"c0aaaa41-bdef-4c6a-a828-18de65269b1a\") " pod="openshift-multus/multus-additional-cni-plugins-dn4s9" Sep 18 08:07:11.958644 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.958155 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a56b7fed-7af6-4ed5-962d-9bd3f342cd2b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9kn9p\" (UID: \"a56b7fed-7af6-4ed5-962d-9bd3f342cd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kn9p" Sep 18 08:07:11.958644 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.958173 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8d257247-8dae-4dce-9c31-62cf736b2b9f-original-pull-secret\") pod \"global-pull-secret-syncer-6rnbm\" (UID: \"8d257247-8dae-4dce-9c31-62cf736b2b9f\") " pod="kube-system/global-pull-secret-syncer-6rnbm" Sep 18 08:07:11.958644 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.958198 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-crw8f\" (UniqueName: \"kubernetes.io/projected/c0aaaa41-bdef-4c6a-a828-18de65269b1a-kube-api-access-crw8f\") pod \"multus-additional-cni-plugins-dn4s9\" (UID: \"c0aaaa41-bdef-4c6a-a828-18de65269b1a\") " pod="openshift-multus/multus-additional-cni-plugins-dn4s9" Sep 18 08:07:11.958644 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.958223 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/459b617e-1505-4bf6-9ee4-23d57ea13ddb-hosts-file\") pod \"node-resolver-jh2mg\" (UID: \"459b617e-1505-4bf6-9ee4-23d57ea13ddb\") " pod="openshift-dns/node-resolver-jh2mg" Sep 18 08:07:11.958644 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.958226 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/44849783-4c3d-4537-9559-5c5d79e76cb4-socket-dir\") pod \"aws-ebs-csi-driver-node-pnp5z\" (UID: \"44849783-4c3d-4537-9559-5c5d79e76cb4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pnp5z" Sep 18 08:07:11.958644 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.958293 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a56b7fed-7af6-4ed5-962d-9bd3f342cd2b-host-kubelet\") pod \"ovnkube-node-9kn9p\" (UID: \"a56b7fed-7af6-4ed5-962d-9bd3f342cd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kn9p" Sep 18 08:07:11.958644 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.958315 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a56b7fed-7af6-4ed5-962d-9bd3f342cd2b-host-slash\") pod \"ovnkube-node-9kn9p\" (UID: \"a56b7fed-7af6-4ed5-962d-9bd3f342cd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kn9p" Sep 18 08:07:11.958644 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.958329 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a56b7fed-7af6-4ed5-962d-9bd3f342cd2b-run-openvswitch\") pod \"ovnkube-node-9kn9p\" (UID: \"a56b7fed-7af6-4ed5-962d-9bd3f342cd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kn9p" Sep 18 08:07:11.958644 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.958326 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/44849783-4c3d-4537-9559-5c5d79e76cb4-device-dir\") pod \"aws-ebs-csi-driver-node-pnp5z\" (UID: \"44849783-4c3d-4537-9559-5c5d79e76cb4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pnp5z" Sep 18 08:07:11.958644 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.958346 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/977770b5-c53e-4c76-8946-e76d0663f9fb-etc-sysctl-conf\") pod \"tuned-hsz4j\" (UID: \"977770b5-c53e-4c76-8946-e76d0663f9fb\") " pod="openshift-cluster-node-tuning-operator/tuned-hsz4j" Sep 18 08:07:11.958644 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.958364 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/459b617e-1505-4bf6-9ee4-23d57ea13ddb-hosts-file\") pod \"node-resolver-jh2mg\" (UID: \"459b617e-1505-4bf6-9ee4-23d57ea13ddb\") " pod="openshift-dns/node-resolver-jh2mg" Sep 18 08:07:11.958644 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.958362 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9ffad063-9ddb-4986-ab43-8931a4288d24-etc-kubernetes\") pod \"multus-gjb6q\" (UID: \"9ffad063-9ddb-4986-ab43-8931a4288d24\") " pod="openshift-multus/multus-gjb6q" Sep 18 08:07:11.958644 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.958398 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9ffad063-9ddb-4986-ab43-8931a4288d24-etc-kubernetes\") pod \"multus-gjb6q\" (UID: \"9ffad063-9ddb-4986-ab43-8931a4288d24\") " pod="openshift-multus/multus-gjb6q" Sep 18 08:07:11.959289 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.958432 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/44849783-4c3d-4537-9559-5c5d79e76cb4-sys-fs\") pod \"aws-ebs-csi-driver-node-pnp5z\" (UID: \"44849783-4c3d-4537-9559-5c5d79e76cb4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pnp5z" Sep 18 08:07:11.959289 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:07:11.958299 2585 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 08:07:11.959289 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:07:11.958659 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d257247-8dae-4dce-9c31-62cf736b2b9f-original-pull-secret podName:8d257247-8dae-4dce-9c31-62cf736b2b9f nodeName:}" failed. No retries permitted until 2026-09-18 08:07:12.458642077 +0000 UTC m=+4.728342001 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8d257247-8dae-4dce-9c31-62cf736b2b9f-original-pull-secret") pod "global-pull-secret-syncer-6rnbm" (UID: "8d257247-8dae-4dce-9c31-62cf736b2b9f") : object "kube-system"/"original-pull-secret" not registered Sep 18 08:07:11.959289 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.958720 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c0aaaa41-bdef-4c6a-a828-18de65269b1a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dn4s9\" (UID: \"c0aaaa41-bdef-4c6a-a828-18de65269b1a\") " pod="openshift-multus/multus-additional-cni-plugins-dn4s9" Sep 18 08:07:11.959289 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.958730 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c0aaaa41-bdef-4c6a-a828-18de65269b1a-cni-binary-copy\") pod \"multus-additional-cni-plugins-dn4s9\" (UID: \"c0aaaa41-bdef-4c6a-a828-18de65269b1a\") " pod="openshift-multus/multus-additional-cni-plugins-dn4s9" Sep 18 08:07:11.959289 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.958749 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9ffad063-9ddb-4986-ab43-8931a4288d24-multus-cni-dir\") pod \"multus-gjb6q\" (UID: \"9ffad063-9ddb-4986-ab43-8931a4288d24\") " pod="openshift-multus/multus-gjb6q" Sep 18 08:07:11.959289 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.958773 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9ffad063-9ddb-4986-ab43-8931a4288d24-host-run-netns\") pod \"multus-gjb6q\" (UID: \"9ffad063-9ddb-4986-ab43-8931a4288d24\") " pod="openshift-multus/multus-gjb6q" Sep 18 08:07:11.959289 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.958788 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9ffad063-9ddb-4986-ab43-8931a4288d24-host-var-lib-kubelet\") pod \"multus-gjb6q\" (UID: \"9ffad063-9ddb-4986-ab43-8931a4288d24\") " pod="openshift-multus/multus-gjb6q" Sep 18 08:07:11.959289 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.958814 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/459b617e-1505-4bf6-9ee4-23d57ea13ddb-tmp-dir\") pod \"node-resolver-jh2mg\" (UID: \"459b617e-1505-4bf6-9ee4-23d57ea13ddb\") " pod="openshift-dns/node-resolver-jh2mg" Sep 18 08:07:11.959289 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.958830 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mn2b7\" (UniqueName: \"kubernetes.io/projected/44849783-4c3d-4537-9559-5c5d79e76cb4-kube-api-access-mn2b7\") pod \"aws-ebs-csi-driver-node-pnp5z\" (UID: \"44849783-4c3d-4537-9559-5c5d79e76cb4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pnp5z" Sep 18 08:07:11.959289 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.958834 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c0aaaa41-bdef-4c6a-a828-18de65269b1a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dn4s9\" (UID: \"c0aaaa41-bdef-4c6a-a828-18de65269b1a\") " pod="openshift-multus/multus-additional-cni-plugins-dn4s9" Sep 18 08:07:11.959289 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.958867 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/977770b5-c53e-4c76-8946-e76d0663f9fb-var-lib-kubelet\") pod \"tuned-hsz4j\" (UID: \"977770b5-c53e-4c76-8946-e76d0663f9fb\") " pod="openshift-cluster-node-tuning-operator/tuned-hsz4j" Sep 18 08:07:11.959289 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.958893 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9ffad063-9ddb-4986-ab43-8931a4288d24-host-run-netns\") pod \"multus-gjb6q\" (UID: \"9ffad063-9ddb-4986-ab43-8931a4288d24\") " pod="openshift-multus/multus-gjb6q" Sep 18 08:07:11.959289 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.958926 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9ffad063-9ddb-4986-ab43-8931a4288d24-system-cni-dir\") pod \"multus-gjb6q\" (UID: \"9ffad063-9ddb-4986-ab43-8931a4288d24\") " pod="openshift-multus/multus-gjb6q" Sep 18 08:07:11.959289 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.958951 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dmf74\" (UniqueName: \"kubernetes.io/projected/459b617e-1505-4bf6-9ee4-23d57ea13ddb-kube-api-access-dmf74\") pod \"node-resolver-jh2mg\" (UID: \"459b617e-1505-4bf6-9ee4-23d57ea13ddb\") " pod="openshift-dns/node-resolver-jh2mg" Sep 18 08:07:11.959289 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.958968 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3f760b01-3480-42e1-989d-4b35132437aa-serviceca\") pod \"node-ca-nb4q9\" (UID: \"3f760b01-3480-42e1-989d-4b35132437aa\") " pod="openshift-image-registry/node-ca-nb4q9" Sep 18 08:07:11.959289 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.959000 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a56b7fed-7af6-4ed5-962d-9bd3f342cd2b-ovn-node-metrics-cert\") pod \"ovnkube-node-9kn9p\" (UID: \"a56b7fed-7af6-4ed5-962d-9bd3f342cd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kn9p" Sep 18 08:07:11.959859 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.959018 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9ffad063-9ddb-4986-ab43-8931a4288d24-host-run-k8s-cni-cncf-io\") pod \"multus-gjb6q\" (UID: \"9ffad063-9ddb-4986-ab43-8931a4288d24\") " pod="openshift-multus/multus-gjb6q" Sep 18 08:07:11.959859 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.959042 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/44849783-4c3d-4537-9559-5c5d79e76cb4-registration-dir\") pod \"aws-ebs-csi-driver-node-pnp5z\" (UID: \"44849783-4c3d-4537-9559-5c5d79e76cb4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pnp5z" Sep 18 08:07:11.959859 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.959058 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/977770b5-c53e-4c76-8946-e76d0663f9fb-etc-kubernetes\") pod \"tuned-hsz4j\" (UID: \"977770b5-c53e-4c76-8946-e76d0663f9fb\") " pod="openshift-cluster-node-tuning-operator/tuned-hsz4j" Sep 18 08:07:11.959859 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.959074 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/977770b5-c53e-4c76-8946-e76d0663f9fb-host\") pod \"tuned-hsz4j\" (UID: \"977770b5-c53e-4c76-8946-e76d0663f9fb\") " pod="openshift-cluster-node-tuning-operator/tuned-hsz4j" Sep 18 08:07:11.959859 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.959090 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kv5mq\" (UniqueName: \"kubernetes.io/projected/3f760b01-3480-42e1-989d-4b35132437aa-kube-api-access-kv5mq\") pod \"node-ca-nb4q9\" (UID: \"3f760b01-3480-42e1-989d-4b35132437aa\") " pod="openshift-image-registry/node-ca-nb4q9" Sep 18 08:07:11.959859 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.959073 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/459b617e-1505-4bf6-9ee4-23d57ea13ddb-tmp-dir\") pod \"node-resolver-jh2mg\" (UID: \"459b617e-1505-4bf6-9ee4-23d57ea13ddb\") " pod="openshift-dns/node-resolver-jh2mg" Sep 18 08:07:11.959859 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.959182 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a56b7fed-7af6-4ed5-962d-9bd3f342cd2b-host-cni-bin\") pod \"ovnkube-node-9kn9p\" (UID: \"a56b7fed-7af6-4ed5-962d-9bd3f342cd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kn9p" Sep 18 08:07:11.959859 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.959202 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3a7d7351-f419-4f97-a1fe-a490512e47ab-iptables-alerter-script\") pod \"iptables-alerter-wzhkw\" (UID: \"3a7d7351-f419-4f97-a1fe-a490512e47ab\") " pod="openshift-network-operator/iptables-alerter-wzhkw" Sep 18 08:07:11.959859 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.959222 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c0aaaa41-bdef-4c6a-a828-18de65269b1a-cnibin\") pod \"multus-additional-cni-plugins-dn4s9\" (UID: \"c0aaaa41-bdef-4c6a-a828-18de65269b1a\") " pod="openshift-multus/multus-additional-cni-plugins-dn4s9" Sep 18 08:07:11.959859 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.959239 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9ffad063-9ddb-4986-ab43-8931a4288d24-host-var-lib-cni-bin\") pod \"multus-gjb6q\" (UID: \"9ffad063-9ddb-4986-ab43-8931a4288d24\") " pod="openshift-multus/multus-gjb6q" Sep 18 08:07:11.959859 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.959256 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/977770b5-c53e-4c76-8946-e76d0663f9fb-etc-modprobe-d\") pod \"tuned-hsz4j\" (UID: \"977770b5-c53e-4c76-8946-e76d0663f9fb\") " pod="openshift-cluster-node-tuning-operator/tuned-hsz4j" Sep 18 08:07:11.959859 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.959273 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3a914598-1705-4865-9bbf-f7e2461c20f0-konnectivity-ca\") pod \"konnectivity-agent-dtq72\" (UID: \"3a914598-1705-4865-9bbf-f7e2461c20f0\") " pod="kube-system/konnectivity-agent-dtq72" Sep 18 08:07:11.959859 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.959289 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9ffad063-9ddb-4986-ab43-8931a4288d24-multus-cni-dir\") pod \"multus-gjb6q\" (UID: \"9ffad063-9ddb-4986-ab43-8931a4288d24\") " pod="openshift-multus/multus-gjb6q" Sep 18 08:07:11.959859 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.959303 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3f760b01-3480-42e1-989d-4b35132437aa-host\") pod \"node-ca-nb4q9\" (UID: \"3f760b01-3480-42e1-989d-4b35132437aa\") " pod="openshift-image-registry/node-ca-nb4q9" Sep 18 08:07:11.959859 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.959366 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9ffad063-9ddb-4986-ab43-8931a4288d24-system-cni-dir\") pod \"multus-gjb6q\" (UID: \"9ffad063-9ddb-4986-ab43-8931a4288d24\") " pod="openshift-multus/multus-gjb6q" Sep 18 08:07:11.959859 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.959510 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9ffad063-9ddb-4986-ab43-8931a4288d24-host-run-k8s-cni-cncf-io\") pod \"multus-gjb6q\" (UID: \"9ffad063-9ddb-4986-ab43-8931a4288d24\") " pod="openshift-multus/multus-gjb6q" Sep 18 08:07:11.959859 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.959554 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/44849783-4c3d-4537-9559-5c5d79e76cb4-registration-dir\") pod \"aws-ebs-csi-driver-node-pnp5z\" (UID: \"44849783-4c3d-4537-9559-5c5d79e76cb4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pnp5z" Sep 18 08:07:11.960442 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.959585 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a56b7fed-7af6-4ed5-962d-9bd3f342cd2b-run-ovn\") pod \"ovnkube-node-9kn9p\" (UID: \"a56b7fed-7af6-4ed5-962d-9bd3f342cd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kn9p" Sep 18 08:07:11.960442 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.959619 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a56b7fed-7af6-4ed5-962d-9bd3f342cd2b-node-log\") pod \"ovnkube-node-9kn9p\" (UID: \"a56b7fed-7af6-4ed5-962d-9bd3f342cd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kn9p" Sep 18 08:07:11.960442 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.959651 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9ffad063-9ddb-4986-ab43-8931a4288d24-multus-daemon-config\") pod \"multus-gjb6q\" (UID: \"9ffad063-9ddb-4986-ab43-8931a4288d24\") " pod="openshift-multus/multus-gjb6q" Sep 18 08:07:11.960442 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.959683 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c0aaaa41-bdef-4c6a-a828-18de65269b1a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dn4s9\" (UID: \"c0aaaa41-bdef-4c6a-a828-18de65269b1a\") " pod="openshift-multus/multus-additional-cni-plugins-dn4s9" Sep 18 08:07:11.960442 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.959701 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9ffad063-9ddb-4986-ab43-8931a4288d24-cni-binary-copy\") pod \"multus-gjb6q\" (UID: \"9ffad063-9ddb-4986-ab43-8931a4288d24\") " pod="openshift-multus/multus-gjb6q" Sep 18 08:07:11.960442 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.959725 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/977770b5-c53e-4c76-8946-e76d0663f9fb-sys\") pod \"tuned-hsz4j\" (UID: \"977770b5-c53e-4c76-8946-e76d0663f9fb\") " pod="openshift-cluster-node-tuning-operator/tuned-hsz4j" Sep 18 08:07:11.960442 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.959749 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a56b7fed-7af6-4ed5-962d-9bd3f342cd2b-host-cni-netd\") pod \"ovnkube-node-9kn9p\" (UID: \"a56b7fed-7af6-4ed5-962d-9bd3f342cd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kn9p" Sep 18 08:07:11.960442 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.959775 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3a7d7351-f419-4f97-a1fe-a490512e47ab-iptables-alerter-script\") pod \"iptables-alerter-wzhkw\" (UID: \"3a7d7351-f419-4f97-a1fe-a490512e47ab\") " pod="openshift-network-operator/iptables-alerter-wzhkw" Sep 18 08:07:11.960442 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.959801 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a56b7fed-7af6-4ed5-962d-9bd3f342cd2b-ovnkube-config\") pod \"ovnkube-node-9kn9p\" (UID: \"a56b7fed-7af6-4ed5-962d-9bd3f342cd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kn9p" Sep 18 08:07:11.960442 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.959829 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c0aaaa41-bdef-4c6a-a828-18de65269b1a-cnibin\") pod \"multus-additional-cni-plugins-dn4s9\" (UID: \"c0aaaa41-bdef-4c6a-a828-18de65269b1a\") " pod="openshift-multus/multus-additional-cni-plugins-dn4s9" Sep 18 08:07:11.960442 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.959899 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9ffad063-9ddb-4986-ab43-8931a4288d24-host-var-lib-cni-bin\") pod \"multus-gjb6q\" (UID: \"9ffad063-9ddb-4986-ab43-8931a4288d24\") " pod="openshift-multus/multus-gjb6q" Sep 18 08:07:11.960442 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.959256 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9ffad063-9ddb-4986-ab43-8931a4288d24-host-var-lib-kubelet\") pod \"multus-gjb6q\" (UID: \"9ffad063-9ddb-4986-ab43-8931a4288d24\") " pod="openshift-multus/multus-gjb6q" Sep 18 08:07:11.960442 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.960279 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c0aaaa41-bdef-4c6a-a828-18de65269b1a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dn4s9\" (UID: \"c0aaaa41-bdef-4c6a-a828-18de65269b1a\") " pod="openshift-multus/multus-additional-cni-plugins-dn4s9" Sep 18 08:07:11.960442 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.960354 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9ffad063-9ddb-4986-ab43-8931a4288d24-multus-daemon-config\") pod \"multus-gjb6q\" (UID: \"9ffad063-9ddb-4986-ab43-8931a4288d24\") " pod="openshift-multus/multus-gjb6q" Sep 18 08:07:11.960970 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.960594 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9ffad063-9ddb-4986-ab43-8931a4288d24-cni-binary-copy\") pod \"multus-gjb6q\" (UID: \"9ffad063-9ddb-4986-ab43-8931a4288d24\") " pod="openshift-multus/multus-gjb6q" Sep 18 08:07:11.966443 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:07:11.966421 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 08:07:11.966567 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:07:11.966449 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 08:07:11.966567 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:07:11.966461 2585 projected.go:196] Error preparing data for projected volume kube-api-access-h55b9 for pod openshift-network-diagnostics/network-check-target-qmmgl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 08:07:11.966567 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:07:11.966511 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/97cadd54-3234-4e3f-a2bf-c96b134566b1-kube-api-access-h55b9 podName:97cadd54-3234-4e3f-a2bf-c96b134566b1 nodeName:}" failed. No retries permitted until 2026-09-18 08:07:12.466497605 +0000 UTC m=+4.736197518 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-h55b9" (UniqueName: "kubernetes.io/projected/97cadd54-3234-4e3f-a2bf-c96b134566b1-kube-api-access-h55b9") pod "network-check-target-qmmgl" (UID: "97cadd54-3234-4e3f-a2bf-c96b134566b1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 08:07:11.966835 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.966815 2585 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 18 08:07:11.970887 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.970865 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2ngpn\" (UniqueName: \"kubernetes.io/projected/3a7d7351-f419-4f97-a1fe-a490512e47ab-kube-api-access-2ngpn\") pod \"iptables-alerter-wzhkw\" (UID: \"3a7d7351-f419-4f97-a1fe-a490512e47ab\") " pod="openshift-network-operator/iptables-alerter-wzhkw" Sep 18 08:07:11.970956 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.970913 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kr5cb\" (UniqueName: \"kubernetes.io/projected/b6e0d1e7-a182-4ac0-a484-f174f64ca021-kube-api-access-kr5cb\") pod \"network-metrics-daemon-9vz5k\" (UID: \"b6e0d1e7-a182-4ac0-a484-f174f64ca021\") " pod="openshift-multus/network-metrics-daemon-9vz5k" Sep 18 08:07:11.971151 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.971124 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-crw8f\" (UniqueName: \"kubernetes.io/projected/c0aaaa41-bdef-4c6a-a828-18de65269b1a-kube-api-access-crw8f\") pod \"multus-additional-cni-plugins-dn4s9\" (UID: \"c0aaaa41-bdef-4c6a-a828-18de65269b1a\") " pod="openshift-multus/multus-additional-cni-plugins-dn4s9" Sep 18 08:07:11.971340 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.971319 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mn2b7\" (UniqueName: \"kubernetes.io/projected/44849783-4c3d-4537-9559-5c5d79e76cb4-kube-api-access-mn2b7\") pod \"aws-ebs-csi-driver-node-pnp5z\" (UID: \"44849783-4c3d-4537-9559-5c5d79e76cb4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pnp5z" Sep 18 08:07:11.971733 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.971713 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dmf74\" (UniqueName: \"kubernetes.io/projected/459b617e-1505-4bf6-9ee4-23d57ea13ddb-kube-api-access-dmf74\") pod \"node-resolver-jh2mg\" (UID: \"459b617e-1505-4bf6-9ee4-23d57ea13ddb\") " pod="openshift-dns/node-resolver-jh2mg" Sep 18 08:07:11.971811 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:11.971798 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d24r9\" (UniqueName: \"kubernetes.io/projected/9ffad063-9ddb-4986-ab43-8931a4288d24-kube-api-access-d24r9\") pod \"multus-gjb6q\" (UID: \"9ffad063-9ddb-4986-ab43-8931a4288d24\") " pod="openshift-multus/multus-gjb6q" Sep 18 08:07:12.060380 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:12.060319 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a56b7fed-7af6-4ed5-962d-9bd3f342cd2b-systemd-units\") pod \"ovnkube-node-9kn9p\" (UID: \"a56b7fed-7af6-4ed5-962d-9bd3f342cd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kn9p" Sep 18 08:07:12.060493 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:12.060381 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/977770b5-c53e-4c76-8946-e76d0663f9fb-run\") pod \"tuned-hsz4j\" (UID: \"977770b5-c53e-4c76-8946-e76d0663f9fb\") " pod="openshift-cluster-node-tuning-operator/tuned-hsz4j" Sep 18 08:07:12.060493 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:12.060406 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a56b7fed-7af6-4ed5-962d-9bd3f342cd2b-var-lib-openvswitch\") pod \"ovnkube-node-9kn9p\" (UID: \"a56b7fed-7af6-4ed5-962d-9bd3f342cd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kn9p" Sep 18 08:07:12.060493 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:12.060429 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/977770b5-c53e-4c76-8946-e76d0663f9fb-etc-systemd\") pod \"tuned-hsz4j\" (UID: \"977770b5-c53e-4c76-8946-e76d0663f9fb\") " pod="openshift-cluster-node-tuning-operator/tuned-hsz4j" Sep 18 08:07:12.060493 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:12.060437 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a56b7fed-7af6-4ed5-962d-9bd3f342cd2b-systemd-units\") pod \"ovnkube-node-9kn9p\" (UID: \"a56b7fed-7af6-4ed5-962d-9bd3f342cd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kn9p" Sep 18 08:07:12.060493 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:12.060453 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/977770b5-c53e-4c76-8946-e76d0663f9fb-etc-tuned\") pod \"tuned-hsz4j\" (UID: \"977770b5-c53e-4c76-8946-e76d0663f9fb\") " pod="openshift-cluster-node-tuning-operator/tuned-hsz4j" Sep 18 08:07:12.060712 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:12.060493 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a56b7fed-7af6-4ed5-962d-9bd3f342cd2b-var-lib-openvswitch\") pod \"ovnkube-node-9kn9p\" (UID: \"a56b7fed-7af6-4ed5-962d-9bd3f342cd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kn9p" Sep 18 08:07:12.060712 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:12.060523 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g9588\" (UniqueName: \"kubernetes.io/projected/977770b5-c53e-4c76-8946-e76d0663f9fb-kube-api-access-g9588\") pod \"tuned-hsz4j\" (UID: \"977770b5-c53e-4c76-8946-e76d0663f9fb\") " pod="openshift-cluster-node-tuning-operator/tuned-hsz4j" Sep 18 08:07:12.060712 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:12.060531 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/977770b5-c53e-4c76-8946-e76d0663f9fb-etc-systemd\") pod \"tuned-hsz4j\" (UID: \"977770b5-c53e-4c76-8946-e76d0663f9fb\") " pod="openshift-cluster-node-tuning-operator/tuned-hsz4j" Sep 18 08:07:12.060712 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:12.060549 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a56b7fed-7af6-4ed5-962d-9bd3f342cd2b-host-run-netns\") pod \"ovnkube-node-9kn9p\" (UID: \"a56b7fed-7af6-4ed5-962d-9bd3f342cd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kn9p" Sep 18 08:07:12.060712 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:12.060558 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/977770b5-c53e-4c76-8946-e76d0663f9fb-run\") pod \"tuned-hsz4j\" (UID: \"977770b5-c53e-4c76-8946-e76d0663f9fb\") " pod="openshift-cluster-node-tuning-operator/tuned-hsz4j" Sep 18 08:07:12.060712 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:12.060590 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a56b7fed-7af6-4ed5-962d-9bd3f342cd2b-host-run-netns\") pod \"ovnkube-node-9kn9p\" (UID: \"a56b7fed-7af6-4ed5-962d-9bd3f342cd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kn9p" Sep 18 08:07:12.060712 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:12.060624 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/977770b5-c53e-4c76-8946-e76d0663f9fb-etc-sysconfig\") pod \"tuned-hsz4j\" (UID: \"977770b5-c53e-4c76-8946-e76d0663f9fb\") " pod="openshift-cluster-node-tuning-operator/tuned-hsz4j" Sep 18 08:07:12.060712 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:12.060645 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a56b7fed-7af6-4ed5-962d-9bd3f342cd2b-etc-openvswitch\") pod \"ovnkube-node-9kn9p\" (UID: \"a56b7fed-7af6-4ed5-962d-9bd3f342cd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kn9p" Sep 18 08:07:12.060712 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:12.060663 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/977770b5-c53e-4c76-8946-e76d0663f9fb-etc-sysctl-d\") pod \"tuned-hsz4j\" (UID: \"977770b5-c53e-4c76-8946-e76d0663f9fb\") " pod="openshift-cluster-node-tuning-operator/tuned-hsz4j" Sep 18 08:07:12.060712 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:12.060702 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/977770b5-c53e-4c76-8946-e76d0663f9fb-lib-modules\") pod \"tuned-hsz4j\" (UID: \"977770b5-c53e-4c76-8946-e76d0663f9fb\") " pod="openshift-cluster-node-tuning-operator/tuned-hsz4j" Sep 18 08:07:12.061229 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:12.060722 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a56b7fed-7af6-4ed5-962d-9bd3f342cd2b-etc-openvswitch\") pod \"ovnkube-node-9kn9p\" (UID: \"a56b7fed-7af6-4ed5-962d-9bd3f342cd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kn9p" Sep 18 08:07:12.061229 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:12.060726 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a56b7fed-7af6-4ed5-962d-9bd3f342cd2b-env-overrides\") pod \"ovnkube-node-9kn9p\" (UID: \"a56b7fed-7af6-4ed5-962d-9bd3f342cd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kn9p" Sep 18 08:07:12.061229 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:12.060727 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/977770b5-c53e-4c76-8946-e76d0663f9fb-etc-sysconfig\") pod \"tuned-hsz4j\" (UID: \"977770b5-c53e-4c76-8946-e76d0663f9fb\") " pod="openshift-cluster-node-tuning-operator/tuned-hsz4j" Sep 18 08:07:12.061229 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:12.060758 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a56b7fed-7af6-4ed5-962d-9bd3f342cd2b-run-systemd\") pod \"ovnkube-node-9kn9p\" (UID: \"a56b7fed-7af6-4ed5-962d-9bd3f342cd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kn9p" Sep 18 08:07:12.061229 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:12.060787 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/977770b5-c53e-4c76-8946-e76d0663f9fb-tmp\") pod \"tuned-hsz4j\" (UID: \"977770b5-c53e-4c76-8946-e76d0663f9fb\") " pod="openshift-cluster-node-tuning-operator/tuned-hsz4j" Sep 18 08:07:12.061229 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:12.060811 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3a914598-1705-4865-9bbf-f7e2461c20f0-agent-certs\") pod \"konnectivity-agent-dtq72\" (UID: \"3a914598-1705-4865-9bbf-f7e2461c20f0\") " pod="kube-system/konnectivity-agent-dtq72" Sep 18 08:07:12.061229 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:12.060824 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/977770b5-c53e-4c76-8946-e76d0663f9fb-etc-sysctl-d\") pod \"tuned-hsz4j\" (UID: \"977770b5-c53e-4c76-8946-e76d0663f9fb\") " pod="openshift-cluster-node-tuning-operator/tuned-hsz4j" Sep 18 08:07:12.061229 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:12.060834 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a56b7fed-7af6-4ed5-962d-9bd3f342cd2b-log-socket\") pod \"ovnkube-node-9kn9p\" (UID: \"a56b7fed-7af6-4ed5-962d-9bd3f342cd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kn9p" Sep 18 08:07:12.061229 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:12.060826 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/977770b5-c53e-4c76-8946-e76d0663f9fb-lib-modules\") pod \"tuned-hsz4j\" (UID: \"977770b5-c53e-4c76-8946-e76d0663f9fb\") " pod="openshift-cluster-node-tuning-operator/tuned-hsz4j" Sep 18 08:07:12.061229 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:12.060890 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a56b7fed-7af6-4ed5-962d-9bd3f342cd2b-host-run-ovn-kubernetes\") pod \"ovnkube-node-9kn9p\" (UID: \"a56b7fed-7af6-4ed5-962d-9bd3f342cd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kn9p" Sep 18 08:07:12.061229 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:12.060896 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a56b7fed-7af6-4ed5-962d-9bd3f342cd2b-log-socket\") pod \"ovnkube-node-9kn9p\" (UID: \"a56b7fed-7af6-4ed5-962d-9bd3f342cd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kn9p" Sep 18 08:07:12.061229 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:12.060830 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a56b7fed-7af6-4ed5-962d-9bd3f342cd2b-run-systemd\") pod \"ovnkube-node-9kn9p\" (UID: \"a56b7fed-7af6-4ed5-962d-9bd3f342cd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kn9p" Sep 18 08:07:12.061229 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:12.060915 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a56b7fed-7af6-4ed5-962d-9bd3f342cd2b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9kn9p\" (UID: \"a56b7fed-7af6-4ed5-962d-9bd3f342cd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kn9p" Sep 18 08:07:12.061229 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:12.060954 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a56b7fed-7af6-4ed5-962d-9bd3f342cd2b-host-kubelet\") pod \"ovnkube-node-9kn9p\" (UID: \"a56b7fed-7af6-4ed5-962d-9bd3f342cd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kn9p" Sep 18 08:07:12.061229 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:12.060960 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a56b7fed-7af6-4ed5-962d-9bd3f342cd2b-host-run-ovn-kubernetes\") pod \"ovnkube-node-9kn9p\" (UID: \"a56b7fed-7af6-4ed5-962d-9bd3f342cd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kn9p" Sep 18 08:07:12.061229 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:12.060977 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a56b7fed-7af6-4ed5-962d-9bd3f342cd2b-host-slash\") pod \"ovnkube-node-9kn9p\" (UID: \"a56b7fed-7af6-4ed5-962d-9bd3f342cd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kn9p" Sep 18 08:07:12.061229 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:12.060999 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a56b7fed-7af6-4ed5-962d-9bd3f342cd2b-run-openvswitch\") pod \"ovnkube-node-9kn9p\" (UID: \"a56b7fed-7af6-4ed5-962d-9bd3f342cd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kn9p" Sep 18 08:07:12.062028 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:12.061006 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a56b7fed-7af6-4ed5-962d-9bd3f342cd2b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9kn9p\" (UID: \"a56b7fed-7af6-4ed5-962d-9bd3f342cd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kn9p" Sep 18 08:07:12.062028 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:12.061021 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/977770b5-c53e-4c76-8946-e76d0663f9fb-etc-sysctl-conf\") pod \"tuned-hsz4j\" (UID: \"977770b5-c53e-4c76-8946-e76d0663f9fb\") " pod="openshift-cluster-node-tuning-operator/tuned-hsz4j" Sep 18 08:07:12.062028 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:12.061050 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/977770b5-c53e-4c76-8946-e76d0663f9fb-var-lib-kubelet\") pod \"tuned-hsz4j\" (UID: \"977770b5-c53e-4c76-8946-e76d0663f9fb\") " pod="openshift-cluster-node-tuning-operator/tuned-hsz4j" Sep 18 08:07:12.062028 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:12.061055 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a56b7fed-7af6-4ed5-962d-9bd3f342cd2b-host-slash\") pod \"ovnkube-node-9kn9p\" (UID: \"a56b7fed-7af6-4ed5-962d-9bd3f342cd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kn9p" Sep 18 08:07:12.062028 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:12.061075 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3f760b01-3480-42e1-989d-4b35132437aa-serviceca\") pod \"node-ca-nb4q9\" (UID: \"3f760b01-3480-42e1-989d-4b35132437aa\") " pod="openshift-image-registry/node-ca-nb4q9" Sep 18 08:07:12.062028 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:12.061097 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a56b7fed-7af6-4ed5-962d-9bd3f342cd2b-host-kubelet\") pod \"ovnkube-node-9kn9p\" (UID: \"a56b7fed-7af6-4ed5-962d-9bd3f342cd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kn9p" Sep 18 08:07:12.062028 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:12.061099 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a56b7fed-7af6-4ed5-962d-9bd3f342cd2b-ovn-node-metrics-cert\") pod \"ovnkube-node-9kn9p\" (UID: \"a56b7fed-7af6-4ed5-962d-9bd3f342cd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kn9p" Sep 18 08:07:12.062028 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:12.061131 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/977770b5-c53e-4c76-8946-e76d0663f9fb-etc-kubernetes\") pod \"tuned-hsz4j\" (UID: \"977770b5-c53e-4c76-8946-e76d0663f9fb\") " pod="openshift-cluster-node-tuning-operator/tuned-hsz4j" Sep 18 08:07:12.062028 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:12.061155 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/977770b5-c53e-4c76-8946-e76d0663f9fb-host\") pod \"tuned-hsz4j\" (UID: \"977770b5-c53e-4c76-8946-e76d0663f9fb\") " pod="openshift-cluster-node-tuning-operator/tuned-hsz4j" Sep 18 08:07:12.062028 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:12.061178 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kv5mq\" (UniqueName: \"kubernetes.io/projected/3f760b01-3480-42e1-989d-4b35132437aa-kube-api-access-kv5mq\") pod \"node-ca-nb4q9\" (UID: \"3f760b01-3480-42e1-989d-4b35132437aa\") " pod="openshift-image-registry/node-ca-nb4q9" Sep 18 08:07:12.062028 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:12.061201 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a56b7fed-7af6-4ed5-962d-9bd3f342cd2b-host-cni-bin\") pod \"ovnkube-node-9kn9p\" (UID: \"a56b7fed-7af6-4ed5-962d-9bd3f342cd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kn9p" Sep 18 08:07:12.062028 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:12.061227 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/977770b5-c53e-4c76-8946-e76d0663f9fb-etc-modprobe-d\") pod \"tuned-hsz4j\" (UID: \"977770b5-c53e-4c76-8946-e76d0663f9fb\") " pod="openshift-cluster-node-tuning-operator/tuned-hsz4j" Sep 18 08:07:12.062028 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:12.061235 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a56b7fed-7af6-4ed5-962d-9bd3f342cd2b-env-overrides\") pod \"ovnkube-node-9kn9p\" (UID: \"a56b7fed-7af6-4ed5-962d-9bd3f342cd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kn9p" Sep 18 08:07:12.062028 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:12.061249 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3a914598-1705-4865-9bbf-f7e2461c20f0-konnectivity-ca\") pod \"konnectivity-agent-dtq72\" (UID: \"3a914598-1705-4865-9bbf-f7e2461c20f0\") " pod="kube-system/konnectivity-agent-dtq72" Sep 18 08:07:12.062028 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:12.061270 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3f760b01-3480-42e1-989d-4b35132437aa-host\") pod \"node-ca-nb4q9\" (UID: \"3f760b01-3480-42e1-989d-4b35132437aa\") " pod="openshift-image-registry/node-ca-nb4q9" Sep 18 08:07:12.062028 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:12.061293 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a56b7fed-7af6-4ed5-962d-9bd3f342cd2b-run-ovn\") pod \"ovnkube-node-9kn9p\" (UID: \"a56b7fed-7af6-4ed5-962d-9bd3f342cd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kn9p" Sep 18 08:07:12.062028 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:12.061314 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a56b7fed-7af6-4ed5-962d-9bd3f342cd2b-node-log\") pod \"ovnkube-node-9kn9p\" (UID: \"a56b7fed-7af6-4ed5-962d-9bd3f342cd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kn9p" Sep 18 08:07:12.062028 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:12.061339 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/977770b5-c53e-4c76-8946-e76d0663f9fb-sys\") pod \"tuned-hsz4j\" (UID: \"977770b5-c53e-4c76-8946-e76d0663f9fb\") " pod="openshift-cluster-node-tuning-operator/tuned-hsz4j" Sep 18 08:07:12.063097 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:12.061361 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a56b7fed-7af6-4ed5-962d-9bd3f342cd2b-host-cni-netd\") pod \"ovnkube-node-9kn9p\" (UID: \"a56b7fed-7af6-4ed5-962d-9bd3f342cd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kn9p" Sep 18 08:07:12.063097 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:12.061383 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a56b7fed-7af6-4ed5-962d-9bd3f342cd2b-ovnkube-config\") pod \"ovnkube-node-9kn9p\" (UID: \"a56b7fed-7af6-4ed5-962d-9bd3f342cd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kn9p" Sep 18 08:07:12.063097 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:12.061405 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a56b7fed-7af6-4ed5-962d-9bd3f342cd2b-ovnkube-script-lib\") pod \"ovnkube-node-9kn9p\" (UID: \"a56b7fed-7af6-4ed5-962d-9bd3f342cd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kn9p" Sep 18 08:07:12.063097 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:12.061429 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rnvs4\" (UniqueName: \"kubernetes.io/projected/a56b7fed-7af6-4ed5-962d-9bd3f342cd2b-kube-api-access-rnvs4\") pod \"ovnkube-node-9kn9p\" (UID: \"a56b7fed-7af6-4ed5-962d-9bd3f342cd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kn9p" Sep 18 08:07:12.063097 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:12.061472 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a56b7fed-7af6-4ed5-962d-9bd3f342cd2b-run-openvswitch\") pod \"ovnkube-node-9kn9p\" (UID: \"a56b7fed-7af6-4ed5-962d-9bd3f342cd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kn9p" Sep 18 08:07:12.063097 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:12.061478 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/977770b5-c53e-4c76-8946-e76d0663f9fb-var-lib-kubelet\") pod \"tuned-hsz4j\" (UID: \"977770b5-c53e-4c76-8946-e76d0663f9fb\") " pod="openshift-cluster-node-tuning-operator/tuned-hsz4j" Sep 18 08:07:12.063097 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:12.061531 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3f760b01-3480-42e1-989d-4b35132437aa-host\") pod \"node-ca-nb4q9\" (UID: \"3f760b01-3480-42e1-989d-4b35132437aa\") " pod="openshift-image-registry/node-ca-nb4q9" Sep 18 08:07:12.063097 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:12.061545 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/977770b5-c53e-4c76-8946-e76d0663f9fb-sys\") pod \"tuned-hsz4j\" (UID: \"977770b5-c53e-4c76-8946-e76d0663f9fb\") " pod="openshift-cluster-node-tuning-operator/tuned-hsz4j" Sep 18 08:07:12.063097 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:12.061578 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/977770b5-c53e-4c76-8946-e76d0663f9fb-etc-kubernetes\") pod \"tuned-hsz4j\" (UID: \"977770b5-c53e-4c76-8946-e76d0663f9fb\") " pod="openshift-cluster-node-tuning-operator/tuned-hsz4j" Sep 18 08:07:12.063097 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:12.061623 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a56b7fed-7af6-4ed5-962d-9bd3f342cd2b-host-cni-bin\") pod \"ovnkube-node-9kn9p\" (UID: \"a56b7fed-7af6-4ed5-962d-9bd3f342cd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kn9p" Sep 18 08:07:12.063097 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:12.061662 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/977770b5-c53e-4c76-8946-e76d0663f9fb-etc-sysctl-conf\") pod \"tuned-hsz4j\" (UID: \"977770b5-c53e-4c76-8946-e76d0663f9fb\") " pod="openshift-cluster-node-tuning-operator/tuned-hsz4j" Sep 18 08:07:12.063097 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:12.061715 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a56b7fed-7af6-4ed5-962d-9bd3f342cd2b-node-log\") pod \"ovnkube-node-9kn9p\" (UID: \"a56b7fed-7af6-4ed5-962d-9bd3f342cd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kn9p" Sep 18 08:07:12.063097 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:12.061749 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a56b7fed-7af6-4ed5-962d-9bd3f342cd2b-host-cni-netd\") pod \"ovnkube-node-9kn9p\" (UID: \"a56b7fed-7af6-4ed5-962d-9bd3f342cd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kn9p" Sep 18 08:07:12.063097 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:12.061779 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/977770b5-c53e-4c76-8946-e76d0663f9fb-host\") pod \"tuned-hsz4j\" (UID: \"977770b5-c53e-4c76-8946-e76d0663f9fb\") " pod="openshift-cluster-node-tuning-operator/tuned-hsz4j" Sep 18 08:07:12.063097 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:12.061803 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a56b7fed-7af6-4ed5-962d-9bd3f342cd2b-run-ovn\") pod \"ovnkube-node-9kn9p\" (UID: \"a56b7fed-7af6-4ed5-962d-9bd3f342cd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kn9p" Sep 18 08:07:12.063097 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:12.062183 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a56b7fed-7af6-4ed5-962d-9bd3f342cd2b-ovnkube-script-lib\") pod \"ovnkube-node-9kn9p\" (UID: \"a56b7fed-7af6-4ed5-962d-9bd3f342cd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kn9p" Sep 18 08:07:12.063097 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:12.062306 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a56b7fed-7af6-4ed5-962d-9bd3f342cd2b-ovnkube-config\") pod \"ovnkube-node-9kn9p\" (UID: \"a56b7fed-7af6-4ed5-962d-9bd3f342cd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kn9p" Sep 18 08:07:12.063097 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:12.062395 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/977770b5-c53e-4c76-8946-e76d0663f9fb-etc-modprobe-d\") pod \"tuned-hsz4j\" (UID: \"977770b5-c53e-4c76-8946-e76d0663f9fb\") " pod="openshift-cluster-node-tuning-operator/tuned-hsz4j" Sep 18 08:07:12.063978 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:12.062445 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3f760b01-3480-42e1-989d-4b35132437aa-serviceca\") pod \"node-ca-nb4q9\" (UID: \"3f760b01-3480-42e1-989d-4b35132437aa\") " pod="openshift-image-registry/node-ca-nb4q9" Sep 18 08:07:12.063978 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:12.062514 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3a914598-1705-4865-9bbf-f7e2461c20f0-konnectivity-ca\") pod \"konnectivity-agent-dtq72\" (UID: \"3a914598-1705-4865-9bbf-f7e2461c20f0\") " pod="kube-system/konnectivity-agent-dtq72" Sep 18 08:07:12.063978 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:12.063495 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/977770b5-c53e-4c76-8946-e76d0663f9fb-tmp\") pod \"tuned-hsz4j\" (UID: \"977770b5-c53e-4c76-8946-e76d0663f9fb\") " pod="openshift-cluster-node-tuning-operator/tuned-hsz4j" Sep 18 08:07:12.063978 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:12.063508 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3a914598-1705-4865-9bbf-f7e2461c20f0-agent-certs\") pod \"konnectivity-agent-dtq72\" (UID: \"3a914598-1705-4865-9bbf-f7e2461c20f0\") " pod="kube-system/konnectivity-agent-dtq72" Sep 18 08:07:12.064174 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:12.064117 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/977770b5-c53e-4c76-8946-e76d0663f9fb-etc-tuned\") pod \"tuned-hsz4j\" (UID: \"977770b5-c53e-4c76-8946-e76d0663f9fb\") " pod="openshift-cluster-node-tuning-operator/tuned-hsz4j" Sep 18 08:07:12.064572 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:12.064550 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a56b7fed-7af6-4ed5-962d-9bd3f342cd2b-ovn-node-metrics-cert\") pod \"ovnkube-node-9kn9p\" (UID: \"a56b7fed-7af6-4ed5-962d-9bd3f342cd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kn9p" Sep 18 08:07:12.069300 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:12.069276 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rnvs4\" (UniqueName: \"kubernetes.io/projected/a56b7fed-7af6-4ed5-962d-9bd3f342cd2b-kube-api-access-rnvs4\") pod \"ovnkube-node-9kn9p\" (UID: \"a56b7fed-7af6-4ed5-962d-9bd3f342cd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kn9p" Sep 18 08:07:12.069615 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:12.069599 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g9588\" (UniqueName: \"kubernetes.io/projected/977770b5-c53e-4c76-8946-e76d0663f9fb-kube-api-access-g9588\") pod \"tuned-hsz4j\" (UID: \"977770b5-c53e-4c76-8946-e76d0663f9fb\") " pod="openshift-cluster-node-tuning-operator/tuned-hsz4j" Sep 18 08:07:12.069691 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:12.069648 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kv5mq\" (UniqueName: \"kubernetes.io/projected/3f760b01-3480-42e1-989d-4b35132437aa-kube-api-access-kv5mq\") pod \"node-ca-nb4q9\" (UID: \"3f760b01-3480-42e1-989d-4b35132437aa\") " pod="openshift-image-registry/node-ca-nb4q9" Sep 18 08:07:12.144099 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:12.144073 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-wzhkw" Sep 18 08:07:12.151199 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:12.151163 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-jh2mg" Sep 18 08:07:12.159834 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:12.159817 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pnp5z" Sep 18 08:07:12.168579 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:12.168562 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-dn4s9" Sep 18 08:07:12.173440 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:12.173425 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-gjb6q" Sep 18 08:07:12.179543 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:12.179525 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-9kn9p" Sep 18 08:07:12.185479 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:12.185462 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-hsz4j" Sep 18 08:07:12.192428 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:12.192406 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-dtq72" Sep 18 08:07:12.197901 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:12.197885 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-nb4q9" Sep 18 08:07:12.464615 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:12.464548 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8d257247-8dae-4dce-9c31-62cf736b2b9f-original-pull-secret\") pod \"global-pull-secret-syncer-6rnbm\" (UID: \"8d257247-8dae-4dce-9c31-62cf736b2b9f\") " pod="kube-system/global-pull-secret-syncer-6rnbm" Sep 18 08:07:12.464615 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:12.464609 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b6e0d1e7-a182-4ac0-a484-f174f64ca021-metrics-certs\") pod \"network-metrics-daemon-9vz5k\" (UID: \"b6e0d1e7-a182-4ac0-a484-f174f64ca021\") " pod="openshift-multus/network-metrics-daemon-9vz5k" Sep 18 08:07:12.464824 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:07:12.464683 2585 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 08:07:12.464824 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:07:12.464710 2585 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 08:07:12.464824 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:07:12.464787 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6e0d1e7-a182-4ac0-a484-f174f64ca021-metrics-certs podName:b6e0d1e7-a182-4ac0-a484-f174f64ca021 nodeName:}" failed. No retries permitted until 2026-09-18 08:07:13.464768715 +0000 UTC m=+5.734468637 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b6e0d1e7-a182-4ac0-a484-f174f64ca021-metrics-certs") pod "network-metrics-daemon-9vz5k" (UID: "b6e0d1e7-a182-4ac0-a484-f174f64ca021") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 08:07:12.464824 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:07:12.464807 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d257247-8dae-4dce-9c31-62cf736b2b9f-original-pull-secret podName:8d257247-8dae-4dce-9c31-62cf736b2b9f nodeName:}" failed. No retries permitted until 2026-09-18 08:07:13.464796884 +0000 UTC m=+5.734496797 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8d257247-8dae-4dce-9c31-62cf736b2b9f-original-pull-secret") pod "global-pull-secret-syncer-6rnbm" (UID: "8d257247-8dae-4dce-9c31-62cf736b2b9f") : object "kube-system"/"original-pull-secret" not registered Sep 18 08:07:12.565897 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:12.565868 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h55b9\" (UniqueName: \"kubernetes.io/projected/97cadd54-3234-4e3f-a2bf-c96b134566b1-kube-api-access-h55b9\") pod \"network-check-target-qmmgl\" (UID: \"97cadd54-3234-4e3f-a2bf-c96b134566b1\") " pod="openshift-network-diagnostics/network-check-target-qmmgl" Sep 18 08:07:12.566035 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:07:12.566018 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 08:07:12.566072 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:07:12.566042 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 08:07:12.566072 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:07:12.566055 2585 projected.go:196] Error preparing data for projected volume kube-api-access-h55b9 for pod openshift-network-diagnostics/network-check-target-qmmgl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 08:07:12.566150 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:07:12.566113 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/97cadd54-3234-4e3f-a2bf-c96b134566b1-kube-api-access-h55b9 podName:97cadd54-3234-4e3f-a2bf-c96b134566b1 nodeName:}" failed. No retries permitted until 2026-09-18 08:07:13.566097105 +0000 UTC m=+5.835797013 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-h55b9" (UniqueName: "kubernetes.io/projected/97cadd54-3234-4e3f-a2bf-c96b134566b1-kube-api-access-h55b9") pod "network-check-target-qmmgl" (UID: "97cadd54-3234-4e3f-a2bf-c96b134566b1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 08:07:12.798588 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:12.798554 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda56b7fed_7af6_4ed5_962d_9bd3f342cd2b.slice/crio-d40b275c4e3966fc3724f284323cdd92fdccffddbf721b87dcf0b705eee70073 WatchSource:0}: Error finding container d40b275c4e3966fc3724f284323cdd92fdccffddbf721b87dcf0b705eee70073: Status 404 returned error can't find the container with id d40b275c4e3966fc3724f284323cdd92fdccffddbf721b87dcf0b705eee70073 Sep 18 08:07:12.800728 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:12.800708 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a7d7351_f419_4f97_a1fe_a490512e47ab.slice/crio-0f2d575f125d0fbc4924e8a56282b7b9585a602f906afc1af1fd6ca3033a08f5 WatchSource:0}: Error finding container 0f2d575f125d0fbc4924e8a56282b7b9585a602f906afc1af1fd6ca3033a08f5: Status 404 returned error can't find the container with id 0f2d575f125d0fbc4924e8a56282b7b9585a602f906afc1af1fd6ca3033a08f5 Sep 18 08:07:12.801760 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:12.801727 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0aaaa41_bdef_4c6a_a828_18de65269b1a.slice/crio-626cc1dbf64a568aa882d86fe9af918c99fa10fcc012aa9e97d03bbf5db666c4 WatchSource:0}: Error finding container 626cc1dbf64a568aa882d86fe9af918c99fa10fcc012aa9e97d03bbf5db666c4: Status 404 returned error can't find the container with id 626cc1dbf64a568aa882d86fe9af918c99fa10fcc012aa9e97d03bbf5db666c4 Sep 18 08:07:12.805379 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:12.805360 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f760b01_3480_42e1_989d_4b35132437aa.slice/crio-f8124ba9f044880cb4b04af410148398c34a5e71d8be9fea5895eb5ec1b7ec80 WatchSource:0}: Error finding container f8124ba9f044880cb4b04af410148398c34a5e71d8be9fea5895eb5ec1b7ec80: Status 404 returned error can't find the container with id f8124ba9f044880cb4b04af410148398c34a5e71d8be9fea5895eb5ec1b7ec80 Sep 18 08:07:12.806266 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:12.806246 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a914598_1705_4865_9bbf_f7e2461c20f0.slice/crio-df926790e71619d7f1c3b570c12b36114a126ea40df5de5867b6ce3977b2a127 WatchSource:0}: Error finding container df926790e71619d7f1c3b570c12b36114a126ea40df5de5867b6ce3977b2a127: Status 404 returned error can't find the container with id df926790e71619d7f1c3b570c12b36114a126ea40df5de5867b6ce3977b2a127 Sep 18 08:07:12.807097 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:12.807075 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44849783_4c3d_4537_9559_5c5d79e76cb4.slice/crio-f385f27a42fc9ea15500b0edcc3830e269114aca3004c942f7963a86e399619d WatchSource:0}: Error finding container f385f27a42fc9ea15500b0edcc3830e269114aca3004c942f7963a86e399619d: Status 404 returned error can't find the container with id f385f27a42fc9ea15500b0edcc3830e269114aca3004c942f7963a86e399619d Sep 18 08:07:12.918663 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:12.918637 2585 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-17 08:02:11 +0000 UTC" deadline="2028-04-27 23:46:12.263826153 +0000 UTC" Sep 18 08:07:12.918663 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:12.918662 2585 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14103h38m59.345167019s" Sep 18 08:07:12.948253 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:12.948231 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pnp5z" event={"ID":"44849783-4c3d-4537-9559-5c5d79e76cb4","Type":"ContainerStarted","Data":"f385f27a42fc9ea15500b0edcc3830e269114aca3004c942f7963a86e399619d"} Sep 18 08:07:12.950119 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:12.950095 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-nb4q9" event={"ID":"3f760b01-3480-42e1-989d-4b35132437aa","Type":"ContainerStarted","Data":"f8124ba9f044880cb4b04af410148398c34a5e71d8be9fea5895eb5ec1b7ec80"} Sep 18 08:07:12.952497 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:12.952468 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-wzhkw" event={"ID":"3a7d7351-f419-4f97-a1fe-a490512e47ab","Type":"ContainerStarted","Data":"0f2d575f125d0fbc4924e8a56282b7b9585a602f906afc1af1fd6ca3033a08f5"} Sep 18 08:07:12.953500 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:12.953479 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-dtq72" event={"ID":"3a914598-1705-4865-9bbf-f7e2461c20f0","Type":"ContainerStarted","Data":"df926790e71619d7f1c3b570c12b36114a126ea40df5de5867b6ce3977b2a127"} Sep 18 08:07:12.955493 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:12.955466 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dn4s9" event={"ID":"c0aaaa41-bdef-4c6a-a828-18de65269b1a","Type":"ContainerStarted","Data":"626cc1dbf64a568aa882d86fe9af918c99fa10fcc012aa9e97d03bbf5db666c4"} Sep 18 08:07:12.956978 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:12.956960 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9kn9p" event={"ID":"a56b7fed-7af6-4ed5-962d-9bd3f342cd2b","Type":"ContainerStarted","Data":"d40b275c4e3966fc3724f284323cdd92fdccffddbf721b87dcf0b705eee70073"} Sep 18 08:07:12.958893 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:12.958871 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-42.ec2.internal" event={"ID":"4d9488aa4884c8db37ce53e0291649d1","Type":"ContainerStarted","Data":"431aefc93cf0fb8946036940d5d6c52adb2ea590c132e54d322c6a68db8a12ef"} Sep 18 08:07:12.961259 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:12.961242 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-jh2mg" event={"ID":"459b617e-1505-4bf6-9ee4-23d57ea13ddb","Type":"ContainerStarted","Data":"6f0c6e007d82b270ee668117e088012dbbcdf9cd5cca73e87821eebdc51b0cf1"} Sep 18 08:07:12.963963 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:12.963943 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-hsz4j" event={"ID":"977770b5-c53e-4c76-8946-e76d0663f9fb","Type":"ContainerStarted","Data":"020268f518275b0efbe974a2051a1f012e83df0ad23990f443ea8e90bb935ec8"} Sep 18 08:07:12.965828 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:12.965809 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-gjb6q" event={"ID":"9ffad063-9ddb-4986-ab43-8931a4288d24","Type":"ContainerStarted","Data":"fe501ee05b8f9fac5ad5366d93069a717b9279bcf1abdce17945d7e52b4be6cc"} Sep 18 08:07:13.473776 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:13.473456 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b6e0d1e7-a182-4ac0-a484-f174f64ca021-metrics-certs\") pod \"network-metrics-daemon-9vz5k\" (UID: \"b6e0d1e7-a182-4ac0-a484-f174f64ca021\") " pod="openshift-multus/network-metrics-daemon-9vz5k" Sep 18 08:07:13.473776 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:13.473749 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8d257247-8dae-4dce-9c31-62cf736b2b9f-original-pull-secret\") pod \"global-pull-secret-syncer-6rnbm\" (UID: \"8d257247-8dae-4dce-9c31-62cf736b2b9f\") " pod="kube-system/global-pull-secret-syncer-6rnbm" Sep 18 08:07:13.474001 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:07:13.473890 2585 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 08:07:13.474001 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:07:13.473953 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d257247-8dae-4dce-9c31-62cf736b2b9f-original-pull-secret podName:8d257247-8dae-4dce-9c31-62cf736b2b9f nodeName:}" failed. No retries permitted until 2026-09-18 08:07:15.473936774 +0000 UTC m=+7.743636686 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8d257247-8dae-4dce-9c31-62cf736b2b9f-original-pull-secret") pod "global-pull-secret-syncer-6rnbm" (UID: "8d257247-8dae-4dce-9c31-62cf736b2b9f") : object "kube-system"/"original-pull-secret" not registered Sep 18 08:07:13.474378 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:07:13.474354 2585 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 08:07:13.474455 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:07:13.474414 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6e0d1e7-a182-4ac0-a484-f174f64ca021-metrics-certs podName:b6e0d1e7-a182-4ac0-a484-f174f64ca021 nodeName:}" failed. No retries permitted until 2026-09-18 08:07:15.474397678 +0000 UTC m=+7.744097589 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b6e0d1e7-a182-4ac0-a484-f174f64ca021-metrics-certs") pod "network-metrics-daemon-9vz5k" (UID: "b6e0d1e7-a182-4ac0-a484-f174f64ca021") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 08:07:13.574274 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:13.574236 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h55b9\" (UniqueName: \"kubernetes.io/projected/97cadd54-3234-4e3f-a2bf-c96b134566b1-kube-api-access-h55b9\") pod \"network-check-target-qmmgl\" (UID: \"97cadd54-3234-4e3f-a2bf-c96b134566b1\") " pod="openshift-network-diagnostics/network-check-target-qmmgl" Sep 18 08:07:13.574468 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:07:13.574427 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 08:07:13.574468 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:07:13.574453 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 08:07:13.574468 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:07:13.574466 2585 projected.go:196] Error preparing data for projected volume kube-api-access-h55b9 for pod openshift-network-diagnostics/network-check-target-qmmgl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 08:07:13.574645 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:07:13.574526 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/97cadd54-3234-4e3f-a2bf-c96b134566b1-kube-api-access-h55b9 podName:97cadd54-3234-4e3f-a2bf-c96b134566b1 nodeName:}" failed. No retries permitted until 2026-09-18 08:07:15.574507488 +0000 UTC m=+7.844207427 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-h55b9" (UniqueName: "kubernetes.io/projected/97cadd54-3234-4e3f-a2bf-c96b134566b1-kube-api-access-h55b9") pod "network-check-target-qmmgl" (UID: "97cadd54-3234-4e3f-a2bf-c96b134566b1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 08:07:13.919752 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:13.919621 2585 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-17 08:02:11 +0000 UTC" deadline="2028-06-11 06:52:37.940136492 +0000 UTC" Sep 18 08:07:13.919752 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:13.919683 2585 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15166h45m24.020457157s" Sep 18 08:07:13.939178 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:13.939141 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qmmgl" Sep 18 08:07:13.939325 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:07:13.939277 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qmmgl" podUID="97cadd54-3234-4e3f-a2bf-c96b134566b1" Sep 18 08:07:13.939701 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:13.939679 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6rnbm" Sep 18 08:07:13.939808 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:07:13.939784 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6rnbm" podUID="8d257247-8dae-4dce-9c31-62cf736b2b9f" Sep 18 08:07:13.939932 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:13.939916 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9vz5k" Sep 18 08:07:13.940032 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:07:13.940012 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9vz5k" podUID="b6e0d1e7-a182-4ac0-a484-f174f64ca021" Sep 18 08:07:13.983981 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:13.983946 2585 generic.go:356] "Generic (PLEG): container finished" podID="841522c3fa8765282e5cd65659c3f206" containerID="3d092a3c93d71689d20cfc93f9c3c3d795dd8ad4698680333d963d9937b757dc" exitCode=0 Sep 18 08:07:13.984540 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:13.984514 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-42.ec2.internal" event={"ID":"841522c3fa8765282e5cd65659c3f206","Type":"ContainerDied","Data":"3d092a3c93d71689d20cfc93f9c3c3d795dd8ad4698680333d963d9937b757dc"} Sep 18 08:07:14.001739 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:14.001679 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-42.ec2.internal" podStartSLOduration=3.001661911 podStartE2EDuration="3.001661911s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 08:07:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 08:07:12.975109444 +0000 UTC m=+5.244809390" watchObservedRunningTime="2026-09-18 08:07:14.001661911 +0000 UTC m=+6.271361843" Sep 18 08:07:14.999562 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:14.999498 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-42.ec2.internal" event={"ID":"841522c3fa8765282e5cd65659c3f206","Type":"ContainerStarted","Data":"4854ac652ac99e5955afaedafca7537d1ca5f3b2607ca67d789e6f9bb4b86a61"} Sep 18 08:07:15.489987 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:15.489904 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b6e0d1e7-a182-4ac0-a484-f174f64ca021-metrics-certs\") pod \"network-metrics-daemon-9vz5k\" (UID: \"b6e0d1e7-a182-4ac0-a484-f174f64ca021\") " pod="openshift-multus/network-metrics-daemon-9vz5k" Sep 18 08:07:15.490151 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:15.489991 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8d257247-8dae-4dce-9c31-62cf736b2b9f-original-pull-secret\") pod \"global-pull-secret-syncer-6rnbm\" (UID: \"8d257247-8dae-4dce-9c31-62cf736b2b9f\") " pod="kube-system/global-pull-secret-syncer-6rnbm" Sep 18 08:07:15.490314 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:07:15.490150 2585 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 08:07:15.490314 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:07:15.490217 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d257247-8dae-4dce-9c31-62cf736b2b9f-original-pull-secret podName:8d257247-8dae-4dce-9c31-62cf736b2b9f nodeName:}" failed. No retries permitted until 2026-09-18 08:07:19.490197444 +0000 UTC m=+11.759897375 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8d257247-8dae-4dce-9c31-62cf736b2b9f-original-pull-secret") pod "global-pull-secret-syncer-6rnbm" (UID: "8d257247-8dae-4dce-9c31-62cf736b2b9f") : object "kube-system"/"original-pull-secret" not registered Sep 18 08:07:15.491061 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:07:15.490619 2585 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 08:07:15.491061 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:07:15.490674 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6e0d1e7-a182-4ac0-a484-f174f64ca021-metrics-certs podName:b6e0d1e7-a182-4ac0-a484-f174f64ca021 nodeName:}" failed. No retries permitted until 2026-09-18 08:07:19.49065967 +0000 UTC m=+11.760359582 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b6e0d1e7-a182-4ac0-a484-f174f64ca021-metrics-certs") pod "network-metrics-daemon-9vz5k" (UID: "b6e0d1e7-a182-4ac0-a484-f174f64ca021") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 08:07:15.590977 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:15.590900 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h55b9\" (UniqueName: \"kubernetes.io/projected/97cadd54-3234-4e3f-a2bf-c96b134566b1-kube-api-access-h55b9\") pod \"network-check-target-qmmgl\" (UID: \"97cadd54-3234-4e3f-a2bf-c96b134566b1\") " pod="openshift-network-diagnostics/network-check-target-qmmgl" Sep 18 08:07:15.591244 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:07:15.591134 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 08:07:15.591244 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:07:15.591160 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 08:07:15.591244 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:07:15.591171 2585 projected.go:196] Error preparing data for projected volume kube-api-access-h55b9 for pod openshift-network-diagnostics/network-check-target-qmmgl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 08:07:15.591244 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:07:15.591229 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/97cadd54-3234-4e3f-a2bf-c96b134566b1-kube-api-access-h55b9 podName:97cadd54-3234-4e3f-a2bf-c96b134566b1 nodeName:}" failed. No retries permitted until 2026-09-18 08:07:19.59121056 +0000 UTC m=+11.860910474 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-h55b9" (UniqueName: "kubernetes.io/projected/97cadd54-3234-4e3f-a2bf-c96b134566b1-kube-api-access-h55b9") pod "network-check-target-qmmgl" (UID: "97cadd54-3234-4e3f-a2bf-c96b134566b1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 08:07:15.941039 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:15.940960 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qmmgl" Sep 18 08:07:15.941192 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:07:15.941063 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qmmgl" podUID="97cadd54-3234-4e3f-a2bf-c96b134566b1" Sep 18 08:07:15.941349 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:15.941332 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6rnbm" Sep 18 08:07:15.941443 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:07:15.941408 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6rnbm" podUID="8d257247-8dae-4dce-9c31-62cf736b2b9f" Sep 18 08:07:15.941507 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:15.941449 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9vz5k" Sep 18 08:07:15.941507 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:07:15.941500 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9vz5k" podUID="b6e0d1e7-a182-4ac0-a484-f174f64ca021" Sep 18 08:07:17.940248 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:17.939705 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qmmgl" Sep 18 08:07:17.940248 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:17.939711 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6rnbm" Sep 18 08:07:17.940248 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:07:17.939868 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qmmgl" podUID="97cadd54-3234-4e3f-a2bf-c96b134566b1" Sep 18 08:07:17.940248 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:07:17.939994 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6rnbm" podUID="8d257247-8dae-4dce-9c31-62cf736b2b9f" Sep 18 08:07:17.940248 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:17.940067 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9vz5k" Sep 18 08:07:17.940248 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:07:17.940149 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9vz5k" podUID="b6e0d1e7-a182-4ac0-a484-f174f64ca021" Sep 18 08:07:19.523974 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:19.523944 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8d257247-8dae-4dce-9c31-62cf736b2b9f-original-pull-secret\") pod \"global-pull-secret-syncer-6rnbm\" (UID: \"8d257247-8dae-4dce-9c31-62cf736b2b9f\") " pod="kube-system/global-pull-secret-syncer-6rnbm" Sep 18 08:07:19.524432 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:19.524001 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b6e0d1e7-a182-4ac0-a484-f174f64ca021-metrics-certs\") pod \"network-metrics-daemon-9vz5k\" (UID: \"b6e0d1e7-a182-4ac0-a484-f174f64ca021\") " pod="openshift-multus/network-metrics-daemon-9vz5k" Sep 18 08:07:19.524432 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:07:19.524118 2585 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 08:07:19.524432 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:07:19.524124 2585 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 08:07:19.524432 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:07:19.524173 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d257247-8dae-4dce-9c31-62cf736b2b9f-original-pull-secret podName:8d257247-8dae-4dce-9c31-62cf736b2b9f nodeName:}" failed. No retries permitted until 2026-09-18 08:07:27.524158163 +0000 UTC m=+19.793858074 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8d257247-8dae-4dce-9c31-62cf736b2b9f-original-pull-secret") pod "global-pull-secret-syncer-6rnbm" (UID: "8d257247-8dae-4dce-9c31-62cf736b2b9f") : object "kube-system"/"original-pull-secret" not registered Sep 18 08:07:19.524432 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:07:19.524194 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6e0d1e7-a182-4ac0-a484-f174f64ca021-metrics-certs podName:b6e0d1e7-a182-4ac0-a484-f174f64ca021 nodeName:}" failed. No retries permitted until 2026-09-18 08:07:27.52418251 +0000 UTC m=+19.793882431 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b6e0d1e7-a182-4ac0-a484-f174f64ca021-metrics-certs") pod "network-metrics-daemon-9vz5k" (UID: "b6e0d1e7-a182-4ac0-a484-f174f64ca021") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 08:07:19.625077 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:19.624934 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h55b9\" (UniqueName: \"kubernetes.io/projected/97cadd54-3234-4e3f-a2bf-c96b134566b1-kube-api-access-h55b9\") pod \"network-check-target-qmmgl\" (UID: \"97cadd54-3234-4e3f-a2bf-c96b134566b1\") " pod="openshift-network-diagnostics/network-check-target-qmmgl" Sep 18 08:07:19.625241 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:07:19.625104 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 08:07:19.625241 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:07:19.625128 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 08:07:19.625241 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:07:19.625139 2585 projected.go:196] Error preparing data for projected volume kube-api-access-h55b9 for pod openshift-network-diagnostics/network-check-target-qmmgl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 08:07:19.625241 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:07:19.625185 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/97cadd54-3234-4e3f-a2bf-c96b134566b1-kube-api-access-h55b9 podName:97cadd54-3234-4e3f-a2bf-c96b134566b1 nodeName:}" failed. No retries permitted until 2026-09-18 08:07:27.625171685 +0000 UTC m=+19.894871596 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-h55b9" (UniqueName: "kubernetes.io/projected/97cadd54-3234-4e3f-a2bf-c96b134566b1-kube-api-access-h55b9") pod "network-check-target-qmmgl" (UID: "97cadd54-3234-4e3f-a2bf-c96b134566b1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 08:07:19.940250 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:19.940178 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9vz5k" Sep 18 08:07:19.940381 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:07:19.940303 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9vz5k" podUID="b6e0d1e7-a182-4ac0-a484-f174f64ca021" Sep 18 08:07:19.940673 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:19.940656 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qmmgl" Sep 18 08:07:19.940775 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:07:19.940755 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qmmgl" podUID="97cadd54-3234-4e3f-a2bf-c96b134566b1" Sep 18 08:07:19.940820 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:19.940807 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6rnbm" Sep 18 08:07:19.940921 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:07:19.940902 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6rnbm" podUID="8d257247-8dae-4dce-9c31-62cf736b2b9f" Sep 18 08:07:21.938983 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:21.938951 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qmmgl" Sep 18 08:07:21.938983 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:21.938975 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6rnbm" Sep 18 08:07:21.939432 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:07:21.939058 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qmmgl" podUID="97cadd54-3234-4e3f-a2bf-c96b134566b1" Sep 18 08:07:21.939432 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:07:21.939124 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6rnbm" podUID="8d257247-8dae-4dce-9c31-62cf736b2b9f" Sep 18 08:07:21.939432 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:21.939152 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9vz5k" Sep 18 08:07:21.939432 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:07:21.939211 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9vz5k" podUID="b6e0d1e7-a182-4ac0-a484-f174f64ca021" Sep 18 08:07:23.938625 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:23.938598 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qmmgl" Sep 18 08:07:23.938625 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:23.938616 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6rnbm" Sep 18 08:07:23.938625 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:23.938627 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9vz5k" Sep 18 08:07:23.939186 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:07:23.938721 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qmmgl" podUID="97cadd54-3234-4e3f-a2bf-c96b134566b1" Sep 18 08:07:23.939186 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:07:23.938828 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6rnbm" podUID="8d257247-8dae-4dce-9c31-62cf736b2b9f" Sep 18 08:07:23.939186 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:07:23.939016 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9vz5k" podUID="b6e0d1e7-a182-4ac0-a484-f174f64ca021" Sep 18 08:07:25.939133 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:25.939099 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qmmgl" Sep 18 08:07:25.939133 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:25.939117 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9vz5k" Sep 18 08:07:25.939633 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:25.939099 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6rnbm" Sep 18 08:07:25.939633 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:07:25.939210 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qmmgl" podUID="97cadd54-3234-4e3f-a2bf-c96b134566b1" Sep 18 08:07:25.939633 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:07:25.939301 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6rnbm" podUID="8d257247-8dae-4dce-9c31-62cf736b2b9f" Sep 18 08:07:25.939633 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:07:25.939394 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9vz5k" podUID="b6e0d1e7-a182-4ac0-a484-f174f64ca021" Sep 18 08:07:27.583964 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:27.583915 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b6e0d1e7-a182-4ac0-a484-f174f64ca021-metrics-certs\") pod \"network-metrics-daemon-9vz5k\" (UID: \"b6e0d1e7-a182-4ac0-a484-f174f64ca021\") " pod="openshift-multus/network-metrics-daemon-9vz5k" Sep 18 08:07:27.584391 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:27.583974 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8d257247-8dae-4dce-9c31-62cf736b2b9f-original-pull-secret\") pod \"global-pull-secret-syncer-6rnbm\" (UID: \"8d257247-8dae-4dce-9c31-62cf736b2b9f\") " pod="kube-system/global-pull-secret-syncer-6rnbm" Sep 18 08:07:27.584391 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:07:27.584041 2585 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 08:07:27.584391 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:07:27.584052 2585 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 08:07:27.584391 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:07:27.584110 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d257247-8dae-4dce-9c31-62cf736b2b9f-original-pull-secret podName:8d257247-8dae-4dce-9c31-62cf736b2b9f nodeName:}" failed. No retries permitted until 2026-09-18 08:07:43.584091462 +0000 UTC m=+35.853791387 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8d257247-8dae-4dce-9c31-62cf736b2b9f-original-pull-secret") pod "global-pull-secret-syncer-6rnbm" (UID: "8d257247-8dae-4dce-9c31-62cf736b2b9f") : object "kube-system"/"original-pull-secret" not registered Sep 18 08:07:27.584391 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:07:27.584131 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6e0d1e7-a182-4ac0-a484-f174f64ca021-metrics-certs podName:b6e0d1e7-a182-4ac0-a484-f174f64ca021 nodeName:}" failed. No retries permitted until 2026-09-18 08:07:43.584116485 +0000 UTC m=+35.853816391 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b6e0d1e7-a182-4ac0-a484-f174f64ca021-metrics-certs") pod "network-metrics-daemon-9vz5k" (UID: "b6e0d1e7-a182-4ac0-a484-f174f64ca021") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 08:07:27.684256 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:27.684228 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h55b9\" (UniqueName: \"kubernetes.io/projected/97cadd54-3234-4e3f-a2bf-c96b134566b1-kube-api-access-h55b9\") pod \"network-check-target-qmmgl\" (UID: \"97cadd54-3234-4e3f-a2bf-c96b134566b1\") " pod="openshift-network-diagnostics/network-check-target-qmmgl" Sep 18 08:07:27.684402 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:07:27.684345 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 08:07:27.684402 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:07:27.684371 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 08:07:27.684402 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:07:27.684381 2585 projected.go:196] Error preparing data for projected volume kube-api-access-h55b9 for pod openshift-network-diagnostics/network-check-target-qmmgl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 08:07:27.684548 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:07:27.684431 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/97cadd54-3234-4e3f-a2bf-c96b134566b1-kube-api-access-h55b9 podName:97cadd54-3234-4e3f-a2bf-c96b134566b1 nodeName:}" failed. No retries permitted until 2026-09-18 08:07:43.684413155 +0000 UTC m=+35.954113063 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-h55b9" (UniqueName: "kubernetes.io/projected/97cadd54-3234-4e3f-a2bf-c96b134566b1-kube-api-access-h55b9") pod "network-check-target-qmmgl" (UID: "97cadd54-3234-4e3f-a2bf-c96b134566b1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 08:07:27.941338 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:27.941266 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9vz5k" Sep 18 08:07:27.941338 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:27.941279 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6rnbm" Sep 18 08:07:27.941338 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:27.941266 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qmmgl" Sep 18 08:07:27.941594 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:07:27.941370 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6rnbm" podUID="8d257247-8dae-4dce-9c31-62cf736b2b9f" Sep 18 08:07:27.941594 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:07:27.941440 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9vz5k" podUID="b6e0d1e7-a182-4ac0-a484-f174f64ca021" Sep 18 08:07:27.941594 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:07:27.941489 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qmmgl" podUID="97cadd54-3234-4e3f-a2bf-c96b134566b1" Sep 18 08:07:29.942020 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:29.941994 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6rnbm" Sep 18 08:07:29.942391 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:29.942039 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9vz5k" Sep 18 08:07:29.942391 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:29.941993 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qmmgl" Sep 18 08:07:29.942391 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:07:29.942094 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6rnbm" podUID="8d257247-8dae-4dce-9c31-62cf736b2b9f" Sep 18 08:07:29.942391 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:07:29.942201 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qmmgl" podUID="97cadd54-3234-4e3f-a2bf-c96b134566b1" Sep 18 08:07:29.942391 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:07:29.942269 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9vz5k" podUID="b6e0d1e7-a182-4ac0-a484-f174f64ca021" Sep 18 08:07:31.032816 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:31.032577 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-jh2mg" event={"ID":"459b617e-1505-4bf6-9ee4-23d57ea13ddb","Type":"ContainerStarted","Data":"e105548d5f87760effc4c140612e5a977231b45431702988b8bc3f960396c8a2"} Sep 18 08:07:31.034283 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:31.034241 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-hsz4j" event={"ID":"977770b5-c53e-4c76-8946-e76d0663f9fb","Type":"ContainerStarted","Data":"d1f2314c16b88345fcf31b5b814e060a439dc1f7876682b13f3868da3b612359"} Sep 18 08:07:31.035739 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:31.035715 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-gjb6q" event={"ID":"9ffad063-9ddb-4986-ab43-8931a4288d24","Type":"ContainerStarted","Data":"91433d501bcef78e518f8e812c6a3059a0725699ebfb4085eb88c92a849bbbb9"} Sep 18 08:07:31.037122 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:31.037103 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pnp5z" event={"ID":"44849783-4c3d-4537-9559-5c5d79e76cb4","Type":"ContainerStarted","Data":"e6bf3a00391d8a0436274aa887f7ced19ab7d76f21987bc0a43136a2fb4e026a"} Sep 18 08:07:31.038391 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:31.038373 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-nb4q9" event={"ID":"3f760b01-3480-42e1-989d-4b35132437aa","Type":"ContainerStarted","Data":"a8a413a1c03ef76aa1f70a5095cd1df2a07eb301f82b4b2a3ae0122d5b7c28d6"} Sep 18 08:07:31.039753 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:31.039732 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-dtq72" event={"ID":"3a914598-1705-4865-9bbf-f7e2461c20f0","Type":"ContainerStarted","Data":"c8e99300911ad4b74b0129fd9da010bc30fbf187c051a3e20a3f82822b297364"} Sep 18 08:07:31.041184 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:31.041162 2585 generic.go:356] "Generic (PLEG): container finished" podID="c0aaaa41-bdef-4c6a-a828-18de65269b1a" containerID="15600232e05dfa9847925a7c492ab0d7ad79482200cc8a9bdf56a4f912dd09bd" exitCode=0 Sep 18 08:07:31.041278 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:31.041224 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dn4s9" event={"ID":"c0aaaa41-bdef-4c6a-a828-18de65269b1a","Type":"ContainerDied","Data":"15600232e05dfa9847925a7c492ab0d7ad79482200cc8a9bdf56a4f912dd09bd"} Sep 18 08:07:31.043549 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:31.043531 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9kn9p_a56b7fed-7af6-4ed5-962d-9bd3f342cd2b/ovn-acl-logging/0.log" Sep 18 08:07:31.044134 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:31.044112 2585 generic.go:356] "Generic (PLEG): container finished" podID="a56b7fed-7af6-4ed5-962d-9bd3f342cd2b" containerID="d9433d5be5436496efa6f95394f5c63c3c0e76c32cc9b3aa34b97c8e5ac8bb16" exitCode=1 Sep 18 08:07:31.044226 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:31.044146 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9kn9p" event={"ID":"a56b7fed-7af6-4ed5-962d-9bd3f342cd2b","Type":"ContainerStarted","Data":"14870e0aec8be6124dc869374e2036ad5b354462aeb7f3db3bbc1bb2ee7d7ea7"} Sep 18 08:07:31.044226 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:31.044194 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9kn9p" event={"ID":"a56b7fed-7af6-4ed5-962d-9bd3f342cd2b","Type":"ContainerStarted","Data":"3c0a1bf055df1f20207f5c7095b09d5c605cf309d17b19c79f3a88146a0c4f51"} Sep 18 08:07:31.044403 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:31.044237 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9kn9p" event={"ID":"a56b7fed-7af6-4ed5-962d-9bd3f342cd2b","Type":"ContainerDied","Data":"d9433d5be5436496efa6f95394f5c63c3c0e76c32cc9b3aa34b97c8e5ac8bb16"} Sep 18 08:07:31.044403 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:31.044269 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9kn9p" event={"ID":"a56b7fed-7af6-4ed5-962d-9bd3f342cd2b","Type":"ContainerStarted","Data":"62ae5b9021179ed4d11e2ce3a171ad2e256d979af262d080ab945a0577e453e9"} Sep 18 08:07:31.049676 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:31.049591 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-42.ec2.internal" podStartSLOduration=20.049576912 podStartE2EDuration="20.049576912s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 08:07:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 08:07:15.015034344 +0000 UTC m=+7.284734290" watchObservedRunningTime="2026-09-18 08:07:31.049576912 +0000 UTC m=+23.319276841" Sep 18 08:07:31.075667 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:31.075472 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-jh2mg" podStartSLOduration=3.473462446 podStartE2EDuration="21.075455639s" totalImagesPullingTime="17.601993193s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 08:07:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 08:07:31.049424488 +0000 UTC m=+23.319124419" watchObservedRunningTime="2026-09-18 08:07:31.075455639 +0000 UTC m=+23.345155569" Sep 18 08:07:31.121941 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:31.121898 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-gjb6q" podStartSLOduration=3.505195268 podStartE2EDuration="21.121886314s" totalImagesPullingTime="17.616691046s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 08:07:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 08:07:31.121781426 +0000 UTC m=+23.391481357" watchObservedRunningTime="2026-09-18 08:07:31.121886314 +0000 UTC m=+23.391586249" Sep 18 08:07:31.122415 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:31.122381 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-nb4q9" podStartSLOduration=3.519666622 podStartE2EDuration="21.1223739s" totalImagesPullingTime="17.602707278s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 08:07:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 08:07:31.094912688 +0000 UTC m=+23.364612617" watchObservedRunningTime="2026-09-18 08:07:31.1223739 +0000 UTC m=+23.392073828" Sep 18 08:07:31.151994 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:31.151961 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-hsz4j" podStartSLOduration=3.553678014 podStartE2EDuration="21.151940979s" totalImagesPullingTime="17.598262965s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 08:07:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 08:07:31.151224317 +0000 UTC m=+23.420924245" watchObservedRunningTime="2026-09-18 08:07:31.151940979 +0000 UTC m=+23.421640907" Sep 18 08:07:31.939262 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:31.939237 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6rnbm" Sep 18 08:07:31.939377 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:31.939309 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9vz5k" Sep 18 08:07:31.939449 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:31.939435 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qmmgl" Sep 18 08:07:31.939500 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:07:31.939441 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6rnbm" podUID="8d257247-8dae-4dce-9c31-62cf736b2b9f" Sep 18 08:07:31.939561 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:07:31.939534 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9vz5k" podUID="b6e0d1e7-a182-4ac0-a484-f174f64ca021" Sep 18 08:07:31.939625 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:07:31.939605 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qmmgl" podUID="97cadd54-3234-4e3f-a2bf-c96b134566b1" Sep 18 08:07:31.965047 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:31.965024 2585 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 18 08:07:32.049575 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:32.049549 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9kn9p_a56b7fed-7af6-4ed5-962d-9bd3f342cd2b/ovn-acl-logging/0.log" Sep 18 08:07:32.050025 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:32.049993 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9kn9p" event={"ID":"a56b7fed-7af6-4ed5-962d-9bd3f342cd2b","Type":"ContainerStarted","Data":"b2412affc270c4c0166b14f3a9803f1a6987b8a4e7bf4897831df721fa012de0"} Sep 18 08:07:32.050105 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:32.050084 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9kn9p" event={"ID":"a56b7fed-7af6-4ed5-962d-9bd3f342cd2b","Type":"ContainerStarted","Data":"5a0c73e7c23d4ec40a44127a1aa7736f7f5c77cf9b1af4904ec3579ec65fe9d1"} Sep 18 08:07:32.052112 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:32.052083 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pnp5z" event={"ID":"44849783-4c3d-4537-9559-5c5d79e76cb4","Type":"ContainerStarted","Data":"57487413320ac91f22219a1fcf08feaf8288ed34f2b6d3d9b76bbf513cb42dad"} Sep 18 08:07:32.053737 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:32.053712 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-wzhkw" event={"ID":"3a7d7351-f419-4f97-a1fe-a490512e47ab","Type":"ContainerStarted","Data":"c7f4665ef4f41dfa7c2afe1b570fc43774ebe4b0846dad490dafcb3f5250854c"} Sep 18 08:07:32.070543 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:32.070476 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-dtq72" podStartSLOduration=4.53786637 podStartE2EDuration="22.070460832s" totalImagesPullingTime="17.532594462s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 08:07:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 08:07:31.183007664 +0000 UTC m=+23.452707610" watchObservedRunningTime="2026-09-18 08:07:32.070460832 +0000 UTC m=+24.340160761" Sep 18 08:07:32.070970 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:32.070938 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-wzhkw" podStartSLOduration=4.532878403 podStartE2EDuration="22.0709239s" totalImagesPullingTime="17.538045497s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 08:07:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 08:07:32.070573675 +0000 UTC m=+24.340273607" watchObservedRunningTime="2026-09-18 08:07:32.0709239 +0000 UTC m=+24.340623831" Sep 18 08:07:32.918743 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:32.918639 2585 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-18T08:07:31.965042634Z","UUID":"42390065-dc75-43ff-a529-5a07294402ef","Handler":null,"Name":"","Endpoint":""} Sep 18 08:07:32.920435 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:32.920416 2585 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 18 08:07:32.920541 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:32.920451 2585 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 18 08:07:33.058518 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:33.058440 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pnp5z" event={"ID":"44849783-4c3d-4537-9559-5c5d79e76cb4","Type":"ContainerStarted","Data":"b8649397f918480211cd0f7ce4da339f9c81a1fb301fee5b72e3f1df00891611"} Sep 18 08:07:33.096307 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:33.096250 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pnp5z" podStartSLOduration=3.43078107 podStartE2EDuration="23.096234209s" totalImagesPullingTime="19.665453139s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 08:07:10 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 08:07:33.09611945 +0000 UTC m=+25.365819380" watchObservedRunningTime="2026-09-18 08:07:33.096234209 +0000 UTC m=+25.365934135" Sep 18 08:07:33.710472 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:33.710401 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-dtq72" Sep 18 08:07:33.710947 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:33.710926 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-dtq72" Sep 18 08:07:33.938948 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:33.938919 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6rnbm" Sep 18 08:07:33.939116 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:33.938919 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9vz5k" Sep 18 08:07:33.939116 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:07:33.939045 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6rnbm" podUID="8d257247-8dae-4dce-9c31-62cf736b2b9f" Sep 18 08:07:33.939232 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:07:33.939145 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9vz5k" podUID="b6e0d1e7-a182-4ac0-a484-f174f64ca021" Sep 18 08:07:33.939232 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:33.938919 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qmmgl" Sep 18 08:07:33.939331 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:07:33.939245 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qmmgl" podUID="97cadd54-3234-4e3f-a2bf-c96b134566b1" Sep 18 08:07:34.064084 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:34.064012 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9kn9p_a56b7fed-7af6-4ed5-962d-9bd3f342cd2b/ovn-acl-logging/0.log" Sep 18 08:07:34.064503 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:34.064421 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9kn9p" event={"ID":"a56b7fed-7af6-4ed5-962d-9bd3f342cd2b","Type":"ContainerStarted","Data":"eea749598b86b29ecc8d287720c8605c4da351d5b0b5d875bbf7353cee2fc778"} Sep 18 08:07:35.939345 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:35.939151 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qmmgl" Sep 18 08:07:35.939922 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:35.939158 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6rnbm" Sep 18 08:07:35.939922 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:07:35.939498 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6rnbm" podUID="8d257247-8dae-4dce-9c31-62cf736b2b9f" Sep 18 08:07:35.939922 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:07:35.939390 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qmmgl" podUID="97cadd54-3234-4e3f-a2bf-c96b134566b1" Sep 18 08:07:35.939922 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:35.939223 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9vz5k" Sep 18 08:07:35.939922 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:07:35.939609 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9vz5k" podUID="b6e0d1e7-a182-4ac0-a484-f174f64ca021" Sep 18 08:07:36.070119 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:36.070092 2585 generic.go:356] "Generic (PLEG): container finished" podID="c0aaaa41-bdef-4c6a-a828-18de65269b1a" containerID="c3d3cab1376588c18d37c264a586b76dce7d724f8bb1e044ce0e72ae17324c8b" exitCode=0 Sep 18 08:07:36.070224 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:36.070180 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dn4s9" event={"ID":"c0aaaa41-bdef-4c6a-a828-18de65269b1a","Type":"ContainerDied","Data":"c3d3cab1376588c18d37c264a586b76dce7d724f8bb1e044ce0e72ae17324c8b"} Sep 18 08:07:36.074075 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:36.074059 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9kn9p_a56b7fed-7af6-4ed5-962d-9bd3f342cd2b/ovn-acl-logging/0.log" Sep 18 08:07:36.074411 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:36.074390 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9kn9p" event={"ID":"a56b7fed-7af6-4ed5-962d-9bd3f342cd2b","Type":"ContainerStarted","Data":"e157ce228c53e3f717d30fe4e51905b5041b67762500cf8d103be272f8239921"} Sep 18 08:07:36.074664 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:36.074644 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9kn9p" Sep 18 08:07:36.074781 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:36.074713 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9kn9p" Sep 18 08:07:36.074820 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:36.074795 2585 scope.go:117] "RemoveContainer" containerID="d9433d5be5436496efa6f95394f5c63c3c0e76c32cc9b3aa34b97c8e5ac8bb16" Sep 18 08:07:36.090779 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:36.090760 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9kn9p" Sep 18 08:07:37.080129 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:37.080101 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9kn9p_a56b7fed-7af6-4ed5-962d-9bd3f342cd2b/ovn-acl-logging/0.log" Sep 18 08:07:37.080528 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:37.080436 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9kn9p" event={"ID":"a56b7fed-7af6-4ed5-962d-9bd3f342cd2b","Type":"ContainerStarted","Data":"3b259dcb0d39cbab2dbe1ec44e14b2f671be231618ab265c88bfe1813ae9854c"} Sep 18 08:07:37.080681 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:37.080666 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9kn9p" Sep 18 08:07:37.097076 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:37.097054 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9kn9p" Sep 18 08:07:37.111712 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:37.111680 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-9kn9p" podStartSLOduration=9.270551059 podStartE2EDuration="27.111668054s" totalImagesPullingTime="17.841116995s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 08:07:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 08:07:37.111359475 +0000 UTC m=+29.381059404" watchObservedRunningTime="2026-09-18 08:07:37.111668054 +0000 UTC m=+29.381367983" Sep 18 08:07:37.938624 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:37.938595 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qmmgl" Sep 18 08:07:37.938624 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:37.938609 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9vz5k" Sep 18 08:07:37.938890 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:37.938596 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6rnbm" Sep 18 08:07:37.938890 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:07:37.938692 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qmmgl" podUID="97cadd54-3234-4e3f-a2bf-c96b134566b1" Sep 18 08:07:37.938890 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:07:37.938777 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6rnbm" podUID="8d257247-8dae-4dce-9c31-62cf736b2b9f" Sep 18 08:07:37.938890 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:07:37.938867 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9vz5k" podUID="b6e0d1e7-a182-4ac0-a484-f174f64ca021" Sep 18 08:07:38.085370 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:38.085336 2585 generic.go:356] "Generic (PLEG): container finished" podID="c0aaaa41-bdef-4c6a-a828-18de65269b1a" containerID="25066a606ba9434d4c77dafe446d1ebb1dd583cd247a46d7d2265da3a73c7072" exitCode=0 Sep 18 08:07:38.085771 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:38.085369 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dn4s9" event={"ID":"c0aaaa41-bdef-4c6a-a828-18de65269b1a","Type":"ContainerDied","Data":"25066a606ba9434d4c77dafe446d1ebb1dd583cd247a46d7d2265da3a73c7072"} Sep 18 08:07:39.941422 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:39.940754 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9vz5k" Sep 18 08:07:39.941422 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:07:39.941162 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9vz5k" podUID="b6e0d1e7-a182-4ac0-a484-f174f64ca021" Sep 18 08:07:39.941422 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:39.941407 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qmmgl" Sep 18 08:07:39.941990 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:39.941579 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6rnbm" Sep 18 08:07:39.941990 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:07:39.941590 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qmmgl" podUID="97cadd54-3234-4e3f-a2bf-c96b134566b1" Sep 18 08:07:39.941990 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:07:39.941776 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6rnbm" podUID="8d257247-8dae-4dce-9c31-62cf736b2b9f" Sep 18 08:07:40.091992 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:40.091969 2585 generic.go:356] "Generic (PLEG): container finished" podID="c0aaaa41-bdef-4c6a-a828-18de65269b1a" containerID="a6dc447c727353a6ee92df924668cfb7e64f653ac9cd9fdada90528d4aff8922" exitCode=0 Sep 18 08:07:40.092095 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:40.091997 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dn4s9" event={"ID":"c0aaaa41-bdef-4c6a-a828-18de65269b1a","Type":"ContainerDied","Data":"a6dc447c727353a6ee92df924668cfb7e64f653ac9cd9fdada90528d4aff8922"} Sep 18 08:07:41.938251 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:41.938223 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6rnbm" Sep 18 08:07:41.938705 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:07:41.938343 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6rnbm" podUID="8d257247-8dae-4dce-9c31-62cf736b2b9f" Sep 18 08:07:41.938705 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:41.938222 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9vz5k" Sep 18 08:07:41.938705 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:07:41.938417 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9vz5k" podUID="b6e0d1e7-a182-4ac0-a484-f174f64ca021" Sep 18 08:07:41.938705 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:41.938222 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qmmgl" Sep 18 08:07:41.938705 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:07:41.938460 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qmmgl" podUID="97cadd54-3234-4e3f-a2bf-c96b134566b1" Sep 18 08:07:42.050733 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:42.050708 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-dtq72" Sep 18 08:07:42.050901 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:42.050813 2585 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Sep 18 08:07:42.051537 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:42.051516 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-dtq72" Sep 18 08:07:43.608548 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:43.608512 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b6e0d1e7-a182-4ac0-a484-f174f64ca021-metrics-certs\") pod \"network-metrics-daemon-9vz5k\" (UID: \"b6e0d1e7-a182-4ac0-a484-f174f64ca021\") " pod="openshift-multus/network-metrics-daemon-9vz5k" Sep 18 08:07:43.609034 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:43.608579 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8d257247-8dae-4dce-9c31-62cf736b2b9f-original-pull-secret\") pod \"global-pull-secret-syncer-6rnbm\" (UID: \"8d257247-8dae-4dce-9c31-62cf736b2b9f\") " pod="kube-system/global-pull-secret-syncer-6rnbm" Sep 18 08:07:43.609034 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:07:43.608683 2585 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 08:07:43.609034 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:07:43.608688 2585 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 08:07:43.609034 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:07:43.608746 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d257247-8dae-4dce-9c31-62cf736b2b9f-original-pull-secret podName:8d257247-8dae-4dce-9c31-62cf736b2b9f nodeName:}" failed. No retries permitted until 2026-09-18 08:08:15.608731579 +0000 UTC m=+67.878431498 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8d257247-8dae-4dce-9c31-62cf736b2b9f-original-pull-secret") pod "global-pull-secret-syncer-6rnbm" (UID: "8d257247-8dae-4dce-9c31-62cf736b2b9f") : object "kube-system"/"original-pull-secret" not registered Sep 18 08:07:43.609034 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:07:43.608762 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6e0d1e7-a182-4ac0-a484-f174f64ca021-metrics-certs podName:b6e0d1e7-a182-4ac0-a484-f174f64ca021 nodeName:}" failed. No retries permitted until 2026-09-18 08:08:15.608754613 +0000 UTC m=+67.878454521 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b6e0d1e7-a182-4ac0-a484-f174f64ca021-metrics-certs") pod "network-metrics-daemon-9vz5k" (UID: "b6e0d1e7-a182-4ac0-a484-f174f64ca021") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 08:07:43.709603 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:43.709572 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h55b9\" (UniqueName: \"kubernetes.io/projected/97cadd54-3234-4e3f-a2bf-c96b134566b1-kube-api-access-h55b9\") pod \"network-check-target-qmmgl\" (UID: \"97cadd54-3234-4e3f-a2bf-c96b134566b1\") " pod="openshift-network-diagnostics/network-check-target-qmmgl" Sep 18 08:07:43.709751 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:07:43.709733 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 08:07:43.709798 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:07:43.709758 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 08:07:43.709798 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:07:43.709768 2585 projected.go:196] Error preparing data for projected volume kube-api-access-h55b9 for pod openshift-network-diagnostics/network-check-target-qmmgl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 08:07:43.709905 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:07:43.709814 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/97cadd54-3234-4e3f-a2bf-c96b134566b1-kube-api-access-h55b9 podName:97cadd54-3234-4e3f-a2bf-c96b134566b1 nodeName:}" failed. No retries permitted until 2026-09-18 08:08:15.709801405 +0000 UTC m=+67.979501312 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-h55b9" (UniqueName: "kubernetes.io/projected/97cadd54-3234-4e3f-a2bf-c96b134566b1-kube-api-access-h55b9") pod "network-check-target-qmmgl" (UID: "97cadd54-3234-4e3f-a2bf-c96b134566b1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 08:07:43.939013 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:43.938938 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9vz5k" Sep 18 08:07:43.939013 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:43.938950 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qmmgl" Sep 18 08:07:43.939013 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:43.938964 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6rnbm" Sep 18 08:07:43.939238 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:07:43.939072 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9vz5k" podUID="b6e0d1e7-a182-4ac0-a484-f174f64ca021" Sep 18 08:07:43.939238 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:07:43.939213 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qmmgl" podUID="97cadd54-3234-4e3f-a2bf-c96b134566b1" Sep 18 08:07:43.939325 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:07:43.939305 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6rnbm" podUID="8d257247-8dae-4dce-9c31-62cf736b2b9f" Sep 18 08:07:45.107043 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:45.107003 2585 generic.go:356] "Generic (PLEG): container finished" podID="c0aaaa41-bdef-4c6a-a828-18de65269b1a" containerID="00abe885d32f4712b0f505ea5a68eafd5336a667034e5ae325f673bd1d613cc0" exitCode=0 Sep 18 08:07:45.107400 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:45.107082 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dn4s9" event={"ID":"c0aaaa41-bdef-4c6a-a828-18de65269b1a","Type":"ContainerDied","Data":"00abe885d32f4712b0f505ea5a68eafd5336a667034e5ae325f673bd1d613cc0"} Sep 18 08:07:45.938374 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:45.938346 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9vz5k" Sep 18 08:07:45.938534 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:45.938353 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qmmgl" Sep 18 08:07:45.938534 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:07:45.938494 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9vz5k" podUID="b6e0d1e7-a182-4ac0-a484-f174f64ca021" Sep 18 08:07:45.938534 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:45.938357 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6rnbm" Sep 18 08:07:45.938534 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:07:45.938523 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qmmgl" podUID="97cadd54-3234-4e3f-a2bf-c96b134566b1" Sep 18 08:07:45.938722 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:07:45.938608 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6rnbm" podUID="8d257247-8dae-4dce-9c31-62cf736b2b9f" Sep 18 08:07:46.112605 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:46.112576 2585 generic.go:356] "Generic (PLEG): container finished" podID="c0aaaa41-bdef-4c6a-a828-18de65269b1a" containerID="c512ea14b44aa079d84d4c09b7ecc1a2a3094cb57db96bb4db3b75d24f709bcc" exitCode=0 Sep 18 08:07:46.112953 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:46.112626 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dn4s9" event={"ID":"c0aaaa41-bdef-4c6a-a828-18de65269b1a","Type":"ContainerDied","Data":"c512ea14b44aa079d84d4c09b7ecc1a2a3094cb57db96bb4db3b75d24f709bcc"} Sep 18 08:07:47.118027 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:47.118001 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dn4s9" event={"ID":"c0aaaa41-bdef-4c6a-a828-18de65269b1a","Type":"ContainerStarted","Data":"fa578c29d3f452d517b627f18df68d544088f9b1eb86492b83592d2c97758ef2"} Sep 18 08:07:47.145785 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:47.145743 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-dn4s9" podStartSLOduration=8.178730062 podStartE2EDuration="37.145729461s" totalImagesPullingTime="28.966999399s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 08:07:10 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 08:07:47.145524414 +0000 UTC m=+39.415224344" watchObservedRunningTime="2026-09-18 08:07:47.145729461 +0000 UTC m=+39.415429389" Sep 18 08:07:47.938576 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:47.938546 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6rnbm" Sep 18 08:07:47.938738 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:47.938547 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9vz5k" Sep 18 08:07:47.938738 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:07:47.938664 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6rnbm" podUID="8d257247-8dae-4dce-9c31-62cf736b2b9f" Sep 18 08:07:47.938738 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:47.938547 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qmmgl" Sep 18 08:07:47.938878 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:07:47.938732 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9vz5k" podUID="b6e0d1e7-a182-4ac0-a484-f174f64ca021" Sep 18 08:07:47.938878 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:07:47.938788 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qmmgl" podUID="97cadd54-3234-4e3f-a2bf-c96b134566b1" Sep 18 08:07:49.939782 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:49.939754 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qmmgl" Sep 18 08:07:49.940276 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:49.939901 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9vz5k" Sep 18 08:07:49.940276 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:07:49.939905 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qmmgl" podUID="97cadd54-3234-4e3f-a2bf-c96b134566b1" Sep 18 08:07:49.940276 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:07:49.940022 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9vz5k" podUID="b6e0d1e7-a182-4ac0-a484-f174f64ca021" Sep 18 08:07:49.940276 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:49.940065 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6rnbm" Sep 18 08:07:49.940276 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:07:49.940122 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6rnbm" podUID="8d257247-8dae-4dce-9c31-62cf736b2b9f" Sep 18 08:07:51.590688 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:51.590659 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-9vz5k"] Sep 18 08:07:51.591033 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:51.590828 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9vz5k" Sep 18 08:07:51.591033 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:07:51.590969 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9vz5k" podUID="b6e0d1e7-a182-4ac0-a484-f174f64ca021" Sep 18 08:07:51.593751 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:51.593714 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-qmmgl"] Sep 18 08:07:51.593907 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:51.593835 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qmmgl" Sep 18 08:07:51.594346 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:07:51.593985 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qmmgl" podUID="97cadd54-3234-4e3f-a2bf-c96b134566b1" Sep 18 08:07:51.595183 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:51.595161 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6rnbm"] Sep 18 08:07:51.595283 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:51.595262 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6rnbm" Sep 18 08:07:51.595371 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:07:51.595348 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6rnbm" podUID="8d257247-8dae-4dce-9c31-62cf736b2b9f" Sep 18 08:07:52.938796 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:52.938623 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6rnbm" Sep 18 08:07:52.939183 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:52.938636 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9vz5k" Sep 18 08:07:52.939183 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:07:52.938888 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6rnbm" podUID="8d257247-8dae-4dce-9c31-62cf736b2b9f" Sep 18 08:07:52.939183 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:07:52.938956 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9vz5k" podUID="b6e0d1e7-a182-4ac0-a484-f174f64ca021" Sep 18 08:07:53.938781 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:53.938750 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qmmgl" Sep 18 08:07:53.938935 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:07:53.938879 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qmmgl" podUID="97cadd54-3234-4e3f-a2bf-c96b134566b1" Sep 18 08:07:54.938630 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:54.938601 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9vz5k" Sep 18 08:07:54.938809 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:07:54.938702 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9vz5k" podUID="b6e0d1e7-a182-4ac0-a484-f174f64ca021" Sep 18 08:07:54.938809 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:54.938755 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6rnbm" Sep 18 08:07:54.938920 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:07:54.938840 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6rnbm" podUID="8d257247-8dae-4dce-9c31-62cf736b2b9f" Sep 18 08:07:55.939064 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:55.939031 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qmmgl" Sep 18 08:07:55.939451 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:07:55.939146 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qmmgl" podUID="97cadd54-3234-4e3f-a2bf-c96b134566b1" Sep 18 08:07:56.252392 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:56.252330 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-42.ec2.internal" event="NodeReady" Sep 18 08:07:56.252498 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:56.252435 2585 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 18 08:07:56.297921 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:56.297894 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-zb5n2"] Sep 18 08:07:56.312989 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:56.312968 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-dp9kd"] Sep 18 08:07:56.313139 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:56.313108 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-zb5n2" Sep 18 08:07:56.315967 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:56.315945 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 18 08:07:56.316081 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:56.315989 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 18 08:07:56.316081 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:56.315968 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 18 08:07:56.316200 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:56.316090 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-cw8f8\"" Sep 18 08:07:56.326922 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:56.326904 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-zb5n2"] Sep 18 08:07:56.327002 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:56.326936 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-dp9kd"] Sep 18 08:07:56.327040 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:56.327016 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-dp9kd" Sep 18 08:07:56.329562 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:56.329541 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 18 08:07:56.329562 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:56.329560 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 18 08:07:56.329710 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:56.329590 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 18 08:07:56.329773 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:56.329724 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 18 08:07:56.329890 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:56.329873 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-zwvfn\"" Sep 18 08:07:56.397135 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:56.397113 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-sgft8"] Sep 18 08:07:56.416809 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:56.416791 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-sgft8" Sep 18 08:07:56.419855 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:56.419829 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 18 08:07:56.420595 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:56.420576 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 18 08:07:56.421042 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:56.421025 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-smtr4\"" Sep 18 08:07:56.421495 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:56.421475 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-sgft8"] Sep 18 08:07:56.497262 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:56.497235 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vnfnh\" (UniqueName: \"kubernetes.io/projected/34060a52-4e15-44ce-9044-143f8be28571-kube-api-access-vnfnh\") pod \"ingress-canary-zb5n2\" (UID: \"34060a52-4e15-44ce-9044-143f8be28571\") " pod="openshift-ingress-canary/ingress-canary-zb5n2" Sep 18 08:07:56.497361 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:56.497281 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/34060a52-4e15-44ce-9044-143f8be28571-cert\") pod \"ingress-canary-zb5n2\" (UID: \"34060a52-4e15-44ce-9044-143f8be28571\") " pod="openshift-ingress-canary/ingress-canary-zb5n2" Sep 18 08:07:56.497361 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:56.497322 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/694f168d-57b8-4c0b-bf70-a0b8efb05306-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dp9kd\" (UID: \"694f168d-57b8-4c0b-bf70-a0b8efb05306\") " pod="openshift-insights/insights-runtime-extractor-dp9kd" Sep 18 08:07:56.497473 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:56.497388 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/694f168d-57b8-4c0b-bf70-a0b8efb05306-data-volume\") pod \"insights-runtime-extractor-dp9kd\" (UID: \"694f168d-57b8-4c0b-bf70-a0b8efb05306\") " pod="openshift-insights/insights-runtime-extractor-dp9kd" Sep 18 08:07:56.497473 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:56.497427 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/694f168d-57b8-4c0b-bf70-a0b8efb05306-crio-socket\") pod \"insights-runtime-extractor-dp9kd\" (UID: \"694f168d-57b8-4c0b-bf70-a0b8efb05306\") " pod="openshift-insights/insights-runtime-extractor-dp9kd" Sep 18 08:07:56.497574 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:56.497472 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pjtpc\" (UniqueName: \"kubernetes.io/projected/694f168d-57b8-4c0b-bf70-a0b8efb05306-kube-api-access-pjtpc\") pod \"insights-runtime-extractor-dp9kd\" (UID: \"694f168d-57b8-4c0b-bf70-a0b8efb05306\") " pod="openshift-insights/insights-runtime-extractor-dp9kd" Sep 18 08:07:56.497574 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:56.497505 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/694f168d-57b8-4c0b-bf70-a0b8efb05306-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dp9kd\" (UID: \"694f168d-57b8-4c0b-bf70-a0b8efb05306\") " pod="openshift-insights/insights-runtime-extractor-dp9kd" Sep 18 08:07:56.598579 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:56.598559 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9089de9c-a355-499b-9cd1-60bad78ef458-metrics-tls\") pod \"dns-default-sgft8\" (UID: \"9089de9c-a355-499b-9cd1-60bad78ef458\") " pod="openshift-dns/dns-default-sgft8" Sep 18 08:07:56.598689 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:56.598589 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjtpc\" (UniqueName: \"kubernetes.io/projected/694f168d-57b8-4c0b-bf70-a0b8efb05306-kube-api-access-pjtpc\") pod \"insights-runtime-extractor-dp9kd\" (UID: \"694f168d-57b8-4c0b-bf70-a0b8efb05306\") " pod="openshift-insights/insights-runtime-extractor-dp9kd" Sep 18 08:07:56.598689 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:56.598611 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/694f168d-57b8-4c0b-bf70-a0b8efb05306-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dp9kd\" (UID: \"694f168d-57b8-4c0b-bf70-a0b8efb05306\") " pod="openshift-insights/insights-runtime-extractor-dp9kd" Sep 18 08:07:56.598689 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:56.598628 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vnfnh\" (UniqueName: \"kubernetes.io/projected/34060a52-4e15-44ce-9044-143f8be28571-kube-api-access-vnfnh\") pod \"ingress-canary-zb5n2\" (UID: \"34060a52-4e15-44ce-9044-143f8be28571\") " pod="openshift-ingress-canary/ingress-canary-zb5n2" Sep 18 08:07:56.598689 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:56.598651 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/34060a52-4e15-44ce-9044-143f8be28571-cert\") pod \"ingress-canary-zb5n2\" (UID: \"34060a52-4e15-44ce-9044-143f8be28571\") " pod="openshift-ingress-canary/ingress-canary-zb5n2" Sep 18 08:07:56.598689 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:56.598669 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/694f168d-57b8-4c0b-bf70-a0b8efb05306-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dp9kd\" (UID: \"694f168d-57b8-4c0b-bf70-a0b8efb05306\") " pod="openshift-insights/insights-runtime-extractor-dp9kd" Sep 18 08:07:56.598970 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:56.598769 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9089de9c-a355-499b-9cd1-60bad78ef458-config-volume\") pod \"dns-default-sgft8\" (UID: \"9089de9c-a355-499b-9cd1-60bad78ef458\") " pod="openshift-dns/dns-default-sgft8" Sep 18 08:07:56.598970 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:56.598820 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9089de9c-a355-499b-9cd1-60bad78ef458-tmp-dir\") pod \"dns-default-sgft8\" (UID: \"9089de9c-a355-499b-9cd1-60bad78ef458\") " pod="openshift-dns/dns-default-sgft8" Sep 18 08:07:56.598970 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:56.598899 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/694f168d-57b8-4c0b-bf70-a0b8efb05306-data-volume\") pod \"insights-runtime-extractor-dp9kd\" (UID: \"694f168d-57b8-4c0b-bf70-a0b8efb05306\") " pod="openshift-insights/insights-runtime-extractor-dp9kd" Sep 18 08:07:56.598970 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:56.598925 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4lr5c\" (UniqueName: \"kubernetes.io/projected/9089de9c-a355-499b-9cd1-60bad78ef458-kube-api-access-4lr5c\") pod \"dns-default-sgft8\" (UID: \"9089de9c-a355-499b-9cd1-60bad78ef458\") " pod="openshift-dns/dns-default-sgft8" Sep 18 08:07:56.598970 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:56.598958 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/694f168d-57b8-4c0b-bf70-a0b8efb05306-crio-socket\") pod \"insights-runtime-extractor-dp9kd\" (UID: \"694f168d-57b8-4c0b-bf70-a0b8efb05306\") " pod="openshift-insights/insights-runtime-extractor-dp9kd" Sep 18 08:07:56.599182 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:56.599137 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/694f168d-57b8-4c0b-bf70-a0b8efb05306-crio-socket\") pod \"insights-runtime-extractor-dp9kd\" (UID: \"694f168d-57b8-4c0b-bf70-a0b8efb05306\") " pod="openshift-insights/insights-runtime-extractor-dp9kd" Sep 18 08:07:56.599238 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:56.599218 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/694f168d-57b8-4c0b-bf70-a0b8efb05306-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dp9kd\" (UID: \"694f168d-57b8-4c0b-bf70-a0b8efb05306\") " pod="openshift-insights/insights-runtime-extractor-dp9kd" Sep 18 08:07:56.599276 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:56.599223 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/694f168d-57b8-4c0b-bf70-a0b8efb05306-data-volume\") pod \"insights-runtime-extractor-dp9kd\" (UID: \"694f168d-57b8-4c0b-bf70-a0b8efb05306\") " pod="openshift-insights/insights-runtime-extractor-dp9kd" Sep 18 08:07:56.602910 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:56.602887 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/694f168d-57b8-4c0b-bf70-a0b8efb05306-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dp9kd\" (UID: \"694f168d-57b8-4c0b-bf70-a0b8efb05306\") " pod="openshift-insights/insights-runtime-extractor-dp9kd" Sep 18 08:07:56.602996 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:56.602940 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/34060a52-4e15-44ce-9044-143f8be28571-cert\") pod \"ingress-canary-zb5n2\" (UID: \"34060a52-4e15-44ce-9044-143f8be28571\") " pod="openshift-ingress-canary/ingress-canary-zb5n2" Sep 18 08:07:56.607144 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:56.607123 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pjtpc\" (UniqueName: \"kubernetes.io/projected/694f168d-57b8-4c0b-bf70-a0b8efb05306-kube-api-access-pjtpc\") pod \"insights-runtime-extractor-dp9kd\" (UID: \"694f168d-57b8-4c0b-bf70-a0b8efb05306\") " pod="openshift-insights/insights-runtime-extractor-dp9kd" Sep 18 08:07:56.607371 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:56.607350 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vnfnh\" (UniqueName: \"kubernetes.io/projected/34060a52-4e15-44ce-9044-143f8be28571-kube-api-access-vnfnh\") pod \"ingress-canary-zb5n2\" (UID: \"34060a52-4e15-44ce-9044-143f8be28571\") " pod="openshift-ingress-canary/ingress-canary-zb5n2" Sep 18 08:07:56.624132 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:56.624109 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-zb5n2" Sep 18 08:07:56.634219 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:56.634205 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-dp9kd" Sep 18 08:07:56.699513 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:56.699476 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9089de9c-a355-499b-9cd1-60bad78ef458-tmp-dir\") pod \"dns-default-sgft8\" (UID: \"9089de9c-a355-499b-9cd1-60bad78ef458\") " pod="openshift-dns/dns-default-sgft8" Sep 18 08:07:56.699628 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:56.699547 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4lr5c\" (UniqueName: \"kubernetes.io/projected/9089de9c-a355-499b-9cd1-60bad78ef458-kube-api-access-4lr5c\") pod \"dns-default-sgft8\" (UID: \"9089de9c-a355-499b-9cd1-60bad78ef458\") " pod="openshift-dns/dns-default-sgft8" Sep 18 08:07:56.699628 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:56.699611 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9089de9c-a355-499b-9cd1-60bad78ef458-metrics-tls\") pod \"dns-default-sgft8\" (UID: \"9089de9c-a355-499b-9cd1-60bad78ef458\") " pod="openshift-dns/dns-default-sgft8" Sep 18 08:07:56.699712 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:56.699675 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9089de9c-a355-499b-9cd1-60bad78ef458-config-volume\") pod \"dns-default-sgft8\" (UID: \"9089de9c-a355-499b-9cd1-60bad78ef458\") " pod="openshift-dns/dns-default-sgft8" Sep 18 08:07:56.699870 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:56.699829 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9089de9c-a355-499b-9cd1-60bad78ef458-tmp-dir\") pod \"dns-default-sgft8\" (UID: \"9089de9c-a355-499b-9cd1-60bad78ef458\") " pod="openshift-dns/dns-default-sgft8" Sep 18 08:07:56.700171 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:56.700150 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9089de9c-a355-499b-9cd1-60bad78ef458-config-volume\") pod \"dns-default-sgft8\" (UID: \"9089de9c-a355-499b-9cd1-60bad78ef458\") " pod="openshift-dns/dns-default-sgft8" Sep 18 08:07:56.702092 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:56.702063 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9089de9c-a355-499b-9cd1-60bad78ef458-metrics-tls\") pod \"dns-default-sgft8\" (UID: \"9089de9c-a355-499b-9cd1-60bad78ef458\") " pod="openshift-dns/dns-default-sgft8" Sep 18 08:07:56.708707 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:56.708687 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4lr5c\" (UniqueName: \"kubernetes.io/projected/9089de9c-a355-499b-9cd1-60bad78ef458-kube-api-access-4lr5c\") pod \"dns-default-sgft8\" (UID: \"9089de9c-a355-499b-9cd1-60bad78ef458\") " pod="openshift-dns/dns-default-sgft8" Sep 18 08:07:56.725654 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:56.725629 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-sgft8" Sep 18 08:07:56.938299 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:56.938247 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9vz5k" Sep 18 08:07:56.938708 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:56.938437 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6rnbm" Sep 18 08:07:56.941242 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:56.941219 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-4bfgf\"" Sep 18 08:07:56.941242 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:56.941230 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 18 08:07:56.941880 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:56.941458 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 18 08:07:56.957577 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:56.957551 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-zb5n2"] Sep 18 08:07:56.959964 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:56.959941 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-dp9kd"] Sep 18 08:07:56.964337 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:56.964308 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod694f168d_57b8_4c0b_bf70_a0b8efb05306.slice/crio-14841569d9350f3ccb0a1f7294ab9a661011eee4f1f9af561365cc06476e0011 WatchSource:0}: Error finding container 14841569d9350f3ccb0a1f7294ab9a661011eee4f1f9af561365cc06476e0011: Status 404 returned error can't find the container with id 14841569d9350f3ccb0a1f7294ab9a661011eee4f1f9af561365cc06476e0011 Sep 18 08:07:57.027735 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:57.027712 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-sgft8"] Sep 18 08:07:57.036770 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:07:57.036747 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9089de9c_a355_499b_9cd1_60bad78ef458.slice/crio-72546a199e233a3273377d9e1307f4cc160183e3410a3d9c43e96e4e293a790a WatchSource:0}: Error finding container 72546a199e233a3273377d9e1307f4cc160183e3410a3d9c43e96e4e293a790a: Status 404 returned error can't find the container with id 72546a199e233a3273377d9e1307f4cc160183e3410a3d9c43e96e4e293a790a Sep 18 08:07:57.141197 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:57.141169 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-sgft8" event={"ID":"9089de9c-a355-499b-9cd1-60bad78ef458","Type":"ContainerStarted","Data":"72546a199e233a3273377d9e1307f4cc160183e3410a3d9c43e96e4e293a790a"} Sep 18 08:07:57.142628 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:57.142600 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dp9kd" event={"ID":"694f168d-57b8-4c0b-bf70-a0b8efb05306","Type":"ContainerStarted","Data":"918e8ae03d143a3bdd16be4c5b071b00ba63a938f7064b8579fce10aba8566fe"} Sep 18 08:07:57.142708 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:57.142650 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dp9kd" event={"ID":"694f168d-57b8-4c0b-bf70-a0b8efb05306","Type":"ContainerStarted","Data":"14841569d9350f3ccb0a1f7294ab9a661011eee4f1f9af561365cc06476e0011"} Sep 18 08:07:57.143699 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:57.143680 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-zb5n2" event={"ID":"34060a52-4e15-44ce-9044-143f8be28571","Type":"ContainerStarted","Data":"273571fe08733d9fb7d7265a112b7bf0b151a31a38744c39b31403bdc0fb0fc5"} Sep 18 08:07:57.938497 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:57.938466 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qmmgl" Sep 18 08:07:57.941301 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:57.941273 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 18 08:07:57.942056 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:57.942032 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 18 08:07:57.942285 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:57.942266 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-fz876\"" Sep 18 08:07:59.150869 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:59.150824 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dp9kd" event={"ID":"694f168d-57b8-4c0b-bf70-a0b8efb05306","Type":"ContainerStarted","Data":"45926ddc60b24441a17da69ac6c9a57067477a3af3764aadc14555c0aa325799"} Sep 18 08:07:59.242959 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:59.242917 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7bd5d56d6-hnjwf"] Sep 18 08:07:59.256121 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:59.256096 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-hnjwf" Sep 18 08:07:59.256699 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:59.256673 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7bd5d56d6-hnjwf"] Sep 18 08:07:59.259712 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:59.259689 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 18 08:07:59.259861 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:59.259762 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Sep 18 08:07:59.260038 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:59.260021 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Sep 18 08:07:59.260132 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:59.260050 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 18 08:07:59.260189 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:59.260129 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-7h78v\"" Sep 18 08:07:59.260335 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:59.260321 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 18 08:07:59.315974 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:59.315945 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h2b6g\" (UniqueName: \"kubernetes.io/projected/b79f5fcc-eb77-43f6-b274-a22b7dbdec8c-kube-api-access-h2b6g\") pod \"prometheus-operator-7bd5d56d6-hnjwf\" (UID: \"b79f5fcc-eb77-43f6-b274-a22b7dbdec8c\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-hnjwf" Sep 18 08:07:59.316162 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:59.316060 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b79f5fcc-eb77-43f6-b274-a22b7dbdec8c-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7bd5d56d6-hnjwf\" (UID: \"b79f5fcc-eb77-43f6-b274-a22b7dbdec8c\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-hnjwf" Sep 18 08:07:59.316162 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:59.316096 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/b79f5fcc-eb77-43f6-b274-a22b7dbdec8c-prometheus-operator-tls\") pod \"prometheus-operator-7bd5d56d6-hnjwf\" (UID: \"b79f5fcc-eb77-43f6-b274-a22b7dbdec8c\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-hnjwf" Sep 18 08:07:59.316162 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:59.316132 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b79f5fcc-eb77-43f6-b274-a22b7dbdec8c-metrics-client-ca\") pod \"prometheus-operator-7bd5d56d6-hnjwf\" (UID: \"b79f5fcc-eb77-43f6-b274-a22b7dbdec8c\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-hnjwf" Sep 18 08:07:59.416918 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:59.416833 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h2b6g\" (UniqueName: \"kubernetes.io/projected/b79f5fcc-eb77-43f6-b274-a22b7dbdec8c-kube-api-access-h2b6g\") pod \"prometheus-operator-7bd5d56d6-hnjwf\" (UID: \"b79f5fcc-eb77-43f6-b274-a22b7dbdec8c\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-hnjwf" Sep 18 08:07:59.417103 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:59.416949 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b79f5fcc-eb77-43f6-b274-a22b7dbdec8c-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7bd5d56d6-hnjwf\" (UID: \"b79f5fcc-eb77-43f6-b274-a22b7dbdec8c\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-hnjwf" Sep 18 08:07:59.417103 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:59.416993 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/b79f5fcc-eb77-43f6-b274-a22b7dbdec8c-prometheus-operator-tls\") pod \"prometheus-operator-7bd5d56d6-hnjwf\" (UID: \"b79f5fcc-eb77-43f6-b274-a22b7dbdec8c\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-hnjwf" Sep 18 08:07:59.417103 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:59.417029 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b79f5fcc-eb77-43f6-b274-a22b7dbdec8c-metrics-client-ca\") pod \"prometheus-operator-7bd5d56d6-hnjwf\" (UID: \"b79f5fcc-eb77-43f6-b274-a22b7dbdec8c\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-hnjwf" Sep 18 08:07:59.417262 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:07:59.417173 2585 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Sep 18 08:07:59.417262 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:07:59.417247 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b79f5fcc-eb77-43f6-b274-a22b7dbdec8c-prometheus-operator-tls podName:b79f5fcc-eb77-43f6-b274-a22b7dbdec8c nodeName:}" failed. No retries permitted until 2026-09-18 08:07:59.917229156 +0000 UTC m=+52.186929085 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/b79f5fcc-eb77-43f6-b274-a22b7dbdec8c-prometheus-operator-tls") pod "prometheus-operator-7bd5d56d6-hnjwf" (UID: "b79f5fcc-eb77-43f6-b274-a22b7dbdec8c") : secret "prometheus-operator-tls" not found Sep 18 08:07:59.417713 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:59.417691 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b79f5fcc-eb77-43f6-b274-a22b7dbdec8c-metrics-client-ca\") pod \"prometheus-operator-7bd5d56d6-hnjwf\" (UID: \"b79f5fcc-eb77-43f6-b274-a22b7dbdec8c\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-hnjwf" Sep 18 08:07:59.420529 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:59.420499 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b79f5fcc-eb77-43f6-b274-a22b7dbdec8c-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7bd5d56d6-hnjwf\" (UID: \"b79f5fcc-eb77-43f6-b274-a22b7dbdec8c\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-hnjwf" Sep 18 08:07:59.432653 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:59.432631 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h2b6g\" (UniqueName: \"kubernetes.io/projected/b79f5fcc-eb77-43f6-b274-a22b7dbdec8c-kube-api-access-h2b6g\") pod \"prometheus-operator-7bd5d56d6-hnjwf\" (UID: \"b79f5fcc-eb77-43f6-b274-a22b7dbdec8c\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-hnjwf" Sep 18 08:07:59.919564 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:59.919525 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/b79f5fcc-eb77-43f6-b274-a22b7dbdec8c-prometheus-operator-tls\") pod \"prometheus-operator-7bd5d56d6-hnjwf\" (UID: \"b79f5fcc-eb77-43f6-b274-a22b7dbdec8c\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-hnjwf" Sep 18 08:07:59.923081 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:07:59.923056 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/b79f5fcc-eb77-43f6-b274-a22b7dbdec8c-prometheus-operator-tls\") pod \"prometheus-operator-7bd5d56d6-hnjwf\" (UID: \"b79f5fcc-eb77-43f6-b274-a22b7dbdec8c\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-hnjwf" Sep 18 08:08:00.167703 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:00.167671 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-hnjwf" Sep 18 08:08:00.957123 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:00.956856 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7bd5d56d6-hnjwf"] Sep 18 08:08:00.976822 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:08:00.976791 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb79f5fcc_eb77_43f6_b274_a22b7dbdec8c.slice/crio-cda8e734d20e61725ee265346cc4768cca3070521ada937f937abcd2b3063967 WatchSource:0}: Error finding container cda8e734d20e61725ee265346cc4768cca3070521ada937f937abcd2b3063967: Status 404 returned error can't find the container with id cda8e734d20e61725ee265346cc4768cca3070521ada937f937abcd2b3063967 Sep 18 08:08:01.158078 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:01.158047 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-zb5n2" event={"ID":"34060a52-4e15-44ce-9044-143f8be28571","Type":"ContainerStarted","Data":"7553db365cb0a430a05e153f4aa11a5864f9779ce7843198ce2d8660b48a2718"} Sep 18 08:08:01.159275 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:01.159248 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-hnjwf" event={"ID":"b79f5fcc-eb77-43f6-b274-a22b7dbdec8c","Type":"ContainerStarted","Data":"cda8e734d20e61725ee265346cc4768cca3070521ada937f937abcd2b3063967"} Sep 18 08:08:01.160997 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:01.160965 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-sgft8" event={"ID":"9089de9c-a355-499b-9cd1-60bad78ef458","Type":"ContainerStarted","Data":"4bf587ef370da714d08611085e7ce19917ef918e7c5d64d6b50e324e5b55b51d"} Sep 18 08:08:01.161092 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:01.161011 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-sgft8" event={"ID":"9089de9c-a355-499b-9cd1-60bad78ef458","Type":"ContainerStarted","Data":"bda799d126aac41b67787f24934190ea022101fb0fcde5a16856689d098160b0"} Sep 18 08:08:01.161150 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:01.161137 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-sgft8" Sep 18 08:08:01.162963 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:01.162945 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dp9kd" event={"ID":"694f168d-57b8-4c0b-bf70-a0b8efb05306","Type":"ContainerStarted","Data":"fb8c49b73c7a4d0cbe7c6449aa0c0b59d13f683d4cde6a24d440336f68e58cb9"} Sep 18 08:08:01.179213 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:01.179164 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-zb5n2" podStartSLOduration=1.460826264 podStartE2EDuration="5.179149263s" totalImagesPullingTime="3.718322999s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 08:07:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 08:08:01.178703346 +0000 UTC m=+53.448403274" watchObservedRunningTime="2026-09-18 08:08:01.179149263 +0000 UTC m=+53.448849193" Sep 18 08:08:01.197110 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:01.197069 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-sgft8" podStartSLOduration=1.552115652 podStartE2EDuration="5.197055746s" totalImagesPullingTime="3.644940094s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 08:07:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 08:08:01.196535248 +0000 UTC m=+53.466235190" watchObservedRunningTime="2026-09-18 08:08:01.197055746 +0000 UTC m=+53.466755671" Sep 18 08:08:01.214658 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:01.214587 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-dp9kd" podStartSLOduration=1.415801235 podStartE2EDuration="5.214576855s" totalImagesPullingTime="3.79877562s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 08:07:56 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 08:08:01.213783817 +0000 UTC m=+53.483483748" watchObservedRunningTime="2026-09-18 08:08:01.214576855 +0000 UTC m=+53.484276775" Sep 18 08:08:03.175786 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:03.175697 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-hnjwf" event={"ID":"b79f5fcc-eb77-43f6-b274-a22b7dbdec8c","Type":"ContainerStarted","Data":"326b68c84655ac34b427cd69d249860f96afa2f1431ed97ba367754b05447b09"} Sep 18 08:08:03.175786 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:03.175785 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-hnjwf" event={"ID":"b79f5fcc-eb77-43f6-b274-a22b7dbdec8c","Type":"ContainerStarted","Data":"8853d2de6fde33e08dba4622a867fc53705b672bdbacc72a686ab8d88c695065"} Sep 18 08:08:03.196743 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:03.196701 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-hnjwf" podStartSLOduration=2.40501336 podStartE2EDuration="4.196687393s" totalImagesPullingTime="1.791674033s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 08:07:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 08:08:03.196008672 +0000 UTC m=+55.465708601" watchObservedRunningTime="2026-09-18 08:08:03.196687393 +0000 UTC m=+55.466387322" Sep 18 08:08:04.690167 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:04.690134 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-84c885658c-wfr6k"] Sep 18 08:08:04.712577 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:04.712539 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-84c885658c-wfr6k"] Sep 18 08:08:04.712751 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:04.712650 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-84c885658c-wfr6k" Sep 18 08:08:04.715411 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:04.715380 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Sep 18 08:08:04.715411 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:04.715380 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-cdh6f\"" Sep 18 08:08:04.715594 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:04.715580 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Sep 18 08:08:04.716483 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:04.716464 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Sep 18 08:08:04.737167 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:04.737143 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-86c5bc79d6-q2zl7"] Sep 18 08:08:04.754678 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:04.754655 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-86c5bc79d6-q2zl7"] Sep 18 08:08:04.754813 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:04.754750 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-q2zl7" Sep 18 08:08:04.754911 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:04.754813 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r6wsl\" (UniqueName: \"kubernetes.io/projected/88ed125b-8189-4544-ac91-d69a10721b8c-kube-api-access-r6wsl\") pod \"kube-state-metrics-84c885658c-wfr6k\" (UID: \"88ed125b-8189-4544-ac91-d69a10721b8c\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-wfr6k" Sep 18 08:08:04.754911 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:04.754875 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/88ed125b-8189-4544-ac91-d69a10721b8c-kube-state-metrics-tls\") pod \"kube-state-metrics-84c885658c-wfr6k\" (UID: \"88ed125b-8189-4544-ac91-d69a10721b8c\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-wfr6k" Sep 18 08:08:04.755026 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:04.754911 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/88ed125b-8189-4544-ac91-d69a10721b8c-metrics-client-ca\") pod \"kube-state-metrics-84c885658c-wfr6k\" (UID: \"88ed125b-8189-4544-ac91-d69a10721b8c\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-wfr6k" Sep 18 08:08:04.755026 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:04.754989 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/88ed125b-8189-4544-ac91-d69a10721b8c-volume-directive-shadow\") pod \"kube-state-metrics-84c885658c-wfr6k\" (UID: \"88ed125b-8189-4544-ac91-d69a10721b8c\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-wfr6k" Sep 18 08:08:04.755126 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:04.755043 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/88ed125b-8189-4544-ac91-d69a10721b8c-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-84c885658c-wfr6k\" (UID: \"88ed125b-8189-4544-ac91-d69a10721b8c\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-wfr6k" Sep 18 08:08:04.755126 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:04.755086 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/88ed125b-8189-4544-ac91-d69a10721b8c-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-84c885658c-wfr6k\" (UID: \"88ed125b-8189-4544-ac91-d69a10721b8c\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-wfr6k" Sep 18 08:08:04.758252 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:04.758228 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-b6f8p\"" Sep 18 08:08:04.758507 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:04.758491 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Sep 18 08:08:04.758708 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:04.758678 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Sep 18 08:08:04.772811 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:04.772792 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-76vv5"] Sep 18 08:08:04.792705 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:04.792683 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-76vv5" Sep 18 08:08:04.794989 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:04.794972 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-rtw9j\"" Sep 18 08:08:04.795106 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:04.795091 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 18 08:08:04.795175 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:04.795095 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 18 08:08:04.795371 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:04.795355 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 18 08:08:04.815718 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:04.815695 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-66bbdc9c7f-rklml"] Sep 18 08:08:04.830809 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:04.830789 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66bbdc9c7f-rklml" Sep 18 08:08:04.833002 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:04.832972 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-66bbdc9c7f-rklml"] Sep 18 08:08:04.833830 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:04.833810 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Sep 18 08:08:04.834021 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:04.833990 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Sep 18 08:08:04.834021 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:04.833999 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Sep 18 08:08:04.834152 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:04.833998 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Sep 18 08:08:04.834152 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:04.834073 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-7m5vx\"" Sep 18 08:08:04.834152 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:04.834106 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Sep 18 08:08:04.834152 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:04.834126 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Sep 18 08:08:04.834320 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:04.834212 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Sep 18 08:08:04.856069 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:04.856043 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/88ed125b-8189-4544-ac91-d69a10721b8c-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-84c885658c-wfr6k\" (UID: \"88ed125b-8189-4544-ac91-d69a10721b8c\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-wfr6k" Sep 18 08:08:04.856173 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:04.856081 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1e301fcf-dcde-48d6-9ac9-cf2bb026c820-root\") pod \"node-exporter-76vv5\" (UID: \"1e301fcf-dcde-48d6-9ac9-cf2bb026c820\") " pod="openshift-monitoring/node-exporter-76vv5" Sep 18 08:08:04.856173 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:04.856103 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1e301fcf-dcde-48d6-9ac9-cf2bb026c820-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-76vv5\" (UID: \"1e301fcf-dcde-48d6-9ac9-cf2bb026c820\") " pod="openshift-monitoring/node-exporter-76vv5" Sep 18 08:08:04.856173 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:04.856132 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1e301fcf-dcde-48d6-9ac9-cf2bb026c820-metrics-client-ca\") pod \"node-exporter-76vv5\" (UID: \"1e301fcf-dcde-48d6-9ac9-cf2bb026c820\") " pod="openshift-monitoring/node-exporter-76vv5" Sep 18 08:08:04.856326 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:04.856179 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1e301fcf-dcde-48d6-9ac9-cf2bb026c820-node-exporter-tls\") pod \"node-exporter-76vv5\" (UID: \"1e301fcf-dcde-48d6-9ac9-cf2bb026c820\") " pod="openshift-monitoring/node-exporter-76vv5" Sep 18 08:08:04.856326 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:04.856211 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2f0bb4e9-f8cc-4b04-a0f7-a2bdde20ddc8-openshift-state-metrics-tls\") pod \"openshift-state-metrics-86c5bc79d6-q2zl7\" (UID: \"2f0bb4e9-f8cc-4b04-a0f7-a2bdde20ddc8\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-q2zl7" Sep 18 08:08:04.856326 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:04.856299 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1e301fcf-dcde-48d6-9ac9-cf2bb026c820-sys\") pod \"node-exporter-76vv5\" (UID: \"1e301fcf-dcde-48d6-9ac9-cf2bb026c820\") " pod="openshift-monitoring/node-exporter-76vv5" Sep 18 08:08:04.856440 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:04.856329 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hjw6d\" (UniqueName: \"kubernetes.io/projected/2f0bb4e9-f8cc-4b04-a0f7-a2bdde20ddc8-kube-api-access-hjw6d\") pod \"openshift-state-metrics-86c5bc79d6-q2zl7\" (UID: \"2f0bb4e9-f8cc-4b04-a0f7-a2bdde20ddc8\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-q2zl7" Sep 18 08:08:04.856440 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:04.856362 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1e301fcf-dcde-48d6-9ac9-cf2bb026c820-node-exporter-wtmp\") pod \"node-exporter-76vv5\" (UID: \"1e301fcf-dcde-48d6-9ac9-cf2bb026c820\") " pod="openshift-monitoring/node-exporter-76vv5" Sep 18 08:08:04.856440 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:04.856403 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xbtdk\" (UniqueName: \"kubernetes.io/projected/2aa01fbe-57ff-4d1e-9728-91ff8382f85c-kube-api-access-xbtdk\") pod \"console-66bbdc9c7f-rklml\" (UID: \"2aa01fbe-57ff-4d1e-9728-91ff8382f85c\") " pod="openshift-console/console-66bbdc9c7f-rklml" Sep 18 08:08:04.856528 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:04.856439 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1e301fcf-dcde-48d6-9ac9-cf2bb026c820-node-exporter-textfile\") pod \"node-exporter-76vv5\" (UID: \"1e301fcf-dcde-48d6-9ac9-cf2bb026c820\") " pod="openshift-monitoring/node-exporter-76vv5" Sep 18 08:08:04.856528 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:04.856459 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nljwz\" (UniqueName: \"kubernetes.io/projected/1e301fcf-dcde-48d6-9ac9-cf2bb026c820-kube-api-access-nljwz\") pod \"node-exporter-76vv5\" (UID: \"1e301fcf-dcde-48d6-9ac9-cf2bb026c820\") " pod="openshift-monitoring/node-exporter-76vv5" Sep 18 08:08:04.856528 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:04.856479 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2aa01fbe-57ff-4d1e-9728-91ff8382f85c-console-config\") pod \"console-66bbdc9c7f-rklml\" (UID: \"2aa01fbe-57ff-4d1e-9728-91ff8382f85c\") " pod="openshift-console/console-66bbdc9c7f-rklml" Sep 18 08:08:04.856528 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:04.856522 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2aa01fbe-57ff-4d1e-9728-91ff8382f85c-console-serving-cert\") pod \"console-66bbdc9c7f-rklml\" (UID: \"2aa01fbe-57ff-4d1e-9728-91ff8382f85c\") " pod="openshift-console/console-66bbdc9c7f-rklml" Sep 18 08:08:04.856645 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:04.856556 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2aa01fbe-57ff-4d1e-9728-91ff8382f85c-oauth-serving-cert\") pod \"console-66bbdc9c7f-rklml\" (UID: \"2aa01fbe-57ff-4d1e-9728-91ff8382f85c\") " pod="openshift-console/console-66bbdc9c7f-rklml" Sep 18 08:08:04.856645 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:04.856583 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2f0bb4e9-f8cc-4b04-a0f7-a2bdde20ddc8-metrics-client-ca\") pod \"openshift-state-metrics-86c5bc79d6-q2zl7\" (UID: \"2f0bb4e9-f8cc-4b04-a0f7-a2bdde20ddc8\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-q2zl7" Sep 18 08:08:04.856645 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:04.856615 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/88ed125b-8189-4544-ac91-d69a10721b8c-metrics-client-ca\") pod \"kube-state-metrics-84c885658c-wfr6k\" (UID: \"88ed125b-8189-4544-ac91-d69a10721b8c\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-wfr6k" Sep 18 08:08:04.856645 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:04.856635 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2aa01fbe-57ff-4d1e-9728-91ff8382f85c-console-oauth-config\") pod \"console-66bbdc9c7f-rklml\" (UID: \"2aa01fbe-57ff-4d1e-9728-91ff8382f85c\") " pod="openshift-console/console-66bbdc9c7f-rklml" Sep 18 08:08:04.856798 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:04.856657 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/88ed125b-8189-4544-ac91-d69a10721b8c-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-84c885658c-wfr6k\" (UID: \"88ed125b-8189-4544-ac91-d69a10721b8c\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-wfr6k" Sep 18 08:08:04.856798 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:04.856685 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/88ed125b-8189-4544-ac91-d69a10721b8c-volume-directive-shadow\") pod \"kube-state-metrics-84c885658c-wfr6k\" (UID: \"88ed125b-8189-4544-ac91-d69a10721b8c\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-wfr6k" Sep 18 08:08:04.856798 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:04.856740 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r6wsl\" (UniqueName: \"kubernetes.io/projected/88ed125b-8189-4544-ac91-d69a10721b8c-kube-api-access-r6wsl\") pod \"kube-state-metrics-84c885658c-wfr6k\" (UID: \"88ed125b-8189-4544-ac91-d69a10721b8c\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-wfr6k" Sep 18 08:08:04.856798 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:04.856767 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1e301fcf-dcde-48d6-9ac9-cf2bb026c820-node-exporter-accelerators-collector-config\") pod \"node-exporter-76vv5\" (UID: \"1e301fcf-dcde-48d6-9ac9-cf2bb026c820\") " pod="openshift-monitoring/node-exporter-76vv5" Sep 18 08:08:04.856798 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:04.856789 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2f0bb4e9-f8cc-4b04-a0f7-a2bdde20ddc8-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-86c5bc79d6-q2zl7\" (UID: \"2f0bb4e9-f8cc-4b04-a0f7-a2bdde20ddc8\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-q2zl7" Sep 18 08:08:04.857048 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:04.856818 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/88ed125b-8189-4544-ac91-d69a10721b8c-kube-state-metrics-tls\") pod \"kube-state-metrics-84c885658c-wfr6k\" (UID: \"88ed125b-8189-4544-ac91-d69a10721b8c\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-wfr6k" Sep 18 08:08:04.857048 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:04.856840 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2aa01fbe-57ff-4d1e-9728-91ff8382f85c-service-ca\") pod \"console-66bbdc9c7f-rklml\" (UID: \"2aa01fbe-57ff-4d1e-9728-91ff8382f85c\") " pod="openshift-console/console-66bbdc9c7f-rklml" Sep 18 08:08:04.857048 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:04.857028 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/88ed125b-8189-4544-ac91-d69a10721b8c-volume-directive-shadow\") pod \"kube-state-metrics-84c885658c-wfr6k\" (UID: \"88ed125b-8189-4544-ac91-d69a10721b8c\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-wfr6k" Sep 18 08:08:04.857491 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:04.857464 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/88ed125b-8189-4544-ac91-d69a10721b8c-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-84c885658c-wfr6k\" (UID: \"88ed125b-8189-4544-ac91-d69a10721b8c\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-wfr6k" Sep 18 08:08:04.857672 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:04.857655 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/88ed125b-8189-4544-ac91-d69a10721b8c-metrics-client-ca\") pod \"kube-state-metrics-84c885658c-wfr6k\" (UID: \"88ed125b-8189-4544-ac91-d69a10721b8c\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-wfr6k" Sep 18 08:08:04.860530 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:04.860508 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/88ed125b-8189-4544-ac91-d69a10721b8c-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-84c885658c-wfr6k\" (UID: \"88ed125b-8189-4544-ac91-d69a10721b8c\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-wfr6k" Sep 18 08:08:04.860624 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:04.860546 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/88ed125b-8189-4544-ac91-d69a10721b8c-kube-state-metrics-tls\") pod \"kube-state-metrics-84c885658c-wfr6k\" (UID: \"88ed125b-8189-4544-ac91-d69a10721b8c\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-wfr6k" Sep 18 08:08:04.867511 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:04.867490 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r6wsl\" (UniqueName: \"kubernetes.io/projected/88ed125b-8189-4544-ac91-d69a10721b8c-kube-api-access-r6wsl\") pod \"kube-state-metrics-84c885658c-wfr6k\" (UID: \"88ed125b-8189-4544-ac91-d69a10721b8c\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-wfr6k" Sep 18 08:08:04.958209 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:04.958137 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2f0bb4e9-f8cc-4b04-a0f7-a2bdde20ddc8-metrics-client-ca\") pod \"openshift-state-metrics-86c5bc79d6-q2zl7\" (UID: \"2f0bb4e9-f8cc-4b04-a0f7-a2bdde20ddc8\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-q2zl7" Sep 18 08:08:04.958209 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:04.958174 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2aa01fbe-57ff-4d1e-9728-91ff8382f85c-console-oauth-config\") pod \"console-66bbdc9c7f-rklml\" (UID: \"2aa01fbe-57ff-4d1e-9728-91ff8382f85c\") " pod="openshift-console/console-66bbdc9c7f-rklml" Sep 18 08:08:04.958209 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:04.958209 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1e301fcf-dcde-48d6-9ac9-cf2bb026c820-node-exporter-accelerators-collector-config\") pod \"node-exporter-76vv5\" (UID: \"1e301fcf-dcde-48d6-9ac9-cf2bb026c820\") " pod="openshift-monitoring/node-exporter-76vv5" Sep 18 08:08:04.958454 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:04.958227 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2f0bb4e9-f8cc-4b04-a0f7-a2bdde20ddc8-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-86c5bc79d6-q2zl7\" (UID: \"2f0bb4e9-f8cc-4b04-a0f7-a2bdde20ddc8\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-q2zl7" Sep 18 08:08:04.958454 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:04.958246 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2aa01fbe-57ff-4d1e-9728-91ff8382f85c-service-ca\") pod \"console-66bbdc9c7f-rklml\" (UID: \"2aa01fbe-57ff-4d1e-9728-91ff8382f85c\") " pod="openshift-console/console-66bbdc9c7f-rklml" Sep 18 08:08:04.958454 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:04.958274 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1e301fcf-dcde-48d6-9ac9-cf2bb026c820-root\") pod \"node-exporter-76vv5\" (UID: \"1e301fcf-dcde-48d6-9ac9-cf2bb026c820\") " pod="openshift-monitoring/node-exporter-76vv5" Sep 18 08:08:04.958454 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:04.958291 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1e301fcf-dcde-48d6-9ac9-cf2bb026c820-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-76vv5\" (UID: \"1e301fcf-dcde-48d6-9ac9-cf2bb026c820\") " pod="openshift-monitoring/node-exporter-76vv5" Sep 18 08:08:04.958454 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:04.958308 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1e301fcf-dcde-48d6-9ac9-cf2bb026c820-metrics-client-ca\") pod \"node-exporter-76vv5\" (UID: \"1e301fcf-dcde-48d6-9ac9-cf2bb026c820\") " pod="openshift-monitoring/node-exporter-76vv5" Sep 18 08:08:04.958454 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:04.958330 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1e301fcf-dcde-48d6-9ac9-cf2bb026c820-node-exporter-tls\") pod \"node-exporter-76vv5\" (UID: \"1e301fcf-dcde-48d6-9ac9-cf2bb026c820\") " pod="openshift-monitoring/node-exporter-76vv5" Sep 18 08:08:04.958454 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:04.958385 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1e301fcf-dcde-48d6-9ac9-cf2bb026c820-root\") pod \"node-exporter-76vv5\" (UID: \"1e301fcf-dcde-48d6-9ac9-cf2bb026c820\") " pod="openshift-monitoring/node-exporter-76vv5" Sep 18 08:08:04.958454 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:04.958439 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2f0bb4e9-f8cc-4b04-a0f7-a2bdde20ddc8-openshift-state-metrics-tls\") pod \"openshift-state-metrics-86c5bc79d6-q2zl7\" (UID: \"2f0bb4e9-f8cc-4b04-a0f7-a2bdde20ddc8\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-q2zl7" Sep 18 08:08:04.958836 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:04.958475 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1e301fcf-dcde-48d6-9ac9-cf2bb026c820-sys\") pod \"node-exporter-76vv5\" (UID: \"1e301fcf-dcde-48d6-9ac9-cf2bb026c820\") " pod="openshift-monitoring/node-exporter-76vv5" Sep 18 08:08:04.958836 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:04.958498 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hjw6d\" (UniqueName: \"kubernetes.io/projected/2f0bb4e9-f8cc-4b04-a0f7-a2bdde20ddc8-kube-api-access-hjw6d\") pod \"openshift-state-metrics-86c5bc79d6-q2zl7\" (UID: \"2f0bb4e9-f8cc-4b04-a0f7-a2bdde20ddc8\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-q2zl7" Sep 18 08:08:04.958836 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:04.958520 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1e301fcf-dcde-48d6-9ac9-cf2bb026c820-node-exporter-wtmp\") pod \"node-exporter-76vv5\" (UID: \"1e301fcf-dcde-48d6-9ac9-cf2bb026c820\") " pod="openshift-monitoring/node-exporter-76vv5" Sep 18 08:08:04.958836 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:04.958542 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xbtdk\" (UniqueName: \"kubernetes.io/projected/2aa01fbe-57ff-4d1e-9728-91ff8382f85c-kube-api-access-xbtdk\") pod \"console-66bbdc9c7f-rklml\" (UID: \"2aa01fbe-57ff-4d1e-9728-91ff8382f85c\") " pod="openshift-console/console-66bbdc9c7f-rklml" Sep 18 08:08:04.958836 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:04.958569 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1e301fcf-dcde-48d6-9ac9-cf2bb026c820-node-exporter-textfile\") pod \"node-exporter-76vv5\" (UID: \"1e301fcf-dcde-48d6-9ac9-cf2bb026c820\") " pod="openshift-monitoring/node-exporter-76vv5" Sep 18 08:08:04.958836 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:04.958594 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nljwz\" (UniqueName: \"kubernetes.io/projected/1e301fcf-dcde-48d6-9ac9-cf2bb026c820-kube-api-access-nljwz\") pod \"node-exporter-76vv5\" (UID: \"1e301fcf-dcde-48d6-9ac9-cf2bb026c820\") " pod="openshift-monitoring/node-exporter-76vv5" Sep 18 08:08:04.958836 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:04.958618 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2aa01fbe-57ff-4d1e-9728-91ff8382f85c-console-config\") pod \"console-66bbdc9c7f-rklml\" (UID: \"2aa01fbe-57ff-4d1e-9728-91ff8382f85c\") " pod="openshift-console/console-66bbdc9c7f-rklml" Sep 18 08:08:04.958836 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:04.958649 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2aa01fbe-57ff-4d1e-9728-91ff8382f85c-console-serving-cert\") pod \"console-66bbdc9c7f-rklml\" (UID: \"2aa01fbe-57ff-4d1e-9728-91ff8382f85c\") " pod="openshift-console/console-66bbdc9c7f-rklml" Sep 18 08:08:04.958836 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:04.958686 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2aa01fbe-57ff-4d1e-9728-91ff8382f85c-oauth-serving-cert\") pod \"console-66bbdc9c7f-rklml\" (UID: \"2aa01fbe-57ff-4d1e-9728-91ff8382f85c\") " pod="openshift-console/console-66bbdc9c7f-rklml" Sep 18 08:08:04.959272 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:04.958871 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1e301fcf-dcde-48d6-9ac9-cf2bb026c820-node-exporter-accelerators-collector-config\") pod \"node-exporter-76vv5\" (UID: \"1e301fcf-dcde-48d6-9ac9-cf2bb026c820\") " pod="openshift-monitoring/node-exporter-76vv5" Sep 18 08:08:04.959272 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:04.958999 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2f0bb4e9-f8cc-4b04-a0f7-a2bdde20ddc8-metrics-client-ca\") pod \"openshift-state-metrics-86c5bc79d6-q2zl7\" (UID: \"2f0bb4e9-f8cc-4b04-a0f7-a2bdde20ddc8\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-q2zl7" Sep 18 08:08:04.959272 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:08:04.959229 2585 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Sep 18 08:08:04.959407 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:04.959286 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2aa01fbe-57ff-4d1e-9728-91ff8382f85c-service-ca\") pod \"console-66bbdc9c7f-rklml\" (UID: \"2aa01fbe-57ff-4d1e-9728-91ff8382f85c\") " pod="openshift-console/console-66bbdc9c7f-rklml" Sep 18 08:08:04.959407 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:08:04.959297 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f0bb4e9-f8cc-4b04-a0f7-a2bdde20ddc8-openshift-state-metrics-tls podName:2f0bb4e9-f8cc-4b04-a0f7-a2bdde20ddc8 nodeName:}" failed. No retries permitted until 2026-09-18 08:08:05.459279631 +0000 UTC m=+57.728979560 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/2f0bb4e9-f8cc-4b04-a0f7-a2bdde20ddc8-openshift-state-metrics-tls") pod "openshift-state-metrics-86c5bc79d6-q2zl7" (UID: "2f0bb4e9-f8cc-4b04-a0f7-a2bdde20ddc8") : secret "openshift-state-metrics-tls" not found Sep 18 08:08:04.959529 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:04.959509 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1e301fcf-dcde-48d6-9ac9-cf2bb026c820-node-exporter-wtmp\") pod \"node-exporter-76vv5\" (UID: \"1e301fcf-dcde-48d6-9ac9-cf2bb026c820\") " pod="openshift-monitoring/node-exporter-76vv5" Sep 18 08:08:04.960206 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:04.959568 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2aa01fbe-57ff-4d1e-9728-91ff8382f85c-oauth-serving-cert\") pod \"console-66bbdc9c7f-rklml\" (UID: \"2aa01fbe-57ff-4d1e-9728-91ff8382f85c\") " pod="openshift-console/console-66bbdc9c7f-rklml" Sep 18 08:08:04.960206 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:04.959574 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1e301fcf-dcde-48d6-9ac9-cf2bb026c820-sys\") pod \"node-exporter-76vv5\" (UID: \"1e301fcf-dcde-48d6-9ac9-cf2bb026c820\") " pod="openshift-monitoring/node-exporter-76vv5" Sep 18 08:08:04.960206 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:04.959739 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1e301fcf-dcde-48d6-9ac9-cf2bb026c820-node-exporter-textfile\") pod \"node-exporter-76vv5\" (UID: \"1e301fcf-dcde-48d6-9ac9-cf2bb026c820\") " pod="openshift-monitoring/node-exporter-76vv5" Sep 18 08:08:04.960206 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:04.959992 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1e301fcf-dcde-48d6-9ac9-cf2bb026c820-metrics-client-ca\") pod \"node-exporter-76vv5\" (UID: \"1e301fcf-dcde-48d6-9ac9-cf2bb026c820\") " pod="openshift-monitoring/node-exporter-76vv5" Sep 18 08:08:04.960455 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:04.960367 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2aa01fbe-57ff-4d1e-9728-91ff8382f85c-console-config\") pod \"console-66bbdc9c7f-rklml\" (UID: \"2aa01fbe-57ff-4d1e-9728-91ff8382f85c\") " pod="openshift-console/console-66bbdc9c7f-rklml" Sep 18 08:08:04.961335 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:04.961302 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2aa01fbe-57ff-4d1e-9728-91ff8382f85c-console-oauth-config\") pod \"console-66bbdc9c7f-rklml\" (UID: \"2aa01fbe-57ff-4d1e-9728-91ff8382f85c\") " pod="openshift-console/console-66bbdc9c7f-rklml" Sep 18 08:08:04.961439 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:04.961426 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2f0bb4e9-f8cc-4b04-a0f7-a2bdde20ddc8-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-86c5bc79d6-q2zl7\" (UID: \"2f0bb4e9-f8cc-4b04-a0f7-a2bdde20ddc8\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-q2zl7" Sep 18 08:08:04.961594 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:04.961572 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1e301fcf-dcde-48d6-9ac9-cf2bb026c820-node-exporter-tls\") pod \"node-exporter-76vv5\" (UID: \"1e301fcf-dcde-48d6-9ac9-cf2bb026c820\") " pod="openshift-monitoring/node-exporter-76vv5" Sep 18 08:08:04.961700 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:04.961683 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1e301fcf-dcde-48d6-9ac9-cf2bb026c820-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-76vv5\" (UID: \"1e301fcf-dcde-48d6-9ac9-cf2bb026c820\") " pod="openshift-monitoring/node-exporter-76vv5" Sep 18 08:08:04.962077 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:04.962061 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2aa01fbe-57ff-4d1e-9728-91ff8382f85c-console-serving-cert\") pod \"console-66bbdc9c7f-rklml\" (UID: \"2aa01fbe-57ff-4d1e-9728-91ff8382f85c\") " pod="openshift-console/console-66bbdc9c7f-rklml" Sep 18 08:08:04.968272 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:04.968250 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hjw6d\" (UniqueName: \"kubernetes.io/projected/2f0bb4e9-f8cc-4b04-a0f7-a2bdde20ddc8-kube-api-access-hjw6d\") pod \"openshift-state-metrics-86c5bc79d6-q2zl7\" (UID: \"2f0bb4e9-f8cc-4b04-a0f7-a2bdde20ddc8\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-q2zl7" Sep 18 08:08:04.968706 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:04.968688 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nljwz\" (UniqueName: \"kubernetes.io/projected/1e301fcf-dcde-48d6-9ac9-cf2bb026c820-kube-api-access-nljwz\") pod \"node-exporter-76vv5\" (UID: \"1e301fcf-dcde-48d6-9ac9-cf2bb026c820\") " pod="openshift-monitoring/node-exporter-76vv5" Sep 18 08:08:04.968888 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:04.968873 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xbtdk\" (UniqueName: \"kubernetes.io/projected/2aa01fbe-57ff-4d1e-9728-91ff8382f85c-kube-api-access-xbtdk\") pod \"console-66bbdc9c7f-rklml\" (UID: \"2aa01fbe-57ff-4d1e-9728-91ff8382f85c\") " pod="openshift-console/console-66bbdc9c7f-rklml" Sep 18 08:08:05.022078 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:05.022045 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-84c885658c-wfr6k" Sep 18 08:08:05.101197 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:05.101169 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-76vv5" Sep 18 08:08:05.137368 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:08:05.137339 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e301fcf_dcde_48d6_9ac9_cf2bb026c820.slice/crio-b135d01538228dc39e37e6ebdc8f24670b67b24e2333d6fe0a95df01b3b47c04 WatchSource:0}: Error finding container b135d01538228dc39e37e6ebdc8f24670b67b24e2333d6fe0a95df01b3b47c04: Status 404 returned error can't find the container with id b135d01538228dc39e37e6ebdc8f24670b67b24e2333d6fe0a95df01b3b47c04 Sep 18 08:08:05.139567 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:05.139454 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66bbdc9c7f-rklml" Sep 18 08:08:05.183355 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:05.183325 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-76vv5" event={"ID":"1e301fcf-dcde-48d6-9ac9-cf2bb026c820","Type":"ContainerStarted","Data":"b135d01538228dc39e37e6ebdc8f24670b67b24e2333d6fe0a95df01b3b47c04"} Sep 18 08:08:05.312145 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:05.312114 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-84c885658c-wfr6k"] Sep 18 08:08:05.315648 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:08:05.315622 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88ed125b_8189_4544_ac91_d69a10721b8c.slice/crio-911bed241c22138a1fa32c8741f76f606096860e10b8b38c841ffb097ffce701 WatchSource:0}: Error finding container 911bed241c22138a1fa32c8741f76f606096860e10b8b38c841ffb097ffce701: Status 404 returned error can't find the container with id 911bed241c22138a1fa32c8741f76f606096860e10b8b38c841ffb097ffce701 Sep 18 08:08:05.438617 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:05.438582 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-66bbdc9c7f-rklml"] Sep 18 08:08:05.441601 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:08:05.441575 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2aa01fbe_57ff_4d1e_9728_91ff8382f85c.slice/crio-6c396dea11b4cc679e844ab5e7ea99d091d58f524b70e7965088753c13f3e382 WatchSource:0}: Error finding container 6c396dea11b4cc679e844ab5e7ea99d091d58f524b70e7965088753c13f3e382: Status 404 returned error can't find the container with id 6c396dea11b4cc679e844ab5e7ea99d091d58f524b70e7965088753c13f3e382 Sep 18 08:08:05.462966 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:05.462907 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2f0bb4e9-f8cc-4b04-a0f7-a2bdde20ddc8-openshift-state-metrics-tls\") pod \"openshift-state-metrics-86c5bc79d6-q2zl7\" (UID: \"2f0bb4e9-f8cc-4b04-a0f7-a2bdde20ddc8\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-q2zl7" Sep 18 08:08:05.463056 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:08:05.463020 2585 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Sep 18 08:08:05.463095 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:08:05.463076 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f0bb4e9-f8cc-4b04-a0f7-a2bdde20ddc8-openshift-state-metrics-tls podName:2f0bb4e9-f8cc-4b04-a0f7-a2bdde20ddc8 nodeName:}" failed. No retries permitted until 2026-09-18 08:08:06.463061081 +0000 UTC m=+58.732761009 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/2f0bb4e9-f8cc-4b04-a0f7-a2bdde20ddc8-openshift-state-metrics-tls") pod "openshift-state-metrics-86c5bc79d6-q2zl7" (UID: "2f0bb4e9-f8cc-4b04-a0f7-a2bdde20ddc8") : secret "openshift-state-metrics-tls" not found Sep 18 08:08:05.788727 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:05.788692 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 18 08:08:05.820999 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:05.820971 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 18 08:08:05.821165 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:05.821086 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 18 08:08:05.823549 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:05.823526 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Sep 18 08:08:05.823692 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:05.823538 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Sep 18 08:08:05.824036 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:05.823822 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Sep 18 08:08:05.824036 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:05.823901 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Sep 18 08:08:05.824036 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:05.823916 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Sep 18 08:08:05.824036 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:05.823924 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Sep 18 08:08:05.824036 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:05.823919 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Sep 18 08:08:05.824338 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:05.824067 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Sep 18 08:08:05.824338 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:05.824071 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-6stn7\"" Sep 18 08:08:05.824338 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:05.824277 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Sep 18 08:08:05.865758 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:05.865230 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8daf0e48-a502-4b73-a0aa-74f9c20116d9-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8daf0e48-a502-4b73-a0aa-74f9c20116d9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 08:08:05.865758 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:05.865288 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8daf0e48-a502-4b73-a0aa-74f9c20116d9-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8daf0e48-a502-4b73-a0aa-74f9c20116d9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 08:08:05.865758 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:05.865311 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nwnjw\" (UniqueName: \"kubernetes.io/projected/8daf0e48-a502-4b73-a0aa-74f9c20116d9-kube-api-access-nwnjw\") pod \"alertmanager-main-0\" (UID: \"8daf0e48-a502-4b73-a0aa-74f9c20116d9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 08:08:05.865758 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:05.865343 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8daf0e48-a502-4b73-a0aa-74f9c20116d9-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8daf0e48-a502-4b73-a0aa-74f9c20116d9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 08:08:05.865758 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:05.865368 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8daf0e48-a502-4b73-a0aa-74f9c20116d9-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8daf0e48-a502-4b73-a0aa-74f9c20116d9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 08:08:05.865758 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:05.865425 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8daf0e48-a502-4b73-a0aa-74f9c20116d9-config-volume\") pod \"alertmanager-main-0\" (UID: \"8daf0e48-a502-4b73-a0aa-74f9c20116d9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 08:08:05.865758 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:05.865449 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8daf0e48-a502-4b73-a0aa-74f9c20116d9-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8daf0e48-a502-4b73-a0aa-74f9c20116d9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 08:08:05.865758 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:05.865476 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8daf0e48-a502-4b73-a0aa-74f9c20116d9-config-out\") pod \"alertmanager-main-0\" (UID: \"8daf0e48-a502-4b73-a0aa-74f9c20116d9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 08:08:05.865758 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:05.865509 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8daf0e48-a502-4b73-a0aa-74f9c20116d9-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8daf0e48-a502-4b73-a0aa-74f9c20116d9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 08:08:05.865758 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:05.865539 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8daf0e48-a502-4b73-a0aa-74f9c20116d9-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8daf0e48-a502-4b73-a0aa-74f9c20116d9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 08:08:05.865758 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:05.865560 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8daf0e48-a502-4b73-a0aa-74f9c20116d9-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8daf0e48-a502-4b73-a0aa-74f9c20116d9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 08:08:05.865758 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:05.865585 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8daf0e48-a502-4b73-a0aa-74f9c20116d9-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8daf0e48-a502-4b73-a0aa-74f9c20116d9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 08:08:05.865758 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:05.865606 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8daf0e48-a502-4b73-a0aa-74f9c20116d9-web-config\") pod \"alertmanager-main-0\" (UID: \"8daf0e48-a502-4b73-a0aa-74f9c20116d9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 08:08:05.966235 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:05.966205 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8daf0e48-a502-4b73-a0aa-74f9c20116d9-config-volume\") pod \"alertmanager-main-0\" (UID: \"8daf0e48-a502-4b73-a0aa-74f9c20116d9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 08:08:05.966235 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:05.966240 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8daf0e48-a502-4b73-a0aa-74f9c20116d9-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8daf0e48-a502-4b73-a0aa-74f9c20116d9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 08:08:05.966466 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:05.966260 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8daf0e48-a502-4b73-a0aa-74f9c20116d9-config-out\") pod \"alertmanager-main-0\" (UID: \"8daf0e48-a502-4b73-a0aa-74f9c20116d9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 08:08:05.966466 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:05.966295 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8daf0e48-a502-4b73-a0aa-74f9c20116d9-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8daf0e48-a502-4b73-a0aa-74f9c20116d9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 08:08:05.966466 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:05.966324 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8daf0e48-a502-4b73-a0aa-74f9c20116d9-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8daf0e48-a502-4b73-a0aa-74f9c20116d9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 08:08:05.966466 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:05.966350 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8daf0e48-a502-4b73-a0aa-74f9c20116d9-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8daf0e48-a502-4b73-a0aa-74f9c20116d9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 08:08:05.966466 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:05.966379 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8daf0e48-a502-4b73-a0aa-74f9c20116d9-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8daf0e48-a502-4b73-a0aa-74f9c20116d9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 08:08:05.966466 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:05.966405 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8daf0e48-a502-4b73-a0aa-74f9c20116d9-web-config\") pod \"alertmanager-main-0\" (UID: \"8daf0e48-a502-4b73-a0aa-74f9c20116d9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 08:08:05.966466 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:05.966465 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8daf0e48-a502-4b73-a0aa-74f9c20116d9-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8daf0e48-a502-4b73-a0aa-74f9c20116d9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 08:08:05.966809 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:05.966497 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8daf0e48-a502-4b73-a0aa-74f9c20116d9-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8daf0e48-a502-4b73-a0aa-74f9c20116d9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 08:08:05.966809 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:05.966520 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nwnjw\" (UniqueName: \"kubernetes.io/projected/8daf0e48-a502-4b73-a0aa-74f9c20116d9-kube-api-access-nwnjw\") pod \"alertmanager-main-0\" (UID: \"8daf0e48-a502-4b73-a0aa-74f9c20116d9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 08:08:05.966809 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:05.966550 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8daf0e48-a502-4b73-a0aa-74f9c20116d9-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8daf0e48-a502-4b73-a0aa-74f9c20116d9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 08:08:05.966809 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:05.966578 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8daf0e48-a502-4b73-a0aa-74f9c20116d9-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8daf0e48-a502-4b73-a0aa-74f9c20116d9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 08:08:05.967080 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:05.966926 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8daf0e48-a502-4b73-a0aa-74f9c20116d9-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8daf0e48-a502-4b73-a0aa-74f9c20116d9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 08:08:05.968198 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:05.968172 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8daf0e48-a502-4b73-a0aa-74f9c20116d9-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8daf0e48-a502-4b73-a0aa-74f9c20116d9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 08:08:05.969786 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:05.969486 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8daf0e48-a502-4b73-a0aa-74f9c20116d9-config-out\") pod \"alertmanager-main-0\" (UID: \"8daf0e48-a502-4b73-a0aa-74f9c20116d9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 08:08:05.969786 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:05.969607 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8daf0e48-a502-4b73-a0aa-74f9c20116d9-config-volume\") pod \"alertmanager-main-0\" (UID: \"8daf0e48-a502-4b73-a0aa-74f9c20116d9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 08:08:05.969786 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:05.969648 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8daf0e48-a502-4b73-a0aa-74f9c20116d9-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8daf0e48-a502-4b73-a0aa-74f9c20116d9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 08:08:05.970061 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:05.969952 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8daf0e48-a502-4b73-a0aa-74f9c20116d9-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8daf0e48-a502-4b73-a0aa-74f9c20116d9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 08:08:05.970189 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:05.970164 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8daf0e48-a502-4b73-a0aa-74f9c20116d9-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8daf0e48-a502-4b73-a0aa-74f9c20116d9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 08:08:05.970427 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:05.970405 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8daf0e48-a502-4b73-a0aa-74f9c20116d9-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8daf0e48-a502-4b73-a0aa-74f9c20116d9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 08:08:05.971302 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:05.971272 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8daf0e48-a502-4b73-a0aa-74f9c20116d9-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8daf0e48-a502-4b73-a0aa-74f9c20116d9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 08:08:05.971385 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:05.971342 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8daf0e48-a502-4b73-a0aa-74f9c20116d9-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8daf0e48-a502-4b73-a0aa-74f9c20116d9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 08:08:05.971385 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:05.971357 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8daf0e48-a502-4b73-a0aa-74f9c20116d9-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8daf0e48-a502-4b73-a0aa-74f9c20116d9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 08:08:05.972185 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:05.972165 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8daf0e48-a502-4b73-a0aa-74f9c20116d9-web-config\") pod \"alertmanager-main-0\" (UID: \"8daf0e48-a502-4b73-a0aa-74f9c20116d9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 08:08:05.979488 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:05.979466 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nwnjw\" (UniqueName: \"kubernetes.io/projected/8daf0e48-a502-4b73-a0aa-74f9c20116d9-kube-api-access-nwnjw\") pod \"alertmanager-main-0\" (UID: \"8daf0e48-a502-4b73-a0aa-74f9c20116d9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 08:08:06.132751 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:06.132687 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 18 08:08:06.188774 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:06.188729 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-84c885658c-wfr6k" event={"ID":"88ed125b-8189-4544-ac91-d69a10721b8c","Type":"ContainerStarted","Data":"911bed241c22138a1fa32c8741f76f606096860e10b8b38c841ffb097ffce701"} Sep 18 08:08:06.190743 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:06.190633 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66bbdc9c7f-rklml" event={"ID":"2aa01fbe-57ff-4d1e-9728-91ff8382f85c","Type":"ContainerStarted","Data":"6c396dea11b4cc679e844ab5e7ea99d091d58f524b70e7965088753c13f3e382"} Sep 18 08:08:06.447407 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:06.447302 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 18 08:08:06.447891 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:08:06.447857 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8daf0e48_a502_4b73_a0aa_74f9c20116d9.slice/crio-0594eacf11a67a16bf222e1b65066028e706124cfa7cc8934af455f692dcdea3 WatchSource:0}: Error finding container 0594eacf11a67a16bf222e1b65066028e706124cfa7cc8934af455f692dcdea3: Status 404 returned error can't find the container with id 0594eacf11a67a16bf222e1b65066028e706124cfa7cc8934af455f692dcdea3 Sep 18 08:08:06.471254 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:06.471234 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2f0bb4e9-f8cc-4b04-a0f7-a2bdde20ddc8-openshift-state-metrics-tls\") pod \"openshift-state-metrics-86c5bc79d6-q2zl7\" (UID: \"2f0bb4e9-f8cc-4b04-a0f7-a2bdde20ddc8\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-q2zl7" Sep 18 08:08:06.474752 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:06.474700 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2f0bb4e9-f8cc-4b04-a0f7-a2bdde20ddc8-openshift-state-metrics-tls\") pod \"openshift-state-metrics-86c5bc79d6-q2zl7\" (UID: \"2f0bb4e9-f8cc-4b04-a0f7-a2bdde20ddc8\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-q2zl7" Sep 18 08:08:06.565207 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:06.564961 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-q2zl7" Sep 18 08:08:07.197349 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:07.197313 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8daf0e48-a502-4b73-a0aa-74f9c20116d9","Type":"ContainerStarted","Data":"0594eacf11a67a16bf222e1b65066028e706124cfa7cc8934af455f692dcdea3"} Sep 18 08:08:07.644666 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:07.644619 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-86c5bc79d6-q2zl7"] Sep 18 08:08:07.724173 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:07.722410 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-757bc5bcdc-4sj2l"] Sep 18 08:08:07.728612 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:07.728367 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-757bc5bcdc-4sj2l" Sep 18 08:08:07.742251 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:07.742220 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Sep 18 08:08:07.742373 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:07.742268 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Sep 18 08:08:07.742508 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:07.742491 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-r2b2q\"" Sep 18 08:08:07.742570 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:07.742537 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Sep 18 08:08:07.742621 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:07.742491 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Sep 18 08:08:07.742801 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:07.742783 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Sep 18 08:08:07.743142 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:07.743105 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-eo393l0qcpv27\"" Sep 18 08:08:07.751635 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:07.751614 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-757bc5bcdc-4sj2l"] Sep 18 08:08:07.784521 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:07.784492 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/816180ae-277e-402e-b6d3-8b3cc8ade4f2-secret-grpc-tls\") pod \"thanos-querier-757bc5bcdc-4sj2l\" (UID: \"816180ae-277e-402e-b6d3-8b3cc8ade4f2\") " pod="openshift-monitoring/thanos-querier-757bc5bcdc-4sj2l" Sep 18 08:08:07.784633 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:07.784560 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/816180ae-277e-402e-b6d3-8b3cc8ade4f2-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-757bc5bcdc-4sj2l\" (UID: \"816180ae-277e-402e-b6d3-8b3cc8ade4f2\") " pod="openshift-monitoring/thanos-querier-757bc5bcdc-4sj2l" Sep 18 08:08:07.784633 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:07.784602 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/816180ae-277e-402e-b6d3-8b3cc8ade4f2-metrics-client-ca\") pod \"thanos-querier-757bc5bcdc-4sj2l\" (UID: \"816180ae-277e-402e-b6d3-8b3cc8ade4f2\") " pod="openshift-monitoring/thanos-querier-757bc5bcdc-4sj2l" Sep 18 08:08:07.784633 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:07.784626 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p8p69\" (UniqueName: \"kubernetes.io/projected/816180ae-277e-402e-b6d3-8b3cc8ade4f2-kube-api-access-p8p69\") pod \"thanos-querier-757bc5bcdc-4sj2l\" (UID: \"816180ae-277e-402e-b6d3-8b3cc8ade4f2\") " pod="openshift-monitoring/thanos-querier-757bc5bcdc-4sj2l" Sep 18 08:08:07.784744 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:07.784659 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/816180ae-277e-402e-b6d3-8b3cc8ade4f2-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-757bc5bcdc-4sj2l\" (UID: \"816180ae-277e-402e-b6d3-8b3cc8ade4f2\") " pod="openshift-monitoring/thanos-querier-757bc5bcdc-4sj2l" Sep 18 08:08:07.784777 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:07.784748 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/816180ae-277e-402e-b6d3-8b3cc8ade4f2-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-757bc5bcdc-4sj2l\" (UID: \"816180ae-277e-402e-b6d3-8b3cc8ade4f2\") " pod="openshift-monitoring/thanos-querier-757bc5bcdc-4sj2l" Sep 18 08:08:07.784814 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:07.784786 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/816180ae-277e-402e-b6d3-8b3cc8ade4f2-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-757bc5bcdc-4sj2l\" (UID: \"816180ae-277e-402e-b6d3-8b3cc8ade4f2\") " pod="openshift-monitoring/thanos-querier-757bc5bcdc-4sj2l" Sep 18 08:08:07.784881 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:07.784818 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/816180ae-277e-402e-b6d3-8b3cc8ade4f2-secret-thanos-querier-tls\") pod \"thanos-querier-757bc5bcdc-4sj2l\" (UID: \"816180ae-277e-402e-b6d3-8b3cc8ade4f2\") " pod="openshift-monitoring/thanos-querier-757bc5bcdc-4sj2l" Sep 18 08:08:07.885439 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:07.885396 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/816180ae-277e-402e-b6d3-8b3cc8ade4f2-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-757bc5bcdc-4sj2l\" (UID: \"816180ae-277e-402e-b6d3-8b3cc8ade4f2\") " pod="openshift-monitoring/thanos-querier-757bc5bcdc-4sj2l" Sep 18 08:08:07.885592 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:07.885459 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/816180ae-277e-402e-b6d3-8b3cc8ade4f2-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-757bc5bcdc-4sj2l\" (UID: \"816180ae-277e-402e-b6d3-8b3cc8ade4f2\") " pod="openshift-monitoring/thanos-querier-757bc5bcdc-4sj2l" Sep 18 08:08:07.885592 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:07.885506 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/816180ae-277e-402e-b6d3-8b3cc8ade4f2-secret-thanos-querier-tls\") pod \"thanos-querier-757bc5bcdc-4sj2l\" (UID: \"816180ae-277e-402e-b6d3-8b3cc8ade4f2\") " pod="openshift-monitoring/thanos-querier-757bc5bcdc-4sj2l" Sep 18 08:08:07.885592 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:07.885532 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/816180ae-277e-402e-b6d3-8b3cc8ade4f2-secret-grpc-tls\") pod \"thanos-querier-757bc5bcdc-4sj2l\" (UID: \"816180ae-277e-402e-b6d3-8b3cc8ade4f2\") " pod="openshift-monitoring/thanos-querier-757bc5bcdc-4sj2l" Sep 18 08:08:07.885592 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:07.885583 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/816180ae-277e-402e-b6d3-8b3cc8ade4f2-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-757bc5bcdc-4sj2l\" (UID: \"816180ae-277e-402e-b6d3-8b3cc8ade4f2\") " pod="openshift-monitoring/thanos-querier-757bc5bcdc-4sj2l" Sep 18 08:08:07.885795 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:07.885624 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/816180ae-277e-402e-b6d3-8b3cc8ade4f2-metrics-client-ca\") pod \"thanos-querier-757bc5bcdc-4sj2l\" (UID: \"816180ae-277e-402e-b6d3-8b3cc8ade4f2\") " pod="openshift-monitoring/thanos-querier-757bc5bcdc-4sj2l" Sep 18 08:08:07.885795 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:07.885649 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p8p69\" (UniqueName: \"kubernetes.io/projected/816180ae-277e-402e-b6d3-8b3cc8ade4f2-kube-api-access-p8p69\") pod \"thanos-querier-757bc5bcdc-4sj2l\" (UID: \"816180ae-277e-402e-b6d3-8b3cc8ade4f2\") " pod="openshift-monitoring/thanos-querier-757bc5bcdc-4sj2l" Sep 18 08:08:07.885795 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:07.885688 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/816180ae-277e-402e-b6d3-8b3cc8ade4f2-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-757bc5bcdc-4sj2l\" (UID: \"816180ae-277e-402e-b6d3-8b3cc8ade4f2\") " pod="openshift-monitoring/thanos-querier-757bc5bcdc-4sj2l" Sep 18 08:08:07.887592 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:07.886794 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/816180ae-277e-402e-b6d3-8b3cc8ade4f2-metrics-client-ca\") pod \"thanos-querier-757bc5bcdc-4sj2l\" (UID: \"816180ae-277e-402e-b6d3-8b3cc8ade4f2\") " pod="openshift-monitoring/thanos-querier-757bc5bcdc-4sj2l" Sep 18 08:08:07.889367 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:07.889177 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/816180ae-277e-402e-b6d3-8b3cc8ade4f2-secret-grpc-tls\") pod \"thanos-querier-757bc5bcdc-4sj2l\" (UID: \"816180ae-277e-402e-b6d3-8b3cc8ade4f2\") " pod="openshift-monitoring/thanos-querier-757bc5bcdc-4sj2l" Sep 18 08:08:07.890256 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:07.890211 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/816180ae-277e-402e-b6d3-8b3cc8ade4f2-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-757bc5bcdc-4sj2l\" (UID: \"816180ae-277e-402e-b6d3-8b3cc8ade4f2\") " pod="openshift-monitoring/thanos-querier-757bc5bcdc-4sj2l" Sep 18 08:08:07.893367 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:07.893342 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/816180ae-277e-402e-b6d3-8b3cc8ade4f2-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-757bc5bcdc-4sj2l\" (UID: \"816180ae-277e-402e-b6d3-8b3cc8ade4f2\") " pod="openshift-monitoring/thanos-querier-757bc5bcdc-4sj2l" Sep 18 08:08:07.893833 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:07.893742 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/816180ae-277e-402e-b6d3-8b3cc8ade4f2-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-757bc5bcdc-4sj2l\" (UID: \"816180ae-277e-402e-b6d3-8b3cc8ade4f2\") " pod="openshift-monitoring/thanos-querier-757bc5bcdc-4sj2l" Sep 18 08:08:07.894199 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:07.894159 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/816180ae-277e-402e-b6d3-8b3cc8ade4f2-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-757bc5bcdc-4sj2l\" (UID: \"816180ae-277e-402e-b6d3-8b3cc8ade4f2\") " pod="openshift-monitoring/thanos-querier-757bc5bcdc-4sj2l" Sep 18 08:08:07.895919 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:07.895784 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p8p69\" (UniqueName: \"kubernetes.io/projected/816180ae-277e-402e-b6d3-8b3cc8ade4f2-kube-api-access-p8p69\") pod \"thanos-querier-757bc5bcdc-4sj2l\" (UID: \"816180ae-277e-402e-b6d3-8b3cc8ade4f2\") " pod="openshift-monitoring/thanos-querier-757bc5bcdc-4sj2l" Sep 18 08:08:07.896150 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:07.896111 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/816180ae-277e-402e-b6d3-8b3cc8ade4f2-secret-thanos-querier-tls\") pod \"thanos-querier-757bc5bcdc-4sj2l\" (UID: \"816180ae-277e-402e-b6d3-8b3cc8ade4f2\") " pod="openshift-monitoring/thanos-querier-757bc5bcdc-4sj2l" Sep 18 08:08:08.040798 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:08.040767 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-757bc5bcdc-4sj2l" Sep 18 08:08:08.206200 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:08.206144 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-76vv5" event={"ID":"1e301fcf-dcde-48d6-9ac9-cf2bb026c820","Type":"ContainerStarted","Data":"cfdeee0ee02c8e3d2411a5aa63d1937b7f3d556f57d780f8d2d1bebd7c3a37bf"} Sep 18 08:08:08.208351 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:08.208319 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-84c885658c-wfr6k" event={"ID":"88ed125b-8189-4544-ac91-d69a10721b8c","Type":"ContainerStarted","Data":"3b6e38cb5064e3c6933544f772921ed3305aef77da6004c8aee2d0c401bd1cde"} Sep 18 08:08:08.208461 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:08.208370 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-84c885658c-wfr6k" event={"ID":"88ed125b-8189-4544-ac91-d69a10721b8c","Type":"ContainerStarted","Data":"deb12618776415da2df593c76541a74fc07ab4f3aeef426f28d707a104b73fca"} Sep 18 08:08:08.431532 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:08:08.431501 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f0bb4e9_f8cc_4b04_a0f7_a2bdde20ddc8.slice/crio-de535027e8b2f94133ef823757c6fc9b5892bbb5ba18f5933097e698c8dc8d65 WatchSource:0}: Error finding container de535027e8b2f94133ef823757c6fc9b5892bbb5ba18f5933097e698c8dc8d65: Status 404 returned error can't find the container with id de535027e8b2f94133ef823757c6fc9b5892bbb5ba18f5933097e698c8dc8d65 Sep 18 08:08:09.100113 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:09.100043 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9kn9p" Sep 18 08:08:09.127761 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:09.127733 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-5dd968f6c-d6whc"] Sep 18 08:08:09.135196 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:09.135171 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5dd968f6c-d6whc" Sep 18 08:08:09.138534 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:09.138514 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Sep 18 08:08:09.139214 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:09.138865 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-4t8h4kh683ftd\"" Sep 18 08:08:09.139214 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:09.139034 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Sep 18 08:08:09.139214 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:09.139102 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-nzkp6\"" Sep 18 08:08:09.139634 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:09.139614 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Sep 18 08:08:09.139725 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:09.139622 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Sep 18 08:08:09.162484 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:09.162460 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5dd968f6c-d6whc"] Sep 18 08:08:09.198761 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:09.198717 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/76a6cab1-d53b-4f40-96b1-f3d4f78e1732-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5dd968f6c-d6whc\" (UID: \"76a6cab1-d53b-4f40-96b1-f3d4f78e1732\") " pod="openshift-monitoring/metrics-server-5dd968f6c-d6whc" Sep 18 08:08:09.198898 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:09.198788 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/76a6cab1-d53b-4f40-96b1-f3d4f78e1732-metrics-server-audit-profiles\") pod \"metrics-server-5dd968f6c-d6whc\" (UID: \"76a6cab1-d53b-4f40-96b1-f3d4f78e1732\") " pod="openshift-monitoring/metrics-server-5dd968f6c-d6whc" Sep 18 08:08:09.199026 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:09.198909 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/76a6cab1-d53b-4f40-96b1-f3d4f78e1732-client-ca-bundle\") pod \"metrics-server-5dd968f6c-d6whc\" (UID: \"76a6cab1-d53b-4f40-96b1-f3d4f78e1732\") " pod="openshift-monitoring/metrics-server-5dd968f6c-d6whc" Sep 18 08:08:09.199026 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:09.199011 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/76a6cab1-d53b-4f40-96b1-f3d4f78e1732-secret-metrics-server-client-certs\") pod \"metrics-server-5dd968f6c-d6whc\" (UID: \"76a6cab1-d53b-4f40-96b1-f3d4f78e1732\") " pod="openshift-monitoring/metrics-server-5dd968f6c-d6whc" Sep 18 08:08:09.199134 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:09.199049 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/76a6cab1-d53b-4f40-96b1-f3d4f78e1732-audit-log\") pod \"metrics-server-5dd968f6c-d6whc\" (UID: \"76a6cab1-d53b-4f40-96b1-f3d4f78e1732\") " pod="openshift-monitoring/metrics-server-5dd968f6c-d6whc" Sep 18 08:08:09.199134 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:09.199071 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k4h4m\" (UniqueName: \"kubernetes.io/projected/76a6cab1-d53b-4f40-96b1-f3d4f78e1732-kube-api-access-k4h4m\") pod \"metrics-server-5dd968f6c-d6whc\" (UID: \"76a6cab1-d53b-4f40-96b1-f3d4f78e1732\") " pod="openshift-monitoring/metrics-server-5dd968f6c-d6whc" Sep 18 08:08:09.199134 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:09.199116 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/76a6cab1-d53b-4f40-96b1-f3d4f78e1732-secret-metrics-server-tls\") pod \"metrics-server-5dd968f6c-d6whc\" (UID: \"76a6cab1-d53b-4f40-96b1-f3d4f78e1732\") " pod="openshift-monitoring/metrics-server-5dd968f6c-d6whc" Sep 18 08:08:09.213311 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:09.213279 2585 generic.go:356] "Generic (PLEG): container finished" podID="1e301fcf-dcde-48d6-9ac9-cf2bb026c820" containerID="cfdeee0ee02c8e3d2411a5aa63d1937b7f3d556f57d780f8d2d1bebd7c3a37bf" exitCode=0 Sep 18 08:08:09.213676 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:09.213370 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-76vv5" event={"ID":"1e301fcf-dcde-48d6-9ac9-cf2bb026c820","Type":"ContainerDied","Data":"cfdeee0ee02c8e3d2411a5aa63d1937b7f3d556f57d780f8d2d1bebd7c3a37bf"} Sep 18 08:08:09.215248 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:09.215228 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-q2zl7" event={"ID":"2f0bb4e9-f8cc-4b04-a0f7-a2bdde20ddc8","Type":"ContainerStarted","Data":"de535027e8b2f94133ef823757c6fc9b5892bbb5ba18f5933097e698c8dc8d65"} Sep 18 08:08:09.299570 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:09.299543 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/76a6cab1-d53b-4f40-96b1-f3d4f78e1732-audit-log\") pod \"metrics-server-5dd968f6c-d6whc\" (UID: \"76a6cab1-d53b-4f40-96b1-f3d4f78e1732\") " pod="openshift-monitoring/metrics-server-5dd968f6c-d6whc" Sep 18 08:08:09.299697 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:09.299582 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k4h4m\" (UniqueName: \"kubernetes.io/projected/76a6cab1-d53b-4f40-96b1-f3d4f78e1732-kube-api-access-k4h4m\") pod \"metrics-server-5dd968f6c-d6whc\" (UID: \"76a6cab1-d53b-4f40-96b1-f3d4f78e1732\") " pod="openshift-monitoring/metrics-server-5dd968f6c-d6whc" Sep 18 08:08:09.299761 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:09.299733 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/76a6cab1-d53b-4f40-96b1-f3d4f78e1732-secret-metrics-server-tls\") pod \"metrics-server-5dd968f6c-d6whc\" (UID: \"76a6cab1-d53b-4f40-96b1-f3d4f78e1732\") " pod="openshift-monitoring/metrics-server-5dd968f6c-d6whc" Sep 18 08:08:09.299871 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:09.299830 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/76a6cab1-d53b-4f40-96b1-f3d4f78e1732-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5dd968f6c-d6whc\" (UID: \"76a6cab1-d53b-4f40-96b1-f3d4f78e1732\") " pod="openshift-monitoring/metrics-server-5dd968f6c-d6whc" Sep 18 08:08:09.299987 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:09.299882 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/76a6cab1-d53b-4f40-96b1-f3d4f78e1732-metrics-server-audit-profiles\") pod \"metrics-server-5dd968f6c-d6whc\" (UID: \"76a6cab1-d53b-4f40-96b1-f3d4f78e1732\") " pod="openshift-monitoring/metrics-server-5dd968f6c-d6whc" Sep 18 08:08:09.299987 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:09.299939 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/76a6cab1-d53b-4f40-96b1-f3d4f78e1732-client-ca-bundle\") pod \"metrics-server-5dd968f6c-d6whc\" (UID: \"76a6cab1-d53b-4f40-96b1-f3d4f78e1732\") " pod="openshift-monitoring/metrics-server-5dd968f6c-d6whc" Sep 18 08:08:09.299987 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:09.299967 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/76a6cab1-d53b-4f40-96b1-f3d4f78e1732-audit-log\") pod \"metrics-server-5dd968f6c-d6whc\" (UID: \"76a6cab1-d53b-4f40-96b1-f3d4f78e1732\") " pod="openshift-monitoring/metrics-server-5dd968f6c-d6whc" Sep 18 08:08:09.300142 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:09.300062 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/76a6cab1-d53b-4f40-96b1-f3d4f78e1732-secret-metrics-server-client-certs\") pod \"metrics-server-5dd968f6c-d6whc\" (UID: \"76a6cab1-d53b-4f40-96b1-f3d4f78e1732\") " pod="openshift-monitoring/metrics-server-5dd968f6c-d6whc" Sep 18 08:08:09.301003 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:09.300938 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/76a6cab1-d53b-4f40-96b1-f3d4f78e1732-metrics-server-audit-profiles\") pod \"metrics-server-5dd968f6c-d6whc\" (UID: \"76a6cab1-d53b-4f40-96b1-f3d4f78e1732\") " pod="openshift-monitoring/metrics-server-5dd968f6c-d6whc" Sep 18 08:08:09.301003 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:09.300982 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/76a6cab1-d53b-4f40-96b1-f3d4f78e1732-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5dd968f6c-d6whc\" (UID: \"76a6cab1-d53b-4f40-96b1-f3d4f78e1732\") " pod="openshift-monitoring/metrics-server-5dd968f6c-d6whc" Sep 18 08:08:09.302661 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:09.302626 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/76a6cab1-d53b-4f40-96b1-f3d4f78e1732-secret-metrics-server-tls\") pod \"metrics-server-5dd968f6c-d6whc\" (UID: \"76a6cab1-d53b-4f40-96b1-f3d4f78e1732\") " pod="openshift-monitoring/metrics-server-5dd968f6c-d6whc" Sep 18 08:08:09.302746 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:09.302668 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/76a6cab1-d53b-4f40-96b1-f3d4f78e1732-client-ca-bundle\") pod \"metrics-server-5dd968f6c-d6whc\" (UID: \"76a6cab1-d53b-4f40-96b1-f3d4f78e1732\") " pod="openshift-monitoring/metrics-server-5dd968f6c-d6whc" Sep 18 08:08:09.303153 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:09.303138 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/76a6cab1-d53b-4f40-96b1-f3d4f78e1732-secret-metrics-server-client-certs\") pod \"metrics-server-5dd968f6c-d6whc\" (UID: \"76a6cab1-d53b-4f40-96b1-f3d4f78e1732\") " pod="openshift-monitoring/metrics-server-5dd968f6c-d6whc" Sep 18 08:08:09.316459 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:09.316431 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k4h4m\" (UniqueName: \"kubernetes.io/projected/76a6cab1-d53b-4f40-96b1-f3d4f78e1732-kube-api-access-k4h4m\") pod \"metrics-server-5dd968f6c-d6whc\" (UID: \"76a6cab1-d53b-4f40-96b1-f3d4f78e1732\") " pod="openshift-monitoring/metrics-server-5dd968f6c-d6whc" Sep 18 08:08:09.445671 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:09.445607 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5dd968f6c-d6whc" Sep 18 08:08:09.469288 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:09.469261 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5984459ff8-vjcz5"] Sep 18 08:08:09.472555 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:09.472537 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5984459ff8-vjcz5" Sep 18 08:08:09.475365 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:09.475345 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Sep 18 08:08:09.475463 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:09.475364 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-fzj7w\"" Sep 18 08:08:09.489299 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:09.489261 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5984459ff8-vjcz5"] Sep 18 08:08:09.502690 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:09.502669 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/efb834d3-4a03-40a3-96ef-68b0af7287a6-monitoring-plugin-cert\") pod \"monitoring-plugin-5984459ff8-vjcz5\" (UID: \"efb834d3-4a03-40a3-96ef-68b0af7287a6\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-vjcz5" Sep 18 08:08:09.502773 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:09.502700 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p95nn\" (UniqueName: \"kubernetes.io/projected/efb834d3-4a03-40a3-96ef-68b0af7287a6-kube-api-access-p95nn\") pod \"monitoring-plugin-5984459ff8-vjcz5\" (UID: \"efb834d3-4a03-40a3-96ef-68b0af7287a6\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-vjcz5" Sep 18 08:08:09.603300 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:09.603268 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/efb834d3-4a03-40a3-96ef-68b0af7287a6-monitoring-plugin-cert\") pod \"monitoring-plugin-5984459ff8-vjcz5\" (UID: \"efb834d3-4a03-40a3-96ef-68b0af7287a6\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-vjcz5" Sep 18 08:08:09.603462 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:09.603317 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p95nn\" (UniqueName: \"kubernetes.io/projected/efb834d3-4a03-40a3-96ef-68b0af7287a6-kube-api-access-p95nn\") pod \"monitoring-plugin-5984459ff8-vjcz5\" (UID: \"efb834d3-4a03-40a3-96ef-68b0af7287a6\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-vjcz5" Sep 18 08:08:09.606130 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:09.606109 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/efb834d3-4a03-40a3-96ef-68b0af7287a6-monitoring-plugin-cert\") pod \"monitoring-plugin-5984459ff8-vjcz5\" (UID: \"efb834d3-4a03-40a3-96ef-68b0af7287a6\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-vjcz5" Sep 18 08:08:09.620038 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:09.620018 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p95nn\" (UniqueName: \"kubernetes.io/projected/efb834d3-4a03-40a3-96ef-68b0af7287a6-kube-api-access-p95nn\") pod \"monitoring-plugin-5984459ff8-vjcz5\" (UID: \"efb834d3-4a03-40a3-96ef-68b0af7287a6\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-vjcz5" Sep 18 08:08:09.790557 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:09.790524 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5984459ff8-vjcz5" Sep 18 08:08:10.819807 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:10.819710 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-757bc5bcdc-4sj2l"] Sep 18 08:08:10.828411 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:08:10.828358 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod816180ae_277e_402e_b6d3_8b3cc8ade4f2.slice/crio-1ee7ecac09700785edf8dab1277cdb2e4e8806299ccd4fad69645dce9e515c9c WatchSource:0}: Error finding container 1ee7ecac09700785edf8dab1277cdb2e4e8806299ccd4fad69645dce9e515c9c: Status 404 returned error can't find the container with id 1ee7ecac09700785edf8dab1277cdb2e4e8806299ccd4fad69645dce9e515c9c Sep 18 08:08:10.878139 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:10.878101 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5dd968f6c-d6whc"] Sep 18 08:08:10.881164 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:10.881129 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5984459ff8-vjcz5"] Sep 18 08:08:10.884053 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:08:10.884030 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podefb834d3_4a03_40a3_96ef_68b0af7287a6.slice/crio-393232c9d0c2f61859015408bfb0f5d2aae8ab563799ccd6ef38ca35883affb2 WatchSource:0}: Error finding container 393232c9d0c2f61859015408bfb0f5d2aae8ab563799ccd6ef38ca35883affb2: Status 404 returned error can't find the container with id 393232c9d0c2f61859015408bfb0f5d2aae8ab563799ccd6ef38ca35883affb2 Sep 18 08:08:10.993827 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:10.991511 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 18 08:08:10.997818 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:10.997784 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 08:08:11.000789 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:11.000761 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Sep 18 08:08:11.000943 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:11.000833 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Sep 18 08:08:11.001314 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:11.001296 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Sep 18 08:08:11.001405 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:11.001387 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Sep 18 08:08:11.001641 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:11.001625 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Sep 18 08:08:11.001822 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:11.001807 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Sep 18 08:08:11.001900 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:11.001829 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Sep 18 08:08:11.002103 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:11.001998 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Sep 18 08:08:11.002103 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:11.002039 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Sep 18 08:08:11.002767 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:11.002321 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Sep 18 08:08:11.002767 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:11.002421 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-ehsedmocdr7be\"" Sep 18 08:08:11.002767 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:11.002585 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Sep 18 08:08:11.004209 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:11.003835 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Sep 18 08:08:11.004209 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:11.004068 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-sdjvn\"" Sep 18 08:08:11.004209 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:11.004052 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Sep 18 08:08:11.004607 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:11.004591 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Sep 18 08:08:11.012273 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:11.012230 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 18 08:08:11.019355 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:11.019327 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/53f6513d-2d21-463e-b9d7-93809bf37f40-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"53f6513d-2d21-463e-b9d7-93809bf37f40\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 08:08:11.019474 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:11.019370 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/53f6513d-2d21-463e-b9d7-93809bf37f40-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"53f6513d-2d21-463e-b9d7-93809bf37f40\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 08:08:11.019474 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:11.019402 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/53f6513d-2d21-463e-b9d7-93809bf37f40-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"53f6513d-2d21-463e-b9d7-93809bf37f40\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 08:08:11.019474 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:11.019436 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/53f6513d-2d21-463e-b9d7-93809bf37f40-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"53f6513d-2d21-463e-b9d7-93809bf37f40\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 08:08:11.019474 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:11.019459 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/53f6513d-2d21-463e-b9d7-93809bf37f40-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"53f6513d-2d21-463e-b9d7-93809bf37f40\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 08:08:11.019664 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:11.019486 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/53f6513d-2d21-463e-b9d7-93809bf37f40-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"53f6513d-2d21-463e-b9d7-93809bf37f40\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 08:08:11.019664 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:11.019509 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/53f6513d-2d21-463e-b9d7-93809bf37f40-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"53f6513d-2d21-463e-b9d7-93809bf37f40\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 08:08:11.019664 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:11.019531 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/53f6513d-2d21-463e-b9d7-93809bf37f40-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"53f6513d-2d21-463e-b9d7-93809bf37f40\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 08:08:11.019664 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:11.019570 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/53f6513d-2d21-463e-b9d7-93809bf37f40-config-out\") pod \"prometheus-k8s-0\" (UID: \"53f6513d-2d21-463e-b9d7-93809bf37f40\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 08:08:11.019664 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:11.019609 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/53f6513d-2d21-463e-b9d7-93809bf37f40-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"53f6513d-2d21-463e-b9d7-93809bf37f40\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 08:08:11.019997 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:11.019684 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/53f6513d-2d21-463e-b9d7-93809bf37f40-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"53f6513d-2d21-463e-b9d7-93809bf37f40\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 08:08:11.019997 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:11.019718 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/53f6513d-2d21-463e-b9d7-93809bf37f40-web-config\") pod \"prometheus-k8s-0\" (UID: \"53f6513d-2d21-463e-b9d7-93809bf37f40\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 08:08:11.019997 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:11.019793 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/53f6513d-2d21-463e-b9d7-93809bf37f40-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"53f6513d-2d21-463e-b9d7-93809bf37f40\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 08:08:11.019997 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:11.019879 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8wxtb\" (UniqueName: \"kubernetes.io/projected/53f6513d-2d21-463e-b9d7-93809bf37f40-kube-api-access-8wxtb\") pod \"prometheus-k8s-0\" (UID: \"53f6513d-2d21-463e-b9d7-93809bf37f40\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 08:08:11.019997 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:11.019960 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/53f6513d-2d21-463e-b9d7-93809bf37f40-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"53f6513d-2d21-463e-b9d7-93809bf37f40\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 08:08:11.020208 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:11.020041 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/53f6513d-2d21-463e-b9d7-93809bf37f40-config\") pod \"prometheus-k8s-0\" (UID: \"53f6513d-2d21-463e-b9d7-93809bf37f40\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 08:08:11.020208 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:11.020100 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/53f6513d-2d21-463e-b9d7-93809bf37f40-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"53f6513d-2d21-463e-b9d7-93809bf37f40\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 08:08:11.020208 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:11.020121 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/53f6513d-2d21-463e-b9d7-93809bf37f40-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"53f6513d-2d21-463e-b9d7-93809bf37f40\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 08:08:11.020340 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:11.020199 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/53f6513d-2d21-463e-b9d7-93809bf37f40-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"53f6513d-2d21-463e-b9d7-93809bf37f40\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 08:08:11.020340 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:11.020276 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/53f6513d-2d21-463e-b9d7-93809bf37f40-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"53f6513d-2d21-463e-b9d7-93809bf37f40\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 08:08:11.120969 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:11.120871 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/53f6513d-2d21-463e-b9d7-93809bf37f40-config\") pod \"prometheus-k8s-0\" (UID: \"53f6513d-2d21-463e-b9d7-93809bf37f40\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 08:08:11.120969 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:11.120912 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/53f6513d-2d21-463e-b9d7-93809bf37f40-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"53f6513d-2d21-463e-b9d7-93809bf37f40\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 08:08:11.120969 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:11.120940 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/53f6513d-2d21-463e-b9d7-93809bf37f40-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"53f6513d-2d21-463e-b9d7-93809bf37f40\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 08:08:11.121233 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:11.120980 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/53f6513d-2d21-463e-b9d7-93809bf37f40-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"53f6513d-2d21-463e-b9d7-93809bf37f40\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 08:08:11.121233 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:11.121022 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/53f6513d-2d21-463e-b9d7-93809bf37f40-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"53f6513d-2d21-463e-b9d7-93809bf37f40\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 08:08:11.121233 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:11.121047 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/53f6513d-2d21-463e-b9d7-93809bf37f40-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"53f6513d-2d21-463e-b9d7-93809bf37f40\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 08:08:11.121233 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:11.121074 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/53f6513d-2d21-463e-b9d7-93809bf37f40-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"53f6513d-2d21-463e-b9d7-93809bf37f40\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 08:08:11.121233 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:11.121102 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/53f6513d-2d21-463e-b9d7-93809bf37f40-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"53f6513d-2d21-463e-b9d7-93809bf37f40\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 08:08:11.121233 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:11.121133 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/53f6513d-2d21-463e-b9d7-93809bf37f40-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"53f6513d-2d21-463e-b9d7-93809bf37f40\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 08:08:11.121233 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:11.121155 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/53f6513d-2d21-463e-b9d7-93809bf37f40-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"53f6513d-2d21-463e-b9d7-93809bf37f40\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 08:08:11.121233 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:11.121185 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/53f6513d-2d21-463e-b9d7-93809bf37f40-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"53f6513d-2d21-463e-b9d7-93809bf37f40\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 08:08:11.121233 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:11.121209 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/53f6513d-2d21-463e-b9d7-93809bf37f40-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"53f6513d-2d21-463e-b9d7-93809bf37f40\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 08:08:11.121233 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:11.121233 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/53f6513d-2d21-463e-b9d7-93809bf37f40-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"53f6513d-2d21-463e-b9d7-93809bf37f40\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 08:08:11.121688 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:11.121265 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/53f6513d-2d21-463e-b9d7-93809bf37f40-config-out\") pod \"prometheus-k8s-0\" (UID: \"53f6513d-2d21-463e-b9d7-93809bf37f40\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 08:08:11.121688 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:11.121306 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/53f6513d-2d21-463e-b9d7-93809bf37f40-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"53f6513d-2d21-463e-b9d7-93809bf37f40\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 08:08:11.121688 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:11.121336 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/53f6513d-2d21-463e-b9d7-93809bf37f40-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"53f6513d-2d21-463e-b9d7-93809bf37f40\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 08:08:11.122427 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:11.122102 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/53f6513d-2d21-463e-b9d7-93809bf37f40-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"53f6513d-2d21-463e-b9d7-93809bf37f40\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 08:08:11.122427 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:11.122162 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/53f6513d-2d21-463e-b9d7-93809bf37f40-web-config\") pod \"prometheus-k8s-0\" (UID: \"53f6513d-2d21-463e-b9d7-93809bf37f40\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 08:08:11.122427 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:11.122199 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/53f6513d-2d21-463e-b9d7-93809bf37f40-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"53f6513d-2d21-463e-b9d7-93809bf37f40\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 08:08:11.122427 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:11.122236 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8wxtb\" (UniqueName: \"kubernetes.io/projected/53f6513d-2d21-463e-b9d7-93809bf37f40-kube-api-access-8wxtb\") pod \"prometheus-k8s-0\" (UID: \"53f6513d-2d21-463e-b9d7-93809bf37f40\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 08:08:11.122427 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:11.122284 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/53f6513d-2d21-463e-b9d7-93809bf37f40-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"53f6513d-2d21-463e-b9d7-93809bf37f40\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 08:08:11.123833 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:11.123794 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/53f6513d-2d21-463e-b9d7-93809bf37f40-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"53f6513d-2d21-463e-b9d7-93809bf37f40\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 08:08:11.124939 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:11.124357 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/53f6513d-2d21-463e-b9d7-93809bf37f40-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"53f6513d-2d21-463e-b9d7-93809bf37f40\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 08:08:11.125071 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:11.125027 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/53f6513d-2d21-463e-b9d7-93809bf37f40-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"53f6513d-2d21-463e-b9d7-93809bf37f40\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 08:08:11.125407 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:11.125382 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/53f6513d-2d21-463e-b9d7-93809bf37f40-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"53f6513d-2d21-463e-b9d7-93809bf37f40\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 08:08:11.125710 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:11.125683 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/53f6513d-2d21-463e-b9d7-93809bf37f40-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"53f6513d-2d21-463e-b9d7-93809bf37f40\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 08:08:11.125788 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:11.125690 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/53f6513d-2d21-463e-b9d7-93809bf37f40-config-out\") pod \"prometheus-k8s-0\" (UID: \"53f6513d-2d21-463e-b9d7-93809bf37f40\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 08:08:11.125788 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:11.125694 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/53f6513d-2d21-463e-b9d7-93809bf37f40-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"53f6513d-2d21-463e-b9d7-93809bf37f40\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 08:08:11.126313 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:11.126292 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/53f6513d-2d21-463e-b9d7-93809bf37f40-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"53f6513d-2d21-463e-b9d7-93809bf37f40\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 08:08:11.126448 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:11.126303 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/53f6513d-2d21-463e-b9d7-93809bf37f40-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"53f6513d-2d21-463e-b9d7-93809bf37f40\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 08:08:11.126557 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:11.126375 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/53f6513d-2d21-463e-b9d7-93809bf37f40-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"53f6513d-2d21-463e-b9d7-93809bf37f40\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 08:08:11.126686 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:11.126661 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/53f6513d-2d21-463e-b9d7-93809bf37f40-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"53f6513d-2d21-463e-b9d7-93809bf37f40\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 08:08:11.126907 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:11.126864 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/53f6513d-2d21-463e-b9d7-93809bf37f40-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"53f6513d-2d21-463e-b9d7-93809bf37f40\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 08:08:11.127307 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:11.127287 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/53f6513d-2d21-463e-b9d7-93809bf37f40-web-config\") pod \"prometheus-k8s-0\" (UID: \"53f6513d-2d21-463e-b9d7-93809bf37f40\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 08:08:11.127452 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:11.127431 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/53f6513d-2d21-463e-b9d7-93809bf37f40-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"53f6513d-2d21-463e-b9d7-93809bf37f40\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 08:08:11.128001 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:11.127980 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/53f6513d-2d21-463e-b9d7-93809bf37f40-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"53f6513d-2d21-463e-b9d7-93809bf37f40\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 08:08:11.128242 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:11.128226 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/53f6513d-2d21-463e-b9d7-93809bf37f40-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"53f6513d-2d21-463e-b9d7-93809bf37f40\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 08:08:11.128359 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:11.128336 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/53f6513d-2d21-463e-b9d7-93809bf37f40-config\") pod \"prometheus-k8s-0\" (UID: \"53f6513d-2d21-463e-b9d7-93809bf37f40\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 08:08:11.128879 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:11.128860 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/53f6513d-2d21-463e-b9d7-93809bf37f40-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"53f6513d-2d21-463e-b9d7-93809bf37f40\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 08:08:11.131719 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:11.131698 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8wxtb\" (UniqueName: \"kubernetes.io/projected/53f6513d-2d21-463e-b9d7-93809bf37f40-kube-api-access-8wxtb\") pod \"prometheus-k8s-0\" (UID: \"53f6513d-2d21-463e-b9d7-93809bf37f40\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 08:08:11.172651 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:11.172623 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-sgft8" Sep 18 08:08:11.224424 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:11.224385 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5984459ff8-vjcz5" event={"ID":"efb834d3-4a03-40a3-96ef-68b0af7287a6","Type":"ContainerStarted","Data":"393232c9d0c2f61859015408bfb0f5d2aae8ab563799ccd6ef38ca35883affb2"} Sep 18 08:08:11.228994 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:11.228960 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-84c885658c-wfr6k" event={"ID":"88ed125b-8189-4544-ac91-d69a10721b8c","Type":"ContainerStarted","Data":"ef7ee6c6cd5b77defbb8baf2645ecc5240d06e92c364653611bd1a2613dad970"} Sep 18 08:08:11.230358 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:11.230333 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-757bc5bcdc-4sj2l" event={"ID":"816180ae-277e-402e-b6d3-8b3cc8ade4f2","Type":"ContainerStarted","Data":"1ee7ecac09700785edf8dab1277cdb2e4e8806299ccd4fad69645dce9e515c9c"} Sep 18 08:08:11.232944 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:11.232921 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-76vv5" event={"ID":"1e301fcf-dcde-48d6-9ac9-cf2bb026c820","Type":"ContainerStarted","Data":"8b2190cf6ca3516f218c1f28f970039f621fffaa841a7fa6235cc46167246c37"} Sep 18 08:08:11.233135 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:11.233109 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-76vv5" event={"ID":"1e301fcf-dcde-48d6-9ac9-cf2bb026c820","Type":"ContainerStarted","Data":"b4c9990e83775995242d2c3c0c7160202d67b1c3da5e00ef8be00cd703ddeaf6"} Sep 18 08:08:11.236727 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:11.236701 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66bbdc9c7f-rklml" event={"ID":"2aa01fbe-57ff-4d1e-9728-91ff8382f85c","Type":"ContainerStarted","Data":"122899182bfafdd0550b6ee36cbcdeaf6585cf21fdc27c3bf4ecc308989b1900"} Sep 18 08:08:11.238595 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:11.238569 2585 generic.go:356] "Generic (PLEG): container finished" podID="8daf0e48-a502-4b73-a0aa-74f9c20116d9" containerID="06ccea7ff4e66233dda7bcb505c01b2749fc14813a36b86edc67b60907ee457a" exitCode=0 Sep 18 08:08:11.238693 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:11.238598 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8daf0e48-a502-4b73-a0aa-74f9c20116d9","Type":"ContainerDied","Data":"06ccea7ff4e66233dda7bcb505c01b2749fc14813a36b86edc67b60907ee457a"} Sep 18 08:08:11.243287 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:11.242145 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-q2zl7" event={"ID":"2f0bb4e9-f8cc-4b04-a0f7-a2bdde20ddc8","Type":"ContainerStarted","Data":"48f145199b5f9c9343f258ad8ae93624f69281e9fff73a4d1734a07c1a70aade"} Sep 18 08:08:11.243287 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:11.242193 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-q2zl7" event={"ID":"2f0bb4e9-f8cc-4b04-a0f7-a2bdde20ddc8","Type":"ContainerStarted","Data":"969440044e987f6455adbb16601e3dbaf8d4e305792efabb82fd725038e829bc"} Sep 18 08:08:11.244687 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:11.244665 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5dd968f6c-d6whc" event={"ID":"76a6cab1-d53b-4f40-96b1-f3d4f78e1732","Type":"ContainerStarted","Data":"352019b920ffdfc2764101cf162feaf925b060f313c8cb4ffd195854cf16f410"} Sep 18 08:08:11.255250 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:11.255192 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-84c885658c-wfr6k" podStartSLOduration=5.213686676 podStartE2EDuration="7.255179759s" totalImagesPullingTime="2.041493083s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 08:08:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 08:08:11.25419245 +0000 UTC m=+63.523892404" watchObservedRunningTime="2026-09-18 08:08:11.255179759 +0000 UTC m=+63.524879687" Sep 18 08:08:11.282618 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:11.282577 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-76vv5" podStartSLOduration=4.963406033 podStartE2EDuration="7.282563049s" totalImagesPullingTime="2.21886485s" totalInitContainerRuntime="100.292166ms" isStatefulPod=true podCreationTimestamp="2026-09-18 08:08:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 08:08:11.282044771 +0000 UTC m=+63.551744736" watchObservedRunningTime="2026-09-18 08:08:11.282563049 +0000 UTC m=+63.552262978" Sep 18 08:08:11.314060 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:11.314029 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 08:08:11.617326 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:11.617002 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-66bbdc9c7f-rklml" podStartSLOduration=2.423812255 podStartE2EDuration="7.616977425s" totalImagesPullingTime="5.19316517s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 08:08:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 08:08:11.338127488 +0000 UTC m=+63.607827436" watchObservedRunningTime="2026-09-18 08:08:11.616977425 +0000 UTC m=+63.886677355" Sep 18 08:08:11.617544 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:11.617525 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 18 08:08:11.621076 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:08:11.620029 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53f6513d_2d21_463e_b9d7_93809bf37f40.slice/crio-1613b7049512d3bbe16b13f69b00f9650ee1685ada603ca6ecab1b4a08d4dca7 WatchSource:0}: Error finding container 1613b7049512d3bbe16b13f69b00f9650ee1685ada603ca6ecab1b4a08d4dca7: Status 404 returned error can't find the container with id 1613b7049512d3bbe16b13f69b00f9650ee1685ada603ca6ecab1b4a08d4dca7 Sep 18 08:08:12.252001 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:12.251960 2585 generic.go:356] "Generic (PLEG): container finished" podID="53f6513d-2d21-463e-b9d7-93809bf37f40" containerID="f2d4545ece7e2d37dcd1e2b0035589fe6cf0466354bcab5822729cee813728ae" exitCode=0 Sep 18 08:08:12.253506 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:12.253477 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"53f6513d-2d21-463e-b9d7-93809bf37f40","Type":"ContainerDied","Data":"f2d4545ece7e2d37dcd1e2b0035589fe6cf0466354bcab5822729cee813728ae"} Sep 18 08:08:12.253633 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:12.253551 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"53f6513d-2d21-463e-b9d7-93809bf37f40","Type":"ContainerStarted","Data":"1613b7049512d3bbe16b13f69b00f9650ee1685ada603ca6ecab1b4a08d4dca7"} Sep 18 08:08:14.271648 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:14.271495 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8daf0e48-a502-4b73-a0aa-74f9c20116d9","Type":"ContainerStarted","Data":"227545cbe899b169d3a90575289bdbe4b7846bf397d2910b2c9d5dd8bf122b2b"} Sep 18 08:08:14.277340 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:14.277031 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-q2zl7" event={"ID":"2f0bb4e9-f8cc-4b04-a0f7-a2bdde20ddc8","Type":"ContainerStarted","Data":"7e83974b3a465504ecb215555f6527778f8c6a3904238ec3e3622966981e93bd"} Sep 18 08:08:14.280350 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:14.280314 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5dd968f6c-d6whc" event={"ID":"76a6cab1-d53b-4f40-96b1-f3d4f78e1732","Type":"ContainerStarted","Data":"4cf85248a87f1f33b2b82905b0c99dbd255f340a1c41bfbff59ff3c2b493f4d7"} Sep 18 08:08:14.284536 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:14.284506 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5984459ff8-vjcz5" event={"ID":"efb834d3-4a03-40a3-96ef-68b0af7287a6","Type":"ContainerStarted","Data":"419e3bc4596433a33ee25683cf7784fd7275228427cf7aaf5498365b579099d8"} Sep 18 08:08:14.285185 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:14.285144 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5984459ff8-vjcz5" Sep 18 08:08:14.288389 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:14.288365 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-757bc5bcdc-4sj2l" event={"ID":"816180ae-277e-402e-b6d3-8b3cc8ade4f2","Type":"ContainerStarted","Data":"08263350ab3a91f15e53a462086b53d3a5713364e5e7075e5cef2fdcda218d66"} Sep 18 08:08:14.293678 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:14.293616 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5984459ff8-vjcz5" Sep 18 08:08:14.319743 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:14.319705 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-q2zl7" podStartSLOduration=7.074484446 podStartE2EDuration="10.319689745s" totalImagesPullingTime="3.245205299s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 08:08:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 08:08:14.296717892 +0000 UTC m=+66.566417820" watchObservedRunningTime="2026-09-18 08:08:14.319689745 +0000 UTC m=+66.589389858" Sep 18 08:08:14.319838 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:14.319802 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-5dd968f6c-d6whc" podStartSLOduration=2.099840815 podStartE2EDuration="5.319797684s" totalImagesPullingTime="3.219956869s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 08:08:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 08:08:14.318115751 +0000 UTC m=+66.587815680" watchObservedRunningTime="2026-09-18 08:08:14.319797684 +0000 UTC m=+66.589497613" Sep 18 08:08:14.343291 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:14.343238 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5984459ff8-vjcz5" podStartSLOduration=2.131075663 podStartE2EDuration="5.343217074s" totalImagesPullingTime="3.212141411s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 08:08:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 08:08:14.342689043 +0000 UTC m=+66.612388973" watchObservedRunningTime="2026-09-18 08:08:14.343217074 +0000 UTC m=+66.612917003" Sep 18 08:08:15.139955 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:15.139919 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-66bbdc9c7f-rklml" Sep 18 08:08:15.140138 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:15.139985 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-66bbdc9c7f-rklml" Sep 18 08:08:15.145413 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:15.145244 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-66bbdc9c7f-rklml" Sep 18 08:08:15.300412 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:15.300384 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-757bc5bcdc-4sj2l" event={"ID":"816180ae-277e-402e-b6d3-8b3cc8ade4f2","Type":"ContainerStarted","Data":"e22ec7dbc9583e6bb1449ca6df5605a57452181bf1f49e6b6a3deaa3c42c935f"} Sep 18 08:08:15.300794 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:15.300457 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-757bc5bcdc-4sj2l" event={"ID":"816180ae-277e-402e-b6d3-8b3cc8ade4f2","Type":"ContainerStarted","Data":"1c15756c9f00958b693c673e7ed1c3f46c67b0f471028c025c312689df7960d4"} Sep 18 08:08:15.305131 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:15.305104 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8daf0e48-a502-4b73-a0aa-74f9c20116d9","Type":"ContainerStarted","Data":"8165c0953a7e38c70c01d59dcc9945d2dfad773940c8fa60be52b5e6430f29cf"} Sep 18 08:08:15.305257 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:15.305222 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8daf0e48-a502-4b73-a0aa-74f9c20116d9","Type":"ContainerStarted","Data":"f42579118cddb16b3cab4b543aa92317861bd1e9e4f25ff446643f28d1cf9dc1"} Sep 18 08:08:15.305317 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:15.305265 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8daf0e48-a502-4b73-a0aa-74f9c20116d9","Type":"ContainerStarted","Data":"4f990ed60fc6a255df375d20ebcf991d937fb81ab4368ebe91fedea382d3a63f"} Sep 18 08:08:15.305317 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:15.305294 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8daf0e48-a502-4b73-a0aa-74f9c20116d9","Type":"ContainerStarted","Data":"a07d37ef4ca6acb644213e821d82d84ac1fc327be10b5b01a02586cd8ffc19da"} Sep 18 08:08:15.312219 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:15.311858 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-66bbdc9c7f-rklml" Sep 18 08:08:15.674805 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:15.674764 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8d257247-8dae-4dce-9c31-62cf736b2b9f-original-pull-secret\") pod \"global-pull-secret-syncer-6rnbm\" (UID: \"8d257247-8dae-4dce-9c31-62cf736b2b9f\") " pod="kube-system/global-pull-secret-syncer-6rnbm" Sep 18 08:08:15.675060 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:15.674830 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b6e0d1e7-a182-4ac0-a484-f174f64ca021-metrics-certs\") pod \"network-metrics-daemon-9vz5k\" (UID: \"b6e0d1e7-a182-4ac0-a484-f174f64ca021\") " pod="openshift-multus/network-metrics-daemon-9vz5k" Sep 18 08:08:15.677793 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:15.677767 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 18 08:08:15.677947 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:15.677923 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 18 08:08:15.687902 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:15.687833 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8d257247-8dae-4dce-9c31-62cf736b2b9f-original-pull-secret\") pod \"global-pull-secret-syncer-6rnbm\" (UID: \"8d257247-8dae-4dce-9c31-62cf736b2b9f\") " pod="kube-system/global-pull-secret-syncer-6rnbm" Sep 18 08:08:15.687902 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:15.687873 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b6e0d1e7-a182-4ac0-a484-f174f64ca021-metrics-certs\") pod \"network-metrics-daemon-9vz5k\" (UID: \"b6e0d1e7-a182-4ac0-a484-f174f64ca021\") " pod="openshift-multus/network-metrics-daemon-9vz5k" Sep 18 08:08:15.775316 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:15.775272 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h55b9\" (UniqueName: \"kubernetes.io/projected/97cadd54-3234-4e3f-a2bf-c96b134566b1-kube-api-access-h55b9\") pod \"network-check-target-qmmgl\" (UID: \"97cadd54-3234-4e3f-a2bf-c96b134566b1\") " pod="openshift-network-diagnostics/network-check-target-qmmgl" Sep 18 08:08:15.778116 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:15.778083 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 18 08:08:15.788002 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:15.787985 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 18 08:08:15.798639 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:15.798610 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h55b9\" (UniqueName: \"kubernetes.io/projected/97cadd54-3234-4e3f-a2bf-c96b134566b1-kube-api-access-h55b9\") pod \"network-check-target-qmmgl\" (UID: \"97cadd54-3234-4e3f-a2bf-c96b134566b1\") " pod="openshift-network-diagnostics/network-check-target-qmmgl" Sep 18 08:08:15.853798 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:15.853775 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-4bfgf\"" Sep 18 08:08:15.858743 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:15.858727 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6rnbm" Sep 18 08:08:15.860804 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:15.860786 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9vz5k" Sep 18 08:08:15.952259 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:15.952199 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-fz876\"" Sep 18 08:08:15.959364 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:15.959344 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qmmgl" Sep 18 08:08:16.315196 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:16.315165 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8daf0e48-a502-4b73-a0aa-74f9c20116d9","Type":"ContainerStarted","Data":"380b1d4b0b336f887cb2445e12ea85e37379ef28ecfdfc44f06282f906f0a4f4"} Sep 18 08:08:16.318069 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:16.318040 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-757bc5bcdc-4sj2l" event={"ID":"816180ae-277e-402e-b6d3-8b3cc8ade4f2","Type":"ContainerStarted","Data":"7fa3e7e7d4367df8b02d3338272b6059b2ff127dfb97581d8fd59da54cb55d82"} Sep 18 08:08:16.344121 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:16.344082 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.611978792 podStartE2EDuration="11.344064896s" totalImagesPullingTime="7.694176915s" totalInitContainerRuntime="37.909189ms" isStatefulPod=false podCreationTimestamp="2026-09-18 08:08:05 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 08:08:16.342685474 +0000 UTC m=+68.612385440" watchObservedRunningTime="2026-09-18 08:08:16.344064896 +0000 UTC m=+68.613764826" Sep 18 08:08:16.707451 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:16.705544 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-qmmgl"] Sep 18 08:08:16.715571 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:16.715539 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-9vz5k"] Sep 18 08:08:16.719251 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:08:16.717920 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97cadd54_3234_4e3f_a2bf_c96b134566b1.slice/crio-a3b0c34829729383ef8fe63a6962ddae6b3b11f50a48ab76bbf709c2e20fe275 WatchSource:0}: Error finding container a3b0c34829729383ef8fe63a6962ddae6b3b11f50a48ab76bbf709c2e20fe275: Status 404 returned error can't find the container with id a3b0c34829729383ef8fe63a6962ddae6b3b11f50a48ab76bbf709c2e20fe275 Sep 18 08:08:16.722630 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:16.722604 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6rnbm"] Sep 18 08:08:16.725590 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:08:16.725562 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6e0d1e7_a182_4ac0_a484_f174f64ca021.slice/crio-8dff5521a1486d1cce1afd2e5ae595031d35247dd69c98ec22bcfc36a942594e WatchSource:0}: Error finding container 8dff5521a1486d1cce1afd2e5ae595031d35247dd69c98ec22bcfc36a942594e: Status 404 returned error can't find the container with id 8dff5521a1486d1cce1afd2e5ae595031d35247dd69c98ec22bcfc36a942594e Sep 18 08:08:16.732561 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:08:16.732535 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d257247_8dae_4dce_9c31_62cf736b2b9f.slice/crio-55e892acf2cf9013c3d6c4c29c24ff57b43858251d54962ab801af2dfc9e05d6 WatchSource:0}: Error finding container 55e892acf2cf9013c3d6c4c29c24ff57b43858251d54962ab801af2dfc9e05d6: Status 404 returned error can't find the container with id 55e892acf2cf9013c3d6c4c29c24ff57b43858251d54962ab801af2dfc9e05d6 Sep 18 08:08:17.330492 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:17.330461 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"53f6513d-2d21-463e-b9d7-93809bf37f40","Type":"ContainerStarted","Data":"47240108698a9acf5d98d4d1e43789681af64e019f1161dbb2c90a457792d27f"} Sep 18 08:08:17.330944 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:17.330527 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"53f6513d-2d21-463e-b9d7-93809bf37f40","Type":"ContainerStarted","Data":"97e021996ce27a924bf6ca5f494d1d0a157bfc8293f561318e5dbda15f820bd8"} Sep 18 08:08:17.330944 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:17.330553 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"53f6513d-2d21-463e-b9d7-93809bf37f40","Type":"ContainerStarted","Data":"ed2b881db9df870bf2057104fac5cc2114f2624ecee69b7af7279787075dafe4"} Sep 18 08:08:17.330944 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:17.330576 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"53f6513d-2d21-463e-b9d7-93809bf37f40","Type":"ContainerStarted","Data":"38969f735a8167c7db58aca0809db04d05add95b7c9b5f27b8fc83722a29eb56"} Sep 18 08:08:17.330944 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:17.330598 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"53f6513d-2d21-463e-b9d7-93809bf37f40","Type":"ContainerStarted","Data":"fcc929806d0830eaaf53032185fcf96e75f7b2bc0b4a7abb3847f123e80272ad"} Sep 18 08:08:17.330944 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:17.330620 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"53f6513d-2d21-463e-b9d7-93809bf37f40","Type":"ContainerStarted","Data":"8f7b7b71e6f90350cac743eabae8d27d0c63fe963d8deb700cbe2015bc780fa6"} Sep 18 08:08:17.334706 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:17.334676 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-qmmgl" event={"ID":"97cadd54-3234-4e3f-a2bf-c96b134566b1","Type":"ContainerStarted","Data":"a3b0c34829729383ef8fe63a6962ddae6b3b11f50a48ab76bbf709c2e20fe275"} Sep 18 08:08:17.341530 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:17.340748 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-757bc5bcdc-4sj2l" event={"ID":"816180ae-277e-402e-b6d3-8b3cc8ade4f2","Type":"ContainerStarted","Data":"7be617f57cfa44da7c4a1f296f7ff1ab5c4faa445f6e4a174ab784bdd2bce3ab"} Sep 18 08:08:17.341530 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:17.340814 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-757bc5bcdc-4sj2l" event={"ID":"816180ae-277e-402e-b6d3-8b3cc8ade4f2","Type":"ContainerStarted","Data":"d8eb212dc749b65002d2bd7721b20527be0247517c5d07cdc3310e9c976a9443"} Sep 18 08:08:17.341530 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:17.340879 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-757bc5bcdc-4sj2l" Sep 18 08:08:17.342504 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:17.342407 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6rnbm" event={"ID":"8d257247-8dae-4dce-9c31-62cf736b2b9f","Type":"ContainerStarted","Data":"55e892acf2cf9013c3d6c4c29c24ff57b43858251d54962ab801af2dfc9e05d6"} Sep 18 08:08:17.346650 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:17.346614 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9vz5k" event={"ID":"b6e0d1e7-a182-4ac0-a484-f174f64ca021","Type":"ContainerStarted","Data":"8dff5521a1486d1cce1afd2e5ae595031d35247dd69c98ec22bcfc36a942594e"} Sep 18 08:08:17.363909 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:17.363859 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.127927145 podStartE2EDuration="7.363822284s" totalImagesPullingTime="4.201927517s" totalInitContainerRuntime="33.967622ms" isStatefulPod=false podCreationTimestamp="2026-09-18 08:08:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 08:08:17.36214294 +0000 UTC m=+69.631842870" watchObservedRunningTime="2026-09-18 08:08:17.363822284 +0000 UTC m=+69.633522194" Sep 18 08:08:17.385331 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:17.385187 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-757bc5bcdc-4sj2l" podStartSLOduration=6.188527528 podStartE2EDuration="10.385166758s" totalImagesPullingTime="4.19663923s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 08:08:07 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 08:08:17.383648525 +0000 UTC m=+69.653348490" watchObservedRunningTime="2026-09-18 08:08:17.385166758 +0000 UTC m=+69.654866688" Sep 18 08:08:18.355419 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:18.354901 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9vz5k" event={"ID":"b6e0d1e7-a182-4ac0-a484-f174f64ca021","Type":"ContainerStarted","Data":"05fc086aa207451557f63444550aa237a6f28a989e662d0782aa69e8dee886d9"} Sep 18 08:08:18.355419 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:18.354975 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9vz5k" event={"ID":"b6e0d1e7-a182-4ac0-a484-f174f64ca021","Type":"ContainerStarted","Data":"c3dd240dc1889d452fb9e4f3492479c16383420531ed3597006cd0411b1ed131"} Sep 18 08:08:18.373682 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:18.373625 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-9vz5k" podStartSLOduration=67.230874389 podStartE2EDuration="1m8.373605408s" totalImagesPullingTime="1.142731019s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 08:07:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 08:08:18.37243981 +0000 UTC m=+70.642139740" watchObservedRunningTime="2026-09-18 08:08:18.373605408 +0000 UTC m=+70.643305343" Sep 18 08:08:21.315448 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:21.315341 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 08:08:22.375159 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:22.375121 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6rnbm" event={"ID":"8d257247-8dae-4dce-9c31-62cf736b2b9f","Type":"ContainerStarted","Data":"dfb3d940cf8b27b3b2427ec0a3e8a79f52e211ef7f64e2514fb0a18398f37e1c"} Sep 18 08:08:22.376805 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:22.376774 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-qmmgl" event={"ID":"97cadd54-3234-4e3f-a2bf-c96b134566b1","Type":"ContainerStarted","Data":"ecbc1f832c6609f46727bef3361c83cf0e1450674d1bf61a5881a390ae4c11eb"} Sep 18 08:08:22.376956 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:22.376899 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-qmmgl" Sep 18 08:08:22.402027 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:22.401978 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-6rnbm" podStartSLOduration=67.807624044 podStartE2EDuration="1m12.401964585s" totalImagesPullingTime="4.594340541s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 08:07:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 08:08:22.400517877 +0000 UTC m=+74.670217808" watchObservedRunningTime="2026-09-18 08:08:22.401964585 +0000 UTC m=+74.671664530" Sep 18 08:08:22.417974 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:22.417930 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-qmmgl" podStartSLOduration=67.818343177 podStartE2EDuration="1m12.417918661s" totalImagesPullingTime="4.599575484s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 08:07:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 08:08:22.417243456 +0000 UTC m=+74.686943387" watchObservedRunningTime="2026-09-18 08:08:22.417918661 +0000 UTC m=+74.687618587" Sep 18 08:08:22.594591 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:22.594560 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-66bbdc9c7f-rklml"] Sep 18 08:08:23.360998 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:23.360973 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-757bc5bcdc-4sj2l" Sep 18 08:08:29.446415 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:29.446369 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-5dd968f6c-d6whc" Sep 18 08:08:29.446902 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:29.446442 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-5dd968f6c-d6whc" Sep 18 08:08:47.614681 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:47.614614 2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-66bbdc9c7f-rklml" podUID="2aa01fbe-57ff-4d1e-9728-91ff8382f85c" containerName="console" containerID="cri-o://122899182bfafdd0550b6ee36cbcdeaf6585cf21fdc27c3bf4ecc308989b1900" gracePeriod=15 Sep 18 08:08:48.367090 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:48.367058 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66bbdc9c7f-rklml" Sep 18 08:08:48.486034 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:48.485975 2585 generic.go:356] "Generic (PLEG): container finished" podID="2aa01fbe-57ff-4d1e-9728-91ff8382f85c" containerID="122899182bfafdd0550b6ee36cbcdeaf6585cf21fdc27c3bf4ecc308989b1900" exitCode=0 Sep 18 08:08:48.486034 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:48.486024 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66bbdc9c7f-rklml" Sep 18 08:08:48.486202 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:48.486059 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66bbdc9c7f-rklml" event={"ID":"2aa01fbe-57ff-4d1e-9728-91ff8382f85c","Type":"ContainerDied","Data":"122899182bfafdd0550b6ee36cbcdeaf6585cf21fdc27c3bf4ecc308989b1900"} Sep 18 08:08:48.486202 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:48.486108 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66bbdc9c7f-rklml" event={"ID":"2aa01fbe-57ff-4d1e-9728-91ff8382f85c","Type":"ContainerDied","Data":"6c396dea11b4cc679e844ab5e7ea99d091d58f524b70e7965088753c13f3e382"} Sep 18 08:08:48.486202 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:48.486131 2585 scope.go:117] "RemoveContainer" containerID="122899182bfafdd0550b6ee36cbcdeaf6585cf21fdc27c3bf4ecc308989b1900" Sep 18 08:08:48.498428 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:48.498408 2585 scope.go:117] "RemoveContainer" containerID="122899182bfafdd0550b6ee36cbcdeaf6585cf21fdc27c3bf4ecc308989b1900" Sep 18 08:08:48.498761 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:08:48.498735 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"122899182bfafdd0550b6ee36cbcdeaf6585cf21fdc27c3bf4ecc308989b1900\": container with ID starting with 122899182bfafdd0550b6ee36cbcdeaf6585cf21fdc27c3bf4ecc308989b1900 not found: ID does not exist" containerID="122899182bfafdd0550b6ee36cbcdeaf6585cf21fdc27c3bf4ecc308989b1900" Sep 18 08:08:48.498885 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:48.498771 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"122899182bfafdd0550b6ee36cbcdeaf6585cf21fdc27c3bf4ecc308989b1900"} err="failed to get container status \"122899182bfafdd0550b6ee36cbcdeaf6585cf21fdc27c3bf4ecc308989b1900\": rpc error: code = NotFound desc = could not find container \"122899182bfafdd0550b6ee36cbcdeaf6585cf21fdc27c3bf4ecc308989b1900\": container with ID starting with 122899182bfafdd0550b6ee36cbcdeaf6585cf21fdc27c3bf4ecc308989b1900 not found: ID does not exist" Sep 18 08:08:48.546135 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:48.546111 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2aa01fbe-57ff-4d1e-9728-91ff8382f85c-oauth-serving-cert\") pod \"2aa01fbe-57ff-4d1e-9728-91ff8382f85c\" (UID: \"2aa01fbe-57ff-4d1e-9728-91ff8382f85c\") " Sep 18 08:08:48.546269 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:48.546143 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2aa01fbe-57ff-4d1e-9728-91ff8382f85c-service-ca\") pod \"2aa01fbe-57ff-4d1e-9728-91ff8382f85c\" (UID: \"2aa01fbe-57ff-4d1e-9728-91ff8382f85c\") " Sep 18 08:08:48.546269 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:48.546168 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2aa01fbe-57ff-4d1e-9728-91ff8382f85c-console-serving-cert\") pod \"2aa01fbe-57ff-4d1e-9728-91ff8382f85c\" (UID: \"2aa01fbe-57ff-4d1e-9728-91ff8382f85c\") " Sep 18 08:08:48.546269 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:48.546190 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2aa01fbe-57ff-4d1e-9728-91ff8382f85c-console-oauth-config\") pod \"2aa01fbe-57ff-4d1e-9728-91ff8382f85c\" (UID: \"2aa01fbe-57ff-4d1e-9728-91ff8382f85c\") " Sep 18 08:08:48.546269 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:48.546239 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xbtdk\" (UniqueName: \"kubernetes.io/projected/2aa01fbe-57ff-4d1e-9728-91ff8382f85c-kube-api-access-xbtdk\") pod \"2aa01fbe-57ff-4d1e-9728-91ff8382f85c\" (UID: \"2aa01fbe-57ff-4d1e-9728-91ff8382f85c\") " Sep 18 08:08:48.546269 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:48.546253 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2aa01fbe-57ff-4d1e-9728-91ff8382f85c-console-config\") pod \"2aa01fbe-57ff-4d1e-9728-91ff8382f85c\" (UID: \"2aa01fbe-57ff-4d1e-9728-91ff8382f85c\") " Sep 18 08:08:48.546666 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:48.546539 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2aa01fbe-57ff-4d1e-9728-91ff8382f85c-service-ca" (OuterVolumeSpecName: "service-ca") pod "2aa01fbe-57ff-4d1e-9728-91ff8382f85c" (UID: "2aa01fbe-57ff-4d1e-9728-91ff8382f85c"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 08:08:48.546767 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:48.546637 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2aa01fbe-57ff-4d1e-9728-91ff8382f85c-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "2aa01fbe-57ff-4d1e-9728-91ff8382f85c" (UID: "2aa01fbe-57ff-4d1e-9728-91ff8382f85c"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 08:08:48.546767 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:48.546740 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2aa01fbe-57ff-4d1e-9728-91ff8382f85c-console-config" (OuterVolumeSpecName: "console-config") pod "2aa01fbe-57ff-4d1e-9728-91ff8382f85c" (UID: "2aa01fbe-57ff-4d1e-9728-91ff8382f85c"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 08:08:48.548546 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:48.548521 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2aa01fbe-57ff-4d1e-9728-91ff8382f85c-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "2aa01fbe-57ff-4d1e-9728-91ff8382f85c" (UID: "2aa01fbe-57ff-4d1e-9728-91ff8382f85c"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 08:08:48.548914 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:48.548892 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2aa01fbe-57ff-4d1e-9728-91ff8382f85c-kube-api-access-xbtdk" (OuterVolumeSpecName: "kube-api-access-xbtdk") pod "2aa01fbe-57ff-4d1e-9728-91ff8382f85c" (UID: "2aa01fbe-57ff-4d1e-9728-91ff8382f85c"). InnerVolumeSpecName "kube-api-access-xbtdk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 08:08:48.548987 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:48.548909 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2aa01fbe-57ff-4d1e-9728-91ff8382f85c-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "2aa01fbe-57ff-4d1e-9728-91ff8382f85c" (UID: "2aa01fbe-57ff-4d1e-9728-91ff8382f85c"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 08:08:48.647065 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:48.647044 2585 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2aa01fbe-57ff-4d1e-9728-91ff8382f85c-oauth-serving-cert\") on node \"ip-10-0-138-42.ec2.internal\" DevicePath \"\"" Sep 18 08:08:48.647065 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:48.647065 2585 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2aa01fbe-57ff-4d1e-9728-91ff8382f85c-service-ca\") on node \"ip-10-0-138-42.ec2.internal\" DevicePath \"\"" Sep 18 08:08:48.647354 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:48.647075 2585 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2aa01fbe-57ff-4d1e-9728-91ff8382f85c-console-serving-cert\") on node \"ip-10-0-138-42.ec2.internal\" DevicePath \"\"" Sep 18 08:08:48.647354 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:48.647084 2585 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2aa01fbe-57ff-4d1e-9728-91ff8382f85c-console-oauth-config\") on node \"ip-10-0-138-42.ec2.internal\" DevicePath \"\"" Sep 18 08:08:48.647354 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:48.647093 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xbtdk\" (UniqueName: \"kubernetes.io/projected/2aa01fbe-57ff-4d1e-9728-91ff8382f85c-kube-api-access-xbtdk\") on node \"ip-10-0-138-42.ec2.internal\" DevicePath \"\"" Sep 18 08:08:48.647354 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:48.647102 2585 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2aa01fbe-57ff-4d1e-9728-91ff8382f85c-console-config\") on node \"ip-10-0-138-42.ec2.internal\" DevicePath \"\"" Sep 18 08:08:48.806692 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:48.806669 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-66bbdc9c7f-rklml"] Sep 18 08:08:48.808755 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:48.808724 2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-66bbdc9c7f-rklml"] Sep 18 08:08:49.452085 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:49.452063 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-5dd968f6c-d6whc" Sep 18 08:08:49.456545 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:49.456517 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-5dd968f6c-d6whc" Sep 18 08:08:49.944074 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:49.944041 2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2aa01fbe-57ff-4d1e-9728-91ff8382f85c" path="/var/lib/kubelet/pods/2aa01fbe-57ff-4d1e-9728-91ff8382f85c/volumes" Sep 18 08:08:53.384339 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:08:53.384299 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-qmmgl" Sep 18 08:09:11.315002 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:11.314966 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 08:09:11.342153 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:11.342127 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 08:09:11.606959 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:11.606886 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 08:09:25.024507 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:25.024472 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 18 08:09:25.024962 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:25.024724 2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8daf0e48-a502-4b73-a0aa-74f9c20116d9" containerName="alertmanager" containerID="cri-o://227545cbe899b169d3a90575289bdbe4b7846bf397d2910b2c9d5dd8bf122b2b" gracePeriod=120 Sep 18 08:09:25.024962 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:25.024817 2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8daf0e48-a502-4b73-a0aa-74f9c20116d9" containerName="config-reloader" containerID="cri-o://a07d37ef4ca6acb644213e821d82d84ac1fc327be10b5b01a02586cd8ffc19da" gracePeriod=120 Sep 18 08:09:25.024962 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:25.024869 2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8daf0e48-a502-4b73-a0aa-74f9c20116d9" containerName="kube-rbac-proxy" containerID="cri-o://f42579118cddb16b3cab4b543aa92317861bd1e9e4f25ff446643f28d1cf9dc1" gracePeriod=120 Sep 18 08:09:25.024962 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:25.024807 2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8daf0e48-a502-4b73-a0aa-74f9c20116d9" containerName="kube-rbac-proxy-web" containerID="cri-o://4f990ed60fc6a255df375d20ebcf991d937fb81ab4368ebe91fedea382d3a63f" gracePeriod=120 Sep 18 08:09:25.025179 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:25.024870 2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8daf0e48-a502-4b73-a0aa-74f9c20116d9" containerName="prom-label-proxy" containerID="cri-o://380b1d4b0b336f887cb2445e12ea85e37379ef28ecfdfc44f06282f906f0a4f4" gracePeriod=120 Sep 18 08:09:25.025179 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:25.024800 2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8daf0e48-a502-4b73-a0aa-74f9c20116d9" containerName="kube-rbac-proxy-metric" containerID="cri-o://8165c0953a7e38c70c01d59dcc9945d2dfad773940c8fa60be52b5e6430f29cf" gracePeriod=120 Sep 18 08:09:25.650619 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:25.650590 2585 generic.go:356] "Generic (PLEG): container finished" podID="8daf0e48-a502-4b73-a0aa-74f9c20116d9" containerID="380b1d4b0b336f887cb2445e12ea85e37379ef28ecfdfc44f06282f906f0a4f4" exitCode=0 Sep 18 08:09:25.650619 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:25.650613 2585 generic.go:356] "Generic (PLEG): container finished" podID="8daf0e48-a502-4b73-a0aa-74f9c20116d9" containerID="8165c0953a7e38c70c01d59dcc9945d2dfad773940c8fa60be52b5e6430f29cf" exitCode=0 Sep 18 08:09:25.650619 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:25.650620 2585 generic.go:356] "Generic (PLEG): container finished" podID="8daf0e48-a502-4b73-a0aa-74f9c20116d9" containerID="f42579118cddb16b3cab4b543aa92317861bd1e9e4f25ff446643f28d1cf9dc1" exitCode=0 Sep 18 08:09:25.650619 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:25.650626 2585 generic.go:356] "Generic (PLEG): container finished" podID="8daf0e48-a502-4b73-a0aa-74f9c20116d9" containerID="a07d37ef4ca6acb644213e821d82d84ac1fc327be10b5b01a02586cd8ffc19da" exitCode=0 Sep 18 08:09:25.650619 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:25.650631 2585 generic.go:356] "Generic (PLEG): container finished" podID="8daf0e48-a502-4b73-a0aa-74f9c20116d9" containerID="227545cbe899b169d3a90575289bdbe4b7846bf397d2910b2c9d5dd8bf122b2b" exitCode=0 Sep 18 08:09:25.650942 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:25.650667 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8daf0e48-a502-4b73-a0aa-74f9c20116d9","Type":"ContainerDied","Data":"380b1d4b0b336f887cb2445e12ea85e37379ef28ecfdfc44f06282f906f0a4f4"} Sep 18 08:09:25.650942 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:25.650737 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8daf0e48-a502-4b73-a0aa-74f9c20116d9","Type":"ContainerDied","Data":"8165c0953a7e38c70c01d59dcc9945d2dfad773940c8fa60be52b5e6430f29cf"} Sep 18 08:09:25.650942 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:25.650763 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8daf0e48-a502-4b73-a0aa-74f9c20116d9","Type":"ContainerDied","Data":"f42579118cddb16b3cab4b543aa92317861bd1e9e4f25ff446643f28d1cf9dc1"} Sep 18 08:09:25.650942 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:25.650787 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8daf0e48-a502-4b73-a0aa-74f9c20116d9","Type":"ContainerDied","Data":"a07d37ef4ca6acb644213e821d82d84ac1fc327be10b5b01a02586cd8ffc19da"} Sep 18 08:09:25.650942 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:25.650810 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8daf0e48-a502-4b73-a0aa-74f9c20116d9","Type":"ContainerDied","Data":"227545cbe899b169d3a90575289bdbe4b7846bf397d2910b2c9d5dd8bf122b2b"} Sep 18 08:09:26.271381 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:26.271357 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 18 08:09:26.327153 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:26.327124 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8daf0e48-a502-4b73-a0aa-74f9c20116d9-secret-alertmanager-kube-rbac-proxy-web\") pod \"8daf0e48-a502-4b73-a0aa-74f9c20116d9\" (UID: \"8daf0e48-a502-4b73-a0aa-74f9c20116d9\") " Sep 18 08:09:26.327326 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:26.327169 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8daf0e48-a502-4b73-a0aa-74f9c20116d9-secret-alertmanager-kube-rbac-proxy-metric\") pod \"8daf0e48-a502-4b73-a0aa-74f9c20116d9\" (UID: \"8daf0e48-a502-4b73-a0aa-74f9c20116d9\") " Sep 18 08:09:26.327326 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:26.327218 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8daf0e48-a502-4b73-a0aa-74f9c20116d9-alertmanager-main-db\") pod \"8daf0e48-a502-4b73-a0aa-74f9c20116d9\" (UID: \"8daf0e48-a502-4b73-a0aa-74f9c20116d9\") " Sep 18 08:09:26.327326 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:26.327258 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8daf0e48-a502-4b73-a0aa-74f9c20116d9-web-config\") pod \"8daf0e48-a502-4b73-a0aa-74f9c20116d9\" (UID: \"8daf0e48-a502-4b73-a0aa-74f9c20116d9\") " Sep 18 08:09:26.327326 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:26.327284 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8daf0e48-a502-4b73-a0aa-74f9c20116d9-config-volume\") pod \"8daf0e48-a502-4b73-a0aa-74f9c20116d9\" (UID: \"8daf0e48-a502-4b73-a0aa-74f9c20116d9\") " Sep 18 08:09:26.327326 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:26.327305 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8daf0e48-a502-4b73-a0aa-74f9c20116d9-tls-assets\") pod \"8daf0e48-a502-4b73-a0aa-74f9c20116d9\" (UID: \"8daf0e48-a502-4b73-a0aa-74f9c20116d9\") " Sep 18 08:09:26.327582 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:26.327334 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nwnjw\" (UniqueName: \"kubernetes.io/projected/8daf0e48-a502-4b73-a0aa-74f9c20116d9-kube-api-access-nwnjw\") pod \"8daf0e48-a502-4b73-a0aa-74f9c20116d9\" (UID: \"8daf0e48-a502-4b73-a0aa-74f9c20116d9\") " Sep 18 08:09:26.327582 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:26.327367 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8daf0e48-a502-4b73-a0aa-74f9c20116d9-alertmanager-trusted-ca-bundle\") pod \"8daf0e48-a502-4b73-a0aa-74f9c20116d9\" (UID: \"8daf0e48-a502-4b73-a0aa-74f9c20116d9\") " Sep 18 08:09:26.327582 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:26.327409 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8daf0e48-a502-4b73-a0aa-74f9c20116d9-config-out\") pod \"8daf0e48-a502-4b73-a0aa-74f9c20116d9\" (UID: \"8daf0e48-a502-4b73-a0aa-74f9c20116d9\") " Sep 18 08:09:26.327582 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:26.327445 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8daf0e48-a502-4b73-a0aa-74f9c20116d9-secret-alertmanager-kube-rbac-proxy\") pod \"8daf0e48-a502-4b73-a0aa-74f9c20116d9\" (UID: \"8daf0e48-a502-4b73-a0aa-74f9c20116d9\") " Sep 18 08:09:26.327582 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:26.327495 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8daf0e48-a502-4b73-a0aa-74f9c20116d9-secret-alertmanager-main-tls\") pod \"8daf0e48-a502-4b73-a0aa-74f9c20116d9\" (UID: \"8daf0e48-a502-4b73-a0aa-74f9c20116d9\") " Sep 18 08:09:26.327582 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:26.327526 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8daf0e48-a502-4b73-a0aa-74f9c20116d9-cluster-tls-config\") pod \"8daf0e48-a502-4b73-a0aa-74f9c20116d9\" (UID: \"8daf0e48-a502-4b73-a0aa-74f9c20116d9\") " Sep 18 08:09:26.327582 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:26.327563 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8daf0e48-a502-4b73-a0aa-74f9c20116d9-metrics-client-ca\") pod \"8daf0e48-a502-4b73-a0aa-74f9c20116d9\" (UID: \"8daf0e48-a502-4b73-a0aa-74f9c20116d9\") " Sep 18 08:09:26.327952 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:26.327598 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8daf0e48-a502-4b73-a0aa-74f9c20116d9-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "8daf0e48-a502-4b73-a0aa-74f9c20116d9" (UID: "8daf0e48-a502-4b73-a0aa-74f9c20116d9"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 18 08:09:26.327952 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:26.327835 2585 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8daf0e48-a502-4b73-a0aa-74f9c20116d9-alertmanager-main-db\") on node \"ip-10-0-138-42.ec2.internal\" DevicePath \"\"" Sep 18 08:09:26.329014 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:26.328228 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8daf0e48-a502-4b73-a0aa-74f9c20116d9-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "8daf0e48-a502-4b73-a0aa-74f9c20116d9" (UID: "8daf0e48-a502-4b73-a0aa-74f9c20116d9"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 08:09:26.329014 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:26.328617 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8daf0e48-a502-4b73-a0aa-74f9c20116d9-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "8daf0e48-a502-4b73-a0aa-74f9c20116d9" (UID: "8daf0e48-a502-4b73-a0aa-74f9c20116d9"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 08:09:26.332529 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:26.332426 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8daf0e48-a502-4b73-a0aa-74f9c20116d9-config-volume" (OuterVolumeSpecName: "config-volume") pod "8daf0e48-a502-4b73-a0aa-74f9c20116d9" (UID: "8daf0e48-a502-4b73-a0aa-74f9c20116d9"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 08:09:26.333329 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:26.333290 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8daf0e48-a502-4b73-a0aa-74f9c20116d9-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "8daf0e48-a502-4b73-a0aa-74f9c20116d9" (UID: "8daf0e48-a502-4b73-a0aa-74f9c20116d9"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 08:09:26.333804 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:26.333325 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8daf0e48-a502-4b73-a0aa-74f9c20116d9-config-out" (OuterVolumeSpecName: "config-out") pod "8daf0e48-a502-4b73-a0aa-74f9c20116d9" (UID: "8daf0e48-a502-4b73-a0aa-74f9c20116d9"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 18 08:09:26.333804 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:26.333410 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8daf0e48-a502-4b73-a0aa-74f9c20116d9-kube-api-access-nwnjw" (OuterVolumeSpecName: "kube-api-access-nwnjw") pod "8daf0e48-a502-4b73-a0aa-74f9c20116d9" (UID: "8daf0e48-a502-4b73-a0aa-74f9c20116d9"). InnerVolumeSpecName "kube-api-access-nwnjw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 08:09:26.333804 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:26.333624 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8daf0e48-a502-4b73-a0aa-74f9c20116d9-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "8daf0e48-a502-4b73-a0aa-74f9c20116d9" (UID: "8daf0e48-a502-4b73-a0aa-74f9c20116d9"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 08:09:26.333804 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:26.333634 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8daf0e48-a502-4b73-a0aa-74f9c20116d9-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "8daf0e48-a502-4b73-a0aa-74f9c20116d9" (UID: "8daf0e48-a502-4b73-a0aa-74f9c20116d9"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 08:09:26.334075 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:26.334019 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8daf0e48-a502-4b73-a0aa-74f9c20116d9-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "8daf0e48-a502-4b73-a0aa-74f9c20116d9" (UID: "8daf0e48-a502-4b73-a0aa-74f9c20116d9"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 08:09:26.334149 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:26.334121 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8daf0e48-a502-4b73-a0aa-74f9c20116d9-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "8daf0e48-a502-4b73-a0aa-74f9c20116d9" (UID: "8daf0e48-a502-4b73-a0aa-74f9c20116d9"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 08:09:26.339338 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:26.339282 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8daf0e48-a502-4b73-a0aa-74f9c20116d9-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "8daf0e48-a502-4b73-a0aa-74f9c20116d9" (UID: "8daf0e48-a502-4b73-a0aa-74f9c20116d9"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 08:09:26.344938 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:26.344913 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8daf0e48-a502-4b73-a0aa-74f9c20116d9-web-config" (OuterVolumeSpecName: "web-config") pod "8daf0e48-a502-4b73-a0aa-74f9c20116d9" (UID: "8daf0e48-a502-4b73-a0aa-74f9c20116d9"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 08:09:26.428575 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:26.428543 2585 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8daf0e48-a502-4b73-a0aa-74f9c20116d9-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-138-42.ec2.internal\" DevicePath \"\"" Sep 18 08:09:26.428575 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:26.428568 2585 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8daf0e48-a502-4b73-a0aa-74f9c20116d9-config-out\") on node \"ip-10-0-138-42.ec2.internal\" DevicePath \"\"" Sep 18 08:09:26.428575 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:26.428578 2585 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8daf0e48-a502-4b73-a0aa-74f9c20116d9-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-138-42.ec2.internal\" DevicePath \"\"" Sep 18 08:09:26.428783 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:26.428586 2585 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8daf0e48-a502-4b73-a0aa-74f9c20116d9-secret-alertmanager-main-tls\") on node \"ip-10-0-138-42.ec2.internal\" DevicePath \"\"" Sep 18 08:09:26.428783 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:26.428595 2585 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8daf0e48-a502-4b73-a0aa-74f9c20116d9-cluster-tls-config\") on node \"ip-10-0-138-42.ec2.internal\" DevicePath \"\"" Sep 18 08:09:26.428783 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:26.428604 2585 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8daf0e48-a502-4b73-a0aa-74f9c20116d9-metrics-client-ca\") on node \"ip-10-0-138-42.ec2.internal\" DevicePath \"\"" Sep 18 08:09:26.428783 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:26.428635 2585 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8daf0e48-a502-4b73-a0aa-74f9c20116d9-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-138-42.ec2.internal\" DevicePath \"\"" Sep 18 08:09:26.428783 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:26.428644 2585 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8daf0e48-a502-4b73-a0aa-74f9c20116d9-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-138-42.ec2.internal\" DevicePath \"\"" Sep 18 08:09:26.428783 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:26.428652 2585 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8daf0e48-a502-4b73-a0aa-74f9c20116d9-web-config\") on node \"ip-10-0-138-42.ec2.internal\" DevicePath \"\"" Sep 18 08:09:26.428783 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:26.428661 2585 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8daf0e48-a502-4b73-a0aa-74f9c20116d9-config-volume\") on node \"ip-10-0-138-42.ec2.internal\" DevicePath \"\"" Sep 18 08:09:26.428783 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:26.428669 2585 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8daf0e48-a502-4b73-a0aa-74f9c20116d9-tls-assets\") on node \"ip-10-0-138-42.ec2.internal\" DevicePath \"\"" Sep 18 08:09:26.428783 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:26.428676 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nwnjw\" (UniqueName: \"kubernetes.io/projected/8daf0e48-a502-4b73-a0aa-74f9c20116d9-kube-api-access-nwnjw\") on node \"ip-10-0-138-42.ec2.internal\" DevicePath \"\"" Sep 18 08:09:26.658776 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:26.658674 2585 generic.go:356] "Generic (PLEG): container finished" podID="8daf0e48-a502-4b73-a0aa-74f9c20116d9" containerID="4f990ed60fc6a255df375d20ebcf991d937fb81ab4368ebe91fedea382d3a63f" exitCode=0 Sep 18 08:09:26.658776 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:26.658770 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 18 08:09:26.658984 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:26.658767 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8daf0e48-a502-4b73-a0aa-74f9c20116d9","Type":"ContainerDied","Data":"4f990ed60fc6a255df375d20ebcf991d937fb81ab4368ebe91fedea382d3a63f"} Sep 18 08:09:26.658984 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:26.658954 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8daf0e48-a502-4b73-a0aa-74f9c20116d9","Type":"ContainerDied","Data":"0594eacf11a67a16bf222e1b65066028e706124cfa7cc8934af455f692dcdea3"} Sep 18 08:09:26.659079 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:26.658992 2585 scope.go:117] "RemoveContainer" containerID="380b1d4b0b336f887cb2445e12ea85e37379ef28ecfdfc44f06282f906f0a4f4" Sep 18 08:09:26.667417 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:26.667394 2585 scope.go:117] "RemoveContainer" containerID="8165c0953a7e38c70c01d59dcc9945d2dfad773940c8fa60be52b5e6430f29cf" Sep 18 08:09:26.674661 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:26.674643 2585 scope.go:117] "RemoveContainer" containerID="f42579118cddb16b3cab4b543aa92317861bd1e9e4f25ff446643f28d1cf9dc1" Sep 18 08:09:26.681468 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:26.681376 2585 scope.go:117] "RemoveContainer" containerID="4f990ed60fc6a255df375d20ebcf991d937fb81ab4368ebe91fedea382d3a63f" Sep 18 08:09:26.684439 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:26.684392 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 18 08:09:26.690078 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:26.690054 2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 18 08:09:26.692800 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:26.692786 2585 scope.go:117] "RemoveContainer" containerID="a07d37ef4ca6acb644213e821d82d84ac1fc327be10b5b01a02586cd8ffc19da" Sep 18 08:09:26.700136 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:26.700109 2585 scope.go:117] "RemoveContainer" containerID="227545cbe899b169d3a90575289bdbe4b7846bf397d2910b2c9d5dd8bf122b2b" Sep 18 08:09:26.707067 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:26.707031 2585 scope.go:117] "RemoveContainer" containerID="06ccea7ff4e66233dda7bcb505c01b2749fc14813a36b86edc67b60907ee457a" Sep 18 08:09:26.714363 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:26.714331 2585 scope.go:117] "RemoveContainer" containerID="380b1d4b0b336f887cb2445e12ea85e37379ef28ecfdfc44f06282f906f0a4f4" Sep 18 08:09:26.714832 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:09:26.714659 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"380b1d4b0b336f887cb2445e12ea85e37379ef28ecfdfc44f06282f906f0a4f4\": container with ID starting with 380b1d4b0b336f887cb2445e12ea85e37379ef28ecfdfc44f06282f906f0a4f4 not found: ID does not exist" containerID="380b1d4b0b336f887cb2445e12ea85e37379ef28ecfdfc44f06282f906f0a4f4" Sep 18 08:09:26.714832 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:26.714697 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"380b1d4b0b336f887cb2445e12ea85e37379ef28ecfdfc44f06282f906f0a4f4"} err="failed to get container status \"380b1d4b0b336f887cb2445e12ea85e37379ef28ecfdfc44f06282f906f0a4f4\": rpc error: code = NotFound desc = could not find container \"380b1d4b0b336f887cb2445e12ea85e37379ef28ecfdfc44f06282f906f0a4f4\": container with ID starting with 380b1d4b0b336f887cb2445e12ea85e37379ef28ecfdfc44f06282f906f0a4f4 not found: ID does not exist" Sep 18 08:09:26.714832 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:26.714725 2585 scope.go:117] "RemoveContainer" containerID="8165c0953a7e38c70c01d59dcc9945d2dfad773940c8fa60be52b5e6430f29cf" Sep 18 08:09:26.715141 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:09:26.715109 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8165c0953a7e38c70c01d59dcc9945d2dfad773940c8fa60be52b5e6430f29cf\": container with ID starting with 8165c0953a7e38c70c01d59dcc9945d2dfad773940c8fa60be52b5e6430f29cf not found: ID does not exist" containerID="8165c0953a7e38c70c01d59dcc9945d2dfad773940c8fa60be52b5e6430f29cf" Sep 18 08:09:26.715220 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:26.715151 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8165c0953a7e38c70c01d59dcc9945d2dfad773940c8fa60be52b5e6430f29cf"} err="failed to get container status \"8165c0953a7e38c70c01d59dcc9945d2dfad773940c8fa60be52b5e6430f29cf\": rpc error: code = NotFound desc = could not find container \"8165c0953a7e38c70c01d59dcc9945d2dfad773940c8fa60be52b5e6430f29cf\": container with ID starting with 8165c0953a7e38c70c01d59dcc9945d2dfad773940c8fa60be52b5e6430f29cf not found: ID does not exist" Sep 18 08:09:26.715220 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:26.715175 2585 scope.go:117] "RemoveContainer" containerID="f42579118cddb16b3cab4b543aa92317861bd1e9e4f25ff446643f28d1cf9dc1" Sep 18 08:09:26.715498 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:09:26.715471 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f42579118cddb16b3cab4b543aa92317861bd1e9e4f25ff446643f28d1cf9dc1\": container with ID starting with f42579118cddb16b3cab4b543aa92317861bd1e9e4f25ff446643f28d1cf9dc1 not found: ID does not exist" containerID="f42579118cddb16b3cab4b543aa92317861bd1e9e4f25ff446643f28d1cf9dc1" Sep 18 08:09:26.715571 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:26.715504 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f42579118cddb16b3cab4b543aa92317861bd1e9e4f25ff446643f28d1cf9dc1"} err="failed to get container status \"f42579118cddb16b3cab4b543aa92317861bd1e9e4f25ff446643f28d1cf9dc1\": rpc error: code = NotFound desc = could not find container \"f42579118cddb16b3cab4b543aa92317861bd1e9e4f25ff446643f28d1cf9dc1\": container with ID starting with f42579118cddb16b3cab4b543aa92317861bd1e9e4f25ff446643f28d1cf9dc1 not found: ID does not exist" Sep 18 08:09:26.715571 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:26.715523 2585 scope.go:117] "RemoveContainer" containerID="4f990ed60fc6a255df375d20ebcf991d937fb81ab4368ebe91fedea382d3a63f" Sep 18 08:09:26.715878 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:09:26.715830 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4f990ed60fc6a255df375d20ebcf991d937fb81ab4368ebe91fedea382d3a63f\": container with ID starting with 4f990ed60fc6a255df375d20ebcf991d937fb81ab4368ebe91fedea382d3a63f not found: ID does not exist" containerID="4f990ed60fc6a255df375d20ebcf991d937fb81ab4368ebe91fedea382d3a63f" Sep 18 08:09:26.715958 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:26.715885 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f990ed60fc6a255df375d20ebcf991d937fb81ab4368ebe91fedea382d3a63f"} err="failed to get container status \"4f990ed60fc6a255df375d20ebcf991d937fb81ab4368ebe91fedea382d3a63f\": rpc error: code = NotFound desc = could not find container \"4f990ed60fc6a255df375d20ebcf991d937fb81ab4368ebe91fedea382d3a63f\": container with ID starting with 4f990ed60fc6a255df375d20ebcf991d937fb81ab4368ebe91fedea382d3a63f not found: ID does not exist" Sep 18 08:09:26.715958 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:26.715900 2585 scope.go:117] "RemoveContainer" containerID="a07d37ef4ca6acb644213e821d82d84ac1fc327be10b5b01a02586cd8ffc19da" Sep 18 08:09:26.716194 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:09:26.716175 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a07d37ef4ca6acb644213e821d82d84ac1fc327be10b5b01a02586cd8ffc19da\": container with ID starting with a07d37ef4ca6acb644213e821d82d84ac1fc327be10b5b01a02586cd8ffc19da not found: ID does not exist" containerID="a07d37ef4ca6acb644213e821d82d84ac1fc327be10b5b01a02586cd8ffc19da" Sep 18 08:09:26.716253 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:26.716197 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a07d37ef4ca6acb644213e821d82d84ac1fc327be10b5b01a02586cd8ffc19da"} err="failed to get container status \"a07d37ef4ca6acb644213e821d82d84ac1fc327be10b5b01a02586cd8ffc19da\": rpc error: code = NotFound desc = could not find container \"a07d37ef4ca6acb644213e821d82d84ac1fc327be10b5b01a02586cd8ffc19da\": container with ID starting with a07d37ef4ca6acb644213e821d82d84ac1fc327be10b5b01a02586cd8ffc19da not found: ID does not exist" Sep 18 08:09:26.716253 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:26.716208 2585 scope.go:117] "RemoveContainer" containerID="227545cbe899b169d3a90575289bdbe4b7846bf397d2910b2c9d5dd8bf122b2b" Sep 18 08:09:26.716465 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:09:26.716448 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"227545cbe899b169d3a90575289bdbe4b7846bf397d2910b2c9d5dd8bf122b2b\": container with ID starting with 227545cbe899b169d3a90575289bdbe4b7846bf397d2910b2c9d5dd8bf122b2b not found: ID does not exist" containerID="227545cbe899b169d3a90575289bdbe4b7846bf397d2910b2c9d5dd8bf122b2b" Sep 18 08:09:26.716520 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:26.716471 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"227545cbe899b169d3a90575289bdbe4b7846bf397d2910b2c9d5dd8bf122b2b"} err="failed to get container status \"227545cbe899b169d3a90575289bdbe4b7846bf397d2910b2c9d5dd8bf122b2b\": rpc error: code = NotFound desc = could not find container \"227545cbe899b169d3a90575289bdbe4b7846bf397d2910b2c9d5dd8bf122b2b\": container with ID starting with 227545cbe899b169d3a90575289bdbe4b7846bf397d2910b2c9d5dd8bf122b2b not found: ID does not exist" Sep 18 08:09:26.716520 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:26.716487 2585 scope.go:117] "RemoveContainer" containerID="06ccea7ff4e66233dda7bcb505c01b2749fc14813a36b86edc67b60907ee457a" Sep 18 08:09:26.716711 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:26.716692 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 18 08:09:26.716791 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:09:26.716696 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"06ccea7ff4e66233dda7bcb505c01b2749fc14813a36b86edc67b60907ee457a\": container with ID starting with 06ccea7ff4e66233dda7bcb505c01b2749fc14813a36b86edc67b60907ee457a not found: ID does not exist" containerID="06ccea7ff4e66233dda7bcb505c01b2749fc14813a36b86edc67b60907ee457a" Sep 18 08:09:26.716869 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:26.716795 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"06ccea7ff4e66233dda7bcb505c01b2749fc14813a36b86edc67b60907ee457a"} err="failed to get container status \"06ccea7ff4e66233dda7bcb505c01b2749fc14813a36b86edc67b60907ee457a\": rpc error: code = NotFound desc = could not find container \"06ccea7ff4e66233dda7bcb505c01b2749fc14813a36b86edc67b60907ee457a\": container with ID starting with 06ccea7ff4e66233dda7bcb505c01b2749fc14813a36b86edc67b60907ee457a not found: ID does not exist" Sep 18 08:09:26.717158 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:26.717138 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8daf0e48-a502-4b73-a0aa-74f9c20116d9" containerName="prom-label-proxy" Sep 18 08:09:26.717158 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:26.717159 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="8daf0e48-a502-4b73-a0aa-74f9c20116d9" containerName="prom-label-proxy" Sep 18 08:09:26.717294 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:26.717171 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8daf0e48-a502-4b73-a0aa-74f9c20116d9" containerName="kube-rbac-proxy-metric" Sep 18 08:09:26.717294 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:26.717177 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="8daf0e48-a502-4b73-a0aa-74f9c20116d9" containerName="kube-rbac-proxy-metric" Sep 18 08:09:26.717294 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:26.717189 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8daf0e48-a502-4b73-a0aa-74f9c20116d9" containerName="kube-rbac-proxy-web" Sep 18 08:09:26.717294 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:26.717195 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="8daf0e48-a502-4b73-a0aa-74f9c20116d9" containerName="kube-rbac-proxy-web" Sep 18 08:09:26.717294 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:26.717201 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2aa01fbe-57ff-4d1e-9728-91ff8382f85c" containerName="console" Sep 18 08:09:26.717294 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:26.717206 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="2aa01fbe-57ff-4d1e-9728-91ff8382f85c" containerName="console" Sep 18 08:09:26.717294 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:26.717215 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8daf0e48-a502-4b73-a0aa-74f9c20116d9" containerName="kube-rbac-proxy" Sep 18 08:09:26.717294 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:26.717220 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="8daf0e48-a502-4b73-a0aa-74f9c20116d9" containerName="kube-rbac-proxy" Sep 18 08:09:26.717294 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:26.717228 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8daf0e48-a502-4b73-a0aa-74f9c20116d9" containerName="init-config-reloader" Sep 18 08:09:26.717294 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:26.717234 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="8daf0e48-a502-4b73-a0aa-74f9c20116d9" containerName="init-config-reloader" Sep 18 08:09:26.717294 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:26.717242 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8daf0e48-a502-4b73-a0aa-74f9c20116d9" containerName="alertmanager" Sep 18 08:09:26.717294 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:26.717247 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="8daf0e48-a502-4b73-a0aa-74f9c20116d9" containerName="alertmanager" Sep 18 08:09:26.717294 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:26.717257 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8daf0e48-a502-4b73-a0aa-74f9c20116d9" containerName="config-reloader" Sep 18 08:09:26.717294 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:26.717263 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="8daf0e48-a502-4b73-a0aa-74f9c20116d9" containerName="config-reloader" Sep 18 08:09:26.717752 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:26.717306 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="2aa01fbe-57ff-4d1e-9728-91ff8382f85c" containerName="console" Sep 18 08:09:26.717752 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:26.717315 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="8daf0e48-a502-4b73-a0aa-74f9c20116d9" containerName="prom-label-proxy" Sep 18 08:09:26.717752 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:26.717320 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="8daf0e48-a502-4b73-a0aa-74f9c20116d9" containerName="alertmanager" Sep 18 08:09:26.717752 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:26.717327 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="8daf0e48-a502-4b73-a0aa-74f9c20116d9" containerName="kube-rbac-proxy" Sep 18 08:09:26.717752 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:26.717333 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="8daf0e48-a502-4b73-a0aa-74f9c20116d9" containerName="kube-rbac-proxy-web" Sep 18 08:09:26.717752 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:26.717339 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="8daf0e48-a502-4b73-a0aa-74f9c20116d9" containerName="kube-rbac-proxy-metric" Sep 18 08:09:26.717752 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:26.717344 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="8daf0e48-a502-4b73-a0aa-74f9c20116d9" containerName="config-reloader" Sep 18 08:09:26.720942 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:26.720924 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 18 08:09:26.723272 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:26.723251 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Sep 18 08:09:26.723378 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:26.723294 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Sep 18 08:09:26.723378 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:26.723298 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Sep 18 08:09:26.723495 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:26.723379 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-6stn7\"" Sep 18 08:09:26.723495 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:26.723298 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Sep 18 08:09:26.723495 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:26.723299 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Sep 18 08:09:26.723495 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:26.723420 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Sep 18 08:09:26.723495 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:26.723428 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Sep 18 08:09:26.723646 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:26.723519 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Sep 18 08:09:26.728614 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:26.728596 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Sep 18 08:09:26.736809 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:26.736788 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 18 08:09:26.832600 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:26.832561 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4b4b6720-16b8-4ff8-ab94-5748bb36d61e-web-config\") pod \"alertmanager-main-0\" (UID: \"4b4b6720-16b8-4ff8-ab94-5748bb36d61e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 08:09:26.832600 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:26.832602 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4b4b6720-16b8-4ff8-ab94-5748bb36d61e-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"4b4b6720-16b8-4ff8-ab94-5748bb36d61e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 08:09:26.832808 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:26.832625 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4b4b6720-16b8-4ff8-ab94-5748bb36d61e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4b4b6720-16b8-4ff8-ab94-5748bb36d61e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 08:09:26.832808 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:26.832699 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4b4b6720-16b8-4ff8-ab94-5748bb36d61e-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"4b4b6720-16b8-4ff8-ab94-5748bb36d61e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 08:09:26.832808 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:26.832760 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4b4b6720-16b8-4ff8-ab94-5748bb36d61e-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"4b4b6720-16b8-4ff8-ab94-5748bb36d61e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 08:09:26.832808 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:26.832794 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4b4b6720-16b8-4ff8-ab94-5748bb36d61e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"4b4b6720-16b8-4ff8-ab94-5748bb36d61e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 08:09:26.832963 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:26.832820 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4b4b6720-16b8-4ff8-ab94-5748bb36d61e-config-volume\") pod \"alertmanager-main-0\" (UID: \"4b4b6720-16b8-4ff8-ab94-5748bb36d61e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 08:09:26.832963 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:26.832864 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4b4b6720-16b8-4ff8-ab94-5748bb36d61e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"4b4b6720-16b8-4ff8-ab94-5748bb36d61e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 08:09:26.832963 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:26.832892 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4b4b6720-16b8-4ff8-ab94-5748bb36d61e-config-out\") pod \"alertmanager-main-0\" (UID: \"4b4b6720-16b8-4ff8-ab94-5748bb36d61e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 08:09:26.832963 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:26.832917 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mn7hd\" (UniqueName: \"kubernetes.io/projected/4b4b6720-16b8-4ff8-ab94-5748bb36d61e-kube-api-access-mn7hd\") pod \"alertmanager-main-0\" (UID: \"4b4b6720-16b8-4ff8-ab94-5748bb36d61e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 08:09:26.833074 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:26.832960 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4b4b6720-16b8-4ff8-ab94-5748bb36d61e-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"4b4b6720-16b8-4ff8-ab94-5748bb36d61e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 08:09:26.833074 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:26.832986 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4b4b6720-16b8-4ff8-ab94-5748bb36d61e-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"4b4b6720-16b8-4ff8-ab94-5748bb36d61e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 08:09:26.833074 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:26.833011 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4b4b6720-16b8-4ff8-ab94-5748bb36d61e-tls-assets\") pod \"alertmanager-main-0\" (UID: \"4b4b6720-16b8-4ff8-ab94-5748bb36d61e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 08:09:26.934017 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:26.933935 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4b4b6720-16b8-4ff8-ab94-5748bb36d61e-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"4b4b6720-16b8-4ff8-ab94-5748bb36d61e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 08:09:26.934017 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:26.933977 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4b4b6720-16b8-4ff8-ab94-5748bb36d61e-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"4b4b6720-16b8-4ff8-ab94-5748bb36d61e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 08:09:26.934017 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:26.933996 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4b4b6720-16b8-4ff8-ab94-5748bb36d61e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"4b4b6720-16b8-4ff8-ab94-5748bb36d61e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 08:09:26.934273 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:26.934045 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4b4b6720-16b8-4ff8-ab94-5748bb36d61e-config-volume\") pod \"alertmanager-main-0\" (UID: \"4b4b6720-16b8-4ff8-ab94-5748bb36d61e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 08:09:26.934273 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:26.934076 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4b4b6720-16b8-4ff8-ab94-5748bb36d61e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"4b4b6720-16b8-4ff8-ab94-5748bb36d61e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 08:09:26.934273 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:26.934230 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4b4b6720-16b8-4ff8-ab94-5748bb36d61e-config-out\") pod \"alertmanager-main-0\" (UID: \"4b4b6720-16b8-4ff8-ab94-5748bb36d61e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 08:09:26.934414 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:26.934289 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mn7hd\" (UniqueName: \"kubernetes.io/projected/4b4b6720-16b8-4ff8-ab94-5748bb36d61e-kube-api-access-mn7hd\") pod \"alertmanager-main-0\" (UID: \"4b4b6720-16b8-4ff8-ab94-5748bb36d61e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 08:09:26.934414 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:26.934328 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4b4b6720-16b8-4ff8-ab94-5748bb36d61e-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"4b4b6720-16b8-4ff8-ab94-5748bb36d61e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 08:09:26.934414 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:26.934356 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4b4b6720-16b8-4ff8-ab94-5748bb36d61e-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"4b4b6720-16b8-4ff8-ab94-5748bb36d61e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 08:09:26.934702 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:26.934672 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4b4b6720-16b8-4ff8-ab94-5748bb36d61e-tls-assets\") pod \"alertmanager-main-0\" (UID: \"4b4b6720-16b8-4ff8-ab94-5748bb36d61e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 08:09:26.935026 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:26.934705 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4b4b6720-16b8-4ff8-ab94-5748bb36d61e-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"4b4b6720-16b8-4ff8-ab94-5748bb36d61e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 08:09:26.935026 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:26.934727 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4b4b6720-16b8-4ff8-ab94-5748bb36d61e-web-config\") pod \"alertmanager-main-0\" (UID: \"4b4b6720-16b8-4ff8-ab94-5748bb36d61e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 08:09:26.935026 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:26.934763 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4b4b6720-16b8-4ff8-ab94-5748bb36d61e-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"4b4b6720-16b8-4ff8-ab94-5748bb36d61e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 08:09:26.935026 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:26.934804 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4b4b6720-16b8-4ff8-ab94-5748bb36d61e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4b4b6720-16b8-4ff8-ab94-5748bb36d61e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 08:09:26.935026 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:26.934958 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4b4b6720-16b8-4ff8-ab94-5748bb36d61e-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"4b4b6720-16b8-4ff8-ab94-5748bb36d61e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 08:09:26.935026 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:26.934987 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4b4b6720-16b8-4ff8-ab94-5748bb36d61e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"4b4b6720-16b8-4ff8-ab94-5748bb36d61e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 08:09:26.937360 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:26.937316 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4b4b6720-16b8-4ff8-ab94-5748bb36d61e-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"4b4b6720-16b8-4ff8-ab94-5748bb36d61e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 08:09:26.937464 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:26.937334 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4b4b6720-16b8-4ff8-ab94-5748bb36d61e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"4b4b6720-16b8-4ff8-ab94-5748bb36d61e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 08:09:26.937464 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:26.937421 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4b4b6720-16b8-4ff8-ab94-5748bb36d61e-config-volume\") pod \"alertmanager-main-0\" (UID: \"4b4b6720-16b8-4ff8-ab94-5748bb36d61e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 08:09:26.937581 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:26.937556 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4b4b6720-16b8-4ff8-ab94-5748bb36d61e-config-out\") pod \"alertmanager-main-0\" (UID: \"4b4b6720-16b8-4ff8-ab94-5748bb36d61e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 08:09:26.937740 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:26.937723 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4b4b6720-16b8-4ff8-ab94-5748bb36d61e-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"4b4b6720-16b8-4ff8-ab94-5748bb36d61e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 08:09:26.937799 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:26.937734 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4b4b6720-16b8-4ff8-ab94-5748bb36d61e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4b4b6720-16b8-4ff8-ab94-5748bb36d61e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 08:09:26.937973 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:26.937953 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4b4b6720-16b8-4ff8-ab94-5748bb36d61e-web-config\") pod \"alertmanager-main-0\" (UID: \"4b4b6720-16b8-4ff8-ab94-5748bb36d61e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 08:09:26.938266 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:26.938246 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4b4b6720-16b8-4ff8-ab94-5748bb36d61e-tls-assets\") pod \"alertmanager-main-0\" (UID: \"4b4b6720-16b8-4ff8-ab94-5748bb36d61e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 08:09:26.939416 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:26.939396 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4b4b6720-16b8-4ff8-ab94-5748bb36d61e-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"4b4b6720-16b8-4ff8-ab94-5748bb36d61e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 08:09:26.941807 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:26.941791 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mn7hd\" (UniqueName: \"kubernetes.io/projected/4b4b6720-16b8-4ff8-ab94-5748bb36d61e-kube-api-access-mn7hd\") pod \"alertmanager-main-0\" (UID: \"4b4b6720-16b8-4ff8-ab94-5748bb36d61e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 08:09:27.030776 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:27.030749 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 18 08:09:27.308147 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:27.308112 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 18 08:09:27.311124 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:09:27.311095 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b4b6720_16b8_4ff8_ab94_5748bb36d61e.slice/crio-778c0b8bc7fadc19a797c24c31245ab0a49f8d51e70ce5494fb8647fbb49d369 WatchSource:0}: Error finding container 778c0b8bc7fadc19a797c24c31245ab0a49f8d51e70ce5494fb8647fbb49d369: Status 404 returned error can't find the container with id 778c0b8bc7fadc19a797c24c31245ab0a49f8d51e70ce5494fb8647fbb49d369 Sep 18 08:09:27.664294 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:27.664197 2585 generic.go:356] "Generic (PLEG): container finished" podID="4b4b6720-16b8-4ff8-ab94-5748bb36d61e" containerID="3b36f1f5ceba01c41c5dc8c5142e545f1cacbbde81d5f36ba71b02a2f277932b" exitCode=0 Sep 18 08:09:27.664294 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:27.664284 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4b4b6720-16b8-4ff8-ab94-5748bb36d61e","Type":"ContainerDied","Data":"3b36f1f5ceba01c41c5dc8c5142e545f1cacbbde81d5f36ba71b02a2f277932b"} Sep 18 08:09:27.664520 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:27.664376 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4b4b6720-16b8-4ff8-ab94-5748bb36d61e","Type":"ContainerStarted","Data":"778c0b8bc7fadc19a797c24c31245ab0a49f8d51e70ce5494fb8647fbb49d369"} Sep 18 08:09:27.944546 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:27.944514 2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8daf0e48-a502-4b73-a0aa-74f9c20116d9" path="/var/lib/kubelet/pods/8daf0e48-a502-4b73-a0aa-74f9c20116d9/volumes" Sep 18 08:09:28.675468 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:28.675433 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4b4b6720-16b8-4ff8-ab94-5748bb36d61e","Type":"ContainerStarted","Data":"3dbed864624e44719908466fc2872a57873a48c83309f92b893922e12a228d64"} Sep 18 08:09:28.675905 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:28.675507 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4b4b6720-16b8-4ff8-ab94-5748bb36d61e","Type":"ContainerStarted","Data":"907206aa5233bf404d54675ec4d6617ee4d664577ebc267ad13f1e18c3bd64e5"} Sep 18 08:09:28.675905 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:28.675536 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4b4b6720-16b8-4ff8-ab94-5748bb36d61e","Type":"ContainerStarted","Data":"dbb55c838fe52f66554cb95aef18edd5ad415b010a07c13d955fe30604277402"} Sep 18 08:09:28.675905 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:28.675565 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4b4b6720-16b8-4ff8-ab94-5748bb36d61e","Type":"ContainerStarted","Data":"aaffd52a2b87ab6d8b36ad224a71aa31ad0732ff399d738f1ee69b51d3e2103a"} Sep 18 08:09:28.675905 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:28.675596 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4b4b6720-16b8-4ff8-ab94-5748bb36d61e","Type":"ContainerStarted","Data":"110fc4d83426920cb270f86a57f2b829da93ce6dc834e10a32e1a4c7b9d4fce7"} Sep 18 08:09:28.675905 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:28.675627 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4b4b6720-16b8-4ff8-ab94-5748bb36d61e","Type":"ContainerStarted","Data":"ccb9ba5eba70d7e5b3fe8783687e0b8d954dee2dd3c841fbe5f0110487e70e83"} Sep 18 08:09:28.706520 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:28.706475 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.692517937 podStartE2EDuration="2.706460126s" totalImagesPullingTime="0s" totalInitContainerRuntime="13.942189ms" isStatefulPod=false podCreationTimestamp="2026-09-18 08:09:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 08:09:28.705213611 +0000 UTC m=+140.974913539" watchObservedRunningTime="2026-09-18 08:09:28.706460126 +0000 UTC m=+140.976160097" Sep 18 08:09:29.093190 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:29.093152 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-54756dd7c6-cttsm"] Sep 18 08:09:29.095739 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:29.095723 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-54756dd7c6-cttsm" Sep 18 08:09:29.098165 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:29.098118 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Sep 18 08:09:29.099235 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:29.098833 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Sep 18 08:09:29.099235 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:29.099084 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Sep 18 08:09:29.099452 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:29.099422 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-w5tlq\"" Sep 18 08:09:29.099562 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:29.099534 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Sep 18 08:09:29.099620 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:29.099560 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Sep 18 08:09:29.105321 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:29.105015 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Sep 18 08:09:29.122381 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:29.122359 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-54756dd7c6-cttsm"] Sep 18 08:09:29.153629 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:29.153604 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ca34238e-3c83-49a4-8a68-99d560074356-metrics-client-ca\") pod \"telemeter-client-54756dd7c6-cttsm\" (UID: \"ca34238e-3c83-49a4-8a68-99d560074356\") " pod="openshift-monitoring/telemeter-client-54756dd7c6-cttsm" Sep 18 08:09:29.153757 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:29.153648 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/ca34238e-3c83-49a4-8a68-99d560074356-federate-client-tls\") pod \"telemeter-client-54756dd7c6-cttsm\" (UID: \"ca34238e-3c83-49a4-8a68-99d560074356\") " pod="openshift-monitoring/telemeter-client-54756dd7c6-cttsm" Sep 18 08:09:29.153757 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:29.153714 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ca34238e-3c83-49a4-8a68-99d560074356-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-54756dd7c6-cttsm\" (UID: \"ca34238e-3c83-49a4-8a68-99d560074356\") " pod="openshift-monitoring/telemeter-client-54756dd7c6-cttsm" Sep 18 08:09:29.153757 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:29.153749 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/ca34238e-3c83-49a4-8a68-99d560074356-telemeter-client-tls\") pod \"telemeter-client-54756dd7c6-cttsm\" (UID: \"ca34238e-3c83-49a4-8a68-99d560074356\") " pod="openshift-monitoring/telemeter-client-54756dd7c6-cttsm" Sep 18 08:09:29.153880 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:29.153766 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca34238e-3c83-49a4-8a68-99d560074356-telemeter-trusted-ca-bundle\") pod \"telemeter-client-54756dd7c6-cttsm\" (UID: \"ca34238e-3c83-49a4-8a68-99d560074356\") " pod="openshift-monitoring/telemeter-client-54756dd7c6-cttsm" Sep 18 08:09:29.153880 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:29.153792 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-47wt2\" (UniqueName: \"kubernetes.io/projected/ca34238e-3c83-49a4-8a68-99d560074356-kube-api-access-47wt2\") pod \"telemeter-client-54756dd7c6-cttsm\" (UID: \"ca34238e-3c83-49a4-8a68-99d560074356\") " pod="openshift-monitoring/telemeter-client-54756dd7c6-cttsm" Sep 18 08:09:29.153880 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:29.153822 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca34238e-3c83-49a4-8a68-99d560074356-serving-certs-ca-bundle\") pod \"telemeter-client-54756dd7c6-cttsm\" (UID: \"ca34238e-3c83-49a4-8a68-99d560074356\") " pod="openshift-monitoring/telemeter-client-54756dd7c6-cttsm" Sep 18 08:09:29.153975 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:29.153880 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/ca34238e-3c83-49a4-8a68-99d560074356-secret-telemeter-client\") pod \"telemeter-client-54756dd7c6-cttsm\" (UID: \"ca34238e-3c83-49a4-8a68-99d560074356\") " pod="openshift-monitoring/telemeter-client-54756dd7c6-cttsm" Sep 18 08:09:29.254730 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:29.254691 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/ca34238e-3c83-49a4-8a68-99d560074356-telemeter-client-tls\") pod \"telemeter-client-54756dd7c6-cttsm\" (UID: \"ca34238e-3c83-49a4-8a68-99d560074356\") " pod="openshift-monitoring/telemeter-client-54756dd7c6-cttsm" Sep 18 08:09:29.254730 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:29.254733 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca34238e-3c83-49a4-8a68-99d560074356-telemeter-trusted-ca-bundle\") pod \"telemeter-client-54756dd7c6-cttsm\" (UID: \"ca34238e-3c83-49a4-8a68-99d560074356\") " pod="openshift-monitoring/telemeter-client-54756dd7c6-cttsm" Sep 18 08:09:29.254995 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:29.254758 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-47wt2\" (UniqueName: \"kubernetes.io/projected/ca34238e-3c83-49a4-8a68-99d560074356-kube-api-access-47wt2\") pod \"telemeter-client-54756dd7c6-cttsm\" (UID: \"ca34238e-3c83-49a4-8a68-99d560074356\") " pod="openshift-monitoring/telemeter-client-54756dd7c6-cttsm" Sep 18 08:09:29.254995 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:29.254780 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca34238e-3c83-49a4-8a68-99d560074356-serving-certs-ca-bundle\") pod \"telemeter-client-54756dd7c6-cttsm\" (UID: \"ca34238e-3c83-49a4-8a68-99d560074356\") " pod="openshift-monitoring/telemeter-client-54756dd7c6-cttsm" Sep 18 08:09:29.254995 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:29.254795 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/ca34238e-3c83-49a4-8a68-99d560074356-secret-telemeter-client\") pod \"telemeter-client-54756dd7c6-cttsm\" (UID: \"ca34238e-3c83-49a4-8a68-99d560074356\") " pod="openshift-monitoring/telemeter-client-54756dd7c6-cttsm" Sep 18 08:09:29.254995 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:29.254818 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ca34238e-3c83-49a4-8a68-99d560074356-metrics-client-ca\") pod \"telemeter-client-54756dd7c6-cttsm\" (UID: \"ca34238e-3c83-49a4-8a68-99d560074356\") " pod="openshift-monitoring/telemeter-client-54756dd7c6-cttsm" Sep 18 08:09:29.254995 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:29.254907 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/ca34238e-3c83-49a4-8a68-99d560074356-federate-client-tls\") pod \"telemeter-client-54756dd7c6-cttsm\" (UID: \"ca34238e-3c83-49a4-8a68-99d560074356\") " pod="openshift-monitoring/telemeter-client-54756dd7c6-cttsm" Sep 18 08:09:29.255231 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:29.254994 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ca34238e-3c83-49a4-8a68-99d560074356-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-54756dd7c6-cttsm\" (UID: \"ca34238e-3c83-49a4-8a68-99d560074356\") " pod="openshift-monitoring/telemeter-client-54756dd7c6-cttsm" Sep 18 08:09:29.255925 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:29.255895 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca34238e-3c83-49a4-8a68-99d560074356-serving-certs-ca-bundle\") pod \"telemeter-client-54756dd7c6-cttsm\" (UID: \"ca34238e-3c83-49a4-8a68-99d560074356\") " pod="openshift-monitoring/telemeter-client-54756dd7c6-cttsm" Sep 18 08:09:29.256055 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:29.256030 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca34238e-3c83-49a4-8a68-99d560074356-telemeter-trusted-ca-bundle\") pod \"telemeter-client-54756dd7c6-cttsm\" (UID: \"ca34238e-3c83-49a4-8a68-99d560074356\") " pod="openshift-monitoring/telemeter-client-54756dd7c6-cttsm" Sep 18 08:09:29.256456 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:29.256427 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ca34238e-3c83-49a4-8a68-99d560074356-metrics-client-ca\") pod \"telemeter-client-54756dd7c6-cttsm\" (UID: \"ca34238e-3c83-49a4-8a68-99d560074356\") " pod="openshift-monitoring/telemeter-client-54756dd7c6-cttsm" Sep 18 08:09:29.257578 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:29.257554 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/ca34238e-3c83-49a4-8a68-99d560074356-telemeter-client-tls\") pod \"telemeter-client-54756dd7c6-cttsm\" (UID: \"ca34238e-3c83-49a4-8a68-99d560074356\") " pod="openshift-monitoring/telemeter-client-54756dd7c6-cttsm" Sep 18 08:09:29.257747 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:29.257689 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/ca34238e-3c83-49a4-8a68-99d560074356-secret-telemeter-client\") pod \"telemeter-client-54756dd7c6-cttsm\" (UID: \"ca34238e-3c83-49a4-8a68-99d560074356\") " pod="openshift-monitoring/telemeter-client-54756dd7c6-cttsm" Sep 18 08:09:29.257985 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:29.257966 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/ca34238e-3c83-49a4-8a68-99d560074356-federate-client-tls\") pod \"telemeter-client-54756dd7c6-cttsm\" (UID: \"ca34238e-3c83-49a4-8a68-99d560074356\") " pod="openshift-monitoring/telemeter-client-54756dd7c6-cttsm" Sep 18 08:09:29.258063 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:29.258030 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ca34238e-3c83-49a4-8a68-99d560074356-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-54756dd7c6-cttsm\" (UID: \"ca34238e-3c83-49a4-8a68-99d560074356\") " pod="openshift-monitoring/telemeter-client-54756dd7c6-cttsm" Sep 18 08:09:29.263282 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:29.263264 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-47wt2\" (UniqueName: \"kubernetes.io/projected/ca34238e-3c83-49a4-8a68-99d560074356-kube-api-access-47wt2\") pod \"telemeter-client-54756dd7c6-cttsm\" (UID: \"ca34238e-3c83-49a4-8a68-99d560074356\") " pod="openshift-monitoring/telemeter-client-54756dd7c6-cttsm" Sep 18 08:09:29.378817 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:29.378732 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 18 08:09:29.379448 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:29.379391 2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="53f6513d-2d21-463e-b9d7-93809bf37f40" containerName="prometheus" containerID="cri-o://8f7b7b71e6f90350cac743eabae8d27d0c63fe963d8deb700cbe2015bc780fa6" gracePeriod=600 Sep 18 08:09:29.379948 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:29.379918 2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="53f6513d-2d21-463e-b9d7-93809bf37f40" containerName="kube-rbac-proxy-thanos" containerID="cri-o://47240108698a9acf5d98d4d1e43789681af64e019f1161dbb2c90a457792d27f" gracePeriod=600 Sep 18 08:09:29.380349 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:29.380078 2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="53f6513d-2d21-463e-b9d7-93809bf37f40" containerName="kube-rbac-proxy" containerID="cri-o://97e021996ce27a924bf6ca5f494d1d0a157bfc8293f561318e5dbda15f820bd8" gracePeriod=600 Sep 18 08:09:29.380349 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:29.380178 2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="53f6513d-2d21-463e-b9d7-93809bf37f40" containerName="kube-rbac-proxy-web" containerID="cri-o://ed2b881db9df870bf2057104fac5cc2114f2624ecee69b7af7279787075dafe4" gracePeriod=600 Sep 18 08:09:29.380349 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:29.380290 2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="53f6513d-2d21-463e-b9d7-93809bf37f40" containerName="thanos-sidecar" containerID="cri-o://38969f735a8167c7db58aca0809db04d05add95b7c9b5f27b8fc83722a29eb56" gracePeriod=600 Sep 18 08:09:29.380497 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:29.380324 2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="53f6513d-2d21-463e-b9d7-93809bf37f40" containerName="config-reloader" containerID="cri-o://fcc929806d0830eaaf53032185fcf96e75f7b2bc0b4a7abb3847f123e80272ad" gracePeriod=600 Sep 18 08:09:29.408008 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:29.407984 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-54756dd7c6-cttsm" Sep 18 08:09:29.684768 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:29.684684 2585 generic.go:356] "Generic (PLEG): container finished" podID="53f6513d-2d21-463e-b9d7-93809bf37f40" containerID="47240108698a9acf5d98d4d1e43789681af64e019f1161dbb2c90a457792d27f" exitCode=0 Sep 18 08:09:29.684768 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:29.684714 2585 generic.go:356] "Generic (PLEG): container finished" podID="53f6513d-2d21-463e-b9d7-93809bf37f40" containerID="97e021996ce27a924bf6ca5f494d1d0a157bfc8293f561318e5dbda15f820bd8" exitCode=0 Sep 18 08:09:29.684768 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:29.684721 2585 generic.go:356] "Generic (PLEG): container finished" podID="53f6513d-2d21-463e-b9d7-93809bf37f40" containerID="38969f735a8167c7db58aca0809db04d05add95b7c9b5f27b8fc83722a29eb56" exitCode=0 Sep 18 08:09:29.684768 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:29.684726 2585 generic.go:356] "Generic (PLEG): container finished" podID="53f6513d-2d21-463e-b9d7-93809bf37f40" containerID="fcc929806d0830eaaf53032185fcf96e75f7b2bc0b4a7abb3847f123e80272ad" exitCode=0 Sep 18 08:09:29.684768 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:29.684731 2585 generic.go:356] "Generic (PLEG): container finished" podID="53f6513d-2d21-463e-b9d7-93809bf37f40" containerID="8f7b7b71e6f90350cac743eabae8d27d0c63fe963d8deb700cbe2015bc780fa6" exitCode=0 Sep 18 08:09:29.684768 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:29.684754 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"53f6513d-2d21-463e-b9d7-93809bf37f40","Type":"ContainerDied","Data":"47240108698a9acf5d98d4d1e43789681af64e019f1161dbb2c90a457792d27f"} Sep 18 08:09:29.685282 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:29.684828 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"53f6513d-2d21-463e-b9d7-93809bf37f40","Type":"ContainerDied","Data":"97e021996ce27a924bf6ca5f494d1d0a157bfc8293f561318e5dbda15f820bd8"} Sep 18 08:09:29.685282 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:29.684884 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"53f6513d-2d21-463e-b9d7-93809bf37f40","Type":"ContainerDied","Data":"38969f735a8167c7db58aca0809db04d05add95b7c9b5f27b8fc83722a29eb56"} Sep 18 08:09:29.685282 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:29.684911 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"53f6513d-2d21-463e-b9d7-93809bf37f40","Type":"ContainerDied","Data":"fcc929806d0830eaaf53032185fcf96e75f7b2bc0b4a7abb3847f123e80272ad"} Sep 18 08:09:29.685282 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:29.684934 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"53f6513d-2d21-463e-b9d7-93809bf37f40","Type":"ContainerDied","Data":"8f7b7b71e6f90350cac743eabae8d27d0c63fe963d8deb700cbe2015bc780fa6"} Sep 18 08:09:29.698620 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:29.698540 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-54756dd7c6-cttsm"] Sep 18 08:09:29.700675 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:09:29.700653 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca34238e_3c83_49a4_8a68_99d560074356.slice/crio-d1472438c09d4c0c8e70fb2500e1a2659fe82f62a64a6383783645cec327373d WatchSource:0}: Error finding container d1472438c09d4c0c8e70fb2500e1a2659fe82f62a64a6383783645cec327373d: Status 404 returned error can't find the container with id d1472438c09d4c0c8e70fb2500e1a2659fe82f62a64a6383783645cec327373d Sep 18 08:09:30.690236 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:30.690202 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-54756dd7c6-cttsm" event={"ID":"ca34238e-3c83-49a4-8a68-99d560074356","Type":"ContainerStarted","Data":"d1472438c09d4c0c8e70fb2500e1a2659fe82f62a64a6383783645cec327373d"} Sep 18 08:09:30.693952 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:30.693923 2585 generic.go:356] "Generic (PLEG): container finished" podID="53f6513d-2d21-463e-b9d7-93809bf37f40" containerID="ed2b881db9df870bf2057104fac5cc2114f2624ecee69b7af7279787075dafe4" exitCode=0 Sep 18 08:09:30.694087 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:30.693963 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"53f6513d-2d21-463e-b9d7-93809bf37f40","Type":"ContainerDied","Data":"ed2b881db9df870bf2057104fac5cc2114f2624ecee69b7af7279787075dafe4"} Sep 18 08:09:30.728927 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:30.728893 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 08:09:30.869837 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:30.869763 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/53f6513d-2d21-463e-b9d7-93809bf37f40-prometheus-trusted-ca-bundle\") pod \"53f6513d-2d21-463e-b9d7-93809bf37f40\" (UID: \"53f6513d-2d21-463e-b9d7-93809bf37f40\") " Sep 18 08:09:30.869837 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:30.869801 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/53f6513d-2d21-463e-b9d7-93809bf37f40-configmap-serving-certs-ca-bundle\") pod \"53f6513d-2d21-463e-b9d7-93809bf37f40\" (UID: \"53f6513d-2d21-463e-b9d7-93809bf37f40\") " Sep 18 08:09:30.870075 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:30.869834 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/53f6513d-2d21-463e-b9d7-93809bf37f40-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"53f6513d-2d21-463e-b9d7-93809bf37f40\" (UID: \"53f6513d-2d21-463e-b9d7-93809bf37f40\") " Sep 18 08:09:30.870075 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:30.869894 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/53f6513d-2d21-463e-b9d7-93809bf37f40-prometheus-k8s-db\") pod \"53f6513d-2d21-463e-b9d7-93809bf37f40\" (UID: \"53f6513d-2d21-463e-b9d7-93809bf37f40\") " Sep 18 08:09:30.870075 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:30.869924 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/53f6513d-2d21-463e-b9d7-93809bf37f40-configmap-metrics-client-ca\") pod \"53f6513d-2d21-463e-b9d7-93809bf37f40\" (UID: \"53f6513d-2d21-463e-b9d7-93809bf37f40\") " Sep 18 08:09:30.870075 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:30.869964 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/53f6513d-2d21-463e-b9d7-93809bf37f40-prometheus-k8s-rulefiles-1\") pod \"53f6513d-2d21-463e-b9d7-93809bf37f40\" (UID: \"53f6513d-2d21-463e-b9d7-93809bf37f40\") " Sep 18 08:09:30.870075 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:30.869988 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/53f6513d-2d21-463e-b9d7-93809bf37f40-secret-prometheus-k8s-tls\") pod \"53f6513d-2d21-463e-b9d7-93809bf37f40\" (UID: \"53f6513d-2d21-463e-b9d7-93809bf37f40\") " Sep 18 08:09:30.870075 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:30.870007 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/53f6513d-2d21-463e-b9d7-93809bf37f40-prometheus-k8s-rulefiles-0\") pod \"53f6513d-2d21-463e-b9d7-93809bf37f40\" (UID: \"53f6513d-2d21-463e-b9d7-93809bf37f40\") " Sep 18 08:09:30.870075 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:30.870043 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/53f6513d-2d21-463e-b9d7-93809bf37f40-secret-kube-rbac-proxy\") pod \"53f6513d-2d21-463e-b9d7-93809bf37f40\" (UID: \"53f6513d-2d21-463e-b9d7-93809bf37f40\") " Sep 18 08:09:30.870075 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:30.870066 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/53f6513d-2d21-463e-b9d7-93809bf37f40-secret-metrics-client-certs\") pod \"53f6513d-2d21-463e-b9d7-93809bf37f40\" (UID: \"53f6513d-2d21-463e-b9d7-93809bf37f40\") " Sep 18 08:09:30.870526 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:30.870135 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/53f6513d-2d21-463e-b9d7-93809bf37f40-prometheus-k8s-rulefiles-2\") pod \"53f6513d-2d21-463e-b9d7-93809bf37f40\" (UID: \"53f6513d-2d21-463e-b9d7-93809bf37f40\") " Sep 18 08:09:30.870526 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:30.870159 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/53f6513d-2d21-463e-b9d7-93809bf37f40-config\") pod \"53f6513d-2d21-463e-b9d7-93809bf37f40\" (UID: \"53f6513d-2d21-463e-b9d7-93809bf37f40\") " Sep 18 08:09:30.870526 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:30.870188 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/53f6513d-2d21-463e-b9d7-93809bf37f40-secret-grpc-tls\") pod \"53f6513d-2d21-463e-b9d7-93809bf37f40\" (UID: \"53f6513d-2d21-463e-b9d7-93809bf37f40\") " Sep 18 08:09:30.870526 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:30.870210 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/53f6513d-2d21-463e-b9d7-93809bf37f40-tls-assets\") pod \"53f6513d-2d21-463e-b9d7-93809bf37f40\" (UID: \"53f6513d-2d21-463e-b9d7-93809bf37f40\") " Sep 18 08:09:30.870526 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:30.870249 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/53f6513d-2d21-463e-b9d7-93809bf37f40-configmap-kubelet-serving-ca-bundle\") pod \"53f6513d-2d21-463e-b9d7-93809bf37f40\" (UID: \"53f6513d-2d21-463e-b9d7-93809bf37f40\") " Sep 18 08:09:30.870526 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:30.870273 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/53f6513d-2d21-463e-b9d7-93809bf37f40-web-config\") pod \"53f6513d-2d21-463e-b9d7-93809bf37f40\" (UID: \"53f6513d-2d21-463e-b9d7-93809bf37f40\") " Sep 18 08:09:30.870526 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:30.870309 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/53f6513d-2d21-463e-b9d7-93809bf37f40-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"53f6513d-2d21-463e-b9d7-93809bf37f40\" (UID: \"53f6513d-2d21-463e-b9d7-93809bf37f40\") " Sep 18 08:09:30.870526 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:30.870311 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/53f6513d-2d21-463e-b9d7-93809bf37f40-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "53f6513d-2d21-463e-b9d7-93809bf37f40" (UID: "53f6513d-2d21-463e-b9d7-93809bf37f40"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 08:09:30.870526 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:30.870344 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8wxtb\" (UniqueName: \"kubernetes.io/projected/53f6513d-2d21-463e-b9d7-93809bf37f40-kube-api-access-8wxtb\") pod \"53f6513d-2d21-463e-b9d7-93809bf37f40\" (UID: \"53f6513d-2d21-463e-b9d7-93809bf37f40\") " Sep 18 08:09:30.870526 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:30.870343 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/53f6513d-2d21-463e-b9d7-93809bf37f40-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "53f6513d-2d21-463e-b9d7-93809bf37f40" (UID: "53f6513d-2d21-463e-b9d7-93809bf37f40"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 08:09:30.871013 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:30.870628 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/53f6513d-2d21-463e-b9d7-93809bf37f40-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "53f6513d-2d21-463e-b9d7-93809bf37f40" (UID: "53f6513d-2d21-463e-b9d7-93809bf37f40"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 08:09:30.871077 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:30.871005 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/53f6513d-2d21-463e-b9d7-93809bf37f40-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "53f6513d-2d21-463e-b9d7-93809bf37f40" (UID: "53f6513d-2d21-463e-b9d7-93809bf37f40"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 08:09:30.871077 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:30.871041 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/53f6513d-2d21-463e-b9d7-93809bf37f40-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "53f6513d-2d21-463e-b9d7-93809bf37f40" (UID: "53f6513d-2d21-463e-b9d7-93809bf37f40"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 08:09:30.871302 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:30.871277 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/53f6513d-2d21-463e-b9d7-93809bf37f40-config-out\") pod \"53f6513d-2d21-463e-b9d7-93809bf37f40\" (UID: \"53f6513d-2d21-463e-b9d7-93809bf37f40\") " Sep 18 08:09:30.871368 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:30.871323 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/53f6513d-2d21-463e-b9d7-93809bf37f40-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "53f6513d-2d21-463e-b9d7-93809bf37f40" (UID: "53f6513d-2d21-463e-b9d7-93809bf37f40"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 08:09:30.871422 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:30.871402 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/53f6513d-2d21-463e-b9d7-93809bf37f40-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "53f6513d-2d21-463e-b9d7-93809bf37f40" (UID: "53f6513d-2d21-463e-b9d7-93809bf37f40"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 18 08:09:30.871509 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:30.871397 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/53f6513d-2d21-463e-b9d7-93809bf37f40-thanos-prometheus-http-client-file\") pod \"53f6513d-2d21-463e-b9d7-93809bf37f40\" (UID: \"53f6513d-2d21-463e-b9d7-93809bf37f40\") " Sep 18 08:09:30.871834 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:30.871811 2585 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/53f6513d-2d21-463e-b9d7-93809bf37f40-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-138-42.ec2.internal\" DevicePath \"\"" Sep 18 08:09:30.871943 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:30.871867 2585 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/53f6513d-2d21-463e-b9d7-93809bf37f40-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-138-42.ec2.internal\" DevicePath \"\"" Sep 18 08:09:30.871943 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:30.871888 2585 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/53f6513d-2d21-463e-b9d7-93809bf37f40-prometheus-trusted-ca-bundle\") on node \"ip-10-0-138-42.ec2.internal\" DevicePath \"\"" Sep 18 08:09:30.871943 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:30.871902 2585 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/53f6513d-2d21-463e-b9d7-93809bf37f40-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-138-42.ec2.internal\" DevicePath \"\"" Sep 18 08:09:30.871943 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:30.871917 2585 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/53f6513d-2d21-463e-b9d7-93809bf37f40-prometheus-k8s-db\") on node \"ip-10-0-138-42.ec2.internal\" DevicePath \"\"" Sep 18 08:09:30.871943 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:30.871930 2585 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/53f6513d-2d21-463e-b9d7-93809bf37f40-configmap-metrics-client-ca\") on node \"ip-10-0-138-42.ec2.internal\" DevicePath \"\"" Sep 18 08:09:30.872173 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:30.871944 2585 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/53f6513d-2d21-463e-b9d7-93809bf37f40-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-138-42.ec2.internal\" DevicePath \"\"" Sep 18 08:09:30.873123 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:30.873020 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/53f6513d-2d21-463e-b9d7-93809bf37f40-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "53f6513d-2d21-463e-b9d7-93809bf37f40" (UID: "53f6513d-2d21-463e-b9d7-93809bf37f40"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 08:09:30.873695 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:30.873661 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/53f6513d-2d21-463e-b9d7-93809bf37f40-config" (OuterVolumeSpecName: "config") pod "53f6513d-2d21-463e-b9d7-93809bf37f40" (UID: "53f6513d-2d21-463e-b9d7-93809bf37f40"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 08:09:30.873925 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:30.873884 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/53f6513d-2d21-463e-b9d7-93809bf37f40-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "53f6513d-2d21-463e-b9d7-93809bf37f40" (UID: "53f6513d-2d21-463e-b9d7-93809bf37f40"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 08:09:30.874271 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:30.874233 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/53f6513d-2d21-463e-b9d7-93809bf37f40-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "53f6513d-2d21-463e-b9d7-93809bf37f40" (UID: "53f6513d-2d21-463e-b9d7-93809bf37f40"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 08:09:30.874693 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:30.874486 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/53f6513d-2d21-463e-b9d7-93809bf37f40-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "53f6513d-2d21-463e-b9d7-93809bf37f40" (UID: "53f6513d-2d21-463e-b9d7-93809bf37f40"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 08:09:30.874787 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:30.874750 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/53f6513d-2d21-463e-b9d7-93809bf37f40-kube-api-access-8wxtb" (OuterVolumeSpecName: "kube-api-access-8wxtb") pod "53f6513d-2d21-463e-b9d7-93809bf37f40" (UID: "53f6513d-2d21-463e-b9d7-93809bf37f40"). InnerVolumeSpecName "kube-api-access-8wxtb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 08:09:30.874920 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:30.874878 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/53f6513d-2d21-463e-b9d7-93809bf37f40-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "53f6513d-2d21-463e-b9d7-93809bf37f40" (UID: "53f6513d-2d21-463e-b9d7-93809bf37f40"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 08:09:30.875250 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:30.875224 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/53f6513d-2d21-463e-b9d7-93809bf37f40-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "53f6513d-2d21-463e-b9d7-93809bf37f40" (UID: "53f6513d-2d21-463e-b9d7-93809bf37f40"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 08:09:30.875346 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:30.875327 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/53f6513d-2d21-463e-b9d7-93809bf37f40-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "53f6513d-2d21-463e-b9d7-93809bf37f40" (UID: "53f6513d-2d21-463e-b9d7-93809bf37f40"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 08:09:30.876223 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:30.876202 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/53f6513d-2d21-463e-b9d7-93809bf37f40-config-out" (OuterVolumeSpecName: "config-out") pod "53f6513d-2d21-463e-b9d7-93809bf37f40" (UID: "53f6513d-2d21-463e-b9d7-93809bf37f40"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 18 08:09:30.876376 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:30.876355 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/53f6513d-2d21-463e-b9d7-93809bf37f40-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "53f6513d-2d21-463e-b9d7-93809bf37f40" (UID: "53f6513d-2d21-463e-b9d7-93809bf37f40"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 08:09:30.876474 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:30.876457 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/53f6513d-2d21-463e-b9d7-93809bf37f40-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "53f6513d-2d21-463e-b9d7-93809bf37f40" (UID: "53f6513d-2d21-463e-b9d7-93809bf37f40"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 08:09:30.886092 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:30.886068 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/53f6513d-2d21-463e-b9d7-93809bf37f40-web-config" (OuterVolumeSpecName: "web-config") pod "53f6513d-2d21-463e-b9d7-93809bf37f40" (UID: "53f6513d-2d21-463e-b9d7-93809bf37f40"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 08:09:30.973003 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:30.972966 2585 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/53f6513d-2d21-463e-b9d7-93809bf37f40-config\") on node \"ip-10-0-138-42.ec2.internal\" DevicePath \"\"" Sep 18 08:09:30.973003 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:30.972996 2585 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/53f6513d-2d21-463e-b9d7-93809bf37f40-secret-grpc-tls\") on node \"ip-10-0-138-42.ec2.internal\" DevicePath \"\"" Sep 18 08:09:30.973003 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:30.973007 2585 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/53f6513d-2d21-463e-b9d7-93809bf37f40-tls-assets\") on node \"ip-10-0-138-42.ec2.internal\" DevicePath \"\"" Sep 18 08:09:30.973003 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:30.973015 2585 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/53f6513d-2d21-463e-b9d7-93809bf37f40-web-config\") on node \"ip-10-0-138-42.ec2.internal\" DevicePath \"\"" Sep 18 08:09:30.973243 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:30.973025 2585 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/53f6513d-2d21-463e-b9d7-93809bf37f40-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-138-42.ec2.internal\" DevicePath \"\"" Sep 18 08:09:30.973243 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:30.973034 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8wxtb\" (UniqueName: \"kubernetes.io/projected/53f6513d-2d21-463e-b9d7-93809bf37f40-kube-api-access-8wxtb\") on node \"ip-10-0-138-42.ec2.internal\" DevicePath \"\"" Sep 18 08:09:30.973243 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:30.973042 2585 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/53f6513d-2d21-463e-b9d7-93809bf37f40-config-out\") on node \"ip-10-0-138-42.ec2.internal\" DevicePath \"\"" Sep 18 08:09:30.973243 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:30.973050 2585 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/53f6513d-2d21-463e-b9d7-93809bf37f40-thanos-prometheus-http-client-file\") on node \"ip-10-0-138-42.ec2.internal\" DevicePath \"\"" Sep 18 08:09:30.973243 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:30.973060 2585 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/53f6513d-2d21-463e-b9d7-93809bf37f40-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-138-42.ec2.internal\" DevicePath \"\"" Sep 18 08:09:30.973243 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:30.973068 2585 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/53f6513d-2d21-463e-b9d7-93809bf37f40-secret-prometheus-k8s-tls\") on node \"ip-10-0-138-42.ec2.internal\" DevicePath \"\"" Sep 18 08:09:30.973243 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:30.973077 2585 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/53f6513d-2d21-463e-b9d7-93809bf37f40-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-138-42.ec2.internal\" DevicePath \"\"" Sep 18 08:09:30.973243 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:30.973085 2585 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/53f6513d-2d21-463e-b9d7-93809bf37f40-secret-kube-rbac-proxy\") on node \"ip-10-0-138-42.ec2.internal\" DevicePath \"\"" Sep 18 08:09:30.973243 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:30.973096 2585 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/53f6513d-2d21-463e-b9d7-93809bf37f40-secret-metrics-client-certs\") on node \"ip-10-0-138-42.ec2.internal\" DevicePath \"\"" Sep 18 08:09:31.701934 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:31.701891 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"53f6513d-2d21-463e-b9d7-93809bf37f40","Type":"ContainerDied","Data":"1613b7049512d3bbe16b13f69b00f9650ee1685ada603ca6ecab1b4a08d4dca7"} Sep 18 08:09:31.702370 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:31.701911 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 08:09:31.702370 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:31.702029 2585 scope.go:117] "RemoveContainer" containerID="47240108698a9acf5d98d4d1e43789681af64e019f1161dbb2c90a457792d27f" Sep 18 08:09:31.710430 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:31.710406 2585 scope.go:117] "RemoveContainer" containerID="97e021996ce27a924bf6ca5f494d1d0a157bfc8293f561318e5dbda15f820bd8" Sep 18 08:09:31.717673 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:31.717653 2585 scope.go:117] "RemoveContainer" containerID="ed2b881db9df870bf2057104fac5cc2114f2624ecee69b7af7279787075dafe4" Sep 18 08:09:31.724681 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:31.724663 2585 scope.go:117] "RemoveContainer" containerID="38969f735a8167c7db58aca0809db04d05add95b7c9b5f27b8fc83722a29eb56" Sep 18 08:09:31.728560 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:31.728536 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 18 08:09:31.732803 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:31.732691 2585 scope.go:117] "RemoveContainer" containerID="fcc929806d0830eaaf53032185fcf96e75f7b2bc0b4a7abb3847f123e80272ad" Sep 18 08:09:31.734717 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:31.734697 2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 18 08:09:31.740078 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:31.740055 2585 scope.go:117] "RemoveContainer" containerID="8f7b7b71e6f90350cac743eabae8d27d0c63fe963d8deb700cbe2015bc780fa6" Sep 18 08:09:31.747585 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:31.747568 2585 scope.go:117] "RemoveContainer" containerID="f2d4545ece7e2d37dcd1e2b0035589fe6cf0466354bcab5822729cee813728ae" Sep 18 08:09:31.765813 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:31.765781 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 18 08:09:31.766126 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:31.766112 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="53f6513d-2d21-463e-b9d7-93809bf37f40" containerName="init-config-reloader" Sep 18 08:09:31.766191 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:31.766128 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="53f6513d-2d21-463e-b9d7-93809bf37f40" containerName="init-config-reloader" Sep 18 08:09:31.766191 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:31.766142 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="53f6513d-2d21-463e-b9d7-93809bf37f40" containerName="thanos-sidecar" Sep 18 08:09:31.766191 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:31.766147 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="53f6513d-2d21-463e-b9d7-93809bf37f40" containerName="thanos-sidecar" Sep 18 08:09:31.766191 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:31.766156 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="53f6513d-2d21-463e-b9d7-93809bf37f40" containerName="config-reloader" Sep 18 08:09:31.766191 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:31.766161 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="53f6513d-2d21-463e-b9d7-93809bf37f40" containerName="config-reloader" Sep 18 08:09:31.766191 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:31.766170 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="53f6513d-2d21-463e-b9d7-93809bf37f40" containerName="prometheus" Sep 18 08:09:31.766191 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:31.766175 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="53f6513d-2d21-463e-b9d7-93809bf37f40" containerName="prometheus" Sep 18 08:09:31.766191 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:31.766184 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="53f6513d-2d21-463e-b9d7-93809bf37f40" containerName="kube-rbac-proxy" Sep 18 08:09:31.766191 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:31.766190 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="53f6513d-2d21-463e-b9d7-93809bf37f40" containerName="kube-rbac-proxy" Sep 18 08:09:31.766471 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:31.766197 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="53f6513d-2d21-463e-b9d7-93809bf37f40" containerName="kube-rbac-proxy-web" Sep 18 08:09:31.766471 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:31.766203 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="53f6513d-2d21-463e-b9d7-93809bf37f40" containerName="kube-rbac-proxy-web" Sep 18 08:09:31.766471 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:31.766209 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="53f6513d-2d21-463e-b9d7-93809bf37f40" containerName="kube-rbac-proxy-thanos" Sep 18 08:09:31.766471 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:31.766215 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="53f6513d-2d21-463e-b9d7-93809bf37f40" containerName="kube-rbac-proxy-thanos" Sep 18 08:09:31.766471 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:31.766256 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="53f6513d-2d21-463e-b9d7-93809bf37f40" containerName="config-reloader" Sep 18 08:09:31.766471 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:31.766265 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="53f6513d-2d21-463e-b9d7-93809bf37f40" containerName="kube-rbac-proxy-web" Sep 18 08:09:31.766471 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:31.766272 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="53f6513d-2d21-463e-b9d7-93809bf37f40" containerName="kube-rbac-proxy-thanos" Sep 18 08:09:31.766471 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:31.766278 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="53f6513d-2d21-463e-b9d7-93809bf37f40" containerName="kube-rbac-proxy" Sep 18 08:09:31.766471 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:31.766284 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="53f6513d-2d21-463e-b9d7-93809bf37f40" containerName="thanos-sidecar" Sep 18 08:09:31.766471 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:31.766289 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="53f6513d-2d21-463e-b9d7-93809bf37f40" containerName="prometheus" Sep 18 08:09:31.770701 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:31.770682 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 08:09:31.773950 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:31.773924 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Sep 18 08:09:31.774121 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:31.774018 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Sep 18 08:09:31.774296 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:31.774280 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Sep 18 08:09:31.774463 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:31.774440 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Sep 18 08:09:31.774614 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:31.774599 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Sep 18 08:09:31.774879 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:31.774750 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-sdjvn\"" Sep 18 08:09:31.774879 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:31.774836 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Sep 18 08:09:31.774879 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:31.774861 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Sep 18 08:09:31.775068 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:31.774882 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Sep 18 08:09:31.775553 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:31.775535 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Sep 18 08:09:31.775553 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:31.775547 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Sep 18 08:09:31.775687 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:31.775551 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Sep 18 08:09:31.775778 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:31.775762 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-ehsedmocdr7be\"" Sep 18 08:09:31.776035 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:31.776003 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Sep 18 08:09:31.779024 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:31.779005 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Sep 18 08:09:31.782467 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:31.782449 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Sep 18 08:09:31.799306 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:31.799271 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 18 08:09:31.880724 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:31.880684 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8447a4cf-f877-4d7e-b43c-210da0616a87-config\") pod \"prometheus-k8s-0\" (UID: \"8447a4cf-f877-4d7e-b43c-210da0616a87\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 08:09:31.880724 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:31.880722 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8447a4cf-f877-4d7e-b43c-210da0616a87-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8447a4cf-f877-4d7e-b43c-210da0616a87\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 08:09:31.881060 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:31.880739 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8447a4cf-f877-4d7e-b43c-210da0616a87-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"8447a4cf-f877-4d7e-b43c-210da0616a87\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 08:09:31.881060 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:31.880802 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8447a4cf-f877-4d7e-b43c-210da0616a87-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8447a4cf-f877-4d7e-b43c-210da0616a87\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 08:09:31.881060 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:31.880883 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8447a4cf-f877-4d7e-b43c-210da0616a87-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8447a4cf-f877-4d7e-b43c-210da0616a87\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 08:09:31.881060 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:31.880906 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8447a4cf-f877-4d7e-b43c-210da0616a87-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"8447a4cf-f877-4d7e-b43c-210da0616a87\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 08:09:31.881060 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:31.880945 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8447a4cf-f877-4d7e-b43c-210da0616a87-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8447a4cf-f877-4d7e-b43c-210da0616a87\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 08:09:31.881060 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:31.880975 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8447a4cf-f877-4d7e-b43c-210da0616a87-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8447a4cf-f877-4d7e-b43c-210da0616a87\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 08:09:31.881060 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:31.880998 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8447a4cf-f877-4d7e-b43c-210da0616a87-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8447a4cf-f877-4d7e-b43c-210da0616a87\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 08:09:31.881060 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:31.881024 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8447a4cf-f877-4d7e-b43c-210da0616a87-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8447a4cf-f877-4d7e-b43c-210da0616a87\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 08:09:31.881359 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:31.881059 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8447a4cf-f877-4d7e-b43c-210da0616a87-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8447a4cf-f877-4d7e-b43c-210da0616a87\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 08:09:31.881359 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:31.881132 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8447a4cf-f877-4d7e-b43c-210da0616a87-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8447a4cf-f877-4d7e-b43c-210da0616a87\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 08:09:31.881359 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:31.881153 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8447a4cf-f877-4d7e-b43c-210da0616a87-web-config\") pod \"prometheus-k8s-0\" (UID: \"8447a4cf-f877-4d7e-b43c-210da0616a87\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 08:09:31.881359 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:31.881174 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8447a4cf-f877-4d7e-b43c-210da0616a87-config-out\") pod \"prometheus-k8s-0\" (UID: \"8447a4cf-f877-4d7e-b43c-210da0616a87\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 08:09:31.881359 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:31.881189 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8447a4cf-f877-4d7e-b43c-210da0616a87-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8447a4cf-f877-4d7e-b43c-210da0616a87\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 08:09:31.881359 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:31.881257 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8447a4cf-f877-4d7e-b43c-210da0616a87-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8447a4cf-f877-4d7e-b43c-210da0616a87\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 08:09:31.881359 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:31.881286 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6frp7\" (UniqueName: \"kubernetes.io/projected/8447a4cf-f877-4d7e-b43c-210da0616a87-kube-api-access-6frp7\") pod \"prometheus-k8s-0\" (UID: \"8447a4cf-f877-4d7e-b43c-210da0616a87\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 08:09:31.881359 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:31.881311 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8447a4cf-f877-4d7e-b43c-210da0616a87-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8447a4cf-f877-4d7e-b43c-210da0616a87\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 08:09:31.881359 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:31.881334 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8447a4cf-f877-4d7e-b43c-210da0616a87-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8447a4cf-f877-4d7e-b43c-210da0616a87\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 08:09:31.881359 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:31.881356 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8447a4cf-f877-4d7e-b43c-210da0616a87-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8447a4cf-f877-4d7e-b43c-210da0616a87\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 08:09:31.944134 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:31.944098 2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="53f6513d-2d21-463e-b9d7-93809bf37f40" path="/var/lib/kubelet/pods/53f6513d-2d21-463e-b9d7-93809bf37f40/volumes" Sep 18 08:09:31.982224 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:31.982134 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8447a4cf-f877-4d7e-b43c-210da0616a87-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8447a4cf-f877-4d7e-b43c-210da0616a87\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 08:09:31.982224 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:31.982178 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8447a4cf-f877-4d7e-b43c-210da0616a87-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8447a4cf-f877-4d7e-b43c-210da0616a87\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 08:09:31.982224 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:31.982204 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8447a4cf-f877-4d7e-b43c-210da0616a87-config\") pod \"prometheus-k8s-0\" (UID: \"8447a4cf-f877-4d7e-b43c-210da0616a87\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 08:09:31.982497 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:31.982325 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8447a4cf-f877-4d7e-b43c-210da0616a87-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8447a4cf-f877-4d7e-b43c-210da0616a87\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 08:09:31.982497 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:31.982368 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8447a4cf-f877-4d7e-b43c-210da0616a87-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"8447a4cf-f877-4d7e-b43c-210da0616a87\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 08:09:31.982497 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:31.982399 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8447a4cf-f877-4d7e-b43c-210da0616a87-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8447a4cf-f877-4d7e-b43c-210da0616a87\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 08:09:31.982497 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:31.982437 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8447a4cf-f877-4d7e-b43c-210da0616a87-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8447a4cf-f877-4d7e-b43c-210da0616a87\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 08:09:31.982497 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:31.982463 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8447a4cf-f877-4d7e-b43c-210da0616a87-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"8447a4cf-f877-4d7e-b43c-210da0616a87\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 08:09:31.982743 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:31.982505 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8447a4cf-f877-4d7e-b43c-210da0616a87-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8447a4cf-f877-4d7e-b43c-210da0616a87\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 08:09:31.982743 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:31.982539 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8447a4cf-f877-4d7e-b43c-210da0616a87-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8447a4cf-f877-4d7e-b43c-210da0616a87\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 08:09:31.982743 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:31.982563 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8447a4cf-f877-4d7e-b43c-210da0616a87-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8447a4cf-f877-4d7e-b43c-210da0616a87\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 08:09:31.982743 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:31.982594 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8447a4cf-f877-4d7e-b43c-210da0616a87-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8447a4cf-f877-4d7e-b43c-210da0616a87\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 08:09:31.982743 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:31.982618 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8447a4cf-f877-4d7e-b43c-210da0616a87-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8447a4cf-f877-4d7e-b43c-210da0616a87\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 08:09:31.982743 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:31.982663 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8447a4cf-f877-4d7e-b43c-210da0616a87-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8447a4cf-f877-4d7e-b43c-210da0616a87\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 08:09:31.982743 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:31.982688 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8447a4cf-f877-4d7e-b43c-210da0616a87-web-config\") pod \"prometheus-k8s-0\" (UID: \"8447a4cf-f877-4d7e-b43c-210da0616a87\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 08:09:31.982743 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:31.982721 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8447a4cf-f877-4d7e-b43c-210da0616a87-config-out\") pod \"prometheus-k8s-0\" (UID: \"8447a4cf-f877-4d7e-b43c-210da0616a87\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 08:09:31.983154 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:31.982749 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8447a4cf-f877-4d7e-b43c-210da0616a87-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8447a4cf-f877-4d7e-b43c-210da0616a87\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 08:09:31.983154 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:31.982804 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8447a4cf-f877-4d7e-b43c-210da0616a87-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8447a4cf-f877-4d7e-b43c-210da0616a87\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 08:09:31.983154 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:31.982866 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6frp7\" (UniqueName: \"kubernetes.io/projected/8447a4cf-f877-4d7e-b43c-210da0616a87-kube-api-access-6frp7\") pod \"prometheus-k8s-0\" (UID: \"8447a4cf-f877-4d7e-b43c-210da0616a87\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 08:09:31.983154 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:31.982901 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8447a4cf-f877-4d7e-b43c-210da0616a87-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8447a4cf-f877-4d7e-b43c-210da0616a87\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 08:09:31.983415 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:31.983199 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8447a4cf-f877-4d7e-b43c-210da0616a87-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"8447a4cf-f877-4d7e-b43c-210da0616a87\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 08:09:31.983415 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:31.983250 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8447a4cf-f877-4d7e-b43c-210da0616a87-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8447a4cf-f877-4d7e-b43c-210da0616a87\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 08:09:31.983525 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:31.983442 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8447a4cf-f877-4d7e-b43c-210da0616a87-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8447a4cf-f877-4d7e-b43c-210da0616a87\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 08:09:31.983633 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:31.983606 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8447a4cf-f877-4d7e-b43c-210da0616a87-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"8447a4cf-f877-4d7e-b43c-210da0616a87\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 08:09:31.985780 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:31.985441 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8447a4cf-f877-4d7e-b43c-210da0616a87-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8447a4cf-f877-4d7e-b43c-210da0616a87\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 08:09:31.985780 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:31.985612 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/8447a4cf-f877-4d7e-b43c-210da0616a87-config\") pod \"prometheus-k8s-0\" (UID: \"8447a4cf-f877-4d7e-b43c-210da0616a87\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 08:09:31.986152 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:31.986054 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8447a4cf-f877-4d7e-b43c-210da0616a87-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8447a4cf-f877-4d7e-b43c-210da0616a87\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 08:09:31.986267 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:31.986171 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8447a4cf-f877-4d7e-b43c-210da0616a87-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8447a4cf-f877-4d7e-b43c-210da0616a87\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 08:09:31.986338 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:31.986302 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8447a4cf-f877-4d7e-b43c-210da0616a87-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8447a4cf-f877-4d7e-b43c-210da0616a87\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 08:09:31.986675 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:31.986647 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8447a4cf-f877-4d7e-b43c-210da0616a87-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8447a4cf-f877-4d7e-b43c-210da0616a87\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 08:09:31.986897 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:31.986875 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8447a4cf-f877-4d7e-b43c-210da0616a87-web-config\") pod \"prometheus-k8s-0\" (UID: \"8447a4cf-f877-4d7e-b43c-210da0616a87\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 08:09:31.987001 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:31.986988 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8447a4cf-f877-4d7e-b43c-210da0616a87-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8447a4cf-f877-4d7e-b43c-210da0616a87\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 08:09:31.987246 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:31.987217 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8447a4cf-f877-4d7e-b43c-210da0616a87-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8447a4cf-f877-4d7e-b43c-210da0616a87\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 08:09:31.987451 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:31.987429 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8447a4cf-f877-4d7e-b43c-210da0616a87-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8447a4cf-f877-4d7e-b43c-210da0616a87\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 08:09:31.987735 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:31.987705 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8447a4cf-f877-4d7e-b43c-210da0616a87-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8447a4cf-f877-4d7e-b43c-210da0616a87\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 08:09:31.988137 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:31.988117 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8447a4cf-f877-4d7e-b43c-210da0616a87-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8447a4cf-f877-4d7e-b43c-210da0616a87\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 08:09:31.988358 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:31.988339 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8447a4cf-f877-4d7e-b43c-210da0616a87-config-out\") pod \"prometheus-k8s-0\" (UID: \"8447a4cf-f877-4d7e-b43c-210da0616a87\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 08:09:31.989165 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:31.989147 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8447a4cf-f877-4d7e-b43c-210da0616a87-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8447a4cf-f877-4d7e-b43c-210da0616a87\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 08:09:31.990257 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:31.990236 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8447a4cf-f877-4d7e-b43c-210da0616a87-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8447a4cf-f877-4d7e-b43c-210da0616a87\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 08:09:31.992303 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:31.992283 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6frp7\" (UniqueName: \"kubernetes.io/projected/8447a4cf-f877-4d7e-b43c-210da0616a87-kube-api-access-6frp7\") pod \"prometheus-k8s-0\" (UID: \"8447a4cf-f877-4d7e-b43c-210da0616a87\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 08:09:32.081714 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:32.081672 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 08:09:32.366056 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:32.366029 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 18 08:09:32.368356 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:09:32.368322 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8447a4cf_f877_4d7e_b43c_210da0616a87.slice/crio-ee36990227acfd6714bef1d1ddeda4dfae0914fdb602aab1f55bb977708407a0 WatchSource:0}: Error finding container ee36990227acfd6714bef1d1ddeda4dfae0914fdb602aab1f55bb977708407a0: Status 404 returned error can't find the container with id ee36990227acfd6714bef1d1ddeda4dfae0914fdb602aab1f55bb977708407a0 Sep 18 08:09:32.709149 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:32.709058 2585 generic.go:356] "Generic (PLEG): container finished" podID="8447a4cf-f877-4d7e-b43c-210da0616a87" containerID="92d10fd85afb3f8380ec39f82ae931e3d173d4f420b3c05b72da4cc0d5b9da9a" exitCode=0 Sep 18 08:09:32.709149 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:32.709136 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8447a4cf-f877-4d7e-b43c-210da0616a87","Type":"ContainerDied","Data":"92d10fd85afb3f8380ec39f82ae931e3d173d4f420b3c05b72da4cc0d5b9da9a"} Sep 18 08:09:32.709604 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:32.709203 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8447a4cf-f877-4d7e-b43c-210da0616a87","Type":"ContainerStarted","Data":"ee36990227acfd6714bef1d1ddeda4dfae0914fdb602aab1f55bb977708407a0"} Sep 18 08:09:33.717650 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:33.717610 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8447a4cf-f877-4d7e-b43c-210da0616a87","Type":"ContainerStarted","Data":"d6ca14369fa1b14a41f66190752572fc0047e8f0bb9dd83dae6d1aaad3a7ce8a"} Sep 18 08:09:33.718071 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:33.717693 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8447a4cf-f877-4d7e-b43c-210da0616a87","Type":"ContainerStarted","Data":"adaeddf51d89d9445927e9b055be82cb1a447b5f202bfd80f7d8677456a44610"} Sep 18 08:09:33.718071 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:33.717735 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8447a4cf-f877-4d7e-b43c-210da0616a87","Type":"ContainerStarted","Data":"660b6141a47733a3a6d3556b647ff211b1fae4a1fe5ea3a41a3119efa252a8f8"} Sep 18 08:09:33.718071 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:33.717773 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8447a4cf-f877-4d7e-b43c-210da0616a87","Type":"ContainerStarted","Data":"cba951ef9ed3a9b73cf9ed24c48c62a7b7ef240bd651c7f2db0ed97eadd54086"} Sep 18 08:09:33.718071 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:33.717810 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8447a4cf-f877-4d7e-b43c-210da0616a87","Type":"ContainerStarted","Data":"6a35937eb6dad73c113b63626feb63489d0e369d5c22d4de7b7b25e1dad60dcd"} Sep 18 08:09:33.718071 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:33.717870 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8447a4cf-f877-4d7e-b43c-210da0616a87","Type":"ContainerStarted","Data":"5a10f3144c998b70b2d8a30d2f963adaff11bd4d60bd0af83142bac7167d9fc6"} Sep 18 08:09:33.753123 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:33.753069 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.733062507 podStartE2EDuration="2.753049959s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.987452ms" isStatefulPod=false podCreationTimestamp="2026-09-18 08:09:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 08:09:33.749799752 +0000 UTC m=+146.019499693" watchObservedRunningTime="2026-09-18 08:09:33.753049959 +0000 UTC m=+146.022749888" Sep 18 08:09:34.725539 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:34.725494 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-54756dd7c6-cttsm" event={"ID":"ca34238e-3c83-49a4-8a68-99d560074356","Type":"ContainerStarted","Data":"1969cde15ee4c98486fda4dccd4e7584e107f3262bd593a6b996b9dd27143815"} Sep 18 08:09:34.726039 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:34.725566 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-54756dd7c6-cttsm" event={"ID":"ca34238e-3c83-49a4-8a68-99d560074356","Type":"ContainerStarted","Data":"69524506a932a4db7866528efe293940d5512794bc983705229c1a93ef16f8b0"} Sep 18 08:09:34.726039 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:34.725589 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-54756dd7c6-cttsm" event={"ID":"ca34238e-3c83-49a4-8a68-99d560074356","Type":"ContainerStarted","Data":"296460fef5925c0afaae90da3cc061a767e9c7bbe2d8de073f26f5e770e8af5c"} Sep 18 08:09:34.749909 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:34.749801 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-54756dd7c6-cttsm" podStartSLOduration=1.464884863 podStartE2EDuration="5.749747388s" totalImagesPullingTime="4.284862525s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 08:09:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 08:09:34.748137059 +0000 UTC m=+147.017837009" watchObservedRunningTime="2026-09-18 08:09:34.749747388 +0000 UTC m=+147.019447319" Sep 18 08:09:37.082352 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:09:37.082306 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 08:10:32.082496 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:10:32.082461 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 08:10:32.100601 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:10:32.100574 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 08:10:32.994885 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:10:32.994821 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 08:12:09.863716 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:12:09.863685 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9kn9p_a56b7fed-7af6-4ed5-962d-9bd3f342cd2b/ovn-acl-logging/0.log" Sep 18 08:12:09.866698 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:12:09.866679 2585 kubelet.go:1648] "Image garbage collection succeeded" Sep 18 08:12:09.867940 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:12:09.867922 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9kn9p_a56b7fed-7af6-4ed5-962d-9bd3f342cd2b/ovn-acl-logging/0.log" Sep 18 08:12:12.075372 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:12:12.075334 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-5q5qk"] Sep 18 08:12:12.078424 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:12:12.078404 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-5q5qk" Sep 18 08:12:12.080630 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:12:12.080607 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Sep 18 08:12:12.081646 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:12:12.081631 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-j6v6h\"" Sep 18 08:12:12.081705 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:12:12.081687 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Sep 18 08:12:12.086602 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:12:12.086578 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-5q5qk"] Sep 18 08:12:12.175160 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:12:12.175126 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6ed02b47-a45f-4cd1-bf45-f4f3e3885dc9-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-5q5qk\" (UID: \"6ed02b47-a45f-4cd1-bf45-f4f3e3885dc9\") " pod="cert-manager/cert-manager-webhook-6486ffd997-5q5qk" Sep 18 08:12:12.175398 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:12:12.175182 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w2ffs\" (UniqueName: \"kubernetes.io/projected/6ed02b47-a45f-4cd1-bf45-f4f3e3885dc9-kube-api-access-w2ffs\") pod \"cert-manager-webhook-6486ffd997-5q5qk\" (UID: \"6ed02b47-a45f-4cd1-bf45-f4f3e3885dc9\") " pod="cert-manager/cert-manager-webhook-6486ffd997-5q5qk" Sep 18 08:12:12.276145 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:12:12.276105 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w2ffs\" (UniqueName: \"kubernetes.io/projected/6ed02b47-a45f-4cd1-bf45-f4f3e3885dc9-kube-api-access-w2ffs\") pod \"cert-manager-webhook-6486ffd997-5q5qk\" (UID: \"6ed02b47-a45f-4cd1-bf45-f4f3e3885dc9\") " pod="cert-manager/cert-manager-webhook-6486ffd997-5q5qk" Sep 18 08:12:12.276331 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:12:12.276188 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6ed02b47-a45f-4cd1-bf45-f4f3e3885dc9-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-5q5qk\" (UID: \"6ed02b47-a45f-4cd1-bf45-f4f3e3885dc9\") " pod="cert-manager/cert-manager-webhook-6486ffd997-5q5qk" Sep 18 08:12:12.284614 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:12:12.284585 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6ed02b47-a45f-4cd1-bf45-f4f3e3885dc9-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-5q5qk\" (UID: \"6ed02b47-a45f-4cd1-bf45-f4f3e3885dc9\") " pod="cert-manager/cert-manager-webhook-6486ffd997-5q5qk" Sep 18 08:12:12.284790 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:12:12.284768 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w2ffs\" (UniqueName: \"kubernetes.io/projected/6ed02b47-a45f-4cd1-bf45-f4f3e3885dc9-kube-api-access-w2ffs\") pod \"cert-manager-webhook-6486ffd997-5q5qk\" (UID: \"6ed02b47-a45f-4cd1-bf45-f4f3e3885dc9\") " pod="cert-manager/cert-manager-webhook-6486ffd997-5q5qk" Sep 18 08:12:12.396399 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:12:12.396307 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-5q5qk" Sep 18 08:12:12.665972 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:12:12.665945 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-5q5qk"] Sep 18 08:12:12.668727 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:12:12.668701 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6ed02b47_a45f_4cd1_bf45_f4f3e3885dc9.slice/crio-5985e30b212549045ef79cadfa02d1518032fe8b678f1f8cee6f62d43339853a WatchSource:0}: Error finding container 5985e30b212549045ef79cadfa02d1518032fe8b678f1f8cee6f62d43339853a: Status 404 returned error can't find the container with id 5985e30b212549045ef79cadfa02d1518032fe8b678f1f8cee6f62d43339853a Sep 18 08:12:12.671122 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:12:12.671103 2585 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 18 08:12:13.377241 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:12:13.377205 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-5q5qk" event={"ID":"6ed02b47-a45f-4cd1-bf45-f4f3e3885dc9","Type":"ContainerStarted","Data":"5985e30b212549045ef79cadfa02d1518032fe8b678f1f8cee6f62d43339853a"} Sep 18 08:12:16.392407 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:12:16.392370 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-5q5qk" event={"ID":"6ed02b47-a45f-4cd1-bf45-f4f3e3885dc9","Type":"ContainerStarted","Data":"15f47f89316ba519c97e6d0c09b3a868ce8c9511fcfea2507d12e8579140646f"} Sep 18 08:12:16.392772 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:12:16.392431 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-5q5qk" Sep 18 08:12:16.409170 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:12:16.409116 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-5q5qk" podStartSLOduration=1.181214594 podStartE2EDuration="4.409096975s" totalImagesPullingTime="3.227882381s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 08:12:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 08:12:16.408812114 +0000 UTC m=+308.678512044" watchObservedRunningTime="2026-09-18 08:12:16.409096975 +0000 UTC m=+308.678796923" Sep 18 08:12:22.398910 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:12:22.398879 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-5q5qk" Sep 18 08:12:37.451943 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:12:37.451905 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-jobset-operator/jobset-operator-5bc45f897-q4t2t"] Sep 18 08:12:37.457088 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:12:37.457068 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-operator-5bc45f897-q4t2t" Sep 18 08:12:37.459976 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:12:37.459942 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"openshift-service-ca.crt\"" Sep 18 08:12:37.460131 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:12:37.459952 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"jobset-operator-dockercfg-ww298\"" Sep 18 08:12:37.460896 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:12:37.460879 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"kube-root-ca.crt\"" Sep 18 08:12:37.465865 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:12:37.465821 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-operator-5bc45f897-q4t2t"] Sep 18 08:12:37.582427 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:12:37.582360 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jdlg7\" (UniqueName: \"kubernetes.io/projected/cc2ebbcb-a43a-4d9f-9734-0dd5e8befbb6-kube-api-access-jdlg7\") pod \"jobset-operator-5bc45f897-q4t2t\" (UID: \"cc2ebbcb-a43a-4d9f-9734-0dd5e8befbb6\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-q4t2t" Sep 18 08:12:37.582601 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:12:37.582546 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cc2ebbcb-a43a-4d9f-9734-0dd5e8befbb6-tmp\") pod \"jobset-operator-5bc45f897-q4t2t\" (UID: \"cc2ebbcb-a43a-4d9f-9734-0dd5e8befbb6\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-q4t2t" Sep 18 08:12:37.683128 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:12:37.683100 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jdlg7\" (UniqueName: \"kubernetes.io/projected/cc2ebbcb-a43a-4d9f-9734-0dd5e8befbb6-kube-api-access-jdlg7\") pod \"jobset-operator-5bc45f897-q4t2t\" (UID: \"cc2ebbcb-a43a-4d9f-9734-0dd5e8befbb6\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-q4t2t" Sep 18 08:12:37.683262 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:12:37.683151 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cc2ebbcb-a43a-4d9f-9734-0dd5e8befbb6-tmp\") pod \"jobset-operator-5bc45f897-q4t2t\" (UID: \"cc2ebbcb-a43a-4d9f-9734-0dd5e8befbb6\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-q4t2t" Sep 18 08:12:37.683476 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:12:37.683462 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cc2ebbcb-a43a-4d9f-9734-0dd5e8befbb6-tmp\") pod \"jobset-operator-5bc45f897-q4t2t\" (UID: \"cc2ebbcb-a43a-4d9f-9734-0dd5e8befbb6\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-q4t2t" Sep 18 08:12:37.691954 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:12:37.691931 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jdlg7\" (UniqueName: \"kubernetes.io/projected/cc2ebbcb-a43a-4d9f-9734-0dd5e8befbb6-kube-api-access-jdlg7\") pod \"jobset-operator-5bc45f897-q4t2t\" (UID: \"cc2ebbcb-a43a-4d9f-9734-0dd5e8befbb6\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-q4t2t" Sep 18 08:12:37.767962 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:12:37.767944 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-operator-5bc45f897-q4t2t" Sep 18 08:12:38.036694 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:12:38.036673 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-operator-5bc45f897-q4t2t"] Sep 18 08:12:38.038661 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:12:38.038634 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcc2ebbcb_a43a_4d9f_9734_0dd5e8befbb6.slice/crio-b8924e499298d3012ec43e95017596836e2c494b7299b3df557ec19cb373364d WatchSource:0}: Error finding container b8924e499298d3012ec43e95017596836e2c494b7299b3df557ec19cb373364d: Status 404 returned error can't find the container with id b8924e499298d3012ec43e95017596836e2c494b7299b3df557ec19cb373364d Sep 18 08:12:38.491066 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:12:38.490998 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-operator-5bc45f897-q4t2t" event={"ID":"cc2ebbcb-a43a-4d9f-9734-0dd5e8befbb6","Type":"ContainerStarted","Data":"b8924e499298d3012ec43e95017596836e2c494b7299b3df557ec19cb373364d"} Sep 18 08:12:40.501408 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:12:40.501377 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-operator-5bc45f897-q4t2t" event={"ID":"cc2ebbcb-a43a-4d9f-9734-0dd5e8befbb6","Type":"ContainerStarted","Data":"3c5c58c8a5fc4d55b74567a9b34ff6c8b05b9202876e48548d79cd83a0c67a54"} Sep 18 08:12:40.520164 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:12:40.520115 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-jobset-operator/jobset-operator-5bc45f897-q4t2t" podStartSLOduration=1.16456105 podStartE2EDuration="3.52009451s" totalImagesPullingTime="2.35553346s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 08:12:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 08:12:40.518009268 +0000 UTC m=+332.787709197" watchObservedRunningTime="2026-09-18 08:12:40.52009451 +0000 UTC m=+332.789794450" Sep 18 08:13:36.975414 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:13:36.975379 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["trainer-operator-system/trainer-operator-controller-manager-65c9dd8fd9-r9tsq"] Sep 18 08:13:36.977858 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:13:36.977826 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="trainer-operator-system/trainer-operator-controller-manager-65c9dd8fd9-r9tsq" Sep 18 08:13:36.983295 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:13:36.983265 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"trainer-operator-system\"/\"trainer-operator-metrics-tls\"" Sep 18 08:13:36.984696 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:13:36.984372 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"trainer-operator-system\"/\"openshift-service-ca.crt\"" Sep 18 08:13:36.984696 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:13:36.984386 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"trainer-operator-system\"/\"kube-root-ca.crt\"" Sep 18 08:13:36.984696 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:13:36.984372 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"trainer-operator-system\"/\"trainer-operator-controller-manager-dockercfg-spwbm\"" Sep 18 08:13:36.996416 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:13:36.996394 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["trainer-operator-system/trainer-operator-controller-manager-65c9dd8fd9-r9tsq"] Sep 18 08:13:37.045043 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:13:37.045012 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests-work\" (UniqueName: \"kubernetes.io/empty-dir/56911f95-623b-44f1-a676-9d0e7f86e4d2-manifests-work\") pod \"trainer-operator-controller-manager-65c9dd8fd9-r9tsq\" (UID: \"56911f95-623b-44f1-a676-9d0e7f86e4d2\") " pod="trainer-operator-system/trainer-operator-controller-manager-65c9dd8fd9-r9tsq" Sep 18 08:13:37.045151 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:13:37.045058 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/56911f95-623b-44f1-a676-9d0e7f86e4d2-metrics-certs\") pod \"trainer-operator-controller-manager-65c9dd8fd9-r9tsq\" (UID: \"56911f95-623b-44f1-a676-9d0e7f86e4d2\") " pod="trainer-operator-system/trainer-operator-controller-manager-65c9dd8fd9-r9tsq" Sep 18 08:13:37.045151 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:13:37.045092 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/56911f95-623b-44f1-a676-9d0e7f86e4d2-tmp\") pod \"trainer-operator-controller-manager-65c9dd8fd9-r9tsq\" (UID: \"56911f95-623b-44f1-a676-9d0e7f86e4d2\") " pod="trainer-operator-system/trainer-operator-controller-manager-65c9dd8fd9-r9tsq" Sep 18 08:13:37.045248 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:13:37.045147 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rdx8v\" (UniqueName: \"kubernetes.io/projected/56911f95-623b-44f1-a676-9d0e7f86e4d2-kube-api-access-rdx8v\") pod \"trainer-operator-controller-manager-65c9dd8fd9-r9tsq\" (UID: \"56911f95-623b-44f1-a676-9d0e7f86e4d2\") " pod="trainer-operator-system/trainer-operator-controller-manager-65c9dd8fd9-r9tsq" Sep 18 08:13:37.145514 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:13:37.145483 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests-work\" (UniqueName: \"kubernetes.io/empty-dir/56911f95-623b-44f1-a676-9d0e7f86e4d2-manifests-work\") pod \"trainer-operator-controller-manager-65c9dd8fd9-r9tsq\" (UID: \"56911f95-623b-44f1-a676-9d0e7f86e4d2\") " pod="trainer-operator-system/trainer-operator-controller-manager-65c9dd8fd9-r9tsq" Sep 18 08:13:37.145649 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:13:37.145522 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/56911f95-623b-44f1-a676-9d0e7f86e4d2-metrics-certs\") pod \"trainer-operator-controller-manager-65c9dd8fd9-r9tsq\" (UID: \"56911f95-623b-44f1-a676-9d0e7f86e4d2\") " pod="trainer-operator-system/trainer-operator-controller-manager-65c9dd8fd9-r9tsq" Sep 18 08:13:37.145649 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:13:37.145542 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/56911f95-623b-44f1-a676-9d0e7f86e4d2-tmp\") pod \"trainer-operator-controller-manager-65c9dd8fd9-r9tsq\" (UID: \"56911f95-623b-44f1-a676-9d0e7f86e4d2\") " pod="trainer-operator-system/trainer-operator-controller-manager-65c9dd8fd9-r9tsq" Sep 18 08:13:37.145649 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:13:37.145571 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rdx8v\" (UniqueName: \"kubernetes.io/projected/56911f95-623b-44f1-a676-9d0e7f86e4d2-kube-api-access-rdx8v\") pod \"trainer-operator-controller-manager-65c9dd8fd9-r9tsq\" (UID: \"56911f95-623b-44f1-a676-9d0e7f86e4d2\") " pod="trainer-operator-system/trainer-operator-controller-manager-65c9dd8fd9-r9tsq" Sep 18 08:13:37.145907 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:13:37.145871 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests-work\" (UniqueName: \"kubernetes.io/empty-dir/56911f95-623b-44f1-a676-9d0e7f86e4d2-manifests-work\") pod \"trainer-operator-controller-manager-65c9dd8fd9-r9tsq\" (UID: \"56911f95-623b-44f1-a676-9d0e7f86e4d2\") " pod="trainer-operator-system/trainer-operator-controller-manager-65c9dd8fd9-r9tsq" Sep 18 08:13:37.145988 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:13:37.145945 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/56911f95-623b-44f1-a676-9d0e7f86e4d2-tmp\") pod \"trainer-operator-controller-manager-65c9dd8fd9-r9tsq\" (UID: \"56911f95-623b-44f1-a676-9d0e7f86e4d2\") " pod="trainer-operator-system/trainer-operator-controller-manager-65c9dd8fd9-r9tsq" Sep 18 08:13:37.147815 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:13:37.147789 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/56911f95-623b-44f1-a676-9d0e7f86e4d2-metrics-certs\") pod \"trainer-operator-controller-manager-65c9dd8fd9-r9tsq\" (UID: \"56911f95-623b-44f1-a676-9d0e7f86e4d2\") " pod="trainer-operator-system/trainer-operator-controller-manager-65c9dd8fd9-r9tsq" Sep 18 08:13:37.158584 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:13:37.158564 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rdx8v\" (UniqueName: \"kubernetes.io/projected/56911f95-623b-44f1-a676-9d0e7f86e4d2-kube-api-access-rdx8v\") pod \"trainer-operator-controller-manager-65c9dd8fd9-r9tsq\" (UID: \"56911f95-623b-44f1-a676-9d0e7f86e4d2\") " pod="trainer-operator-system/trainer-operator-controller-manager-65c9dd8fd9-r9tsq" Sep 18 08:13:37.288239 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:13:37.288217 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="trainer-operator-system/trainer-operator-controller-manager-65c9dd8fd9-r9tsq" Sep 18 08:13:37.571741 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:13:37.571666 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["trainer-operator-system/trainer-operator-controller-manager-65c9dd8fd9-r9tsq"] Sep 18 08:13:37.575602 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:13:37.575575 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56911f95_623b_44f1_a676_9d0e7f86e4d2.slice/crio-6b2990cb0b7ec0364db861b2a3e335d5cb73f19429d18fa4d49b9c54e549fc50 WatchSource:0}: Error finding container 6b2990cb0b7ec0364db861b2a3e335d5cb73f19429d18fa4d49b9c54e549fc50: Status 404 returned error can't find the container with id 6b2990cb0b7ec0364db861b2a3e335d5cb73f19429d18fa4d49b9c54e549fc50 Sep 18 08:13:37.752947 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:13:37.752905 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="trainer-operator-system/trainer-operator-controller-manager-65c9dd8fd9-r9tsq" event={"ID":"56911f95-623b-44f1-a676-9d0e7f86e4d2","Type":"ContainerStarted","Data":"6b2990cb0b7ec0364db861b2a3e335d5cb73f19429d18fa4d49b9c54e549fc50"} Sep 18 08:13:40.769578 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:13:40.769539 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="trainer-operator-system/trainer-operator-controller-manager-65c9dd8fd9-r9tsq" event={"ID":"56911f95-623b-44f1-a676-9d0e7f86e4d2","Type":"ContainerStarted","Data":"a3829f26b732f47bbcdfde7c821679d9e66a878a527d7b8d72fb393f3b220c33"} Sep 18 08:13:40.769987 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:13:40.769693 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="trainer-operator-system/trainer-operator-controller-manager-65c9dd8fd9-r9tsq" Sep 18 08:13:40.789757 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:13:40.789715 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="trainer-operator-system/trainer-operator-controller-manager-65c9dd8fd9-r9tsq" podStartSLOduration=2.273187316 podStartE2EDuration="4.789701889s" totalImagesPullingTime="2.516514573s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 08:13:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 08:13:40.788159944 +0000 UTC m=+393.057859874" watchObservedRunningTime="2026-09-18 08:13:40.789701889 +0000 UTC m=+393.059401818" Sep 18 08:13:51.777289 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:13:51.777245 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="trainer-operator-system/trainer-operator-controller-manager-65c9dd8fd9-r9tsq" Sep 18 08:14:47.759520 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:14:47.759483 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-trainjob-workflow-node-0-0-x7vjl"] Sep 18 08:14:47.762959 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:14:47.762936 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-trainjob-workflow-node-0-0-x7vjl" Sep 18 08:14:47.769462 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:14:47.769432 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Sep 18 08:14:47.769462 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:14:47.769448 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Sep 18 08:14:47.769682 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:14:47.769498 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-vx8sr\"" Sep 18 08:14:47.788056 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:14:47.788033 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-trainjob-workflow-node-0-0-x7vjl"] Sep 18 08:14:47.795730 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:14:47.795705 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c75gx\" (UniqueName: \"kubernetes.io/projected/42e95761-2983-4370-bf7b-c82df3642851-kube-api-access-c75gx\") pod \"test-trainjob-workflow-node-0-0-x7vjl\" (UID: \"42e95761-2983-4370-bf7b-c82df3642851\") " pod="opendatahub/test-trainjob-workflow-node-0-0-x7vjl" Sep 18 08:14:47.896696 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:14:47.896670 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c75gx\" (UniqueName: \"kubernetes.io/projected/42e95761-2983-4370-bf7b-c82df3642851-kube-api-access-c75gx\") pod \"test-trainjob-workflow-node-0-0-x7vjl\" (UID: \"42e95761-2983-4370-bf7b-c82df3642851\") " pod="opendatahub/test-trainjob-workflow-node-0-0-x7vjl" Sep 18 08:14:47.906097 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:14:47.906073 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c75gx\" (UniqueName: \"kubernetes.io/projected/42e95761-2983-4370-bf7b-c82df3642851-kube-api-access-c75gx\") pod \"test-trainjob-workflow-node-0-0-x7vjl\" (UID: \"42e95761-2983-4370-bf7b-c82df3642851\") " pod="opendatahub/test-trainjob-workflow-node-0-0-x7vjl" Sep 18 08:14:48.073303 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:14:48.073278 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-trainjob-workflow-node-0-0-x7vjl" Sep 18 08:14:48.339431 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:14:48.339404 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-trainjob-workflow-node-0-0-x7vjl"] Sep 18 08:14:48.341691 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:14:48.341662 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod42e95761_2983_4370_bf7b_c82df3642851.slice/crio-0bef633168f173b62d645fd76fc8afffd13a1b5da4b88f8f795b2cda00cea8f3 WatchSource:0}: Error finding container 0bef633168f173b62d645fd76fc8afffd13a1b5da4b88f8f795b2cda00cea8f3: Status 404 returned error can't find the container with id 0bef633168f173b62d645fd76fc8afffd13a1b5da4b88f8f795b2cda00cea8f3 Sep 18 08:14:49.063353 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:14:49.063318 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-trainjob-workflow-node-0-0-x7vjl" event={"ID":"42e95761-2983-4370-bf7b-c82df3642851","Type":"ContainerStarted","Data":"0bef633168f173b62d645fd76fc8afffd13a1b5da4b88f8f795b2cda00cea8f3"} Sep 18 08:15:56.407711 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:15:56.407662 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-trainjob-workflow-node-0-0-x7vjl" event={"ID":"42e95761-2983-4370-bf7b-c82df3642851","Type":"ContainerStarted","Data":"b9851478fe217571d4e0f4292e5bcd2ac1652434f62bb7eceb6f80ddf9fea9a8"} Sep 18 08:15:56.425316 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:15:56.425265 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-trainjob-workflow-node-0-0-x7vjl" podStartSLOduration=2.351332942 podStartE2EDuration="1m9.425250002s" totalImagesPullingTime="1m7.07391706s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 08:14:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 08:15:56.42326753 +0000 UTC m=+528.692967460" watchObservedRunningTime="2026-09-18 08:15:56.425250002 +0000 UTC m=+528.694949932" Sep 18 08:15:58.418451 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:15:58.418412 2585 generic.go:356] "Generic (PLEG): container finished" podID="42e95761-2983-4370-bf7b-c82df3642851" containerID="b9851478fe217571d4e0f4292e5bcd2ac1652434f62bb7eceb6f80ddf9fea9a8" exitCode=0 Sep 18 08:15:58.418877 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:15:58.418492 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-trainjob-workflow-node-0-0-x7vjl" event={"ID":"42e95761-2983-4370-bf7b-c82df3642851","Type":"ContainerDied","Data":"b9851478fe217571d4e0f4292e5bcd2ac1652434f62bb7eceb6f80ddf9fea9a8"} Sep 18 08:15:59.572830 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:15:59.572808 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-trainjob-workflow-node-0-0-x7vjl" Sep 18 08:15:59.723806 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:15:59.723748 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c75gx\" (UniqueName: \"kubernetes.io/projected/42e95761-2983-4370-bf7b-c82df3642851-kube-api-access-c75gx\") pod \"42e95761-2983-4370-bf7b-c82df3642851\" (UID: \"42e95761-2983-4370-bf7b-c82df3642851\") " Sep 18 08:15:59.726035 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:15:59.726009 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/42e95761-2983-4370-bf7b-c82df3642851-kube-api-access-c75gx" (OuterVolumeSpecName: "kube-api-access-c75gx") pod "42e95761-2983-4370-bf7b-c82df3642851" (UID: "42e95761-2983-4370-bf7b-c82df3642851"). InnerVolumeSpecName "kube-api-access-c75gx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 08:15:59.824935 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:15:59.824913 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c75gx\" (UniqueName: \"kubernetes.io/projected/42e95761-2983-4370-bf7b-c82df3642851-kube-api-access-c75gx\") on node \"ip-10-0-138-42.ec2.internal\" DevicePath \"\"" Sep 18 08:16:00.428679 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:16:00.428646 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-trainjob-workflow-node-0-0-x7vjl" event={"ID":"42e95761-2983-4370-bf7b-c82df3642851","Type":"ContainerDied","Data":"0bef633168f173b62d645fd76fc8afffd13a1b5da4b88f8f795b2cda00cea8f3"} Sep 18 08:16:00.428831 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:16:00.428685 2585 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0bef633168f173b62d645fd76fc8afffd13a1b5da4b88f8f795b2cda00cea8f3" Sep 18 08:16:00.428831 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:16:00.428688 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-trainjob-workflow-node-0-0-x7vjl" Sep 18 08:16:00.963768 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:16:00.963736 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-trainjob-workflow-node-0-0-x7vjl"] Sep 18 08:16:00.966329 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:16:00.966302 2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-trainjob-workflow-node-0-0-x7vjl"] Sep 18 08:16:01.943262 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:16:01.943229 2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="42e95761-2983-4370-bf7b-c82df3642851" path="/var/lib/kubelet/pods/42e95761-2983-4370-bf7b-c82df3642851/volumes" Sep 18 08:16:02.304614 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:16:02.304586 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-xkjz5/must-gather-f2l4x"] Sep 18 08:16:02.304965 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:16:02.304926 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="42e95761-2983-4370-bf7b-c82df3642851" containerName="node" Sep 18 08:16:02.304965 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:16:02.304937 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="42e95761-2983-4370-bf7b-c82df3642851" containerName="node" Sep 18 08:16:02.305034 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:16:02.304997 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="42e95761-2983-4370-bf7b-c82df3642851" containerName="node" Sep 18 08:16:02.385295 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:16:02.385268 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-xkjz5/must-gather-f2l4x"] Sep 18 08:16:02.385431 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:16:02.385351 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xkjz5/must-gather-f2l4x" Sep 18 08:16:02.388014 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:16:02.387993 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-xkjz5\"/\"kube-root-ca.crt\"" Sep 18 08:16:02.388150 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:16:02.388104 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-xkjz5\"/\"default-dockercfg-m7t42\"" Sep 18 08:16:02.388235 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:16:02.388221 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-xkjz5\"/\"openshift-service-ca.crt\"" Sep 18 08:16:02.544627 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:16:02.544596 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qsrzb\" (UniqueName: \"kubernetes.io/projected/28091f62-256d-4cac-853c-593987ba91a0-kube-api-access-qsrzb\") pod \"must-gather-f2l4x\" (UID: \"28091f62-256d-4cac-853c-593987ba91a0\") " pod="openshift-must-gather-xkjz5/must-gather-f2l4x" Sep 18 08:16:02.544738 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:16:02.544638 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/28091f62-256d-4cac-853c-593987ba91a0-must-gather-output\") pod \"must-gather-f2l4x\" (UID: \"28091f62-256d-4cac-853c-593987ba91a0\") " pod="openshift-must-gather-xkjz5/must-gather-f2l4x" Sep 18 08:16:02.645004 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:16:02.644951 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qsrzb\" (UniqueName: \"kubernetes.io/projected/28091f62-256d-4cac-853c-593987ba91a0-kube-api-access-qsrzb\") pod \"must-gather-f2l4x\" (UID: \"28091f62-256d-4cac-853c-593987ba91a0\") " pod="openshift-must-gather-xkjz5/must-gather-f2l4x" Sep 18 08:16:02.645004 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:16:02.644986 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/28091f62-256d-4cac-853c-593987ba91a0-must-gather-output\") pod \"must-gather-f2l4x\" (UID: \"28091f62-256d-4cac-853c-593987ba91a0\") " pod="openshift-must-gather-xkjz5/must-gather-f2l4x" Sep 18 08:16:02.645266 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:16:02.645244 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/28091f62-256d-4cac-853c-593987ba91a0-must-gather-output\") pod \"must-gather-f2l4x\" (UID: \"28091f62-256d-4cac-853c-593987ba91a0\") " pod="openshift-must-gather-xkjz5/must-gather-f2l4x" Sep 18 08:16:02.653251 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:16:02.653228 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qsrzb\" (UniqueName: \"kubernetes.io/projected/28091f62-256d-4cac-853c-593987ba91a0-kube-api-access-qsrzb\") pod \"must-gather-f2l4x\" (UID: \"28091f62-256d-4cac-853c-593987ba91a0\") " pod="openshift-must-gather-xkjz5/must-gather-f2l4x" Sep 18 08:16:02.694296 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:16:02.694276 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xkjz5/must-gather-f2l4x" Sep 18 08:16:02.990386 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:16:02.990362 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-xkjz5/must-gather-f2l4x"] Sep 18 08:16:02.993668 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:16:02.993638 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod28091f62_256d_4cac_853c_593987ba91a0.slice/crio-af3d9ee9a69a729244b999a4f69697b5672484d759eedb776fe0c84112b90d62 WatchSource:0}: Error finding container af3d9ee9a69a729244b999a4f69697b5672484d759eedb776fe0c84112b90d62: Status 404 returned error can't find the container with id af3d9ee9a69a729244b999a4f69697b5672484d759eedb776fe0c84112b90d62 Sep 18 08:16:03.443788 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:16:03.443761 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xkjz5/must-gather-f2l4x" event={"ID":"28091f62-256d-4cac-853c-593987ba91a0","Type":"ContainerStarted","Data":"af3d9ee9a69a729244b999a4f69697b5672484d759eedb776fe0c84112b90d62"} Sep 18 08:16:11.489910 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:16:11.489875 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xkjz5/must-gather-f2l4x" event={"ID":"28091f62-256d-4cac-853c-593987ba91a0","Type":"ContainerStarted","Data":"90262d5b1b713c100718ac9661e65cffd7a06f0c3aad6a3b5d4a9530c79e0f4f"} Sep 18 08:16:11.489910 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:16:11.489919 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xkjz5/must-gather-f2l4x" event={"ID":"28091f62-256d-4cac-853c-593987ba91a0","Type":"ContainerStarted","Data":"b94a18fce98445e0b2431b9947916470ecf7e41066a157490852d977ce539504"} Sep 18 08:16:11.506206 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:16:11.506147 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-xkjz5/must-gather-f2l4x" podStartSLOduration=1.8965285710000002 podStartE2EDuration="9.506129796s" totalImagesPullingTime="7.609601225s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 08:16:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 08:16:11.506035773 +0000 UTC m=+543.775735703" watchObservedRunningTime="2026-09-18 08:16:11.506129796 +0000 UTC m=+543.775829726" Sep 18 08:16:56.722988 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:16:56.722957 2585 generic.go:356] "Generic (PLEG): container finished" podID="28091f62-256d-4cac-853c-593987ba91a0" containerID="b94a18fce98445e0b2431b9947916470ecf7e41066a157490852d977ce539504" exitCode=0 Sep 18 08:16:56.723363 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:16:56.723037 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xkjz5/must-gather-f2l4x" event={"ID":"28091f62-256d-4cac-853c-593987ba91a0","Type":"ContainerDied","Data":"b94a18fce98445e0b2431b9947916470ecf7e41066a157490852d977ce539504"} Sep 18 08:16:56.723363 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:16:56.723323 2585 scope.go:117] "RemoveContainer" containerID="b94a18fce98445e0b2431b9947916470ecf7e41066a157490852d977ce539504" Sep 18 08:16:57.250031 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:16:57.250005 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-xkjz5_must-gather-f2l4x_28091f62-256d-4cac-853c-593987ba91a0/gather/0.log" Sep 18 08:17:00.390161 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:17:00.390130 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-6rnbm_8d257247-8dae-4dce-9c31-62cf736b2b9f/global-pull-secret-syncer/0.log" Sep 18 08:17:00.555050 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:17:00.555005 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-dtq72_3a914598-1705-4865-9bbf-f7e2461c20f0/konnectivity-agent/0.log" Sep 18 08:17:00.654959 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:17:00.654880 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-42.ec2.internal_4d9488aa4884c8db37ce53e0291649d1/haproxy/0.log" Sep 18 08:17:02.577736 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:17:02.577699 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-xkjz5/must-gather-f2l4x"] Sep 18 08:17:02.578314 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:17:02.577931 2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-must-gather-xkjz5/must-gather-f2l4x" podUID="28091f62-256d-4cac-853c-593987ba91a0" containerName="copy" containerID="cri-o://90262d5b1b713c100718ac9661e65cffd7a06f0c3aad6a3b5d4a9530c79e0f4f" gracePeriod=2 Sep 18 08:17:02.581075 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:17:02.581039 2585 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-f2l4x\" is forbidden: User \"system:node:ip-10-0-138-42.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-xkjz5\": no relationship found between node 'ip-10-0-138-42.ec2.internal' and this object" podUID="28091f62-256d-4cac-853c-593987ba91a0" pod="openshift-must-gather-xkjz5/must-gather-f2l4x" Sep 18 08:17:02.583046 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:17:02.583019 2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-xkjz5/must-gather-f2l4x"] Sep 18 08:17:02.752301 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:17:02.752276 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-xkjz5_must-gather-f2l4x_28091f62-256d-4cac-853c-593987ba91a0/copy/0.log" Sep 18 08:17:02.752703 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:17:02.752673 2585 generic.go:356] "Generic (PLEG): container finished" podID="28091f62-256d-4cac-853c-593987ba91a0" containerID="90262d5b1b713c100718ac9661e65cffd7a06f0c3aad6a3b5d4a9530c79e0f4f" exitCode=143 Sep 18 08:17:02.809159 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:17:02.809143 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-xkjz5_must-gather-f2l4x_28091f62-256d-4cac-853c-593987ba91a0/copy/0.log" Sep 18 08:17:02.810827 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:17:02.810811 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xkjz5/must-gather-f2l4x" Sep 18 08:17:02.813178 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:17:02.813156 2585 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-f2l4x\" is forbidden: User \"system:node:ip-10-0-138-42.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-xkjz5\": no relationship found between node 'ip-10-0-138-42.ec2.internal' and this object" podUID="28091f62-256d-4cac-853c-593987ba91a0" pod="openshift-must-gather-xkjz5/must-gather-f2l4x" Sep 18 08:17:02.869163 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:17:02.869112 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qsrzb\" (UniqueName: \"kubernetes.io/projected/28091f62-256d-4cac-853c-593987ba91a0-kube-api-access-qsrzb\") pod \"28091f62-256d-4cac-853c-593987ba91a0\" (UID: \"28091f62-256d-4cac-853c-593987ba91a0\") " Sep 18 08:17:02.869245 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:17:02.869178 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/28091f62-256d-4cac-853c-593987ba91a0-must-gather-output\") pod \"28091f62-256d-4cac-853c-593987ba91a0\" (UID: \"28091f62-256d-4cac-853c-593987ba91a0\") " Sep 18 08:17:02.870140 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:17:02.870113 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/28091f62-256d-4cac-853c-593987ba91a0-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "28091f62-256d-4cac-853c-593987ba91a0" (UID: "28091f62-256d-4cac-853c-593987ba91a0"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 18 08:17:02.871372 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:17:02.871353 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/28091f62-256d-4cac-853c-593987ba91a0-kube-api-access-qsrzb" (OuterVolumeSpecName: "kube-api-access-qsrzb") pod "28091f62-256d-4cac-853c-593987ba91a0" (UID: "28091f62-256d-4cac-853c-593987ba91a0"). InnerVolumeSpecName "kube-api-access-qsrzb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 08:17:02.970581 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:17:02.970556 2585 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/28091f62-256d-4cac-853c-593987ba91a0-must-gather-output\") on node \"ip-10-0-138-42.ec2.internal\" DevicePath \"\"" Sep 18 08:17:02.970581 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:17:02.970584 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qsrzb\" (UniqueName: \"kubernetes.io/projected/28091f62-256d-4cac-853c-593987ba91a0-kube-api-access-qsrzb\") on node \"ip-10-0-138-42.ec2.internal\" DevicePath \"\"" Sep 18 08:17:03.428823 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:17:03.428785 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4b4b6720-16b8-4ff8-ab94-5748bb36d61e/alertmanager/0.log" Sep 18 08:17:03.452554 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:17:03.452530 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4b4b6720-16b8-4ff8-ab94-5748bb36d61e/config-reloader/0.log" Sep 18 08:17:03.488988 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:17:03.488967 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4b4b6720-16b8-4ff8-ab94-5748bb36d61e/kube-rbac-proxy-web/0.log" Sep 18 08:17:03.511501 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:17:03.511482 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4b4b6720-16b8-4ff8-ab94-5748bb36d61e/kube-rbac-proxy/0.log" Sep 18 08:17:03.540949 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:17:03.540924 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4b4b6720-16b8-4ff8-ab94-5748bb36d61e/kube-rbac-proxy-metric/0.log" Sep 18 08:17:03.563199 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:17:03.563177 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4b4b6720-16b8-4ff8-ab94-5748bb36d61e/prom-label-proxy/0.log" Sep 18 08:17:03.585382 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:17:03.585359 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4b4b6720-16b8-4ff8-ab94-5748bb36d61e/init-config-reloader/0.log" Sep 18 08:17:03.669384 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:17:03.669349 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-84c885658c-wfr6k_88ed125b-8189-4544-ac91-d69a10721b8c/kube-state-metrics/0.log" Sep 18 08:17:03.689837 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:17:03.689767 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-84c885658c-wfr6k_88ed125b-8189-4544-ac91-d69a10721b8c/kube-rbac-proxy-main/0.log" Sep 18 08:17:03.713384 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:17:03.713360 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-84c885658c-wfr6k_88ed125b-8189-4544-ac91-d69a10721b8c/kube-rbac-proxy-self/0.log" Sep 18 08:17:03.753407 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:17:03.753389 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-5dd968f6c-d6whc_76a6cab1-d53b-4f40-96b1-f3d4f78e1732/metrics-server/0.log" Sep 18 08:17:03.757541 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:17:03.757525 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-xkjz5_must-gather-f2l4x_28091f62-256d-4cac-853c-593987ba91a0/copy/0.log" Sep 18 08:17:03.757940 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:17:03.757927 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xkjz5/must-gather-f2l4x" Sep 18 08:17:03.758013 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:17:03.757981 2585 scope.go:117] "RemoveContainer" containerID="90262d5b1b713c100718ac9661e65cffd7a06f0c3aad6a3b5d4a9530c79e0f4f" Sep 18 08:17:03.760127 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:17:03.760099 2585 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-f2l4x\" is forbidden: User \"system:node:ip-10-0-138-42.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-xkjz5\": no relationship found between node 'ip-10-0-138-42.ec2.internal' and this object" podUID="28091f62-256d-4cac-853c-593987ba91a0" pod="openshift-must-gather-xkjz5/must-gather-f2l4x" Sep 18 08:17:03.766039 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:17:03.766021 2585 scope.go:117] "RemoveContainer" containerID="b94a18fce98445e0b2431b9947916470ecf7e41066a157490852d977ce539504" Sep 18 08:17:03.767861 ip-10-0-138-42 kubenswrapper[2585]: E0918 08:17:03.767825 2585 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-f2l4x\" is forbidden: User \"system:node:ip-10-0-138-42.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-xkjz5\": no relationship found between node 'ip-10-0-138-42.ec2.internal' and this object" podUID="28091f62-256d-4cac-853c-593987ba91a0" pod="openshift-must-gather-xkjz5/must-gather-f2l4x" Sep 18 08:17:03.780979 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:17:03.780961 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5984459ff8-vjcz5_efb834d3-4a03-40a3-96ef-68b0af7287a6/monitoring-plugin/0.log" Sep 18 08:17:03.819662 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:17:03.819641 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-76vv5_1e301fcf-dcde-48d6-9ac9-cf2bb026c820/node-exporter/0.log" Sep 18 08:17:03.844943 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:17:03.844912 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-76vv5_1e301fcf-dcde-48d6-9ac9-cf2bb026c820/kube-rbac-proxy/0.log" Sep 18 08:17:03.874353 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:17:03.874339 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-76vv5_1e301fcf-dcde-48d6-9ac9-cf2bb026c820/init-textfile/0.log" Sep 18 08:17:03.943181 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:17:03.943135 2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="28091f62-256d-4cac-853c-593987ba91a0" path="/var/lib/kubelet/pods/28091f62-256d-4cac-853c-593987ba91a0/volumes" Sep 18 08:17:04.115190 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:17:04.115168 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-86c5bc79d6-q2zl7_2f0bb4e9-f8cc-4b04-a0f7-a2bdde20ddc8/kube-rbac-proxy-main/0.log" Sep 18 08:17:04.147109 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:17:04.147092 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-86c5bc79d6-q2zl7_2f0bb4e9-f8cc-4b04-a0f7-a2bdde20ddc8/kube-rbac-proxy-self/0.log" Sep 18 08:17:04.180322 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:17:04.180301 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-86c5bc79d6-q2zl7_2f0bb4e9-f8cc-4b04-a0f7-a2bdde20ddc8/openshift-state-metrics/0.log" Sep 18 08:17:04.251433 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:17:04.251365 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8447a4cf-f877-4d7e-b43c-210da0616a87/prometheus/0.log" Sep 18 08:17:04.274327 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:17:04.274308 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8447a4cf-f877-4d7e-b43c-210da0616a87/config-reloader/0.log" Sep 18 08:17:04.301947 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:17:04.301927 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8447a4cf-f877-4d7e-b43c-210da0616a87/thanos-sidecar/0.log" Sep 18 08:17:04.333565 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:17:04.333542 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8447a4cf-f877-4d7e-b43c-210da0616a87/kube-rbac-proxy-web/0.log" Sep 18 08:17:04.360678 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:17:04.360658 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8447a4cf-f877-4d7e-b43c-210da0616a87/kube-rbac-proxy/0.log" Sep 18 08:17:04.388856 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:17:04.388829 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8447a4cf-f877-4d7e-b43c-210da0616a87/kube-rbac-proxy-thanos/0.log" Sep 18 08:17:04.418024 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:17:04.418005 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8447a4cf-f877-4d7e-b43c-210da0616a87/init-config-reloader/0.log" Sep 18 08:17:04.452719 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:17:04.452706 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7bd5d56d6-hnjwf_b79f5fcc-eb77-43f6-b274-a22b7dbdec8c/prometheus-operator/0.log" Sep 18 08:17:04.472621 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:17:04.472605 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7bd5d56d6-hnjwf_b79f5fcc-eb77-43f6-b274-a22b7dbdec8c/kube-rbac-proxy/0.log" Sep 18 08:17:04.538070 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:17:04.538049 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-54756dd7c6-cttsm_ca34238e-3c83-49a4-8a68-99d560074356/telemeter-client/0.log" Sep 18 08:17:04.567033 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:17:04.567009 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-54756dd7c6-cttsm_ca34238e-3c83-49a4-8a68-99d560074356/reload/0.log" Sep 18 08:17:04.591353 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:17:04.591328 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-54756dd7c6-cttsm_ca34238e-3c83-49a4-8a68-99d560074356/kube-rbac-proxy/0.log" Sep 18 08:17:04.628103 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:17:04.628077 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-757bc5bcdc-4sj2l_816180ae-277e-402e-b6d3-8b3cc8ade4f2/thanos-query/0.log" Sep 18 08:17:04.651451 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:17:04.651428 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-757bc5bcdc-4sj2l_816180ae-277e-402e-b6d3-8b3cc8ade4f2/kube-rbac-proxy-web/0.log" Sep 18 08:17:04.673648 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:17:04.673629 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-757bc5bcdc-4sj2l_816180ae-277e-402e-b6d3-8b3cc8ade4f2/kube-rbac-proxy/0.log" Sep 18 08:17:04.695100 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:17:04.695079 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-757bc5bcdc-4sj2l_816180ae-277e-402e-b6d3-8b3cc8ade4f2/prom-label-proxy/0.log" Sep 18 08:17:04.718062 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:17:04.718043 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-757bc5bcdc-4sj2l_816180ae-277e-402e-b6d3-8b3cc8ade4f2/kube-rbac-proxy-rules/0.log" Sep 18 08:17:04.738819 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:17:04.738804 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-757bc5bcdc-4sj2l_816180ae-277e-402e-b6d3-8b3cc8ade4f2/kube-rbac-proxy-metrics/0.log" Sep 18 08:17:08.257514 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:17:08.257484 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-ztshj/perf-node-gather-daemonset-9z4jr"] Sep 18 08:17:08.258159 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:17:08.258136 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28091f62-256d-4cac-853c-593987ba91a0" containerName="copy" Sep 18 08:17:08.258159 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:17:08.258158 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="28091f62-256d-4cac-853c-593987ba91a0" containerName="copy" Sep 18 08:17:08.258388 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:17:08.258170 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28091f62-256d-4cac-853c-593987ba91a0" containerName="gather" Sep 18 08:17:08.258388 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:17:08.258179 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="28091f62-256d-4cac-853c-593987ba91a0" containerName="gather" Sep 18 08:17:08.258388 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:17:08.258260 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="28091f62-256d-4cac-853c-593987ba91a0" containerName="gather" Sep 18 08:17:08.258388 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:17:08.258273 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="28091f62-256d-4cac-853c-593987ba91a0" containerName="copy" Sep 18 08:17:08.260501 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:17:08.260486 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ztshj/perf-node-gather-daemonset-9z4jr" Sep 18 08:17:08.262873 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:17:08.262823 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-ztshj\"/\"openshift-service-ca.crt\"" Sep 18 08:17:08.263774 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:17:08.263761 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-ztshj\"/\"kube-root-ca.crt\"" Sep 18 08:17:08.263838 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:17:08.263764 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-ztshj\"/\"default-dockercfg-nws29\"" Sep 18 08:17:08.270188 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:17:08.270158 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ztshj/perf-node-gather-daemonset-9z4jr"] Sep 18 08:17:08.314333 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:17:08.314304 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8e2440a0-2747-4abd-a40a-cb20dbaef933-sys\") pod \"perf-node-gather-daemonset-9z4jr\" (UID: \"8e2440a0-2747-4abd-a40a-cb20dbaef933\") " pod="openshift-must-gather-ztshj/perf-node-gather-daemonset-9z4jr" Sep 18 08:17:08.314454 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:17:08.314355 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bm7pg\" (UniqueName: \"kubernetes.io/projected/8e2440a0-2747-4abd-a40a-cb20dbaef933-kube-api-access-bm7pg\") pod \"perf-node-gather-daemonset-9z4jr\" (UID: \"8e2440a0-2747-4abd-a40a-cb20dbaef933\") " pod="openshift-must-gather-ztshj/perf-node-gather-daemonset-9z4jr" Sep 18 08:17:08.314454 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:17:08.314387 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8e2440a0-2747-4abd-a40a-cb20dbaef933-lib-modules\") pod \"perf-node-gather-daemonset-9z4jr\" (UID: \"8e2440a0-2747-4abd-a40a-cb20dbaef933\") " pod="openshift-must-gather-ztshj/perf-node-gather-daemonset-9z4jr" Sep 18 08:17:08.314454 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:17:08.314437 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8e2440a0-2747-4abd-a40a-cb20dbaef933-podres\") pod \"perf-node-gather-daemonset-9z4jr\" (UID: \"8e2440a0-2747-4abd-a40a-cb20dbaef933\") " pod="openshift-must-gather-ztshj/perf-node-gather-daemonset-9z4jr" Sep 18 08:17:08.314601 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:17:08.314487 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8e2440a0-2747-4abd-a40a-cb20dbaef933-proc\") pod \"perf-node-gather-daemonset-9z4jr\" (UID: \"8e2440a0-2747-4abd-a40a-cb20dbaef933\") " pod="openshift-must-gather-ztshj/perf-node-gather-daemonset-9z4jr" Sep 18 08:17:08.415135 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:17:08.415103 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8e2440a0-2747-4abd-a40a-cb20dbaef933-podres\") pod \"perf-node-gather-daemonset-9z4jr\" (UID: \"8e2440a0-2747-4abd-a40a-cb20dbaef933\") " pod="openshift-must-gather-ztshj/perf-node-gather-daemonset-9z4jr" Sep 18 08:17:08.415301 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:17:08.415142 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8e2440a0-2747-4abd-a40a-cb20dbaef933-proc\") pod \"perf-node-gather-daemonset-9z4jr\" (UID: \"8e2440a0-2747-4abd-a40a-cb20dbaef933\") " pod="openshift-must-gather-ztshj/perf-node-gather-daemonset-9z4jr" Sep 18 08:17:08.415301 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:17:08.415199 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8e2440a0-2747-4abd-a40a-cb20dbaef933-sys\") pod \"perf-node-gather-daemonset-9z4jr\" (UID: \"8e2440a0-2747-4abd-a40a-cb20dbaef933\") " pod="openshift-must-gather-ztshj/perf-node-gather-daemonset-9z4jr" Sep 18 08:17:08.415301 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:17:08.415240 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bm7pg\" (UniqueName: \"kubernetes.io/projected/8e2440a0-2747-4abd-a40a-cb20dbaef933-kube-api-access-bm7pg\") pod \"perf-node-gather-daemonset-9z4jr\" (UID: \"8e2440a0-2747-4abd-a40a-cb20dbaef933\") " pod="openshift-must-gather-ztshj/perf-node-gather-daemonset-9z4jr" Sep 18 08:17:08.415301 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:17:08.415286 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8e2440a0-2747-4abd-a40a-cb20dbaef933-podres\") pod \"perf-node-gather-daemonset-9z4jr\" (UID: \"8e2440a0-2747-4abd-a40a-cb20dbaef933\") " pod="openshift-must-gather-ztshj/perf-node-gather-daemonset-9z4jr" Sep 18 08:17:08.415457 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:17:08.415307 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8e2440a0-2747-4abd-a40a-cb20dbaef933-lib-modules\") pod \"perf-node-gather-daemonset-9z4jr\" (UID: \"8e2440a0-2747-4abd-a40a-cb20dbaef933\") " pod="openshift-must-gather-ztshj/perf-node-gather-daemonset-9z4jr" Sep 18 08:17:08.415457 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:17:08.415314 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8e2440a0-2747-4abd-a40a-cb20dbaef933-proc\") pod \"perf-node-gather-daemonset-9z4jr\" (UID: \"8e2440a0-2747-4abd-a40a-cb20dbaef933\") " pod="openshift-must-gather-ztshj/perf-node-gather-daemonset-9z4jr" Sep 18 08:17:08.415457 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:17:08.415314 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8e2440a0-2747-4abd-a40a-cb20dbaef933-sys\") pod \"perf-node-gather-daemonset-9z4jr\" (UID: \"8e2440a0-2747-4abd-a40a-cb20dbaef933\") " pod="openshift-must-gather-ztshj/perf-node-gather-daemonset-9z4jr" Sep 18 08:17:08.415457 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:17:08.415393 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8e2440a0-2747-4abd-a40a-cb20dbaef933-lib-modules\") pod \"perf-node-gather-daemonset-9z4jr\" (UID: \"8e2440a0-2747-4abd-a40a-cb20dbaef933\") " pod="openshift-must-gather-ztshj/perf-node-gather-daemonset-9z4jr" Sep 18 08:17:08.423502 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:17:08.423479 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bm7pg\" (UniqueName: \"kubernetes.io/projected/8e2440a0-2747-4abd-a40a-cb20dbaef933-kube-api-access-bm7pg\") pod \"perf-node-gather-daemonset-9z4jr\" (UID: \"8e2440a0-2747-4abd-a40a-cb20dbaef933\") " pod="openshift-must-gather-ztshj/perf-node-gather-daemonset-9z4jr" Sep 18 08:17:08.570807 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:17:08.570777 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ztshj/perf-node-gather-daemonset-9z4jr" Sep 18 08:17:08.749046 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:17:08.749012 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-sgft8_9089de9c-a355-499b-9cd1-60bad78ef458/dns/0.log" Sep 18 08:17:08.809944 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:17:08.809918 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-sgft8_9089de9c-a355-499b-9cd1-60bad78ef458/kube-rbac-proxy/0.log" Sep 18 08:17:08.856398 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:17:08.856371 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ztshj/perf-node-gather-daemonset-9z4jr"] Sep 18 08:17:08.858541 ip-10-0-138-42 kubenswrapper[2585]: W0918 08:17:08.858512 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod8e2440a0_2747_4abd_a40a_cb20dbaef933.slice/crio-020457530e02cb5f2d38ea92324b805f56493aa7bad4668cf4f68e488e54cce0 WatchSource:0}: Error finding container 020457530e02cb5f2d38ea92324b805f56493aa7bad4668cf4f68e488e54cce0: Status 404 returned error can't find the container with id 020457530e02cb5f2d38ea92324b805f56493aa7bad4668cf4f68e488e54cce0 Sep 18 08:17:09.020235 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:17:09.020209 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-jh2mg_459b617e-1505-4bf6-9ee4-23d57ea13ddb/dns-node-resolver/0.log" Sep 18 08:17:09.489134 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:17:09.489108 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-nb4q9_3f760b01-3480-42e1-989d-4b35132437aa/node-ca/0.log" Sep 18 08:17:09.786967 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:17:09.786935 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ztshj/perf-node-gather-daemonset-9z4jr" event={"ID":"8e2440a0-2747-4abd-a40a-cb20dbaef933","Type":"ContainerStarted","Data":"f6e441f99494085195b881105e67a5d1c84e6884b36fe2d5e3b88bb6b5832625"} Sep 18 08:17:09.787130 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:17:09.786991 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ztshj/perf-node-gather-daemonset-9z4jr" event={"ID":"8e2440a0-2747-4abd-a40a-cb20dbaef933","Type":"ContainerStarted","Data":"020457530e02cb5f2d38ea92324b805f56493aa7bad4668cf4f68e488e54cce0"} Sep 18 08:17:09.787130 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:17:09.787021 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-ztshj/perf-node-gather-daemonset-9z4jr" Sep 18 08:17:09.802831 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:17:09.802788 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-ztshj/perf-node-gather-daemonset-9z4jr" podStartSLOduration=1.802775341 podStartE2EDuration="1.802775341s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 08:17:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 08:17:09.802118894 +0000 UTC m=+602.071818823" watchObservedRunningTime="2026-09-18 08:17:09.802775341 +0000 UTC m=+602.072475269" Sep 18 08:17:09.897300 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:17:09.897277 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9kn9p_a56b7fed-7af6-4ed5-962d-9bd3f342cd2b/ovn-acl-logging/0.log" Sep 18 08:17:09.900144 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:17:09.900121 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9kn9p_a56b7fed-7af6-4ed5-962d-9bd3f342cd2b/ovn-acl-logging/0.log" Sep 18 08:17:10.526919 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:17:10.526891 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-zb5n2_34060a52-4e15-44ce-9044-143f8be28571/serve-healthcheck-canary/0.log" Sep 18 08:17:10.971335 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:17:10.971252 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-dp9kd_694f168d-57b8-4c0b-bf70-a0b8efb05306/kube-rbac-proxy/0.log" Sep 18 08:17:10.990891 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:17:10.990863 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-dp9kd_694f168d-57b8-4c0b-bf70-a0b8efb05306/exporter/0.log" Sep 18 08:17:11.010028 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:17:11.010009 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-dp9kd_694f168d-57b8-4c0b-bf70-a0b8efb05306/extractor/0.log" Sep 18 08:17:12.727168 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:17:12.727138 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-jobset-operator_jobset-operator-5bc45f897-q4t2t_cc2ebbcb-a43a-4d9f-9734-0dd5e8befbb6/jobset-operator/0.log" Sep 18 08:17:15.801407 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:17:15.801371 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-ztshj/perf-node-gather-daemonset-9z4jr" Sep 18 08:17:17.194386 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:17:17.194316 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dn4s9_c0aaaa41-bdef-4c6a-a828-18de65269b1a/kube-multus-additional-cni-plugins/0.log" Sep 18 08:17:17.224930 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:17:17.224906 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dn4s9_c0aaaa41-bdef-4c6a-a828-18de65269b1a/egress-router-binary-copy/0.log" Sep 18 08:17:17.250527 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:17:17.250500 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dn4s9_c0aaaa41-bdef-4c6a-a828-18de65269b1a/cni-plugins/0.log" Sep 18 08:17:17.277705 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:17:17.277681 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dn4s9_c0aaaa41-bdef-4c6a-a828-18de65269b1a/bond-cni-plugin/0.log" Sep 18 08:17:17.316312 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:17:17.316291 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dn4s9_c0aaaa41-bdef-4c6a-a828-18de65269b1a/routeoverride-cni/0.log" Sep 18 08:17:17.344747 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:17:17.344719 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dn4s9_c0aaaa41-bdef-4c6a-a828-18de65269b1a/whereabouts-cni-bincopy/0.log" Sep 18 08:17:17.373614 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:17:17.373593 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dn4s9_c0aaaa41-bdef-4c6a-a828-18de65269b1a/whereabouts-cni/0.log" Sep 18 08:17:17.780244 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:17:17.780218 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-gjb6q_9ffad063-9ddb-4986-ab43-8931a4288d24/kube-multus/0.log" Sep 18 08:17:17.837806 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:17:17.837723 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-9vz5k_b6e0d1e7-a182-4ac0-a484-f174f64ca021/network-metrics-daemon/0.log" Sep 18 08:17:17.863566 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:17:17.863540 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-9vz5k_b6e0d1e7-a182-4ac0-a484-f174f64ca021/kube-rbac-proxy/0.log" Sep 18 08:17:19.012215 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:17:19.012185 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9kn9p_a56b7fed-7af6-4ed5-962d-9bd3f342cd2b/ovn-controller/0.log" Sep 18 08:17:19.047052 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:17:19.047030 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9kn9p_a56b7fed-7af6-4ed5-962d-9bd3f342cd2b/ovn-acl-logging/0.log" Sep 18 08:17:19.050489 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:17:19.050435 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9kn9p_a56b7fed-7af6-4ed5-962d-9bd3f342cd2b/ovn-acl-logging/1.log" Sep 18 08:17:19.087132 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:17:19.087115 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9kn9p_a56b7fed-7af6-4ed5-962d-9bd3f342cd2b/kube-rbac-proxy-node/0.log" Sep 18 08:17:19.117071 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:17:19.117053 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9kn9p_a56b7fed-7af6-4ed5-962d-9bd3f342cd2b/kube-rbac-proxy-ovn-metrics/0.log" Sep 18 08:17:19.144821 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:17:19.144804 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9kn9p_a56b7fed-7af6-4ed5-962d-9bd3f342cd2b/northd/0.log" Sep 18 08:17:19.179885 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:17:19.179863 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9kn9p_a56b7fed-7af6-4ed5-962d-9bd3f342cd2b/nbdb/0.log" Sep 18 08:17:19.211975 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:17:19.211938 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9kn9p_a56b7fed-7af6-4ed5-962d-9bd3f342cd2b/sbdb/0.log" Sep 18 08:17:19.278628 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:17:19.278611 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9kn9p_a56b7fed-7af6-4ed5-962d-9bd3f342cd2b/ovnkube-controller/0.log" Sep 18 08:17:20.649459 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:17:20.649430 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-qmmgl_97cadd54-3234-4e3f-a2bf-c96b134566b1/network-check-target-container/0.log" Sep 18 08:17:21.643868 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:17:21.643829 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-wzhkw_3a7d7351-f419-4f97-a1fe-a490512e47ab/iptables-alerter/0.log" Sep 18 08:17:22.328095 ip-10-0-138-42 kubenswrapper[2585]: I0918 08:17:22.328049 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-hsz4j_977770b5-c53e-4c76-8946-e76d0663f9fb/tuned/0.log"