Jul 27 12:20:35.819910 ip-10-0-141-3 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 27 12:20:35.820154 ip-10-0-141-3 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 27 12:20:35.820173 ip-10-0-141-3 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 27 12:20:35.820486 ip-10-0-141-3 systemd[1]: Failed to start Kubernetes Kubelet. Jul 27 12:20:46.005857 ip-10-0-141-3 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 27 12:20:46.005876 ip-10-0-141-3 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot d5ac521b2b8c466a972c4dd5d35e85ac -- Jul 27 12:22:44.422843 ip-10-0-141-3 systemd[1]: Starting Kubernetes Kubelet... Jul 27 12:22:44.804899 ip-10-0-141-3 kubenswrapper[2568]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 27 12:22:44.804899 ip-10-0-141-3 kubenswrapper[2568]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 27 12:22:44.804899 ip-10-0-141-3 kubenswrapper[2568]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 27 12:22:44.804899 ip-10-0-141-3 kubenswrapper[2568]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 27 12:22:44.804899 ip-10-0-141-3 kubenswrapper[2568]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 27 12:22:44.805633 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.804958 2568 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 27 12:22:44.810016 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.809999 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 27 12:22:44.810016 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.810016 2568 feature_gate.go:328] unrecognized feature gate: Example Jul 27 12:22:44.810087 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.810020 2568 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 27 12:22:44.810087 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.810023 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 27 12:22:44.810087 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.810027 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 27 12:22:44.810087 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.810030 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 27 12:22:44.810087 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.810033 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 27 12:22:44.810087 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.810035 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 27 12:22:44.810087 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.810038 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 27 12:22:44.810087 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.810041 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 27 12:22:44.810087 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.810044 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 27 12:22:44.810087 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.810046 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 27 12:22:44.810087 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.810049 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 27 12:22:44.810087 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.810052 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 27 12:22:44.810087 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.810054 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 27 12:22:44.810087 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.810057 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 27 12:22:44.810087 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.810059 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 27 12:22:44.810087 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.810062 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 27 12:22:44.810087 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.810064 2568 feature_gate.go:328] unrecognized feature gate: Example2 Jul 27 12:22:44.810087 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.810067 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 27 12:22:44.810087 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.810075 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 27 12:22:44.810087 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.810077 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 27 12:22:44.810581 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.810080 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 27 12:22:44.810581 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.810082 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 27 12:22:44.810581 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.810085 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 27 12:22:44.810581 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.810088 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 27 12:22:44.810581 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.810090 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 27 12:22:44.810581 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.810093 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 27 12:22:44.810581 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.810096 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 27 12:22:44.810581 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.810099 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 27 12:22:44.810581 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.810102 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 27 12:22:44.810581 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.810104 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 27 12:22:44.810581 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.810107 2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 27 12:22:44.810581 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.810110 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 27 12:22:44.810581 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.810112 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 27 12:22:44.810581 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.810115 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 27 12:22:44.810581 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.810117 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 27 12:22:44.810581 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.810119 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 27 12:22:44.810581 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.810122 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 27 12:22:44.810581 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.810125 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 27 12:22:44.810581 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.810127 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 27 12:22:44.810581 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.810131 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 27 12:22:44.811108 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.810133 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 27 12:22:44.811108 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.810135 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 27 12:22:44.811108 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.810138 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 27 12:22:44.811108 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.810140 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 27 12:22:44.811108 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.810143 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 27 12:22:44.811108 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.810146 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 27 12:22:44.811108 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.810149 2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 27 12:22:44.811108 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.810151 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 27 12:22:44.811108 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.810155 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 27 12:22:44.811108 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.810157 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 27 12:22:44.811108 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.810160 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 27 12:22:44.811108 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.810162 2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 27 12:22:44.811108 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.810165 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 27 12:22:44.811108 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.810168 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 27 12:22:44.811108 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.810170 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 27 12:22:44.811108 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.810173 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 27 12:22:44.811108 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.810175 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 27 12:22:44.811108 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.810178 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 27 12:22:44.811108 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.810180 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 27 12:22:44.811108 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.810183 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 27 12:22:44.811604 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.810185 2568 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 27 12:22:44.811604 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.810188 2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 27 12:22:44.811604 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.810190 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 27 12:22:44.811604 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.810194 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 27 12:22:44.811604 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.810198 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 27 12:22:44.811604 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.810201 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 27 12:22:44.811604 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.810203 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 27 12:22:44.811604 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.810206 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 27 12:22:44.811604 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.810208 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 27 12:22:44.811604 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.810211 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 27 12:22:44.811604 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.810215 2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 27 12:22:44.811604 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.810219 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 27 12:22:44.811604 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.810223 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 27 12:22:44.811604 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.810226 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 27 12:22:44.811604 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.810229 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 27 12:22:44.811604 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.810232 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 27 12:22:44.811604 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.810234 2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 27 12:22:44.811604 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.810238 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 27 12:22:44.811604 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.810241 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 27 12:22:44.812063 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.810244 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 27 12:22:44.812063 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.810247 2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 27 12:22:44.812063 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.810250 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 27 12:22:44.812063 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.810252 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 27 12:22:44.812063 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.810255 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 27 12:22:44.812063 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.810259 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 27 12:22:44.812063 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.810263 2568 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 27 12:22:44.812063 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.810266 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 27 12:22:44.812063 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.810269 2568 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 27 12:22:44.812063 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.810272 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 27 12:22:44.812063 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.810275 2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 27 12:22:44.812063 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.810278 2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 27 12:22:44.812063 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.810280 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 27 12:22:44.812063 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.810283 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 27 12:22:44.812063 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.810286 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 27 12:22:44.812063 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.810288 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 27 12:22:44.812063 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.810291 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 27 12:22:44.812063 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.810294 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 27 12:22:44.812063 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.810999 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 27 12:22:44.812549 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811005 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 27 12:22:44.812549 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811008 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 27 12:22:44.812549 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811011 2568 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 27 12:22:44.812549 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811014 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 27 12:22:44.812549 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811018 2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 27 12:22:44.812549 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811020 2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 27 12:22:44.812549 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811023 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 27 12:22:44.812549 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811026 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 27 12:22:44.812549 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811028 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 27 12:22:44.812549 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811031 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 27 12:22:44.812549 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811034 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 27 12:22:44.812549 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811037 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 27 12:22:44.812549 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811039 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 27 12:22:44.812549 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811042 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 27 12:22:44.812549 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811045 2568 feature_gate.go:328] unrecognized feature gate: Example2 Jul 27 12:22:44.812549 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811047 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 27 12:22:44.812549 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811050 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 27 12:22:44.812549 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811052 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 27 12:22:44.812549 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811055 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 27 12:22:44.812549 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811058 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 27 12:22:44.813051 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811061 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 27 12:22:44.813051 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811064 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 27 12:22:44.813051 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811067 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 27 12:22:44.813051 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811069 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 27 12:22:44.813051 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811072 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 27 12:22:44.813051 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811075 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 27 12:22:44.813051 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811077 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 27 12:22:44.813051 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811080 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 27 12:22:44.813051 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811083 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 27 12:22:44.813051 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811085 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 27 12:22:44.813051 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811087 2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 27 12:22:44.813051 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811090 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 27 12:22:44.813051 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811093 2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 27 12:22:44.813051 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811095 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 27 12:22:44.813051 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811098 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 27 12:22:44.813051 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811100 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 27 12:22:44.813051 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811103 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 27 12:22:44.813051 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811106 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 27 12:22:44.813051 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811109 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 27 12:22:44.813508 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811111 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 27 12:22:44.813508 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811114 2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 27 12:22:44.813508 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811117 2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 27 12:22:44.813508 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811120 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 27 12:22:44.813508 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811123 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 27 12:22:44.813508 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811126 2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 27 12:22:44.813508 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811129 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 27 12:22:44.813508 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811131 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 27 12:22:44.813508 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811134 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 27 12:22:44.813508 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811136 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 27 12:22:44.813508 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811140 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 27 12:22:44.813508 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811143 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 27 12:22:44.813508 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811146 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 27 12:22:44.813508 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811148 2568 feature_gate.go:328] unrecognized feature gate: Example Jul 27 12:22:44.813508 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811151 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 27 12:22:44.813508 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811154 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 27 12:22:44.813508 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811156 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 27 12:22:44.813508 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811159 2568 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 27 12:22:44.813508 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811161 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 27 12:22:44.813508 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811164 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 27 12:22:44.814034 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811166 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 27 12:22:44.814034 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811169 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 27 12:22:44.814034 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811171 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 27 12:22:44.814034 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811174 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 27 12:22:44.814034 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811176 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 27 12:22:44.814034 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811179 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 27 12:22:44.814034 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811182 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 27 12:22:44.814034 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811185 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 27 12:22:44.814034 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811187 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 27 12:22:44.814034 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811190 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 27 12:22:44.814034 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811192 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 27 12:22:44.814034 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811195 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 27 12:22:44.814034 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811198 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 27 12:22:44.814034 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811201 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 27 12:22:44.814034 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811205 2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 27 12:22:44.814034 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811208 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 27 12:22:44.814034 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811212 2568 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 27 12:22:44.814034 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811215 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 27 12:22:44.814034 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811218 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 27 12:22:44.814034 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811221 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 27 12:22:44.814508 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811223 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 27 12:22:44.814508 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811227 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 27 12:22:44.814508 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811230 2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 27 12:22:44.814508 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811232 2568 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 27 12:22:44.814508 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811235 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 27 12:22:44.814508 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811238 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 27 12:22:44.814508 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811240 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 27 12:22:44.814508 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811243 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 27 12:22:44.814508 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811246 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 27 12:22:44.814508 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811248 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 27 12:22:44.814508 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811251 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 27 12:22:44.814508 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811253 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 27 12:22:44.814508 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811258 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 27 12:22:44.814508 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811261 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 27 12:22:44.814508 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811264 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 27 12:22:44.814508 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811268 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 27 12:22:44.814508 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811271 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 27 12:22:44.814508 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811274 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 27 12:22:44.814508 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811277 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 27 12:22:44.814987 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811649 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 27 12:22:44.814987 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811654 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 27 12:22:44.814987 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811657 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 27 12:22:44.814987 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811660 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 27 12:22:44.814987 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811663 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 27 12:22:44.814987 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811666 2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 27 12:22:44.814987 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811669 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 27 12:22:44.814987 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811671 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 27 12:22:44.814987 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811674 2568 feature_gate.go:328] unrecognized feature gate: Example2 Jul 27 12:22:44.814987 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811677 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 27 12:22:44.814987 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811680 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 27 12:22:44.814987 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811682 2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 27 12:22:44.814987 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811685 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 27 12:22:44.814987 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811687 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 27 12:22:44.814987 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811690 2568 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 27 12:22:44.814987 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811692 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 27 12:22:44.814987 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811696 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 27 12:22:44.814987 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811699 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 27 12:22:44.814987 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811701 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 27 12:22:44.814987 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811704 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 27 12:22:44.815471 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811707 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 27 12:22:44.815471 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811710 2568 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 27 12:22:44.815471 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811712 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 27 12:22:44.815471 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811715 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 27 12:22:44.815471 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811717 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 27 12:22:44.815471 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811719 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 27 12:22:44.815471 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811722 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 27 12:22:44.815471 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811724 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 27 12:22:44.815471 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811727 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 27 12:22:44.815471 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811730 2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 27 12:22:44.815471 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811732 2568 feature_gate.go:328] unrecognized feature gate: Example Jul 27 12:22:44.815471 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811735 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 27 12:22:44.815471 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811737 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 27 12:22:44.815471 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811740 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 27 12:22:44.815471 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811742 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 27 12:22:44.815471 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811745 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 27 12:22:44.815471 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811747 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 27 12:22:44.815471 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811750 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 27 12:22:44.815471 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811753 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 27 12:22:44.815471 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811756 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 27 12:22:44.815976 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811759 2568 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 27 12:22:44.815976 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811762 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 27 12:22:44.815976 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811764 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 27 12:22:44.815976 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811767 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 27 12:22:44.815976 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811769 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 27 12:22:44.815976 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811772 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 27 12:22:44.815976 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811775 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 27 12:22:44.815976 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811778 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 27 12:22:44.815976 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811782 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 27 12:22:44.815976 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811785 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 27 12:22:44.815976 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811788 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 27 12:22:44.815976 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811790 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 27 12:22:44.815976 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811793 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 27 12:22:44.815976 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811796 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 27 12:22:44.815976 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811799 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 27 12:22:44.815976 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811801 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 27 12:22:44.815976 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811804 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 27 12:22:44.815976 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811806 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 27 12:22:44.815976 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811809 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 27 12:22:44.815976 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811812 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 27 12:22:44.816474 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811814 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 27 12:22:44.816474 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811816 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 27 12:22:44.816474 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811819 2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 27 12:22:44.816474 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811822 2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 27 12:22:44.816474 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811824 2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 27 12:22:44.816474 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811827 2568 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 27 12:22:44.816474 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811829 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 27 12:22:44.816474 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811832 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 27 12:22:44.816474 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811834 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 27 12:22:44.816474 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811837 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 27 12:22:44.816474 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811860 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 27 12:22:44.816474 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811863 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 27 12:22:44.816474 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811866 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 27 12:22:44.816474 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811869 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 27 12:22:44.816474 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811872 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 27 12:22:44.816474 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811874 2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 27 12:22:44.816474 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811878 2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 27 12:22:44.816474 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811882 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 27 12:22:44.816474 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811885 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 27 12:22:44.816474 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811888 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 27 12:22:44.816961 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811892 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 27 12:22:44.816961 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811896 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 27 12:22:44.816961 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811899 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 27 12:22:44.816961 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811902 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 27 12:22:44.816961 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811905 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 27 12:22:44.816961 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811908 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 27 12:22:44.816961 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811911 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 27 12:22:44.816961 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811914 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 27 12:22:44.816961 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811917 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 27 12:22:44.816961 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811919 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 27 12:22:44.816961 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811922 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 27 12:22:44.816961 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811924 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 27 12:22:44.816961 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811927 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 27 12:22:44.816961 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811930 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 27 12:22:44.816961 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811932 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 27 12:22:44.816961 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811935 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 27 12:22:44.816961 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811937 2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 27 12:22:44.816961 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811940 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 27 12:22:44.816961 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.811942 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 27 12:22:44.817415 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.812014 2568 flags.go:64] FLAG: --address="0.0.0.0" Jul 27 12:22:44.817415 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.812021 2568 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 27 12:22:44.817415 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.812027 2568 flags.go:64] FLAG: --anonymous-auth="true" Jul 27 12:22:44.817415 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.812032 2568 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 27 12:22:44.817415 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.812037 2568 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 27 12:22:44.817415 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.812046 2568 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 27 12:22:44.817415 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.812050 2568 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 27 12:22:44.817415 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.812055 2568 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 27 12:22:44.817415 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.812058 2568 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 27 12:22:44.817415 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.812061 2568 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 27 12:22:44.817415 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.812064 2568 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 27 12:22:44.817415 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.812068 2568 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 27 12:22:44.817415 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.812074 2568 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 27 12:22:44.817415 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.812077 2568 flags.go:64] FLAG: --cgroup-root="" Jul 27 12:22:44.817415 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.812080 2568 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 27 12:22:44.817415 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.812083 2568 flags.go:64] FLAG: --client-ca-file="" Jul 27 12:22:44.817415 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.812086 2568 flags.go:64] FLAG: --cloud-provider="external" Jul 27 12:22:44.817415 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.812089 2568 flags.go:64] FLAG: --cluster-dns="[]" Jul 27 12:22:44.817415 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.812093 2568 flags.go:64] FLAG: --cluster-domain="" Jul 27 12:22:44.817415 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.812096 2568 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 27 12:22:44.817415 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.812099 2568 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 27 12:22:44.817415 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.812102 2568 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 27 12:22:44.817415 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.812106 2568 flags.go:64] FLAG: --container-log-max-files="5" Jul 27 12:22:44.817415 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.812109 2568 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 27 12:22:44.817993 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.812112 2568 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 27 12:22:44.817993 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.812115 2568 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 27 12:22:44.817993 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.812119 2568 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 27 12:22:44.817993 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.812122 2568 flags.go:64] FLAG: --contention-profiling="false" Jul 27 12:22:44.817993 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.812125 2568 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 27 12:22:44.817993 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.812128 2568 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 27 12:22:44.817993 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.812131 2568 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 27 12:22:44.817993 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.812134 2568 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 27 12:22:44.817993 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.812138 2568 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 27 12:22:44.817993 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.812141 2568 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 27 12:22:44.817993 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.812144 2568 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 27 12:22:44.817993 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.812147 2568 flags.go:64] FLAG: --enable-load-reader="false" Jul 27 12:22:44.817993 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.812150 2568 flags.go:64] FLAG: --enable-server="true" Jul 27 12:22:44.817993 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.812155 2568 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 27 12:22:44.817993 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.812160 2568 flags.go:64] FLAG: --event-burst="100" Jul 27 12:22:44.817993 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.812163 2568 flags.go:64] FLAG: --event-qps="50" Jul 27 12:22:44.817993 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.812166 2568 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 27 12:22:44.817993 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.812169 2568 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 27 12:22:44.817993 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.812172 2568 flags.go:64] FLAG: --eviction-hard="" Jul 27 12:22:44.817993 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.812175 2568 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 27 12:22:44.817993 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.812179 2568 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 27 12:22:44.817993 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.812182 2568 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 27 12:22:44.817993 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.812185 2568 flags.go:64] FLAG: --eviction-soft="" Jul 27 12:22:44.817993 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.812189 2568 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 27 12:22:44.817993 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.812191 2568 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 27 12:22:44.818610 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.812194 2568 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 27 12:22:44.818610 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.812197 2568 flags.go:64] FLAG: --experimental-mounter-path="" Jul 27 12:22:44.818610 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.812200 2568 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 27 12:22:44.818610 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.812203 2568 flags.go:64] FLAG: --fail-swap-on="true" Jul 27 12:22:44.818610 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.812206 2568 flags.go:64] FLAG: --feature-gates="" Jul 27 12:22:44.818610 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.812209 2568 flags.go:64] FLAG: --file-check-frequency="20s" Jul 27 12:22:44.818610 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.812213 2568 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 27 12:22:44.818610 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.812237 2568 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 27 12:22:44.818610 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.812242 2568 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 27 12:22:44.818610 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.812246 2568 flags.go:64] FLAG: --healthz-port="10248" Jul 27 12:22:44.818610 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.812249 2568 flags.go:64] FLAG: --help="false" Jul 27 12:22:44.818610 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.812252 2568 flags.go:64] FLAG: --hostname-override="ip-10-0-141-3.ec2.internal" Jul 27 12:22:44.818610 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.812256 2568 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 27 12:22:44.818610 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.812259 2568 flags.go:64] FLAG: --http-check-frequency="20s" Jul 27 12:22:44.818610 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.812262 2568 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 27 12:22:44.818610 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.812266 2568 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 27 12:22:44.818610 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.812269 2568 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 27 12:22:44.818610 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.812272 2568 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 27 12:22:44.818610 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.812275 2568 flags.go:64] FLAG: --image-service-endpoint="" Jul 27 12:22:44.818610 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.812277 2568 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 27 12:22:44.818610 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.812282 2568 flags.go:64] FLAG: --kube-api-burst="100" Jul 27 12:22:44.818610 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.812285 2568 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 27 12:22:44.818610 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.812289 2568 flags.go:64] FLAG: --kube-api-qps="50" Jul 27 12:22:44.818610 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.812291 2568 flags.go:64] FLAG: --kube-reserved="" Jul 27 12:22:44.819422 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.812294 2568 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 27 12:22:44.819422 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.812297 2568 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 27 12:22:44.819422 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.812300 2568 flags.go:64] FLAG: --kubelet-cgroups="" Jul 27 12:22:44.819422 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.812304 2568 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 27 12:22:44.819422 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.812307 2568 flags.go:64] FLAG: --lock-file="" Jul 27 12:22:44.819422 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.812310 2568 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 27 12:22:44.819422 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.812313 2568 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 27 12:22:44.819422 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.812316 2568 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 27 12:22:44.819422 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.812321 2568 flags.go:64] FLAG: --log-json-split-stream="false" Jul 27 12:22:44.819422 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.812324 2568 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 27 12:22:44.819422 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.812327 2568 flags.go:64] FLAG: --log-text-split-stream="false" Jul 27 12:22:44.819422 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.812330 2568 flags.go:64] FLAG: --logging-format="text" Jul 27 12:22:44.819422 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.812333 2568 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 27 12:22:44.819422 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.812336 2568 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 27 12:22:44.819422 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.812339 2568 flags.go:64] FLAG: --manifest-url="" Jul 27 12:22:44.819422 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.812342 2568 flags.go:64] FLAG: --manifest-url-header="" Jul 27 12:22:44.819422 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.812346 2568 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 27 12:22:44.819422 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.812349 2568 flags.go:64] FLAG: --max-open-files="1000000" Jul 27 12:22:44.819422 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.812353 2568 flags.go:64] FLAG: --max-pods="110" Jul 27 12:22:44.819422 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.812356 2568 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 27 12:22:44.819422 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.812360 2568 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 27 12:22:44.819422 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.812363 2568 flags.go:64] FLAG: --memory-manager-policy="None" Jul 27 12:22:44.819422 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.812366 2568 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 27 12:22:44.819422 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.812369 2568 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 27 12:22:44.819422 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.812371 2568 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 27 12:22:44.820550 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.812375 2568 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 27 12:22:44.820550 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.812382 2568 flags.go:64] FLAG: --node-status-max-images="50" Jul 27 12:22:44.820550 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.812384 2568 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 27 12:22:44.820550 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.812389 2568 flags.go:64] FLAG: --oom-score-adj="-999" Jul 27 12:22:44.820550 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.812392 2568 flags.go:64] FLAG: --pod-cidr="" Jul 27 12:22:44.820550 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.812396 2568 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb" Jul 27 12:22:44.820550 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.812402 2568 flags.go:64] FLAG: --pod-manifest-path="" Jul 27 12:22:44.820550 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.812405 2568 flags.go:64] FLAG: --pod-max-pids="-1" Jul 27 12:22:44.820550 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.812408 2568 flags.go:64] FLAG: --pods-per-core="0" Jul 27 12:22:44.820550 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.812411 2568 flags.go:64] FLAG: --port="10250" Jul 27 12:22:44.820550 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.812414 2568 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 27 12:22:44.820550 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.812419 2568 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-070bb074cfc34d694" Jul 27 12:22:44.820550 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.812422 2568 flags.go:64] FLAG: --qos-reserved="" Jul 27 12:22:44.820550 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.812425 2568 flags.go:64] FLAG: --read-only-port="10255" Jul 27 12:22:44.820550 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.812428 2568 flags.go:64] FLAG: --register-node="true" Jul 27 12:22:44.820550 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.812431 2568 flags.go:64] FLAG: --register-with-taints="" Jul 27 12:22:44.820550 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.812441 2568 flags.go:64] FLAG: --registry-burst="10" Jul 27 12:22:44.820550 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.812444 2568 flags.go:64] FLAG: --registry-qps="5" Jul 27 12:22:44.820550 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.812447 2568 flags.go:64] FLAG: --reserved-cpus="" Jul 27 12:22:44.820550 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.812450 2568 flags.go:64] FLAG: --reserved-memory="" Jul 27 12:22:44.820550 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.812453 2568 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 27 12:22:44.820550 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.812457 2568 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 27 12:22:44.820550 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.812460 2568 flags.go:64] FLAG: --rotate-certificates="false" Jul 27 12:22:44.820550 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.812463 2568 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 27 12:22:44.820550 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.812466 2568 flags.go:64] FLAG: --runonce="false" Jul 27 12:22:44.821675 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.812469 2568 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 27 12:22:44.821675 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.812472 2568 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 27 12:22:44.821675 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.812475 2568 flags.go:64] FLAG: --seccomp-default="false" Jul 27 12:22:44.821675 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.812478 2568 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 27 12:22:44.821675 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.812481 2568 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 27 12:22:44.821675 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.812484 2568 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 27 12:22:44.821675 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.812487 2568 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 27 12:22:44.821675 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.812490 2568 flags.go:64] FLAG: --storage-driver-password="root" Jul 27 12:22:44.821675 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.812493 2568 flags.go:64] FLAG: --storage-driver-secure="false" Jul 27 12:22:44.821675 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.812496 2568 flags.go:64] FLAG: --storage-driver-table="stats" Jul 27 12:22:44.821675 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.812500 2568 flags.go:64] FLAG: --storage-driver-user="root" Jul 27 12:22:44.821675 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.812503 2568 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 27 12:22:44.821675 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.812506 2568 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 27 12:22:44.821675 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.812510 2568 flags.go:64] FLAG: --system-cgroups="" Jul 27 12:22:44.821675 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.812513 2568 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 27 12:22:44.821675 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.812518 2568 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 27 12:22:44.821675 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.812521 2568 flags.go:64] FLAG: --tls-cert-file="" Jul 27 12:22:44.821675 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.812524 2568 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 27 12:22:44.821675 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.812543 2568 flags.go:64] FLAG: --tls-min-version="" Jul 27 12:22:44.821675 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.812546 2568 flags.go:64] FLAG: --tls-private-key-file="" Jul 27 12:22:44.821675 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.812554 2568 flags.go:64] FLAG: --topology-manager-policy="none" Jul 27 12:22:44.821675 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.812557 2568 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 27 12:22:44.821675 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.812560 2568 flags.go:64] FLAG: --topology-manager-scope="container" Jul 27 12:22:44.821675 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.812563 2568 flags.go:64] FLAG: --v="2" Jul 27 12:22:44.821675 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.812568 2568 flags.go:64] FLAG: --version="false" Jul 27 12:22:44.822877 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.812575 2568 flags.go:64] FLAG: --vmodule="" Jul 27 12:22:44.822877 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.812579 2568 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 27 12:22:44.822877 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.812582 2568 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 27 12:22:44.822877 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.812698 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 27 12:22:44.822877 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.812702 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 27 12:22:44.822877 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.812705 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 27 12:22:44.822877 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.812708 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 27 12:22:44.822877 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.812711 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 27 12:22:44.822877 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.812714 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 27 12:22:44.822877 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.812717 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 27 12:22:44.822877 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.812720 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 27 12:22:44.822877 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.812722 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 27 12:22:44.822877 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.812725 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 27 12:22:44.822877 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.812728 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 27 12:22:44.822877 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.812730 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 27 12:22:44.822877 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.812733 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 27 12:22:44.822877 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.812736 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 27 12:22:44.822877 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.812739 2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 27 12:22:44.822877 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.812742 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 27 12:22:44.822877 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.812745 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 27 12:22:44.823699 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.812747 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 27 12:22:44.823699 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.812750 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 27 12:22:44.823699 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.812753 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 27 12:22:44.823699 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.812755 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 27 12:22:44.823699 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.812758 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 27 12:22:44.823699 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.812763 2568 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 27 12:22:44.823699 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.812765 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 27 12:22:44.823699 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.812768 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 27 12:22:44.823699 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.812771 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 27 12:22:44.823699 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.812775 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 27 12:22:44.823699 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.812779 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 27 12:22:44.823699 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.812781 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 27 12:22:44.823699 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.812785 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 27 12:22:44.823699 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.812788 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 27 12:22:44.823699 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.812790 2568 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 27 12:22:44.823699 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.812793 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 27 12:22:44.823699 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.812796 2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 27 12:22:44.823699 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.812798 2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 27 12:22:44.823699 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.812801 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 27 12:22:44.824349 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.812804 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 27 12:22:44.824349 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.812806 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 27 12:22:44.824349 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.812809 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 27 12:22:44.824349 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.812812 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 27 12:22:44.824349 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.812814 2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 27 12:22:44.824349 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.812817 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 27 12:22:44.824349 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.812819 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 27 12:22:44.824349 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.812822 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 27 12:22:44.824349 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.812824 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 27 12:22:44.824349 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.812827 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 27 12:22:44.824349 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.812830 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 27 12:22:44.824349 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.812832 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 27 12:22:44.824349 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.812835 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 27 12:22:44.824349 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.812838 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 27 12:22:44.824349 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.812840 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 27 12:22:44.824349 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.812843 2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 27 12:22:44.824349 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.812846 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 27 12:22:44.824349 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.812849 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 27 12:22:44.824349 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.812853 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 27 12:22:44.824349 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.812856 2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 27 12:22:44.825203 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.812858 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 27 12:22:44.825203 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.812861 2568 feature_gate.go:328] unrecognized feature gate: Example2 Jul 27 12:22:44.825203 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.812863 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 27 12:22:44.825203 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.812866 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 27 12:22:44.825203 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.812869 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 27 12:22:44.825203 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.812871 2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 27 12:22:44.825203 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.812874 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 27 12:22:44.825203 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.812877 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 27 12:22:44.825203 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.812879 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 27 12:22:44.825203 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.812882 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 27 12:22:44.825203 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.812884 2568 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 27 12:22:44.825203 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.812888 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 27 12:22:44.825203 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.812892 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 27 12:22:44.825203 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.812895 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 27 12:22:44.825203 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.812898 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 27 12:22:44.825203 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.812900 2568 feature_gate.go:328] unrecognized feature gate: Example Jul 27 12:22:44.825203 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.812903 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 27 12:22:44.825203 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.812906 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 27 12:22:44.825203 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.812909 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 27 12:22:44.825203 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.812912 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 27 12:22:44.826048 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.812915 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 27 12:22:44.826048 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.812918 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 27 12:22:44.826048 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.812921 2568 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 27 12:22:44.826048 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.812924 2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 27 12:22:44.826048 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.812926 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 27 12:22:44.826048 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.812929 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 27 12:22:44.826048 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.812932 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 27 12:22:44.826048 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.812934 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 27 12:22:44.826048 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.812939 2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 27 12:22:44.826048 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.812942 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 27 12:22:44.826048 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.812947 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 27 12:22:44.826048 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.812950 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 27 12:22:44.826048 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.812953 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 27 12:22:44.826048 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.812956 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 27 12:22:44.826048 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.812959 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 27 12:22:44.826048 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.812962 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 27 12:22:44.826048 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.812964 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 27 12:22:44.826048 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.812967 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 27 12:22:44.826048 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.812970 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 27 12:22:44.826787 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.812972 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 27 12:22:44.826787 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.812975 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 27 12:22:44.826787 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.812977 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 27 12:22:44.826787 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.812980 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 27 12:22:44.826787 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.813854 2568 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 27 12:22:44.826787 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.821886 2568 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 27 12:22:44.826787 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.821909 2568 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 27 12:22:44.826787 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.821931 2568 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 27 12:22:44.826787 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.821940 2568 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 27 12:22:44.826787 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.822047 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 27 12:22:44.826787 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.822055 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 27 12:22:44.826787 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.822061 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 27 12:22:44.826787 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.822066 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 27 12:22:44.826787 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.822070 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 27 12:22:44.827352 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.822075 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 27 12:22:44.827352 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.822079 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 27 12:22:44.827352 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.822084 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 27 12:22:44.827352 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.822088 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 27 12:22:44.827352 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.822093 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 27 12:22:44.827352 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.822097 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 27 12:22:44.827352 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.822101 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 27 12:22:44.827352 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.822105 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 27 12:22:44.827352 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.822110 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 27 12:22:44.827352 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.822114 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 27 12:22:44.827352 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.822118 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 27 12:22:44.827352 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.822122 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 27 12:22:44.827352 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.822127 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 27 12:22:44.827352 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.822131 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 27 12:22:44.827352 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.822136 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 27 12:22:44.827352 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.822140 2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 27 12:22:44.827352 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.822144 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 27 12:22:44.827352 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.822148 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 27 12:22:44.827352 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.822153 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 27 12:22:44.827924 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.822157 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 27 12:22:44.827924 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.822162 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 27 12:22:44.827924 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.822166 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 27 12:22:44.827924 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.822170 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 27 12:22:44.827924 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.822174 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 27 12:22:44.827924 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.822188 2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 27 12:22:44.827924 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.822193 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 27 12:22:44.827924 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.822198 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 27 12:22:44.827924 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.822202 2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 27 12:22:44.827924 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.822206 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 27 12:22:44.827924 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.822211 2568 feature_gate.go:328] unrecognized feature gate: Example2 Jul 27 12:22:44.827924 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.822215 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 27 12:22:44.827924 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.822219 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 27 12:22:44.827924 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.822223 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 27 12:22:44.827924 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.822227 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 27 12:22:44.827924 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.822231 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 27 12:22:44.827924 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.822236 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 27 12:22:44.827924 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.822242 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 27 12:22:44.827924 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.822248 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 27 12:22:44.827924 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.822253 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 27 12:22:44.828413 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.822257 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 27 12:22:44.828413 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.822261 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 27 12:22:44.828413 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.822265 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 27 12:22:44.828413 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.822269 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 27 12:22:44.828413 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.822274 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 27 12:22:44.828413 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.822278 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 27 12:22:44.828413 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.822282 2568 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 27 12:22:44.828413 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.822286 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 27 12:22:44.828413 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.822291 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 27 12:22:44.828413 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.822295 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 27 12:22:44.828413 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.822299 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 27 12:22:44.828413 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.822303 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 27 12:22:44.828413 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.822307 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 27 12:22:44.828413 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.822311 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 27 12:22:44.828413 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.822315 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 27 12:22:44.828413 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.822320 2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 27 12:22:44.828413 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.822324 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 27 12:22:44.828413 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.822329 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 27 12:22:44.828413 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.822349 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 27 12:22:44.828413 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.822354 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 27 12:22:44.829004 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.822358 2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 27 12:22:44.829004 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.822362 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 27 12:22:44.829004 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.822366 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 27 12:22:44.829004 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.822371 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 27 12:22:44.829004 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.822377 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 27 12:22:44.829004 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.822382 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 27 12:22:44.829004 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.822387 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 27 12:22:44.829004 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.822392 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 27 12:22:44.829004 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.822396 2568 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 27 12:22:44.829004 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.822401 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 27 12:22:44.829004 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.822405 2568 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 27 12:22:44.829004 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.822409 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 27 12:22:44.829004 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.822413 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 27 12:22:44.829004 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.822417 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 27 12:22:44.829004 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.822421 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 27 12:22:44.829004 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.822425 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 27 12:22:44.829004 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.822429 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 27 12:22:44.829004 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.822433 2568 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 27 12:22:44.829004 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.822438 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 27 12:22:44.829004 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.822441 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 27 12:22:44.829581 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.822446 2568 feature_gate.go:328] unrecognized feature gate: Example Jul 27 12:22:44.829581 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.822450 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 27 12:22:44.829581 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.822453 2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 27 12:22:44.829581 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.822458 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 27 12:22:44.829581 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.822462 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 27 12:22:44.829581 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.822466 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 27 12:22:44.829581 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.822470 2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 27 12:22:44.829581 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.822474 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 27 12:22:44.829581 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.822478 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 27 12:22:44.829581 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.822483 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 27 12:22:44.829581 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.822487 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 27 12:22:44.829581 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.822503 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 27 12:22:44.829581 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.822507 2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 27 12:22:44.829581 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.822512 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 27 12:22:44.829581 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.822518 2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 27 12:22:44.829989 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.822526 2568 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 27 12:22:44.829989 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.822766 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 27 12:22:44.829989 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.822775 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 27 12:22:44.829989 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.822780 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 27 12:22:44.829989 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.822784 2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 27 12:22:44.829989 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.822789 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 27 12:22:44.829989 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.822793 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 27 12:22:44.829989 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.822798 2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 27 12:22:44.829989 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.822803 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 27 12:22:44.829989 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.822807 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 27 12:22:44.829989 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.822812 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 27 12:22:44.829989 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.822816 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 27 12:22:44.829989 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.822820 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 27 12:22:44.829989 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.822824 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 27 12:22:44.829989 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.822828 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 27 12:22:44.830363 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.822832 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 27 12:22:44.830363 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.822836 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 27 12:22:44.830363 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.822841 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 27 12:22:44.830363 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.822845 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 27 12:22:44.830363 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.822849 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 27 12:22:44.830363 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.822853 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 27 12:22:44.830363 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.822857 2568 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 27 12:22:44.830363 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.822861 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 27 12:22:44.830363 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.822866 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 27 12:22:44.830363 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.822872 2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 27 12:22:44.830363 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.822878 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 27 12:22:44.830363 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.822883 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 27 12:22:44.830363 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.822888 2568 feature_gate.go:328] unrecognized feature gate: Example2 Jul 27 12:22:44.830363 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.822892 2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 27 12:22:44.830363 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.822904 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 27 12:22:44.830363 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.822908 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 27 12:22:44.830363 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.822913 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 27 12:22:44.830363 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.822917 2568 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 27 12:22:44.830363 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.822921 2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 27 12:22:44.830363 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.822936 2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 27 12:22:44.830866 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.822941 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 27 12:22:44.830866 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.822945 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 27 12:22:44.830866 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.822951 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 27 12:22:44.830866 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.822956 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 27 12:22:44.830866 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.822961 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 27 12:22:44.830866 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.822967 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 27 12:22:44.830866 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.822971 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 27 12:22:44.830866 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.822976 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 27 12:22:44.830866 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.822981 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 27 12:22:44.830866 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.822985 2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 27 12:22:44.830866 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.822989 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 27 12:22:44.830866 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.822993 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 27 12:22:44.830866 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.822998 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 27 12:22:44.830866 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.823002 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 27 12:22:44.830866 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.823006 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 27 12:22:44.830866 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.823011 2568 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 27 12:22:44.830866 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.823015 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 27 12:22:44.830866 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.823019 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 27 12:22:44.830866 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.823023 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 27 12:22:44.831330 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.823027 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 27 12:22:44.831330 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.823031 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 27 12:22:44.831330 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.823035 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 27 12:22:44.831330 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.823039 2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 27 12:22:44.831330 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.823044 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 27 12:22:44.831330 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.823048 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 27 12:22:44.831330 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.823052 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 27 12:22:44.831330 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.823056 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 27 12:22:44.831330 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.823068 2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 27 12:22:44.831330 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.823073 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 27 12:22:44.831330 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.823077 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 27 12:22:44.831330 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.823081 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 27 12:22:44.831330 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.823085 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 27 12:22:44.831330 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.823089 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 27 12:22:44.831330 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.823093 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 27 12:22:44.831330 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.823098 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 27 12:22:44.831330 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.823102 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 27 12:22:44.831330 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.823106 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 27 12:22:44.831330 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.823111 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 27 12:22:44.831330 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.823115 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 27 12:22:44.831824 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.823119 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 27 12:22:44.831824 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.823123 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 27 12:22:44.831824 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.823127 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 27 12:22:44.831824 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.823132 2568 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 27 12:22:44.831824 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.823136 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 27 12:22:44.831824 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.823140 2568 feature_gate.go:328] unrecognized feature gate: Example Jul 27 12:22:44.831824 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.823144 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 27 12:22:44.831824 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.823148 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 27 12:22:44.831824 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.823152 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 27 12:22:44.831824 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.823156 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 27 12:22:44.831824 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.823160 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 27 12:22:44.831824 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.823164 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 27 12:22:44.831824 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.823169 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 27 12:22:44.831824 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.823174 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 27 12:22:44.831824 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.823180 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 27 12:22:44.831824 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.823185 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 27 12:22:44.831824 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.823189 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 27 12:22:44.831824 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.823194 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 27 12:22:44.831824 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.823198 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 27 12:22:44.832282 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.823202 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 27 12:22:44.832282 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.823206 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 27 12:22:44.832282 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.823219 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 27 12:22:44.832282 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.823224 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 27 12:22:44.832282 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.823227 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 27 12:22:44.832282 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.823232 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 27 12:22:44.832282 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:44.823236 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 27 12:22:44.832282 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.823243 2568 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 27 12:22:44.832282 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.823430 2568 server.go:962] "Client rotation is on, will bootstrap in background" Jul 27 12:22:44.832282 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.828377 2568 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 27 12:22:44.832282 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.829868 2568 server.go:1019] "Starting client certificate rotation" Jul 27 12:22:44.832282 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.829972 2568 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 27 12:22:44.832282 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.830010 2568 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 27 12:22:44.832731 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.832715 2568 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 27 12:22:44.835649 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.835621 2568 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 27 12:22:44.844813 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.844796 2568 log.go:25] "Validated CRI v1 runtime API" Jul 27 12:22:44.848613 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.848591 2568 log.go:25] "Validated CRI v1 image API" Jul 27 12:22:44.850509 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.850490 2568 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 27 12:22:44.852868 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.852840 2568 fs.go:135] Filesystem UUIDs: map[099846f8-0968-4b3c-8fa6-cd357f2252b6:/dev/nvme0n1p3 16df166c-c6de-4e6c-8d13-358fa6a0b74b:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2] Jul 27 12:22:44.852954 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.852868 2568 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 27 12:22:44.856800 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.856778 2568 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 27 12:22:44.858743 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.858627 2568 manager.go:216] Machine: {Timestamp:2026-07-27 12:22:44.857323387 +0000 UTC m=+0.321636348 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3101196 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec25f155dda7e5975db75893738edac0 SystemUUID:ec25f155-dda7-e597-5db7-5893738edac0 BootID:d5ac521b-2b8c-466a-972c-4dd5d35e85ac Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:79:77:06:67:29 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:79:77:06:67:29 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:da:92:d5:44:77:d7 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 27 12:22:44.858743 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.858738 2568 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 27 12:22:44.858907 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.858840 2568 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 27 12:22:44.861472 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.861444 2568 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 27 12:22:44.861704 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.861474 2568 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-3.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 27 12:22:44.862304 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.862292 2568 topology_manager.go:138] "Creating topology manager with none policy" Jul 27 12:22:44.862364 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.862310 2568 container_manager_linux.go:309] "Creating device plugin manager" Jul 27 12:22:44.862364 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.862321 2568 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 27 12:22:44.862943 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.862931 2568 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 27 12:22:44.864519 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.864500 2568 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 27 12:22:44.867164 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.867152 2568 state_mem.go:36] "Initialized new in-memory state store" Jul 27 12:22:44.867287 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.867277 2568 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 27 12:22:44.867322 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.867306 2568 kubelet.go:486] "Attempting to sync node with API server" Jul 27 12:22:44.867350 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.867322 2568 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 27 12:22:44.867350 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.867339 2568 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 27 12:22:44.867406 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.867368 2568 kubelet.go:398] "Adding apiserver pod source" Jul 27 12:22:44.867406 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.867387 2568 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 27 12:22:44.867897 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.867868 2568 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 27 12:22:44.867992 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.867916 2568 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 27 12:22:44.870277 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.870261 2568 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 27 12:22:44.873194 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.873176 2568 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 27 12:22:44.873276 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.873209 2568 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 27 12:22:44.874669 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.874652 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 27 12:22:44.874721 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.874676 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 27 12:22:44.874721 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.874687 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 27 12:22:44.874721 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.874697 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 27 12:22:44.874721 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.874710 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 27 12:22:44.874721 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.874718 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 27 12:22:44.874864 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.874730 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 27 12:22:44.874864 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.874740 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 27 12:22:44.874864 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.874750 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 27 12:22:44.874864 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.874758 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 27 12:22:44.874864 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.874770 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 27 12:22:44.874864 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.874779 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 27 12:22:44.875496 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.875484 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 27 12:22:44.875525 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.875497 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 27 12:22:44.876616 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:22:44.876592 2568 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-3.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 27 12:22:44.876681 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:22:44.876592 2568 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 27 12:22:44.878023 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.878007 2568 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-3.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 27 12:22:44.878746 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.878733 2568 server.go:1268] "Started kubelet" Jul 27 12:22:44.878823 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.878791 2568 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 27 12:22:44.878929 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.878880 2568 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 27 12:22:44.878979 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.878958 2568 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 27 12:22:44.879634 ip-10-0-141-3 systemd[1]: Started Kubernetes Kubelet. Jul 27 12:22:44.880487 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.880452 2568 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 27 12:22:44.880825 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.880811 2568 server.go:310] "Adding debug handlers to kubelet server" Jul 27 12:22:44.882166 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.882144 2568 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-xdwjq" Jul 27 12:22:44.883753 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:22:44.883733 2568 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 27 12:22:44.887710 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.887692 2568 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-xdwjq" Jul 27 12:22:44.887881 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.887861 2568 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 27 12:22:44.887881 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.887875 2568 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 27 12:22:44.888029 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:22:44.887944 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-3.ec2.internal\" not found" Jul 27 12:22:44.888490 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.888467 2568 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 27 12:22:44.888490 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.888469 2568 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 27 12:22:44.888649 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.888512 2568 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 27 12:22:44.888649 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.888631 2568 reconstruct.go:97] "Volume reconstruction finished" Jul 27 12:22:44.888649 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.888641 2568 reconciler.go:29] "Reconciler: start to sync state" Jul 27 12:22:44.889165 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.889147 2568 factory.go:153] Registering CRI-O factory Jul 27 12:22:44.889165 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.889167 2568 factory.go:223] Registration of the crio container factory successfully Jul 27 12:22:44.889279 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.889225 2568 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 27 12:22:44.889279 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.889236 2568 factory.go:55] Registering systemd factory Jul 27 12:22:44.889279 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.889245 2568 factory.go:223] Registration of the systemd container factory successfully Jul 27 12:22:44.889279 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.889271 2568 factory.go:103] Registering Raw factory Jul 27 12:22:44.889456 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.889286 2568 manager.go:1196] Started watching for new ooms in manager Jul 27 12:22:44.889837 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.889822 2568 manager.go:349] Starting recovery of all containers Jul 27 12:22:44.890863 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:22:44.889977 2568 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-3.ec2.internal.18c624fb7e9ebca9 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-3.ec2.internal,UID:ip-10-0-141-3.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-141-3.ec2.internal,},FirstTimestamp:2026-07-27 12:22:44.878703785 +0000 UTC m=+0.343016749,LastTimestamp:2026-07-27 12:22:44.878703785 +0000 UTC m=+0.343016749,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-3.ec2.internal,}" Jul 27 12:22:44.890958 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:22:44.890935 2568 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-141-3.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 27 12:22:44.897320 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.897295 2568 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 27 12:22:44.901405 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.901116 2568 manager.go:354] Recovery completed Jul 27 12:22:44.904074 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:22:44.904044 2568 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Jul 27 12:22:44.907051 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.907036 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 27 12:22:44.908931 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.908914 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-3.ec2.internal" event="NodeHasSufficientMemory" Jul 27 12:22:44.908990 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.908945 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-3.ec2.internal" event="NodeHasNoDiskPressure" Jul 27 12:22:44.908990 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.908955 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-3.ec2.internal" event="NodeHasSufficientPID" Jul 27 12:22:44.909571 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.909557 2568 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 27 12:22:44.909571 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.909570 2568 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 27 12:22:44.909651 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.909576 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 27 12:22:44.909651 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.909585 2568 state_mem.go:36] "Initialized new in-memory state store" Jul 27 12:22:44.910247 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.910232 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-3.ec2.internal" event="NodeHasSufficientMemory" Jul 27 12:22:44.910291 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.910259 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-3.ec2.internal" event="NodeHasNoDiskPressure" Jul 27 12:22:44.910291 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.910269 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-3.ec2.internal" event="NodeHasSufficientPID" Jul 27 12:22:44.911298 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.911286 2568 policy_none.go:49] "None policy: Start" Jul 27 12:22:44.911343 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.911301 2568 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 27 12:22:44.911343 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.911312 2568 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 27 12:22:44.912288 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.912278 2568 policy_none.go:47] "Start" Jul 27 12:22:44.951090 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.951074 2568 manager.go:337] "Starting Device Plugin manager" Jul 27 12:22:44.951190 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:22:44.951108 2568 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 27 12:22:44.951190 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.951122 2568 server.go:87] "Starting device plugin registration server" Jul 27 12:22:44.951384 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.951372 2568 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 27 12:22:44.951420 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.951387 2568 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 27 12:22:44.951506 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.951488 2568 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 27 12:22:44.951596 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.951582 2568 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 27 12:22:44.951651 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:44.951597 2568 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 27 12:22:44.952139 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:22:44.952113 2568 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 27 12:22:44.952210 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:22:44.952165 2568 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-3.ec2.internal\" not found" Jul 27 12:22:45.051765 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:45.051737 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 27 12:22:45.054580 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:45.054557 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-3.ec2.internal" event="NodeHasSufficientMemory" Jul 27 12:22:45.054678 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:45.054595 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-3.ec2.internal" event="NodeHasNoDiskPressure" Jul 27 12:22:45.054678 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:45.054606 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-3.ec2.internal" event="NodeHasSufficientPID" Jul 27 12:22:45.054678 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:45.054632 2568 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-3.ec2.internal" Jul 27 12:22:46.123660 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:46.123520 2568 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-3.ec2.internal" Jul 27 12:22:46.123726 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:22:46.123668 2568 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-3.ec2.internal\": node \"ip-10-0-141-3.ec2.internal\" not found" Jul 27 12:22:46.141057 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:22:46.141031 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-3.ec2.internal\" not found" Jul 27 12:22:46.155074 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:46.155037 2568 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 27 12:22:46.156299 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:46.156274 2568 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 27 12:22:46.156400 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:46.156312 2568 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 27 12:22:46.156400 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:46.156336 2568 kubelet.go:2448] "Starting kubelet main sync loop" Jul 27 12:22:46.156400 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:22:46.156374 2568 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 27 12:22:46.158859 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:46.158833 2568 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 27 12:22:46.241413 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:22:46.241376 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-3.ec2.internal\" not found" Jul 27 12:22:46.256848 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:46.256811 2568 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-3.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-141-3.ec2.internal"] Jul 27 12:22:46.256935 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:46.256900 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 27 12:22:46.258507 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:46.258489 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-3.ec2.internal" event="NodeHasSufficientMemory" Jul 27 12:22:46.258604 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:46.258524 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-3.ec2.internal" event="NodeHasNoDiskPressure" Jul 27 12:22:46.258604 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:46.258538 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-3.ec2.internal" event="NodeHasSufficientPID" Jul 27 12:22:46.259808 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:46.259792 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 27 12:22:46.259916 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:46.259901 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-3.ec2.internal" Jul 27 12:22:46.259968 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:46.259930 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 27 12:22:46.260490 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:46.260475 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-3.ec2.internal" event="NodeHasSufficientMemory" Jul 27 12:22:46.260490 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:46.260486 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-3.ec2.internal" event="NodeHasSufficientMemory" Jul 27 12:22:46.260623 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:46.260505 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-3.ec2.internal" event="NodeHasNoDiskPressure" Jul 27 12:22:46.260623 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:46.260505 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-3.ec2.internal" event="NodeHasNoDiskPressure" Jul 27 12:22:46.260623 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:46.260531 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-3.ec2.internal" event="NodeHasSufficientPID" Jul 27 12:22:46.260623 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:46.260516 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-3.ec2.internal" event="NodeHasSufficientPID" Jul 27 12:22:46.261809 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:46.261791 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-3.ec2.internal" Jul 27 12:22:46.261858 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:46.261829 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 27 12:22:46.262476 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:46.262461 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-3.ec2.internal" event="NodeHasSufficientMemory" Jul 27 12:22:46.262540 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:46.262492 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-3.ec2.internal" event="NodeHasNoDiskPressure" Jul 27 12:22:46.262540 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:46.262507 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-3.ec2.internal" event="NodeHasSufficientPID" Jul 27 12:22:46.297493 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:22:46.297465 2568 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-3.ec2.internal\" not found" node="ip-10-0-141-3.ec2.internal" Jul 27 12:22:46.301736 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:22:46.301701 2568 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-3.ec2.internal\" not found" node="ip-10-0-141-3.ec2.internal" Jul 27 12:22:46.341722 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:22:46.341685 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-3.ec2.internal\" not found" Jul 27 12:22:46.351969 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:46.351945 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/36a46d688b7e502bc5634c748870ec91-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-3.ec2.internal\" (UID: \"36a46d688b7e502bc5634c748870ec91\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-3.ec2.internal" Jul 27 12:22:46.352056 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:46.351973 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/cff9f289b3eaca0aa84c8bb4795faff0-config\") pod \"kube-apiserver-proxy-ip-10-0-141-3.ec2.internal\" (UID: \"cff9f289b3eaca0aa84c8bb4795faff0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-3.ec2.internal" Jul 27 12:22:46.352056 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:46.351991 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/36a46d688b7e502bc5634c748870ec91-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-3.ec2.internal\" (UID: \"36a46d688b7e502bc5634c748870ec91\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-3.ec2.internal" Jul 27 12:22:46.442346 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:22:46.442278 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-3.ec2.internal\" not found" Jul 27 12:22:46.452674 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:46.452653 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/cff9f289b3eaca0aa84c8bb4795faff0-config\") pod \"kube-apiserver-proxy-ip-10-0-141-3.ec2.internal\" (UID: \"cff9f289b3eaca0aa84c8bb4795faff0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-3.ec2.internal" Jul 27 12:22:46.452765 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:46.452680 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/36a46d688b7e502bc5634c748870ec91-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-3.ec2.internal\" (UID: \"36a46d688b7e502bc5634c748870ec91\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-3.ec2.internal" Jul 27 12:22:46.452765 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:46.452703 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/36a46d688b7e502bc5634c748870ec91-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-3.ec2.internal\" (UID: \"36a46d688b7e502bc5634c748870ec91\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-3.ec2.internal" Jul 27 12:22:46.452765 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:46.452751 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/36a46d688b7e502bc5634c748870ec91-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-3.ec2.internal\" (UID: \"36a46d688b7e502bc5634c748870ec91\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-3.ec2.internal" Jul 27 12:22:46.452869 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:46.452776 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/36a46d688b7e502bc5634c748870ec91-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-3.ec2.internal\" (UID: \"36a46d688b7e502bc5634c748870ec91\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-3.ec2.internal" Jul 27 12:22:46.452869 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:46.452751 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/cff9f289b3eaca0aa84c8bb4795faff0-config\") pod \"kube-apiserver-proxy-ip-10-0-141-3.ec2.internal\" (UID: \"cff9f289b3eaca0aa84c8bb4795faff0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-3.ec2.internal" Jul 27 12:22:46.542882 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:22:46.542828 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-3.ec2.internal\" not found" Jul 27 12:22:46.600326 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:46.600288 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-3.ec2.internal" Jul 27 12:22:46.604884 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:46.604566 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-3.ec2.internal" Jul 27 12:22:46.643557 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:22:46.643527 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-3.ec2.internal\" not found" Jul 27 12:22:46.744186 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:22:46.744105 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-3.ec2.internal\" not found" Jul 27 12:22:46.844650 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:22:46.844610 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-3.ec2.internal\" not found" Jul 27 12:22:46.890093 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:46.890047 2568 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 27 12:22:46.890548 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:46.890232 2568 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 27 12:22:46.890548 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:46.890241 2568 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 27 12:22:46.945239 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:22:46.945202 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-3.ec2.internal\" not found" Jul 27 12:22:46.953017 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:46.952977 2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-26 12:17:45 +0000 UTC" deadline="2027-12-23 15:28:56.847268788 +0000 UTC" Jul 27 12:22:46.953017 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:46.953015 2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12339h6m9.894257068s" Jul 27 12:22:47.045982 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:22:47.045899 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-3.ec2.internal\" not found" Jul 27 12:22:47.146425 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:22:47.146393 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-3.ec2.internal\" not found" Jul 27 12:22:47.163820 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:47.163784 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcff9f289b3eaca0aa84c8bb4795faff0.slice/crio-84c9d562323558c4d44139d4cb3327f796d8877938e46db168fd5467290f5fb6 WatchSource:0}: Error finding container 84c9d562323558c4d44139d4cb3327f796d8877938e46db168fd5467290f5fb6: Status 404 returned error can't find the container with id 84c9d562323558c4d44139d4cb3327f796d8877938e46db168fd5467290f5fb6 Jul 27 12:22:47.164309 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:47.164289 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36a46d688b7e502bc5634c748870ec91.slice/crio-f9b1ae5ac04907a1ef1e05049c85e0a96fcc4c910e4ad7b97233fe37c0d53d12 WatchSource:0}: Error finding container f9b1ae5ac04907a1ef1e05049c85e0a96fcc4c910e4ad7b97233fe37c0d53d12: Status 404 returned error can't find the container with id f9b1ae5ac04907a1ef1e05049c85e0a96fcc4c910e4ad7b97233fe37c0d53d12 Jul 27 12:22:47.168290 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:47.168277 2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 27 12:22:47.246559 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:22:47.246514 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-3.ec2.internal\" not found" Jul 27 12:22:47.280806 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:47.280785 2568 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 27 12:22:47.329323 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:47.329249 2568 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 27 12:22:47.349325 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:47.349303 2568 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-3.ec2.internal" Jul 27 12:22:47.366003 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:47.365979 2568 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 27 12:22:47.367078 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:47.367063 2568 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-3.ec2.internal" Jul 27 12:22:47.375973 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:47.375955 2568 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 27 12:22:47.698491 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:47.698419 2568 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 27 12:22:47.722019 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:47.721988 2568 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 27 12:22:47.929792 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:47.929757 2568 apiserver.go:52] "Watching apiserver" Jul 27 12:22:47.938679 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:47.938650 2568 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 27 12:22:47.939555 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:47.939178 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-c6p2s","openshift-multus/multus-additional-cni-plugins-bzpr5","openshift-network-operator/iptables-alerter-lx8jr","openshift-ovn-kubernetes/ovnkube-node-ktgz9","kube-system/konnectivity-agent-x45bt","kube-system/kube-apiserver-proxy-ip-10-0-141-3.ec2.internal","openshift-dns/node-resolver-rr46t","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-3.ec2.internal","openshift-multus/multus-22ct8","openshift-multus/network-metrics-daemon-4p2n8","openshift-network-diagnostics/network-check-target-8vcwp","kube-system/global-pull-secret-syncer-sfvmh","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n8dpc","openshift-cluster-node-tuning-operator/tuned-pfcwv"] Jul 27 12:22:47.941751 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:47.941725 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-rr46t" Jul 27 12:22:47.943903 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:47.943835 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n8dpc" Jul 27 12:22:47.944333 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:47.944006 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-mvfkx\"" Jul 27 12:22:47.944333 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:47.944038 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 27 12:22:47.944333 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:47.944237 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 27 12:22:47.945992 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:47.945973 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 27 12:22:47.946096 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:47.946060 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 27 12:22:47.946561 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:47.946354 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 27 12:22:47.946561 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:47.946405 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-f5v24\"" Jul 27 12:22:47.946964 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:47.946907 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-lx8jr" Jul 27 12:22:47.949233 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:47.949182 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-ktgz9" Jul 27 12:22:47.949880 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:47.949856 2568 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 27 12:22:47.950158 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:47.950054 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 27 12:22:47.950158 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:47.950139 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 27 12:22:47.950300 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:47.950164 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 27 12:22:47.950300 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:47.950140 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-xhc9p\"" Jul 27 12:22:47.951976 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:47.951657 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 27 12:22:47.951976 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:47.951664 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-x45bt" Jul 27 12:22:47.952233 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:47.952039 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-wx5nr\"" Jul 27 12:22:47.952354 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:47.952337 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 27 12:22:47.952447 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:47.952396 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 27 12:22:47.952621 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:47.952527 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 27 12:22:47.952686 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:47.952658 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 27 12:22:47.952767 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:47.952737 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 27 12:22:47.954580 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:47.954560 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 27 12:22:47.954672 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:47.954653 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-pfcwv" Jul 27 12:22:47.955093 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:47.955067 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-wh2hw\"" Jul 27 12:22:47.955093 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:47.955083 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 27 12:22:47.956396 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:47.956376 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-22ct8" Jul 27 12:22:47.957029 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:47.956906 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-hd7st\"" Jul 27 12:22:47.957029 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:47.956923 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 27 12:22:47.957206 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:47.957126 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 27 12:22:47.958834 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:47.958814 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-c6p2s" Jul 27 12:22:47.959472 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:47.959453 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 27 12:22:47.959553 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:47.959485 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 27 12:22:47.959697 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:47.959679 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 27 12:22:47.959780 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:47.959691 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/25263f75-a634-43a0-ba16-79930eda24ae-run-systemd\") pod \"ovnkube-node-ktgz9\" (UID: \"25263f75-a634-43a0-ba16-79930eda24ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktgz9" Jul 27 12:22:47.959938 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:47.959787 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/25263f75-a634-43a0-ba16-79930eda24ae-run-ovn\") pod \"ovnkube-node-ktgz9\" (UID: \"25263f75-a634-43a0-ba16-79930eda24ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktgz9" Jul 27 12:22:47.959938 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:47.959814 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/25263f75-a634-43a0-ba16-79930eda24ae-log-socket\") pod \"ovnkube-node-ktgz9\" (UID: \"25263f75-a634-43a0-ba16-79930eda24ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktgz9" Jul 27 12:22:47.959938 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:47.959857 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/82bda458-1d5c-44ae-8cd0-def7ee6470c0-host-slash\") pod \"iptables-alerter-lx8jr\" (UID: \"82bda458-1d5c-44ae-8cd0-def7ee6470c0\") " pod="openshift-network-operator/iptables-alerter-lx8jr" Jul 27 12:22:47.959938 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:47.959883 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/25263f75-a634-43a0-ba16-79930eda24ae-host-cni-bin\") pod \"ovnkube-node-ktgz9\" (UID: \"25263f75-a634-43a0-ba16-79930eda24ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktgz9" Jul 27 12:22:47.959938 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:47.959905 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/25263f75-a634-43a0-ba16-79930eda24ae-ovnkube-config\") pod \"ovnkube-node-ktgz9\" (UID: \"25263f75-a634-43a0-ba16-79930eda24ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktgz9" Jul 27 12:22:47.959938 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:47.959915 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-r5c78\"" Jul 27 12:22:47.959938 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:47.959926 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/cfbb87c2-555d-4b49-a675-d640a5793147-etc-selinux\") pod \"aws-ebs-csi-driver-node-n8dpc\" (UID: \"cfbb87c2-555d-4b49-a675-d640a5793147\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n8dpc" Jul 27 12:22:47.960251 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:47.959952 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/25263f75-a634-43a0-ba16-79930eda24ae-node-log\") pod \"ovnkube-node-ktgz9\" (UID: \"25263f75-a634-43a0-ba16-79930eda24ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktgz9" Jul 27 12:22:47.960251 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:47.959990 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bsqzd\" (UniqueName: \"kubernetes.io/projected/bf7a8649-39cb-471e-8d6e-2d55bb3d4e68-kube-api-access-bsqzd\") pod \"node-resolver-rr46t\" (UID: \"bf7a8649-39cb-471e-8d6e-2d55bb3d4e68\") " pod="openshift-dns/node-resolver-rr46t" Jul 27 12:22:47.960251 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:47.960015 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/cfbb87c2-555d-4b49-a675-d640a5793147-device-dir\") pod \"aws-ebs-csi-driver-node-n8dpc\" (UID: \"cfbb87c2-555d-4b49-a675-d640a5793147\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n8dpc" Jul 27 12:22:47.960251 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:47.960044 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/25263f75-a634-43a0-ba16-79930eda24ae-host-kubelet\") pod \"ovnkube-node-ktgz9\" (UID: \"25263f75-a634-43a0-ba16-79930eda24ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktgz9" Jul 27 12:22:47.960251 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:47.960066 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/25263f75-a634-43a0-ba16-79930eda24ae-systemd-units\") pod \"ovnkube-node-ktgz9\" (UID: \"25263f75-a634-43a0-ba16-79930eda24ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktgz9" Jul 27 12:22:47.960251 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:47.960088 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/25263f75-a634-43a0-ba16-79930eda24ae-host-run-netns\") pod \"ovnkube-node-ktgz9\" (UID: \"25263f75-a634-43a0-ba16-79930eda24ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktgz9" Jul 27 12:22:47.960251 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:47.960109 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/25263f75-a634-43a0-ba16-79930eda24ae-etc-openvswitch\") pod \"ovnkube-node-ktgz9\" (UID: \"25263f75-a634-43a0-ba16-79930eda24ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktgz9" Jul 27 12:22:47.960251 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:47.960132 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/25263f75-a634-43a0-ba16-79930eda24ae-ovnkube-script-lib\") pod \"ovnkube-node-ktgz9\" (UID: \"25263f75-a634-43a0-ba16-79930eda24ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktgz9" Jul 27 12:22:47.960251 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:47.960138 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 27 12:22:47.960251 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:47.960156 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/25263f75-a634-43a0-ba16-79930eda24ae-host-slash\") pod \"ovnkube-node-ktgz9\" (UID: \"25263f75-a634-43a0-ba16-79930eda24ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktgz9" Jul 27 12:22:47.960251 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:47.960175 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/25263f75-a634-43a0-ba16-79930eda24ae-run-openvswitch\") pod \"ovnkube-node-ktgz9\" (UID: \"25263f75-a634-43a0-ba16-79930eda24ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktgz9" Jul 27 12:22:47.960251 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:47.960198 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/25263f75-a634-43a0-ba16-79930eda24ae-host-run-ovn-kubernetes\") pod \"ovnkube-node-ktgz9\" (UID: \"25263f75-a634-43a0-ba16-79930eda24ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktgz9" Jul 27 12:22:47.960251 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:47.960220 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/162b7fac-bf33-40ac-9803-42ee68d8bc52-agent-certs\") pod \"konnectivity-agent-x45bt\" (UID: \"162b7fac-bf33-40ac-9803-42ee68d8bc52\") " pod="kube-system/konnectivity-agent-x45bt" Jul 27 12:22:47.960864 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:47.960244 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/cfbb87c2-555d-4b49-a675-d640a5793147-socket-dir\") pod \"aws-ebs-csi-driver-node-n8dpc\" (UID: \"cfbb87c2-555d-4b49-a675-d640a5793147\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n8dpc" Jul 27 12:22:47.960864 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:47.960297 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/cfbb87c2-555d-4b49-a675-d640a5793147-sys-fs\") pod \"aws-ebs-csi-driver-node-n8dpc\" (UID: \"cfbb87c2-555d-4b49-a675-d640a5793147\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n8dpc" Jul 27 12:22:47.960864 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:47.960323 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b7hd4\" (UniqueName: \"kubernetes.io/projected/82bda458-1d5c-44ae-8cd0-def7ee6470c0-kube-api-access-b7hd4\") pod \"iptables-alerter-lx8jr\" (UID: \"82bda458-1d5c-44ae-8cd0-def7ee6470c0\") " pod="openshift-network-operator/iptables-alerter-lx8jr" Jul 27 12:22:47.960864 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:47.960348 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wkmpw\" (UniqueName: \"kubernetes.io/projected/25263f75-a634-43a0-ba16-79930eda24ae-kube-api-access-wkmpw\") pod \"ovnkube-node-ktgz9\" (UID: \"25263f75-a634-43a0-ba16-79930eda24ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktgz9" Jul 27 12:22:47.960864 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:47.960388 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/162b7fac-bf33-40ac-9803-42ee68d8bc52-konnectivity-ca\") pod \"konnectivity-agent-x45bt\" (UID: \"162b7fac-bf33-40ac-9803-42ee68d8bc52\") " pod="kube-system/konnectivity-agent-x45bt" Jul 27 12:22:47.960864 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:47.960418 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/bf7a8649-39cb-471e-8d6e-2d55bb3d4e68-hosts-file\") pod \"node-resolver-rr46t\" (UID: \"bf7a8649-39cb-471e-8d6e-2d55bb3d4e68\") " pod="openshift-dns/node-resolver-rr46t" Jul 27 12:22:47.960864 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:47.960460 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/cfbb87c2-555d-4b49-a675-d640a5793147-kubelet-dir\") pod \"aws-ebs-csi-driver-node-n8dpc\" (UID: \"cfbb87c2-555d-4b49-a675-d640a5793147\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n8dpc" Jul 27 12:22:47.960864 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:47.960494 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5wlps\" (UniqueName: \"kubernetes.io/projected/cfbb87c2-555d-4b49-a675-d640a5793147-kube-api-access-5wlps\") pod \"aws-ebs-csi-driver-node-n8dpc\" (UID: \"cfbb87c2-555d-4b49-a675-d640a5793147\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n8dpc" Jul 27 12:22:47.960864 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:47.960526 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/25263f75-a634-43a0-ba16-79930eda24ae-var-lib-openvswitch\") pod \"ovnkube-node-ktgz9\" (UID: \"25263f75-a634-43a0-ba16-79930eda24ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktgz9" Jul 27 12:22:47.960864 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:47.960609 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/25263f75-a634-43a0-ba16-79930eda24ae-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ktgz9\" (UID: \"25263f75-a634-43a0-ba16-79930eda24ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktgz9" Jul 27 12:22:47.960864 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:47.960650 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/25263f75-a634-43a0-ba16-79930eda24ae-ovn-node-metrics-cert\") pod \"ovnkube-node-ktgz9\" (UID: \"25263f75-a634-43a0-ba16-79930eda24ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktgz9" Jul 27 12:22:47.960864 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:47.960684 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/82bda458-1d5c-44ae-8cd0-def7ee6470c0-iptables-alerter-script\") pod \"iptables-alerter-lx8jr\" (UID: \"82bda458-1d5c-44ae-8cd0-def7ee6470c0\") " pod="openshift-network-operator/iptables-alerter-lx8jr" Jul 27 12:22:47.960864 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:47.960776 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/25263f75-a634-43a0-ba16-79930eda24ae-host-cni-netd\") pod \"ovnkube-node-ktgz9\" (UID: \"25263f75-a634-43a0-ba16-79930eda24ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktgz9" Jul 27 12:22:47.960864 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:47.960813 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/25263f75-a634-43a0-ba16-79930eda24ae-env-overrides\") pod \"ovnkube-node-ktgz9\" (UID: \"25263f75-a634-43a0-ba16-79930eda24ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktgz9" Jul 27 12:22:47.960864 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:47.960846 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bf7a8649-39cb-471e-8d6e-2d55bb3d4e68-tmp-dir\") pod \"node-resolver-rr46t\" (UID: \"bf7a8649-39cb-471e-8d6e-2d55bb3d4e68\") " pod="openshift-dns/node-resolver-rr46t" Jul 27 12:22:47.961613 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:47.960879 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/cfbb87c2-555d-4b49-a675-d640a5793147-registration-dir\") pod \"aws-ebs-csi-driver-node-n8dpc\" (UID: \"cfbb87c2-555d-4b49-a675-d640a5793147\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n8dpc" Jul 27 12:22:47.961613 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:47.960957 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-gkdgc\"" Jul 27 12:22:47.961613 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:47.961311 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 27 12:22:47.961613 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:47.961360 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 27 12:22:47.961613 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:47.961314 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 27 12:22:47.961899 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:47.961883 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-bzpr5" Jul 27 12:22:47.963489 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:47.963463 2568 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 27 12:22:47.964345 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:47.964287 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 27 12:22:47.967886 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:47.964975 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 27 12:22:47.967886 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:47.965000 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-clb67\"" Jul 27 12:22:47.967886 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:47.965188 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4p2n8" Jul 27 12:22:47.967886 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:22:47.965429 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4p2n8" podUID="ae5989c7-50c7-40bd-aac4-3383a9a9c435" Jul 27 12:22:47.968358 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:47.968336 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8vcwp" Jul 27 12:22:47.968447 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:22:47.968420 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8vcwp" podUID="fdfb006f-abc1-4762-9c0b-15b1159e2d8e" Jul 27 12:22:47.971443 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:47.971378 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sfvmh" Jul 27 12:22:47.971535 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:22:47.971455 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sfvmh" podUID="38ae6d3f-614b-4437-bb61-ad161748269f" Jul 27 12:22:47.991059 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:47.991016 2568 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-b5cxg" Jul 27 12:22:48.001907 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.001863 2568 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-b5cxg" Jul 27 12:22:48.051634 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.051602 2568 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 27 12:22:48.061807 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.061771 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5fdb7eea-5a10-47dd-930c-89239b36b74e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-bzpr5\" (UID: \"5fdb7eea-5a10-47dd-930c-89239b36b74e\") " pod="openshift-multus/multus-additional-cni-plugins-bzpr5" Jul 27 12:22:48.061973 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.061816 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zk9tf\" (UniqueName: \"kubernetes.io/projected/ae5989c7-50c7-40bd-aac4-3383a9a9c435-kube-api-access-zk9tf\") pod \"network-metrics-daemon-4p2n8\" (UID: \"ae5989c7-50c7-40bd-aac4-3383a9a9c435\") " pod="openshift-multus/network-metrics-daemon-4p2n8" Jul 27 12:22:48.061973 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.061840 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/41b1b110-9819-4966-966f-8fe838132d71-tmp\") pod \"tuned-pfcwv\" (UID: \"41b1b110-9819-4966-966f-8fe838132d71\") " pod="openshift-cluster-node-tuning-operator/tuned-pfcwv" Jul 27 12:22:48.061973 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.061861 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7bd721fb-fc40-4f80-8ed4-0956b5b5343d-host-var-lib-cni-bin\") pod \"multus-22ct8\" (UID: \"7bd721fb-fc40-4f80-8ed4-0956b5b5343d\") " pod="openshift-multus/multus-22ct8" Jul 27 12:22:48.061973 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.061883 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dz2hg\" (UniqueName: \"kubernetes.io/projected/a80003d1-f5f7-442b-83c9-bba4bd72902a-kube-api-access-dz2hg\") pod \"node-ca-c6p2s\" (UID: \"a80003d1-f5f7-442b-83c9-bba4bd72902a\") " pod="openshift-image-registry/node-ca-c6p2s" Jul 27 12:22:48.061973 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.061906 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zmf6t\" (UniqueName: \"kubernetes.io/projected/5fdb7eea-5a10-47dd-930c-89239b36b74e-kube-api-access-zmf6t\") pod \"multus-additional-cni-plugins-bzpr5\" (UID: \"5fdb7eea-5a10-47dd-930c-89239b36b74e\") " pod="openshift-multus/multus-additional-cni-plugins-bzpr5" Jul 27 12:22:48.061973 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.061930 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ae5989c7-50c7-40bd-aac4-3383a9a9c435-metrics-certs\") pod \"network-metrics-daemon-4p2n8\" (UID: \"ae5989c7-50c7-40bd-aac4-3383a9a9c435\") " pod="openshift-multus/network-metrics-daemon-4p2n8" Jul 27 12:22:48.061973 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.061958 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/25263f75-a634-43a0-ba16-79930eda24ae-run-ovn\") pod \"ovnkube-node-ktgz9\" (UID: \"25263f75-a634-43a0-ba16-79930eda24ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktgz9" Jul 27 12:22:48.062313 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.062006 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/41b1b110-9819-4966-966f-8fe838132d71-etc-sysctl-d\") pod \"tuned-pfcwv\" (UID: \"41b1b110-9819-4966-966f-8fe838132d71\") " pod="openshift-cluster-node-tuning-operator/tuned-pfcwv" Jul 27 12:22:48.062313 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.062043 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/25263f75-a634-43a0-ba16-79930eda24ae-run-ovn\") pod \"ovnkube-node-ktgz9\" (UID: \"25263f75-a634-43a0-ba16-79930eda24ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktgz9" Jul 27 12:22:48.062313 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.062089 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7bd721fb-fc40-4f80-8ed4-0956b5b5343d-multus-daemon-config\") pod \"multus-22ct8\" (UID: \"7bd721fb-fc40-4f80-8ed4-0956b5b5343d\") " pod="openshift-multus/multus-22ct8" Jul 27 12:22:48.062313 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.062119 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/25263f75-a634-43a0-ba16-79930eda24ae-host-cni-bin\") pod \"ovnkube-node-ktgz9\" (UID: \"25263f75-a634-43a0-ba16-79930eda24ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktgz9" Jul 27 12:22:48.062313 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.062156 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/cfbb87c2-555d-4b49-a675-d640a5793147-etc-selinux\") pod \"aws-ebs-csi-driver-node-n8dpc\" (UID: \"cfbb87c2-555d-4b49-a675-d640a5793147\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n8dpc" Jul 27 12:22:48.062313 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.062255 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7bd721fb-fc40-4f80-8ed4-0956b5b5343d-host-run-k8s-cni-cncf-io\") pod \"multus-22ct8\" (UID: \"7bd721fb-fc40-4f80-8ed4-0956b5b5343d\") " pod="openshift-multus/multus-22ct8" Jul 27 12:22:48.062313 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.062260 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/cfbb87c2-555d-4b49-a675-d640a5793147-etc-selinux\") pod \"aws-ebs-csi-driver-node-n8dpc\" (UID: \"cfbb87c2-555d-4b49-a675-d640a5793147\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n8dpc" Jul 27 12:22:48.062313 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.062296 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/25263f75-a634-43a0-ba16-79930eda24ae-host-cni-bin\") pod \"ovnkube-node-ktgz9\" (UID: \"25263f75-a634-43a0-ba16-79930eda24ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktgz9" Jul 27 12:22:48.062562 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.062400 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7bd721fb-fc40-4f80-8ed4-0956b5b5343d-host-run-netns\") pod \"multus-22ct8\" (UID: \"7bd721fb-fc40-4f80-8ed4-0956b5b5343d\") " pod="openshift-multus/multus-22ct8" Jul 27 12:22:48.062562 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.062445 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/25263f75-a634-43a0-ba16-79930eda24ae-node-log\") pod \"ovnkube-node-ktgz9\" (UID: \"25263f75-a634-43a0-ba16-79930eda24ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktgz9" Jul 27 12:22:48.062562 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.062473 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/41b1b110-9819-4966-966f-8fe838132d71-etc-systemd\") pod \"tuned-pfcwv\" (UID: \"41b1b110-9819-4966-966f-8fe838132d71\") " pod="openshift-cluster-node-tuning-operator/tuned-pfcwv" Jul 27 12:22:48.062562 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.062492 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5fdb7eea-5a10-47dd-930c-89239b36b74e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-bzpr5\" (UID: \"5fdb7eea-5a10-47dd-930c-89239b36b74e\") " pod="openshift-multus/multus-additional-cni-plugins-bzpr5" Jul 27 12:22:48.062562 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.062526 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/25263f75-a634-43a0-ba16-79930eda24ae-host-kubelet\") pod \"ovnkube-node-ktgz9\" (UID: \"25263f75-a634-43a0-ba16-79930eda24ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktgz9" Jul 27 12:22:48.062562 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.062550 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/25263f75-a634-43a0-ba16-79930eda24ae-host-run-netns\") pod \"ovnkube-node-ktgz9\" (UID: \"25263f75-a634-43a0-ba16-79930eda24ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktgz9" Jul 27 12:22:48.062777 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.062574 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/41b1b110-9819-4966-966f-8fe838132d71-run\") pod \"tuned-pfcwv\" (UID: \"41b1b110-9819-4966-966f-8fe838132d71\") " pod="openshift-cluster-node-tuning-operator/tuned-pfcwv" Jul 27 12:22:48.062777 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.062597 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a80003d1-f5f7-442b-83c9-bba4bd72902a-host\") pod \"node-ca-c6p2s\" (UID: \"a80003d1-f5f7-442b-83c9-bba4bd72902a\") " pod="openshift-image-registry/node-ca-c6p2s" Jul 27 12:22:48.062777 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.062652 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5fdb7eea-5a10-47dd-930c-89239b36b74e-cnibin\") pod \"multus-additional-cni-plugins-bzpr5\" (UID: \"5fdb7eea-5a10-47dd-930c-89239b36b74e\") " pod="openshift-multus/multus-additional-cni-plugins-bzpr5" Jul 27 12:22:48.062777 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.062675 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5fdb7eea-5a10-47dd-930c-89239b36b74e-os-release\") pod \"multus-additional-cni-plugins-bzpr5\" (UID: \"5fdb7eea-5a10-47dd-930c-89239b36b74e\") " pod="openshift-multus/multus-additional-cni-plugins-bzpr5" Jul 27 12:22:48.062777 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.062720 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vsjpz\" (UniqueName: \"kubernetes.io/projected/fdfb006f-abc1-4762-9c0b-15b1159e2d8e-kube-api-access-vsjpz\") pod \"network-check-target-8vcwp\" (UID: \"fdfb006f-abc1-4762-9c0b-15b1159e2d8e\") " pod="openshift-network-diagnostics/network-check-target-8vcwp" Jul 27 12:22:48.062777 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.062748 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/38ae6d3f-614b-4437-bb61-ad161748269f-original-pull-secret\") pod \"global-pull-secret-syncer-sfvmh\" (UID: \"38ae6d3f-614b-4437-bb61-ad161748269f\") " pod="kube-system/global-pull-secret-syncer-sfvmh" Jul 27 12:22:48.062968 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.062818 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b7hd4\" (UniqueName: \"kubernetes.io/projected/82bda458-1d5c-44ae-8cd0-def7ee6470c0-kube-api-access-b7hd4\") pod \"iptables-alerter-lx8jr\" (UID: \"82bda458-1d5c-44ae-8cd0-def7ee6470c0\") " pod="openshift-network-operator/iptables-alerter-lx8jr" Jul 27 12:22:48.062968 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.062854 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/41b1b110-9819-4966-966f-8fe838132d71-lib-modules\") pod \"tuned-pfcwv\" (UID: \"41b1b110-9819-4966-966f-8fe838132d71\") " pod="openshift-cluster-node-tuning-operator/tuned-pfcwv" Jul 27 12:22:48.062968 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.062879 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7bd721fb-fc40-4f80-8ed4-0956b5b5343d-multus-conf-dir\") pod \"multus-22ct8\" (UID: \"7bd721fb-fc40-4f80-8ed4-0956b5b5343d\") " pod="openshift-multus/multus-22ct8" Jul 27 12:22:48.062968 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.062904 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/cfbb87c2-555d-4b49-a675-d640a5793147-kubelet-dir\") pod \"aws-ebs-csi-driver-node-n8dpc\" (UID: \"cfbb87c2-555d-4b49-a675-d640a5793147\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n8dpc" Jul 27 12:22:48.063102 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.063010 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5wlps\" (UniqueName: \"kubernetes.io/projected/cfbb87c2-555d-4b49-a675-d640a5793147-kube-api-access-5wlps\") pod \"aws-ebs-csi-driver-node-n8dpc\" (UID: \"cfbb87c2-555d-4b49-a675-d640a5793147\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n8dpc" Jul 27 12:22:48.063102 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.063033 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a80003d1-f5f7-442b-83c9-bba4bd72902a-serviceca\") pod \"node-ca-c6p2s\" (UID: \"a80003d1-f5f7-442b-83c9-bba4bd72902a\") " pod="openshift-image-registry/node-ca-c6p2s" Jul 27 12:22:48.063102 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.063049 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/25263f75-a634-43a0-ba16-79930eda24ae-var-lib-openvswitch\") pod \"ovnkube-node-ktgz9\" (UID: \"25263f75-a634-43a0-ba16-79930eda24ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktgz9" Jul 27 12:22:48.063102 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.063052 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/cfbb87c2-555d-4b49-a675-d640a5793147-kubelet-dir\") pod \"aws-ebs-csi-driver-node-n8dpc\" (UID: \"cfbb87c2-555d-4b49-a675-d640a5793147\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n8dpc" Jul 27 12:22:48.063102 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.063064 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/25263f75-a634-43a0-ba16-79930eda24ae-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ktgz9\" (UID: \"25263f75-a634-43a0-ba16-79930eda24ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktgz9" Jul 27 12:22:48.063102 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.063088 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/25263f75-a634-43a0-ba16-79930eda24ae-node-log\") pod \"ovnkube-node-ktgz9\" (UID: \"25263f75-a634-43a0-ba16-79930eda24ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktgz9" Jul 27 12:22:48.063310 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.063124 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7bd721fb-fc40-4f80-8ed4-0956b5b5343d-host-var-lib-kubelet\") pod \"multus-22ct8\" (UID: \"7bd721fb-fc40-4f80-8ed4-0956b5b5343d\") " pod="openshift-multus/multus-22ct8" Jul 27 12:22:48.063310 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.063132 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/25263f75-a634-43a0-ba16-79930eda24ae-host-kubelet\") pod \"ovnkube-node-ktgz9\" (UID: \"25263f75-a634-43a0-ba16-79930eda24ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktgz9" Jul 27 12:22:48.063310 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.063157 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/25263f75-a634-43a0-ba16-79930eda24ae-host-run-netns\") pod \"ovnkube-node-ktgz9\" (UID: \"25263f75-a634-43a0-ba16-79930eda24ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktgz9" Jul 27 12:22:48.063310 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.063223 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/25263f75-a634-43a0-ba16-79930eda24ae-var-lib-openvswitch\") pod \"ovnkube-node-ktgz9\" (UID: \"25263f75-a634-43a0-ba16-79930eda24ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktgz9" Jul 27 12:22:48.063310 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.063275 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/25263f75-a634-43a0-ba16-79930eda24ae-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ktgz9\" (UID: \"25263f75-a634-43a0-ba16-79930eda24ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktgz9" Jul 27 12:22:48.063479 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.063428 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/38ae6d3f-614b-4437-bb61-ad161748269f-dbus\") pod \"global-pull-secret-syncer-sfvmh\" (UID: \"38ae6d3f-614b-4437-bb61-ad161748269f\") " pod="kube-system/global-pull-secret-syncer-sfvmh" Jul 27 12:22:48.063479 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.063466 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/25263f75-a634-43a0-ba16-79930eda24ae-host-cni-netd\") pod \"ovnkube-node-ktgz9\" (UID: \"25263f75-a634-43a0-ba16-79930eda24ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktgz9" Jul 27 12:22:48.063539 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.063497 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/25263f75-a634-43a0-ba16-79930eda24ae-host-cni-netd\") pod \"ovnkube-node-ktgz9\" (UID: \"25263f75-a634-43a0-ba16-79930eda24ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktgz9" Jul 27 12:22:48.063539 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.063508 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/25263f75-a634-43a0-ba16-79930eda24ae-env-overrides\") pod \"ovnkube-node-ktgz9\" (UID: \"25263f75-a634-43a0-ba16-79930eda24ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktgz9" Jul 27 12:22:48.063539 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.063533 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bf7a8649-39cb-471e-8d6e-2d55bb3d4e68-tmp-dir\") pod \"node-resolver-rr46t\" (UID: \"bf7a8649-39cb-471e-8d6e-2d55bb3d4e68\") " pod="openshift-dns/node-resolver-rr46t" Jul 27 12:22:48.063652 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.063606 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/cfbb87c2-555d-4b49-a675-d640a5793147-registration-dir\") pod \"aws-ebs-csi-driver-node-n8dpc\" (UID: \"cfbb87c2-555d-4b49-a675-d640a5793147\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n8dpc" Jul 27 12:22:48.063652 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.063640 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7bd721fb-fc40-4f80-8ed4-0956b5b5343d-os-release\") pod \"multus-22ct8\" (UID: \"7bd721fb-fc40-4f80-8ed4-0956b5b5343d\") " pod="openshift-multus/multus-22ct8" Jul 27 12:22:48.063760 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.063678 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7bd721fb-fc40-4f80-8ed4-0956b5b5343d-etc-kubernetes\") pod \"multus-22ct8\" (UID: \"7bd721fb-fc40-4f80-8ed4-0956b5b5343d\") " pod="openshift-multus/multus-22ct8" Jul 27 12:22:48.063760 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.063720 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/25263f75-a634-43a0-ba16-79930eda24ae-run-systemd\") pod \"ovnkube-node-ktgz9\" (UID: \"25263f75-a634-43a0-ba16-79930eda24ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktgz9" Jul 27 12:22:48.063760 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.063746 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/25263f75-a634-43a0-ba16-79930eda24ae-log-socket\") pod \"ovnkube-node-ktgz9\" (UID: \"25263f75-a634-43a0-ba16-79930eda24ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktgz9" Jul 27 12:22:48.063894 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.063794 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/82bda458-1d5c-44ae-8cd0-def7ee6470c0-host-slash\") pod \"iptables-alerter-lx8jr\" (UID: \"82bda458-1d5c-44ae-8cd0-def7ee6470c0\") " pod="openshift-network-operator/iptables-alerter-lx8jr" Jul 27 12:22:48.063894 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.063819 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7bd721fb-fc40-4f80-8ed4-0956b5b5343d-multus-socket-dir-parent\") pod \"multus-22ct8\" (UID: \"7bd721fb-fc40-4f80-8ed4-0956b5b5343d\") " pod="openshift-multus/multus-22ct8" Jul 27 12:22:48.063894 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.063858 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jw8td\" (UniqueName: \"kubernetes.io/projected/7bd721fb-fc40-4f80-8ed4-0956b5b5343d-kube-api-access-jw8td\") pod \"multus-22ct8\" (UID: \"7bd721fb-fc40-4f80-8ed4-0956b5b5343d\") " pod="openshift-multus/multus-22ct8" Jul 27 12:22:48.063894 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.063884 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5fdb7eea-5a10-47dd-930c-89239b36b74e-cni-binary-copy\") pod \"multus-additional-cni-plugins-bzpr5\" (UID: \"5fdb7eea-5a10-47dd-930c-89239b36b74e\") " pod="openshift-multus/multus-additional-cni-plugins-bzpr5" Jul 27 12:22:48.064071 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.063909 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5fdb7eea-5a10-47dd-930c-89239b36b74e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-bzpr5\" (UID: \"5fdb7eea-5a10-47dd-930c-89239b36b74e\") " pod="openshift-multus/multus-additional-cni-plugins-bzpr5" Jul 27 12:22:48.064071 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.063944 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/25263f75-a634-43a0-ba16-79930eda24ae-ovnkube-config\") pod \"ovnkube-node-ktgz9\" (UID: \"25263f75-a634-43a0-ba16-79930eda24ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktgz9" Jul 27 12:22:48.064071 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.064009 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/25263f75-a634-43a0-ba16-79930eda24ae-env-overrides\") pod \"ovnkube-node-ktgz9\" (UID: \"25263f75-a634-43a0-ba16-79930eda24ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktgz9" Jul 27 12:22:48.064071 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.064012 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7bd721fb-fc40-4f80-8ed4-0956b5b5343d-multus-cni-dir\") pod \"multus-22ct8\" (UID: \"7bd721fb-fc40-4f80-8ed4-0956b5b5343d\") " pod="openshift-multus/multus-22ct8" Jul 27 12:22:48.064071 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.064062 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bsqzd\" (UniqueName: \"kubernetes.io/projected/bf7a8649-39cb-471e-8d6e-2d55bb3d4e68-kube-api-access-bsqzd\") pod \"node-resolver-rr46t\" (UID: \"bf7a8649-39cb-471e-8d6e-2d55bb3d4e68\") " pod="openshift-dns/node-resolver-rr46t" Jul 27 12:22:48.064306 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.064093 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/cfbb87c2-555d-4b49-a675-d640a5793147-device-dir\") pod \"aws-ebs-csi-driver-node-n8dpc\" (UID: \"cfbb87c2-555d-4b49-a675-d640a5793147\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n8dpc" Jul 27 12:22:48.064306 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.064111 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7bd721fb-fc40-4f80-8ed4-0956b5b5343d-cnibin\") pod \"multus-22ct8\" (UID: \"7bd721fb-fc40-4f80-8ed4-0956b5b5343d\") " pod="openshift-multus/multus-22ct8" Jul 27 12:22:48.064306 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.064138 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7bd721fb-fc40-4f80-8ed4-0956b5b5343d-host-var-lib-cni-multus\") pod \"multus-22ct8\" (UID: \"7bd721fb-fc40-4f80-8ed4-0956b5b5343d\") " pod="openshift-multus/multus-22ct8" Jul 27 12:22:48.064306 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.064163 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5fdb7eea-5a10-47dd-930c-89239b36b74e-system-cni-dir\") pod \"multus-additional-cni-plugins-bzpr5\" (UID: \"5fdb7eea-5a10-47dd-930c-89239b36b74e\") " pod="openshift-multus/multus-additional-cni-plugins-bzpr5" Jul 27 12:22:48.064306 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.064186 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/25263f75-a634-43a0-ba16-79930eda24ae-systemd-units\") pod \"ovnkube-node-ktgz9\" (UID: \"25263f75-a634-43a0-ba16-79930eda24ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktgz9" Jul 27 12:22:48.064306 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.064201 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/25263f75-a634-43a0-ba16-79930eda24ae-etc-openvswitch\") pod \"ovnkube-node-ktgz9\" (UID: \"25263f75-a634-43a0-ba16-79930eda24ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktgz9" Jul 27 12:22:48.064306 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.064218 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/25263f75-a634-43a0-ba16-79930eda24ae-ovnkube-script-lib\") pod \"ovnkube-node-ktgz9\" (UID: \"25263f75-a634-43a0-ba16-79930eda24ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktgz9" Jul 27 12:22:48.064306 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.064234 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8x9dl\" (UniqueName: \"kubernetes.io/projected/41b1b110-9819-4966-966f-8fe838132d71-kube-api-access-8x9dl\") pod \"tuned-pfcwv\" (UID: \"41b1b110-9819-4966-966f-8fe838132d71\") " pod="openshift-cluster-node-tuning-operator/tuned-pfcwv" Jul 27 12:22:48.064306 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.064260 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7bd721fb-fc40-4f80-8ed4-0956b5b5343d-cni-binary-copy\") pod \"multus-22ct8\" (UID: \"7bd721fb-fc40-4f80-8ed4-0956b5b5343d\") " pod="openshift-multus/multus-22ct8" Jul 27 12:22:48.064727 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.064317 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7bd721fb-fc40-4f80-8ed4-0956b5b5343d-hostroot\") pod \"multus-22ct8\" (UID: \"7bd721fb-fc40-4f80-8ed4-0956b5b5343d\") " pod="openshift-multus/multus-22ct8" Jul 27 12:22:48.064727 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.064340 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/38ae6d3f-614b-4437-bb61-ad161748269f-kubelet-config\") pod \"global-pull-secret-syncer-sfvmh\" (UID: \"38ae6d3f-614b-4437-bb61-ad161748269f\") " pod="kube-system/global-pull-secret-syncer-sfvmh" Jul 27 12:22:48.064727 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.064358 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/41b1b110-9819-4966-966f-8fe838132d71-var-lib-kubelet\") pod \"tuned-pfcwv\" (UID: \"41b1b110-9819-4966-966f-8fe838132d71\") " pod="openshift-cluster-node-tuning-operator/tuned-pfcwv" Jul 27 12:22:48.064727 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.064373 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/41b1b110-9819-4966-966f-8fe838132d71-host\") pod \"tuned-pfcwv\" (UID: \"41b1b110-9819-4966-966f-8fe838132d71\") " pod="openshift-cluster-node-tuning-operator/tuned-pfcwv" Jul 27 12:22:48.064727 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.064395 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/41b1b110-9819-4966-966f-8fe838132d71-etc-tuned\") pod \"tuned-pfcwv\" (UID: \"41b1b110-9819-4966-966f-8fe838132d71\") " pod="openshift-cluster-node-tuning-operator/tuned-pfcwv" Jul 27 12:22:48.064727 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.064418 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7bd721fb-fc40-4f80-8ed4-0956b5b5343d-system-cni-dir\") pod \"multus-22ct8\" (UID: \"7bd721fb-fc40-4f80-8ed4-0956b5b5343d\") " pod="openshift-multus/multus-22ct8" Jul 27 12:22:48.064727 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.064445 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/25263f75-a634-43a0-ba16-79930eda24ae-host-slash\") pod \"ovnkube-node-ktgz9\" (UID: \"25263f75-a634-43a0-ba16-79930eda24ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktgz9" Jul 27 12:22:48.064727 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.064469 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/25263f75-a634-43a0-ba16-79930eda24ae-run-openvswitch\") pod \"ovnkube-node-ktgz9\" (UID: \"25263f75-a634-43a0-ba16-79930eda24ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktgz9" Jul 27 12:22:48.064727 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.064492 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/25263f75-a634-43a0-ba16-79930eda24ae-host-run-ovn-kubernetes\") pod \"ovnkube-node-ktgz9\" (UID: \"25263f75-a634-43a0-ba16-79930eda24ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktgz9" Jul 27 12:22:48.064727 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.064502 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/25263f75-a634-43a0-ba16-79930eda24ae-log-socket\") pod \"ovnkube-node-ktgz9\" (UID: \"25263f75-a634-43a0-ba16-79930eda24ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktgz9" Jul 27 12:22:48.064727 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.064523 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/162b7fac-bf33-40ac-9803-42ee68d8bc52-agent-certs\") pod \"konnectivity-agent-x45bt\" (UID: \"162b7fac-bf33-40ac-9803-42ee68d8bc52\") " pod="kube-system/konnectivity-agent-x45bt" Jul 27 12:22:48.064727 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.064527 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/25263f75-a634-43a0-ba16-79930eda24ae-ovnkube-config\") pod \"ovnkube-node-ktgz9\" (UID: \"25263f75-a634-43a0-ba16-79930eda24ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktgz9" Jul 27 12:22:48.064727 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.064559 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/cfbb87c2-555d-4b49-a675-d640a5793147-registration-dir\") pod \"aws-ebs-csi-driver-node-n8dpc\" (UID: \"cfbb87c2-555d-4b49-a675-d640a5793147\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n8dpc" Jul 27 12:22:48.064727 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.064561 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/cfbb87c2-555d-4b49-a675-d640a5793147-socket-dir\") pod \"aws-ebs-csi-driver-node-n8dpc\" (UID: \"cfbb87c2-555d-4b49-a675-d640a5793147\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n8dpc" Jul 27 12:22:48.064727 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.064597 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/25263f75-a634-43a0-ba16-79930eda24ae-run-systemd\") pod \"ovnkube-node-ktgz9\" (UID: \"25263f75-a634-43a0-ba16-79930eda24ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktgz9" Jul 27 12:22:48.064727 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.064625 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/cfbb87c2-555d-4b49-a675-d640a5793147-sys-fs\") pod \"aws-ebs-csi-driver-node-n8dpc\" (UID: \"cfbb87c2-555d-4b49-a675-d640a5793147\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n8dpc" Jul 27 12:22:48.064727 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.064631 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/82bda458-1d5c-44ae-8cd0-def7ee6470c0-host-slash\") pod \"iptables-alerter-lx8jr\" (UID: \"82bda458-1d5c-44ae-8cd0-def7ee6470c0\") " pod="openshift-network-operator/iptables-alerter-lx8jr" Jul 27 12:22:48.065593 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.064653 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/41b1b110-9819-4966-966f-8fe838132d71-etc-modprobe-d\") pod \"tuned-pfcwv\" (UID: \"41b1b110-9819-4966-966f-8fe838132d71\") " pod="openshift-cluster-node-tuning-operator/tuned-pfcwv" Jul 27 12:22:48.065593 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.064682 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wkmpw\" (UniqueName: \"kubernetes.io/projected/25263f75-a634-43a0-ba16-79930eda24ae-kube-api-access-wkmpw\") pod \"ovnkube-node-ktgz9\" (UID: \"25263f75-a634-43a0-ba16-79930eda24ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktgz9" Jul 27 12:22:48.065593 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.064724 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/162b7fac-bf33-40ac-9803-42ee68d8bc52-konnectivity-ca\") pod \"konnectivity-agent-x45bt\" (UID: \"162b7fac-bf33-40ac-9803-42ee68d8bc52\") " pod="kube-system/konnectivity-agent-x45bt" Jul 27 12:22:48.065593 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.064751 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/bf7a8649-39cb-471e-8d6e-2d55bb3d4e68-hosts-file\") pod \"node-resolver-rr46t\" (UID: \"bf7a8649-39cb-471e-8d6e-2d55bb3d4e68\") " pod="openshift-dns/node-resolver-rr46t" Jul 27 12:22:48.065593 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.064778 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/41b1b110-9819-4966-966f-8fe838132d71-etc-sysconfig\") pod \"tuned-pfcwv\" (UID: \"41b1b110-9819-4966-966f-8fe838132d71\") " pod="openshift-cluster-node-tuning-operator/tuned-pfcwv" Jul 27 12:22:48.065593 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.064759 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/cfbb87c2-555d-4b49-a675-d640a5793147-socket-dir\") pod \"aws-ebs-csi-driver-node-n8dpc\" (UID: \"cfbb87c2-555d-4b49-a675-d640a5793147\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n8dpc" Jul 27 12:22:48.065593 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.064806 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/41b1b110-9819-4966-966f-8fe838132d71-etc-sysctl-conf\") pod \"tuned-pfcwv\" (UID: \"41b1b110-9819-4966-966f-8fe838132d71\") " pod="openshift-cluster-node-tuning-operator/tuned-pfcwv" Jul 27 12:22:48.065593 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.064812 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/cfbb87c2-555d-4b49-a675-d640a5793147-sys-fs\") pod \"aws-ebs-csi-driver-node-n8dpc\" (UID: \"cfbb87c2-555d-4b49-a675-d640a5793147\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n8dpc" Jul 27 12:22:48.065593 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.064856 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/25263f75-a634-43a0-ba16-79930eda24ae-ovn-node-metrics-cert\") pod \"ovnkube-node-ktgz9\" (UID: \"25263f75-a634-43a0-ba16-79930eda24ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktgz9" Jul 27 12:22:48.065593 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.064865 2568 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 27 12:22:48.065593 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.064888 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/82bda458-1d5c-44ae-8cd0-def7ee6470c0-iptables-alerter-script\") pod \"iptables-alerter-lx8jr\" (UID: \"82bda458-1d5c-44ae-8cd0-def7ee6470c0\") " pod="openshift-network-operator/iptables-alerter-lx8jr" Jul 27 12:22:48.065593 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.064918 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/41b1b110-9819-4966-966f-8fe838132d71-etc-kubernetes\") pod \"tuned-pfcwv\" (UID: \"41b1b110-9819-4966-966f-8fe838132d71\") " pod="openshift-cluster-node-tuning-operator/tuned-pfcwv" Jul 27 12:22:48.065593 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.064944 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/41b1b110-9819-4966-966f-8fe838132d71-sys\") pod \"tuned-pfcwv\" (UID: \"41b1b110-9819-4966-966f-8fe838132d71\") " pod="openshift-cluster-node-tuning-operator/tuned-pfcwv" Jul 27 12:22:48.065593 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.064971 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7bd721fb-fc40-4f80-8ed4-0956b5b5343d-host-run-multus-certs\") pod \"multus-22ct8\" (UID: \"7bd721fb-fc40-4f80-8ed4-0956b5b5343d\") " pod="openshift-multus/multus-22ct8" Jul 27 12:22:48.065593 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.065238 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/25263f75-a634-43a0-ba16-79930eda24ae-ovnkube-script-lib\") pod \"ovnkube-node-ktgz9\" (UID: \"25263f75-a634-43a0-ba16-79930eda24ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktgz9" Jul 27 12:22:48.065593 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.065259 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/cfbb87c2-555d-4b49-a675-d640a5793147-device-dir\") pod \"aws-ebs-csi-driver-node-n8dpc\" (UID: \"cfbb87c2-555d-4b49-a675-d640a5793147\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n8dpc" Jul 27 12:22:48.065593 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.065289 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/25263f75-a634-43a0-ba16-79930eda24ae-systemd-units\") pod \"ovnkube-node-ktgz9\" (UID: \"25263f75-a634-43a0-ba16-79930eda24ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktgz9" Jul 27 12:22:48.066395 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.065315 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/bf7a8649-39cb-471e-8d6e-2d55bb3d4e68-hosts-file\") pod \"node-resolver-rr46t\" (UID: \"bf7a8649-39cb-471e-8d6e-2d55bb3d4e68\") " pod="openshift-dns/node-resolver-rr46t" Jul 27 12:22:48.066395 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.065322 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/25263f75-a634-43a0-ba16-79930eda24ae-etc-openvswitch\") pod \"ovnkube-node-ktgz9\" (UID: \"25263f75-a634-43a0-ba16-79930eda24ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktgz9" Jul 27 12:22:48.066395 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.065373 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/25263f75-a634-43a0-ba16-79930eda24ae-host-slash\") pod \"ovnkube-node-ktgz9\" (UID: \"25263f75-a634-43a0-ba16-79930eda24ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktgz9" Jul 27 12:22:48.066395 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.065401 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/162b7fac-bf33-40ac-9803-42ee68d8bc52-konnectivity-ca\") pod \"konnectivity-agent-x45bt\" (UID: \"162b7fac-bf33-40ac-9803-42ee68d8bc52\") " pod="kube-system/konnectivity-agent-x45bt" Jul 27 12:22:48.066395 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.065421 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/25263f75-a634-43a0-ba16-79930eda24ae-run-openvswitch\") pod \"ovnkube-node-ktgz9\" (UID: \"25263f75-a634-43a0-ba16-79930eda24ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktgz9" Jul 27 12:22:48.066395 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.065472 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/25263f75-a634-43a0-ba16-79930eda24ae-host-run-ovn-kubernetes\") pod \"ovnkube-node-ktgz9\" (UID: \"25263f75-a634-43a0-ba16-79930eda24ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktgz9" Jul 27 12:22:48.066395 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.065481 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bf7a8649-39cb-471e-8d6e-2d55bb3d4e68-tmp-dir\") pod \"node-resolver-rr46t\" (UID: \"bf7a8649-39cb-471e-8d6e-2d55bb3d4e68\") " pod="openshift-dns/node-resolver-rr46t" Jul 27 12:22:48.066395 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.065585 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/82bda458-1d5c-44ae-8cd0-def7ee6470c0-iptables-alerter-script\") pod \"iptables-alerter-lx8jr\" (UID: \"82bda458-1d5c-44ae-8cd0-def7ee6470c0\") " pod="openshift-network-operator/iptables-alerter-lx8jr" Jul 27 12:22:48.068993 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.068966 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/25263f75-a634-43a0-ba16-79930eda24ae-ovn-node-metrics-cert\") pod \"ovnkube-node-ktgz9\" (UID: \"25263f75-a634-43a0-ba16-79930eda24ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktgz9" Jul 27 12:22:48.069441 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.069418 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/162b7fac-bf33-40ac-9803-42ee68d8bc52-agent-certs\") pod \"konnectivity-agent-x45bt\" (UID: \"162b7fac-bf33-40ac-9803-42ee68d8bc52\") " pod="kube-system/konnectivity-agent-x45bt" Jul 27 12:22:48.074596 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.074386 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b7hd4\" (UniqueName: \"kubernetes.io/projected/82bda458-1d5c-44ae-8cd0-def7ee6470c0-kube-api-access-b7hd4\") pod \"iptables-alerter-lx8jr\" (UID: \"82bda458-1d5c-44ae-8cd0-def7ee6470c0\") " pod="openshift-network-operator/iptables-alerter-lx8jr" Jul 27 12:22:48.075729 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.075597 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wkmpw\" (UniqueName: \"kubernetes.io/projected/25263f75-a634-43a0-ba16-79930eda24ae-kube-api-access-wkmpw\") pod \"ovnkube-node-ktgz9\" (UID: \"25263f75-a634-43a0-ba16-79930eda24ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktgz9" Jul 27 12:22:48.076029 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.076008 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bsqzd\" (UniqueName: \"kubernetes.io/projected/bf7a8649-39cb-471e-8d6e-2d55bb3d4e68-kube-api-access-bsqzd\") pod \"node-resolver-rr46t\" (UID: \"bf7a8649-39cb-471e-8d6e-2d55bb3d4e68\") " pod="openshift-dns/node-resolver-rr46t" Jul 27 12:22:48.077162 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.077137 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5wlps\" (UniqueName: \"kubernetes.io/projected/cfbb87c2-555d-4b49-a675-d640a5793147-kube-api-access-5wlps\") pod \"aws-ebs-csi-driver-node-n8dpc\" (UID: \"cfbb87c2-555d-4b49-a675-d640a5793147\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n8dpc" Jul 27 12:22:48.161130 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.161070 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-3.ec2.internal" event={"ID":"36a46d688b7e502bc5634c748870ec91","Type":"ContainerStarted","Data":"f9b1ae5ac04907a1ef1e05049c85e0a96fcc4c910e4ad7b97233fe37c0d53d12"} Jul 27 12:22:48.162186 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.162154 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-3.ec2.internal" event={"ID":"cff9f289b3eaca0aa84c8bb4795faff0","Type":"ContainerStarted","Data":"84c9d562323558c4d44139d4cb3327f796d8877938e46db168fd5467290f5fb6"} Jul 27 12:22:48.165624 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.165596 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8x9dl\" (UniqueName: \"kubernetes.io/projected/41b1b110-9819-4966-966f-8fe838132d71-kube-api-access-8x9dl\") pod \"tuned-pfcwv\" (UID: \"41b1b110-9819-4966-966f-8fe838132d71\") " pod="openshift-cluster-node-tuning-operator/tuned-pfcwv" Jul 27 12:22:48.165738 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.165630 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7bd721fb-fc40-4f80-8ed4-0956b5b5343d-cni-binary-copy\") pod \"multus-22ct8\" (UID: \"7bd721fb-fc40-4f80-8ed4-0956b5b5343d\") " pod="openshift-multus/multus-22ct8" Jul 27 12:22:48.165738 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.165652 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7bd721fb-fc40-4f80-8ed4-0956b5b5343d-hostroot\") pod \"multus-22ct8\" (UID: \"7bd721fb-fc40-4f80-8ed4-0956b5b5343d\") " pod="openshift-multus/multus-22ct8" Jul 27 12:22:48.165738 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.165689 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7bd721fb-fc40-4f80-8ed4-0956b5b5343d-hostroot\") pod \"multus-22ct8\" (UID: \"7bd721fb-fc40-4f80-8ed4-0956b5b5343d\") " pod="openshift-multus/multus-22ct8" Jul 27 12:22:48.165926 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.165834 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/38ae6d3f-614b-4437-bb61-ad161748269f-kubelet-config\") pod \"global-pull-secret-syncer-sfvmh\" (UID: \"38ae6d3f-614b-4437-bb61-ad161748269f\") " pod="kube-system/global-pull-secret-syncer-sfvmh" Jul 27 12:22:48.165926 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.165867 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/41b1b110-9819-4966-966f-8fe838132d71-var-lib-kubelet\") pod \"tuned-pfcwv\" (UID: \"41b1b110-9819-4966-966f-8fe838132d71\") " pod="openshift-cluster-node-tuning-operator/tuned-pfcwv" Jul 27 12:22:48.165926 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.165892 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/41b1b110-9819-4966-966f-8fe838132d71-host\") pod \"tuned-pfcwv\" (UID: \"41b1b110-9819-4966-966f-8fe838132d71\") " pod="openshift-cluster-node-tuning-operator/tuned-pfcwv" Jul 27 12:22:48.165926 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.165894 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/38ae6d3f-614b-4437-bb61-ad161748269f-kubelet-config\") pod \"global-pull-secret-syncer-sfvmh\" (UID: \"38ae6d3f-614b-4437-bb61-ad161748269f\") " pod="kube-system/global-pull-secret-syncer-sfvmh" Jul 27 12:22:48.165926 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.165915 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/41b1b110-9819-4966-966f-8fe838132d71-etc-tuned\") pod \"tuned-pfcwv\" (UID: \"41b1b110-9819-4966-966f-8fe838132d71\") " pod="openshift-cluster-node-tuning-operator/tuned-pfcwv" Jul 27 12:22:48.166164 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.165937 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7bd721fb-fc40-4f80-8ed4-0956b5b5343d-system-cni-dir\") pod \"multus-22ct8\" (UID: \"7bd721fb-fc40-4f80-8ed4-0956b5b5343d\") " pod="openshift-multus/multus-22ct8" Jul 27 12:22:48.166164 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.165962 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/41b1b110-9819-4966-966f-8fe838132d71-host\") pod \"tuned-pfcwv\" (UID: \"41b1b110-9819-4966-966f-8fe838132d71\") " pod="openshift-cluster-node-tuning-operator/tuned-pfcwv" Jul 27 12:22:48.166164 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.165988 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/41b1b110-9819-4966-966f-8fe838132d71-var-lib-kubelet\") pod \"tuned-pfcwv\" (UID: \"41b1b110-9819-4966-966f-8fe838132d71\") " pod="openshift-cluster-node-tuning-operator/tuned-pfcwv" Jul 27 12:22:48.166164 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.166038 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7bd721fb-fc40-4f80-8ed4-0956b5b5343d-system-cni-dir\") pod \"multus-22ct8\" (UID: \"7bd721fb-fc40-4f80-8ed4-0956b5b5343d\") " pod="openshift-multus/multus-22ct8" Jul 27 12:22:48.166164 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.165966 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/41b1b110-9819-4966-966f-8fe838132d71-etc-modprobe-d\") pod \"tuned-pfcwv\" (UID: \"41b1b110-9819-4966-966f-8fe838132d71\") " pod="openshift-cluster-node-tuning-operator/tuned-pfcwv" Jul 27 12:22:48.166164 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.166125 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/41b1b110-9819-4966-966f-8fe838132d71-etc-sysconfig\") pod \"tuned-pfcwv\" (UID: \"41b1b110-9819-4966-966f-8fe838132d71\") " pod="openshift-cluster-node-tuning-operator/tuned-pfcwv" Jul 27 12:22:48.166164 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.166066 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/41b1b110-9819-4966-966f-8fe838132d71-etc-modprobe-d\") pod \"tuned-pfcwv\" (UID: \"41b1b110-9819-4966-966f-8fe838132d71\") " pod="openshift-cluster-node-tuning-operator/tuned-pfcwv" Jul 27 12:22:48.166164 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.166156 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/41b1b110-9819-4966-966f-8fe838132d71-etc-sysctl-conf\") pod \"tuned-pfcwv\" (UID: \"41b1b110-9819-4966-966f-8fe838132d71\") " pod="openshift-cluster-node-tuning-operator/tuned-pfcwv" Jul 27 12:22:48.166539 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.166172 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/41b1b110-9819-4966-966f-8fe838132d71-etc-sysconfig\") pod \"tuned-pfcwv\" (UID: \"41b1b110-9819-4966-966f-8fe838132d71\") " pod="openshift-cluster-node-tuning-operator/tuned-pfcwv" Jul 27 12:22:48.166539 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.166188 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/41b1b110-9819-4966-966f-8fe838132d71-etc-kubernetes\") pod \"tuned-pfcwv\" (UID: \"41b1b110-9819-4966-966f-8fe838132d71\") " pod="openshift-cluster-node-tuning-operator/tuned-pfcwv" Jul 27 12:22:48.166539 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.166212 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/41b1b110-9819-4966-966f-8fe838132d71-sys\") pod \"tuned-pfcwv\" (UID: \"41b1b110-9819-4966-966f-8fe838132d71\") " pod="openshift-cluster-node-tuning-operator/tuned-pfcwv" Jul 27 12:22:48.166539 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.166227 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7bd721fb-fc40-4f80-8ed4-0956b5b5343d-cni-binary-copy\") pod \"multus-22ct8\" (UID: \"7bd721fb-fc40-4f80-8ed4-0956b5b5343d\") " pod="openshift-multus/multus-22ct8" Jul 27 12:22:48.166539 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.166236 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7bd721fb-fc40-4f80-8ed4-0956b5b5343d-host-run-multus-certs\") pod \"multus-22ct8\" (UID: \"7bd721fb-fc40-4f80-8ed4-0956b5b5343d\") " pod="openshift-multus/multus-22ct8" Jul 27 12:22:48.166539 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.166260 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/41b1b110-9819-4966-966f-8fe838132d71-etc-kubernetes\") pod \"tuned-pfcwv\" (UID: \"41b1b110-9819-4966-966f-8fe838132d71\") " pod="openshift-cluster-node-tuning-operator/tuned-pfcwv" Jul 27 12:22:48.166539 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.166263 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5fdb7eea-5a10-47dd-930c-89239b36b74e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-bzpr5\" (UID: \"5fdb7eea-5a10-47dd-930c-89239b36b74e\") " pod="openshift-multus/multus-additional-cni-plugins-bzpr5" Jul 27 12:22:48.166539 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.166284 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/41b1b110-9819-4966-966f-8fe838132d71-sys\") pod \"tuned-pfcwv\" (UID: \"41b1b110-9819-4966-966f-8fe838132d71\") " pod="openshift-cluster-node-tuning-operator/tuned-pfcwv" Jul 27 12:22:48.166539 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.166297 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/41b1b110-9819-4966-966f-8fe838132d71-etc-sysctl-conf\") pod \"tuned-pfcwv\" (UID: \"41b1b110-9819-4966-966f-8fe838132d71\") " pod="openshift-cluster-node-tuning-operator/tuned-pfcwv" Jul 27 12:22:48.166539 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.166309 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7bd721fb-fc40-4f80-8ed4-0956b5b5343d-host-run-multus-certs\") pod \"multus-22ct8\" (UID: \"7bd721fb-fc40-4f80-8ed4-0956b5b5343d\") " pod="openshift-multus/multus-22ct8" Jul 27 12:22:48.166539 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.166307 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zk9tf\" (UniqueName: \"kubernetes.io/projected/ae5989c7-50c7-40bd-aac4-3383a9a9c435-kube-api-access-zk9tf\") pod \"network-metrics-daemon-4p2n8\" (UID: \"ae5989c7-50c7-40bd-aac4-3383a9a9c435\") " pod="openshift-multus/network-metrics-daemon-4p2n8" Jul 27 12:22:48.166539 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.166341 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/41b1b110-9819-4966-966f-8fe838132d71-tmp\") pod \"tuned-pfcwv\" (UID: \"41b1b110-9819-4966-966f-8fe838132d71\") " pod="openshift-cluster-node-tuning-operator/tuned-pfcwv" Jul 27 12:22:48.166539 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.166363 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7bd721fb-fc40-4f80-8ed4-0956b5b5343d-host-var-lib-cni-bin\") pod \"multus-22ct8\" (UID: \"7bd721fb-fc40-4f80-8ed4-0956b5b5343d\") " pod="openshift-multus/multus-22ct8" Jul 27 12:22:48.166539 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.166389 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dz2hg\" (UniqueName: \"kubernetes.io/projected/a80003d1-f5f7-442b-83c9-bba4bd72902a-kube-api-access-dz2hg\") pod \"node-ca-c6p2s\" (UID: \"a80003d1-f5f7-442b-83c9-bba4bd72902a\") " pod="openshift-image-registry/node-ca-c6p2s" Jul 27 12:22:48.166539 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.166399 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5fdb7eea-5a10-47dd-930c-89239b36b74e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-bzpr5\" (UID: \"5fdb7eea-5a10-47dd-930c-89239b36b74e\") " pod="openshift-multus/multus-additional-cni-plugins-bzpr5" Jul 27 12:22:48.166539 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.166433 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7bd721fb-fc40-4f80-8ed4-0956b5b5343d-host-var-lib-cni-bin\") pod \"multus-22ct8\" (UID: \"7bd721fb-fc40-4f80-8ed4-0956b5b5343d\") " pod="openshift-multus/multus-22ct8" Jul 27 12:22:48.166539 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.166456 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zmf6t\" (UniqueName: \"kubernetes.io/projected/5fdb7eea-5a10-47dd-930c-89239b36b74e-kube-api-access-zmf6t\") pod \"multus-additional-cni-plugins-bzpr5\" (UID: \"5fdb7eea-5a10-47dd-930c-89239b36b74e\") " pod="openshift-multus/multus-additional-cni-plugins-bzpr5" Jul 27 12:22:48.167294 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.166473 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ae5989c7-50c7-40bd-aac4-3383a9a9c435-metrics-certs\") pod \"network-metrics-daemon-4p2n8\" (UID: \"ae5989c7-50c7-40bd-aac4-3383a9a9c435\") " pod="openshift-multus/network-metrics-daemon-4p2n8" Jul 27 12:22:48.167294 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.166490 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/41b1b110-9819-4966-966f-8fe838132d71-etc-sysctl-d\") pod \"tuned-pfcwv\" (UID: \"41b1b110-9819-4966-966f-8fe838132d71\") " pod="openshift-cluster-node-tuning-operator/tuned-pfcwv" Jul 27 12:22:48.167294 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.166504 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7bd721fb-fc40-4f80-8ed4-0956b5b5343d-multus-daemon-config\") pod \"multus-22ct8\" (UID: \"7bd721fb-fc40-4f80-8ed4-0956b5b5343d\") " pod="openshift-multus/multus-22ct8" Jul 27 12:22:48.167294 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.166520 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7bd721fb-fc40-4f80-8ed4-0956b5b5343d-host-run-k8s-cni-cncf-io\") pod \"multus-22ct8\" (UID: \"7bd721fb-fc40-4f80-8ed4-0956b5b5343d\") " pod="openshift-multus/multus-22ct8" Jul 27 12:22:48.167294 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.166535 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7bd721fb-fc40-4f80-8ed4-0956b5b5343d-host-run-netns\") pod \"multus-22ct8\" (UID: \"7bd721fb-fc40-4f80-8ed4-0956b5b5343d\") " pod="openshift-multus/multus-22ct8" Jul 27 12:22:48.167294 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.166549 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/41b1b110-9819-4966-966f-8fe838132d71-etc-systemd\") pod \"tuned-pfcwv\" (UID: \"41b1b110-9819-4966-966f-8fe838132d71\") " pod="openshift-cluster-node-tuning-operator/tuned-pfcwv" Jul 27 12:22:48.167294 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.166565 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5fdb7eea-5a10-47dd-930c-89239b36b74e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-bzpr5\" (UID: \"5fdb7eea-5a10-47dd-930c-89239b36b74e\") " pod="openshift-multus/multus-additional-cni-plugins-bzpr5" Jul 27 12:22:48.167294 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:22:48.166568 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 12:22:48.167294 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.166582 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/41b1b110-9819-4966-966f-8fe838132d71-run\") pod \"tuned-pfcwv\" (UID: \"41b1b110-9819-4966-966f-8fe838132d71\") " pod="openshift-cluster-node-tuning-operator/tuned-pfcwv" Jul 27 12:22:48.167294 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.166600 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a80003d1-f5f7-442b-83c9-bba4bd72902a-host\") pod \"node-ca-c6p2s\" (UID: \"a80003d1-f5f7-442b-83c9-bba4bd72902a\") " pod="openshift-image-registry/node-ca-c6p2s" Jul 27 12:22:48.167294 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:22:48.166629 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae5989c7-50c7-40bd-aac4-3383a9a9c435-metrics-certs podName:ae5989c7-50c7-40bd-aac4-3383a9a9c435 nodeName:}" failed. No retries permitted until 2026-07-27 12:22:48.666609445 +0000 UTC m=+3.069744299 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ae5989c7-50c7-40bd-aac4-3383a9a9c435-metrics-certs") pod "network-metrics-daemon-4p2n8" (UID: "ae5989c7-50c7-40bd-aac4-3383a9a9c435") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 12:22:48.167294 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.166629 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7bd721fb-fc40-4f80-8ed4-0956b5b5343d-host-run-k8s-cni-cncf-io\") pod \"multus-22ct8\" (UID: \"7bd721fb-fc40-4f80-8ed4-0956b5b5343d\") " pod="openshift-multus/multus-22ct8" Jul 27 12:22:48.167294 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.166647 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a80003d1-f5f7-442b-83c9-bba4bd72902a-host\") pod \"node-ca-c6p2s\" (UID: \"a80003d1-f5f7-442b-83c9-bba4bd72902a\") " pod="openshift-image-registry/node-ca-c6p2s" Jul 27 12:22:48.167294 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.166662 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5fdb7eea-5a10-47dd-930c-89239b36b74e-cnibin\") pod \"multus-additional-cni-plugins-bzpr5\" (UID: \"5fdb7eea-5a10-47dd-930c-89239b36b74e\") " pod="openshift-multus/multus-additional-cni-plugins-bzpr5" Jul 27 12:22:48.167294 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.166690 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5fdb7eea-5a10-47dd-930c-89239b36b74e-os-release\") pod \"multus-additional-cni-plugins-bzpr5\" (UID: \"5fdb7eea-5a10-47dd-930c-89239b36b74e\") " pod="openshift-multus/multus-additional-cni-plugins-bzpr5" Jul 27 12:22:48.167294 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.166701 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/41b1b110-9819-4966-966f-8fe838132d71-etc-systemd\") pod \"tuned-pfcwv\" (UID: \"41b1b110-9819-4966-966f-8fe838132d71\") " pod="openshift-cluster-node-tuning-operator/tuned-pfcwv" Jul 27 12:22:48.167294 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.166739 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vsjpz\" (UniqueName: \"kubernetes.io/projected/fdfb006f-abc1-4762-9c0b-15b1159e2d8e-kube-api-access-vsjpz\") pod \"network-check-target-8vcwp\" (UID: \"fdfb006f-abc1-4762-9c0b-15b1159e2d8e\") " pod="openshift-network-diagnostics/network-check-target-8vcwp" Jul 27 12:22:48.168140 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.166765 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/38ae6d3f-614b-4437-bb61-ad161748269f-original-pull-secret\") pod \"global-pull-secret-syncer-sfvmh\" (UID: \"38ae6d3f-614b-4437-bb61-ad161748269f\") " pod="kube-system/global-pull-secret-syncer-sfvmh" Jul 27 12:22:48.168140 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.166771 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/41b1b110-9819-4966-966f-8fe838132d71-etc-sysctl-d\") pod \"tuned-pfcwv\" (UID: \"41b1b110-9819-4966-966f-8fe838132d71\") " pod="openshift-cluster-node-tuning-operator/tuned-pfcwv" Jul 27 12:22:48.168140 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.166791 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/41b1b110-9819-4966-966f-8fe838132d71-lib-modules\") pod \"tuned-pfcwv\" (UID: \"41b1b110-9819-4966-966f-8fe838132d71\") " pod="openshift-cluster-node-tuning-operator/tuned-pfcwv" Jul 27 12:22:48.168140 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.166816 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7bd721fb-fc40-4f80-8ed4-0956b5b5343d-multus-conf-dir\") pod \"multus-22ct8\" (UID: \"7bd721fb-fc40-4f80-8ed4-0956b5b5343d\") " pod="openshift-multus/multus-22ct8" Jul 27 12:22:48.168140 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.166840 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5fdb7eea-5a10-47dd-930c-89239b36b74e-os-release\") pod \"multus-additional-cni-plugins-bzpr5\" (UID: \"5fdb7eea-5a10-47dd-930c-89239b36b74e\") " pod="openshift-multus/multus-additional-cni-plugins-bzpr5" Jul 27 12:22:48.168140 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.166845 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a80003d1-f5f7-442b-83c9-bba4bd72902a-serviceca\") pod \"node-ca-c6p2s\" (UID: \"a80003d1-f5f7-442b-83c9-bba4bd72902a\") " pod="openshift-image-registry/node-ca-c6p2s" Jul 27 12:22:48.168140 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.166878 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7bd721fb-fc40-4f80-8ed4-0956b5b5343d-host-var-lib-kubelet\") pod \"multus-22ct8\" (UID: \"7bd721fb-fc40-4f80-8ed4-0956b5b5343d\") " pod="openshift-multus/multus-22ct8" Jul 27 12:22:48.168140 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.166902 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/38ae6d3f-614b-4437-bb61-ad161748269f-dbus\") pod \"global-pull-secret-syncer-sfvmh\" (UID: \"38ae6d3f-614b-4437-bb61-ad161748269f\") " pod="kube-system/global-pull-secret-syncer-sfvmh" Jul 27 12:22:48.168140 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.166929 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7bd721fb-fc40-4f80-8ed4-0956b5b5343d-os-release\") pod \"multus-22ct8\" (UID: \"7bd721fb-fc40-4f80-8ed4-0956b5b5343d\") " pod="openshift-multus/multus-22ct8" Jul 27 12:22:48.168140 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.166952 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7bd721fb-fc40-4f80-8ed4-0956b5b5343d-etc-kubernetes\") pod \"multus-22ct8\" (UID: \"7bd721fb-fc40-4f80-8ed4-0956b5b5343d\") " pod="openshift-multus/multus-22ct8" Jul 27 12:22:48.168140 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.166981 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7bd721fb-fc40-4f80-8ed4-0956b5b5343d-multus-socket-dir-parent\") pod \"multus-22ct8\" (UID: \"7bd721fb-fc40-4f80-8ed4-0956b5b5343d\") " pod="openshift-multus/multus-22ct8" Jul 27 12:22:48.168140 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.167006 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jw8td\" (UniqueName: \"kubernetes.io/projected/7bd721fb-fc40-4f80-8ed4-0956b5b5343d-kube-api-access-jw8td\") pod \"multus-22ct8\" (UID: \"7bd721fb-fc40-4f80-8ed4-0956b5b5343d\") " pod="openshift-multus/multus-22ct8" Jul 27 12:22:48.168140 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.167030 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5fdb7eea-5a10-47dd-930c-89239b36b74e-cni-binary-copy\") pod \"multus-additional-cni-plugins-bzpr5\" (UID: \"5fdb7eea-5a10-47dd-930c-89239b36b74e\") " pod="openshift-multus/multus-additional-cni-plugins-bzpr5" Jul 27 12:22:48.168140 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.167055 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5fdb7eea-5a10-47dd-930c-89239b36b74e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-bzpr5\" (UID: \"5fdb7eea-5a10-47dd-930c-89239b36b74e\") " pod="openshift-multus/multus-additional-cni-plugins-bzpr5" Jul 27 12:22:48.168140 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.167083 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7bd721fb-fc40-4f80-8ed4-0956b5b5343d-multus-cni-dir\") pod \"multus-22ct8\" (UID: \"7bd721fb-fc40-4f80-8ed4-0956b5b5343d\") " pod="openshift-multus/multus-22ct8" Jul 27 12:22:48.168140 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.167107 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7bd721fb-fc40-4f80-8ed4-0956b5b5343d-cnibin\") pod \"multus-22ct8\" (UID: \"7bd721fb-fc40-4f80-8ed4-0956b5b5343d\") " pod="openshift-multus/multus-22ct8" Jul 27 12:22:48.168140 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.167130 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7bd721fb-fc40-4f80-8ed4-0956b5b5343d-host-var-lib-cni-multus\") pod \"multus-22ct8\" (UID: \"7bd721fb-fc40-4f80-8ed4-0956b5b5343d\") " pod="openshift-multus/multus-22ct8" Jul 27 12:22:48.168783 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.167155 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5fdb7eea-5a10-47dd-930c-89239b36b74e-system-cni-dir\") pod \"multus-additional-cni-plugins-bzpr5\" (UID: \"5fdb7eea-5a10-47dd-930c-89239b36b74e\") " pod="openshift-multus/multus-additional-cni-plugins-bzpr5" Jul 27 12:22:48.168783 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.167191 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7bd721fb-fc40-4f80-8ed4-0956b5b5343d-host-run-netns\") pod \"multus-22ct8\" (UID: \"7bd721fb-fc40-4f80-8ed4-0956b5b5343d\") " pod="openshift-multus/multus-22ct8" Jul 27 12:22:48.168783 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.167155 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7bd721fb-fc40-4f80-8ed4-0956b5b5343d-multus-daemon-config\") pod \"multus-22ct8\" (UID: \"7bd721fb-fc40-4f80-8ed4-0956b5b5343d\") " pod="openshift-multus/multus-22ct8" Jul 27 12:22:48.168783 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.167244 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5fdb7eea-5a10-47dd-930c-89239b36b74e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-bzpr5\" (UID: \"5fdb7eea-5a10-47dd-930c-89239b36b74e\") " pod="openshift-multus/multus-additional-cni-plugins-bzpr5" Jul 27 12:22:48.168783 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.167354 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5fdb7eea-5a10-47dd-930c-89239b36b74e-cnibin\") pod \"multus-additional-cni-plugins-bzpr5\" (UID: \"5fdb7eea-5a10-47dd-930c-89239b36b74e\") " pod="openshift-multus/multus-additional-cni-plugins-bzpr5" Jul 27 12:22:48.168783 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.167370 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/41b1b110-9819-4966-966f-8fe838132d71-run\") pod \"tuned-pfcwv\" (UID: \"41b1b110-9819-4966-966f-8fe838132d71\") " pod="openshift-cluster-node-tuning-operator/tuned-pfcwv" Jul 27 12:22:48.168783 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.167397 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7bd721fb-fc40-4f80-8ed4-0956b5b5343d-host-var-lib-kubelet\") pod \"multus-22ct8\" (UID: \"7bd721fb-fc40-4f80-8ed4-0956b5b5343d\") " pod="openshift-multus/multus-22ct8" Jul 27 12:22:48.168783 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.167435 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7bd721fb-fc40-4f80-8ed4-0956b5b5343d-os-release\") pod \"multus-22ct8\" (UID: \"7bd721fb-fc40-4f80-8ed4-0956b5b5343d\") " pod="openshift-multus/multus-22ct8" Jul 27 12:22:48.168783 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.167529 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7bd721fb-fc40-4f80-8ed4-0956b5b5343d-multus-cni-dir\") pod \"multus-22ct8\" (UID: \"7bd721fb-fc40-4f80-8ed4-0956b5b5343d\") " pod="openshift-multus/multus-22ct8" Jul 27 12:22:48.168783 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.167530 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/38ae6d3f-614b-4437-bb61-ad161748269f-dbus\") pod \"global-pull-secret-syncer-sfvmh\" (UID: \"38ae6d3f-614b-4437-bb61-ad161748269f\") " pod="kube-system/global-pull-secret-syncer-sfvmh" Jul 27 12:22:48.168783 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.167562 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7bd721fb-fc40-4f80-8ed4-0956b5b5343d-etc-kubernetes\") pod \"multus-22ct8\" (UID: \"7bd721fb-fc40-4f80-8ed4-0956b5b5343d\") " pod="openshift-multus/multus-22ct8" Jul 27 12:22:48.168783 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.167592 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7bd721fb-fc40-4f80-8ed4-0956b5b5343d-cnibin\") pod \"multus-22ct8\" (UID: \"7bd721fb-fc40-4f80-8ed4-0956b5b5343d\") " pod="openshift-multus/multus-22ct8" Jul 27 12:22:48.168783 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.167614 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7bd721fb-fc40-4f80-8ed4-0956b5b5343d-multus-socket-dir-parent\") pod \"multus-22ct8\" (UID: \"7bd721fb-fc40-4f80-8ed4-0956b5b5343d\") " pod="openshift-multus/multus-22ct8" Jul 27 12:22:48.168783 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.167632 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7bd721fb-fc40-4f80-8ed4-0956b5b5343d-host-var-lib-cni-multus\") pod \"multus-22ct8\" (UID: \"7bd721fb-fc40-4f80-8ed4-0956b5b5343d\") " pod="openshift-multus/multus-22ct8" Jul 27 12:22:48.168783 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.167653 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5fdb7eea-5a10-47dd-930c-89239b36b74e-system-cni-dir\") pod \"multus-additional-cni-plugins-bzpr5\" (UID: \"5fdb7eea-5a10-47dd-930c-89239b36b74e\") " pod="openshift-multus/multus-additional-cni-plugins-bzpr5" Jul 27 12:22:48.168783 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:22:48.167727 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 27 12:22:48.168783 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.167769 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/41b1b110-9819-4966-966f-8fe838132d71-lib-modules\") pod \"tuned-pfcwv\" (UID: \"41b1b110-9819-4966-966f-8fe838132d71\") " pod="openshift-cluster-node-tuning-operator/tuned-pfcwv" Jul 27 12:22:48.168783 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:22:48.167774 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38ae6d3f-614b-4437-bb61-ad161748269f-original-pull-secret podName:38ae6d3f-614b-4437-bb61-ad161748269f nodeName:}" failed. No retries permitted until 2026-07-27 12:22:48.667759083 +0000 UTC m=+3.070893922 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/38ae6d3f-614b-4437-bb61-ad161748269f-original-pull-secret") pod "global-pull-secret-syncer-sfvmh" (UID: "38ae6d3f-614b-4437-bb61-ad161748269f") : object "kube-system"/"original-pull-secret" not registered Jul 27 12:22:48.169420 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.167823 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7bd721fb-fc40-4f80-8ed4-0956b5b5343d-multus-conf-dir\") pod \"multus-22ct8\" (UID: \"7bd721fb-fc40-4f80-8ed4-0956b5b5343d\") " pod="openshift-multus/multus-22ct8" Jul 27 12:22:48.169420 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.167840 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a80003d1-f5f7-442b-83c9-bba4bd72902a-serviceca\") pod \"node-ca-c6p2s\" (UID: \"a80003d1-f5f7-442b-83c9-bba4bd72902a\") " pod="openshift-image-registry/node-ca-c6p2s" Jul 27 12:22:48.169420 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.167865 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5fdb7eea-5a10-47dd-930c-89239b36b74e-cni-binary-copy\") pod \"multus-additional-cni-plugins-bzpr5\" (UID: \"5fdb7eea-5a10-47dd-930c-89239b36b74e\") " pod="openshift-multus/multus-additional-cni-plugins-bzpr5" Jul 27 12:22:48.169420 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.168272 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5fdb7eea-5a10-47dd-930c-89239b36b74e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-bzpr5\" (UID: \"5fdb7eea-5a10-47dd-930c-89239b36b74e\") " pod="openshift-multus/multus-additional-cni-plugins-bzpr5" Jul 27 12:22:48.169420 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.168615 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/41b1b110-9819-4966-966f-8fe838132d71-etc-tuned\") pod \"tuned-pfcwv\" (UID: \"41b1b110-9819-4966-966f-8fe838132d71\") " pod="openshift-cluster-node-tuning-operator/tuned-pfcwv" Jul 27 12:22:48.169420 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.169075 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/41b1b110-9819-4966-966f-8fe838132d71-tmp\") pod \"tuned-pfcwv\" (UID: \"41b1b110-9819-4966-966f-8fe838132d71\") " pod="openshift-cluster-node-tuning-operator/tuned-pfcwv" Jul 27 12:22:48.176141 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:22:48.176106 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 27 12:22:48.176141 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:22:48.176132 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 27 12:22:48.176314 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:22:48.176148 2568 projected.go:196] Error preparing data for projected volume kube-api-access-vsjpz for pod openshift-network-diagnostics/network-check-target-8vcwp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 12:22:48.176314 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:22:48.176223 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fdfb006f-abc1-4762-9c0b-15b1159e2d8e-kube-api-access-vsjpz podName:fdfb006f-abc1-4762-9c0b-15b1159e2d8e nodeName:}" failed. No retries permitted until 2026-07-27 12:22:48.676206706 +0000 UTC m=+3.079341563 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-vsjpz" (UniqueName: "kubernetes.io/projected/fdfb006f-abc1-4762-9c0b-15b1159e2d8e-kube-api-access-vsjpz") pod "network-check-target-8vcwp" (UID: "fdfb006f-abc1-4762-9c0b-15b1159e2d8e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 12:22:48.177008 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.176986 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8x9dl\" (UniqueName: \"kubernetes.io/projected/41b1b110-9819-4966-966f-8fe838132d71-kube-api-access-8x9dl\") pod \"tuned-pfcwv\" (UID: \"41b1b110-9819-4966-966f-8fe838132d71\") " pod="openshift-cluster-node-tuning-operator/tuned-pfcwv" Jul 27 12:22:48.177767 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.177737 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zk9tf\" (UniqueName: \"kubernetes.io/projected/ae5989c7-50c7-40bd-aac4-3383a9a9c435-kube-api-access-zk9tf\") pod \"network-metrics-daemon-4p2n8\" (UID: \"ae5989c7-50c7-40bd-aac4-3383a9a9c435\") " pod="openshift-multus/network-metrics-daemon-4p2n8" Jul 27 12:22:48.177982 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.177961 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dz2hg\" (UniqueName: \"kubernetes.io/projected/a80003d1-f5f7-442b-83c9-bba4bd72902a-kube-api-access-dz2hg\") pod \"node-ca-c6p2s\" (UID: \"a80003d1-f5f7-442b-83c9-bba4bd72902a\") " pod="openshift-image-registry/node-ca-c6p2s" Jul 27 12:22:48.178183 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.178167 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zmf6t\" (UniqueName: \"kubernetes.io/projected/5fdb7eea-5a10-47dd-930c-89239b36b74e-kube-api-access-zmf6t\") pod \"multus-additional-cni-plugins-bzpr5\" (UID: \"5fdb7eea-5a10-47dd-930c-89239b36b74e\") " pod="openshift-multus/multus-additional-cni-plugins-bzpr5" Jul 27 12:22:48.178749 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.178730 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jw8td\" (UniqueName: \"kubernetes.io/projected/7bd721fb-fc40-4f80-8ed4-0956b5b5343d-kube-api-access-jw8td\") pod \"multus-22ct8\" (UID: \"7bd721fb-fc40-4f80-8ed4-0956b5b5343d\") " pod="openshift-multus/multus-22ct8" Jul 27 12:22:48.255551 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.255460 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-rr46t" Jul 27 12:22:48.264646 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.264620 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n8dpc" Jul 27 12:22:48.276423 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.276392 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-lx8jr" Jul 27 12:22:48.281138 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.281113 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-ktgz9" Jul 27 12:22:48.288989 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.288968 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-x45bt" Jul 27 12:22:48.295598 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.295578 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-pfcwv" Jul 27 12:22:48.303224 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.303207 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-22ct8" Jul 27 12:22:48.311055 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.311033 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-c6p2s" Jul 27 12:22:48.318626 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.318609 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-bzpr5" Jul 27 12:22:48.670451 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.670372 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ae5989c7-50c7-40bd-aac4-3383a9a9c435-metrics-certs\") pod \"network-metrics-daemon-4p2n8\" (UID: \"ae5989c7-50c7-40bd-aac4-3383a9a9c435\") " pod="openshift-multus/network-metrics-daemon-4p2n8" Jul 27 12:22:48.670451 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.670415 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/38ae6d3f-614b-4437-bb61-ad161748269f-original-pull-secret\") pod \"global-pull-secret-syncer-sfvmh\" (UID: \"38ae6d3f-614b-4437-bb61-ad161748269f\") " pod="kube-system/global-pull-secret-syncer-sfvmh" Jul 27 12:22:48.670671 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:22:48.670525 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 12:22:48.670671 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:22:48.670585 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae5989c7-50c7-40bd-aac4-3383a9a9c435-metrics-certs podName:ae5989c7-50c7-40bd-aac4-3383a9a9c435 nodeName:}" failed. No retries permitted until 2026-07-27 12:22:49.6705709 +0000 UTC m=+4.073705734 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ae5989c7-50c7-40bd-aac4-3383a9a9c435-metrics-certs") pod "network-metrics-daemon-4p2n8" (UID: "ae5989c7-50c7-40bd-aac4-3383a9a9c435") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 12:22:48.670671 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:22:48.670525 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 27 12:22:48.670671 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:22:48.670651 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38ae6d3f-614b-4437-bb61-ad161748269f-original-pull-secret podName:38ae6d3f-614b-4437-bb61-ad161748269f nodeName:}" failed. No retries permitted until 2026-07-27 12:22:49.670637619 +0000 UTC m=+4.073772453 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/38ae6d3f-614b-4437-bb61-ad161748269f-original-pull-secret") pod "global-pull-secret-syncer-sfvmh" (UID: "38ae6d3f-614b-4437-bb61-ad161748269f") : object "kube-system"/"original-pull-secret" not registered Jul 27 12:22:48.770875 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:48.770846 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vsjpz\" (UniqueName: \"kubernetes.io/projected/fdfb006f-abc1-4762-9c0b-15b1159e2d8e-kube-api-access-vsjpz\") pod \"network-check-target-8vcwp\" (UID: \"fdfb006f-abc1-4762-9c0b-15b1159e2d8e\") " pod="openshift-network-diagnostics/network-check-target-8vcwp" Jul 27 12:22:48.771025 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:22:48.770991 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 27 12:22:48.771025 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:22:48.771015 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 27 12:22:48.771025 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:22:48.771024 2568 projected.go:196] Error preparing data for projected volume kube-api-access-vsjpz for pod openshift-network-diagnostics/network-check-target-8vcwp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 12:22:48.771153 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:22:48.771078 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fdfb006f-abc1-4762-9c0b-15b1159e2d8e-kube-api-access-vsjpz podName:fdfb006f-abc1-4762-9c0b-15b1159e2d8e nodeName:}" failed. No retries permitted until 2026-07-27 12:22:49.77106282 +0000 UTC m=+4.174197654 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-vsjpz" (UniqueName: "kubernetes.io/projected/fdfb006f-abc1-4762-9c0b-15b1159e2d8e-kube-api-access-vsjpz") pod "network-check-target-8vcwp" (UID: "fdfb006f-abc1-4762-9c0b-15b1159e2d8e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 12:22:49.006341 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:49.006250 2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-26 12:17:47 +0000 UTC" deadline="2028-01-05 20:51:11.953331841 +0000 UTC" Jul 27 12:22:49.006341 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:49.006284 2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12656h28m22.94705185s" Jul 27 12:22:49.094894 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:49.094835 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fdb7eea_5a10_47dd_930c_89239b36b74e.slice/crio-a2974583d6216a49b864fd2c3f3672f028b739e4f673c62d4d4965007e738d17 WatchSource:0}: Error finding container a2974583d6216a49b864fd2c3f3672f028b739e4f673c62d4d4965007e738d17: Status 404 returned error can't find the container with id a2974583d6216a49b864fd2c3f3672f028b739e4f673c62d4d4965007e738d17 Jul 27 12:22:49.096071 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:49.096045 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf7a8649_39cb_471e_8d6e_2d55bb3d4e68.slice/crio-09540f6609b6c5ff8d8264892b0af5e03c7986279adfac5394d5352ce2e0379c WatchSource:0}: Error finding container 09540f6609b6c5ff8d8264892b0af5e03c7986279adfac5394d5352ce2e0379c: Status 404 returned error can't find the container with id 09540f6609b6c5ff8d8264892b0af5e03c7986279adfac5394d5352ce2e0379c Jul 27 12:22:49.097568 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:49.097430 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25263f75_a634_43a0_ba16_79930eda24ae.slice/crio-ea413b955c62dfd9817777ceb05402931cbeb634a837634218cd345ab0f2c5d9 WatchSource:0}: Error finding container ea413b955c62dfd9817777ceb05402931cbeb634a837634218cd345ab0f2c5d9: Status 404 returned error can't find the container with id ea413b955c62dfd9817777ceb05402931cbeb634a837634218cd345ab0f2c5d9 Jul 27 12:22:49.098453 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:49.098380 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7bd721fb_fc40_4f80_8ed4_0956b5b5343d.slice/crio-1170d167feb269ad4dbe771b6f0fda8634775fd5a673ba5ab74d1859c4aa16b4 WatchSource:0}: Error finding container 1170d167feb269ad4dbe771b6f0fda8634775fd5a673ba5ab74d1859c4aa16b4: Status 404 returned error can't find the container with id 1170d167feb269ad4dbe771b6f0fda8634775fd5a673ba5ab74d1859c4aa16b4 Jul 27 12:22:49.119568 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:49.119539 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcfbb87c2_555d_4b49_a675_d640a5793147.slice/crio-53b35348377d515cef1c6d0ac70c45695f97c36bf79839e46f062c0244cb4249 WatchSource:0}: Error finding container 53b35348377d515cef1c6d0ac70c45695f97c36bf79839e46f062c0244cb4249: Status 404 returned error can't find the container with id 53b35348377d515cef1c6d0ac70c45695f97c36bf79839e46f062c0244cb4249 Jul 27 12:22:49.121634 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:49.121613 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41b1b110_9819_4966_966f_8fe838132d71.slice/crio-0ec34a1fee4f0e7265f296378c9b3fcc28928330b48492e94195ad3b1697b446 WatchSource:0}: Error finding container 0ec34a1fee4f0e7265f296378c9b3fcc28928330b48492e94195ad3b1697b446: Status 404 returned error can't find the container with id 0ec34a1fee4f0e7265f296378c9b3fcc28928330b48492e94195ad3b1697b446 Jul 27 12:22:49.122759 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:49.122733 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82bda458_1d5c_44ae_8cd0_def7ee6470c0.slice/crio-8e6ef2821c23b658a4e8f345081cefc9ed32e3e4edfc74cbab09b141a662e100 WatchSource:0}: Error finding container 8e6ef2821c23b658a4e8f345081cefc9ed32e3e4edfc74cbab09b141a662e100: Status 404 returned error can't find the container with id 8e6ef2821c23b658a4e8f345081cefc9ed32e3e4edfc74cbab09b141a662e100 Jul 27 12:22:49.123780 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:49.123764 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod162b7fac_bf33_40ac_9803_42ee68d8bc52.slice/crio-0b0d1bde0c9cf63583895ae6d117ac1d3ad74e1e500d8eb0ccf28c3703c47d4d WatchSource:0}: Error finding container 0b0d1bde0c9cf63583895ae6d117ac1d3ad74e1e500d8eb0ccf28c3703c47d4d: Status 404 returned error can't find the container with id 0b0d1bde0c9cf63583895ae6d117ac1d3ad74e1e500d8eb0ccf28c3703c47d4d Jul 27 12:22:49.124191 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:22:49.124166 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda80003d1_f5f7_442b_83c9_bba4bd72902a.slice/crio-d69f74cc3349a92658b83c614aec83e9c6cd9dc2af3778777e80899ca9460163 WatchSource:0}: Error finding container d69f74cc3349a92658b83c614aec83e9c6cd9dc2af3778777e80899ca9460163: Status 404 returned error can't find the container with id d69f74cc3349a92658b83c614aec83e9c6cd9dc2af3778777e80899ca9460163 Jul 27 12:22:49.156632 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:49.156606 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4p2n8" Jul 27 12:22:49.156790 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:22:49.156760 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4p2n8" podUID="ae5989c7-50c7-40bd-aac4-3383a9a9c435" Jul 27 12:22:49.165029 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:49.165002 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-pfcwv" event={"ID":"41b1b110-9819-4966-966f-8fe838132d71","Type":"ContainerStarted","Data":"0ec34a1fee4f0e7265f296378c9b3fcc28928330b48492e94195ad3b1697b446"} Jul 27 12:22:49.169317 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:49.169187 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n8dpc" event={"ID":"cfbb87c2-555d-4b49-a675-d640a5793147","Type":"ContainerStarted","Data":"53b35348377d515cef1c6d0ac70c45695f97c36bf79839e46f062c0244cb4249"} Jul 27 12:22:49.171525 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:49.171503 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-22ct8" event={"ID":"7bd721fb-fc40-4f80-8ed4-0956b5b5343d","Type":"ContainerStarted","Data":"1170d167feb269ad4dbe771b6f0fda8634775fd5a673ba5ab74d1859c4aa16b4"} Jul 27 12:22:49.172535 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:49.172507 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-x45bt" event={"ID":"162b7fac-bf33-40ac-9803-42ee68d8bc52","Type":"ContainerStarted","Data":"0b0d1bde0c9cf63583895ae6d117ac1d3ad74e1e500d8eb0ccf28c3703c47d4d"} Jul 27 12:22:49.173580 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:49.173554 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-rr46t" event={"ID":"bf7a8649-39cb-471e-8d6e-2d55bb3d4e68","Type":"ContainerStarted","Data":"09540f6609b6c5ff8d8264892b0af5e03c7986279adfac5394d5352ce2e0379c"} Jul 27 12:22:49.174534 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:49.174510 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ktgz9" event={"ID":"25263f75-a634-43a0-ba16-79930eda24ae","Type":"ContainerStarted","Data":"ea413b955c62dfd9817777ceb05402931cbeb634a837634218cd345ab0f2c5d9"} Jul 27 12:22:49.176206 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:49.176183 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bzpr5" event={"ID":"5fdb7eea-5a10-47dd-930c-89239b36b74e","Type":"ContainerStarted","Data":"a2974583d6216a49b864fd2c3f3672f028b739e4f673c62d4d4965007e738d17"} Jul 27 12:22:49.177310 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:49.177291 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-c6p2s" event={"ID":"a80003d1-f5f7-442b-83c9-bba4bd72902a","Type":"ContainerStarted","Data":"d69f74cc3349a92658b83c614aec83e9c6cd9dc2af3778777e80899ca9460163"} Jul 27 12:22:49.178395 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:49.178373 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-lx8jr" event={"ID":"82bda458-1d5c-44ae-8cd0-def7ee6470c0","Type":"ContainerStarted","Data":"8e6ef2821c23b658a4e8f345081cefc9ed32e3e4edfc74cbab09b141a662e100"} Jul 27 12:22:49.676140 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:49.676025 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/38ae6d3f-614b-4437-bb61-ad161748269f-original-pull-secret\") pod \"global-pull-secret-syncer-sfvmh\" (UID: \"38ae6d3f-614b-4437-bb61-ad161748269f\") " pod="kube-system/global-pull-secret-syncer-sfvmh" Jul 27 12:22:49.676140 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:49.676115 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ae5989c7-50c7-40bd-aac4-3383a9a9c435-metrics-certs\") pod \"network-metrics-daemon-4p2n8\" (UID: \"ae5989c7-50c7-40bd-aac4-3383a9a9c435\") " pod="openshift-multus/network-metrics-daemon-4p2n8" Jul 27 12:22:49.676395 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:22:49.676240 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 12:22:49.676395 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:22:49.676304 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae5989c7-50c7-40bd-aac4-3383a9a9c435-metrics-certs podName:ae5989c7-50c7-40bd-aac4-3383a9a9c435 nodeName:}" failed. No retries permitted until 2026-07-27 12:22:51.676285856 +0000 UTC m=+6.079420715 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ae5989c7-50c7-40bd-aac4-3383a9a9c435-metrics-certs") pod "network-metrics-daemon-4p2n8" (UID: "ae5989c7-50c7-40bd-aac4-3383a9a9c435") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 12:22:49.676731 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:22:49.676688 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 27 12:22:49.676823 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:22:49.676758 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38ae6d3f-614b-4437-bb61-ad161748269f-original-pull-secret podName:38ae6d3f-614b-4437-bb61-ad161748269f nodeName:}" failed. No retries permitted until 2026-07-27 12:22:51.676743143 +0000 UTC m=+6.079877983 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/38ae6d3f-614b-4437-bb61-ad161748269f-original-pull-secret") pod "global-pull-secret-syncer-sfvmh" (UID: "38ae6d3f-614b-4437-bb61-ad161748269f") : object "kube-system"/"original-pull-secret" not registered Jul 27 12:22:49.777575 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:49.777536 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vsjpz\" (UniqueName: \"kubernetes.io/projected/fdfb006f-abc1-4762-9c0b-15b1159e2d8e-kube-api-access-vsjpz\") pod \"network-check-target-8vcwp\" (UID: \"fdfb006f-abc1-4762-9c0b-15b1159e2d8e\") " pod="openshift-network-diagnostics/network-check-target-8vcwp" Jul 27 12:22:49.777798 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:22:49.777778 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 27 12:22:49.777864 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:22:49.777806 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 27 12:22:49.777864 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:22:49.777819 2568 projected.go:196] Error preparing data for projected volume kube-api-access-vsjpz for pod openshift-network-diagnostics/network-check-target-8vcwp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 12:22:49.777979 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:22:49.777879 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fdfb006f-abc1-4762-9c0b-15b1159e2d8e-kube-api-access-vsjpz podName:fdfb006f-abc1-4762-9c0b-15b1159e2d8e nodeName:}" failed. No retries permitted until 2026-07-27 12:22:51.777861506 +0000 UTC m=+6.180996364 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-vsjpz" (UniqueName: "kubernetes.io/projected/fdfb006f-abc1-4762-9c0b-15b1159e2d8e-kube-api-access-vsjpz") pod "network-check-target-8vcwp" (UID: "fdfb006f-abc1-4762-9c0b-15b1159e2d8e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 12:22:50.010086 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:50.009892 2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-26 12:17:47 +0000 UTC" deadline="2028-02-08 12:21:13.654419754 +0000 UTC" Jul 27 12:22:50.010086 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:50.009960 2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13463h58m23.644464728s" Jul 27 12:22:50.159308 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:50.159277 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sfvmh" Jul 27 12:22:50.159466 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:22:50.159405 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sfvmh" podUID="38ae6d3f-614b-4437-bb61-ad161748269f" Jul 27 12:22:50.159822 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:50.159802 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8vcwp" Jul 27 12:22:50.159918 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:22:50.159897 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8vcwp" podUID="fdfb006f-abc1-4762-9c0b-15b1159e2d8e" Jul 27 12:22:50.192601 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:50.192436 2568 generic.go:356] "Generic (PLEG): container finished" podID="36a46d688b7e502bc5634c748870ec91" containerID="091b8ed815c03f4c65be6deb3d9c5cd20b4294f6520af5284e6152b9818f77ca" exitCode=0 Jul 27 12:22:50.192601 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:50.192535 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-3.ec2.internal" event={"ID":"36a46d688b7e502bc5634c748870ec91","Type":"ContainerDied","Data":"091b8ed815c03f4c65be6deb3d9c5cd20b4294f6520af5284e6152b9818f77ca"} Jul 27 12:22:50.197212 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:50.197181 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-3.ec2.internal" event={"ID":"cff9f289b3eaca0aa84c8bb4795faff0","Type":"ContainerStarted","Data":"1d6af1ba276847cae55fd439d3f17d10a4610a4ad570bce2ec4ae604025c8753"} Jul 27 12:22:50.227136 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:50.227077 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-3.ec2.internal" podStartSLOduration=3.227054774 podStartE2EDuration="3.227054774s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 12:22:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 12:22:50.22636877 +0000 UTC m=+4.629503628" watchObservedRunningTime="2026-07-27 12:22:50.227054774 +0000 UTC m=+4.630189632" Jul 27 12:22:51.157934 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:51.157373 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4p2n8" Jul 27 12:22:51.157934 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:22:51.157538 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4p2n8" podUID="ae5989c7-50c7-40bd-aac4-3383a9a9c435" Jul 27 12:22:51.217364 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:51.217303 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-3.ec2.internal" event={"ID":"36a46d688b7e502bc5634c748870ec91","Type":"ContainerStarted","Data":"6fc9d760956be9049cbfb305f185f2065a8e5768d96a1a05dc9ebe0203435fb4"} Jul 27 12:22:51.694698 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:51.694658 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/38ae6d3f-614b-4437-bb61-ad161748269f-original-pull-secret\") pod \"global-pull-secret-syncer-sfvmh\" (UID: \"38ae6d3f-614b-4437-bb61-ad161748269f\") " pod="kube-system/global-pull-secret-syncer-sfvmh" Jul 27 12:22:51.694891 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:51.694759 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ae5989c7-50c7-40bd-aac4-3383a9a9c435-metrics-certs\") pod \"network-metrics-daemon-4p2n8\" (UID: \"ae5989c7-50c7-40bd-aac4-3383a9a9c435\") " pod="openshift-multus/network-metrics-daemon-4p2n8" Jul 27 12:22:51.694962 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:22:51.694907 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 12:22:51.695016 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:22:51.694967 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae5989c7-50c7-40bd-aac4-3383a9a9c435-metrics-certs podName:ae5989c7-50c7-40bd-aac4-3383a9a9c435 nodeName:}" failed. No retries permitted until 2026-07-27 12:22:55.694949647 +0000 UTC m=+10.098084497 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ae5989c7-50c7-40bd-aac4-3383a9a9c435-metrics-certs") pod "network-metrics-daemon-4p2n8" (UID: "ae5989c7-50c7-40bd-aac4-3383a9a9c435") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 12:22:51.695365 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:22:51.695346 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 27 12:22:51.695470 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:22:51.695404 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38ae6d3f-614b-4437-bb61-ad161748269f-original-pull-secret podName:38ae6d3f-614b-4437-bb61-ad161748269f nodeName:}" failed. No retries permitted until 2026-07-27 12:22:55.695387985 +0000 UTC m=+10.098522824 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/38ae6d3f-614b-4437-bb61-ad161748269f-original-pull-secret") pod "global-pull-secret-syncer-sfvmh" (UID: "38ae6d3f-614b-4437-bb61-ad161748269f") : object "kube-system"/"original-pull-secret" not registered Jul 27 12:22:51.796096 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:51.796015 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vsjpz\" (UniqueName: \"kubernetes.io/projected/fdfb006f-abc1-4762-9c0b-15b1159e2d8e-kube-api-access-vsjpz\") pod \"network-check-target-8vcwp\" (UID: \"fdfb006f-abc1-4762-9c0b-15b1159e2d8e\") " pod="openshift-network-diagnostics/network-check-target-8vcwp" Jul 27 12:22:51.796279 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:22:51.796191 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 27 12:22:51.796279 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:22:51.796210 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 27 12:22:51.796279 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:22:51.796222 2568 projected.go:196] Error preparing data for projected volume kube-api-access-vsjpz for pod openshift-network-diagnostics/network-check-target-8vcwp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 12:22:51.796279 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:22:51.796277 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fdfb006f-abc1-4762-9c0b-15b1159e2d8e-kube-api-access-vsjpz podName:fdfb006f-abc1-4762-9c0b-15b1159e2d8e nodeName:}" failed. No retries permitted until 2026-07-27 12:22:55.796259416 +0000 UTC m=+10.199394265 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-vsjpz" (UniqueName: "kubernetes.io/projected/fdfb006f-abc1-4762-9c0b-15b1159e2d8e-kube-api-access-vsjpz") pod "network-check-target-8vcwp" (UID: "fdfb006f-abc1-4762-9c0b-15b1159e2d8e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 12:22:52.157830 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:52.157799 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8vcwp" Jul 27 12:22:52.157996 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:22:52.157961 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8vcwp" podUID="fdfb006f-abc1-4762-9c0b-15b1159e2d8e" Jul 27 12:22:52.158366 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:52.158305 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sfvmh" Jul 27 12:22:52.158429 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:22:52.158410 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sfvmh" podUID="38ae6d3f-614b-4437-bb61-ad161748269f" Jul 27 12:22:53.157450 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:53.157415 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4p2n8" Jul 27 12:22:53.157638 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:22:53.157593 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4p2n8" podUID="ae5989c7-50c7-40bd-aac4-3383a9a9c435" Jul 27 12:22:54.157857 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:54.157825 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8vcwp" Jul 27 12:22:54.158299 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:22:54.157950 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8vcwp" podUID="fdfb006f-abc1-4762-9c0b-15b1159e2d8e" Jul 27 12:22:54.160216 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:54.160190 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sfvmh" Jul 27 12:22:54.160322 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:22:54.160294 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sfvmh" podUID="38ae6d3f-614b-4437-bb61-ad161748269f" Jul 27 12:22:55.156926 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:55.156890 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4p2n8" Jul 27 12:22:55.157117 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:22:55.157041 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4p2n8" podUID="ae5989c7-50c7-40bd-aac4-3383a9a9c435" Jul 27 12:22:55.730643 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:55.730604 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ae5989c7-50c7-40bd-aac4-3383a9a9c435-metrics-certs\") pod \"network-metrics-daemon-4p2n8\" (UID: \"ae5989c7-50c7-40bd-aac4-3383a9a9c435\") " pod="openshift-multus/network-metrics-daemon-4p2n8" Jul 27 12:22:55.731144 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:55.730675 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/38ae6d3f-614b-4437-bb61-ad161748269f-original-pull-secret\") pod \"global-pull-secret-syncer-sfvmh\" (UID: \"38ae6d3f-614b-4437-bb61-ad161748269f\") " pod="kube-system/global-pull-secret-syncer-sfvmh" Jul 27 12:22:55.731144 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:22:55.730790 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 27 12:22:55.731144 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:22:55.730872 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38ae6d3f-614b-4437-bb61-ad161748269f-original-pull-secret podName:38ae6d3f-614b-4437-bb61-ad161748269f nodeName:}" failed. No retries permitted until 2026-07-27 12:23:03.730851538 +0000 UTC m=+18.133986378 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/38ae6d3f-614b-4437-bb61-ad161748269f-original-pull-secret") pod "global-pull-secret-syncer-sfvmh" (UID: "38ae6d3f-614b-4437-bb61-ad161748269f") : object "kube-system"/"original-pull-secret" not registered Jul 27 12:22:55.731144 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:22:55.730790 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 12:22:55.731144 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:22:55.730953 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae5989c7-50c7-40bd-aac4-3383a9a9c435-metrics-certs podName:ae5989c7-50c7-40bd-aac4-3383a9a9c435 nodeName:}" failed. No retries permitted until 2026-07-27 12:23:03.73093498 +0000 UTC m=+18.134069819 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ae5989c7-50c7-40bd-aac4-3383a9a9c435-metrics-certs") pod "network-metrics-daemon-4p2n8" (UID: "ae5989c7-50c7-40bd-aac4-3383a9a9c435") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 12:22:55.831729 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:55.831668 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vsjpz\" (UniqueName: \"kubernetes.io/projected/fdfb006f-abc1-4762-9c0b-15b1159e2d8e-kube-api-access-vsjpz\") pod \"network-check-target-8vcwp\" (UID: \"fdfb006f-abc1-4762-9c0b-15b1159e2d8e\") " pod="openshift-network-diagnostics/network-check-target-8vcwp" Jul 27 12:22:55.831891 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:22:55.831859 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 27 12:22:55.831891 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:22:55.831882 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 27 12:22:55.831891 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:22:55.831891 2568 projected.go:196] Error preparing data for projected volume kube-api-access-vsjpz for pod openshift-network-diagnostics/network-check-target-8vcwp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 12:22:55.832014 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:22:55.831953 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fdfb006f-abc1-4762-9c0b-15b1159e2d8e-kube-api-access-vsjpz podName:fdfb006f-abc1-4762-9c0b-15b1159e2d8e nodeName:}" failed. No retries permitted until 2026-07-27 12:23:03.831934355 +0000 UTC m=+18.235069198 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-vsjpz" (UniqueName: "kubernetes.io/projected/fdfb006f-abc1-4762-9c0b-15b1159e2d8e-kube-api-access-vsjpz") pod "network-check-target-8vcwp" (UID: "fdfb006f-abc1-4762-9c0b-15b1159e2d8e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 12:22:56.159300 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:56.158530 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8vcwp" Jul 27 12:22:56.159300 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:22:56.158678 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8vcwp" podUID="fdfb006f-abc1-4762-9c0b-15b1159e2d8e" Jul 27 12:22:56.159300 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:56.159117 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sfvmh" Jul 27 12:22:56.159300 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:22:56.159210 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sfvmh" podUID="38ae6d3f-614b-4437-bb61-ad161748269f" Jul 27 12:22:57.157323 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:57.157251 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4p2n8" Jul 27 12:22:57.157810 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:22:57.157402 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4p2n8" podUID="ae5989c7-50c7-40bd-aac4-3383a9a9c435" Jul 27 12:22:58.157131 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:58.157104 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sfvmh" Jul 27 12:22:58.157318 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:58.157102 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8vcwp" Jul 27 12:22:58.157318 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:22:58.157224 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sfvmh" podUID="38ae6d3f-614b-4437-bb61-ad161748269f" Jul 27 12:22:58.157318 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:22:58.157301 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8vcwp" podUID="fdfb006f-abc1-4762-9c0b-15b1159e2d8e" Jul 27 12:22:59.157551 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:22:59.157512 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4p2n8" Jul 27 12:22:59.158012 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:22:59.157677 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4p2n8" podUID="ae5989c7-50c7-40bd-aac4-3383a9a9c435" Jul 27 12:23:00.157007 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:00.156970 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sfvmh" Jul 27 12:23:00.157178 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:00.157019 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8vcwp" Jul 27 12:23:00.157178 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:23:00.157129 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sfvmh" podUID="38ae6d3f-614b-4437-bb61-ad161748269f" Jul 27 12:23:00.157294 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:23:00.157257 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8vcwp" podUID="fdfb006f-abc1-4762-9c0b-15b1159e2d8e" Jul 27 12:23:01.157238 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:01.157204 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4p2n8" Jul 27 12:23:01.157691 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:23:01.157402 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4p2n8" podUID="ae5989c7-50c7-40bd-aac4-3383a9a9c435" Jul 27 12:23:02.156847 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:02.156806 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8vcwp" Jul 27 12:23:02.157008 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:23:02.156943 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8vcwp" podUID="fdfb006f-abc1-4762-9c0b-15b1159e2d8e" Jul 27 12:23:02.157008 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:02.156982 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sfvmh" Jul 27 12:23:02.157128 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:23:02.157058 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sfvmh" podUID="38ae6d3f-614b-4437-bb61-ad161748269f" Jul 27 12:23:03.157454 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:03.157419 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4p2n8" Jul 27 12:23:03.157971 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:23:03.157544 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4p2n8" podUID="ae5989c7-50c7-40bd-aac4-3383a9a9c435" Jul 27 12:23:03.789894 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:03.789850 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/38ae6d3f-614b-4437-bb61-ad161748269f-original-pull-secret\") pod \"global-pull-secret-syncer-sfvmh\" (UID: \"38ae6d3f-614b-4437-bb61-ad161748269f\") " pod="kube-system/global-pull-secret-syncer-sfvmh" Jul 27 12:23:03.790156 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:03.789944 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ae5989c7-50c7-40bd-aac4-3383a9a9c435-metrics-certs\") pod \"network-metrics-daemon-4p2n8\" (UID: \"ae5989c7-50c7-40bd-aac4-3383a9a9c435\") " pod="openshift-multus/network-metrics-daemon-4p2n8" Jul 27 12:23:03.790156 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:23:03.790010 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 27 12:23:03.790156 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:23:03.790022 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 12:23:03.790156 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:23:03.790092 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38ae6d3f-614b-4437-bb61-ad161748269f-original-pull-secret podName:38ae6d3f-614b-4437-bb61-ad161748269f nodeName:}" failed. No retries permitted until 2026-07-27 12:23:19.790062902 +0000 UTC m=+34.193197740 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/38ae6d3f-614b-4437-bb61-ad161748269f-original-pull-secret") pod "global-pull-secret-syncer-sfvmh" (UID: "38ae6d3f-614b-4437-bb61-ad161748269f") : object "kube-system"/"original-pull-secret" not registered Jul 27 12:23:03.790156 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:23:03.790114 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae5989c7-50c7-40bd-aac4-3383a9a9c435-metrics-certs podName:ae5989c7-50c7-40bd-aac4-3383a9a9c435 nodeName:}" failed. No retries permitted until 2026-07-27 12:23:19.790103423 +0000 UTC m=+34.193238259 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ae5989c7-50c7-40bd-aac4-3383a9a9c435-metrics-certs") pod "network-metrics-daemon-4p2n8" (UID: "ae5989c7-50c7-40bd-aac4-3383a9a9c435") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 12:23:03.890384 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:03.890338 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vsjpz\" (UniqueName: \"kubernetes.io/projected/fdfb006f-abc1-4762-9c0b-15b1159e2d8e-kube-api-access-vsjpz\") pod \"network-check-target-8vcwp\" (UID: \"fdfb006f-abc1-4762-9c0b-15b1159e2d8e\") " pod="openshift-network-diagnostics/network-check-target-8vcwp" Jul 27 12:23:03.890589 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:23:03.890526 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 27 12:23:03.890589 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:23:03.890547 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 27 12:23:03.890589 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:23:03.890561 2568 projected.go:196] Error preparing data for projected volume kube-api-access-vsjpz for pod openshift-network-diagnostics/network-check-target-8vcwp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 12:23:03.890733 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:23:03.890624 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fdfb006f-abc1-4762-9c0b-15b1159e2d8e-kube-api-access-vsjpz podName:fdfb006f-abc1-4762-9c0b-15b1159e2d8e nodeName:}" failed. No retries permitted until 2026-07-27 12:23:19.89060608 +0000 UTC m=+34.293740918 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-vsjpz" (UniqueName: "kubernetes.io/projected/fdfb006f-abc1-4762-9c0b-15b1159e2d8e-kube-api-access-vsjpz") pod "network-check-target-8vcwp" (UID: "fdfb006f-abc1-4762-9c0b-15b1159e2d8e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 12:23:04.157224 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:04.157122 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8vcwp" Jul 27 12:23:04.157224 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:04.157152 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sfvmh" Jul 27 12:23:04.157466 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:23:04.157252 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8vcwp" podUID="fdfb006f-abc1-4762-9c0b-15b1159e2d8e" Jul 27 12:23:04.157466 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:23:04.157401 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sfvmh" podUID="38ae6d3f-614b-4437-bb61-ad161748269f" Jul 27 12:23:05.156987 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:05.156958 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4p2n8" Jul 27 12:23:05.157155 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:23:05.157093 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4p2n8" podUID="ae5989c7-50c7-40bd-aac4-3383a9a9c435" Jul 27 12:23:06.157765 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:06.157730 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8vcwp" Jul 27 12:23:06.158241 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:23:06.157835 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8vcwp" podUID="fdfb006f-abc1-4762-9c0b-15b1159e2d8e" Jul 27 12:23:06.158241 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:06.157896 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sfvmh" Jul 27 12:23:06.158241 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:23:06.158004 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sfvmh" podUID="38ae6d3f-614b-4437-bb61-ad161748269f" Jul 27 12:23:07.156871 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:07.156839 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4p2n8" Jul 27 12:23:07.157025 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:23:07.156956 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4p2n8" podUID="ae5989c7-50c7-40bd-aac4-3383a9a9c435" Jul 27 12:23:08.157438 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:08.157215 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8vcwp" Jul 27 12:23:08.158135 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:08.157278 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sfvmh" Jul 27 12:23:08.158135 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:23:08.157546 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8vcwp" podUID="fdfb006f-abc1-4762-9c0b-15b1159e2d8e" Jul 27 12:23:08.158135 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:23:08.157586 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sfvmh" podUID="38ae6d3f-614b-4437-bb61-ad161748269f" Jul 27 12:23:08.251416 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:08.251385 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-x45bt" event={"ID":"162b7fac-bf33-40ac-9803-42ee68d8bc52","Type":"ContainerStarted","Data":"ac0339e607d37b977764d6d42a069c3b7d9f1684d2f09d5fb5b2017ab0779d0e"} Jul 27 12:23:08.253191 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:08.253125 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-rr46t" event={"ID":"bf7a8649-39cb-471e-8d6e-2d55bb3d4e68","Type":"ContainerStarted","Data":"e03fc5b3f6a76636ce41f73092ed5d7e4894ded42f9e9dfc8352fbec85e8d655"} Jul 27 12:23:08.256665 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:08.256636 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ktgz9" event={"ID":"25263f75-a634-43a0-ba16-79930eda24ae","Type":"ContainerStarted","Data":"3889afba5317bd203af0a907ebf604c6bb5c291fca0a31f9b7a9404abea63c12"} Jul 27 12:23:08.256813 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:08.256701 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ktgz9" event={"ID":"25263f75-a634-43a0-ba16-79930eda24ae","Type":"ContainerStarted","Data":"489bbeca6ec87c02742819e415e8c66d186418eeb6e7932fef99df63914d5d90"} Jul 27 12:23:08.256813 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:08.256764 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ktgz9" event={"ID":"25263f75-a634-43a0-ba16-79930eda24ae","Type":"ContainerStarted","Data":"cc171691259801fe0061be44c2db3e42be7c83e930b6a5695ee28a32cc19a86c"} Jul 27 12:23:08.256813 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:08.256800 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ktgz9" event={"ID":"25263f75-a634-43a0-ba16-79930eda24ae","Type":"ContainerStarted","Data":"296bb6a39442087512d0146f994bea7b95c5ac02f488e9d6764b3f056c195cfb"} Jul 27 12:23:08.256971 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:08.256831 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ktgz9" event={"ID":"25263f75-a634-43a0-ba16-79930eda24ae","Type":"ContainerStarted","Data":"2b3ebb43d640cde9872d3bca70c2de12bbd4d59363b5764cb0bd6b4d6f5570bc"} Jul 27 12:23:08.256971 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:08.256874 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ktgz9" event={"ID":"25263f75-a634-43a0-ba16-79930eda24ae","Type":"ContainerStarted","Data":"d556d9be0e084879bd97931e69669a2cd764b17dc4d24df9a878511f4d717fbe"} Jul 27 12:23:08.258255 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:08.258226 2568 generic.go:356] "Generic (PLEG): container finished" podID="5fdb7eea-5a10-47dd-930c-89239b36b74e" containerID="07eba874544994918209d7d1c4ded09e4ae21e83a46a1abdd96f525c41419db9" exitCode=0 Jul 27 12:23:08.258357 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:08.258299 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bzpr5" event={"ID":"5fdb7eea-5a10-47dd-930c-89239b36b74e","Type":"ContainerDied","Data":"07eba874544994918209d7d1c4ded09e4ae21e83a46a1abdd96f525c41419db9"} Jul 27 12:23:08.260019 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:08.259992 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-c6p2s" event={"ID":"a80003d1-f5f7-442b-83c9-bba4bd72902a","Type":"ContainerStarted","Data":"79993c09176e2d2bb4e731a56637f1782f628182c8414d66a9d5123c2c129b78"} Jul 27 12:23:08.261545 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:08.261523 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-pfcwv" event={"ID":"41b1b110-9819-4966-966f-8fe838132d71","Type":"ContainerStarted","Data":"9e42eae305f8deac583c3a2091f24cccae7b292dcf0f3c99bc5c2f35cd37ff64"} Jul 27 12:23:08.263334 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:08.263277 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n8dpc" event={"ID":"cfbb87c2-555d-4b49-a675-d640a5793147","Type":"ContainerStarted","Data":"17472834b8e81cb62527fb70594173ab277212f01ccf340979ed86ba3a51a63e"} Jul 27 12:23:08.264944 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:08.264894 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-22ct8" event={"ID":"7bd721fb-fc40-4f80-8ed4-0956b5b5343d","Type":"ContainerStarted","Data":"15b951878cee4569d06a993178b899b37c61f014d4302f395b0b18767b286bbf"} Jul 27 12:23:08.270122 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:08.270077 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-x45bt" podStartSLOduration=8.186967008 podStartE2EDuration="22.27006098s" totalImagesPullingTime="14.083093972s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 12:22:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 12:23:08.269320047 +0000 UTC m=+22.672454905" watchObservedRunningTime="2026-07-27 12:23:08.27006098 +0000 UTC m=+22.673195837" Jul 27 12:23:08.270308 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:08.270251 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-3.ec2.internal" podStartSLOduration=21.270240678 podStartE2EDuration="21.270240678s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 12:22:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 12:22:51.238341346 +0000 UTC m=+5.641476216" watchObservedRunningTime="2026-07-27 12:23:08.270240678 +0000 UTC m=+22.673375538" Jul 27 12:23:08.286773 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:08.286735 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-22ct8" podStartSLOduration=3.948894236 podStartE2EDuration="22.286721478s" totalImagesPullingTime="18.337827242s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 12:22:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 12:23:08.286448467 +0000 UTC m=+22.689583323" watchObservedRunningTime="2026-07-27 12:23:08.286721478 +0000 UTC m=+22.689856337" Jul 27 12:23:08.320218 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:08.319826 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-c6p2s" podStartSLOduration=4.221568505 podStartE2EDuration="22.319811135s" totalImagesPullingTime="18.09824263s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 12:22:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 12:23:08.319571275 +0000 UTC m=+22.722706132" watchObservedRunningTime="2026-07-27 12:23:08.319811135 +0000 UTC m=+22.722945995" Jul 27 12:23:08.334422 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:08.334390 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-rr46t" podStartSLOduration=4.194062361 podStartE2EDuration="22.334378822s" totalImagesPullingTime="18.140316461s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 12:22:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 12:23:08.334183897 +0000 UTC m=+22.737318765" watchObservedRunningTime="2026-07-27 12:23:08.334378822 +0000 UTC m=+22.737513678" Jul 27 12:23:08.351678 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:08.351646 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-pfcwv" podStartSLOduration=4.237295137 podStartE2EDuration="22.351638574s" totalImagesPullingTime="18.114343437s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 12:22:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 12:23:08.351453483 +0000 UTC m=+22.754588340" watchObservedRunningTime="2026-07-27 12:23:08.351638574 +0000 UTC m=+22.754773431" Jul 27 12:23:08.783473 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:08.783409 2568 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 27 12:23:09.023157 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:09.023047 2568 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-27T12:23:08.783429132Z","UUID":"b493b53d-3046-40cc-a360-9995e3d87fd4","Handler":null,"Name":"","Endpoint":""} Jul 27 12:23:09.024619 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:09.024594 2568 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 27 12:23:09.024753 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:09.024638 2568 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 27 12:23:09.157469 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:09.157420 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4p2n8" Jul 27 12:23:09.157899 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:23:09.157561 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4p2n8" podUID="ae5989c7-50c7-40bd-aac4-3383a9a9c435" Jul 27 12:23:09.268909 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:09.268847 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n8dpc" event={"ID":"cfbb87c2-555d-4b49-a675-d640a5793147","Type":"ContainerStarted","Data":"1262e7961802f8aa9cea3ec0e8a8b2b1b2ebfc609bf44fbaf2ff16036fd5ea73"} Jul 27 12:23:09.270418 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:09.270386 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-lx8jr" event={"ID":"82bda458-1d5c-44ae-8cd0-def7ee6470c0","Type":"ContainerStarted","Data":"070b1b968f76725ffcde999cc890ba64e2a847de37c00639e3fa3e4aaa18cfc0"} Jul 27 12:23:09.285533 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:09.285449 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-lx8jr" podStartSLOduration=5.172579652 podStartE2EDuration="23.285431983s" totalImagesPullingTime="18.112852331s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 12:22:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 12:23:09.284937159 +0000 UTC m=+23.688072017" watchObservedRunningTime="2026-07-27 12:23:09.285431983 +0000 UTC m=+23.688566843" Jul 27 12:23:10.156826 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:10.156790 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sfvmh" Jul 27 12:23:10.157030 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:10.156806 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8vcwp" Jul 27 12:23:10.157030 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:23:10.156927 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sfvmh" podUID="38ae6d3f-614b-4437-bb61-ad161748269f" Jul 27 12:23:10.157030 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:23:10.156964 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8vcwp" podUID="fdfb006f-abc1-4762-9c0b-15b1159e2d8e" Jul 27 12:23:10.275764 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:10.275668 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n8dpc" event={"ID":"cfbb87c2-555d-4b49-a675-d640a5793147","Type":"ContainerStarted","Data":"acf3fb974995df34f38c8fa166d116bb3b297889a003e0a067537fd6358a0a06"} Jul 27 12:23:10.279610 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:10.279573 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ktgz9" event={"ID":"25263f75-a634-43a0-ba16-79930eda24ae","Type":"ContainerStarted","Data":"36e2390fe9e04e34edd931ba0142fde9430303321b22c2cd6b479aa5bb60ecba"} Jul 27 12:23:10.300983 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:10.300933 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n8dpc" podStartSLOduration=3.841931787 podStartE2EDuration="24.300914263s" totalImagesPullingTime="20.458982476s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 12:22:46 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 12:23:10.300526863 +0000 UTC m=+24.703661721" watchObservedRunningTime="2026-07-27 12:23:10.300914263 +0000 UTC m=+24.704049121" Jul 27 12:23:11.157262 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:11.157230 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4p2n8" Jul 27 12:23:11.157436 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:23:11.157332 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4p2n8" podUID="ae5989c7-50c7-40bd-aac4-3383a9a9c435" Jul 27 12:23:12.157297 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:12.157266 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sfvmh" Jul 27 12:23:12.157759 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:12.157266 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8vcwp" Jul 27 12:23:12.157759 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:23:12.157404 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sfvmh" podUID="38ae6d3f-614b-4437-bb61-ad161748269f" Jul 27 12:23:12.157759 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:23:12.157503 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8vcwp" podUID="fdfb006f-abc1-4762-9c0b-15b1159e2d8e" Jul 27 12:23:12.575603 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:12.575335 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-x45bt" Jul 27 12:23:12.576031 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:12.576002 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-x45bt" Jul 27 12:23:13.156499 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:13.156468 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4p2n8" Jul 27 12:23:13.156662 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:23:13.156568 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4p2n8" podUID="ae5989c7-50c7-40bd-aac4-3383a9a9c435" Jul 27 12:23:13.292038 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:13.292006 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ktgz9" event={"ID":"25263f75-a634-43a0-ba16-79930eda24ae","Type":"ContainerStarted","Data":"b210127a74d53c9585c525bc5d4bf6d8073d333dbddb296c1a940a186471aa3e"} Jul 27 12:23:13.292755 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:13.292261 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ktgz9" Jul 27 12:23:13.293986 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:13.293957 2568 generic.go:356] "Generic (PLEG): container finished" podID="5fdb7eea-5a10-47dd-930c-89239b36b74e" containerID="b1e8f6148be27c1f2d2955feaba2fc2f00ad091403fc3ddd1e0a8798ca8d03ed" exitCode=0 Jul 27 12:23:13.294105 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:13.294038 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bzpr5" event={"ID":"5fdb7eea-5a10-47dd-930c-89239b36b74e","Type":"ContainerDied","Data":"b1e8f6148be27c1f2d2955feaba2fc2f00ad091403fc3ddd1e0a8798ca8d03ed"} Jul 27 12:23:13.294248 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:13.294230 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-x45bt" Jul 27 12:23:13.294740 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:13.294703 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-x45bt" Jul 27 12:23:13.307774 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:13.307756 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ktgz9" Jul 27 12:23:13.320471 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:13.320435 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-ktgz9" podStartSLOduration=9.130312435 podStartE2EDuration="27.320423186s" totalImagesPullingTime="18.190110751s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 12:22:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 12:23:13.319064504 +0000 UTC m=+27.722199361" watchObservedRunningTime="2026-07-27 12:23:13.320423186 +0000 UTC m=+27.723558042" Jul 27 12:23:14.157353 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:14.157325 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8vcwp" Jul 27 12:23:14.157502 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:14.157368 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sfvmh" Jul 27 12:23:14.157543 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:23:14.157497 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sfvmh" podUID="38ae6d3f-614b-4437-bb61-ad161748269f" Jul 27 12:23:14.157619 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:23:14.157599 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8vcwp" podUID="fdfb006f-abc1-4762-9c0b-15b1159e2d8e" Jul 27 12:23:14.296254 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:14.296175 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ktgz9" Jul 27 12:23:14.296600 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:14.296254 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ktgz9" Jul 27 12:23:14.310826 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:14.310803 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ktgz9" Jul 27 12:23:14.394021 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:14.393986 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-4p2n8"] Jul 27 12:23:14.394136 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:14.394111 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4p2n8" Jul 27 12:23:14.394253 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:23:14.394226 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4p2n8" podUID="ae5989c7-50c7-40bd-aac4-3383a9a9c435" Jul 27 12:23:14.397273 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:14.397248 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-8vcwp"] Jul 27 12:23:14.397386 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:14.397370 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8vcwp" Jul 27 12:23:14.397495 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:23:14.397468 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8vcwp" podUID="fdfb006f-abc1-4762-9c0b-15b1159e2d8e" Jul 27 12:23:14.409338 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:14.409315 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-sfvmh"] Jul 27 12:23:14.409484 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:14.409400 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sfvmh" Jul 27 12:23:14.409484 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:23:14.409477 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sfvmh" podUID="38ae6d3f-614b-4437-bb61-ad161748269f" Jul 27 12:23:15.299579 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:15.299541 2568 generic.go:356] "Generic (PLEG): container finished" podID="5fdb7eea-5a10-47dd-930c-89239b36b74e" containerID="5dbe556a491a0f6a20f33e752b2c0ea40c339d7b514068a5e8b999df5fd5ae7c" exitCode=0 Jul 27 12:23:15.299958 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:15.299623 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bzpr5" event={"ID":"5fdb7eea-5a10-47dd-930c-89239b36b74e","Type":"ContainerDied","Data":"5dbe556a491a0f6a20f33e752b2c0ea40c339d7b514068a5e8b999df5fd5ae7c"} Jul 27 12:23:16.157571 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:16.157533 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4p2n8" Jul 27 12:23:16.157794 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:23:16.157641 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4p2n8" podUID="ae5989c7-50c7-40bd-aac4-3383a9a9c435" Jul 27 12:23:16.157794 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:16.157749 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8vcwp" Jul 27 12:23:16.157907 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:23:16.157848 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8vcwp" podUID="fdfb006f-abc1-4762-9c0b-15b1159e2d8e" Jul 27 12:23:16.157907 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:16.157895 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sfvmh" Jul 27 12:23:16.158023 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:23:16.157957 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sfvmh" podUID="38ae6d3f-614b-4437-bb61-ad161748269f" Jul 27 12:23:17.307204 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:17.307030 2568 generic.go:356] "Generic (PLEG): container finished" podID="5fdb7eea-5a10-47dd-930c-89239b36b74e" containerID="846db69956722b58ac9ed70d97f38a73e50a7c41e279f38b23c6917e7b69524d" exitCode=0 Jul 27 12:23:17.307569 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:17.307112 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bzpr5" event={"ID":"5fdb7eea-5a10-47dd-930c-89239b36b74e","Type":"ContainerDied","Data":"846db69956722b58ac9ed70d97f38a73e50a7c41e279f38b23c6917e7b69524d"} Jul 27 12:23:18.157337 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:18.157308 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4p2n8" Jul 27 12:23:18.157533 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:18.157316 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8vcwp" Jul 27 12:23:18.157533 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:23:18.157438 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4p2n8" podUID="ae5989c7-50c7-40bd-aac4-3383a9a9c435" Jul 27 12:23:18.157533 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:23:18.157504 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8vcwp" podUID="fdfb006f-abc1-4762-9c0b-15b1159e2d8e" Jul 27 12:23:18.157696 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:18.157555 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sfvmh" Jul 27 12:23:18.157696 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:23:18.157627 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sfvmh" podUID="38ae6d3f-614b-4437-bb61-ad161748269f" Jul 27 12:23:19.810493 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:19.810453 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ae5989c7-50c7-40bd-aac4-3383a9a9c435-metrics-certs\") pod \"network-metrics-daemon-4p2n8\" (UID: \"ae5989c7-50c7-40bd-aac4-3383a9a9c435\") " pod="openshift-multus/network-metrics-daemon-4p2n8" Jul 27 12:23:19.810924 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:19.810524 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/38ae6d3f-614b-4437-bb61-ad161748269f-original-pull-secret\") pod \"global-pull-secret-syncer-sfvmh\" (UID: \"38ae6d3f-614b-4437-bb61-ad161748269f\") " pod="kube-system/global-pull-secret-syncer-sfvmh" Jul 27 12:23:19.810924 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:23:19.810621 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 12:23:19.810924 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:23:19.810646 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 27 12:23:19.810924 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:23:19.810685 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae5989c7-50c7-40bd-aac4-3383a9a9c435-metrics-certs podName:ae5989c7-50c7-40bd-aac4-3383a9a9c435 nodeName:}" failed. No retries permitted until 2026-07-27 12:23:51.810670169 +0000 UTC m=+66.213805005 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ae5989c7-50c7-40bd-aac4-3383a9a9c435-metrics-certs") pod "network-metrics-daemon-4p2n8" (UID: "ae5989c7-50c7-40bd-aac4-3383a9a9c435") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 12:23:19.810924 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:23:19.810699 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38ae6d3f-614b-4437-bb61-ad161748269f-original-pull-secret podName:38ae6d3f-614b-4437-bb61-ad161748269f nodeName:}" failed. No retries permitted until 2026-07-27 12:23:51.810693712 +0000 UTC m=+66.213828546 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/38ae6d3f-614b-4437-bb61-ad161748269f-original-pull-secret") pod "global-pull-secret-syncer-sfvmh" (UID: "38ae6d3f-614b-4437-bb61-ad161748269f") : object "kube-system"/"original-pull-secret" not registered Jul 27 12:23:19.911739 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:19.911693 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vsjpz\" (UniqueName: \"kubernetes.io/projected/fdfb006f-abc1-4762-9c0b-15b1159e2d8e-kube-api-access-vsjpz\") pod \"network-check-target-8vcwp\" (UID: \"fdfb006f-abc1-4762-9c0b-15b1159e2d8e\") " pod="openshift-network-diagnostics/network-check-target-8vcwp" Jul 27 12:23:19.911854 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:23:19.911837 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 27 12:23:19.911909 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:23:19.911860 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 27 12:23:19.911909 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:23:19.911872 2568 projected.go:196] Error preparing data for projected volume kube-api-access-vsjpz for pod openshift-network-diagnostics/network-check-target-8vcwp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 12:23:19.912038 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:23:19.911922 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fdfb006f-abc1-4762-9c0b-15b1159e2d8e-kube-api-access-vsjpz podName:fdfb006f-abc1-4762-9c0b-15b1159e2d8e nodeName:}" failed. No retries permitted until 2026-07-27 12:23:51.911908292 +0000 UTC m=+66.315043127 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-vsjpz" (UniqueName: "kubernetes.io/projected/fdfb006f-abc1-4762-9c0b-15b1159e2d8e-kube-api-access-vsjpz") pod "network-check-target-8vcwp" (UID: "fdfb006f-abc1-4762-9c0b-15b1159e2d8e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 12:23:20.157234 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:20.157145 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sfvmh" Jul 27 12:23:20.157409 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:23:20.157266 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sfvmh" podUID="38ae6d3f-614b-4437-bb61-ad161748269f" Jul 27 12:23:20.157409 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:20.157152 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8vcwp" Jul 27 12:23:20.157409 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:20.157145 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4p2n8" Jul 27 12:23:20.157409 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:23:20.157356 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8vcwp" podUID="fdfb006f-abc1-4762-9c0b-15b1159e2d8e" Jul 27 12:23:20.157628 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:23:20.157470 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4p2n8" podUID="ae5989c7-50c7-40bd-aac4-3383a9a9c435" Jul 27 12:23:20.388295 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:20.388264 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-3.ec2.internal" event="NodeReady" Jul 27 12:23:20.388465 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:20.388439 2568 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 27 12:23:20.443594 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:20.443375 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-wc5br"] Jul 27 12:23:20.446015 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:20.445989 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-h5sgp"] Jul 27 12:23:20.446148 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:20.446085 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-wc5br" Jul 27 12:23:20.447640 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:20.447622 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-h5sgp" Jul 27 12:23:20.448450 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:20.448428 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 27 12:23:20.451731 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:20.451697 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 27 12:23:20.451845 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:20.451748 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-vw7l9\"" Jul 27 12:23:20.452856 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:20.452737 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 27 12:23:20.452856 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:20.452737 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 27 12:23:20.452856 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:20.452743 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-n7vz6\"" Jul 27 12:23:20.453091 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:20.453071 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 27 12:23:20.463592 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:20.463574 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-wc5br"] Jul 27 12:23:20.480131 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:20.480109 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-h5sgp"] Jul 27 12:23:20.616114 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:20.616076 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8be6dd92-30a3-4fa3-83f0-a352c43ae37d-metrics-tls\") pod \"dns-default-wc5br\" (UID: \"8be6dd92-30a3-4fa3-83f0-a352c43ae37d\") " pod="openshift-dns/dns-default-wc5br" Jul 27 12:23:20.616277 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:20.616129 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8be6dd92-30a3-4fa3-83f0-a352c43ae37d-tmp-dir\") pod \"dns-default-wc5br\" (UID: \"8be6dd92-30a3-4fa3-83f0-a352c43ae37d\") " pod="openshift-dns/dns-default-wc5br" Jul 27 12:23:20.616277 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:20.616152 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2bfeb1e3-aa75-4b3d-90d8-eef715105e77-cert\") pod \"ingress-canary-h5sgp\" (UID: \"2bfeb1e3-aa75-4b3d-90d8-eef715105e77\") " pod="openshift-ingress-canary/ingress-canary-h5sgp" Jul 27 12:23:20.616277 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:20.616226 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hnb7z\" (UniqueName: \"kubernetes.io/projected/8be6dd92-30a3-4fa3-83f0-a352c43ae37d-kube-api-access-hnb7z\") pod \"dns-default-wc5br\" (UID: \"8be6dd92-30a3-4fa3-83f0-a352c43ae37d\") " pod="openshift-dns/dns-default-wc5br" Jul 27 12:23:20.616277 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:20.616252 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8be6dd92-30a3-4fa3-83f0-a352c43ae37d-config-volume\") pod \"dns-default-wc5br\" (UID: \"8be6dd92-30a3-4fa3-83f0-a352c43ae37d\") " pod="openshift-dns/dns-default-wc5br" Jul 27 12:23:20.616277 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:20.616272 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j46wl\" (UniqueName: \"kubernetes.io/projected/2bfeb1e3-aa75-4b3d-90d8-eef715105e77-kube-api-access-j46wl\") pod \"ingress-canary-h5sgp\" (UID: \"2bfeb1e3-aa75-4b3d-90d8-eef715105e77\") " pod="openshift-ingress-canary/ingress-canary-h5sgp" Jul 27 12:23:20.717125 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:20.717086 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j46wl\" (UniqueName: \"kubernetes.io/projected/2bfeb1e3-aa75-4b3d-90d8-eef715105e77-kube-api-access-j46wl\") pod \"ingress-canary-h5sgp\" (UID: \"2bfeb1e3-aa75-4b3d-90d8-eef715105e77\") " pod="openshift-ingress-canary/ingress-canary-h5sgp" Jul 27 12:23:20.717300 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:20.717139 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8be6dd92-30a3-4fa3-83f0-a352c43ae37d-metrics-tls\") pod \"dns-default-wc5br\" (UID: \"8be6dd92-30a3-4fa3-83f0-a352c43ae37d\") " pod="openshift-dns/dns-default-wc5br" Jul 27 12:23:20.717300 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:20.717253 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8be6dd92-30a3-4fa3-83f0-a352c43ae37d-tmp-dir\") pod \"dns-default-wc5br\" (UID: \"8be6dd92-30a3-4fa3-83f0-a352c43ae37d\") " pod="openshift-dns/dns-default-wc5br" Jul 27 12:23:20.717300 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:20.717272 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2bfeb1e3-aa75-4b3d-90d8-eef715105e77-cert\") pod \"ingress-canary-h5sgp\" (UID: \"2bfeb1e3-aa75-4b3d-90d8-eef715105e77\") " pod="openshift-ingress-canary/ingress-canary-h5sgp" Jul 27 12:23:20.717476 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:20.717315 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hnb7z\" (UniqueName: \"kubernetes.io/projected/8be6dd92-30a3-4fa3-83f0-a352c43ae37d-kube-api-access-hnb7z\") pod \"dns-default-wc5br\" (UID: \"8be6dd92-30a3-4fa3-83f0-a352c43ae37d\") " pod="openshift-dns/dns-default-wc5br" Jul 27 12:23:20.717476 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:20.717354 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8be6dd92-30a3-4fa3-83f0-a352c43ae37d-config-volume\") pod \"dns-default-wc5br\" (UID: \"8be6dd92-30a3-4fa3-83f0-a352c43ae37d\") " pod="openshift-dns/dns-default-wc5br" Jul 27 12:23:20.717476 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:23:20.717411 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 27 12:23:20.717672 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:23:20.717491 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8be6dd92-30a3-4fa3-83f0-a352c43ae37d-metrics-tls podName:8be6dd92-30a3-4fa3-83f0-a352c43ae37d nodeName:}" failed. No retries permitted until 2026-07-27 12:23:21.217469305 +0000 UTC m=+35.620604158 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8be6dd92-30a3-4fa3-83f0-a352c43ae37d-metrics-tls") pod "dns-default-wc5br" (UID: "8be6dd92-30a3-4fa3-83f0-a352c43ae37d") : secret "dns-default-metrics-tls" not found Jul 27 12:23:20.717762 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:20.717679 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8be6dd92-30a3-4fa3-83f0-a352c43ae37d-tmp-dir\") pod \"dns-default-wc5br\" (UID: \"8be6dd92-30a3-4fa3-83f0-a352c43ae37d\") " pod="openshift-dns/dns-default-wc5br" Jul 27 12:23:20.717918 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:20.717899 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8be6dd92-30a3-4fa3-83f0-a352c43ae37d-config-volume\") pod \"dns-default-wc5br\" (UID: \"8be6dd92-30a3-4fa3-83f0-a352c43ae37d\") " pod="openshift-dns/dns-default-wc5br" Jul 27 12:23:20.722596 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:20.722571 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2bfeb1e3-aa75-4b3d-90d8-eef715105e77-cert\") pod \"ingress-canary-h5sgp\" (UID: \"2bfeb1e3-aa75-4b3d-90d8-eef715105e77\") " pod="openshift-ingress-canary/ingress-canary-h5sgp" Jul 27 12:23:20.726549 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:20.726464 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j46wl\" (UniqueName: \"kubernetes.io/projected/2bfeb1e3-aa75-4b3d-90d8-eef715105e77-kube-api-access-j46wl\") pod \"ingress-canary-h5sgp\" (UID: \"2bfeb1e3-aa75-4b3d-90d8-eef715105e77\") " pod="openshift-ingress-canary/ingress-canary-h5sgp" Jul 27 12:23:20.726549 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:20.726509 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hnb7z\" (UniqueName: \"kubernetes.io/projected/8be6dd92-30a3-4fa3-83f0-a352c43ae37d-kube-api-access-hnb7z\") pod \"dns-default-wc5br\" (UID: \"8be6dd92-30a3-4fa3-83f0-a352c43ae37d\") " pod="openshift-dns/dns-default-wc5br" Jul 27 12:23:20.763613 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:20.763584 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-h5sgp" Jul 27 12:23:21.222258 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:21.221438 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8be6dd92-30a3-4fa3-83f0-a352c43ae37d-metrics-tls\") pod \"dns-default-wc5br\" (UID: \"8be6dd92-30a3-4fa3-83f0-a352c43ae37d\") " pod="openshift-dns/dns-default-wc5br" Jul 27 12:23:21.222258 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:23:21.221598 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 27 12:23:21.222258 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:23:21.221658 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8be6dd92-30a3-4fa3-83f0-a352c43ae37d-metrics-tls podName:8be6dd92-30a3-4fa3-83f0-a352c43ae37d nodeName:}" failed. No retries permitted until 2026-07-27 12:23:22.221639606 +0000 UTC m=+36.624774445 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8be6dd92-30a3-4fa3-83f0-a352c43ae37d-metrics-tls") pod "dns-default-wc5br" (UID: "8be6dd92-30a3-4fa3-83f0-a352c43ae37d") : secret "dns-default-metrics-tls" not found Jul 27 12:23:21.284973 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:21.284810 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-h5sgp"] Jul 27 12:23:21.288213 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:23:21.288189 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2bfeb1e3_aa75_4b3d_90d8_eef715105e77.slice/crio-2ce38520836afcddab7f70bdc4334463355b25600492edbb3ce2544129809f59 WatchSource:0}: Error finding container 2ce38520836afcddab7f70bdc4334463355b25600492edbb3ce2544129809f59: Status 404 returned error can't find the container with id 2ce38520836afcddab7f70bdc4334463355b25600492edbb3ce2544129809f59 Jul 27 12:23:21.322336 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:21.322309 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bzpr5" event={"ID":"5fdb7eea-5a10-47dd-930c-89239b36b74e","Type":"ContainerStarted","Data":"a94a1853c59e37aeff6a57e3f83ee26b0924dd8bf62aa2453a965ccdb856a1d9"} Jul 27 12:23:21.323495 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:21.323469 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-h5sgp" event={"ID":"2bfeb1e3-aa75-4b3d-90d8-eef715105e77","Type":"ContainerStarted","Data":"2ce38520836afcddab7f70bdc4334463355b25600492edbb3ce2544129809f59"} Jul 27 12:23:22.161201 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:22.161126 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4p2n8" Jul 27 12:23:22.161370 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:22.161244 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8vcwp" Jul 27 12:23:22.161370 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:22.161277 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sfvmh" Jul 27 12:23:22.164201 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:22.164180 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 27 12:23:22.164327 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:22.164216 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-vxl2z\"" Jul 27 12:23:22.165015 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:22.164992 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 27 12:23:22.165130 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:22.165032 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 27 12:23:22.165130 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:22.165044 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 27 12:23:22.165130 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:22.165047 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-kgw4x\"" Jul 27 12:23:22.230310 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:22.230281 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8be6dd92-30a3-4fa3-83f0-a352c43ae37d-metrics-tls\") pod \"dns-default-wc5br\" (UID: \"8be6dd92-30a3-4fa3-83f0-a352c43ae37d\") " pod="openshift-dns/dns-default-wc5br" Jul 27 12:23:22.230692 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:23:22.230426 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 27 12:23:22.230692 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:23:22.230485 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8be6dd92-30a3-4fa3-83f0-a352c43ae37d-metrics-tls podName:8be6dd92-30a3-4fa3-83f0-a352c43ae37d nodeName:}" failed. No retries permitted until 2026-07-27 12:23:24.23046568 +0000 UTC m=+38.633600528 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8be6dd92-30a3-4fa3-83f0-a352c43ae37d-metrics-tls") pod "dns-default-wc5br" (UID: "8be6dd92-30a3-4fa3-83f0-a352c43ae37d") : secret "dns-default-metrics-tls" not found Jul 27 12:23:22.329774 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:22.329740 2568 generic.go:356] "Generic (PLEG): container finished" podID="5fdb7eea-5a10-47dd-930c-89239b36b74e" containerID="a94a1853c59e37aeff6a57e3f83ee26b0924dd8bf62aa2453a965ccdb856a1d9" exitCode=0 Jul 27 12:23:22.329917 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:22.329816 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bzpr5" event={"ID":"5fdb7eea-5a10-47dd-930c-89239b36b74e","Type":"ContainerDied","Data":"a94a1853c59e37aeff6a57e3f83ee26b0924dd8bf62aa2453a965ccdb856a1d9"} Jul 27 12:23:23.336447 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:23.336411 2568 generic.go:356] "Generic (PLEG): container finished" podID="5fdb7eea-5a10-47dd-930c-89239b36b74e" containerID="f7573147c161ff5a625acfae8e9008466c385ab4f19ee3826a3e330676650eb6" exitCode=0 Jul 27 12:23:23.337038 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:23.336459 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bzpr5" event={"ID":"5fdb7eea-5a10-47dd-930c-89239b36b74e","Type":"ContainerDied","Data":"f7573147c161ff5a625acfae8e9008466c385ab4f19ee3826a3e330676650eb6"} Jul 27 12:23:23.904527 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:23.904499 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-mdfcs"] Jul 27 12:23:23.927338 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:23.927316 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-mdfcs"] Jul 27 12:23:23.927447 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:23.927431 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-mdfcs" Jul 27 12:23:23.930284 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:23.930265 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 27 12:23:23.930653 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:23.930636 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-svzcd\"" Jul 27 12:23:23.930789 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:23.930772 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 27 12:23:23.930962 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:23.930936 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 27 12:23:23.930962 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:23.930955 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 27 12:23:24.046104 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:24.045832 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c421b82e-b61e-4a0f-8a1c-055841ac0e4f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mdfcs\" (UID: \"c421b82e-b61e-4a0f-8a1c-055841ac0e4f\") " pod="openshift-insights/insights-runtime-extractor-mdfcs" Jul 27 12:23:24.046104 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:24.045884 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5tzsv\" (UniqueName: \"kubernetes.io/projected/c421b82e-b61e-4a0f-8a1c-055841ac0e4f-kube-api-access-5tzsv\") pod \"insights-runtime-extractor-mdfcs\" (UID: \"c421b82e-b61e-4a0f-8a1c-055841ac0e4f\") " pod="openshift-insights/insights-runtime-extractor-mdfcs" Jul 27 12:23:24.046104 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:24.045936 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c421b82e-b61e-4a0f-8a1c-055841ac0e4f-data-volume\") pod \"insights-runtime-extractor-mdfcs\" (UID: \"c421b82e-b61e-4a0f-8a1c-055841ac0e4f\") " pod="openshift-insights/insights-runtime-extractor-mdfcs" Jul 27 12:23:24.046104 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:24.046018 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c421b82e-b61e-4a0f-8a1c-055841ac0e4f-crio-socket\") pod \"insights-runtime-extractor-mdfcs\" (UID: \"c421b82e-b61e-4a0f-8a1c-055841ac0e4f\") " pod="openshift-insights/insights-runtime-extractor-mdfcs" Jul 27 12:23:24.046104 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:24.046049 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c421b82e-b61e-4a0f-8a1c-055841ac0e4f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mdfcs\" (UID: \"c421b82e-b61e-4a0f-8a1c-055841ac0e4f\") " pod="openshift-insights/insights-runtime-extractor-mdfcs" Jul 27 12:23:24.146967 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:24.146889 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5tzsv\" (UniqueName: \"kubernetes.io/projected/c421b82e-b61e-4a0f-8a1c-055841ac0e4f-kube-api-access-5tzsv\") pod \"insights-runtime-extractor-mdfcs\" (UID: \"c421b82e-b61e-4a0f-8a1c-055841ac0e4f\") " pod="openshift-insights/insights-runtime-extractor-mdfcs" Jul 27 12:23:24.146967 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:24.146932 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c421b82e-b61e-4a0f-8a1c-055841ac0e4f-data-volume\") pod \"insights-runtime-extractor-mdfcs\" (UID: \"c421b82e-b61e-4a0f-8a1c-055841ac0e4f\") " pod="openshift-insights/insights-runtime-extractor-mdfcs" Jul 27 12:23:24.147183 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:24.146983 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c421b82e-b61e-4a0f-8a1c-055841ac0e4f-crio-socket\") pod \"insights-runtime-extractor-mdfcs\" (UID: \"c421b82e-b61e-4a0f-8a1c-055841ac0e4f\") " pod="openshift-insights/insights-runtime-extractor-mdfcs" Jul 27 12:23:24.147183 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:24.147003 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c421b82e-b61e-4a0f-8a1c-055841ac0e4f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mdfcs\" (UID: \"c421b82e-b61e-4a0f-8a1c-055841ac0e4f\") " pod="openshift-insights/insights-runtime-extractor-mdfcs" Jul 27 12:23:24.147183 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:24.147037 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c421b82e-b61e-4a0f-8a1c-055841ac0e4f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mdfcs\" (UID: \"c421b82e-b61e-4a0f-8a1c-055841ac0e4f\") " pod="openshift-insights/insights-runtime-extractor-mdfcs" Jul 27 12:23:24.147183 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:23:24.147120 2568 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 27 12:23:24.147183 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:23:24.147153 2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 27 12:23:24.147183 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:23:24.147185 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c421b82e-b61e-4a0f-8a1c-055841ac0e4f-kube-rbac-proxy-cm podName:c421b82e-b61e-4a0f-8a1c-055841ac0e4f nodeName:}" failed. No retries permitted until 2026-07-27 12:23:24.647170756 +0000 UTC m=+39.050305590 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c421b82e-b61e-4a0f-8a1c-055841ac0e4f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-mdfcs" (UID: "c421b82e-b61e-4a0f-8a1c-055841ac0e4f") : configmap "kube-rbac-proxy" not found Jul 27 12:23:24.147643 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:23:24.147218 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c421b82e-b61e-4a0f-8a1c-055841ac0e4f-insights-runtime-extractor-tls podName:c421b82e-b61e-4a0f-8a1c-055841ac0e4f nodeName:}" failed. No retries permitted until 2026-07-27 12:23:24.647204383 +0000 UTC m=+39.050339218 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c421b82e-b61e-4a0f-8a1c-055841ac0e4f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mdfcs" (UID: "c421b82e-b61e-4a0f-8a1c-055841ac0e4f") : secret "insights-runtime-extractor-tls" not found Jul 27 12:23:24.147643 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:24.147238 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c421b82e-b61e-4a0f-8a1c-055841ac0e4f-crio-socket\") pod \"insights-runtime-extractor-mdfcs\" (UID: \"c421b82e-b61e-4a0f-8a1c-055841ac0e4f\") " pod="openshift-insights/insights-runtime-extractor-mdfcs" Jul 27 12:23:24.147643 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:24.147406 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c421b82e-b61e-4a0f-8a1c-055841ac0e4f-data-volume\") pod \"insights-runtime-extractor-mdfcs\" (UID: \"c421b82e-b61e-4a0f-8a1c-055841ac0e4f\") " pod="openshift-insights/insights-runtime-extractor-mdfcs" Jul 27 12:23:24.157771 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:24.157650 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5tzsv\" (UniqueName: \"kubernetes.io/projected/c421b82e-b61e-4a0f-8a1c-055841ac0e4f-kube-api-access-5tzsv\") pod \"insights-runtime-extractor-mdfcs\" (UID: \"c421b82e-b61e-4a0f-8a1c-055841ac0e4f\") " pod="openshift-insights/insights-runtime-extractor-mdfcs" Jul 27 12:23:24.247775 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:24.247740 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8be6dd92-30a3-4fa3-83f0-a352c43ae37d-metrics-tls\") pod \"dns-default-wc5br\" (UID: \"8be6dd92-30a3-4fa3-83f0-a352c43ae37d\") " pod="openshift-dns/dns-default-wc5br" Jul 27 12:23:24.247933 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:23:24.247890 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 27 12:23:24.247982 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:23:24.247950 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8be6dd92-30a3-4fa3-83f0-a352c43ae37d-metrics-tls podName:8be6dd92-30a3-4fa3-83f0-a352c43ae37d nodeName:}" failed. No retries permitted until 2026-07-27 12:23:28.247936352 +0000 UTC m=+42.651071187 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8be6dd92-30a3-4fa3-83f0-a352c43ae37d-metrics-tls") pod "dns-default-wc5br" (UID: "8be6dd92-30a3-4fa3-83f0-a352c43ae37d") : secret "dns-default-metrics-tls" not found Jul 27 12:23:24.341536 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:24.341503 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bzpr5" event={"ID":"5fdb7eea-5a10-47dd-930c-89239b36b74e","Type":"ContainerStarted","Data":"34cb024737cf9c74fb78b1729f928c588713b017d6d15d1909f1f4e01214e329"} Jul 27 12:23:24.342914 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:24.342889 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-h5sgp" event={"ID":"2bfeb1e3-aa75-4b3d-90d8-eef715105e77","Type":"ContainerStarted","Data":"fde6b9a92ed6d0077869a2f94586676644a7b1ee9048ef64faa9094fc0239e26"} Jul 27 12:23:24.367512 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:24.367468 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-bzpr5" podStartSLOduration=10.133438858 podStartE2EDuration="38.367454393s" totalImagesPullingTime="28.234015535s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 12:22:46 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 12:23:24.366106411 +0000 UTC m=+38.769241267" watchObservedRunningTime="2026-07-27 12:23:24.367454393 +0000 UTC m=+38.770589250" Jul 27 12:23:24.383431 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:24.383391 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-h5sgp" podStartSLOduration=1.79071701 podStartE2EDuration="4.383378767s" totalImagesPullingTime="2.592661757s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 12:23:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 12:23:24.382842882 +0000 UTC m=+38.785977739" watchObservedRunningTime="2026-07-27 12:23:24.383378767 +0000 UTC m=+38.786513606" Jul 27 12:23:24.652157 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:24.652124 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c421b82e-b61e-4a0f-8a1c-055841ac0e4f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mdfcs\" (UID: \"c421b82e-b61e-4a0f-8a1c-055841ac0e4f\") " pod="openshift-insights/insights-runtime-extractor-mdfcs" Jul 27 12:23:24.652321 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:24.652177 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c421b82e-b61e-4a0f-8a1c-055841ac0e4f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mdfcs\" (UID: \"c421b82e-b61e-4a0f-8a1c-055841ac0e4f\") " pod="openshift-insights/insights-runtime-extractor-mdfcs" Jul 27 12:23:24.652321 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:23:24.652239 2568 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 27 12:23:24.652321 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:23:24.652275 2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 27 12:23:24.652321 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:23:24.652299 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c421b82e-b61e-4a0f-8a1c-055841ac0e4f-kube-rbac-proxy-cm podName:c421b82e-b61e-4a0f-8a1c-055841ac0e4f nodeName:}" failed. No retries permitted until 2026-07-27 12:23:25.652285159 +0000 UTC m=+40.055419994 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c421b82e-b61e-4a0f-8a1c-055841ac0e4f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-mdfcs" (UID: "c421b82e-b61e-4a0f-8a1c-055841ac0e4f") : configmap "kube-rbac-proxy" not found Jul 27 12:23:24.652321 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:23:24.652327 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c421b82e-b61e-4a0f-8a1c-055841ac0e4f-insights-runtime-extractor-tls podName:c421b82e-b61e-4a0f-8a1c-055841ac0e4f nodeName:}" failed. No retries permitted until 2026-07-27 12:23:25.652314783 +0000 UTC m=+40.055449617 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c421b82e-b61e-4a0f-8a1c-055841ac0e4f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mdfcs" (UID: "c421b82e-b61e-4a0f-8a1c-055841ac0e4f") : secret "insights-runtime-extractor-tls" not found Jul 27 12:23:25.369956 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:25.369930 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-q4w2k"] Jul 27 12:23:25.382284 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:25.382260 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-q4w2k"] Jul 27 12:23:25.382408 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:25.382352 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-q4w2k" Jul 27 12:23:25.384675 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:25.384651 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 27 12:23:25.384815 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:25.384676 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 27 12:23:25.384815 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:25.384735 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 27 12:23:25.384815 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:25.384738 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-5k8xp\"" Jul 27 12:23:25.464977 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:25.464949 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-2cdc4"] Jul 27 12:23:25.486320 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:25.486298 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-2cdc4"] Jul 27 12:23:25.486444 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:25.486382 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-584dcb6b54-2cdc4" Jul 27 12:23:25.488818 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:25.488796 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 27 12:23:25.489052 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:25.488887 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 27 12:23:25.489052 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:25.488897 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 27 12:23:25.489052 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:25.488907 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 27 12:23:25.489345 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:25.489055 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-cqsqv\"" Jul 27 12:23:25.492845 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:25.492825 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 27 12:23:25.559264 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:25.559231 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/47c5fef3-31cb-4670-9299-9561ecf16099-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-q4w2k\" (UID: \"47c5fef3-31cb-4670-9299-9561ecf16099\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-q4w2k" Jul 27 12:23:25.559399 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:25.559269 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fzjkh\" (UniqueName: \"kubernetes.io/projected/47c5fef3-31cb-4670-9299-9561ecf16099-kube-api-access-fzjkh\") pod \"cluster-samples-operator-6748489656-q4w2k\" (UID: \"47c5fef3-31cb-4670-9299-9561ecf16099\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-q4w2k" Jul 27 12:23:25.660119 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:25.660044 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c421b82e-b61e-4a0f-8a1c-055841ac0e4f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mdfcs\" (UID: \"c421b82e-b61e-4a0f-8a1c-055841ac0e4f\") " pod="openshift-insights/insights-runtime-extractor-mdfcs" Jul 27 12:23:25.660119 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:25.660114 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5313f3d9-169d-4010-a1a0-9a0405b1bccf-config\") pod \"console-operator-584dcb6b54-2cdc4\" (UID: \"5313f3d9-169d-4010-a1a0-9a0405b1bccf\") " pod="openshift-console-operator/console-operator-584dcb6b54-2cdc4" Jul 27 12:23:25.660313 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:25.660134 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/47c5fef3-31cb-4670-9299-9561ecf16099-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-q4w2k\" (UID: \"47c5fef3-31cb-4670-9299-9561ecf16099\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-q4w2k" Jul 27 12:23:25.660313 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:25.660152 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5313f3d9-169d-4010-a1a0-9a0405b1bccf-trusted-ca\") pod \"console-operator-584dcb6b54-2cdc4\" (UID: \"5313f3d9-169d-4010-a1a0-9a0405b1bccf\") " pod="openshift-console-operator/console-operator-584dcb6b54-2cdc4" Jul 27 12:23:25.660313 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:23:25.660162 2568 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 27 12:23:25.660313 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:25.660166 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hm4mh\" (UniqueName: \"kubernetes.io/projected/5313f3d9-169d-4010-a1a0-9a0405b1bccf-kube-api-access-hm4mh\") pod \"console-operator-584dcb6b54-2cdc4\" (UID: \"5313f3d9-169d-4010-a1a0-9a0405b1bccf\") " pod="openshift-console-operator/console-operator-584dcb6b54-2cdc4" Jul 27 12:23:25.660313 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:25.660224 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c421b82e-b61e-4a0f-8a1c-055841ac0e4f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mdfcs\" (UID: \"c421b82e-b61e-4a0f-8a1c-055841ac0e4f\") " pod="openshift-insights/insights-runtime-extractor-mdfcs" Jul 27 12:23:25.660313 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:23:25.660242 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c421b82e-b61e-4a0f-8a1c-055841ac0e4f-kube-rbac-proxy-cm podName:c421b82e-b61e-4a0f-8a1c-055841ac0e4f nodeName:}" failed. No retries permitted until 2026-07-27 12:23:27.660220484 +0000 UTC m=+42.063355323 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c421b82e-b61e-4a0f-8a1c-055841ac0e4f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-mdfcs" (UID: "c421b82e-b61e-4a0f-8a1c-055841ac0e4f") : configmap "kube-rbac-proxy" not found Jul 27 12:23:25.660313 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:23:25.660268 2568 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 27 12:23:25.660313 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:25.660282 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fzjkh\" (UniqueName: \"kubernetes.io/projected/47c5fef3-31cb-4670-9299-9561ecf16099-kube-api-access-fzjkh\") pod \"cluster-samples-operator-6748489656-q4w2k\" (UID: \"47c5fef3-31cb-4670-9299-9561ecf16099\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-q4w2k" Jul 27 12:23:25.660313 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:23:25.660312 2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 27 12:23:25.660613 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:23:25.660314 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47c5fef3-31cb-4670-9299-9561ecf16099-samples-operator-tls podName:47c5fef3-31cb-4670-9299-9561ecf16099 nodeName:}" failed. No retries permitted until 2026-07-27 12:23:26.160297883 +0000 UTC m=+40.563432731 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/47c5fef3-31cb-4670-9299-9561ecf16099-samples-operator-tls") pod "cluster-samples-operator-6748489656-q4w2k" (UID: "47c5fef3-31cb-4670-9299-9561ecf16099") : secret "samples-operator-tls" not found Jul 27 12:23:25.660613 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:25.660363 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5313f3d9-169d-4010-a1a0-9a0405b1bccf-serving-cert\") pod \"console-operator-584dcb6b54-2cdc4\" (UID: \"5313f3d9-169d-4010-a1a0-9a0405b1bccf\") " pod="openshift-console-operator/console-operator-584dcb6b54-2cdc4" Jul 27 12:23:25.660613 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:23:25.660413 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c421b82e-b61e-4a0f-8a1c-055841ac0e4f-insights-runtime-extractor-tls podName:c421b82e-b61e-4a0f-8a1c-055841ac0e4f nodeName:}" failed. No retries permitted until 2026-07-27 12:23:27.660400359 +0000 UTC m=+42.063535194 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c421b82e-b61e-4a0f-8a1c-055841ac0e4f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mdfcs" (UID: "c421b82e-b61e-4a0f-8a1c-055841ac0e4f") : secret "insights-runtime-extractor-tls" not found Jul 27 12:23:25.669528 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:25.669501 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fzjkh\" (UniqueName: \"kubernetes.io/projected/47c5fef3-31cb-4670-9299-9561ecf16099-kube-api-access-fzjkh\") pod \"cluster-samples-operator-6748489656-q4w2k\" (UID: \"47c5fef3-31cb-4670-9299-9561ecf16099\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-q4w2k" Jul 27 12:23:25.761595 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:25.761557 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5313f3d9-169d-4010-a1a0-9a0405b1bccf-config\") pod \"console-operator-584dcb6b54-2cdc4\" (UID: \"5313f3d9-169d-4010-a1a0-9a0405b1bccf\") " pod="openshift-console-operator/console-operator-584dcb6b54-2cdc4" Jul 27 12:23:25.761760 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:25.761607 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5313f3d9-169d-4010-a1a0-9a0405b1bccf-trusted-ca\") pod \"console-operator-584dcb6b54-2cdc4\" (UID: \"5313f3d9-169d-4010-a1a0-9a0405b1bccf\") " pod="openshift-console-operator/console-operator-584dcb6b54-2cdc4" Jul 27 12:23:25.761760 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:25.761631 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hm4mh\" (UniqueName: \"kubernetes.io/projected/5313f3d9-169d-4010-a1a0-9a0405b1bccf-kube-api-access-hm4mh\") pod \"console-operator-584dcb6b54-2cdc4\" (UID: \"5313f3d9-169d-4010-a1a0-9a0405b1bccf\") " pod="openshift-console-operator/console-operator-584dcb6b54-2cdc4" Jul 27 12:23:25.762568 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:25.762537 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5313f3d9-169d-4010-a1a0-9a0405b1bccf-serving-cert\") pod \"console-operator-584dcb6b54-2cdc4\" (UID: \"5313f3d9-169d-4010-a1a0-9a0405b1bccf\") " pod="openshift-console-operator/console-operator-584dcb6b54-2cdc4" Jul 27 12:23:25.762729 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:25.762690 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5313f3d9-169d-4010-a1a0-9a0405b1bccf-config\") pod \"console-operator-584dcb6b54-2cdc4\" (UID: \"5313f3d9-169d-4010-a1a0-9a0405b1bccf\") " pod="openshift-console-operator/console-operator-584dcb6b54-2cdc4" Jul 27 12:23:25.765798 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:25.765779 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5313f3d9-169d-4010-a1a0-9a0405b1bccf-serving-cert\") pod \"console-operator-584dcb6b54-2cdc4\" (UID: \"5313f3d9-169d-4010-a1a0-9a0405b1bccf\") " pod="openshift-console-operator/console-operator-584dcb6b54-2cdc4" Jul 27 12:23:25.766119 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:25.766101 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5313f3d9-169d-4010-a1a0-9a0405b1bccf-trusted-ca\") pod \"console-operator-584dcb6b54-2cdc4\" (UID: \"5313f3d9-169d-4010-a1a0-9a0405b1bccf\") " pod="openshift-console-operator/console-operator-584dcb6b54-2cdc4" Jul 27 12:23:25.772384 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:25.772363 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hm4mh\" (UniqueName: \"kubernetes.io/projected/5313f3d9-169d-4010-a1a0-9a0405b1bccf-kube-api-access-hm4mh\") pod \"console-operator-584dcb6b54-2cdc4\" (UID: \"5313f3d9-169d-4010-a1a0-9a0405b1bccf\") " pod="openshift-console-operator/console-operator-584dcb6b54-2cdc4" Jul 27 12:23:25.794665 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:25.794643 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-584dcb6b54-2cdc4" Jul 27 12:23:25.880808 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:25.880785 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-rr46t_bf7a8649-39cb-471e-8d6e-2d55bb3d4e68/dns-node-resolver/0.log" Jul 27 12:23:25.896801 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:25.896776 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-rrrcd"] Jul 27 12:23:25.925425 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:25.925367 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-rrrcd"] Jul 27 12:23:25.925530 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:25.925505 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-658d7b7c78-rrrcd" Jul 27 12:23:25.928172 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:25.928031 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 27 12:23:25.928172 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:25.928031 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 27 12:23:25.928172 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:25.928033 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-hxlxz\"" Jul 27 12:23:25.928172 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:25.928102 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 27 12:23:25.928468 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:25.928427 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 27 12:23:25.959643 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:25.959603 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-2cdc4"] Jul 27 12:23:25.963758 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:23:25.963737 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5313f3d9_169d_4010_a1a0_9a0405b1bccf.slice/crio-e830b61856ae71677bd8025c2ab0c5d72518414d2b38dfe2efd038800b745857 WatchSource:0}: Error finding container e830b61856ae71677bd8025c2ab0c5d72518414d2b38dfe2efd038800b745857: Status 404 returned error can't find the container with id e830b61856ae71677bd8025c2ab0c5d72518414d2b38dfe2efd038800b745857 Jul 27 12:23:26.065245 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:26.065215 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/75203917-b2f8-418f-a9b4-0267e1fd4518-signing-key\") pod \"service-ca-658d7b7c78-rrrcd\" (UID: \"75203917-b2f8-418f-a9b4-0267e1fd4518\") " pod="openshift-service-ca/service-ca-658d7b7c78-rrrcd" Jul 27 12:23:26.065424 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:26.065299 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/75203917-b2f8-418f-a9b4-0267e1fd4518-signing-cabundle\") pod \"service-ca-658d7b7c78-rrrcd\" (UID: \"75203917-b2f8-418f-a9b4-0267e1fd4518\") " pod="openshift-service-ca/service-ca-658d7b7c78-rrrcd" Jul 27 12:23:26.065424 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:26.065324 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xk88r\" (UniqueName: \"kubernetes.io/projected/75203917-b2f8-418f-a9b4-0267e1fd4518-kube-api-access-xk88r\") pod \"service-ca-658d7b7c78-rrrcd\" (UID: \"75203917-b2f8-418f-a9b4-0267e1fd4518\") " pod="openshift-service-ca/service-ca-658d7b7c78-rrrcd" Jul 27 12:23:26.166591 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:26.166562 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xk88r\" (UniqueName: \"kubernetes.io/projected/75203917-b2f8-418f-a9b4-0267e1fd4518-kube-api-access-xk88r\") pod \"service-ca-658d7b7c78-rrrcd\" (UID: \"75203917-b2f8-418f-a9b4-0267e1fd4518\") " pod="openshift-service-ca/service-ca-658d7b7c78-rrrcd" Jul 27 12:23:26.166740 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:26.166629 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/75203917-b2f8-418f-a9b4-0267e1fd4518-signing-key\") pod \"service-ca-658d7b7c78-rrrcd\" (UID: \"75203917-b2f8-418f-a9b4-0267e1fd4518\") " pod="openshift-service-ca/service-ca-658d7b7c78-rrrcd" Jul 27 12:23:26.166740 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:26.166672 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/47c5fef3-31cb-4670-9299-9561ecf16099-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-q4w2k\" (UID: \"47c5fef3-31cb-4670-9299-9561ecf16099\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-q4w2k" Jul 27 12:23:26.166740 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:26.166697 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/75203917-b2f8-418f-a9b4-0267e1fd4518-signing-cabundle\") pod \"service-ca-658d7b7c78-rrrcd\" (UID: \"75203917-b2f8-418f-a9b4-0267e1fd4518\") " pod="openshift-service-ca/service-ca-658d7b7c78-rrrcd" Jul 27 12:23:26.166868 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:23:26.166799 2568 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 27 12:23:26.166868 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:23:26.166857 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47c5fef3-31cb-4670-9299-9561ecf16099-samples-operator-tls podName:47c5fef3-31cb-4670-9299-9561ecf16099 nodeName:}" failed. No retries permitted until 2026-07-27 12:23:27.166839774 +0000 UTC m=+41.569974614 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/47c5fef3-31cb-4670-9299-9561ecf16099-samples-operator-tls") pod "cluster-samples-operator-6748489656-q4w2k" (UID: "47c5fef3-31cb-4670-9299-9561ecf16099") : secret "samples-operator-tls" not found Jul 27 12:23:26.167254 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:26.167233 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/75203917-b2f8-418f-a9b4-0267e1fd4518-signing-cabundle\") pod \"service-ca-658d7b7c78-rrrcd\" (UID: \"75203917-b2f8-418f-a9b4-0267e1fd4518\") " pod="openshift-service-ca/service-ca-658d7b7c78-rrrcd" Jul 27 12:23:26.168989 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:26.168970 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/75203917-b2f8-418f-a9b4-0267e1fd4518-signing-key\") pod \"service-ca-658d7b7c78-rrrcd\" (UID: \"75203917-b2f8-418f-a9b4-0267e1fd4518\") " pod="openshift-service-ca/service-ca-658d7b7c78-rrrcd" Jul 27 12:23:26.183682 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:26.183626 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xk88r\" (UniqueName: \"kubernetes.io/projected/75203917-b2f8-418f-a9b4-0267e1fd4518-kube-api-access-xk88r\") pod \"service-ca-658d7b7c78-rrrcd\" (UID: \"75203917-b2f8-418f-a9b4-0267e1fd4518\") " pod="openshift-service-ca/service-ca-658d7b7c78-rrrcd" Jul 27 12:23:26.235473 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:26.235445 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-658d7b7c78-rrrcd" Jul 27 12:23:26.349293 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:26.349264 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-2cdc4" event={"ID":"5313f3d9-169d-4010-a1a0-9a0405b1bccf","Type":"ContainerStarted","Data":"e830b61856ae71677bd8025c2ab0c5d72518414d2b38dfe2efd038800b745857"} Jul 27 12:23:26.383273 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:26.383246 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-rrrcd"] Jul 27 12:23:26.385955 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:23:26.385932 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75203917_b2f8_418f_a9b4_0267e1fd4518.slice/crio-5f2f962863390fe93e2ee27050809549a7997a1b3e2b94d67747b5e8dfb43120 WatchSource:0}: Error finding container 5f2f962863390fe93e2ee27050809549a7997a1b3e2b94d67747b5e8dfb43120: Status 404 returned error can't find the container with id 5f2f962863390fe93e2ee27050809549a7997a1b3e2b94d67747b5e8dfb43120 Jul 27 12:23:26.480877 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:26.480854 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-c6p2s_a80003d1-f5f7-442b-83c9-bba4bd72902a/node-ca/0.log" Jul 27 12:23:27.175145 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:27.175109 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/47c5fef3-31cb-4670-9299-9561ecf16099-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-q4w2k\" (UID: \"47c5fef3-31cb-4670-9299-9561ecf16099\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-q4w2k" Jul 27 12:23:27.175344 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:23:27.175298 2568 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 27 12:23:27.175404 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:23:27.175367 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47c5fef3-31cb-4670-9299-9561ecf16099-samples-operator-tls podName:47c5fef3-31cb-4670-9299-9561ecf16099 nodeName:}" failed. No retries permitted until 2026-07-27 12:23:29.175348156 +0000 UTC m=+43.578483014 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/47c5fef3-31cb-4670-9299-9561ecf16099-samples-operator-tls") pod "cluster-samples-operator-6748489656-q4w2k" (UID: "47c5fef3-31cb-4670-9299-9561ecf16099") : secret "samples-operator-tls" not found Jul 27 12:23:27.353746 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:27.353698 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-658d7b7c78-rrrcd" event={"ID":"75203917-b2f8-418f-a9b4-0267e1fd4518","Type":"ContainerStarted","Data":"5f2f962863390fe93e2ee27050809549a7997a1b3e2b94d67747b5e8dfb43120"} Jul 27 12:23:27.486423 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:27.486390 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-h5sgp_2bfeb1e3-aa75-4b3d-90d8-eef715105e77/serve-healthcheck-canary/0.log" Jul 27 12:23:27.679848 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:27.679814 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c421b82e-b61e-4a0f-8a1c-055841ac0e4f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mdfcs\" (UID: \"c421b82e-b61e-4a0f-8a1c-055841ac0e4f\") " pod="openshift-insights/insights-runtime-extractor-mdfcs" Jul 27 12:23:27.680035 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:27.679914 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c421b82e-b61e-4a0f-8a1c-055841ac0e4f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mdfcs\" (UID: \"c421b82e-b61e-4a0f-8a1c-055841ac0e4f\") " pod="openshift-insights/insights-runtime-extractor-mdfcs" Jul 27 12:23:27.680035 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:23:27.679941 2568 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 27 12:23:27.680035 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:23:27.680018 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c421b82e-b61e-4a0f-8a1c-055841ac0e4f-kube-rbac-proxy-cm podName:c421b82e-b61e-4a0f-8a1c-055841ac0e4f nodeName:}" failed. No retries permitted until 2026-07-27 12:23:31.680000552 +0000 UTC m=+46.083135387 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c421b82e-b61e-4a0f-8a1c-055841ac0e4f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-mdfcs" (UID: "c421b82e-b61e-4a0f-8a1c-055841ac0e4f") : configmap "kube-rbac-proxy" not found Jul 27 12:23:27.680175 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:23:27.680030 2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 27 12:23:27.680175 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:23:27.680102 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c421b82e-b61e-4a0f-8a1c-055841ac0e4f-insights-runtime-extractor-tls podName:c421b82e-b61e-4a0f-8a1c-055841ac0e4f nodeName:}" failed. No retries permitted until 2026-07-27 12:23:31.680087036 +0000 UTC m=+46.083221872 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c421b82e-b61e-4a0f-8a1c-055841ac0e4f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mdfcs" (UID: "c421b82e-b61e-4a0f-8a1c-055841ac0e4f") : secret "insights-runtime-extractor-tls" not found Jul 27 12:23:28.284994 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:28.284955 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8be6dd92-30a3-4fa3-83f0-a352c43ae37d-metrics-tls\") pod \"dns-default-wc5br\" (UID: \"8be6dd92-30a3-4fa3-83f0-a352c43ae37d\") " pod="openshift-dns/dns-default-wc5br" Jul 27 12:23:28.285188 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:23:28.285100 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 27 12:23:28.285188 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:23:28.285168 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8be6dd92-30a3-4fa3-83f0-a352c43ae37d-metrics-tls podName:8be6dd92-30a3-4fa3-83f0-a352c43ae37d nodeName:}" failed. No retries permitted until 2026-07-27 12:23:36.285150551 +0000 UTC m=+50.688285388 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8be6dd92-30a3-4fa3-83f0-a352c43ae37d-metrics-tls") pod "dns-default-wc5br" (UID: "8be6dd92-30a3-4fa3-83f0-a352c43ae37d") : secret "dns-default-metrics-tls" not found Jul 27 12:23:29.192434 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:29.192404 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/47c5fef3-31cb-4670-9299-9561ecf16099-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-q4w2k\" (UID: \"47c5fef3-31cb-4670-9299-9561ecf16099\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-q4w2k" Jul 27 12:23:29.192819 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:23:29.192580 2568 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 27 12:23:29.192819 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:23:29.192658 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47c5fef3-31cb-4670-9299-9561ecf16099-samples-operator-tls podName:47c5fef3-31cb-4670-9299-9561ecf16099 nodeName:}" failed. No retries permitted until 2026-07-27 12:23:33.192637882 +0000 UTC m=+47.595772720 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/47c5fef3-31cb-4670-9299-9561ecf16099-samples-operator-tls") pod "cluster-samples-operator-6748489656-q4w2k" (UID: "47c5fef3-31cb-4670-9299-9561ecf16099") : secret "samples-operator-tls" not found Jul 27 12:23:29.360779 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:29.360694 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-2cdc4_5313f3d9-169d-4010-a1a0-9a0405b1bccf/console-operator/0.log" Jul 27 12:23:29.360779 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:29.360743 2568 generic.go:356] "Generic (PLEG): container finished" podID="5313f3d9-169d-4010-a1a0-9a0405b1bccf" containerID="c5ca544c835eb86fb579b66e7c30b9b82effb87d78cbbac7bd3d221d811d1431" exitCode=255 Jul 27 12:23:29.360965 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:29.360778 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-2cdc4" event={"ID":"5313f3d9-169d-4010-a1a0-9a0405b1bccf","Type":"ContainerDied","Data":"c5ca544c835eb86fb579b66e7c30b9b82effb87d78cbbac7bd3d221d811d1431"} Jul 27 12:23:29.361095 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:29.361058 2568 scope.go:117] "RemoveContainer" containerID="c5ca544c835eb86fb579b66e7c30b9b82effb87d78cbbac7bd3d221d811d1431" Jul 27 12:23:29.362425 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:29.362402 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-658d7b7c78-rrrcd" event={"ID":"75203917-b2f8-418f-a9b4-0267e1fd4518","Type":"ContainerStarted","Data":"15e96abe5d1857f5b531f134b7585e8c866f4ecab64ba475fe0ee3076abeddbd"} Jul 27 12:23:29.406942 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:29.406901 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-658d7b7c78-rrrcd" podStartSLOduration=1.789038951 podStartE2EDuration="4.406887495s" totalImagesPullingTime="2.617848544s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 12:23:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 12:23:29.405977124 +0000 UTC m=+43.809111991" watchObservedRunningTime="2026-07-27 12:23:29.406887495 +0000 UTC m=+43.810022352" Jul 27 12:23:30.366369 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:30.366340 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-2cdc4_5313f3d9-169d-4010-a1a0-9a0405b1bccf/console-operator/1.log" Jul 27 12:23:30.366912 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:30.366808 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-2cdc4_5313f3d9-169d-4010-a1a0-9a0405b1bccf/console-operator/0.log" Jul 27 12:23:30.366912 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:30.366851 2568 generic.go:356] "Generic (PLEG): container finished" podID="5313f3d9-169d-4010-a1a0-9a0405b1bccf" containerID="b353c79dc832670a381900242b697543af76fb9fe3a2a6e3f69aabe3cfbe1b6f" exitCode=255 Jul 27 12:23:30.367034 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:30.366927 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-2cdc4" event={"ID":"5313f3d9-169d-4010-a1a0-9a0405b1bccf","Type":"ContainerDied","Data":"b353c79dc832670a381900242b697543af76fb9fe3a2a6e3f69aabe3cfbe1b6f"} Jul 27 12:23:30.367034 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:30.366978 2568 scope.go:117] "RemoveContainer" containerID="c5ca544c835eb86fb579b66e7c30b9b82effb87d78cbbac7bd3d221d811d1431" Jul 27 12:23:30.367173 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:30.367156 2568 scope.go:117] "RemoveContainer" containerID="b353c79dc832670a381900242b697543af76fb9fe3a2a6e3f69aabe3cfbe1b6f" Jul 27 12:23:30.367361 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:23:30.367338 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-2cdc4_openshift-console-operator(5313f3d9-169d-4010-a1a0-9a0405b1bccf)\"" pod="openshift-console-operator/console-operator-584dcb6b54-2cdc4" podUID="5313f3d9-169d-4010-a1a0-9a0405b1bccf" Jul 27 12:23:31.371369 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:31.371342 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-2cdc4_5313f3d9-169d-4010-a1a0-9a0405b1bccf/console-operator/1.log" Jul 27 12:23:31.371747 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:31.371730 2568 scope.go:117] "RemoveContainer" containerID="b353c79dc832670a381900242b697543af76fb9fe3a2a6e3f69aabe3cfbe1b6f" Jul 27 12:23:31.371927 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:23:31.371904 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-2cdc4_openshift-console-operator(5313f3d9-169d-4010-a1a0-9a0405b1bccf)\"" pod="openshift-console-operator/console-operator-584dcb6b54-2cdc4" podUID="5313f3d9-169d-4010-a1a0-9a0405b1bccf" Jul 27 12:23:31.711249 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:31.711221 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c421b82e-b61e-4a0f-8a1c-055841ac0e4f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mdfcs\" (UID: \"c421b82e-b61e-4a0f-8a1c-055841ac0e4f\") " pod="openshift-insights/insights-runtime-extractor-mdfcs" Jul 27 12:23:31.711413 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:31.711273 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c421b82e-b61e-4a0f-8a1c-055841ac0e4f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mdfcs\" (UID: \"c421b82e-b61e-4a0f-8a1c-055841ac0e4f\") " pod="openshift-insights/insights-runtime-extractor-mdfcs" Jul 27 12:23:31.711413 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:23:31.711354 2568 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 27 12:23:31.711413 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:23:31.711377 2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 27 12:23:31.711514 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:23:31.711438 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c421b82e-b61e-4a0f-8a1c-055841ac0e4f-kube-rbac-proxy-cm podName:c421b82e-b61e-4a0f-8a1c-055841ac0e4f nodeName:}" failed. No retries permitted until 2026-07-27 12:23:39.711424393 +0000 UTC m=+54.114559228 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c421b82e-b61e-4a0f-8a1c-055841ac0e4f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-mdfcs" (UID: "c421b82e-b61e-4a0f-8a1c-055841ac0e4f") : configmap "kube-rbac-proxy" not found Jul 27 12:23:31.711514 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:23:31.711452 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c421b82e-b61e-4a0f-8a1c-055841ac0e4f-insights-runtime-extractor-tls podName:c421b82e-b61e-4a0f-8a1c-055841ac0e4f nodeName:}" failed. No retries permitted until 2026-07-27 12:23:39.711445766 +0000 UTC m=+54.114580601 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c421b82e-b61e-4a0f-8a1c-055841ac0e4f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mdfcs" (UID: "c421b82e-b61e-4a0f-8a1c-055841ac0e4f") : secret "insights-runtime-extractor-tls" not found Jul 27 12:23:33.222458 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:33.222424 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/47c5fef3-31cb-4670-9299-9561ecf16099-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-q4w2k\" (UID: \"47c5fef3-31cb-4670-9299-9561ecf16099\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-q4w2k" Jul 27 12:23:33.224810 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:33.224788 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/47c5fef3-31cb-4670-9299-9561ecf16099-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-q4w2k\" (UID: \"47c5fef3-31cb-4670-9299-9561ecf16099\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-q4w2k" Jul 27 12:23:33.492730 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:33.492638 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-q4w2k" Jul 27 12:23:33.648936 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:33.648905 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-q4w2k"] Jul 27 12:23:34.380725 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:34.380654 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-q4w2k" event={"ID":"47c5fef3-31cb-4670-9299-9561ecf16099","Type":"ContainerStarted","Data":"9b313d0b9b631504697e5c218afa914bcbfbd4d9cd5c212ca75e0e2988c6835c"} Jul 27 12:23:35.795498 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:35.795467 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-2cdc4" Jul 27 12:23:35.795935 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:35.795913 2568 scope.go:117] "RemoveContainer" containerID="b353c79dc832670a381900242b697543af76fb9fe3a2a6e3f69aabe3cfbe1b6f" Jul 27 12:23:35.796107 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:23:35.796081 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-2cdc4_openshift-console-operator(5313f3d9-169d-4010-a1a0-9a0405b1bccf)\"" pod="openshift-console-operator/console-operator-584dcb6b54-2cdc4" podUID="5313f3d9-169d-4010-a1a0-9a0405b1bccf" Jul 27 12:23:35.796416 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:35.796358 2568 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-584dcb6b54-2cdc4" Jul 27 12:23:36.347194 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:36.347163 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8be6dd92-30a3-4fa3-83f0-a352c43ae37d-metrics-tls\") pod \"dns-default-wc5br\" (UID: \"8be6dd92-30a3-4fa3-83f0-a352c43ae37d\") " pod="openshift-dns/dns-default-wc5br" Jul 27 12:23:36.349474 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:36.349451 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8be6dd92-30a3-4fa3-83f0-a352c43ae37d-metrics-tls\") pod \"dns-default-wc5br\" (UID: \"8be6dd92-30a3-4fa3-83f0-a352c43ae37d\") " pod="openshift-dns/dns-default-wc5br" Jul 27 12:23:36.358321 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:36.358302 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-wc5br" Jul 27 12:23:36.388467 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:36.388439 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-q4w2k" event={"ID":"47c5fef3-31cb-4670-9299-9561ecf16099","Type":"ContainerStarted","Data":"ace1e6e201eca15cf08649516cc7e2a9a848392d10a7ea707e2626b749754b32"} Jul 27 12:23:36.388568 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:36.388499 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-q4w2k" event={"ID":"47c5fef3-31cb-4670-9299-9561ecf16099","Type":"ContainerStarted","Data":"a0d3212511f41dd55627880ca654a2a407450074f95d45b873a546f263708f81"} Jul 27 12:23:36.388832 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:36.388815 2568 scope.go:117] "RemoveContainer" containerID="b353c79dc832670a381900242b697543af76fb9fe3a2a6e3f69aabe3cfbe1b6f" Jul 27 12:23:36.388968 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:23:36.388950 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-2cdc4_openshift-console-operator(5313f3d9-169d-4010-a1a0-9a0405b1bccf)\"" pod="openshift-console-operator/console-operator-584dcb6b54-2cdc4" podUID="5313f3d9-169d-4010-a1a0-9a0405b1bccf" Jul 27 12:23:36.409910 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:36.409866 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-q4w2k" podStartSLOduration=9.36183037 podStartE2EDuration="11.409852194s" totalImagesPullingTime="2.048021824s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 12:23:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 12:23:36.408969074 +0000 UTC m=+50.812103932" watchObservedRunningTime="2026-07-27 12:23:36.409852194 +0000 UTC m=+50.812987050" Jul 27 12:23:36.490934 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:36.490909 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-wc5br"] Jul 27 12:23:36.493877 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:23:36.493855 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8be6dd92_30a3_4fa3_83f0_a352c43ae37d.slice/crio-9ebaeb0351103e681c41772b34987e2aa0908c3c1e7c4ceaee48ef3f83d28f0e WatchSource:0}: Error finding container 9ebaeb0351103e681c41772b34987e2aa0908c3c1e7c4ceaee48ef3f83d28f0e: Status 404 returned error can't find the container with id 9ebaeb0351103e681c41772b34987e2aa0908c3c1e7c4ceaee48ef3f83d28f0e Jul 27 12:23:37.392130 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:37.392091 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wc5br" event={"ID":"8be6dd92-30a3-4fa3-83f0-a352c43ae37d","Type":"ContainerStarted","Data":"9ebaeb0351103e681c41772b34987e2aa0908c3c1e7c4ceaee48ef3f83d28f0e"} Jul 27 12:23:39.401211 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:39.401179 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wc5br" event={"ID":"8be6dd92-30a3-4fa3-83f0-a352c43ae37d","Type":"ContainerStarted","Data":"5b1e5295447ecec5fa201113bbe1609a838f94812f7a4d398b1753640d0e09c2"} Jul 27 12:23:39.401655 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:39.401231 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wc5br" event={"ID":"8be6dd92-30a3-4fa3-83f0-a352c43ae37d","Type":"ContainerStarted","Data":"2d8dc0cfd92d126b4ee9b3d77d6f83d0a22a276843ee08b428f24e1b6518867a"} Jul 27 12:23:39.401655 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:39.401304 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-wc5br" Jul 27 12:23:39.420051 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:39.420003 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-wc5br" podStartSLOduration=17.461137201 podStartE2EDuration="19.419987764s" totalImagesPullingTime="1.958850563s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 12:23:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 12:23:39.419169732 +0000 UTC m=+53.822304590" watchObservedRunningTime="2026-07-27 12:23:39.419987764 +0000 UTC m=+53.823122621" Jul 27 12:23:39.772935 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:39.772902 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c421b82e-b61e-4a0f-8a1c-055841ac0e4f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mdfcs\" (UID: \"c421b82e-b61e-4a0f-8a1c-055841ac0e4f\") " pod="openshift-insights/insights-runtime-extractor-mdfcs" Jul 27 12:23:39.773170 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:39.772958 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c421b82e-b61e-4a0f-8a1c-055841ac0e4f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mdfcs\" (UID: \"c421b82e-b61e-4a0f-8a1c-055841ac0e4f\") " pod="openshift-insights/insights-runtime-extractor-mdfcs" Jul 27 12:23:39.773170 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:23:39.773052 2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 27 12:23:39.773170 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:23:39.773121 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c421b82e-b61e-4a0f-8a1c-055841ac0e4f-insights-runtime-extractor-tls podName:c421b82e-b61e-4a0f-8a1c-055841ac0e4f nodeName:}" failed. No retries permitted until 2026-07-27 12:23:55.773105039 +0000 UTC m=+70.176239874 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c421b82e-b61e-4a0f-8a1c-055841ac0e4f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mdfcs" (UID: "c421b82e-b61e-4a0f-8a1c-055841ac0e4f") : secret "insights-runtime-extractor-tls" not found Jul 27 12:23:39.773469 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:39.773452 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c421b82e-b61e-4a0f-8a1c-055841ac0e4f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mdfcs\" (UID: \"c421b82e-b61e-4a0f-8a1c-055841ac0e4f\") " pod="openshift-insights/insights-runtime-extractor-mdfcs" Jul 27 12:23:46.318030 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:46.318003 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ktgz9" Jul 27 12:23:48.016556 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:48.016526 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-q9hxp"] Jul 27 12:23:48.019214 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:48.019195 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-q9hxp" Jul 27 12:23:48.022295 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:48.022270 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 27 12:23:48.022447 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:48.022323 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-7vj8l\"" Jul 27 12:23:48.022447 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:48.022330 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 27 12:23:48.026268 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:48.026248 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f487bbd78-z2mkg"] Jul 27 12:23:48.028306 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:48.028289 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f487bbd78-z2mkg" Jul 27 12:23:48.032178 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:48.032153 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 27 12:23:48.032178 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:48.032163 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 27 12:23:48.032353 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:48.032230 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 27 12:23:48.032353 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:48.032286 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-7qwm6\"" Jul 27 12:23:48.032536 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:48.032520 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 27 12:23:48.035526 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:48.035508 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-q9hxp"] Jul 27 12:23:48.047388 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:48.047367 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f487bbd78-z2mkg"] Jul 27 12:23:48.127863 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:48.127831 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-78bb786d79-m5w5m"] Jul 27 12:23:48.128877 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:48.128858 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wmrsp\" (UniqueName: \"kubernetes.io/projected/54341936-ecff-42e8-91df-003c39022b7a-kube-api-access-wmrsp\") pod \"managed-serviceaccount-addon-agent-5f487bbd78-z2mkg\" (UID: \"54341936-ecff-42e8-91df-003c39022b7a\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f487bbd78-z2mkg" Jul 27 12:23:48.128943 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:48.128897 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/eb9990e4-1960-48c4-9e5f-97f84e6f57a1-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-q9hxp\" (UID: \"eb9990e4-1960-48c4-9e5f-97f84e6f57a1\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-q9hxp" Jul 27 12:23:48.128943 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:48.128936 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/eb9990e4-1960-48c4-9e5f-97f84e6f57a1-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-q9hxp\" (UID: \"eb9990e4-1960-48c4-9e5f-97f84e6f57a1\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-q9hxp" Jul 27 12:23:48.129011 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:48.128989 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/54341936-ecff-42e8-91df-003c39022b7a-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5f487bbd78-z2mkg\" (UID: \"54341936-ecff-42e8-91df-003c39022b7a\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f487bbd78-z2mkg" Jul 27 12:23:48.129791 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:48.129777 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-78bb786d79-m5w5m" Jul 27 12:23:48.132428 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:48.132407 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 27 12:23:48.132546 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:48.132459 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 27 12:23:48.132944 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:48.132927 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 27 12:23:48.133024 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:48.132935 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-6wbbb\"" Jul 27 12:23:48.138563 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:48.138546 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 27 12:23:48.145534 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:48.145516 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-78bb786d79-m5w5m"] Jul 27 12:23:48.162584 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:48.162566 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-78bb786d79-m5w5m"] Jul 27 12:23:48.162796 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:23:48.162776 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[bound-sa-token ca-trust-extracted image-registry-private-configuration installation-pull-secrets kube-api-access-rwdvz registry-certificates registry-tls trusted-ca], unattached volumes=[], failed to process volumes=[bound-sa-token ca-trust-extracted image-registry-private-configuration installation-pull-secrets kube-api-access-rwdvz registry-certificates registry-tls trusted-ca]: context canceled" pod="openshift-image-registry/image-registry-78bb786d79-m5w5m" podUID="1919e65d-d384-48a7-8d39-d87ea81fa55e" Jul 27 12:23:48.229866 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:48.229836 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1919e65d-d384-48a7-8d39-d87ea81fa55e-image-registry-private-configuration\") pod \"image-registry-78bb786d79-m5w5m\" (UID: \"1919e65d-d384-48a7-8d39-d87ea81fa55e\") " pod="openshift-image-registry/image-registry-78bb786d79-m5w5m" Jul 27 12:23:48.229866 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:48.229869 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1919e65d-d384-48a7-8d39-d87ea81fa55e-bound-sa-token\") pod \"image-registry-78bb786d79-m5w5m\" (UID: \"1919e65d-d384-48a7-8d39-d87ea81fa55e\") " pod="openshift-image-registry/image-registry-78bb786d79-m5w5m" Jul 27 12:23:48.230084 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:48.229892 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1919e65d-d384-48a7-8d39-d87ea81fa55e-installation-pull-secrets\") pod \"image-registry-78bb786d79-m5w5m\" (UID: \"1919e65d-d384-48a7-8d39-d87ea81fa55e\") " pod="openshift-image-registry/image-registry-78bb786d79-m5w5m" Jul 27 12:23:48.230084 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:48.229996 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1919e65d-d384-48a7-8d39-d87ea81fa55e-registry-tls\") pod \"image-registry-78bb786d79-m5w5m\" (UID: \"1919e65d-d384-48a7-8d39-d87ea81fa55e\") " pod="openshift-image-registry/image-registry-78bb786d79-m5w5m" Jul 27 12:23:48.230084 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:48.230044 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1919e65d-d384-48a7-8d39-d87ea81fa55e-registry-certificates\") pod \"image-registry-78bb786d79-m5w5m\" (UID: \"1919e65d-d384-48a7-8d39-d87ea81fa55e\") " pod="openshift-image-registry/image-registry-78bb786d79-m5w5m" Jul 27 12:23:48.230084 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:48.230082 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/eb9990e4-1960-48c4-9e5f-97f84e6f57a1-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-q9hxp\" (UID: \"eb9990e4-1960-48c4-9e5f-97f84e6f57a1\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-q9hxp" Jul 27 12:23:48.230310 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:48.230101 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/54341936-ecff-42e8-91df-003c39022b7a-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5f487bbd78-z2mkg\" (UID: \"54341936-ecff-42e8-91df-003c39022b7a\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f487bbd78-z2mkg" Jul 27 12:23:48.230310 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:48.230116 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1919e65d-d384-48a7-8d39-d87ea81fa55e-ca-trust-extracted\") pod \"image-registry-78bb786d79-m5w5m\" (UID: \"1919e65d-d384-48a7-8d39-d87ea81fa55e\") " pod="openshift-image-registry/image-registry-78bb786d79-m5w5m" Jul 27 12:23:48.230310 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:48.230147 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/eb9990e4-1960-48c4-9e5f-97f84e6f57a1-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-q9hxp\" (UID: \"eb9990e4-1960-48c4-9e5f-97f84e6f57a1\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-q9hxp" Jul 27 12:23:48.230310 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:48.230186 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1919e65d-d384-48a7-8d39-d87ea81fa55e-trusted-ca\") pod \"image-registry-78bb786d79-m5w5m\" (UID: \"1919e65d-d384-48a7-8d39-d87ea81fa55e\") " pod="openshift-image-registry/image-registry-78bb786d79-m5w5m" Jul 27 12:23:48.230310 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:48.230224 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wmrsp\" (UniqueName: \"kubernetes.io/projected/54341936-ecff-42e8-91df-003c39022b7a-kube-api-access-wmrsp\") pod \"managed-serviceaccount-addon-agent-5f487bbd78-z2mkg\" (UID: \"54341936-ecff-42e8-91df-003c39022b7a\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f487bbd78-z2mkg" Jul 27 12:23:48.230310 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:48.230281 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rwdvz\" (UniqueName: \"kubernetes.io/projected/1919e65d-d384-48a7-8d39-d87ea81fa55e-kube-api-access-rwdvz\") pod \"image-registry-78bb786d79-m5w5m\" (UID: \"1919e65d-d384-48a7-8d39-d87ea81fa55e\") " pod="openshift-image-registry/image-registry-78bb786d79-m5w5m" Jul 27 12:23:48.231196 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:48.231173 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/eb9990e4-1960-48c4-9e5f-97f84e6f57a1-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-q9hxp\" (UID: \"eb9990e4-1960-48c4-9e5f-97f84e6f57a1\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-q9hxp" Jul 27 12:23:48.232628 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:48.232604 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/54341936-ecff-42e8-91df-003c39022b7a-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5f487bbd78-z2mkg\" (UID: \"54341936-ecff-42e8-91df-003c39022b7a\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f487bbd78-z2mkg" Jul 27 12:23:48.232865 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:48.232846 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/eb9990e4-1960-48c4-9e5f-97f84e6f57a1-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-q9hxp\" (UID: \"eb9990e4-1960-48c4-9e5f-97f84e6f57a1\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-q9hxp" Jul 27 12:23:48.244633 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:48.244613 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wmrsp\" (UniqueName: \"kubernetes.io/projected/54341936-ecff-42e8-91df-003c39022b7a-kube-api-access-wmrsp\") pod \"managed-serviceaccount-addon-agent-5f487bbd78-z2mkg\" (UID: \"54341936-ecff-42e8-91df-003c39022b7a\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f487bbd78-z2mkg" Jul 27 12:23:48.327668 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:48.327585 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-q9hxp" Jul 27 12:23:48.330800 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:48.330777 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1919e65d-d384-48a7-8d39-d87ea81fa55e-ca-trust-extracted\") pod \"image-registry-78bb786d79-m5w5m\" (UID: \"1919e65d-d384-48a7-8d39-d87ea81fa55e\") " pod="openshift-image-registry/image-registry-78bb786d79-m5w5m" Jul 27 12:23:48.330865 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:48.330833 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1919e65d-d384-48a7-8d39-d87ea81fa55e-trusted-ca\") pod \"image-registry-78bb786d79-m5w5m\" (UID: \"1919e65d-d384-48a7-8d39-d87ea81fa55e\") " pod="openshift-image-registry/image-registry-78bb786d79-m5w5m" Jul 27 12:23:48.330901 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:48.330862 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rwdvz\" (UniqueName: \"kubernetes.io/projected/1919e65d-d384-48a7-8d39-d87ea81fa55e-kube-api-access-rwdvz\") pod \"image-registry-78bb786d79-m5w5m\" (UID: \"1919e65d-d384-48a7-8d39-d87ea81fa55e\") " pod="openshift-image-registry/image-registry-78bb786d79-m5w5m" Jul 27 12:23:48.330901 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:48.330895 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1919e65d-d384-48a7-8d39-d87ea81fa55e-image-registry-private-configuration\") pod \"image-registry-78bb786d79-m5w5m\" (UID: \"1919e65d-d384-48a7-8d39-d87ea81fa55e\") " pod="openshift-image-registry/image-registry-78bb786d79-m5w5m" Jul 27 12:23:48.330974 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:48.330912 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1919e65d-d384-48a7-8d39-d87ea81fa55e-bound-sa-token\") pod \"image-registry-78bb786d79-m5w5m\" (UID: \"1919e65d-d384-48a7-8d39-d87ea81fa55e\") " pod="openshift-image-registry/image-registry-78bb786d79-m5w5m" Jul 27 12:23:48.330974 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:48.330937 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1919e65d-d384-48a7-8d39-d87ea81fa55e-installation-pull-secrets\") pod \"image-registry-78bb786d79-m5w5m\" (UID: \"1919e65d-d384-48a7-8d39-d87ea81fa55e\") " pod="openshift-image-registry/image-registry-78bb786d79-m5w5m" Jul 27 12:23:48.331076 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:48.330980 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1919e65d-d384-48a7-8d39-d87ea81fa55e-registry-tls\") pod \"image-registry-78bb786d79-m5w5m\" (UID: \"1919e65d-d384-48a7-8d39-d87ea81fa55e\") " pod="openshift-image-registry/image-registry-78bb786d79-m5w5m" Jul 27 12:23:48.331076 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:48.331015 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1919e65d-d384-48a7-8d39-d87ea81fa55e-registry-certificates\") pod \"image-registry-78bb786d79-m5w5m\" (UID: \"1919e65d-d384-48a7-8d39-d87ea81fa55e\") " pod="openshift-image-registry/image-registry-78bb786d79-m5w5m" Jul 27 12:23:48.331184 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:48.331163 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1919e65d-d384-48a7-8d39-d87ea81fa55e-ca-trust-extracted\") pod \"image-registry-78bb786d79-m5w5m\" (UID: \"1919e65d-d384-48a7-8d39-d87ea81fa55e\") " pod="openshift-image-registry/image-registry-78bb786d79-m5w5m" Jul 27 12:23:48.332038 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:48.332009 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1919e65d-d384-48a7-8d39-d87ea81fa55e-registry-certificates\") pod \"image-registry-78bb786d79-m5w5m\" (UID: \"1919e65d-d384-48a7-8d39-d87ea81fa55e\") " pod="openshift-image-registry/image-registry-78bb786d79-m5w5m" Jul 27 12:23:48.332243 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:48.332221 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1919e65d-d384-48a7-8d39-d87ea81fa55e-trusted-ca\") pod \"image-registry-78bb786d79-m5w5m\" (UID: \"1919e65d-d384-48a7-8d39-d87ea81fa55e\") " pod="openshift-image-registry/image-registry-78bb786d79-m5w5m" Jul 27 12:23:48.333539 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:48.333507 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1919e65d-d384-48a7-8d39-d87ea81fa55e-image-registry-private-configuration\") pod \"image-registry-78bb786d79-m5w5m\" (UID: \"1919e65d-d384-48a7-8d39-d87ea81fa55e\") " pod="openshift-image-registry/image-registry-78bb786d79-m5w5m" Jul 27 12:23:48.333650 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:48.333609 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1919e65d-d384-48a7-8d39-d87ea81fa55e-registry-tls\") pod \"image-registry-78bb786d79-m5w5m\" (UID: \"1919e65d-d384-48a7-8d39-d87ea81fa55e\") " pod="openshift-image-registry/image-registry-78bb786d79-m5w5m" Jul 27 12:23:48.333791 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:48.333774 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1919e65d-d384-48a7-8d39-d87ea81fa55e-installation-pull-secrets\") pod \"image-registry-78bb786d79-m5w5m\" (UID: \"1919e65d-d384-48a7-8d39-d87ea81fa55e\") " pod="openshift-image-registry/image-registry-78bb786d79-m5w5m" Jul 27 12:23:48.343900 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:48.343851 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rwdvz\" (UniqueName: \"kubernetes.io/projected/1919e65d-d384-48a7-8d39-d87ea81fa55e-kube-api-access-rwdvz\") pod \"image-registry-78bb786d79-m5w5m\" (UID: \"1919e65d-d384-48a7-8d39-d87ea81fa55e\") " pod="openshift-image-registry/image-registry-78bb786d79-m5w5m" Jul 27 12:23:48.344504 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:48.344479 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1919e65d-d384-48a7-8d39-d87ea81fa55e-bound-sa-token\") pod \"image-registry-78bb786d79-m5w5m\" (UID: \"1919e65d-d384-48a7-8d39-d87ea81fa55e\") " pod="openshift-image-registry/image-registry-78bb786d79-m5w5m" Jul 27 12:23:48.353327 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:48.353308 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f487bbd78-z2mkg" Jul 27 12:23:48.430406 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:48.430378 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-78bb786d79-m5w5m" Jul 27 12:23:48.437020 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:48.436993 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-78bb786d79-m5w5m" Jul 27 12:23:48.465328 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:48.465302 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-q9hxp"] Jul 27 12:23:48.468427 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:23:48.468405 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb9990e4_1960_48c4_9e5f_97f84e6f57a1.slice/crio-a75ff87078045b4ee94e51db0fdc73a00606a5209c9259a2132bc523458abfdb WatchSource:0}: Error finding container a75ff87078045b4ee94e51db0fdc73a00606a5209c9259a2132bc523458abfdb: Status 404 returned error can't find the container with id a75ff87078045b4ee94e51db0fdc73a00606a5209c9259a2132bc523458abfdb Jul 27 12:23:48.484410 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:48.484387 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f487bbd78-z2mkg"] Jul 27 12:23:48.486953 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:23:48.486932 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod54341936_ecff_42e8_91df_003c39022b7a.slice/crio-470d6cab812a4ed1d13cf0c97589eefded272e99cb65c454fdc986626de023ee WatchSource:0}: Error finding container 470d6cab812a4ed1d13cf0c97589eefded272e99cb65c454fdc986626de023ee: Status 404 returned error can't find the container with id 470d6cab812a4ed1d13cf0c97589eefded272e99cb65c454fdc986626de023ee Jul 27 12:23:48.532576 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:48.532555 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1919e65d-d384-48a7-8d39-d87ea81fa55e-registry-tls\") pod \"1919e65d-d384-48a7-8d39-d87ea81fa55e\" (UID: \"1919e65d-d384-48a7-8d39-d87ea81fa55e\") " Jul 27 12:23:48.532735 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:48.532582 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1919e65d-d384-48a7-8d39-d87ea81fa55e-registry-certificates\") pod \"1919e65d-d384-48a7-8d39-d87ea81fa55e\" (UID: \"1919e65d-d384-48a7-8d39-d87ea81fa55e\") " Jul 27 12:23:48.532735 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:48.532605 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1919e65d-d384-48a7-8d39-d87ea81fa55e-installation-pull-secrets\") pod \"1919e65d-d384-48a7-8d39-d87ea81fa55e\" (UID: \"1919e65d-d384-48a7-8d39-d87ea81fa55e\") " Jul 27 12:23:48.532735 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:48.532625 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1919e65d-d384-48a7-8d39-d87ea81fa55e-trusted-ca\") pod \"1919e65d-d384-48a7-8d39-d87ea81fa55e\" (UID: \"1919e65d-d384-48a7-8d39-d87ea81fa55e\") " Jul 27 12:23:48.532735 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:48.532645 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1919e65d-d384-48a7-8d39-d87ea81fa55e-image-registry-private-configuration\") pod \"1919e65d-d384-48a7-8d39-d87ea81fa55e\" (UID: \"1919e65d-d384-48a7-8d39-d87ea81fa55e\") " Jul 27 12:23:48.532735 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:48.532661 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1919e65d-d384-48a7-8d39-d87ea81fa55e-bound-sa-token\") pod \"1919e65d-d384-48a7-8d39-d87ea81fa55e\" (UID: \"1919e65d-d384-48a7-8d39-d87ea81fa55e\") " Jul 27 12:23:48.532735 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:48.532691 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rwdvz\" (UniqueName: \"kubernetes.io/projected/1919e65d-d384-48a7-8d39-d87ea81fa55e-kube-api-access-rwdvz\") pod \"1919e65d-d384-48a7-8d39-d87ea81fa55e\" (UID: \"1919e65d-d384-48a7-8d39-d87ea81fa55e\") " Jul 27 12:23:48.533029 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:48.532763 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1919e65d-d384-48a7-8d39-d87ea81fa55e-ca-trust-extracted\") pod \"1919e65d-d384-48a7-8d39-d87ea81fa55e\" (UID: \"1919e65d-d384-48a7-8d39-d87ea81fa55e\") " Jul 27 12:23:48.533096 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:48.533056 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1919e65d-d384-48a7-8d39-d87ea81fa55e-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "1919e65d-d384-48a7-8d39-d87ea81fa55e" (UID: "1919e65d-d384-48a7-8d39-d87ea81fa55e"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 12:23:48.533204 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:48.533182 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1919e65d-d384-48a7-8d39-d87ea81fa55e-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "1919e65d-d384-48a7-8d39-d87ea81fa55e" (UID: "1919e65d-d384-48a7-8d39-d87ea81fa55e"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 27 12:23:48.533267 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:48.533227 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1919e65d-d384-48a7-8d39-d87ea81fa55e-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "1919e65d-d384-48a7-8d39-d87ea81fa55e" (UID: "1919e65d-d384-48a7-8d39-d87ea81fa55e"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 12:23:48.534993 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:48.534946 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1919e65d-d384-48a7-8d39-d87ea81fa55e-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "1919e65d-d384-48a7-8d39-d87ea81fa55e" (UID: "1919e65d-d384-48a7-8d39-d87ea81fa55e"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 12:23:48.534993 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:48.534959 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1919e65d-d384-48a7-8d39-d87ea81fa55e-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "1919e65d-d384-48a7-8d39-d87ea81fa55e" (UID: "1919e65d-d384-48a7-8d39-d87ea81fa55e"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 12:23:48.534993 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:48.534954 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1919e65d-d384-48a7-8d39-d87ea81fa55e-kube-api-access-rwdvz" (OuterVolumeSpecName: "kube-api-access-rwdvz") pod "1919e65d-d384-48a7-8d39-d87ea81fa55e" (UID: "1919e65d-d384-48a7-8d39-d87ea81fa55e"). InnerVolumeSpecName "kube-api-access-rwdvz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 12:23:48.535218 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:48.535203 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1919e65d-d384-48a7-8d39-d87ea81fa55e-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "1919e65d-d384-48a7-8d39-d87ea81fa55e" (UID: "1919e65d-d384-48a7-8d39-d87ea81fa55e"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 12:23:48.535268 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:48.535243 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1919e65d-d384-48a7-8d39-d87ea81fa55e-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "1919e65d-d384-48a7-8d39-d87ea81fa55e" (UID: "1919e65d-d384-48a7-8d39-d87ea81fa55e"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 12:23:48.633432 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:48.633363 2568 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1919e65d-d384-48a7-8d39-d87ea81fa55e-registry-tls\") on node \"ip-10-0-141-3.ec2.internal\" DevicePath \"\"" Jul 27 12:23:48.633432 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:48.633391 2568 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1919e65d-d384-48a7-8d39-d87ea81fa55e-registry-certificates\") on node \"ip-10-0-141-3.ec2.internal\" DevicePath \"\"" Jul 27 12:23:48.633432 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:48.633402 2568 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1919e65d-d384-48a7-8d39-d87ea81fa55e-installation-pull-secrets\") on node \"ip-10-0-141-3.ec2.internal\" DevicePath \"\"" Jul 27 12:23:48.633432 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:48.633410 2568 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1919e65d-d384-48a7-8d39-d87ea81fa55e-trusted-ca\") on node \"ip-10-0-141-3.ec2.internal\" DevicePath \"\"" Jul 27 12:23:48.633432 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:48.633419 2568 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1919e65d-d384-48a7-8d39-d87ea81fa55e-image-registry-private-configuration\") on node \"ip-10-0-141-3.ec2.internal\" DevicePath \"\"" Jul 27 12:23:48.633432 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:48.633428 2568 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1919e65d-d384-48a7-8d39-d87ea81fa55e-bound-sa-token\") on node \"ip-10-0-141-3.ec2.internal\" DevicePath \"\"" Jul 27 12:23:48.633691 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:48.633437 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rwdvz\" (UniqueName: \"kubernetes.io/projected/1919e65d-d384-48a7-8d39-d87ea81fa55e-kube-api-access-rwdvz\") on node \"ip-10-0-141-3.ec2.internal\" DevicePath \"\"" Jul 27 12:23:48.633691 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:48.633445 2568 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1919e65d-d384-48a7-8d39-d87ea81fa55e-ca-trust-extracted\") on node \"ip-10-0-141-3.ec2.internal\" DevicePath \"\"" Jul 27 12:23:49.157827 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:49.157230 2568 scope.go:117] "RemoveContainer" containerID="b353c79dc832670a381900242b697543af76fb9fe3a2a6e3f69aabe3cfbe1b6f" Jul 27 12:23:49.407152 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:49.407121 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-wc5br" Jul 27 12:23:49.439679 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:49.439601 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f487bbd78-z2mkg" event={"ID":"54341936-ecff-42e8-91df-003c39022b7a","Type":"ContainerStarted","Data":"470d6cab812a4ed1d13cf0c97589eefded272e99cb65c454fdc986626de023ee"} Jul 27 12:23:49.442248 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:49.442222 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-2cdc4_5313f3d9-169d-4010-a1a0-9a0405b1bccf/console-operator/1.log" Jul 27 12:23:49.442368 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:49.442318 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-2cdc4" event={"ID":"5313f3d9-169d-4010-a1a0-9a0405b1bccf","Type":"ContainerStarted","Data":"91d34ebda7d7f9ffb0a828d131d629c31dbfb953c146c41ac5390fb599d98c65"} Jul 27 12:23:49.443296 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:49.443277 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-2cdc4" Jul 27 12:23:49.445627 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:49.445609 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-78bb786d79-m5w5m" Jul 27 12:23:49.450574 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:49.450549 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-q9hxp" event={"ID":"eb9990e4-1960-48c4-9e5f-97f84e6f57a1","Type":"ContainerStarted","Data":"a75ff87078045b4ee94e51db0fdc73a00606a5209c9259a2132bc523458abfdb"} Jul 27 12:23:49.468237 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:49.468190 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-584dcb6b54-2cdc4" podStartSLOduration=21.433917596 podStartE2EDuration="24.468176656s" totalImagesPullingTime="3.03425906s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 12:23:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 12:23:49.46714857 +0000 UTC m=+63.870283428" watchObservedRunningTime="2026-07-27 12:23:49.468176656 +0000 UTC m=+63.871311533" Jul 27 12:23:49.500699 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:49.500674 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-78bb786d79-m5w5m"] Jul 27 12:23:49.509986 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:49.509961 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-78bb786d79-m5w5m"] Jul 27 12:23:49.587463 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:49.586797 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-ck5qx"] Jul 27 12:23:49.591991 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:49.591967 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-ck5qx" Jul 27 12:23:49.595151 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:49.594997 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 27 12:23:49.595373 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:49.595329 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-7wgwl\"" Jul 27 12:23:49.603541 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:49.603481 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-ck5qx"] Jul 27 12:23:49.643536 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:49.643507 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/9f64c6bd-7ab7-4612-a64c-14d46b718bf9-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-ck5qx\" (UID: \"9f64c6bd-7ab7-4612-a64c-14d46b718bf9\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-ck5qx" Jul 27 12:23:49.744566 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:49.744528 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/9f64c6bd-7ab7-4612-a64c-14d46b718bf9-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-ck5qx\" (UID: \"9f64c6bd-7ab7-4612-a64c-14d46b718bf9\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-ck5qx" Jul 27 12:23:49.744766 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:23:49.744699 2568 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jul 27 12:23:49.744846 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:23:49.744807 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f64c6bd-7ab7-4612-a64c-14d46b718bf9-tls-certificates podName:9f64c6bd-7ab7-4612-a64c-14d46b718bf9 nodeName:}" failed. No retries permitted until 2026-07-27 12:23:50.244780854 +0000 UTC m=+64.647915689 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/9f64c6bd-7ab7-4612-a64c-14d46b718bf9-tls-certificates") pod "prometheus-operator-admission-webhook-7f8d78f54b-ck5qx" (UID: "9f64c6bd-7ab7-4612-a64c-14d46b718bf9") : secret "prometheus-operator-admission-webhook-tls" not found Jul 27 12:23:49.770013 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:49.769985 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-584dcb6b54-2cdc4" Jul 27 12:23:50.161286 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:50.161211 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1919e65d-d384-48a7-8d39-d87ea81fa55e" path="/var/lib/kubelet/pods/1919e65d-d384-48a7-8d39-d87ea81fa55e/volumes" Jul 27 12:23:50.248287 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:50.248251 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/9f64c6bd-7ab7-4612-a64c-14d46b718bf9-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-ck5qx\" (UID: \"9f64c6bd-7ab7-4612-a64c-14d46b718bf9\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-ck5qx" Jul 27 12:23:50.250950 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:50.250923 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/9f64c6bd-7ab7-4612-a64c-14d46b718bf9-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-ck5qx\" (UID: \"9f64c6bd-7ab7-4612-a64c-14d46b718bf9\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-ck5qx" Jul 27 12:23:50.451319 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:50.451274 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-q9hxp" event={"ID":"eb9990e4-1960-48c4-9e5f-97f84e6f57a1","Type":"ContainerStarted","Data":"6abf138c6edb2deaa9b6d92c804735e15f6711fa614150f00397852f0ede0ea4"} Jul 27 12:23:50.466411 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:50.466367 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-74c9f884b7-q9hxp" podStartSLOduration=2.15723606 podStartE2EDuration="3.466349493s" totalImagesPullingTime="1.309113433s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 12:23:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 12:23:50.46578929 +0000 UTC m=+64.868924146" watchObservedRunningTime="2026-07-27 12:23:50.466349493 +0000 UTC m=+64.869484350" Jul 27 12:23:50.516305 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:50.516266 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-ck5qx" Jul 27 12:23:51.014597 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:51.014569 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-ck5qx"] Jul 27 12:23:51.017474 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:23:51.017452 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f64c6bd_7ab7_4612_a64c_14d46b718bf9.slice/crio-7f7eafd4300442c41daec846e070cc671e09e65a75f42f3a50f21068ec43a563 WatchSource:0}: Error finding container 7f7eafd4300442c41daec846e070cc671e09e65a75f42f3a50f21068ec43a563: Status 404 returned error can't find the container with id 7f7eafd4300442c41daec846e070cc671e09e65a75f42f3a50f21068ec43a563 Jul 27 12:23:51.458916 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:51.458876 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f487bbd78-z2mkg" event={"ID":"54341936-ecff-42e8-91df-003c39022b7a","Type":"ContainerStarted","Data":"22a5d611e785f14f3075583bcdf6393a6ccdcb85f546e3905d9e4c739ef27905"} Jul 27 12:23:51.460244 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:51.460216 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-ck5qx" event={"ID":"9f64c6bd-7ab7-4612-a64c-14d46b718bf9","Type":"ContainerStarted","Data":"7f7eafd4300442c41daec846e070cc671e09e65a75f42f3a50f21068ec43a563"} Jul 27 12:23:51.488261 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:51.488218 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f487bbd78-z2mkg" podStartSLOduration=2.045848995 podStartE2EDuration="4.488204127s" totalImagesPullingTime="2.442355132s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 12:23:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 12:23:51.487572735 +0000 UTC m=+65.890707596" watchObservedRunningTime="2026-07-27 12:23:51.488204127 +0000 UTC m=+65.891338985" Jul 27 12:23:51.862905 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:51.862818 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ae5989c7-50c7-40bd-aac4-3383a9a9c435-metrics-certs\") pod \"network-metrics-daemon-4p2n8\" (UID: \"ae5989c7-50c7-40bd-aac4-3383a9a9c435\") " pod="openshift-multus/network-metrics-daemon-4p2n8" Jul 27 12:23:51.862905 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:51.862865 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/38ae6d3f-614b-4437-bb61-ad161748269f-original-pull-secret\") pod \"global-pull-secret-syncer-sfvmh\" (UID: \"38ae6d3f-614b-4437-bb61-ad161748269f\") " pod="kube-system/global-pull-secret-syncer-sfvmh" Jul 27 12:23:51.866021 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:51.865998 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 27 12:23:51.866150 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:51.865998 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 27 12:23:51.876035 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:51.876011 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/38ae6d3f-614b-4437-bb61-ad161748269f-original-pull-secret\") pod \"global-pull-secret-syncer-sfvmh\" (UID: \"38ae6d3f-614b-4437-bb61-ad161748269f\") " pod="kube-system/global-pull-secret-syncer-sfvmh" Jul 27 12:23:51.876175 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:51.876014 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ae5989c7-50c7-40bd-aac4-3383a9a9c435-metrics-certs\") pod \"network-metrics-daemon-4p2n8\" (UID: \"ae5989c7-50c7-40bd-aac4-3383a9a9c435\") " pod="openshift-multus/network-metrics-daemon-4p2n8" Jul 27 12:23:51.887139 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:51.887119 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sfvmh" Jul 27 12:23:51.963610 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:51.963566 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vsjpz\" (UniqueName: \"kubernetes.io/projected/fdfb006f-abc1-4762-9c0b-15b1159e2d8e-kube-api-access-vsjpz\") pod \"network-check-target-8vcwp\" (UID: \"fdfb006f-abc1-4762-9c0b-15b1159e2d8e\") " pod="openshift-network-diagnostics/network-check-target-8vcwp" Jul 27 12:23:51.966595 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:51.966568 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 27 12:23:51.976652 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:51.976626 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 27 12:23:51.986844 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:51.986821 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vsjpz\" (UniqueName: \"kubernetes.io/projected/fdfb006f-abc1-4762-9c0b-15b1159e2d8e-kube-api-access-vsjpz\") pod \"network-check-target-8vcwp\" (UID: \"fdfb006f-abc1-4762-9c0b-15b1159e2d8e\") " pod="openshift-network-diagnostics/network-check-target-8vcwp" Jul 27 12:23:52.023510 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:52.023476 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-sfvmh"] Jul 27 12:23:52.163418 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:23:52.163352 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38ae6d3f_614b_4437_bb61_ad161748269f.slice/crio-cfe0a7e134266fef62c6350925ba17b7f10b4244865975d0584de62f21f61302 WatchSource:0}: Error finding container cfe0a7e134266fef62c6350925ba17b7f10b4244865975d0584de62f21f61302: Status 404 returned error can't find the container with id cfe0a7e134266fef62c6350925ba17b7f10b4244865975d0584de62f21f61302 Jul 27 12:23:52.175360 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:52.175338 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-vxl2z\"" Jul 27 12:23:52.182564 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:52.182538 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-kgw4x\"" Jul 27 12:23:52.182678 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:52.182662 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4p2n8" Jul 27 12:23:52.190631 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:52.190616 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8vcwp" Jul 27 12:23:52.318186 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:52.318157 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-4p2n8"] Jul 27 12:23:52.320930 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:23:52.320907 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae5989c7_50c7_40bd_aac4_3383a9a9c435.slice/crio-5d84688d00c7ad939194344af1a519d4603e750c121923ac80b9ae0f8f1623e4 WatchSource:0}: Error finding container 5d84688d00c7ad939194344af1a519d4603e750c121923ac80b9ae0f8f1623e4: Status 404 returned error can't find the container with id 5d84688d00c7ad939194344af1a519d4603e750c121923ac80b9ae0f8f1623e4 Jul 27 12:23:52.334441 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:52.334361 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-8vcwp"] Jul 27 12:23:52.336820 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:23:52.336800 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfdfb006f_abc1_4762_9c0b_15b1159e2d8e.slice/crio-c6dedf786a5b55b3ed11ad3a9c4a806fc1b1ef61d30054a5d5d06ef723ff9399 WatchSource:0}: Error finding container c6dedf786a5b55b3ed11ad3a9c4a806fc1b1ef61d30054a5d5d06ef723ff9399: Status 404 returned error can't find the container with id c6dedf786a5b55b3ed11ad3a9c4a806fc1b1ef61d30054a5d5d06ef723ff9399 Jul 27 12:23:52.464836 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:52.464807 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-8vcwp" event={"ID":"fdfb006f-abc1-4762-9c0b-15b1159e2d8e","Type":"ContainerStarted","Data":"c6dedf786a5b55b3ed11ad3a9c4a806fc1b1ef61d30054a5d5d06ef723ff9399"} Jul 27 12:23:52.466275 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:52.466252 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-ck5qx" event={"ID":"9f64c6bd-7ab7-4612-a64c-14d46b718bf9","Type":"ContainerStarted","Data":"ec5155ad978a4e80413722b5bf01f018664a4885ca3d5ffb06c635d279b72ebb"} Jul 27 12:23:52.466398 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:52.466364 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-ck5qx" Jul 27 12:23:52.467550 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:52.467529 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4p2n8" event={"ID":"ae5989c7-50c7-40bd-aac4-3383a9a9c435","Type":"ContainerStarted","Data":"5d84688d00c7ad939194344af1a519d4603e750c121923ac80b9ae0f8f1623e4"} Jul 27 12:23:52.468869 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:52.468851 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-sfvmh" event={"ID":"38ae6d3f-614b-4437-bb61-ad161748269f","Type":"ContainerStarted","Data":"cfe0a7e134266fef62c6350925ba17b7f10b4244865975d0584de62f21f61302"} Jul 27 12:23:52.471605 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:52.471589 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-ck5qx" Jul 27 12:23:52.483965 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:52.483909 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-ck5qx" podStartSLOduration=2.316249081 podStartE2EDuration="3.483896541s" totalImagesPullingTime="1.16764746s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 12:23:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 12:23:52.482873122 +0000 UTC m=+66.886007980" watchObservedRunningTime="2026-07-27 12:23:52.483896541 +0000 UTC m=+66.887031398" Jul 27 12:23:52.663525 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:52.663490 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-528lr"] Jul 27 12:23:52.669532 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:52.669506 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-528lr" Jul 27 12:23:52.672496 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:52.672278 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 27 12:23:52.672496 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:52.672307 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 27 12:23:52.672496 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:52.672358 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 27 12:23:52.672496 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:52.672282 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 27 12:23:52.672753 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:52.672535 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 27 12:23:52.672753 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:52.672745 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-zl4cz\"" Jul 27 12:23:52.679916 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:52.679892 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-528lr"] Jul 27 12:23:52.770166 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:52.769986 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/d3afbed3-d768-474c-bc23-fa72c717a36e-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-528lr\" (UID: \"d3afbed3-d768-474c-bc23-fa72c717a36e\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-528lr" Jul 27 12:23:52.770166 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:52.770060 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d3afbed3-d768-474c-bc23-fa72c717a36e-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-528lr\" (UID: \"d3afbed3-d768-474c-bc23-fa72c717a36e\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-528lr" Jul 27 12:23:52.770166 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:52.770086 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2sbtk\" (UniqueName: \"kubernetes.io/projected/d3afbed3-d768-474c-bc23-fa72c717a36e-kube-api-access-2sbtk\") pod \"prometheus-operator-84d69f794d-528lr\" (UID: \"d3afbed3-d768-474c-bc23-fa72c717a36e\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-528lr" Jul 27 12:23:52.770166 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:52.770121 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d3afbed3-d768-474c-bc23-fa72c717a36e-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-528lr\" (UID: \"d3afbed3-d768-474c-bc23-fa72c717a36e\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-528lr" Jul 27 12:23:52.870948 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:52.870908 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/d3afbed3-d768-474c-bc23-fa72c717a36e-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-528lr\" (UID: \"d3afbed3-d768-474c-bc23-fa72c717a36e\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-528lr" Jul 27 12:23:52.871127 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:52.870969 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d3afbed3-d768-474c-bc23-fa72c717a36e-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-528lr\" (UID: \"d3afbed3-d768-474c-bc23-fa72c717a36e\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-528lr" Jul 27 12:23:52.871127 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:52.870995 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2sbtk\" (UniqueName: \"kubernetes.io/projected/d3afbed3-d768-474c-bc23-fa72c717a36e-kube-api-access-2sbtk\") pod \"prometheus-operator-84d69f794d-528lr\" (UID: \"d3afbed3-d768-474c-bc23-fa72c717a36e\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-528lr" Jul 27 12:23:52.871127 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:23:52.871027 2568 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jul 27 12:23:52.871127 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:23:52.871100 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3afbed3-d768-474c-bc23-fa72c717a36e-prometheus-operator-tls podName:d3afbed3-d768-474c-bc23-fa72c717a36e nodeName:}" failed. No retries permitted until 2026-07-27 12:23:53.371080241 +0000 UTC m=+67.774215078 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/d3afbed3-d768-474c-bc23-fa72c717a36e-prometheus-operator-tls") pod "prometheus-operator-84d69f794d-528lr" (UID: "d3afbed3-d768-474c-bc23-fa72c717a36e") : secret "prometheus-operator-tls" not found Jul 27 12:23:52.871330 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:52.871032 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d3afbed3-d768-474c-bc23-fa72c717a36e-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-528lr\" (UID: \"d3afbed3-d768-474c-bc23-fa72c717a36e\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-528lr" Jul 27 12:23:52.871874 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:52.871821 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d3afbed3-d768-474c-bc23-fa72c717a36e-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-528lr\" (UID: \"d3afbed3-d768-474c-bc23-fa72c717a36e\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-528lr" Jul 27 12:23:52.875191 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:52.875162 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d3afbed3-d768-474c-bc23-fa72c717a36e-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-528lr\" (UID: \"d3afbed3-d768-474c-bc23-fa72c717a36e\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-528lr" Jul 27 12:23:52.883271 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:52.883170 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2sbtk\" (UniqueName: \"kubernetes.io/projected/d3afbed3-d768-474c-bc23-fa72c717a36e-kube-api-access-2sbtk\") pod \"prometheus-operator-84d69f794d-528lr\" (UID: \"d3afbed3-d768-474c-bc23-fa72c717a36e\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-528lr" Jul 27 12:23:53.376134 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:53.376002 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/d3afbed3-d768-474c-bc23-fa72c717a36e-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-528lr\" (UID: \"d3afbed3-d768-474c-bc23-fa72c717a36e\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-528lr" Jul 27 12:23:53.380472 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:53.380441 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/d3afbed3-d768-474c-bc23-fa72c717a36e-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-528lr\" (UID: \"d3afbed3-d768-474c-bc23-fa72c717a36e\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-528lr" Jul 27 12:23:53.581629 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:53.581599 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-528lr" Jul 27 12:23:53.746212 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:53.746178 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-528lr"] Jul 27 12:23:53.794587 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:23:53.794552 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3afbed3_d768_474c_bc23_fa72c717a36e.slice/crio-2177d175087c44083cf6978080c4723a0e5a537e56e59caefbcf4a26ee6c4c18 WatchSource:0}: Error finding container 2177d175087c44083cf6978080c4723a0e5a537e56e59caefbcf4a26ee6c4c18: Status 404 returned error can't find the container with id 2177d175087c44083cf6978080c4723a0e5a537e56e59caefbcf4a26ee6c4c18 Jul 27 12:23:54.480218 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:54.480177 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-528lr" event={"ID":"d3afbed3-d768-474c-bc23-fa72c717a36e","Type":"ContainerStarted","Data":"2177d175087c44083cf6978080c4723a0e5a537e56e59caefbcf4a26ee6c4c18"} Jul 27 12:23:54.483211 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:54.483135 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4p2n8" event={"ID":"ae5989c7-50c7-40bd-aac4-3383a9a9c435","Type":"ContainerStarted","Data":"be9291405c5af288aac300d49b3296ebbd7aaa7a9ba867bc197d9d2eceb343ff"} Jul 27 12:23:54.483211 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:54.483197 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4p2n8" event={"ID":"ae5989c7-50c7-40bd-aac4-3383a9a9c435","Type":"ContainerStarted","Data":"9273d9e39e5dcb21449dccc8e24c784565eba154117ebb7e05c382b83f04a873"} Jul 27 12:23:54.501678 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:54.501622 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-4p2n8" podStartSLOduration=67.008615603 podStartE2EDuration="1m8.501604281s" totalImagesPullingTime="1.492988678s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 12:22:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 12:23:54.500366304 +0000 UTC m=+68.903501166" watchObservedRunningTime="2026-07-27 12:23:54.501604281 +0000 UTC m=+68.904739143" Jul 27 12:23:55.795878 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:55.795835 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c421b82e-b61e-4a0f-8a1c-055841ac0e4f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mdfcs\" (UID: \"c421b82e-b61e-4a0f-8a1c-055841ac0e4f\") " pod="openshift-insights/insights-runtime-extractor-mdfcs" Jul 27 12:23:55.798483 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:55.798456 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c421b82e-b61e-4a0f-8a1c-055841ac0e4f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mdfcs\" (UID: \"c421b82e-b61e-4a0f-8a1c-055841ac0e4f\") " pod="openshift-insights/insights-runtime-extractor-mdfcs" Jul 27 12:23:56.040918 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:56.040892 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-svzcd\"" Jul 27 12:23:56.049313 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:56.049247 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-mdfcs" Jul 27 12:23:57.579902 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:57.579818 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-mdfcs"] Jul 27 12:23:57.582440 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:23:57.582412 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc421b82e_b61e_4a0f_8a1c_055841ac0e4f.slice/crio-69e8038c6662b6332830f24657e00d6bf50c3307f6f869f1c03d6a6a88dd783f WatchSource:0}: Error finding container 69e8038c6662b6332830f24657e00d6bf50c3307f6f869f1c03d6a6a88dd783f: Status 404 returned error can't find the container with id 69e8038c6662b6332830f24657e00d6bf50c3307f6f869f1c03d6a6a88dd783f Jul 27 12:23:58.505502 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:58.505461 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-sfvmh" event={"ID":"38ae6d3f-614b-4437-bb61-ad161748269f","Type":"ContainerStarted","Data":"e2245cc0f401c8fc6bc65e797fa3f9aa031fc75a0c734f1629c0167427c42819"} Jul 27 12:23:58.507420 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:58.507348 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mdfcs" event={"ID":"c421b82e-b61e-4a0f-8a1c-055841ac0e4f","Type":"ContainerStarted","Data":"69e8038c6662b6332830f24657e00d6bf50c3307f6f869f1c03d6a6a88dd783f"} Jul 27 12:23:58.510141 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:58.510116 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-528lr" event={"ID":"d3afbed3-d768-474c-bc23-fa72c717a36e","Type":"ContainerStarted","Data":"b4ab6061e9a3c1b5fb79979eca4a436e46486ead7614685c5bb841a32fda4d1c"} Jul 27 12:23:58.510251 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:58.510178 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-528lr" event={"ID":"d3afbed3-d768-474c-bc23-fa72c717a36e","Type":"ContainerStarted","Data":"448b9fa608acef40fffb69bcc51e0d71993d198e32aa8efd62c6f322a9f63a3e"} Jul 27 12:23:58.512257 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:58.512229 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-8vcwp" event={"ID":"fdfb006f-abc1-4762-9c0b-15b1159e2d8e","Type":"ContainerStarted","Data":"56415b90fe59e04c907736f616c2e15b84aa84c483ba17a3e57d451e96de2f1b"} Jul 27 12:23:58.512479 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:58.512437 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-8vcwp" Jul 27 12:23:58.528824 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:58.528758 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-sfvmh" podStartSLOduration=67.279627404 podStartE2EDuration="1m12.528741571s" totalImagesPullingTime="5.249114167s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 12:22:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 12:23:58.528457489 +0000 UTC m=+72.931592346" watchObservedRunningTime="2026-07-27 12:23:58.528741571 +0000 UTC m=+72.931876428" Jul 27 12:23:58.551238 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:58.551187 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-8vcwp" podStartSLOduration=67.490370664 podStartE2EDuration="1m12.551166725s" totalImagesPullingTime="5.060796061s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 12:22:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 12:23:58.551012434 +0000 UTC m=+72.954147292" watchObservedRunningTime="2026-07-27 12:23:58.551166725 +0000 UTC m=+72.954301584" Jul 27 12:23:58.581635 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:23:58.581581 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-84d69f794d-528lr" podStartSLOduration=2.993209529 podStartE2EDuration="6.581560989s" totalImagesPullingTime="3.58835146s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 12:23:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 12:23:58.580267399 +0000 UTC m=+72.983402255" watchObservedRunningTime="2026-07-27 12:23:58.581560989 +0000 UTC m=+72.984695847" Jul 27 12:24:00.237663 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:00.237633 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-n2spg"] Jul 27 12:24:00.246135 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:00.246111 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-n2spg" Jul 27 12:24:00.251422 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:00.251385 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 27 12:24:00.251550 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:00.251489 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-h99np\"" Jul 27 12:24:00.251731 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:00.251700 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 27 12:24:00.251990 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:00.251972 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 27 12:24:00.332500 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:00.332457 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/16041d20-46cb-42f8-bbaf-2cb0f58523c4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-n2spg\" (UID: \"16041d20-46cb-42f8-bbaf-2cb0f58523c4\") " pod="openshift-monitoring/node-exporter-n2spg" Jul 27 12:24:00.332679 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:00.332505 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/16041d20-46cb-42f8-bbaf-2cb0f58523c4-node-exporter-tls\") pod \"node-exporter-n2spg\" (UID: \"16041d20-46cb-42f8-bbaf-2cb0f58523c4\") " pod="openshift-monitoring/node-exporter-n2spg" Jul 27 12:24:00.332679 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:00.332542 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/16041d20-46cb-42f8-bbaf-2cb0f58523c4-root\") pod \"node-exporter-n2spg\" (UID: \"16041d20-46cb-42f8-bbaf-2cb0f58523c4\") " pod="openshift-monitoring/node-exporter-n2spg" Jul 27 12:24:00.332679 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:00.332618 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/16041d20-46cb-42f8-bbaf-2cb0f58523c4-node-exporter-textfile\") pod \"node-exporter-n2spg\" (UID: \"16041d20-46cb-42f8-bbaf-2cb0f58523c4\") " pod="openshift-monitoring/node-exporter-n2spg" Jul 27 12:24:00.332679 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:00.332651 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ct64s\" (UniqueName: \"kubernetes.io/projected/16041d20-46cb-42f8-bbaf-2cb0f58523c4-kube-api-access-ct64s\") pod \"node-exporter-n2spg\" (UID: \"16041d20-46cb-42f8-bbaf-2cb0f58523c4\") " pod="openshift-monitoring/node-exporter-n2spg" Jul 27 12:24:00.332923 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:00.332695 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/16041d20-46cb-42f8-bbaf-2cb0f58523c4-node-exporter-accelerators-collector-config\") pod \"node-exporter-n2spg\" (UID: \"16041d20-46cb-42f8-bbaf-2cb0f58523c4\") " pod="openshift-monitoring/node-exporter-n2spg" Jul 27 12:24:00.332923 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:00.332748 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/16041d20-46cb-42f8-bbaf-2cb0f58523c4-sys\") pod \"node-exporter-n2spg\" (UID: \"16041d20-46cb-42f8-bbaf-2cb0f58523c4\") " pod="openshift-monitoring/node-exporter-n2spg" Jul 27 12:24:00.332923 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:00.332776 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/16041d20-46cb-42f8-bbaf-2cb0f58523c4-node-exporter-wtmp\") pod \"node-exporter-n2spg\" (UID: \"16041d20-46cb-42f8-bbaf-2cb0f58523c4\") " pod="openshift-monitoring/node-exporter-n2spg" Jul 27 12:24:00.332923 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:00.332808 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/16041d20-46cb-42f8-bbaf-2cb0f58523c4-metrics-client-ca\") pod \"node-exporter-n2spg\" (UID: \"16041d20-46cb-42f8-bbaf-2cb0f58523c4\") " pod="openshift-monitoring/node-exporter-n2spg" Jul 27 12:24:00.434205 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:00.434161 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/16041d20-46cb-42f8-bbaf-2cb0f58523c4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-n2spg\" (UID: \"16041d20-46cb-42f8-bbaf-2cb0f58523c4\") " pod="openshift-monitoring/node-exporter-n2spg" Jul 27 12:24:00.434391 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:00.434221 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/16041d20-46cb-42f8-bbaf-2cb0f58523c4-node-exporter-tls\") pod \"node-exporter-n2spg\" (UID: \"16041d20-46cb-42f8-bbaf-2cb0f58523c4\") " pod="openshift-monitoring/node-exporter-n2spg" Jul 27 12:24:00.434391 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:00.434254 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/16041d20-46cb-42f8-bbaf-2cb0f58523c4-root\") pod \"node-exporter-n2spg\" (UID: \"16041d20-46cb-42f8-bbaf-2cb0f58523c4\") " pod="openshift-monitoring/node-exporter-n2spg" Jul 27 12:24:00.434391 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:00.434278 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/16041d20-46cb-42f8-bbaf-2cb0f58523c4-node-exporter-textfile\") pod \"node-exporter-n2spg\" (UID: \"16041d20-46cb-42f8-bbaf-2cb0f58523c4\") " pod="openshift-monitoring/node-exporter-n2spg" Jul 27 12:24:00.434391 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:00.434300 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ct64s\" (UniqueName: \"kubernetes.io/projected/16041d20-46cb-42f8-bbaf-2cb0f58523c4-kube-api-access-ct64s\") pod \"node-exporter-n2spg\" (UID: \"16041d20-46cb-42f8-bbaf-2cb0f58523c4\") " pod="openshift-monitoring/node-exporter-n2spg" Jul 27 12:24:00.434391 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:00.434330 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/16041d20-46cb-42f8-bbaf-2cb0f58523c4-node-exporter-accelerators-collector-config\") pod \"node-exporter-n2spg\" (UID: \"16041d20-46cb-42f8-bbaf-2cb0f58523c4\") " pod="openshift-monitoring/node-exporter-n2spg" Jul 27 12:24:00.434391 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:00.434359 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/16041d20-46cb-42f8-bbaf-2cb0f58523c4-sys\") pod \"node-exporter-n2spg\" (UID: \"16041d20-46cb-42f8-bbaf-2cb0f58523c4\") " pod="openshift-monitoring/node-exporter-n2spg" Jul 27 12:24:00.434391 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:24:00.434378 2568 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 27 12:24:00.434659 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:24:00.434443 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16041d20-46cb-42f8-bbaf-2cb0f58523c4-node-exporter-tls podName:16041d20-46cb-42f8-bbaf-2cb0f58523c4 nodeName:}" failed. No retries permitted until 2026-07-27 12:24:00.934427281 +0000 UTC m=+75.337562116 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/16041d20-46cb-42f8-bbaf-2cb0f58523c4-node-exporter-tls") pod "node-exporter-n2spg" (UID: "16041d20-46cb-42f8-bbaf-2cb0f58523c4") : secret "node-exporter-tls" not found Jul 27 12:24:00.434659 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:00.434507 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/16041d20-46cb-42f8-bbaf-2cb0f58523c4-node-exporter-wtmp\") pod \"node-exporter-n2spg\" (UID: \"16041d20-46cb-42f8-bbaf-2cb0f58523c4\") " pod="openshift-monitoring/node-exporter-n2spg" Jul 27 12:24:00.434659 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:00.434560 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/16041d20-46cb-42f8-bbaf-2cb0f58523c4-root\") pod \"node-exporter-n2spg\" (UID: \"16041d20-46cb-42f8-bbaf-2cb0f58523c4\") " pod="openshift-monitoring/node-exporter-n2spg" Jul 27 12:24:00.434659 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:00.434384 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/16041d20-46cb-42f8-bbaf-2cb0f58523c4-node-exporter-wtmp\") pod \"node-exporter-n2spg\" (UID: \"16041d20-46cb-42f8-bbaf-2cb0f58523c4\") " pod="openshift-monitoring/node-exporter-n2spg" Jul 27 12:24:00.434895 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:00.434683 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/16041d20-46cb-42f8-bbaf-2cb0f58523c4-metrics-client-ca\") pod \"node-exporter-n2spg\" (UID: \"16041d20-46cb-42f8-bbaf-2cb0f58523c4\") " pod="openshift-monitoring/node-exporter-n2spg" Jul 27 12:24:00.434895 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:00.434860 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/16041d20-46cb-42f8-bbaf-2cb0f58523c4-node-exporter-textfile\") pod \"node-exporter-n2spg\" (UID: \"16041d20-46cb-42f8-bbaf-2cb0f58523c4\") " pod="openshift-monitoring/node-exporter-n2spg" Jul 27 12:24:00.434997 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:00.434913 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/16041d20-46cb-42f8-bbaf-2cb0f58523c4-sys\") pod \"node-exporter-n2spg\" (UID: \"16041d20-46cb-42f8-bbaf-2cb0f58523c4\") " pod="openshift-monitoring/node-exporter-n2spg" Jul 27 12:24:00.435220 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:00.435193 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/16041d20-46cb-42f8-bbaf-2cb0f58523c4-node-exporter-accelerators-collector-config\") pod \"node-exporter-n2spg\" (UID: \"16041d20-46cb-42f8-bbaf-2cb0f58523c4\") " pod="openshift-monitoring/node-exporter-n2spg" Jul 27 12:24:00.435325 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:00.435248 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/16041d20-46cb-42f8-bbaf-2cb0f58523c4-metrics-client-ca\") pod \"node-exporter-n2spg\" (UID: \"16041d20-46cb-42f8-bbaf-2cb0f58523c4\") " pod="openshift-monitoring/node-exporter-n2spg" Jul 27 12:24:00.437089 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:00.437061 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/16041d20-46cb-42f8-bbaf-2cb0f58523c4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-n2spg\" (UID: \"16041d20-46cb-42f8-bbaf-2cb0f58523c4\") " pod="openshift-monitoring/node-exporter-n2spg" Jul 27 12:24:00.447578 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:00.447527 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ct64s\" (UniqueName: \"kubernetes.io/projected/16041d20-46cb-42f8-bbaf-2cb0f58523c4-kube-api-access-ct64s\") pod \"node-exporter-n2spg\" (UID: \"16041d20-46cb-42f8-bbaf-2cb0f58523c4\") " pod="openshift-monitoring/node-exporter-n2spg" Jul 27 12:24:00.938529 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:00.938410 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/16041d20-46cb-42f8-bbaf-2cb0f58523c4-node-exporter-tls\") pod \"node-exporter-n2spg\" (UID: \"16041d20-46cb-42f8-bbaf-2cb0f58523c4\") " pod="openshift-monitoring/node-exporter-n2spg" Jul 27 12:24:00.941013 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:00.940986 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/16041d20-46cb-42f8-bbaf-2cb0f58523c4-node-exporter-tls\") pod \"node-exporter-n2spg\" (UID: \"16041d20-46cb-42f8-bbaf-2cb0f58523c4\") " pod="openshift-monitoring/node-exporter-n2spg" Jul 27 12:24:01.156257 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:01.156222 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 27 12:24:01.159683 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:01.159659 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-n2spg" Jul 27 12:24:01.171451 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:01.171429 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 27 12:24:01.176373 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:01.176349 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 27 12:24:01.176508 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:01.176349 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 27 12:24:01.176508 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:01.176432 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 27 12:24:01.176508 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:01.176462 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-vmtg8\"" Jul 27 12:24:01.176674 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:01.176571 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 27 12:24:01.176674 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:01.176598 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 27 12:24:01.176800 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:01.176682 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 27 12:24:01.176800 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:01.176685 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 27 12:24:01.176946 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:01.176799 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 27 12:24:01.177036 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:01.177020 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 27 12:24:01.184070 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:01.184049 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 27 12:24:01.241285 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:01.241240 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/11d848cc-1c62-47a7-827a-4b77b2f28d79-tls-assets\") pod \"alertmanager-main-0\" (UID: \"11d848cc-1c62-47a7-827a-4b77b2f28d79\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 12:24:01.241742 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:01.241288 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/11d848cc-1c62-47a7-827a-4b77b2f28d79-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"11d848cc-1c62-47a7-827a-4b77b2f28d79\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 12:24:01.241742 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:01.241328 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/11d848cc-1c62-47a7-827a-4b77b2f28d79-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"11d848cc-1c62-47a7-827a-4b77b2f28d79\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 12:24:01.241742 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:01.241413 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/11d848cc-1c62-47a7-827a-4b77b2f28d79-config-out\") pod \"alertmanager-main-0\" (UID: \"11d848cc-1c62-47a7-827a-4b77b2f28d79\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 12:24:01.241742 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:01.241444 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/11d848cc-1c62-47a7-827a-4b77b2f28d79-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"11d848cc-1c62-47a7-827a-4b77b2f28d79\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 12:24:01.241742 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:01.241470 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/11d848cc-1c62-47a7-827a-4b77b2f28d79-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"11d848cc-1c62-47a7-827a-4b77b2f28d79\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 12:24:01.241742 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:01.241525 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/11d848cc-1c62-47a7-827a-4b77b2f28d79-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"11d848cc-1c62-47a7-827a-4b77b2f28d79\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 12:24:01.241742 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:01.241585 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/11d848cc-1c62-47a7-827a-4b77b2f28d79-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"11d848cc-1c62-47a7-827a-4b77b2f28d79\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 12:24:01.241742 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:01.241619 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/11d848cc-1c62-47a7-827a-4b77b2f28d79-config-volume\") pod \"alertmanager-main-0\" (UID: \"11d848cc-1c62-47a7-827a-4b77b2f28d79\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 12:24:01.241742 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:01.241641 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/11d848cc-1c62-47a7-827a-4b77b2f28d79-web-config\") pod \"alertmanager-main-0\" (UID: \"11d848cc-1c62-47a7-827a-4b77b2f28d79\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 12:24:01.241742 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:01.241665 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jgd5d\" (UniqueName: \"kubernetes.io/projected/11d848cc-1c62-47a7-827a-4b77b2f28d79-kube-api-access-jgd5d\") pod \"alertmanager-main-0\" (UID: \"11d848cc-1c62-47a7-827a-4b77b2f28d79\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 12:24:01.241742 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:01.241692 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/11d848cc-1c62-47a7-827a-4b77b2f28d79-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"11d848cc-1c62-47a7-827a-4b77b2f28d79\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 12:24:01.241742 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:01.241736 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11d848cc-1c62-47a7-827a-4b77b2f28d79-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"11d848cc-1c62-47a7-827a-4b77b2f28d79\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 12:24:01.342577 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:01.342539 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/11d848cc-1c62-47a7-827a-4b77b2f28d79-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"11d848cc-1c62-47a7-827a-4b77b2f28d79\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 12:24:01.342577 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:01.342575 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/11d848cc-1c62-47a7-827a-4b77b2f28d79-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"11d848cc-1c62-47a7-827a-4b77b2f28d79\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 12:24:01.342849 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:01.342598 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/11d848cc-1c62-47a7-827a-4b77b2f28d79-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"11d848cc-1c62-47a7-827a-4b77b2f28d79\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 12:24:01.342849 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:01.342648 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/11d848cc-1c62-47a7-827a-4b77b2f28d79-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"11d848cc-1c62-47a7-827a-4b77b2f28d79\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 12:24:01.342849 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:01.342674 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/11d848cc-1c62-47a7-827a-4b77b2f28d79-config-volume\") pod \"alertmanager-main-0\" (UID: \"11d848cc-1c62-47a7-827a-4b77b2f28d79\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 12:24:01.342849 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:01.342693 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/11d848cc-1c62-47a7-827a-4b77b2f28d79-web-config\") pod \"alertmanager-main-0\" (UID: \"11d848cc-1c62-47a7-827a-4b77b2f28d79\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 12:24:01.342849 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:01.342728 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jgd5d\" (UniqueName: \"kubernetes.io/projected/11d848cc-1c62-47a7-827a-4b77b2f28d79-kube-api-access-jgd5d\") pod \"alertmanager-main-0\" (UID: \"11d848cc-1c62-47a7-827a-4b77b2f28d79\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 12:24:01.342849 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:24:01.342736 2568 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jul 27 12:24:01.342849 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:24:01.342812 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11d848cc-1c62-47a7-827a-4b77b2f28d79-secret-alertmanager-main-tls podName:11d848cc-1c62-47a7-827a-4b77b2f28d79 nodeName:}" failed. No retries permitted until 2026-07-27 12:24:01.842789575 +0000 UTC m=+76.245924425 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/11d848cc-1c62-47a7-827a-4b77b2f28d79-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "11d848cc-1c62-47a7-827a-4b77b2f28d79") : secret "alertmanager-main-tls" not found Jul 27 12:24:01.343184 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:01.343165 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/11d848cc-1c62-47a7-827a-4b77b2f28d79-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"11d848cc-1c62-47a7-827a-4b77b2f28d79\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 12:24:01.343242 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:01.343213 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11d848cc-1c62-47a7-827a-4b77b2f28d79-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"11d848cc-1c62-47a7-827a-4b77b2f28d79\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 12:24:01.343297 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:01.343241 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/11d848cc-1c62-47a7-827a-4b77b2f28d79-tls-assets\") pod \"alertmanager-main-0\" (UID: \"11d848cc-1c62-47a7-827a-4b77b2f28d79\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 12:24:01.343297 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:01.343260 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/11d848cc-1c62-47a7-827a-4b77b2f28d79-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"11d848cc-1c62-47a7-827a-4b77b2f28d79\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 12:24:01.344080 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:01.343269 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/11d848cc-1c62-47a7-827a-4b77b2f28d79-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"11d848cc-1c62-47a7-827a-4b77b2f28d79\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 12:24:01.344080 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:01.343659 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/11d848cc-1c62-47a7-827a-4b77b2f28d79-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"11d848cc-1c62-47a7-827a-4b77b2f28d79\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 12:24:01.344080 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:01.343762 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/11d848cc-1c62-47a7-827a-4b77b2f28d79-config-out\") pod \"alertmanager-main-0\" (UID: \"11d848cc-1c62-47a7-827a-4b77b2f28d79\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 12:24:01.344080 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:01.343976 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/11d848cc-1c62-47a7-827a-4b77b2f28d79-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"11d848cc-1c62-47a7-827a-4b77b2f28d79\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 12:24:01.344370 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:24:01.344096 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/11d848cc-1c62-47a7-827a-4b77b2f28d79-alertmanager-trusted-ca-bundle podName:11d848cc-1c62-47a7-827a-4b77b2f28d79 nodeName:}" failed. No retries permitted until 2026-07-27 12:24:01.844078033 +0000 UTC m=+76.247212883 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/11d848cc-1c62-47a7-827a-4b77b2f28d79-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "11d848cc-1c62-47a7-827a-4b77b2f28d79") : configmap references non-existent config key: ca-bundle.crt Jul 27 12:24:01.346431 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:01.345917 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/11d848cc-1c62-47a7-827a-4b77b2f28d79-web-config\") pod \"alertmanager-main-0\" (UID: \"11d848cc-1c62-47a7-827a-4b77b2f28d79\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 12:24:01.346431 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:01.346014 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/11d848cc-1c62-47a7-827a-4b77b2f28d79-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"11d848cc-1c62-47a7-827a-4b77b2f28d79\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 12:24:01.346431 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:01.346395 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/11d848cc-1c62-47a7-827a-4b77b2f28d79-config-volume\") pod \"alertmanager-main-0\" (UID: \"11d848cc-1c62-47a7-827a-4b77b2f28d79\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 12:24:01.347244 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:01.347153 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/11d848cc-1c62-47a7-827a-4b77b2f28d79-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"11d848cc-1c62-47a7-827a-4b77b2f28d79\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 12:24:01.347971 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:01.347928 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/11d848cc-1c62-47a7-827a-4b77b2f28d79-config-out\") pod \"alertmanager-main-0\" (UID: \"11d848cc-1c62-47a7-827a-4b77b2f28d79\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 12:24:01.348479 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:01.348382 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/11d848cc-1c62-47a7-827a-4b77b2f28d79-tls-assets\") pod \"alertmanager-main-0\" (UID: \"11d848cc-1c62-47a7-827a-4b77b2f28d79\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 12:24:01.348479 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:01.348471 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/11d848cc-1c62-47a7-827a-4b77b2f28d79-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"11d848cc-1c62-47a7-827a-4b77b2f28d79\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 12:24:01.348602 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:01.348485 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/11d848cc-1c62-47a7-827a-4b77b2f28d79-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"11d848cc-1c62-47a7-827a-4b77b2f28d79\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 12:24:01.361479 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:01.361453 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jgd5d\" (UniqueName: \"kubernetes.io/projected/11d848cc-1c62-47a7-827a-4b77b2f28d79-kube-api-access-jgd5d\") pod \"alertmanager-main-0\" (UID: \"11d848cc-1c62-47a7-827a-4b77b2f28d79\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 12:24:01.685097 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:01.685019 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-859dc7c46b-h5jmx"] Jul 27 12:24:01.796373 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:01.796336 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-859dc7c46b-h5jmx"] Jul 27 12:24:01.796373 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:01.796359 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-859dc7c46b-h5jmx" Jul 27 12:24:01.799046 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:01.799009 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 27 12:24:01.799184 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:01.799052 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 27 12:24:01.799255 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:01.799187 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 27 12:24:01.799314 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:01.799267 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 27 12:24:01.799414 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:01.799396 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 27 12:24:01.799495 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:01.799454 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-df2f4\"" Jul 27 12:24:01.799550 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:01.799502 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 27 12:24:01.799602 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:01.799454 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 27 12:24:01.849369 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:01.849336 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11d848cc-1c62-47a7-827a-4b77b2f28d79-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"11d848cc-1c62-47a7-827a-4b77b2f28d79\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 12:24:01.849547 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:01.849378 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/50c8b5c0-deb3-4e2f-afbd-93796cc7d81e-console-config\") pod \"console-859dc7c46b-h5jmx\" (UID: \"50c8b5c0-deb3-4e2f-afbd-93796cc7d81e\") " pod="openshift-console/console-859dc7c46b-h5jmx" Jul 27 12:24:01.849547 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:01.849415 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/50c8b5c0-deb3-4e2f-afbd-93796cc7d81e-console-serving-cert\") pod \"console-859dc7c46b-h5jmx\" (UID: \"50c8b5c0-deb3-4e2f-afbd-93796cc7d81e\") " pod="openshift-console/console-859dc7c46b-h5jmx" Jul 27 12:24:01.849547 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:01.849442 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xx7fn\" (UniqueName: \"kubernetes.io/projected/50c8b5c0-deb3-4e2f-afbd-93796cc7d81e-kube-api-access-xx7fn\") pod \"console-859dc7c46b-h5jmx\" (UID: \"50c8b5c0-deb3-4e2f-afbd-93796cc7d81e\") " pod="openshift-console/console-859dc7c46b-h5jmx" Jul 27 12:24:01.849547 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:01.849509 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/50c8b5c0-deb3-4e2f-afbd-93796cc7d81e-service-ca\") pod \"console-859dc7c46b-h5jmx\" (UID: \"50c8b5c0-deb3-4e2f-afbd-93796cc7d81e\") " pod="openshift-console/console-859dc7c46b-h5jmx" Jul 27 12:24:01.849729 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:01.849567 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/50c8b5c0-deb3-4e2f-afbd-93796cc7d81e-oauth-serving-cert\") pod \"console-859dc7c46b-h5jmx\" (UID: \"50c8b5c0-deb3-4e2f-afbd-93796cc7d81e\") " pod="openshift-console/console-859dc7c46b-h5jmx" Jul 27 12:24:01.849729 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:01.849626 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/11d848cc-1c62-47a7-827a-4b77b2f28d79-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"11d848cc-1c62-47a7-827a-4b77b2f28d79\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 12:24:01.849729 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:01.849675 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/50c8b5c0-deb3-4e2f-afbd-93796cc7d81e-console-oauth-config\") pod \"console-859dc7c46b-h5jmx\" (UID: \"50c8b5c0-deb3-4e2f-afbd-93796cc7d81e\") " pod="openshift-console/console-859dc7c46b-h5jmx" Jul 27 12:24:01.850211 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:01.850188 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11d848cc-1c62-47a7-827a-4b77b2f28d79-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"11d848cc-1c62-47a7-827a-4b77b2f28d79\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 12:24:01.852503 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:01.852478 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/11d848cc-1c62-47a7-827a-4b77b2f28d79-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"11d848cc-1c62-47a7-827a-4b77b2f28d79\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 12:24:01.951043 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:01.951012 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/50c8b5c0-deb3-4e2f-afbd-93796cc7d81e-console-config\") pod \"console-859dc7c46b-h5jmx\" (UID: \"50c8b5c0-deb3-4e2f-afbd-93796cc7d81e\") " pod="openshift-console/console-859dc7c46b-h5jmx" Jul 27 12:24:01.951241 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:01.951049 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/50c8b5c0-deb3-4e2f-afbd-93796cc7d81e-console-serving-cert\") pod \"console-859dc7c46b-h5jmx\" (UID: \"50c8b5c0-deb3-4e2f-afbd-93796cc7d81e\") " pod="openshift-console/console-859dc7c46b-h5jmx" Jul 27 12:24:01.951241 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:01.951065 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xx7fn\" (UniqueName: \"kubernetes.io/projected/50c8b5c0-deb3-4e2f-afbd-93796cc7d81e-kube-api-access-xx7fn\") pod \"console-859dc7c46b-h5jmx\" (UID: \"50c8b5c0-deb3-4e2f-afbd-93796cc7d81e\") " pod="openshift-console/console-859dc7c46b-h5jmx" Jul 27 12:24:01.951241 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:01.951089 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/50c8b5c0-deb3-4e2f-afbd-93796cc7d81e-service-ca\") pod \"console-859dc7c46b-h5jmx\" (UID: \"50c8b5c0-deb3-4e2f-afbd-93796cc7d81e\") " pod="openshift-console/console-859dc7c46b-h5jmx" Jul 27 12:24:01.951241 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:01.951113 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/50c8b5c0-deb3-4e2f-afbd-93796cc7d81e-oauth-serving-cert\") pod \"console-859dc7c46b-h5jmx\" (UID: \"50c8b5c0-deb3-4e2f-afbd-93796cc7d81e\") " pod="openshift-console/console-859dc7c46b-h5jmx" Jul 27 12:24:01.951241 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:01.951140 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/50c8b5c0-deb3-4e2f-afbd-93796cc7d81e-console-oauth-config\") pod \"console-859dc7c46b-h5jmx\" (UID: \"50c8b5c0-deb3-4e2f-afbd-93796cc7d81e\") " pod="openshift-console/console-859dc7c46b-h5jmx" Jul 27 12:24:01.951846 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:01.951820 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/50c8b5c0-deb3-4e2f-afbd-93796cc7d81e-oauth-serving-cert\") pod \"console-859dc7c46b-h5jmx\" (UID: \"50c8b5c0-deb3-4e2f-afbd-93796cc7d81e\") " pod="openshift-console/console-859dc7c46b-h5jmx" Jul 27 12:24:01.951971 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:01.951822 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/50c8b5c0-deb3-4e2f-afbd-93796cc7d81e-service-ca\") pod \"console-859dc7c46b-h5jmx\" (UID: \"50c8b5c0-deb3-4e2f-afbd-93796cc7d81e\") " pod="openshift-console/console-859dc7c46b-h5jmx" Jul 27 12:24:01.951971 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:01.951822 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/50c8b5c0-deb3-4e2f-afbd-93796cc7d81e-console-config\") pod \"console-859dc7c46b-h5jmx\" (UID: \"50c8b5c0-deb3-4e2f-afbd-93796cc7d81e\") " pod="openshift-console/console-859dc7c46b-h5jmx" Jul 27 12:24:01.953495 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:01.953476 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/50c8b5c0-deb3-4e2f-afbd-93796cc7d81e-console-serving-cert\") pod \"console-859dc7c46b-h5jmx\" (UID: \"50c8b5c0-deb3-4e2f-afbd-93796cc7d81e\") " pod="openshift-console/console-859dc7c46b-h5jmx" Jul 27 12:24:01.953860 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:01.953846 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/50c8b5c0-deb3-4e2f-afbd-93796cc7d81e-console-oauth-config\") pod \"console-859dc7c46b-h5jmx\" (UID: \"50c8b5c0-deb3-4e2f-afbd-93796cc7d81e\") " pod="openshift-console/console-859dc7c46b-h5jmx" Jul 27 12:24:01.962998 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:01.962963 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xx7fn\" (UniqueName: \"kubernetes.io/projected/50c8b5c0-deb3-4e2f-afbd-93796cc7d81e-kube-api-access-xx7fn\") pod \"console-859dc7c46b-h5jmx\" (UID: \"50c8b5c0-deb3-4e2f-afbd-93796cc7d81e\") " pod="openshift-console/console-859dc7c46b-h5jmx" Jul 27 12:24:02.084417 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:02.084385 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 27 12:24:02.107528 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:02.107496 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-859dc7c46b-h5jmx" Jul 27 12:24:02.693350 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:02.693321 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-859dc7c46b-h5jmx"] Jul 27 12:24:02.918661 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:24:02.918627 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50c8b5c0_deb3_4e2f_afbd_93796cc7d81e.slice/crio-f08bdd7a261455d726287a9a68e79ee79583ea67c45393def1b76b36a360de89 WatchSource:0}: Error finding container f08bdd7a261455d726287a9a68e79ee79583ea67c45393def1b76b36a360de89: Status 404 returned error can't find the container with id f08bdd7a261455d726287a9a68e79ee79583ea67c45393def1b76b36a360de89 Jul 27 12:24:02.920773 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:24:02.920747 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16041d20_46cb_42f8_bbaf_2cb0f58523c4.slice/crio-7f811fe53670e236d69dd0d038448fbc44c864dce2a941af5681b64e41b5caa6 WatchSource:0}: Error finding container 7f811fe53670e236d69dd0d038448fbc44c864dce2a941af5681b64e41b5caa6: Status 404 returned error can't find the container with id 7f811fe53670e236d69dd0d038448fbc44c864dce2a941af5681b64e41b5caa6 Jul 27 12:24:03.070945 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:03.070915 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 27 12:24:03.072308 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:24:03.072272 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11d848cc_1c62_47a7_827a_4b77b2f28d79.slice/crio-1151ccdbab915c742be75205aa374add274e72a12358991d205c93adcfbe94dd WatchSource:0}: Error finding container 1151ccdbab915c742be75205aa374add274e72a12358991d205c93adcfbe94dd: Status 404 returned error can't find the container with id 1151ccdbab915c742be75205aa374add274e72a12358991d205c93adcfbe94dd Jul 27 12:24:03.534131 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:03.534042 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mdfcs" event={"ID":"c421b82e-b61e-4a0f-8a1c-055841ac0e4f","Type":"ContainerStarted","Data":"299a54c9cc457ea6905fb735e71c1632edbb7e37c01c96f38d125785db5ea26f"} Jul 27 12:24:03.535736 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:03.535631 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"11d848cc-1c62-47a7-827a-4b77b2f28d79","Type":"ContainerStarted","Data":"1151ccdbab915c742be75205aa374add274e72a12358991d205c93adcfbe94dd"} Jul 27 12:24:03.537218 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:03.537194 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-n2spg" event={"ID":"16041d20-46cb-42f8-bbaf-2cb0f58523c4","Type":"ContainerStarted","Data":"7f811fe53670e236d69dd0d038448fbc44c864dce2a941af5681b64e41b5caa6"} Jul 27 12:24:03.538846 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:03.538821 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-859dc7c46b-h5jmx" event={"ID":"50c8b5c0-deb3-4e2f-afbd-93796cc7d81e","Type":"ContainerStarted","Data":"f08bdd7a261455d726287a9a68e79ee79583ea67c45393def1b76b36a360de89"} Jul 27 12:24:04.547771 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:04.547636 2568 generic.go:356] "Generic (PLEG): container finished" podID="16041d20-46cb-42f8-bbaf-2cb0f58523c4" containerID="5ecbb50dd807a7eb7d658153336b19f2b3bdfb79bda0f42cea38a2c9a8c212d1" exitCode=0 Jul 27 12:24:04.547771 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:04.547692 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-n2spg" event={"ID":"16041d20-46cb-42f8-bbaf-2cb0f58523c4","Type":"ContainerDied","Data":"5ecbb50dd807a7eb7d658153336b19f2b3bdfb79bda0f42cea38a2c9a8c212d1"} Jul 27 12:24:04.674279 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:04.672912 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-577f48c4b5-qbp7n"] Jul 27 12:24:04.678525 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:04.677552 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-577f48c4b5-qbp7n" Jul 27 12:24:04.683369 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:04.681793 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 27 12:24:04.683369 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:04.682139 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-fqwkj\"" Jul 27 12:24:04.683369 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:04.682334 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 27 12:24:04.683369 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:04.682628 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-s64vtiv8pbv0\"" Jul 27 12:24:04.683369 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:04.682966 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 27 12:24:04.683369 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:04.683194 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 27 12:24:04.686799 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:04.686702 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-577f48c4b5-qbp7n"] Jul 27 12:24:04.777742 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:04.777462 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/e8d57e09-484b-4e0d-81af-ad0af397bece-metrics-server-audit-profiles\") pod \"metrics-server-577f48c4b5-qbp7n\" (UID: \"e8d57e09-484b-4e0d-81af-ad0af397bece\") " pod="openshift-monitoring/metrics-server-577f48c4b5-qbp7n" Jul 27 12:24:04.777742 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:04.777520 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/e8d57e09-484b-4e0d-81af-ad0af397bece-secret-metrics-server-client-certs\") pod \"metrics-server-577f48c4b5-qbp7n\" (UID: \"e8d57e09-484b-4e0d-81af-ad0af397bece\") " pod="openshift-monitoring/metrics-server-577f48c4b5-qbp7n" Jul 27 12:24:04.777742 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:04.777547 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bzckd\" (UniqueName: \"kubernetes.io/projected/e8d57e09-484b-4e0d-81af-ad0af397bece-kube-api-access-bzckd\") pod \"metrics-server-577f48c4b5-qbp7n\" (UID: \"e8d57e09-484b-4e0d-81af-ad0af397bece\") " pod="openshift-monitoring/metrics-server-577f48c4b5-qbp7n" Jul 27 12:24:04.777742 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:04.777585 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/e8d57e09-484b-4e0d-81af-ad0af397bece-secret-metrics-server-tls\") pod \"metrics-server-577f48c4b5-qbp7n\" (UID: \"e8d57e09-484b-4e0d-81af-ad0af397bece\") " pod="openshift-monitoring/metrics-server-577f48c4b5-qbp7n" Jul 27 12:24:04.777742 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:04.777625 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/e8d57e09-484b-4e0d-81af-ad0af397bece-audit-log\") pod \"metrics-server-577f48c4b5-qbp7n\" (UID: \"e8d57e09-484b-4e0d-81af-ad0af397bece\") " pod="openshift-monitoring/metrics-server-577f48c4b5-qbp7n" Jul 27 12:24:04.778253 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:04.778229 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e8d57e09-484b-4e0d-81af-ad0af397bece-client-ca-bundle\") pod \"metrics-server-577f48c4b5-qbp7n\" (UID: \"e8d57e09-484b-4e0d-81af-ad0af397bece\") " pod="openshift-monitoring/metrics-server-577f48c4b5-qbp7n" Jul 27 12:24:04.778348 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:04.778313 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e8d57e09-484b-4e0d-81af-ad0af397bece-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-577f48c4b5-qbp7n\" (UID: \"e8d57e09-484b-4e0d-81af-ad0af397bece\") " pod="openshift-monitoring/metrics-server-577f48c4b5-qbp7n" Jul 27 12:24:04.858731 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:04.857520 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-d7lwn"] Jul 27 12:24:04.861034 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:04.860963 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-d7lwn" Jul 27 12:24:04.864360 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:04.864311 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-h946x\"" Jul 27 12:24:04.864598 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:04.864582 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 27 12:24:04.874322 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:04.874298 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-d7lwn"] Jul 27 12:24:04.879015 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:04.878992 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/e8d57e09-484b-4e0d-81af-ad0af397bece-audit-log\") pod \"metrics-server-577f48c4b5-qbp7n\" (UID: \"e8d57e09-484b-4e0d-81af-ad0af397bece\") " pod="openshift-monitoring/metrics-server-577f48c4b5-qbp7n" Jul 27 12:24:04.879134 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:04.879052 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e8d57e09-484b-4e0d-81af-ad0af397bece-client-ca-bundle\") pod \"metrics-server-577f48c4b5-qbp7n\" (UID: \"e8d57e09-484b-4e0d-81af-ad0af397bece\") " pod="openshift-monitoring/metrics-server-577f48c4b5-qbp7n" Jul 27 12:24:04.879134 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:04.879110 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e8d57e09-484b-4e0d-81af-ad0af397bece-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-577f48c4b5-qbp7n\" (UID: \"e8d57e09-484b-4e0d-81af-ad0af397bece\") " pod="openshift-monitoring/metrics-server-577f48c4b5-qbp7n" Jul 27 12:24:04.879333 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:04.879161 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/e8d57e09-484b-4e0d-81af-ad0af397bece-metrics-server-audit-profiles\") pod \"metrics-server-577f48c4b5-qbp7n\" (UID: \"e8d57e09-484b-4e0d-81af-ad0af397bece\") " pod="openshift-monitoring/metrics-server-577f48c4b5-qbp7n" Jul 27 12:24:04.879333 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:04.879190 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/e8d57e09-484b-4e0d-81af-ad0af397bece-secret-metrics-server-client-certs\") pod \"metrics-server-577f48c4b5-qbp7n\" (UID: \"e8d57e09-484b-4e0d-81af-ad0af397bece\") " pod="openshift-monitoring/metrics-server-577f48c4b5-qbp7n" Jul 27 12:24:04.879333 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:04.879214 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bzckd\" (UniqueName: \"kubernetes.io/projected/e8d57e09-484b-4e0d-81af-ad0af397bece-kube-api-access-bzckd\") pod \"metrics-server-577f48c4b5-qbp7n\" (UID: \"e8d57e09-484b-4e0d-81af-ad0af397bece\") " pod="openshift-monitoring/metrics-server-577f48c4b5-qbp7n" Jul 27 12:24:04.879333 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:04.879243 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/e8d57e09-484b-4e0d-81af-ad0af397bece-secret-metrics-server-tls\") pod \"metrics-server-577f48c4b5-qbp7n\" (UID: \"e8d57e09-484b-4e0d-81af-ad0af397bece\") " pod="openshift-monitoring/metrics-server-577f48c4b5-qbp7n" Jul 27 12:24:04.880216 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:04.880194 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e8d57e09-484b-4e0d-81af-ad0af397bece-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-577f48c4b5-qbp7n\" (UID: \"e8d57e09-484b-4e0d-81af-ad0af397bece\") " pod="openshift-monitoring/metrics-server-577f48c4b5-qbp7n" Jul 27 12:24:04.880488 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:04.880463 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/e8d57e09-484b-4e0d-81af-ad0af397bece-audit-log\") pod \"metrics-server-577f48c4b5-qbp7n\" (UID: \"e8d57e09-484b-4e0d-81af-ad0af397bece\") " pod="openshift-monitoring/metrics-server-577f48c4b5-qbp7n" Jul 27 12:24:04.881934 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:04.881907 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/e8d57e09-484b-4e0d-81af-ad0af397bece-metrics-server-audit-profiles\") pod \"metrics-server-577f48c4b5-qbp7n\" (UID: \"e8d57e09-484b-4e0d-81af-ad0af397bece\") " pod="openshift-monitoring/metrics-server-577f48c4b5-qbp7n" Jul 27 12:24:04.883854 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:04.883810 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e8d57e09-484b-4e0d-81af-ad0af397bece-client-ca-bundle\") pod \"metrics-server-577f48c4b5-qbp7n\" (UID: \"e8d57e09-484b-4e0d-81af-ad0af397bece\") " pod="openshift-monitoring/metrics-server-577f48c4b5-qbp7n" Jul 27 12:24:04.884745 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:04.884697 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/e8d57e09-484b-4e0d-81af-ad0af397bece-secret-metrics-server-client-certs\") pod \"metrics-server-577f48c4b5-qbp7n\" (UID: \"e8d57e09-484b-4e0d-81af-ad0af397bece\") " pod="openshift-monitoring/metrics-server-577f48c4b5-qbp7n" Jul 27 12:24:04.885651 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:04.885610 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/e8d57e09-484b-4e0d-81af-ad0af397bece-secret-metrics-server-tls\") pod \"metrics-server-577f48c4b5-qbp7n\" (UID: \"e8d57e09-484b-4e0d-81af-ad0af397bece\") " pod="openshift-monitoring/metrics-server-577f48c4b5-qbp7n" Jul 27 12:24:04.900702 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:04.900663 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bzckd\" (UniqueName: \"kubernetes.io/projected/e8d57e09-484b-4e0d-81af-ad0af397bece-kube-api-access-bzckd\") pod \"metrics-server-577f48c4b5-qbp7n\" (UID: \"e8d57e09-484b-4e0d-81af-ad0af397bece\") " pod="openshift-monitoring/metrics-server-577f48c4b5-qbp7n" Jul 27 12:24:04.980810 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:04.980592 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3307059f-e075-4b86-8f14-bc38fb90c9ff-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-d7lwn\" (UID: \"3307059f-e075-4b86-8f14-bc38fb90c9ff\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-d7lwn" Jul 27 12:24:04.980810 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:04.980727 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84lqm\" (UniqueName: \"kubernetes.io/projected/3307059f-e075-4b86-8f14-bc38fb90c9ff-kube-api-access-84lqm\") pod \"monitoring-plugin-68b7fc9574-d7lwn\" (UID: \"3307059f-e075-4b86-8f14-bc38fb90c9ff\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-d7lwn" Jul 27 12:24:04.997123 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:04.997080 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-577f48c4b5-qbp7n" Jul 27 12:24:05.081990 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:05.081955 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84lqm\" (UniqueName: \"kubernetes.io/projected/3307059f-e075-4b86-8f14-bc38fb90c9ff-kube-api-access-84lqm\") pod \"monitoring-plugin-68b7fc9574-d7lwn\" (UID: \"3307059f-e075-4b86-8f14-bc38fb90c9ff\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-d7lwn" Jul 27 12:24:05.082111 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:05.082057 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3307059f-e075-4b86-8f14-bc38fb90c9ff-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-d7lwn\" (UID: \"3307059f-e075-4b86-8f14-bc38fb90c9ff\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-d7lwn" Jul 27 12:24:05.085124 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:05.085101 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3307059f-e075-4b86-8f14-bc38fb90c9ff-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-d7lwn\" (UID: \"3307059f-e075-4b86-8f14-bc38fb90c9ff\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-d7lwn" Jul 27 12:24:05.093480 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:05.093437 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-84lqm\" (UniqueName: \"kubernetes.io/projected/3307059f-e075-4b86-8f14-bc38fb90c9ff-kube-api-access-84lqm\") pod \"monitoring-plugin-68b7fc9574-d7lwn\" (UID: \"3307059f-e075-4b86-8f14-bc38fb90c9ff\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-d7lwn" Jul 27 12:24:05.174483 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:05.174358 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-d7lwn" Jul 27 12:24:05.214304 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:05.214102 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-577f48c4b5-qbp7n"] Jul 27 12:24:05.555613 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:05.555316 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-n2spg" event={"ID":"16041d20-46cb-42f8-bbaf-2cb0f58523c4","Type":"ContainerStarted","Data":"2e2de001d276c3b614b95160f88578ee1355dd89d0257e6be6bbaa05238e019e"} Jul 27 12:24:05.555613 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:05.555384 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-n2spg" event={"ID":"16041d20-46cb-42f8-bbaf-2cb0f58523c4","Type":"ContainerStarted","Data":"002847dc61d3e30a84c2cf27a68ed08cc02a3ae33860bdb4a402a28855abd8a9"} Jul 27 12:24:05.575808 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:05.575753 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-n2spg" podStartSLOduration=4.344662088 podStartE2EDuration="5.575729462s" totalImagesPullingTime="1.133495433s" totalInitContainerRuntime="97.571941ms" isStatefulPod=true podCreationTimestamp="2026-07-27 12:24:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 12:24:05.574653666 +0000 UTC m=+79.977788523" watchObservedRunningTime="2026-07-27 12:24:05.575729462 +0000 UTC m=+79.978864323" Jul 27 12:24:06.411061 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:06.411029 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 27 12:24:06.430866 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:06.430696 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 27 12:24:06.435239 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:06.434893 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 27 12:24:06.435239 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:06.434977 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 27 12:24:06.435239 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:06.434801 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 27 12:24:06.435495 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:06.435288 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 27 12:24:06.435552 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:06.435515 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-hf7d2\"" Jul 27 12:24:06.435642 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:06.435618 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 27 12:24:06.436012 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:06.435772 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-fe6un3ohfcmje\"" Jul 27 12:24:06.436012 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:06.435837 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 27 12:24:06.436611 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:06.436300 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 27 12:24:06.441617 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:06.439856 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 27 12:24:06.441617 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:06.439991 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 27 12:24:06.441617 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:06.440156 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 27 12:24:06.441617 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:06.440818 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 27 12:24:06.441617 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:06.440862 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 27 12:24:06.443095 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:06.442419 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 27 12:24:06.444264 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:06.444246 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 27 12:24:06.448180 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:06.447647 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 27 12:24:06.496986 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:06.496954 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a-config-out\") pod \"prometheus-k8s-0\" (UID: \"f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 12:24:06.497150 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:06.496992 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 12:24:06.497150 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:06.497028 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a-config\") pod \"prometheus-k8s-0\" (UID: \"f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 12:24:06.497150 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:06.497051 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 12:24:06.497150 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:06.497078 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 12:24:06.497150 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:06.497115 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 12:24:06.497150 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:06.497141 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 12:24:06.497519 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:06.497198 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 12:24:06.497519 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:06.497221 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a-web-config\") pod \"prometheus-k8s-0\" (UID: \"f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 12:24:06.497519 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:06.497242 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 12:24:06.497519 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:06.497267 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 12:24:06.497519 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:06.497320 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 12:24:06.497519 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:06.497362 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 12:24:06.497519 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:06.497394 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 12:24:06.497519 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:06.497419 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 12:24:06.497519 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:06.497471 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 12:24:06.497519 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:06.497499 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hbgp8\" (UniqueName: \"kubernetes.io/projected/f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a-kube-api-access-hbgp8\") pod \"prometheus-k8s-0\" (UID: \"f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 12:24:06.497831 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:06.497533 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 12:24:06.497831 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:06.497577 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 12:24:06.497831 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:06.497599 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 12:24:06.508679 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:24:06.508651 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8d57e09_484b_4e0d_81af_ad0af397bece.slice/crio-06fa6b1d738035e24cb8568670bc1aee240548eb164564276c4f8a10a753b374 WatchSource:0}: Error finding container 06fa6b1d738035e24cb8568670bc1aee240548eb164564276c4f8a10a753b374: Status 404 returned error can't find the container with id 06fa6b1d738035e24cb8568670bc1aee240548eb164564276c4f8a10a753b374 Jul 27 12:24:06.560749 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:06.560694 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-577f48c4b5-qbp7n" event={"ID":"e8d57e09-484b-4e0d-81af-ad0af397bece","Type":"ContainerStarted","Data":"06fa6b1d738035e24cb8568670bc1aee240548eb164564276c4f8a10a753b374"} Jul 27 12:24:06.598609 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:06.598579 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 12:24:06.598830 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:06.598616 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 12:24:06.598830 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:06.598641 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a-config-out\") pod \"prometheus-k8s-0\" (UID: \"f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 12:24:06.598830 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:06.598662 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 12:24:06.598830 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:06.598694 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a-config\") pod \"prometheus-k8s-0\" (UID: \"f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 12:24:06.598830 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:06.598726 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 12:24:06.598830 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:06.598751 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 12:24:06.598830 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:06.598780 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 12:24:06.598830 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:06.598809 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 12:24:06.599294 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:06.598847 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 12:24:06.599294 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:06.598874 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a-web-config\") pod \"prometheus-k8s-0\" (UID: \"f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 12:24:06.599294 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:06.598897 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 12:24:06.599294 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:06.598921 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 12:24:06.599294 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:06.598941 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 12:24:06.599294 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:06.598973 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 12:24:06.599294 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:06.599008 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 12:24:06.599294 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:06.599036 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 12:24:06.599294 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:06.599067 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 12:24:06.599294 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:06.599088 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hbgp8\" (UniqueName: \"kubernetes.io/projected/f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a-kube-api-access-hbgp8\") pod \"prometheus-k8s-0\" (UID: \"f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 12:24:06.599294 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:06.599127 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 12:24:06.599866 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:06.599412 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 12:24:06.599866 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:06.599673 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 12:24:06.599866 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:06.599796 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 12:24:06.600545 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:06.600518 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 12:24:06.600846 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:06.600823 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 12:24:06.603797 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:06.603772 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 12:24:06.604043 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:06.604020 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 12:24:06.605047 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:06.604520 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 12:24:06.605047 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:06.604913 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 12:24:06.605047 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:06.605007 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 12:24:06.607192 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:06.606511 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 12:24:06.607192 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:06.606524 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 12:24:06.607192 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:06.606955 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a-web-config\") pod \"prometheus-k8s-0\" (UID: \"f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 12:24:06.607192 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:06.607029 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 12:24:06.607192 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:06.607085 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 12:24:06.607192 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:06.607142 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 12:24:06.607477 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:06.607279 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 12:24:06.607477 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:06.607293 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a-config\") pod \"prometheus-k8s-0\" (UID: \"f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 12:24:06.607477 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:06.607322 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a-config-out\") pod \"prometheus-k8s-0\" (UID: \"f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 12:24:06.613917 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:06.613899 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hbgp8\" (UniqueName: \"kubernetes.io/projected/f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a-kube-api-access-hbgp8\") pod \"prometheus-k8s-0\" (UID: \"f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 12:24:06.749810 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:06.749776 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 27 12:24:08.530990 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:08.530773 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-d7lwn"] Jul 27 12:24:08.563089 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:08.563062 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 27 12:24:08.827519 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:24:08.827446 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3307059f_e075_4b86_8f14_bc38fb90c9ff.slice/crio-5f201a05fa5fc5a849cd0d65238d2a6b79be45caa9c41d09066f6da9f273fb5d WatchSource:0}: Error finding container 5f201a05fa5fc5a849cd0d65238d2a6b79be45caa9c41d09066f6da9f273fb5d: Status 404 returned error can't find the container with id 5f201a05fa5fc5a849cd0d65238d2a6b79be45caa9c41d09066f6da9f273fb5d Jul 27 12:24:08.829392 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:24:08.829368 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4ab84ea_6aa9_4cc1_9d3d_51e9b369e71a.slice/crio-cd907574d62999b42f76fa83042b12a0fbc7fbe37aba891d7a2c374dc6241565 WatchSource:0}: Error finding container cd907574d62999b42f76fa83042b12a0fbc7fbe37aba891d7a2c374dc6241565: Status 404 returned error can't find the container with id cd907574d62999b42f76fa83042b12a0fbc7fbe37aba891d7a2c374dc6241565 Jul 27 12:24:09.580147 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:09.580057 2568 generic.go:356] "Generic (PLEG): container finished" podID="f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a" containerID="91e83ba0cb6cd63533cfc21dce90ec3d3097768c9d870daafe527092c6fda06f" exitCode=0 Jul 27 12:24:09.580544 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:09.580157 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a","Type":"ContainerDied","Data":"91e83ba0cb6cd63533cfc21dce90ec3d3097768c9d870daafe527092c6fda06f"} Jul 27 12:24:09.580544 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:09.580262 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a","Type":"ContainerStarted","Data":"cd907574d62999b42f76fa83042b12a0fbc7fbe37aba891d7a2c374dc6241565"} Jul 27 12:24:09.581657 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:09.581629 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-d7lwn" event={"ID":"3307059f-e075-4b86-8f14-bc38fb90c9ff","Type":"ContainerStarted","Data":"5f201a05fa5fc5a849cd0d65238d2a6b79be45caa9c41d09066f6da9f273fb5d"} Jul 27 12:24:09.583746 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:09.583724 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mdfcs" event={"ID":"c421b82e-b61e-4a0f-8a1c-055841ac0e4f","Type":"ContainerStarted","Data":"ac58cd928551eb4728473002c415723835b1a8856060d839a15d9b8118005dbf"} Jul 27 12:24:09.585670 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:09.585469 2568 generic.go:356] "Generic (PLEG): container finished" podID="11d848cc-1c62-47a7-827a-4b77b2f28d79" containerID="7227fe328fff90390ab58948ba9bde1b8e4815f3540dae0b88aa9fe8b3778fbb" exitCode=0 Jul 27 12:24:09.585670 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:09.585597 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"11d848cc-1c62-47a7-827a-4b77b2f28d79","Type":"ContainerDied","Data":"7227fe328fff90390ab58948ba9bde1b8e4815f3540dae0b88aa9fe8b3778fbb"} Jul 27 12:24:09.587315 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:09.587287 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-577f48c4b5-qbp7n" event={"ID":"e8d57e09-484b-4e0d-81af-ad0af397bece","Type":"ContainerStarted","Data":"a54a2f557f11d41e4530bc9888159f9c61b1407fb742dc0277c09728e66f7bf1"} Jul 27 12:24:09.589430 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:09.589397 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-859dc7c46b-h5jmx" event={"ID":"50c8b5c0-deb3-4e2f-afbd-93796cc7d81e","Type":"ContainerStarted","Data":"d4ed0d117e3ecee654ae378630c306f0e20a385b4b894667db7969b9af8fd244"} Jul 27 12:24:09.663888 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:09.663837 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-577f48c4b5-qbp7n" podStartSLOduration=3.293715177 podStartE2EDuration="5.6638165s" totalImagesPullingTime="2.370101323s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 12:24:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 12:24:09.663280699 +0000 UTC m=+84.066415556" watchObservedRunningTime="2026-07-27 12:24:09.6638165 +0000 UTC m=+84.066951358" Jul 27 12:24:11.602948 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:11.602892 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-d7lwn" event={"ID":"3307059f-e075-4b86-8f14-bc38fb90c9ff","Type":"ContainerStarted","Data":"07aae435de5f10aeca6f4036617f8b63c2361e008e05af721c162d682695da4e"} Jul 27 12:24:11.603425 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:11.603240 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-d7lwn" Jul 27 12:24:11.609127 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:11.609103 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-d7lwn" Jul 27 12:24:11.621247 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:11.621199 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-859dc7c46b-h5jmx" podStartSLOduration=5.137325879 podStartE2EDuration="10.62117865s" totalImagesPullingTime="5.483852771s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 12:24:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 12:24:09.68634704 +0000 UTC m=+84.089481898" watchObservedRunningTime="2026-07-27 12:24:11.62117865 +0000 UTC m=+86.024313510" Jul 27 12:24:11.621402 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:11.621317 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-d7lwn" podStartSLOduration=5.743939183 podStartE2EDuration="7.621308485s" totalImagesPullingTime="1.877369302s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 12:24:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 12:24:11.61941988 +0000 UTC m=+86.022554739" watchObservedRunningTime="2026-07-27 12:24:11.621308485 +0000 UTC m=+86.024443346" Jul 27 12:24:12.107824 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:12.107786 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-859dc7c46b-h5jmx" Jul 27 12:24:12.108004 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:12.107857 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-859dc7c46b-h5jmx" Jul 27 12:24:12.113135 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:12.113111 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-859dc7c46b-h5jmx" Jul 27 12:24:12.613729 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:12.613683 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-859dc7c46b-h5jmx" Jul 27 12:24:14.619736 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:14.619692 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mdfcs" event={"ID":"c421b82e-b61e-4a0f-8a1c-055841ac0e4f","Type":"ContainerStarted","Data":"37bd4f0a23857cdefc03c37471c6fcc0e80277fab026f279da6c83712ce6bb21"} Jul 27 12:24:14.622702 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:14.622670 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"11d848cc-1c62-47a7-827a-4b77b2f28d79","Type":"ContainerStarted","Data":"834580f138d6d6f39ca14691ef9830b1110700e819bc1487b109744cb953ab4d"} Jul 27 12:24:14.622850 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:14.622761 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"11d848cc-1c62-47a7-827a-4b77b2f28d79","Type":"ContainerStarted","Data":"16fced99002cf271026de6d87a592365aa2d127b3393deb9baa770010e2b14e0"} Jul 27 12:24:14.622850 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:14.622805 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"11d848cc-1c62-47a7-827a-4b77b2f28d79","Type":"ContainerStarted","Data":"35f66708ffbd49626cace33ad26c14331e747f10d9a40b0c626898090d225209"} Jul 27 12:24:14.622850 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:14.622845 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"11d848cc-1c62-47a7-827a-4b77b2f28d79","Type":"ContainerStarted","Data":"28d6ff3ab5b97a992dab6b715aa47a74c0dc5f29eb1114d992d1a3cc5f1c40ad"} Jul 27 12:24:14.622978 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:14.622883 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"11d848cc-1c62-47a7-827a-4b77b2f28d79","Type":"ContainerStarted","Data":"3f1db448d609f900038c4aa21332ad323452ee242a4bff15337165765764f5a3"} Jul 27 12:24:14.624755 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:14.624734 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a","Type":"ContainerStarted","Data":"787840332f0c0784dce04033a5ef1273a106016ba12ec86eebf7c17223b726a6"} Jul 27 12:24:14.624868 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:14.624799 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a","Type":"ContainerStarted","Data":"a4f632ed65c9b0b61efd83973f8213596d16c7aa70adbc226ee7b642297a3f87"} Jul 27 12:24:14.641597 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:14.641513 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-mdfcs" podStartSLOduration=35.260560382 podStartE2EDuration="51.641498351s" totalImagesPullingTime="16.380937969s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 12:23:23 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 12:24:14.640020396 +0000 UTC m=+89.043155253" watchObservedRunningTime="2026-07-27 12:24:14.641498351 +0000 UTC m=+89.044633208" Jul 27 12:24:15.632895 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:15.632862 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"11d848cc-1c62-47a7-827a-4b77b2f28d79","Type":"ContainerStarted","Data":"28aa6a06f48c69e3db78a2e19c58dbd562cf7ba0c676d28ecd5bf04eb46c3919"} Jul 27 12:24:15.662913 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:15.662853 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.944013328 podStartE2EDuration="14.662830317s" totalImagesPullingTime="10.69664096s" totalInitContainerRuntime="22.176029ms" isStatefulPod=false podCreationTimestamp="2026-07-27 12:24:01 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 12:24:15.660449695 +0000 UTC m=+90.063584585" watchObservedRunningTime="2026-07-27 12:24:15.662830317 +0000 UTC m=+90.065965178" Jul 27 12:24:16.640123 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:16.640086 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a","Type":"ContainerStarted","Data":"0324c985b5c9db02594e14daac53539084341d6fdaec82d6f613d35c8ce08afd"} Jul 27 12:24:16.640481 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:16.640197 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a","Type":"ContainerStarted","Data":"069219cd10f0d764088eabc58d1b8dba8c23f94c3c298efc6847a6fb06ffdb90"} Jul 27 12:24:16.640481 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:16.640223 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a","Type":"ContainerStarted","Data":"14270636ac61ed5836e70a66df5c2e2213225a7d63e2671574c753068ce30440"} Jul 27 12:24:16.640481 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:16.640251 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a","Type":"ContainerStarted","Data":"0b0501786bcb9b5a44aebc99726752692315f1fadf9f4abfcb2eb7786317db9d"} Jul 27 12:24:16.673076 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:16.672956 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=4.208990374 podStartE2EDuration="10.672935488s" totalImagesPullingTime="6.443399668s" totalInitContainerRuntime="20.545446ms" isStatefulPod=false podCreationTimestamp="2026-07-27 12:24:06 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 12:24:16.671388906 +0000 UTC m=+91.074523762" watchObservedRunningTime="2026-07-27 12:24:16.672935488 +0000 UTC m=+91.076070348" Jul 27 12:24:16.750837 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:16.750808 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 27 12:24:24.998098 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:24.998063 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-577f48c4b5-qbp7n" Jul 27 12:24:24.998617 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:24.998163 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-577f48c4b5-qbp7n" Jul 27 12:24:29.519729 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:29.519680 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-8vcwp" Jul 27 12:24:32.484612 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:32.484576 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-859dc7c46b-h5jmx"] Jul 27 12:24:45.003180 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:45.003148 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-577f48c4b5-qbp7n" Jul 27 12:24:45.006984 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:45.006962 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-577f48c4b5-qbp7n" Jul 27 12:24:57.503753 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:57.503676 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-859dc7c46b-h5jmx" podUID="50c8b5c0-deb3-4e2f-afbd-93796cc7d81e" containerName="console" containerID="cri-o://d4ed0d117e3ecee654ae378630c306f0e20a385b4b894667db7969b9af8fd244" gracePeriod=15 Jul 27 12:24:57.746372 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:57.746348 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-859dc7c46b-h5jmx" Jul 27 12:24:57.799638 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:57.799567 2568 generic.go:356] "Generic (PLEG): container finished" podID="50c8b5c0-deb3-4e2f-afbd-93796cc7d81e" containerID="d4ed0d117e3ecee654ae378630c306f0e20a385b4b894667db7969b9af8fd244" exitCode=0 Jul 27 12:24:57.799638 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:57.799605 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-859dc7c46b-h5jmx" Jul 27 12:24:57.799819 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:57.799650 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-859dc7c46b-h5jmx" event={"ID":"50c8b5c0-deb3-4e2f-afbd-93796cc7d81e","Type":"ContainerDied","Data":"d4ed0d117e3ecee654ae378630c306f0e20a385b4b894667db7969b9af8fd244"} Jul 27 12:24:57.799819 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:57.799698 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-859dc7c46b-h5jmx" event={"ID":"50c8b5c0-deb3-4e2f-afbd-93796cc7d81e","Type":"ContainerDied","Data":"f08bdd7a261455d726287a9a68e79ee79583ea67c45393def1b76b36a360de89"} Jul 27 12:24:57.799819 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:57.799742 2568 scope.go:117] "RemoveContainer" containerID="d4ed0d117e3ecee654ae378630c306f0e20a385b4b894667db7969b9af8fd244" Jul 27 12:24:57.807796 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:57.807779 2568 scope.go:117] "RemoveContainer" containerID="d4ed0d117e3ecee654ae378630c306f0e20a385b4b894667db7969b9af8fd244" Jul 27 12:24:57.808055 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:24:57.808032 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d4ed0d117e3ecee654ae378630c306f0e20a385b4b894667db7969b9af8fd244\": container with ID starting with d4ed0d117e3ecee654ae378630c306f0e20a385b4b894667db7969b9af8fd244 not found: ID does not exist" containerID="d4ed0d117e3ecee654ae378630c306f0e20a385b4b894667db7969b9af8fd244" Jul 27 12:24:57.808109 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:57.808063 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d4ed0d117e3ecee654ae378630c306f0e20a385b4b894667db7969b9af8fd244"} err="failed to get container status \"d4ed0d117e3ecee654ae378630c306f0e20a385b4b894667db7969b9af8fd244\": rpc error: code = NotFound desc = could not find container \"d4ed0d117e3ecee654ae378630c306f0e20a385b4b894667db7969b9af8fd244\": container with ID starting with d4ed0d117e3ecee654ae378630c306f0e20a385b4b894667db7969b9af8fd244 not found: ID does not exist" Jul 27 12:24:57.830349 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:57.830325 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/50c8b5c0-deb3-4e2f-afbd-93796cc7d81e-console-serving-cert\") pod \"50c8b5c0-deb3-4e2f-afbd-93796cc7d81e\" (UID: \"50c8b5c0-deb3-4e2f-afbd-93796cc7d81e\") " Jul 27 12:24:57.830452 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:57.830360 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/50c8b5c0-deb3-4e2f-afbd-93796cc7d81e-console-oauth-config\") pod \"50c8b5c0-deb3-4e2f-afbd-93796cc7d81e\" (UID: \"50c8b5c0-deb3-4e2f-afbd-93796cc7d81e\") " Jul 27 12:24:57.830452 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:57.830410 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/50c8b5c0-deb3-4e2f-afbd-93796cc7d81e-service-ca\") pod \"50c8b5c0-deb3-4e2f-afbd-93796cc7d81e\" (UID: \"50c8b5c0-deb3-4e2f-afbd-93796cc7d81e\") " Jul 27 12:24:57.830452 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:57.830443 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/50c8b5c0-deb3-4e2f-afbd-93796cc7d81e-console-config\") pod \"50c8b5c0-deb3-4e2f-afbd-93796cc7d81e\" (UID: \"50c8b5c0-deb3-4e2f-afbd-93796cc7d81e\") " Jul 27 12:24:57.830576 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:57.830458 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xx7fn\" (UniqueName: \"kubernetes.io/projected/50c8b5c0-deb3-4e2f-afbd-93796cc7d81e-kube-api-access-xx7fn\") pod \"50c8b5c0-deb3-4e2f-afbd-93796cc7d81e\" (UID: \"50c8b5c0-deb3-4e2f-afbd-93796cc7d81e\") " Jul 27 12:24:57.830576 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:57.830489 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/50c8b5c0-deb3-4e2f-afbd-93796cc7d81e-oauth-serving-cert\") pod \"50c8b5c0-deb3-4e2f-afbd-93796cc7d81e\" (UID: \"50c8b5c0-deb3-4e2f-afbd-93796cc7d81e\") " Jul 27 12:24:57.830876 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:57.830847 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/50c8b5c0-deb3-4e2f-afbd-93796cc7d81e-service-ca" (OuterVolumeSpecName: "service-ca") pod "50c8b5c0-deb3-4e2f-afbd-93796cc7d81e" (UID: "50c8b5c0-deb3-4e2f-afbd-93796cc7d81e"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 12:24:57.830876 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:57.830866 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/50c8b5c0-deb3-4e2f-afbd-93796cc7d81e-console-config" (OuterVolumeSpecName: "console-config") pod "50c8b5c0-deb3-4e2f-afbd-93796cc7d81e" (UID: "50c8b5c0-deb3-4e2f-afbd-93796cc7d81e"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 12:24:57.831022 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:57.830935 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/50c8b5c0-deb3-4e2f-afbd-93796cc7d81e-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "50c8b5c0-deb3-4e2f-afbd-93796cc7d81e" (UID: "50c8b5c0-deb3-4e2f-afbd-93796cc7d81e"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 12:24:57.832558 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:57.832541 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/50c8b5c0-deb3-4e2f-afbd-93796cc7d81e-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "50c8b5c0-deb3-4e2f-afbd-93796cc7d81e" (UID: "50c8b5c0-deb3-4e2f-afbd-93796cc7d81e"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 12:24:57.832629 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:57.832597 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/50c8b5c0-deb3-4e2f-afbd-93796cc7d81e-kube-api-access-xx7fn" (OuterVolumeSpecName: "kube-api-access-xx7fn") pod "50c8b5c0-deb3-4e2f-afbd-93796cc7d81e" (UID: "50c8b5c0-deb3-4e2f-afbd-93796cc7d81e"). InnerVolumeSpecName "kube-api-access-xx7fn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 12:24:57.832677 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:57.832633 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/50c8b5c0-deb3-4e2f-afbd-93796cc7d81e-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "50c8b5c0-deb3-4e2f-afbd-93796cc7d81e" (UID: "50c8b5c0-deb3-4e2f-afbd-93796cc7d81e"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 12:24:57.931437 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:57.931402 2568 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/50c8b5c0-deb3-4e2f-afbd-93796cc7d81e-console-serving-cert\") on node \"ip-10-0-141-3.ec2.internal\" DevicePath \"\"" Jul 27 12:24:57.931437 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:57.931431 2568 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/50c8b5c0-deb3-4e2f-afbd-93796cc7d81e-console-oauth-config\") on node \"ip-10-0-141-3.ec2.internal\" DevicePath \"\"" Jul 27 12:24:57.931437 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:57.931446 2568 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/50c8b5c0-deb3-4e2f-afbd-93796cc7d81e-service-ca\") on node \"ip-10-0-141-3.ec2.internal\" DevicePath \"\"" Jul 27 12:24:57.931670 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:57.931459 2568 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/50c8b5c0-deb3-4e2f-afbd-93796cc7d81e-console-config\") on node \"ip-10-0-141-3.ec2.internal\" DevicePath \"\"" Jul 27 12:24:57.931670 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:57.931470 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xx7fn\" (UniqueName: \"kubernetes.io/projected/50c8b5c0-deb3-4e2f-afbd-93796cc7d81e-kube-api-access-xx7fn\") on node \"ip-10-0-141-3.ec2.internal\" DevicePath \"\"" Jul 27 12:24:57.931670 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:57.931483 2568 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/50c8b5c0-deb3-4e2f-afbd-93796cc7d81e-oauth-serving-cert\") on node \"ip-10-0-141-3.ec2.internal\" DevicePath \"\"" Jul 27 12:24:58.120238 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:58.120208 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-859dc7c46b-h5jmx"] Jul 27 12:24:58.124320 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:58.124298 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-859dc7c46b-h5jmx"] Jul 27 12:24:58.161759 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:24:58.161731 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="50c8b5c0-deb3-4e2f-afbd-93796cc7d81e" path="/var/lib/kubelet/pods/50c8b5c0-deb3-4e2f-afbd-93796cc7d81e/volumes" Jul 27 12:25:06.750761 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:06.750726 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 27 12:25:06.776536 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:06.776512 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 27 12:25:06.863958 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:06.863922 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 27 12:25:20.492377 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:20.492339 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 27 12:25:20.492924 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:20.492647 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="11d848cc-1c62-47a7-827a-4b77b2f28d79" containerName="alertmanager" containerID="cri-o://3f1db448d609f900038c4aa21332ad323452ee242a4bff15337165765764f5a3" gracePeriod=120 Jul 27 12:25:20.492924 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:20.492735 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="11d848cc-1c62-47a7-827a-4b77b2f28d79" containerName="prom-label-proxy" containerID="cri-o://28aa6a06f48c69e3db78a2e19c58dbd562cf7ba0c676d28ecd5bf04eb46c3919" gracePeriod=120 Jul 27 12:25:20.492924 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:20.492771 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="11d848cc-1c62-47a7-827a-4b77b2f28d79" containerName="kube-rbac-proxy" containerID="cri-o://16fced99002cf271026de6d87a592365aa2d127b3393deb9baa770010e2b14e0" gracePeriod=120 Jul 27 12:25:20.492924 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:20.492766 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="11d848cc-1c62-47a7-827a-4b77b2f28d79" containerName="config-reloader" containerID="cri-o://28d6ff3ab5b97a992dab6b715aa47a74c0dc5f29eb1114d992d1a3cc5f1c40ad" gracePeriod=120 Jul 27 12:25:20.492924 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:20.492694 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="11d848cc-1c62-47a7-827a-4b77b2f28d79" containerName="kube-rbac-proxy-metric" containerID="cri-o://834580f138d6d6f39ca14691ef9830b1110700e819bc1487b109744cb953ab4d" gracePeriod=120 Jul 27 12:25:20.492924 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:20.492773 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="11d848cc-1c62-47a7-827a-4b77b2f28d79" containerName="kube-rbac-proxy-web" containerID="cri-o://35f66708ffbd49626cace33ad26c14331e747f10d9a40b0c626898090d225209" gracePeriod=120 Jul 27 12:25:20.897964 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:20.897886 2568 generic.go:356] "Generic (PLEG): container finished" podID="11d848cc-1c62-47a7-827a-4b77b2f28d79" containerID="28aa6a06f48c69e3db78a2e19c58dbd562cf7ba0c676d28ecd5bf04eb46c3919" exitCode=0 Jul 27 12:25:20.897964 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:20.897909 2568 generic.go:356] "Generic (PLEG): container finished" podID="11d848cc-1c62-47a7-827a-4b77b2f28d79" containerID="834580f138d6d6f39ca14691ef9830b1110700e819bc1487b109744cb953ab4d" exitCode=0 Jul 27 12:25:20.897964 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:20.897916 2568 generic.go:356] "Generic (PLEG): container finished" podID="11d848cc-1c62-47a7-827a-4b77b2f28d79" containerID="16fced99002cf271026de6d87a592365aa2d127b3393deb9baa770010e2b14e0" exitCode=0 Jul 27 12:25:20.897964 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:20.897922 2568 generic.go:356] "Generic (PLEG): container finished" podID="11d848cc-1c62-47a7-827a-4b77b2f28d79" containerID="28d6ff3ab5b97a992dab6b715aa47a74c0dc5f29eb1114d992d1a3cc5f1c40ad" exitCode=0 Jul 27 12:25:20.897964 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:20.897927 2568 generic.go:356] "Generic (PLEG): container finished" podID="11d848cc-1c62-47a7-827a-4b77b2f28d79" containerID="3f1db448d609f900038c4aa21332ad323452ee242a4bff15337165765764f5a3" exitCode=0 Jul 27 12:25:20.897964 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:20.897957 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"11d848cc-1c62-47a7-827a-4b77b2f28d79","Type":"ContainerDied","Data":"28aa6a06f48c69e3db78a2e19c58dbd562cf7ba0c676d28ecd5bf04eb46c3919"} Jul 27 12:25:20.898249 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:20.898021 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"11d848cc-1c62-47a7-827a-4b77b2f28d79","Type":"ContainerDied","Data":"834580f138d6d6f39ca14691ef9830b1110700e819bc1487b109744cb953ab4d"} Jul 27 12:25:20.898249 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:20.898047 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"11d848cc-1c62-47a7-827a-4b77b2f28d79","Type":"ContainerDied","Data":"16fced99002cf271026de6d87a592365aa2d127b3393deb9baa770010e2b14e0"} Jul 27 12:25:20.898249 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:20.898071 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"11d848cc-1c62-47a7-827a-4b77b2f28d79","Type":"ContainerDied","Data":"28d6ff3ab5b97a992dab6b715aa47a74c0dc5f29eb1114d992d1a3cc5f1c40ad"} Jul 27 12:25:20.898249 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:20.898095 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"11d848cc-1c62-47a7-827a-4b77b2f28d79","Type":"ContainerDied","Data":"3f1db448d609f900038c4aa21332ad323452ee242a4bff15337165765764f5a3"} Jul 27 12:25:21.740018 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:21.739993 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 27 12:25:21.840916 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:21.840830 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/11d848cc-1c62-47a7-827a-4b77b2f28d79-config-out\") pod \"11d848cc-1c62-47a7-827a-4b77b2f28d79\" (UID: \"11d848cc-1c62-47a7-827a-4b77b2f28d79\") " Jul 27 12:25:21.840916 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:21.840881 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/11d848cc-1c62-47a7-827a-4b77b2f28d79-tls-assets\") pod \"11d848cc-1c62-47a7-827a-4b77b2f28d79\" (UID: \"11d848cc-1c62-47a7-827a-4b77b2f28d79\") " Jul 27 12:25:21.840916 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:21.840905 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/11d848cc-1c62-47a7-827a-4b77b2f28d79-cluster-tls-config\") pod \"11d848cc-1c62-47a7-827a-4b77b2f28d79\" (UID: \"11d848cc-1c62-47a7-827a-4b77b2f28d79\") " Jul 27 12:25:21.841193 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:21.840925 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/11d848cc-1c62-47a7-827a-4b77b2f28d79-secret-alertmanager-kube-rbac-proxy\") pod \"11d848cc-1c62-47a7-827a-4b77b2f28d79\" (UID: \"11d848cc-1c62-47a7-827a-4b77b2f28d79\") " Jul 27 12:25:21.841193 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:21.840948 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jgd5d\" (UniqueName: \"kubernetes.io/projected/11d848cc-1c62-47a7-827a-4b77b2f28d79-kube-api-access-jgd5d\") pod \"11d848cc-1c62-47a7-827a-4b77b2f28d79\" (UID: \"11d848cc-1c62-47a7-827a-4b77b2f28d79\") " Jul 27 12:25:21.841193 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:21.840979 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/11d848cc-1c62-47a7-827a-4b77b2f28d79-secret-alertmanager-kube-rbac-proxy-web\") pod \"11d848cc-1c62-47a7-827a-4b77b2f28d79\" (UID: \"11d848cc-1c62-47a7-827a-4b77b2f28d79\") " Jul 27 12:25:21.841193 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:21.840998 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11d848cc-1c62-47a7-827a-4b77b2f28d79-alertmanager-trusted-ca-bundle\") pod \"11d848cc-1c62-47a7-827a-4b77b2f28d79\" (UID: \"11d848cc-1c62-47a7-827a-4b77b2f28d79\") " Jul 27 12:25:21.841397 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:21.841201 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/11d848cc-1c62-47a7-827a-4b77b2f28d79-web-config\") pod \"11d848cc-1c62-47a7-827a-4b77b2f28d79\" (UID: \"11d848cc-1c62-47a7-827a-4b77b2f28d79\") " Jul 27 12:25:21.841397 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:21.841238 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/11d848cc-1c62-47a7-827a-4b77b2f28d79-metrics-client-ca\") pod \"11d848cc-1c62-47a7-827a-4b77b2f28d79\" (UID: \"11d848cc-1c62-47a7-827a-4b77b2f28d79\") " Jul 27 12:25:21.841397 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:21.841279 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/11d848cc-1c62-47a7-827a-4b77b2f28d79-secret-alertmanager-kube-rbac-proxy-metric\") pod \"11d848cc-1c62-47a7-827a-4b77b2f28d79\" (UID: \"11d848cc-1c62-47a7-827a-4b77b2f28d79\") " Jul 27 12:25:21.841397 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:21.841305 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/11d848cc-1c62-47a7-827a-4b77b2f28d79-config-volume\") pod \"11d848cc-1c62-47a7-827a-4b77b2f28d79\" (UID: \"11d848cc-1c62-47a7-827a-4b77b2f28d79\") " Jul 27 12:25:21.841615 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:21.841396 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/11d848cc-1c62-47a7-827a-4b77b2f28d79-secret-alertmanager-main-tls\") pod \"11d848cc-1c62-47a7-827a-4b77b2f28d79\" (UID: \"11d848cc-1c62-47a7-827a-4b77b2f28d79\") " Jul 27 12:25:21.841615 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:21.841418 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/11d848cc-1c62-47a7-827a-4b77b2f28d79-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "11d848cc-1c62-47a7-827a-4b77b2f28d79" (UID: "11d848cc-1c62-47a7-827a-4b77b2f28d79"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 12:25:21.841615 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:21.841425 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/11d848cc-1c62-47a7-827a-4b77b2f28d79-alertmanager-main-db\") pod \"11d848cc-1c62-47a7-827a-4b77b2f28d79\" (UID: \"11d848cc-1c62-47a7-827a-4b77b2f28d79\") " Jul 27 12:25:21.841793 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:21.841676 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11d848cc-1c62-47a7-827a-4b77b2f28d79-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "11d848cc-1c62-47a7-827a-4b77b2f28d79" (UID: "11d848cc-1c62-47a7-827a-4b77b2f28d79"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 27 12:25:21.841852 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:21.841818 2568 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11d848cc-1c62-47a7-827a-4b77b2f28d79-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-141-3.ec2.internal\" DevicePath \"\"" Jul 27 12:25:21.841852 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:21.841838 2568 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/11d848cc-1c62-47a7-827a-4b77b2f28d79-alertmanager-main-db\") on node \"ip-10-0-141-3.ec2.internal\" DevicePath \"\"" Jul 27 12:25:21.842321 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:21.842289 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/11d848cc-1c62-47a7-827a-4b77b2f28d79-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "11d848cc-1c62-47a7-827a-4b77b2f28d79" (UID: "11d848cc-1c62-47a7-827a-4b77b2f28d79"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 12:25:21.844864 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:21.844789 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/11d848cc-1c62-47a7-827a-4b77b2f28d79-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "11d848cc-1c62-47a7-827a-4b77b2f28d79" (UID: "11d848cc-1c62-47a7-827a-4b77b2f28d79"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 12:25:21.844999 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:21.844880 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/11d848cc-1c62-47a7-827a-4b77b2f28d79-config-volume" (OuterVolumeSpecName: "config-volume") pod "11d848cc-1c62-47a7-827a-4b77b2f28d79" (UID: "11d848cc-1c62-47a7-827a-4b77b2f28d79"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 12:25:21.844999 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:21.844878 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/11d848cc-1c62-47a7-827a-4b77b2f28d79-kube-api-access-jgd5d" (OuterVolumeSpecName: "kube-api-access-jgd5d") pod "11d848cc-1c62-47a7-827a-4b77b2f28d79" (UID: "11d848cc-1c62-47a7-827a-4b77b2f28d79"). InnerVolumeSpecName "kube-api-access-jgd5d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 12:25:21.844999 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:21.844906 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/11d848cc-1c62-47a7-827a-4b77b2f28d79-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "11d848cc-1c62-47a7-827a-4b77b2f28d79" (UID: "11d848cc-1c62-47a7-827a-4b77b2f28d79"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 12:25:21.845271 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:21.845235 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/11d848cc-1c62-47a7-827a-4b77b2f28d79-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "11d848cc-1c62-47a7-827a-4b77b2f28d79" (UID: "11d848cc-1c62-47a7-827a-4b77b2f28d79"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 12:25:21.845554 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:21.845517 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11d848cc-1c62-47a7-827a-4b77b2f28d79-config-out" (OuterVolumeSpecName: "config-out") pod "11d848cc-1c62-47a7-827a-4b77b2f28d79" (UID: "11d848cc-1c62-47a7-827a-4b77b2f28d79"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 27 12:25:21.845554 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:21.845548 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/11d848cc-1c62-47a7-827a-4b77b2f28d79-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "11d848cc-1c62-47a7-827a-4b77b2f28d79" (UID: "11d848cc-1c62-47a7-827a-4b77b2f28d79"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 12:25:21.846427 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:21.846402 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/11d848cc-1c62-47a7-827a-4b77b2f28d79-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "11d848cc-1c62-47a7-827a-4b77b2f28d79" (UID: "11d848cc-1c62-47a7-827a-4b77b2f28d79"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 12:25:21.849649 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:21.849620 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/11d848cc-1c62-47a7-827a-4b77b2f28d79-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "11d848cc-1c62-47a7-827a-4b77b2f28d79" (UID: "11d848cc-1c62-47a7-827a-4b77b2f28d79"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 12:25:21.856062 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:21.856036 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/11d848cc-1c62-47a7-827a-4b77b2f28d79-web-config" (OuterVolumeSpecName: "web-config") pod "11d848cc-1c62-47a7-827a-4b77b2f28d79" (UID: "11d848cc-1c62-47a7-827a-4b77b2f28d79"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 12:25:21.904805 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:21.904773 2568 generic.go:356] "Generic (PLEG): container finished" podID="11d848cc-1c62-47a7-827a-4b77b2f28d79" containerID="35f66708ffbd49626cace33ad26c14331e747f10d9a40b0c626898090d225209" exitCode=0 Jul 27 12:25:21.904977 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:21.904823 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"11d848cc-1c62-47a7-827a-4b77b2f28d79","Type":"ContainerDied","Data":"35f66708ffbd49626cace33ad26c14331e747f10d9a40b0c626898090d225209"} Jul 27 12:25:21.904977 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:21.904863 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 27 12:25:21.904977 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:21.904884 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"11d848cc-1c62-47a7-827a-4b77b2f28d79","Type":"ContainerDied","Data":"1151ccdbab915c742be75205aa374add274e72a12358991d205c93adcfbe94dd"} Jul 27 12:25:21.904977 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:21.904925 2568 scope.go:117] "RemoveContainer" containerID="28aa6a06f48c69e3db78a2e19c58dbd562cf7ba0c676d28ecd5bf04eb46c3919" Jul 27 12:25:21.912530 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:21.912512 2568 scope.go:117] "RemoveContainer" containerID="834580f138d6d6f39ca14691ef9830b1110700e819bc1487b109744cb953ab4d" Jul 27 12:25:21.919968 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:21.919946 2568 scope.go:117] "RemoveContainer" containerID="16fced99002cf271026de6d87a592365aa2d127b3393deb9baa770010e2b14e0" Jul 27 12:25:21.926295 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:21.926280 2568 scope.go:117] "RemoveContainer" containerID="35f66708ffbd49626cace33ad26c14331e747f10d9a40b0c626898090d225209" Jul 27 12:25:21.931285 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:21.931263 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 27 12:25:21.934487 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:21.934471 2568 scope.go:117] "RemoveContainer" containerID="28d6ff3ab5b97a992dab6b715aa47a74c0dc5f29eb1114d992d1a3cc5f1c40ad" Jul 27 12:25:21.935044 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:21.935023 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 27 12:25:21.941210 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:21.941195 2568 scope.go:117] "RemoveContainer" containerID="3f1db448d609f900038c4aa21332ad323452ee242a4bff15337165765764f5a3" Jul 27 12:25:21.942191 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:21.942173 2568 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/11d848cc-1c62-47a7-827a-4b77b2f28d79-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-141-3.ec2.internal\" DevicePath \"\"" Jul 27 12:25:21.942291 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:21.942194 2568 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/11d848cc-1c62-47a7-827a-4b77b2f28d79-web-config\") on node \"ip-10-0-141-3.ec2.internal\" DevicePath \"\"" Jul 27 12:25:21.942291 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:21.942209 2568 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/11d848cc-1c62-47a7-827a-4b77b2f28d79-metrics-client-ca\") on node \"ip-10-0-141-3.ec2.internal\" DevicePath \"\"" Jul 27 12:25:21.942291 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:21.942222 2568 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/11d848cc-1c62-47a7-827a-4b77b2f28d79-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-141-3.ec2.internal\" DevicePath \"\"" Jul 27 12:25:21.942291 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:21.942237 2568 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/11d848cc-1c62-47a7-827a-4b77b2f28d79-config-volume\") on node \"ip-10-0-141-3.ec2.internal\" DevicePath \"\"" Jul 27 12:25:21.942291 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:21.942250 2568 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/11d848cc-1c62-47a7-827a-4b77b2f28d79-secret-alertmanager-main-tls\") on node \"ip-10-0-141-3.ec2.internal\" DevicePath \"\"" Jul 27 12:25:21.942291 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:21.942262 2568 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/11d848cc-1c62-47a7-827a-4b77b2f28d79-config-out\") on node \"ip-10-0-141-3.ec2.internal\" DevicePath \"\"" Jul 27 12:25:21.942291 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:21.942274 2568 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/11d848cc-1c62-47a7-827a-4b77b2f28d79-tls-assets\") on node \"ip-10-0-141-3.ec2.internal\" DevicePath \"\"" Jul 27 12:25:21.942291 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:21.942286 2568 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/11d848cc-1c62-47a7-827a-4b77b2f28d79-cluster-tls-config\") on node \"ip-10-0-141-3.ec2.internal\" DevicePath \"\"" Jul 27 12:25:21.942549 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:21.942299 2568 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/11d848cc-1c62-47a7-827a-4b77b2f28d79-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-141-3.ec2.internal\" DevicePath \"\"" Jul 27 12:25:21.942549 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:21.942313 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jgd5d\" (UniqueName: \"kubernetes.io/projected/11d848cc-1c62-47a7-827a-4b77b2f28d79-kube-api-access-jgd5d\") on node \"ip-10-0-141-3.ec2.internal\" DevicePath \"\"" Jul 27 12:25:21.948032 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:21.948006 2568 scope.go:117] "RemoveContainer" containerID="7227fe328fff90390ab58948ba9bde1b8e4815f3540dae0b88aa9fe8b3778fbb" Jul 27 12:25:21.954853 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:21.954835 2568 scope.go:117] "RemoveContainer" containerID="28aa6a06f48c69e3db78a2e19c58dbd562cf7ba0c676d28ecd5bf04eb46c3919" Jul 27 12:25:21.955122 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:25:21.955104 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"28aa6a06f48c69e3db78a2e19c58dbd562cf7ba0c676d28ecd5bf04eb46c3919\": container with ID starting with 28aa6a06f48c69e3db78a2e19c58dbd562cf7ba0c676d28ecd5bf04eb46c3919 not found: ID does not exist" containerID="28aa6a06f48c69e3db78a2e19c58dbd562cf7ba0c676d28ecd5bf04eb46c3919" Jul 27 12:25:21.955179 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:21.955133 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"28aa6a06f48c69e3db78a2e19c58dbd562cf7ba0c676d28ecd5bf04eb46c3919"} err="failed to get container status \"28aa6a06f48c69e3db78a2e19c58dbd562cf7ba0c676d28ecd5bf04eb46c3919\": rpc error: code = NotFound desc = could not find container \"28aa6a06f48c69e3db78a2e19c58dbd562cf7ba0c676d28ecd5bf04eb46c3919\": container with ID starting with 28aa6a06f48c69e3db78a2e19c58dbd562cf7ba0c676d28ecd5bf04eb46c3919 not found: ID does not exist" Jul 27 12:25:21.955179 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:21.955150 2568 scope.go:117] "RemoveContainer" containerID="834580f138d6d6f39ca14691ef9830b1110700e819bc1487b109744cb953ab4d" Jul 27 12:25:21.955359 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:25:21.955343 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"834580f138d6d6f39ca14691ef9830b1110700e819bc1487b109744cb953ab4d\": container with ID starting with 834580f138d6d6f39ca14691ef9830b1110700e819bc1487b109744cb953ab4d not found: ID does not exist" containerID="834580f138d6d6f39ca14691ef9830b1110700e819bc1487b109744cb953ab4d" Jul 27 12:25:21.955405 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:21.955364 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"834580f138d6d6f39ca14691ef9830b1110700e819bc1487b109744cb953ab4d"} err="failed to get container status \"834580f138d6d6f39ca14691ef9830b1110700e819bc1487b109744cb953ab4d\": rpc error: code = NotFound desc = could not find container \"834580f138d6d6f39ca14691ef9830b1110700e819bc1487b109744cb953ab4d\": container with ID starting with 834580f138d6d6f39ca14691ef9830b1110700e819bc1487b109744cb953ab4d not found: ID does not exist" Jul 27 12:25:21.955405 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:21.955380 2568 scope.go:117] "RemoveContainer" containerID="16fced99002cf271026de6d87a592365aa2d127b3393deb9baa770010e2b14e0" Jul 27 12:25:21.955630 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:25:21.955612 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"16fced99002cf271026de6d87a592365aa2d127b3393deb9baa770010e2b14e0\": container with ID starting with 16fced99002cf271026de6d87a592365aa2d127b3393deb9baa770010e2b14e0 not found: ID does not exist" containerID="16fced99002cf271026de6d87a592365aa2d127b3393deb9baa770010e2b14e0" Jul 27 12:25:21.955697 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:21.955639 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"16fced99002cf271026de6d87a592365aa2d127b3393deb9baa770010e2b14e0"} err="failed to get container status \"16fced99002cf271026de6d87a592365aa2d127b3393deb9baa770010e2b14e0\": rpc error: code = NotFound desc = could not find container \"16fced99002cf271026de6d87a592365aa2d127b3393deb9baa770010e2b14e0\": container with ID starting with 16fced99002cf271026de6d87a592365aa2d127b3393deb9baa770010e2b14e0 not found: ID does not exist" Jul 27 12:25:21.955697 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:21.955660 2568 scope.go:117] "RemoveContainer" containerID="35f66708ffbd49626cace33ad26c14331e747f10d9a40b0c626898090d225209" Jul 27 12:25:21.955890 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:25:21.955876 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"35f66708ffbd49626cace33ad26c14331e747f10d9a40b0c626898090d225209\": container with ID starting with 35f66708ffbd49626cace33ad26c14331e747f10d9a40b0c626898090d225209 not found: ID does not exist" containerID="35f66708ffbd49626cace33ad26c14331e747f10d9a40b0c626898090d225209" Jul 27 12:25:21.955931 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:21.955894 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"35f66708ffbd49626cace33ad26c14331e747f10d9a40b0c626898090d225209"} err="failed to get container status \"35f66708ffbd49626cace33ad26c14331e747f10d9a40b0c626898090d225209\": rpc error: code = NotFound desc = could not find container \"35f66708ffbd49626cace33ad26c14331e747f10d9a40b0c626898090d225209\": container with ID starting with 35f66708ffbd49626cace33ad26c14331e747f10d9a40b0c626898090d225209 not found: ID does not exist" Jul 27 12:25:21.955931 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:21.955907 2568 scope.go:117] "RemoveContainer" containerID="28d6ff3ab5b97a992dab6b715aa47a74c0dc5f29eb1114d992d1a3cc5f1c40ad" Jul 27 12:25:21.956117 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:25:21.956101 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"28d6ff3ab5b97a992dab6b715aa47a74c0dc5f29eb1114d992d1a3cc5f1c40ad\": container with ID starting with 28d6ff3ab5b97a992dab6b715aa47a74c0dc5f29eb1114d992d1a3cc5f1c40ad not found: ID does not exist" containerID="28d6ff3ab5b97a992dab6b715aa47a74c0dc5f29eb1114d992d1a3cc5f1c40ad" Jul 27 12:25:21.956156 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:21.956124 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"28d6ff3ab5b97a992dab6b715aa47a74c0dc5f29eb1114d992d1a3cc5f1c40ad"} err="failed to get container status \"28d6ff3ab5b97a992dab6b715aa47a74c0dc5f29eb1114d992d1a3cc5f1c40ad\": rpc error: code = NotFound desc = could not find container \"28d6ff3ab5b97a992dab6b715aa47a74c0dc5f29eb1114d992d1a3cc5f1c40ad\": container with ID starting with 28d6ff3ab5b97a992dab6b715aa47a74c0dc5f29eb1114d992d1a3cc5f1c40ad not found: ID does not exist" Jul 27 12:25:21.956156 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:21.956137 2568 scope.go:117] "RemoveContainer" containerID="3f1db448d609f900038c4aa21332ad323452ee242a4bff15337165765764f5a3" Jul 27 12:25:21.956339 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:25:21.956322 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3f1db448d609f900038c4aa21332ad323452ee242a4bff15337165765764f5a3\": container with ID starting with 3f1db448d609f900038c4aa21332ad323452ee242a4bff15337165765764f5a3 not found: ID does not exist" containerID="3f1db448d609f900038c4aa21332ad323452ee242a4bff15337165765764f5a3" Jul 27 12:25:21.956380 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:21.956343 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f1db448d609f900038c4aa21332ad323452ee242a4bff15337165765764f5a3"} err="failed to get container status \"3f1db448d609f900038c4aa21332ad323452ee242a4bff15337165765764f5a3\": rpc error: code = NotFound desc = could not find container \"3f1db448d609f900038c4aa21332ad323452ee242a4bff15337165765764f5a3\": container with ID starting with 3f1db448d609f900038c4aa21332ad323452ee242a4bff15337165765764f5a3 not found: ID does not exist" Jul 27 12:25:21.956380 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:21.956354 2568 scope.go:117] "RemoveContainer" containerID="7227fe328fff90390ab58948ba9bde1b8e4815f3540dae0b88aa9fe8b3778fbb" Jul 27 12:25:21.956544 ip-10-0-141-3 kubenswrapper[2568]: E0727 12:25:21.956528 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7227fe328fff90390ab58948ba9bde1b8e4815f3540dae0b88aa9fe8b3778fbb\": container with ID starting with 7227fe328fff90390ab58948ba9bde1b8e4815f3540dae0b88aa9fe8b3778fbb not found: ID does not exist" containerID="7227fe328fff90390ab58948ba9bde1b8e4815f3540dae0b88aa9fe8b3778fbb" Jul 27 12:25:21.956584 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:21.956548 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7227fe328fff90390ab58948ba9bde1b8e4815f3540dae0b88aa9fe8b3778fbb"} err="failed to get container status \"7227fe328fff90390ab58948ba9bde1b8e4815f3540dae0b88aa9fe8b3778fbb\": rpc error: code = NotFound desc = could not find container \"7227fe328fff90390ab58948ba9bde1b8e4815f3540dae0b88aa9fe8b3778fbb\": container with ID starting with 7227fe328fff90390ab58948ba9bde1b8e4815f3540dae0b88aa9fe8b3778fbb not found: ID does not exist" Jul 27 12:25:21.961365 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:21.961347 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 27 12:25:21.961626 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:21.961614 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11d848cc-1c62-47a7-827a-4b77b2f28d79" containerName="kube-rbac-proxy-metric" Jul 27 12:25:21.961668 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:21.961627 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="11d848cc-1c62-47a7-827a-4b77b2f28d79" containerName="kube-rbac-proxy-metric" Jul 27 12:25:21.961668 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:21.961638 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11d848cc-1c62-47a7-827a-4b77b2f28d79" containerName="prom-label-proxy" Jul 27 12:25:21.961668 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:21.961643 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="11d848cc-1c62-47a7-827a-4b77b2f28d79" containerName="prom-label-proxy" Jul 27 12:25:21.961668 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:21.961653 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50c8b5c0-deb3-4e2f-afbd-93796cc7d81e" containerName="console" Jul 27 12:25:21.961668 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:21.961658 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="50c8b5c0-deb3-4e2f-afbd-93796cc7d81e" containerName="console" Jul 27 12:25:21.961668 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:21.961666 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11d848cc-1c62-47a7-827a-4b77b2f28d79" containerName="alertmanager" Jul 27 12:25:21.961849 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:21.961672 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="11d848cc-1c62-47a7-827a-4b77b2f28d79" containerName="alertmanager" Jul 27 12:25:21.961849 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:21.961681 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11d848cc-1c62-47a7-827a-4b77b2f28d79" containerName="init-config-reloader" Jul 27 12:25:21.961849 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:21.961686 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="11d848cc-1c62-47a7-827a-4b77b2f28d79" containerName="init-config-reloader" Jul 27 12:25:21.961849 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:21.961694 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11d848cc-1c62-47a7-827a-4b77b2f28d79" containerName="kube-rbac-proxy" Jul 27 12:25:21.961849 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:21.961699 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="11d848cc-1c62-47a7-827a-4b77b2f28d79" containerName="kube-rbac-proxy" Jul 27 12:25:21.961849 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:21.961704 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11d848cc-1c62-47a7-827a-4b77b2f28d79" containerName="config-reloader" Jul 27 12:25:21.961849 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:21.961723 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="11d848cc-1c62-47a7-827a-4b77b2f28d79" containerName="config-reloader" Jul 27 12:25:21.961849 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:21.961728 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11d848cc-1c62-47a7-827a-4b77b2f28d79" containerName="kube-rbac-proxy-web" Jul 27 12:25:21.961849 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:21.961733 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="11d848cc-1c62-47a7-827a-4b77b2f28d79" containerName="kube-rbac-proxy-web" Jul 27 12:25:21.961849 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:21.961773 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="11d848cc-1c62-47a7-827a-4b77b2f28d79" containerName="config-reloader" Jul 27 12:25:21.961849 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:21.961782 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="11d848cc-1c62-47a7-827a-4b77b2f28d79" containerName="prom-label-proxy" Jul 27 12:25:21.961849 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:21.961787 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="11d848cc-1c62-47a7-827a-4b77b2f28d79" containerName="kube-rbac-proxy-web" Jul 27 12:25:21.961849 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:21.961793 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="11d848cc-1c62-47a7-827a-4b77b2f28d79" containerName="alertmanager" Jul 27 12:25:21.961849 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:21.961799 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="50c8b5c0-deb3-4e2f-afbd-93796cc7d81e" containerName="console" Jul 27 12:25:21.961849 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:21.961804 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="11d848cc-1c62-47a7-827a-4b77b2f28d79" containerName="kube-rbac-proxy" Jul 27 12:25:21.961849 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:21.961810 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="11d848cc-1c62-47a7-827a-4b77b2f28d79" containerName="kube-rbac-proxy-metric" Jul 27 12:25:21.966113 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:21.966096 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 27 12:25:21.969964 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:21.969940 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 27 12:25:21.970085 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:21.969963 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 27 12:25:21.970085 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:21.970015 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 27 12:25:21.970085 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:21.970035 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 27 12:25:21.970085 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:21.970018 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 27 12:25:21.970277 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:21.970103 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 27 12:25:21.970277 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:21.970149 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-vmtg8\"" Jul 27 12:25:21.970277 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:21.970183 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 27 12:25:21.970485 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:21.970471 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 27 12:25:21.974268 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:21.974237 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 27 12:25:21.983114 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:21.983097 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 27 12:25:22.042729 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:22.042690 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec733c08-9f4d-47cf-a663-d3ccc1f43324-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ec733c08-9f4d-47cf-a663-d3ccc1f43324\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 12:25:22.042907 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:22.042753 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ec733c08-9f4d-47cf-a663-d3ccc1f43324-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ec733c08-9f4d-47cf-a663-d3ccc1f43324\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 12:25:22.042907 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:22.042786 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ec733c08-9f4d-47cf-a663-d3ccc1f43324-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ec733c08-9f4d-47cf-a663-d3ccc1f43324\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 12:25:22.042907 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:22.042808 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ec733c08-9f4d-47cf-a663-d3ccc1f43324-config-volume\") pod \"alertmanager-main-0\" (UID: \"ec733c08-9f4d-47cf-a663-d3ccc1f43324\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 12:25:22.042907 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:22.042850 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ec733c08-9f4d-47cf-a663-d3ccc1f43324-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ec733c08-9f4d-47cf-a663-d3ccc1f43324\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 12:25:22.042907 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:22.042880 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ec733c08-9f4d-47cf-a663-d3ccc1f43324-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ec733c08-9f4d-47cf-a663-d3ccc1f43324\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 12:25:22.043098 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:22.042916 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ec733c08-9f4d-47cf-a663-d3ccc1f43324-config-out\") pod \"alertmanager-main-0\" (UID: \"ec733c08-9f4d-47cf-a663-d3ccc1f43324\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 12:25:22.043098 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:22.042941 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ec733c08-9f4d-47cf-a663-d3ccc1f43324-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ec733c08-9f4d-47cf-a663-d3ccc1f43324\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 12:25:22.043098 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:22.042963 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5q5sk\" (UniqueName: \"kubernetes.io/projected/ec733c08-9f4d-47cf-a663-d3ccc1f43324-kube-api-access-5q5sk\") pod \"alertmanager-main-0\" (UID: \"ec733c08-9f4d-47cf-a663-d3ccc1f43324\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 12:25:22.043098 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:22.043041 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ec733c08-9f4d-47cf-a663-d3ccc1f43324-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ec733c08-9f4d-47cf-a663-d3ccc1f43324\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 12:25:22.043098 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:22.043070 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ec733c08-9f4d-47cf-a663-d3ccc1f43324-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ec733c08-9f4d-47cf-a663-d3ccc1f43324\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 12:25:22.043098 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:22.043098 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ec733c08-9f4d-47cf-a663-d3ccc1f43324-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ec733c08-9f4d-47cf-a663-d3ccc1f43324\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 12:25:22.043303 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:22.043126 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ec733c08-9f4d-47cf-a663-d3ccc1f43324-web-config\") pod \"alertmanager-main-0\" (UID: \"ec733c08-9f4d-47cf-a663-d3ccc1f43324\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 12:25:22.143778 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:22.143675 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ec733c08-9f4d-47cf-a663-d3ccc1f43324-web-config\") pod \"alertmanager-main-0\" (UID: \"ec733c08-9f4d-47cf-a663-d3ccc1f43324\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 12:25:22.143778 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:22.143744 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec733c08-9f4d-47cf-a663-d3ccc1f43324-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ec733c08-9f4d-47cf-a663-d3ccc1f43324\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 12:25:22.143778 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:22.143777 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ec733c08-9f4d-47cf-a663-d3ccc1f43324-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ec733c08-9f4d-47cf-a663-d3ccc1f43324\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 12:25:22.144040 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:22.143804 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ec733c08-9f4d-47cf-a663-d3ccc1f43324-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ec733c08-9f4d-47cf-a663-d3ccc1f43324\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 12:25:22.144040 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:22.143860 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ec733c08-9f4d-47cf-a663-d3ccc1f43324-config-volume\") pod \"alertmanager-main-0\" (UID: \"ec733c08-9f4d-47cf-a663-d3ccc1f43324\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 12:25:22.144040 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:22.143901 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ec733c08-9f4d-47cf-a663-d3ccc1f43324-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ec733c08-9f4d-47cf-a663-d3ccc1f43324\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 12:25:22.144177 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:22.144046 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ec733c08-9f4d-47cf-a663-d3ccc1f43324-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ec733c08-9f4d-47cf-a663-d3ccc1f43324\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 12:25:22.144177 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:22.144113 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ec733c08-9f4d-47cf-a663-d3ccc1f43324-config-out\") pod \"alertmanager-main-0\" (UID: \"ec733c08-9f4d-47cf-a663-d3ccc1f43324\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 12:25:22.144177 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:22.144154 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ec733c08-9f4d-47cf-a663-d3ccc1f43324-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ec733c08-9f4d-47cf-a663-d3ccc1f43324\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 12:25:22.144324 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:22.144191 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5q5sk\" (UniqueName: \"kubernetes.io/projected/ec733c08-9f4d-47cf-a663-d3ccc1f43324-kube-api-access-5q5sk\") pod \"alertmanager-main-0\" (UID: \"ec733c08-9f4d-47cf-a663-d3ccc1f43324\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 12:25:22.144324 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:22.144233 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ec733c08-9f4d-47cf-a663-d3ccc1f43324-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ec733c08-9f4d-47cf-a663-d3ccc1f43324\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 12:25:22.144324 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:22.144264 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ec733c08-9f4d-47cf-a663-d3ccc1f43324-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ec733c08-9f4d-47cf-a663-d3ccc1f43324\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 12:25:22.144324 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:22.144310 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ec733c08-9f4d-47cf-a663-d3ccc1f43324-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ec733c08-9f4d-47cf-a663-d3ccc1f43324\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 12:25:22.145018 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:22.144920 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec733c08-9f4d-47cf-a663-d3ccc1f43324-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ec733c08-9f4d-47cf-a663-d3ccc1f43324\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 12:25:22.145018 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:22.144946 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ec733c08-9f4d-47cf-a663-d3ccc1f43324-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ec733c08-9f4d-47cf-a663-d3ccc1f43324\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 12:25:22.145818 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:22.145505 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ec733c08-9f4d-47cf-a663-d3ccc1f43324-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ec733c08-9f4d-47cf-a663-d3ccc1f43324\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 12:25:22.147002 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:22.146888 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ec733c08-9f4d-47cf-a663-d3ccc1f43324-web-config\") pod \"alertmanager-main-0\" (UID: \"ec733c08-9f4d-47cf-a663-d3ccc1f43324\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 12:25:22.147002 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:22.146932 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ec733c08-9f4d-47cf-a663-d3ccc1f43324-config-volume\") pod \"alertmanager-main-0\" (UID: \"ec733c08-9f4d-47cf-a663-d3ccc1f43324\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 12:25:22.147002 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:22.146991 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ec733c08-9f4d-47cf-a663-d3ccc1f43324-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ec733c08-9f4d-47cf-a663-d3ccc1f43324\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 12:25:22.147203 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:22.147077 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ec733c08-9f4d-47cf-a663-d3ccc1f43324-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ec733c08-9f4d-47cf-a663-d3ccc1f43324\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 12:25:22.147203 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:22.147109 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ec733c08-9f4d-47cf-a663-d3ccc1f43324-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ec733c08-9f4d-47cf-a663-d3ccc1f43324\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 12:25:22.147203 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:22.147161 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ec733c08-9f4d-47cf-a663-d3ccc1f43324-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ec733c08-9f4d-47cf-a663-d3ccc1f43324\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 12:25:22.147310 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:22.147288 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ec733c08-9f4d-47cf-a663-d3ccc1f43324-config-out\") pod \"alertmanager-main-0\" (UID: \"ec733c08-9f4d-47cf-a663-d3ccc1f43324\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 12:25:22.147921 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:22.147899 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ec733c08-9f4d-47cf-a663-d3ccc1f43324-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ec733c08-9f4d-47cf-a663-d3ccc1f43324\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 12:25:22.148687 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:22.148672 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ec733c08-9f4d-47cf-a663-d3ccc1f43324-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ec733c08-9f4d-47cf-a663-d3ccc1f43324\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 12:25:22.155039 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:22.155019 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5q5sk\" (UniqueName: \"kubernetes.io/projected/ec733c08-9f4d-47cf-a663-d3ccc1f43324-kube-api-access-5q5sk\") pod \"alertmanager-main-0\" (UID: \"ec733c08-9f4d-47cf-a663-d3ccc1f43324\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 12:25:22.161546 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:22.161519 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="11d848cc-1c62-47a7-827a-4b77b2f28d79" path="/var/lib/kubelet/pods/11d848cc-1c62-47a7-827a-4b77b2f28d79/volumes" Jul 27 12:25:22.277146 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:22.277118 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 27 12:25:22.406802 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:22.406734 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 27 12:25:22.409523 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:25:22.409502 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec733c08_9f4d_47cf_a663_d3ccc1f43324.slice/crio-1ec7e43f6f0a69af50f4d6765e107e0c2afe0ff4ceaa4182e6b72b2b3109a300 WatchSource:0}: Error finding container 1ec7e43f6f0a69af50f4d6765e107e0c2afe0ff4ceaa4182e6b72b2b3109a300: Status 404 returned error can't find the container with id 1ec7e43f6f0a69af50f4d6765e107e0c2afe0ff4ceaa4182e6b72b2b3109a300 Jul 27 12:25:22.916176 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:22.916141 2568 generic.go:356] "Generic (PLEG): container finished" podID="ec733c08-9f4d-47cf-a663-d3ccc1f43324" containerID="32ba26f35dbe260d6993718979d5c1b01fe8507104534fd46ed17f714f0749a2" exitCode=0 Jul 27 12:25:22.916607 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:22.916254 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ec733c08-9f4d-47cf-a663-d3ccc1f43324","Type":"ContainerDied","Data":"32ba26f35dbe260d6993718979d5c1b01fe8507104534fd46ed17f714f0749a2"} Jul 27 12:25:22.916607 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:22.916333 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ec733c08-9f4d-47cf-a663-d3ccc1f43324","Type":"ContainerStarted","Data":"1ec7e43f6f0a69af50f4d6765e107e0c2afe0ff4ceaa4182e6b72b2b3109a300"} Jul 27 12:25:23.924422 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:23.924392 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ec733c08-9f4d-47cf-a663-d3ccc1f43324","Type":"ContainerStarted","Data":"f6ccf7b0083b9403f62cc513ed66ed4676ecbf3dbe35572a4fc843cf3be21d45"} Jul 27 12:25:23.924879 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:23.924453 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ec733c08-9f4d-47cf-a663-d3ccc1f43324","Type":"ContainerStarted","Data":"392d7d06cb056d93c4625e7dc01b75cb4fb570f359a3142e97fec3c500f7498a"} Jul 27 12:25:23.924879 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:23.924483 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ec733c08-9f4d-47cf-a663-d3ccc1f43324","Type":"ContainerStarted","Data":"8c9e686a8950d4e9661240ff4950b1b3bc8ffa7d69fa5c568e5bdbbce8238588"} Jul 27 12:25:23.924879 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:23.924506 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ec733c08-9f4d-47cf-a663-d3ccc1f43324","Type":"ContainerStarted","Data":"4fb865e57468edfeb25527c2853e8427ac839bea7b653938b6f3a93e7ca8e067"} Jul 27 12:25:23.924879 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:23.924531 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ec733c08-9f4d-47cf-a663-d3ccc1f43324","Type":"ContainerStarted","Data":"c6808d8318ea890c03c499d406f028746668e277d7c84735daa886df5e020e25"} Jul 27 12:25:23.924879 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:23.924552 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ec733c08-9f4d-47cf-a663-d3ccc1f43324","Type":"ContainerStarted","Data":"895ad46741c6520dc3173275245afd6dd3053489205310e09c6330903252d4ad"} Jul 27 12:25:23.953424 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:23.953372 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.938063586 podStartE2EDuration="2.953356555s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.292969ms" isStatefulPod=false podCreationTimestamp="2026-07-27 12:25:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 12:25:23.95198148 +0000 UTC m=+158.355116349" watchObservedRunningTime="2026-07-27 12:25:23.953356555 +0000 UTC m=+158.356491413" Jul 27 12:25:24.772975 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:24.772941 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 27 12:25:24.773247 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:24.773214 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a" containerName="prometheus" containerID="cri-o://a4f632ed65c9b0b61efd83973f8213596d16c7aa70adbc226ee7b642297a3f87" gracePeriod=600 Jul 27 12:25:24.773381 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:24.773246 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a" containerName="kube-rbac-proxy" containerID="cri-o://069219cd10f0d764088eabc58d1b8dba8c23f94c3c298efc6847a6fb06ffdb90" gracePeriod=600 Jul 27 12:25:24.773381 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:24.773275 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a" containerName="config-reloader" containerID="cri-o://787840332f0c0784dce04033a5ef1273a106016ba12ec86eebf7c17223b726a6" gracePeriod=600 Jul 27 12:25:24.773381 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:24.773297 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a" containerName="kube-rbac-proxy-thanos" containerID="cri-o://0324c985b5c9db02594e14daac53539084341d6fdaec82d6f613d35c8ce08afd" gracePeriod=600 Jul 27 12:25:24.773381 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:24.773314 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a" containerName="kube-rbac-proxy-web" containerID="cri-o://14270636ac61ed5836e70a66df5c2e2213225a7d63e2671574c753068ce30440" gracePeriod=600 Jul 27 12:25:24.773381 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:24.773246 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a" containerName="thanos-sidecar" containerID="cri-o://0b0501786bcb9b5a44aebc99726752692315f1fadf9f4abfcb2eb7786317db9d" gracePeriod=600 Jul 27 12:25:24.932537 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:24.932501 2568 generic.go:356] "Generic (PLEG): container finished" podID="f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a" containerID="0324c985b5c9db02594e14daac53539084341d6fdaec82d6f613d35c8ce08afd" exitCode=0 Jul 27 12:25:24.932537 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:24.932527 2568 generic.go:356] "Generic (PLEG): container finished" podID="f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a" containerID="069219cd10f0d764088eabc58d1b8dba8c23f94c3c298efc6847a6fb06ffdb90" exitCode=0 Jul 27 12:25:24.932537 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:24.932533 2568 generic.go:356] "Generic (PLEG): container finished" podID="f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a" containerID="0b0501786bcb9b5a44aebc99726752692315f1fadf9f4abfcb2eb7786317db9d" exitCode=0 Jul 27 12:25:24.932537 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:24.932539 2568 generic.go:356] "Generic (PLEG): container finished" podID="f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a" containerID="787840332f0c0784dce04033a5ef1273a106016ba12ec86eebf7c17223b726a6" exitCode=0 Jul 27 12:25:24.932537 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:24.932544 2568 generic.go:356] "Generic (PLEG): container finished" podID="f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a" containerID="a4f632ed65c9b0b61efd83973f8213596d16c7aa70adbc226ee7b642297a3f87" exitCode=0 Jul 27 12:25:24.933028 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:24.932561 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a","Type":"ContainerDied","Data":"0324c985b5c9db02594e14daac53539084341d6fdaec82d6f613d35c8ce08afd"} Jul 27 12:25:24.933028 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:24.932633 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a","Type":"ContainerDied","Data":"069219cd10f0d764088eabc58d1b8dba8c23f94c3c298efc6847a6fb06ffdb90"} Jul 27 12:25:24.933028 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:24.932663 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a","Type":"ContainerDied","Data":"0b0501786bcb9b5a44aebc99726752692315f1fadf9f4abfcb2eb7786317db9d"} Jul 27 12:25:24.933028 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:24.932697 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a","Type":"ContainerDied","Data":"787840332f0c0784dce04033a5ef1273a106016ba12ec86eebf7c17223b726a6"} Jul 27 12:25:24.933028 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:24.932742 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a","Type":"ContainerDied","Data":"a4f632ed65c9b0b61efd83973f8213596d16c7aa70adbc226ee7b642297a3f87"} Jul 27 12:25:25.941062 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:25.941028 2568 generic.go:356] "Generic (PLEG): container finished" podID="f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a" containerID="14270636ac61ed5836e70a66df5c2e2213225a7d63e2671574c753068ce30440" exitCode=0 Jul 27 12:25:25.941406 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:25.941103 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a","Type":"ContainerDied","Data":"14270636ac61ed5836e70a66df5c2e2213225a7d63e2671574c753068ce30440"} Jul 27 12:25:26.020726 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:26.020684 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 27 12:25:26.077019 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:26.076987 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a-secret-metrics-client-certs\") pod \"f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a\" (UID: \"f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a\") " Jul 27 12:25:26.077214 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:26.077045 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a-config-out\") pod \"f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a\" (UID: \"f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a\") " Jul 27 12:25:26.077214 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:26.077076 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a-configmap-metrics-client-ca\") pod \"f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a\" (UID: \"f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a\") " Jul 27 12:25:26.077214 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:26.077093 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a-prometheus-k8s-rulefiles-2\") pod \"f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a\" (UID: \"f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a\") " Jul 27 12:25:26.077214 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:26.077128 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a\" (UID: \"f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a\") " Jul 27 12:25:26.077214 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:26.077150 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a-prometheus-k8s-db\") pod \"f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a\" (UID: \"f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a\") " Jul 27 12:25:26.077214 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:26.077167 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a-prometheus-k8s-rulefiles-1\") pod \"f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a\" (UID: \"f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a\") " Jul 27 12:25:26.077214 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:26.077193 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a-configmap-serving-certs-ca-bundle\") pod \"f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a\" (UID: \"f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a\") " Jul 27 12:25:26.077584 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:26.077215 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a-prometheus-k8s-rulefiles-0\") pod \"f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a\" (UID: \"f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a\") " Jul 27 12:25:26.077584 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:26.077245 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a-prometheus-trusted-ca-bundle\") pod \"f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a\" (UID: \"f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a\") " Jul 27 12:25:26.077584 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:26.077289 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hbgp8\" (UniqueName: \"kubernetes.io/projected/f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a-kube-api-access-hbgp8\") pod \"f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a\" (UID: \"f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a\") " Jul 27 12:25:26.077584 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:26.077318 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a-tls-assets\") pod \"f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a\" (UID: \"f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a\") " Jul 27 12:25:26.077584 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:26.077355 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a-secret-grpc-tls\") pod \"f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a\" (UID: \"f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a\") " Jul 27 12:25:26.077584 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:26.077382 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a-web-config\") pod \"f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a\" (UID: \"f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a\") " Jul 27 12:25:26.077584 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:26.077413 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a-secret-prometheus-k8s-tls\") pod \"f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a\" (UID: \"f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a\") " Jul 27 12:25:26.077584 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:26.077449 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a\" (UID: \"f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a\") " Jul 27 12:25:26.077584 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:26.077497 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a-config\") pod \"f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a\" (UID: \"f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a\") " Jul 27 12:25:26.077584 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:26.077522 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a-configmap-kubelet-serving-ca-bundle\") pod \"f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a\" (UID: \"f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a\") " Jul 27 12:25:26.077584 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:26.077547 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a-thanos-prometheus-http-client-file\") pod \"f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a\" (UID: \"f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a\") " Jul 27 12:25:26.077584 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:26.077579 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a-secret-kube-rbac-proxy\") pod \"f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a\" (UID: \"f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a\") " Jul 27 12:25:26.078186 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:26.077686 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a" (UID: "f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 12:25:26.078186 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:26.077760 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a" (UID: "f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 12:25:26.078186 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:26.077894 2568 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-141-3.ec2.internal\" DevicePath \"\"" Jul 27 12:25:26.078186 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:26.077914 2568 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-141-3.ec2.internal\" DevicePath \"\"" Jul 27 12:25:26.078186 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:26.078130 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a" (UID: "f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 12:25:26.084001 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:26.079117 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a" (UID: "f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 12:25:26.084001 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:26.079510 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a" (UID: "f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 12:25:26.084001 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:26.079960 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a" (UID: "f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 27 12:25:26.084001 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:26.081099 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a" (UID: "f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 12:25:26.084001 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:26.082375 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a" (UID: "f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 12:25:26.084001 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:26.083275 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a" (UID: "f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 12:25:26.084001 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:26.083379 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a-kube-api-access-hbgp8" (OuterVolumeSpecName: "kube-api-access-hbgp8") pod "f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a" (UID: "f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a"). InnerVolumeSpecName "kube-api-access-hbgp8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 12:25:26.084489 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:26.084429 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a" (UID: "f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 12:25:26.084681 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:26.084644 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a" (UID: "f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 12:25:26.085228 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:26.084908 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a" (UID: "f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 12:25:26.085228 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:26.085143 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a" (UID: "f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 12:25:26.085228 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:26.085153 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a-config-out" (OuterVolumeSpecName: "config-out") pod "f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a" (UID: "f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 27 12:25:26.085427 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:26.085295 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a" (UID: "f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 12:25:26.085427 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:26.085351 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a" (UID: "f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 12:25:26.085427 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:26.085381 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a" (UID: "f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 12:25:26.086990 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:26.086960 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a-config" (OuterVolumeSpecName: "config") pod "f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a" (UID: "f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 12:25:26.095374 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:26.095341 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a-web-config" (OuterVolumeSpecName: "web-config") pod "f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a" (UID: "f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 12:25:26.178908 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:26.178887 2568 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a-config\") on node \"ip-10-0-141-3.ec2.internal\" DevicePath \"\"" Jul 27 12:25:26.178908 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:26.178910 2568 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-141-3.ec2.internal\" DevicePath \"\"" Jul 27 12:25:26.179046 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:26.178920 2568 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a-thanos-prometheus-http-client-file\") on node \"ip-10-0-141-3.ec2.internal\" DevicePath \"\"" Jul 27 12:25:26.179046 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:26.178930 2568 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a-secret-kube-rbac-proxy\") on node \"ip-10-0-141-3.ec2.internal\" DevicePath \"\"" Jul 27 12:25:26.179046 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:26.178940 2568 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a-secret-metrics-client-certs\") on node \"ip-10-0-141-3.ec2.internal\" DevicePath \"\"" Jul 27 12:25:26.179046 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:26.178950 2568 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a-config-out\") on node \"ip-10-0-141-3.ec2.internal\" DevicePath \"\"" Jul 27 12:25:26.179046 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:26.178958 2568 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a-configmap-metrics-client-ca\") on node \"ip-10-0-141-3.ec2.internal\" DevicePath \"\"" Jul 27 12:25:26.179046 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:26.178966 2568 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-141-3.ec2.internal\" DevicePath \"\"" Jul 27 12:25:26.179046 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:26.178974 2568 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a-prometheus-k8s-db\") on node \"ip-10-0-141-3.ec2.internal\" DevicePath \"\"" Jul 27 12:25:26.179046 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:26.178983 2568 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-141-3.ec2.internal\" DevicePath \"\"" Jul 27 12:25:26.179046 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:26.178992 2568 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-141-3.ec2.internal\" DevicePath \"\"" Jul 27 12:25:26.179046 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:26.179000 2568 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a-prometheus-trusted-ca-bundle\") on node \"ip-10-0-141-3.ec2.internal\" DevicePath \"\"" Jul 27 12:25:26.179046 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:26.179008 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hbgp8\" (UniqueName: \"kubernetes.io/projected/f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a-kube-api-access-hbgp8\") on node \"ip-10-0-141-3.ec2.internal\" DevicePath \"\"" Jul 27 12:25:26.179046 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:26.179016 2568 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a-tls-assets\") on node \"ip-10-0-141-3.ec2.internal\" DevicePath \"\"" Jul 27 12:25:26.179046 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:26.179024 2568 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a-secret-grpc-tls\") on node \"ip-10-0-141-3.ec2.internal\" DevicePath \"\"" Jul 27 12:25:26.179046 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:26.179031 2568 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a-web-config\") on node \"ip-10-0-141-3.ec2.internal\" DevicePath \"\"" Jul 27 12:25:26.179046 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:26.179038 2568 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a-secret-prometheus-k8s-tls\") on node \"ip-10-0-141-3.ec2.internal\" DevicePath \"\"" Jul 27 12:25:26.179046 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:26.179046 2568 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-141-3.ec2.internal\" DevicePath \"\"" Jul 27 12:25:26.947961 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:26.947934 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a","Type":"ContainerDied","Data":"cd907574d62999b42f76fa83042b12a0fbc7fbe37aba891d7a2c374dc6241565"} Jul 27 12:25:26.948358 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:26.948006 2568 scope.go:117] "RemoveContainer" containerID="0324c985b5c9db02594e14daac53539084341d6fdaec82d6f613d35c8ce08afd" Jul 27 12:25:26.948358 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:26.947943 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 27 12:25:26.955371 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:26.955352 2568 scope.go:117] "RemoveContainer" containerID="069219cd10f0d764088eabc58d1b8dba8c23f94c3c298efc6847a6fb06ffdb90" Jul 27 12:25:26.962270 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:26.962252 2568 scope.go:117] "RemoveContainer" containerID="14270636ac61ed5836e70a66df5c2e2213225a7d63e2671574c753068ce30440" Jul 27 12:25:26.968584 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:26.968570 2568 scope.go:117] "RemoveContainer" containerID="0b0501786bcb9b5a44aebc99726752692315f1fadf9f4abfcb2eb7786317db9d" Jul 27 12:25:26.971001 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:26.970982 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 27 12:25:26.975201 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:26.975186 2568 scope.go:117] "RemoveContainer" containerID="787840332f0c0784dce04033a5ef1273a106016ba12ec86eebf7c17223b726a6" Jul 27 12:25:26.978730 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:26.978690 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 27 12:25:26.982019 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:26.981994 2568 scope.go:117] "RemoveContainer" containerID="a4f632ed65c9b0b61efd83973f8213596d16c7aa70adbc226ee7b642297a3f87" Jul 27 12:25:26.988814 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:26.988799 2568 scope.go:117] "RemoveContainer" containerID="91e83ba0cb6cd63533cfc21dce90ec3d3097768c9d870daafe527092c6fda06f" Jul 27 12:25:27.005313 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:27.005290 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 27 12:25:27.005617 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:27.005601 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a" containerName="kube-rbac-proxy" Jul 27 12:25:27.005695 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:27.005618 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a" containerName="kube-rbac-proxy" Jul 27 12:25:27.005695 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:27.005632 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a" containerName="config-reloader" Jul 27 12:25:27.005695 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:27.005640 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a" containerName="config-reloader" Jul 27 12:25:27.005695 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:27.005653 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a" containerName="kube-rbac-proxy-web" Jul 27 12:25:27.005695 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:27.005661 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a" containerName="kube-rbac-proxy-web" Jul 27 12:25:27.005695 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:27.005680 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a" containerName="init-config-reloader" Jul 27 12:25:27.005695 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:27.005688 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a" containerName="init-config-reloader" Jul 27 12:25:27.006045 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:27.005698 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a" containerName="thanos-sidecar" Jul 27 12:25:27.006045 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:27.005728 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a" containerName="thanos-sidecar" Jul 27 12:25:27.006045 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:27.005740 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a" containerName="prometheus" Jul 27 12:25:27.006045 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:27.005749 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a" containerName="prometheus" Jul 27 12:25:27.006045 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:27.005765 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a" containerName="kube-rbac-proxy-thanos" Jul 27 12:25:27.006045 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:27.005772 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a" containerName="kube-rbac-proxy-thanos" Jul 27 12:25:27.006045 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:27.005849 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a" containerName="kube-rbac-proxy" Jul 27 12:25:27.006045 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:27.005861 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a" containerName="kube-rbac-proxy-thanos" Jul 27 12:25:27.006045 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:27.005871 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a" containerName="kube-rbac-proxy-web" Jul 27 12:25:27.006045 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:27.005880 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a" containerName="config-reloader" Jul 27 12:25:27.006045 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:27.005887 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a" containerName="thanos-sidecar" Jul 27 12:25:27.006045 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:27.005897 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a" containerName="prometheus" Jul 27 12:25:27.009743 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:27.009690 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 27 12:25:27.012263 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:27.012244 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 27 12:25:27.012360 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:27.012297 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 27 12:25:27.012445 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:27.012421 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 27 12:25:27.012556 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:27.012540 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 27 12:25:27.012616 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:27.012564 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 27 12:25:27.012918 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:27.012898 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-fe6un3ohfcmje\"" Jul 27 12:25:27.013072 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:27.013026 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-hf7d2\"" Jul 27 12:25:27.013072 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:27.013028 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 27 12:25:27.013072 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:27.013049 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 27 12:25:27.013241 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:27.013096 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 27 12:25:27.013413 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:27.013398 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 27 12:25:27.013633 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:27.013615 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 27 12:25:27.013633 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:27.013629 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 27 12:25:27.013633 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:27.013630 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 27 12:25:27.016793 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:27.016756 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 27 12:25:27.019597 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:27.019578 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 27 12:25:27.028937 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:27.028918 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 27 12:25:27.085741 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:27.085691 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/24c0317d-3cd9-4ec2-b882-affcd1481ccf-config-out\") pod \"prometheus-k8s-0\" (UID: \"24c0317d-3cd9-4ec2-b882-affcd1481ccf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 12:25:27.085741 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:27.085742 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/24c0317d-3cd9-4ec2-b882-affcd1481ccf-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"24c0317d-3cd9-4ec2-b882-affcd1481ccf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 12:25:27.085977 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:27.085794 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/24c0317d-3cd9-4ec2-b882-affcd1481ccf-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"24c0317d-3cd9-4ec2-b882-affcd1481ccf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 12:25:27.085977 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:27.085832 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/24c0317d-3cd9-4ec2-b882-affcd1481ccf-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"24c0317d-3cd9-4ec2-b882-affcd1481ccf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 12:25:27.085977 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:27.085852 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/24c0317d-3cd9-4ec2-b882-affcd1481ccf-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"24c0317d-3cd9-4ec2-b882-affcd1481ccf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 12:25:27.085977 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:27.085869 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/24c0317d-3cd9-4ec2-b882-affcd1481ccf-web-config\") pod \"prometheus-k8s-0\" (UID: \"24c0317d-3cd9-4ec2-b882-affcd1481ccf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 12:25:27.085977 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:27.085890 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24c0317d-3cd9-4ec2-b882-affcd1481ccf-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"24c0317d-3cd9-4ec2-b882-affcd1481ccf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 12:25:27.085977 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:27.085930 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/24c0317d-3cd9-4ec2-b882-affcd1481ccf-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"24c0317d-3cd9-4ec2-b882-affcd1481ccf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 12:25:27.085977 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:27.085947 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24c0317d-3cd9-4ec2-b882-affcd1481ccf-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"24c0317d-3cd9-4ec2-b882-affcd1481ccf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 12:25:27.086184 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:27.085989 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/24c0317d-3cd9-4ec2-b882-affcd1481ccf-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"24c0317d-3cd9-4ec2-b882-affcd1481ccf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 12:25:27.086184 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:27.086022 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/24c0317d-3cd9-4ec2-b882-affcd1481ccf-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"24c0317d-3cd9-4ec2-b882-affcd1481ccf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 12:25:27.086184 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:27.086058 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/24c0317d-3cd9-4ec2-b882-affcd1481ccf-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"24c0317d-3cd9-4ec2-b882-affcd1481ccf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 12:25:27.086184 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:27.086076 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/24c0317d-3cd9-4ec2-b882-affcd1481ccf-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"24c0317d-3cd9-4ec2-b882-affcd1481ccf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 12:25:27.086184 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:27.086103 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/24c0317d-3cd9-4ec2-b882-affcd1481ccf-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"24c0317d-3cd9-4ec2-b882-affcd1481ccf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 12:25:27.086184 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:27.086120 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6mskc\" (UniqueName: \"kubernetes.io/projected/24c0317d-3cd9-4ec2-b882-affcd1481ccf-kube-api-access-6mskc\") pod \"prometheus-k8s-0\" (UID: \"24c0317d-3cd9-4ec2-b882-affcd1481ccf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 12:25:27.086184 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:27.086141 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/24c0317d-3cd9-4ec2-b882-affcd1481ccf-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"24c0317d-3cd9-4ec2-b882-affcd1481ccf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 12:25:27.086184 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:27.086155 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24c0317d-3cd9-4ec2-b882-affcd1481ccf-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"24c0317d-3cd9-4ec2-b882-affcd1481ccf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 12:25:27.086184 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:27.086172 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/24c0317d-3cd9-4ec2-b882-affcd1481ccf-config\") pod \"prometheus-k8s-0\" (UID: \"24c0317d-3cd9-4ec2-b882-affcd1481ccf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 12:25:27.086440 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:27.086193 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/24c0317d-3cd9-4ec2-b882-affcd1481ccf-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"24c0317d-3cd9-4ec2-b882-affcd1481ccf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 12:25:27.086440 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:27.086249 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/24c0317d-3cd9-4ec2-b882-affcd1481ccf-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"24c0317d-3cd9-4ec2-b882-affcd1481ccf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 12:25:27.187504 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:27.187434 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/24c0317d-3cd9-4ec2-b882-affcd1481ccf-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"24c0317d-3cd9-4ec2-b882-affcd1481ccf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 12:25:27.187504 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:27.187469 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/24c0317d-3cd9-4ec2-b882-affcd1481ccf-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"24c0317d-3cd9-4ec2-b882-affcd1481ccf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 12:25:27.187504 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:27.187491 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/24c0317d-3cd9-4ec2-b882-affcd1481ccf-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"24c0317d-3cd9-4ec2-b882-affcd1481ccf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 12:25:27.187781 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:27.187522 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/24c0317d-3cd9-4ec2-b882-affcd1481ccf-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"24c0317d-3cd9-4ec2-b882-affcd1481ccf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 12:25:27.187781 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:27.187544 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6mskc\" (UniqueName: \"kubernetes.io/projected/24c0317d-3cd9-4ec2-b882-affcd1481ccf-kube-api-access-6mskc\") pod \"prometheus-k8s-0\" (UID: \"24c0317d-3cd9-4ec2-b882-affcd1481ccf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 12:25:27.187781 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:27.187569 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/24c0317d-3cd9-4ec2-b882-affcd1481ccf-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"24c0317d-3cd9-4ec2-b882-affcd1481ccf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 12:25:27.187781 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:27.187592 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24c0317d-3cd9-4ec2-b882-affcd1481ccf-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"24c0317d-3cd9-4ec2-b882-affcd1481ccf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 12:25:27.187781 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:27.187619 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/24c0317d-3cd9-4ec2-b882-affcd1481ccf-config\") pod \"prometheus-k8s-0\" (UID: \"24c0317d-3cd9-4ec2-b882-affcd1481ccf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 12:25:27.187781 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:27.187641 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/24c0317d-3cd9-4ec2-b882-affcd1481ccf-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"24c0317d-3cd9-4ec2-b882-affcd1481ccf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 12:25:27.187781 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:27.187673 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/24c0317d-3cd9-4ec2-b882-affcd1481ccf-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"24c0317d-3cd9-4ec2-b882-affcd1481ccf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 12:25:27.187781 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:27.187735 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/24c0317d-3cd9-4ec2-b882-affcd1481ccf-config-out\") pod \"prometheus-k8s-0\" (UID: \"24c0317d-3cd9-4ec2-b882-affcd1481ccf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 12:25:27.187781 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:27.187759 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/24c0317d-3cd9-4ec2-b882-affcd1481ccf-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"24c0317d-3cd9-4ec2-b882-affcd1481ccf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 12:25:27.188161 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:27.187786 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/24c0317d-3cd9-4ec2-b882-affcd1481ccf-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"24c0317d-3cd9-4ec2-b882-affcd1481ccf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 12:25:27.188161 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:27.187813 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/24c0317d-3cd9-4ec2-b882-affcd1481ccf-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"24c0317d-3cd9-4ec2-b882-affcd1481ccf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 12:25:27.188161 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:27.187837 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/24c0317d-3cd9-4ec2-b882-affcd1481ccf-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"24c0317d-3cd9-4ec2-b882-affcd1481ccf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 12:25:27.188161 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:27.187862 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/24c0317d-3cd9-4ec2-b882-affcd1481ccf-web-config\") pod \"prometheus-k8s-0\" (UID: \"24c0317d-3cd9-4ec2-b882-affcd1481ccf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 12:25:27.188161 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:27.187886 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24c0317d-3cd9-4ec2-b882-affcd1481ccf-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"24c0317d-3cd9-4ec2-b882-affcd1481ccf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 12:25:27.188161 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:27.187917 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/24c0317d-3cd9-4ec2-b882-affcd1481ccf-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"24c0317d-3cd9-4ec2-b882-affcd1481ccf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 12:25:27.188161 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:27.187939 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/24c0317d-3cd9-4ec2-b882-affcd1481ccf-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"24c0317d-3cd9-4ec2-b882-affcd1481ccf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 12:25:27.188161 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:27.187945 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24c0317d-3cd9-4ec2-b882-affcd1481ccf-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"24c0317d-3cd9-4ec2-b882-affcd1481ccf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 12:25:27.188161 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:27.188004 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/24c0317d-3cd9-4ec2-b882-affcd1481ccf-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"24c0317d-3cd9-4ec2-b882-affcd1481ccf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 12:25:27.188867 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:27.188836 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24c0317d-3cd9-4ec2-b882-affcd1481ccf-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"24c0317d-3cd9-4ec2-b882-affcd1481ccf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 12:25:27.188963 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:27.188865 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/24c0317d-3cd9-4ec2-b882-affcd1481ccf-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"24c0317d-3cd9-4ec2-b882-affcd1481ccf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 12:25:27.189399 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:27.189374 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/24c0317d-3cd9-4ec2-b882-affcd1481ccf-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"24c0317d-3cd9-4ec2-b882-affcd1481ccf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 12:25:27.189676 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:27.189650 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24c0317d-3cd9-4ec2-b882-affcd1481ccf-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"24c0317d-3cd9-4ec2-b882-affcd1481ccf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 12:25:27.190633 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:27.190603 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/24c0317d-3cd9-4ec2-b882-affcd1481ccf-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"24c0317d-3cd9-4ec2-b882-affcd1481ccf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 12:25:27.190875 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:27.190746 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/24c0317d-3cd9-4ec2-b882-affcd1481ccf-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"24c0317d-3cd9-4ec2-b882-affcd1481ccf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 12:25:27.190875 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:27.190743 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/24c0317d-3cd9-4ec2-b882-affcd1481ccf-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"24c0317d-3cd9-4ec2-b882-affcd1481ccf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 12:25:27.191022 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:27.190882 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/24c0317d-3cd9-4ec2-b882-affcd1481ccf-config\") pod \"prometheus-k8s-0\" (UID: \"24c0317d-3cd9-4ec2-b882-affcd1481ccf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 12:25:27.191494 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:27.191211 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/24c0317d-3cd9-4ec2-b882-affcd1481ccf-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"24c0317d-3cd9-4ec2-b882-affcd1481ccf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 12:25:27.191590 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:27.191500 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/24c0317d-3cd9-4ec2-b882-affcd1481ccf-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"24c0317d-3cd9-4ec2-b882-affcd1481ccf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 12:25:27.191590 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:27.191519 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24c0317d-3cd9-4ec2-b882-affcd1481ccf-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"24c0317d-3cd9-4ec2-b882-affcd1481ccf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 12:25:27.192031 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:27.192007 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/24c0317d-3cd9-4ec2-b882-affcd1481ccf-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"24c0317d-3cd9-4ec2-b882-affcd1481ccf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 12:25:27.192819 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:27.192791 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/24c0317d-3cd9-4ec2-b882-affcd1481ccf-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"24c0317d-3cd9-4ec2-b882-affcd1481ccf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 12:25:27.193146 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:27.193120 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/24c0317d-3cd9-4ec2-b882-affcd1481ccf-config-out\") pod \"prometheus-k8s-0\" (UID: \"24c0317d-3cd9-4ec2-b882-affcd1481ccf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 12:25:27.193246 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:27.193232 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/24c0317d-3cd9-4ec2-b882-affcd1481ccf-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"24c0317d-3cd9-4ec2-b882-affcd1481ccf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 12:25:27.193636 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:27.193612 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/24c0317d-3cd9-4ec2-b882-affcd1481ccf-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"24c0317d-3cd9-4ec2-b882-affcd1481ccf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 12:25:27.193854 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:27.193837 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/24c0317d-3cd9-4ec2-b882-affcd1481ccf-web-config\") pod \"prometheus-k8s-0\" (UID: \"24c0317d-3cd9-4ec2-b882-affcd1481ccf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 12:25:27.193918 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:27.193904 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/24c0317d-3cd9-4ec2-b882-affcd1481ccf-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"24c0317d-3cd9-4ec2-b882-affcd1481ccf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 12:25:27.196528 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:27.196508 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6mskc\" (UniqueName: \"kubernetes.io/projected/24c0317d-3cd9-4ec2-b882-affcd1481ccf-kube-api-access-6mskc\") pod \"prometheus-k8s-0\" (UID: \"24c0317d-3cd9-4ec2-b882-affcd1481ccf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 12:25:27.319822 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:27.319788 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 27 12:25:27.457213 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:27.457110 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 27 12:25:27.461157 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:25:27.461131 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24c0317d_3cd9_4ec2_b882_affcd1481ccf.slice/crio-9a87d4a65e3055d6389b99bd8d88690f23db1aaeecedac95208f104b3be09bd9 WatchSource:0}: Error finding container 9a87d4a65e3055d6389b99bd8d88690f23db1aaeecedac95208f104b3be09bd9: Status 404 returned error can't find the container with id 9a87d4a65e3055d6389b99bd8d88690f23db1aaeecedac95208f104b3be09bd9 Jul 27 12:25:27.952902 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:27.952868 2568 generic.go:356] "Generic (PLEG): container finished" podID="24c0317d-3cd9-4ec2-b882-affcd1481ccf" containerID="49b40b014284a18864a03d772c47f0c51d8c6d556b6e1f09283c0cf2d9d0a3bd" exitCode=0 Jul 27 12:25:27.953329 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:27.952957 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"24c0317d-3cd9-4ec2-b882-affcd1481ccf","Type":"ContainerDied","Data":"49b40b014284a18864a03d772c47f0c51d8c6d556b6e1f09283c0cf2d9d0a3bd"} Jul 27 12:25:27.953329 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:27.953030 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"24c0317d-3cd9-4ec2-b882-affcd1481ccf","Type":"ContainerStarted","Data":"9a87d4a65e3055d6389b99bd8d88690f23db1aaeecedac95208f104b3be09bd9"} Jul 27 12:25:28.179200 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:28.178392 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a" path="/var/lib/kubelet/pods/f4ab84ea-6aa9-4cc1-9d3d-51e9b369e71a/volumes" Jul 27 12:25:28.961500 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:28.961465 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"24c0317d-3cd9-4ec2-b882-affcd1481ccf","Type":"ContainerStarted","Data":"d34f523d334a5d1108dc2b609c0b8c93734fabcc3bab373ce0dacbb7cbb74114"} Jul 27 12:25:28.961904 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:28.961535 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"24c0317d-3cd9-4ec2-b882-affcd1481ccf","Type":"ContainerStarted","Data":"58ef60be1743f5248ffc3d24df52af43a2888ae4696e94634de5f0b93bd8bd3a"} Jul 27 12:25:28.961904 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:28.961565 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"24c0317d-3cd9-4ec2-b882-affcd1481ccf","Type":"ContainerStarted","Data":"d019f7f792238f10ed6f3c0d1a45e65e1163f322c7fc0a4b458005bdfd926298"} Jul 27 12:25:28.961904 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:28.961588 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"24c0317d-3cd9-4ec2-b882-affcd1481ccf","Type":"ContainerStarted","Data":"00422ba16b4ef328928d194818ea5931c1c375f82a303fb5c7bbb74311a16a1b"} Jul 27 12:25:28.961904 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:28.961625 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"24c0317d-3cd9-4ec2-b882-affcd1481ccf","Type":"ContainerStarted","Data":"0fc10581cb2cc5b981e0fc6d80b1e98365f802520d55bbcd5197f0e324db4f06"} Jul 27 12:25:28.961904 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:28.961653 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"24c0317d-3cd9-4ec2-b882-affcd1481ccf","Type":"ContainerStarted","Data":"bca9fad7805507e7434b6f805a2fea97f748b246ac4039a275c355036458e7f7"} Jul 27 12:25:28.989083 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:28.989033 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.973776909 podStartE2EDuration="2.989017575s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.240666ms" isStatefulPod=false podCreationTimestamp="2026-07-27 12:25:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 12:25:28.987317986 +0000 UTC m=+163.390452845" watchObservedRunningTime="2026-07-27 12:25:28.989017575 +0000 UTC m=+163.392152432" Jul 27 12:25:32.320650 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:25:32.320613 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 27 12:26:27.320112 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:26:27.320078 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 27 12:26:27.340837 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:26:27.336244 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 27 12:26:28.201168 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:26:28.201139 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 27 12:27:45.962212 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:27:45.962179 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-2cdc4_5313f3d9-169d-4010-a1a0-9a0405b1bccf/console-operator/1.log" Jul 27 12:27:45.966839 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:27:45.966814 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-2cdc4_5313f3d9-169d-4010-a1a0-9a0405b1bccf/console-operator/1.log" Jul 27 12:27:45.972214 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:27:45.972194 2568 kubelet.go:1648] "Image garbage collection succeeded" Jul 27 12:28:49.222134 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:28:49.222055 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-jobset-operator/jobset-controller-manager-84f78cfcb9-f9tpg"] Jul 27 12:28:49.225173 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:28:49.225157 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-controller-manager-84f78cfcb9-f9tpg" Jul 27 12:28:49.228560 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:28:49.228536 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"metrics-server-cert\"" Jul 27 12:28:49.228560 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:28:49.228556 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"jobset-manager-config\"" Jul 27 12:28:49.231502 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:28:49.231190 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"kube-root-ca.crt\"" Jul 27 12:28:49.231502 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:28:49.231214 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"jobset-controller-manager-dockercfg-9rthx\"" Jul 27 12:28:49.231502 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:28:49.231273 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"openshift-service-ca.crt\"" Jul 27 12:28:49.231502 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:28:49.231300 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"webhook-server-cert\"" Jul 27 12:28:49.235829 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:28:49.235808 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-controller-manager-84f78cfcb9-f9tpg"] Jul 27 12:28:49.326391 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:28:49.326368 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f381fb85-6f91-463d-bc33-0319156781cd-metrics-certs\") pod \"jobset-controller-manager-84f78cfcb9-f9tpg\" (UID: \"f381fb85-6f91-463d-bc33-0319156781cd\") " pod="openshift-jobset-operator/jobset-controller-manager-84f78cfcb9-f9tpg" Jul 27 12:28:49.326541 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:28:49.326403 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/f381fb85-6f91-463d-bc33-0319156781cd-manager-config\") pod \"jobset-controller-manager-84f78cfcb9-f9tpg\" (UID: \"f381fb85-6f91-463d-bc33-0319156781cd\") " pod="openshift-jobset-operator/jobset-controller-manager-84f78cfcb9-f9tpg" Jul 27 12:28:49.326541 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:28:49.326453 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f381fb85-6f91-463d-bc33-0319156781cd-cert\") pod \"jobset-controller-manager-84f78cfcb9-f9tpg\" (UID: \"f381fb85-6f91-463d-bc33-0319156781cd\") " pod="openshift-jobset-operator/jobset-controller-manager-84f78cfcb9-f9tpg" Jul 27 12:28:49.326541 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:28:49.326470 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-csxgv\" (UniqueName: \"kubernetes.io/projected/f381fb85-6f91-463d-bc33-0319156781cd-kube-api-access-csxgv\") pod \"jobset-controller-manager-84f78cfcb9-f9tpg\" (UID: \"f381fb85-6f91-463d-bc33-0319156781cd\") " pod="openshift-jobset-operator/jobset-controller-manager-84f78cfcb9-f9tpg" Jul 27 12:28:49.427015 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:28:49.426977 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f381fb85-6f91-463d-bc33-0319156781cd-metrics-certs\") pod \"jobset-controller-manager-84f78cfcb9-f9tpg\" (UID: \"f381fb85-6f91-463d-bc33-0319156781cd\") " pod="openshift-jobset-operator/jobset-controller-manager-84f78cfcb9-f9tpg" Jul 27 12:28:49.427015 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:28:49.427015 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/f381fb85-6f91-463d-bc33-0319156781cd-manager-config\") pod \"jobset-controller-manager-84f78cfcb9-f9tpg\" (UID: \"f381fb85-6f91-463d-bc33-0319156781cd\") " pod="openshift-jobset-operator/jobset-controller-manager-84f78cfcb9-f9tpg" Jul 27 12:28:49.427231 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:28:49.427059 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f381fb85-6f91-463d-bc33-0319156781cd-cert\") pod \"jobset-controller-manager-84f78cfcb9-f9tpg\" (UID: \"f381fb85-6f91-463d-bc33-0319156781cd\") " pod="openshift-jobset-operator/jobset-controller-manager-84f78cfcb9-f9tpg" Jul 27 12:28:49.427231 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:28:49.427075 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-csxgv\" (UniqueName: \"kubernetes.io/projected/f381fb85-6f91-463d-bc33-0319156781cd-kube-api-access-csxgv\") pod \"jobset-controller-manager-84f78cfcb9-f9tpg\" (UID: \"f381fb85-6f91-463d-bc33-0319156781cd\") " pod="openshift-jobset-operator/jobset-controller-manager-84f78cfcb9-f9tpg" Jul 27 12:28:49.427843 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:28:49.427826 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/f381fb85-6f91-463d-bc33-0319156781cd-manager-config\") pod \"jobset-controller-manager-84f78cfcb9-f9tpg\" (UID: \"f381fb85-6f91-463d-bc33-0319156781cd\") " pod="openshift-jobset-operator/jobset-controller-manager-84f78cfcb9-f9tpg" Jul 27 12:28:49.429455 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:28:49.429434 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f381fb85-6f91-463d-bc33-0319156781cd-metrics-certs\") pod \"jobset-controller-manager-84f78cfcb9-f9tpg\" (UID: \"f381fb85-6f91-463d-bc33-0319156781cd\") " pod="openshift-jobset-operator/jobset-controller-manager-84f78cfcb9-f9tpg" Jul 27 12:28:49.429455 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:28:49.429448 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f381fb85-6f91-463d-bc33-0319156781cd-cert\") pod \"jobset-controller-manager-84f78cfcb9-f9tpg\" (UID: \"f381fb85-6f91-463d-bc33-0319156781cd\") " pod="openshift-jobset-operator/jobset-controller-manager-84f78cfcb9-f9tpg" Jul 27 12:28:49.436614 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:28:49.436594 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-csxgv\" (UniqueName: \"kubernetes.io/projected/f381fb85-6f91-463d-bc33-0319156781cd-kube-api-access-csxgv\") pod \"jobset-controller-manager-84f78cfcb9-f9tpg\" (UID: \"f381fb85-6f91-463d-bc33-0319156781cd\") " pod="openshift-jobset-operator/jobset-controller-manager-84f78cfcb9-f9tpg" Jul 27 12:28:49.535062 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:28:49.534990 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-controller-manager-84f78cfcb9-f9tpg" Jul 27 12:28:49.658039 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:28:49.658015 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-controller-manager-84f78cfcb9-f9tpg"] Jul 27 12:28:49.660034 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:28:49.660007 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf381fb85_6f91_463d_bc33_0319156781cd.slice/crio-e2e158a8c81ef3b226b79fc344bee50134a2e84249ff47b8bb114fb181a48336 WatchSource:0}: Error finding container e2e158a8c81ef3b226b79fc344bee50134a2e84249ff47b8bb114fb181a48336: Status 404 returned error can't find the container with id e2e158a8c81ef3b226b79fc344bee50134a2e84249ff47b8bb114fb181a48336 Jul 27 12:28:49.661911 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:28:49.661895 2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 27 12:28:49.733757 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:28:49.733728 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-controller-manager-84f78cfcb9-f9tpg" event={"ID":"f381fb85-6f91-463d-bc33-0319156781cd","Type":"ContainerStarted","Data":"e2e158a8c81ef3b226b79fc344bee50134a2e84249ff47b8bb114fb181a48336"} Jul 27 12:28:52.755314 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:28:52.755285 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-controller-manager-84f78cfcb9-f9tpg" event={"ID":"f381fb85-6f91-463d-bc33-0319156781cd","Type":"ContainerStarted","Data":"68da5986a4814ae2f1b7598ba4329b298e8d3f66acf2d9ae606c00d0c1defff9"} Jul 27 12:28:52.755728 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:28:52.755388 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-jobset-operator/jobset-controller-manager-84f78cfcb9-f9tpg" Jul 27 12:28:52.775024 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:28:52.774979 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-jobset-operator/jobset-controller-manager-84f78cfcb9-f9tpg" podStartSLOduration=1.1661351899999999 podStartE2EDuration="3.774965999s" totalImagesPullingTime="2.608830809s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 12:28:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 12:28:52.773272137 +0000 UTC m=+367.176406997" watchObservedRunningTime="2026-07-27 12:28:52.774965999 +0000 UTC m=+367.178100856" Jul 27 12:29:03.763764 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:29:03.763734 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-jobset-operator/jobset-controller-manager-84f78cfcb9-f9tpg" Jul 27 12:30:32.142596 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:30:32.142562 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7bcd4c79f5-vwdqq"] Jul 27 12:30:32.146030 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:30:32.146008 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bcd4c79f5-vwdqq" Jul 27 12:30:32.148515 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:30:32.148496 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 27 12:30:32.148636 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:30:32.148497 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 27 12:30:32.149580 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:30:32.149510 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 27 12:30:32.149580 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:30:32.149569 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 27 12:30:32.149796 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:30:32.149595 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 27 12:30:32.149796 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:30:32.149620 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 27 12:30:32.149920 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:30:32.149882 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-df2f4\"" Jul 27 12:30:32.149971 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:30:32.149948 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 27 12:30:32.155559 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:30:32.155536 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7bcd4c79f5-vwdqq"] Jul 27 12:30:32.156032 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:30:32.155900 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 27 12:30:32.280543 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:30:32.280503 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8bdc5f26-626b-4e17-9f9c-3e1a89180136-console-oauth-config\") pod \"console-7bcd4c79f5-vwdqq\" (UID: \"8bdc5f26-626b-4e17-9f9c-3e1a89180136\") " pod="openshift-console/console-7bcd4c79f5-vwdqq" Jul 27 12:30:32.280794 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:30:32.280752 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8bdc5f26-626b-4e17-9f9c-3e1a89180136-trusted-ca-bundle\") pod \"console-7bcd4c79f5-vwdqq\" (UID: \"8bdc5f26-626b-4e17-9f9c-3e1a89180136\") " pod="openshift-console/console-7bcd4c79f5-vwdqq" Jul 27 12:30:32.281106 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:30:32.281077 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8bdc5f26-626b-4e17-9f9c-3e1a89180136-console-config\") pod \"console-7bcd4c79f5-vwdqq\" (UID: \"8bdc5f26-626b-4e17-9f9c-3e1a89180136\") " pod="openshift-console/console-7bcd4c79f5-vwdqq" Jul 27 12:30:32.281209 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:30:32.281119 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8bdc5f26-626b-4e17-9f9c-3e1a89180136-console-serving-cert\") pod \"console-7bcd4c79f5-vwdqq\" (UID: \"8bdc5f26-626b-4e17-9f9c-3e1a89180136\") " pod="openshift-console/console-7bcd4c79f5-vwdqq" Jul 27 12:30:32.281209 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:30:32.281169 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8bdc5f26-626b-4e17-9f9c-3e1a89180136-service-ca\") pod \"console-7bcd4c79f5-vwdqq\" (UID: \"8bdc5f26-626b-4e17-9f9c-3e1a89180136\") " pod="openshift-console/console-7bcd4c79f5-vwdqq" Jul 27 12:30:32.281305 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:30:32.281252 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vrjfl\" (UniqueName: \"kubernetes.io/projected/8bdc5f26-626b-4e17-9f9c-3e1a89180136-kube-api-access-vrjfl\") pod \"console-7bcd4c79f5-vwdqq\" (UID: \"8bdc5f26-626b-4e17-9f9c-3e1a89180136\") " pod="openshift-console/console-7bcd4c79f5-vwdqq" Jul 27 12:30:32.281305 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:30:32.281291 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8bdc5f26-626b-4e17-9f9c-3e1a89180136-oauth-serving-cert\") pod \"console-7bcd4c79f5-vwdqq\" (UID: \"8bdc5f26-626b-4e17-9f9c-3e1a89180136\") " pod="openshift-console/console-7bcd4c79f5-vwdqq" Jul 27 12:30:32.382379 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:30:32.382347 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8bdc5f26-626b-4e17-9f9c-3e1a89180136-console-config\") pod \"console-7bcd4c79f5-vwdqq\" (UID: \"8bdc5f26-626b-4e17-9f9c-3e1a89180136\") " pod="openshift-console/console-7bcd4c79f5-vwdqq" Jul 27 12:30:32.382379 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:30:32.382383 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8bdc5f26-626b-4e17-9f9c-3e1a89180136-console-serving-cert\") pod \"console-7bcd4c79f5-vwdqq\" (UID: \"8bdc5f26-626b-4e17-9f9c-3e1a89180136\") " pod="openshift-console/console-7bcd4c79f5-vwdqq" Jul 27 12:30:32.382644 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:30:32.382401 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8bdc5f26-626b-4e17-9f9c-3e1a89180136-service-ca\") pod \"console-7bcd4c79f5-vwdqq\" (UID: \"8bdc5f26-626b-4e17-9f9c-3e1a89180136\") " pod="openshift-console/console-7bcd4c79f5-vwdqq" Jul 27 12:30:32.382644 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:30:32.382419 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vrjfl\" (UniqueName: \"kubernetes.io/projected/8bdc5f26-626b-4e17-9f9c-3e1a89180136-kube-api-access-vrjfl\") pod \"console-7bcd4c79f5-vwdqq\" (UID: \"8bdc5f26-626b-4e17-9f9c-3e1a89180136\") " pod="openshift-console/console-7bcd4c79f5-vwdqq" Jul 27 12:30:32.382644 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:30:32.382438 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8bdc5f26-626b-4e17-9f9c-3e1a89180136-oauth-serving-cert\") pod \"console-7bcd4c79f5-vwdqq\" (UID: \"8bdc5f26-626b-4e17-9f9c-3e1a89180136\") " pod="openshift-console/console-7bcd4c79f5-vwdqq" Jul 27 12:30:32.382644 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:30:32.382494 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8bdc5f26-626b-4e17-9f9c-3e1a89180136-console-oauth-config\") pod \"console-7bcd4c79f5-vwdqq\" (UID: \"8bdc5f26-626b-4e17-9f9c-3e1a89180136\") " pod="openshift-console/console-7bcd4c79f5-vwdqq" Jul 27 12:30:32.382644 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:30:32.382525 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8bdc5f26-626b-4e17-9f9c-3e1a89180136-trusted-ca-bundle\") pod \"console-7bcd4c79f5-vwdqq\" (UID: \"8bdc5f26-626b-4e17-9f9c-3e1a89180136\") " pod="openshift-console/console-7bcd4c79f5-vwdqq" Jul 27 12:30:32.383178 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:30:32.383153 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8bdc5f26-626b-4e17-9f9c-3e1a89180136-console-config\") pod \"console-7bcd4c79f5-vwdqq\" (UID: \"8bdc5f26-626b-4e17-9f9c-3e1a89180136\") " pod="openshift-console/console-7bcd4c79f5-vwdqq" Jul 27 12:30:32.383285 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:30:32.383225 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8bdc5f26-626b-4e17-9f9c-3e1a89180136-service-ca\") pod \"console-7bcd4c79f5-vwdqq\" (UID: \"8bdc5f26-626b-4e17-9f9c-3e1a89180136\") " pod="openshift-console/console-7bcd4c79f5-vwdqq" Jul 27 12:30:32.383285 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:30:32.383249 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8bdc5f26-626b-4e17-9f9c-3e1a89180136-oauth-serving-cert\") pod \"console-7bcd4c79f5-vwdqq\" (UID: \"8bdc5f26-626b-4e17-9f9c-3e1a89180136\") " pod="openshift-console/console-7bcd4c79f5-vwdqq" Jul 27 12:30:32.383399 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:30:32.383345 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8bdc5f26-626b-4e17-9f9c-3e1a89180136-trusted-ca-bundle\") pod \"console-7bcd4c79f5-vwdqq\" (UID: \"8bdc5f26-626b-4e17-9f9c-3e1a89180136\") " pod="openshift-console/console-7bcd4c79f5-vwdqq" Jul 27 12:30:32.385003 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:30:32.384975 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8bdc5f26-626b-4e17-9f9c-3e1a89180136-console-serving-cert\") pod \"console-7bcd4c79f5-vwdqq\" (UID: \"8bdc5f26-626b-4e17-9f9c-3e1a89180136\") " pod="openshift-console/console-7bcd4c79f5-vwdqq" Jul 27 12:30:32.385104 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:30:32.385075 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8bdc5f26-626b-4e17-9f9c-3e1a89180136-console-oauth-config\") pod \"console-7bcd4c79f5-vwdqq\" (UID: \"8bdc5f26-626b-4e17-9f9c-3e1a89180136\") " pod="openshift-console/console-7bcd4c79f5-vwdqq" Jul 27 12:30:32.393107 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:30:32.393054 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vrjfl\" (UniqueName: \"kubernetes.io/projected/8bdc5f26-626b-4e17-9f9c-3e1a89180136-kube-api-access-vrjfl\") pod \"console-7bcd4c79f5-vwdqq\" (UID: \"8bdc5f26-626b-4e17-9f9c-3e1a89180136\") " pod="openshift-console/console-7bcd4c79f5-vwdqq" Jul 27 12:30:32.466213 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:30:32.466176 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bcd4c79f5-vwdqq" Jul 27 12:30:32.593251 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:30:32.593228 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7bcd4c79f5-vwdqq"] Jul 27 12:30:32.595563 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:30:32.595534 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8bdc5f26_626b_4e17_9f9c_3e1a89180136.slice/crio-2484b48edd506a5e31b93be38fbd16a0d8fc6bae37f4c55a3ffac8fa2407137b WatchSource:0}: Error finding container 2484b48edd506a5e31b93be38fbd16a0d8fc6bae37f4c55a3ffac8fa2407137b: Status 404 returned error can't find the container with id 2484b48edd506a5e31b93be38fbd16a0d8fc6bae37f4c55a3ffac8fa2407137b Jul 27 12:30:33.146824 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:30:33.146791 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bcd4c79f5-vwdqq" event={"ID":"8bdc5f26-626b-4e17-9f9c-3e1a89180136","Type":"ContainerStarted","Data":"edb631bc04439787088e28aa35ff4da13795f4b060d25fb50e9a8e83025dc532"} Jul 27 12:30:33.147220 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:30:33.146840 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bcd4c79f5-vwdqq" event={"ID":"8bdc5f26-626b-4e17-9f9c-3e1a89180136","Type":"ContainerStarted","Data":"2484b48edd506a5e31b93be38fbd16a0d8fc6bae37f4c55a3ffac8fa2407137b"} Jul 27 12:30:33.167990 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:30:33.167943 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7bcd4c79f5-vwdqq" podStartSLOduration=1.167927273 podStartE2EDuration="1.167927273s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 12:30:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 12:30:33.167120116 +0000 UTC m=+467.570254974" watchObservedRunningTime="2026-07-27 12:30:33.167927273 +0000 UTC m=+467.571062129" Jul 27 12:30:42.466370 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:30:42.466319 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7bcd4c79f5-vwdqq" Jul 27 12:30:42.466840 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:30:42.466388 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7bcd4c79f5-vwdqq" Jul 27 12:30:42.471992 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:30:42.471970 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7bcd4c79f5-vwdqq" Jul 27 12:30:43.186778 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:30:43.186747 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7bcd4c79f5-vwdqq" Jul 27 12:32:45.989538 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:32:45.989492 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-2cdc4_5313f3d9-169d-4010-a1a0-9a0405b1bccf/console-operator/1.log" Jul 27 12:32:45.991339 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:32:45.991318 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-2cdc4_5313f3d9-169d-4010-a1a0-9a0405b1bccf/console-operator/1.log" Jul 27 12:33:01.277309 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:33:01.277283 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-sfvmh_38ae6d3f-614b-4437-bb61-ad161748269f/global-pull-secret-syncer/0.log" Jul 27 12:33:01.383982 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:33:01.383949 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-x45bt_162b7fac-bf33-40ac-9803-42ee68d8bc52/konnectivity-agent/0.log" Jul 27 12:33:01.456630 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:33:01.456602 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-3.ec2.internal_cff9f289b3eaca0aa84c8bb4795faff0/haproxy/0.log" Jul 27 12:33:05.178581 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:33:05.178554 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ec733c08-9f4d-47cf-a663-d3ccc1f43324/alertmanager/0.log" Jul 27 12:33:05.218637 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:33:05.218615 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ec733c08-9f4d-47cf-a663-d3ccc1f43324/config-reloader/0.log" Jul 27 12:33:05.261311 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:33:05.261288 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ec733c08-9f4d-47cf-a663-d3ccc1f43324/kube-rbac-proxy-web/0.log" Jul 27 12:33:05.293309 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:33:05.293285 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ec733c08-9f4d-47cf-a663-d3ccc1f43324/kube-rbac-proxy/0.log" Jul 27 12:33:05.327831 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:33:05.327797 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ec733c08-9f4d-47cf-a663-d3ccc1f43324/kube-rbac-proxy-metric/0.log" Jul 27 12:33:05.363043 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:33:05.363020 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ec733c08-9f4d-47cf-a663-d3ccc1f43324/prom-label-proxy/0.log" Jul 27 12:33:05.398868 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:33:05.398842 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ec733c08-9f4d-47cf-a663-d3ccc1f43324/init-config-reloader/0.log" Jul 27 12:33:05.568938 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:33:05.568912 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-577f48c4b5-qbp7n_e8d57e09-484b-4e0d-81af-ad0af397bece/metrics-server/0.log" Jul 27 12:33:05.600449 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:33:05.600423 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-68b7fc9574-d7lwn_3307059f-e075-4b86-8f14-bc38fb90c9ff/monitoring-plugin/0.log" Jul 27 12:33:05.734397 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:33:05.734367 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-n2spg_16041d20-46cb-42f8-bbaf-2cb0f58523c4/node-exporter/0.log" Jul 27 12:33:05.764257 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:33:05.764231 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-n2spg_16041d20-46cb-42f8-bbaf-2cb0f58523c4/kube-rbac-proxy/0.log" Jul 27 12:33:05.793183 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:33:05.793158 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-n2spg_16041d20-46cb-42f8-bbaf-2cb0f58523c4/init-textfile/0.log" Jul 27 12:33:06.014548 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:33:06.014518 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_24c0317d-3cd9-4ec2-b882-affcd1481ccf/prometheus/0.log" Jul 27 12:33:06.043631 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:33:06.043607 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_24c0317d-3cd9-4ec2-b882-affcd1481ccf/config-reloader/0.log" Jul 27 12:33:06.079883 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:33:06.079861 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_24c0317d-3cd9-4ec2-b882-affcd1481ccf/thanos-sidecar/0.log" Jul 27 12:33:06.107792 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:33:06.107768 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_24c0317d-3cd9-4ec2-b882-affcd1481ccf/kube-rbac-proxy-web/0.log" Jul 27 12:33:06.134303 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:33:06.134279 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_24c0317d-3cd9-4ec2-b882-affcd1481ccf/kube-rbac-proxy/0.log" Jul 27 12:33:06.162582 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:33:06.162506 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_24c0317d-3cd9-4ec2-b882-affcd1481ccf/kube-rbac-proxy-thanos/0.log" Jul 27 12:33:06.192615 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:33:06.192592 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_24c0317d-3cd9-4ec2-b882-affcd1481ccf/init-config-reloader/0.log" Jul 27 12:33:06.227023 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:33:06.227000 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-528lr_d3afbed3-d768-474c-bc23-fa72c717a36e/prometheus-operator/0.log" Jul 27 12:33:06.252474 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:33:06.252449 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-528lr_d3afbed3-d768-474c-bc23-fa72c717a36e/kube-rbac-proxy/0.log" Jul 27 12:33:06.283476 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:33:06.283454 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-7f8d78f54b-ck5qx_9f64c6bd-7ab7-4612-a64c-14d46b718bf9/prometheus-operator-admission-webhook/0.log" Jul 27 12:33:07.826042 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:33:07.826011 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-74c9f884b7-q9hxp_eb9990e4-1960-48c4-9e5f-97f84e6f57a1/networking-console-plugin/0.log" Jul 27 12:33:08.302298 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:33:08.302272 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-2cdc4_5313f3d9-169d-4010-a1a0-9a0405b1bccf/console-operator/1.log" Jul 27 12:33:08.306405 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:33:08.306382 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-2cdc4_5313f3d9-169d-4010-a1a0-9a0405b1bccf/console-operator/2.log" Jul 27 12:33:08.712881 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:33:08.712840 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7bcd4c79f5-vwdqq_8bdc5f26-626b-4e17-9f9c-3e1a89180136/console/0.log" Jul 27 12:33:09.360661 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:33:09.360627 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-8d887/perf-node-gather-daemonset-rndzb"] Jul 27 12:33:09.364169 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:33:09.364149 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8d887/perf-node-gather-daemonset-rndzb" Jul 27 12:33:09.366649 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:33:09.366617 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8d887\"/\"openshift-service-ca.crt\"" Jul 27 12:33:09.366853 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:33:09.366836 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8d887\"/\"kube-root-ca.crt\"" Jul 27 12:33:09.367747 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:33:09.367733 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-8d887\"/\"default-dockercfg-98s9g\"" Jul 27 12:33:09.373970 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:33:09.373951 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8d887/perf-node-gather-daemonset-rndzb"] Jul 27 12:33:09.403851 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:33:09.403830 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6db98b17-8bdb-4103-b5ae-894f21bc4766-sys\") pod \"perf-node-gather-daemonset-rndzb\" (UID: \"6db98b17-8bdb-4103-b5ae-894f21bc4766\") " pod="openshift-must-gather-8d887/perf-node-gather-daemonset-rndzb" Jul 27 12:33:09.403989 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:33:09.403868 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wrdz6\" (UniqueName: \"kubernetes.io/projected/6db98b17-8bdb-4103-b5ae-894f21bc4766-kube-api-access-wrdz6\") pod \"perf-node-gather-daemonset-rndzb\" (UID: \"6db98b17-8bdb-4103-b5ae-894f21bc4766\") " pod="openshift-must-gather-8d887/perf-node-gather-daemonset-rndzb" Jul 27 12:33:09.403989 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:33:09.403902 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6db98b17-8bdb-4103-b5ae-894f21bc4766-lib-modules\") pod \"perf-node-gather-daemonset-rndzb\" (UID: \"6db98b17-8bdb-4103-b5ae-894f21bc4766\") " pod="openshift-must-gather-8d887/perf-node-gather-daemonset-rndzb" Jul 27 12:33:09.403989 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:33:09.403963 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6db98b17-8bdb-4103-b5ae-894f21bc4766-proc\") pod \"perf-node-gather-daemonset-rndzb\" (UID: \"6db98b17-8bdb-4103-b5ae-894f21bc4766\") " pod="openshift-must-gather-8d887/perf-node-gather-daemonset-rndzb" Jul 27 12:33:09.404145 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:33:09.404062 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6db98b17-8bdb-4103-b5ae-894f21bc4766-podres\") pod \"perf-node-gather-daemonset-rndzb\" (UID: \"6db98b17-8bdb-4103-b5ae-894f21bc4766\") " pod="openshift-must-gather-8d887/perf-node-gather-daemonset-rndzb" Jul 27 12:33:09.505067 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:33:09.505036 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6db98b17-8bdb-4103-b5ae-894f21bc4766-podres\") pod \"perf-node-gather-daemonset-rndzb\" (UID: \"6db98b17-8bdb-4103-b5ae-894f21bc4766\") " pod="openshift-must-gather-8d887/perf-node-gather-daemonset-rndzb" Jul 27 12:33:09.505067 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:33:09.505072 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6db98b17-8bdb-4103-b5ae-894f21bc4766-sys\") pod \"perf-node-gather-daemonset-rndzb\" (UID: \"6db98b17-8bdb-4103-b5ae-894f21bc4766\") " pod="openshift-must-gather-8d887/perf-node-gather-daemonset-rndzb" Jul 27 12:33:09.505268 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:33:09.505091 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wrdz6\" (UniqueName: \"kubernetes.io/projected/6db98b17-8bdb-4103-b5ae-894f21bc4766-kube-api-access-wrdz6\") pod \"perf-node-gather-daemonset-rndzb\" (UID: \"6db98b17-8bdb-4103-b5ae-894f21bc4766\") " pod="openshift-must-gather-8d887/perf-node-gather-daemonset-rndzb" Jul 27 12:33:09.505268 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:33:09.505120 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6db98b17-8bdb-4103-b5ae-894f21bc4766-lib-modules\") pod \"perf-node-gather-daemonset-rndzb\" (UID: \"6db98b17-8bdb-4103-b5ae-894f21bc4766\") " pod="openshift-must-gather-8d887/perf-node-gather-daemonset-rndzb" Jul 27 12:33:09.505268 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:33:09.505171 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6db98b17-8bdb-4103-b5ae-894f21bc4766-sys\") pod \"perf-node-gather-daemonset-rndzb\" (UID: \"6db98b17-8bdb-4103-b5ae-894f21bc4766\") " pod="openshift-must-gather-8d887/perf-node-gather-daemonset-rndzb" Jul 27 12:33:09.505268 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:33:09.505173 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6db98b17-8bdb-4103-b5ae-894f21bc4766-proc\") pod \"perf-node-gather-daemonset-rndzb\" (UID: \"6db98b17-8bdb-4103-b5ae-894f21bc4766\") " pod="openshift-must-gather-8d887/perf-node-gather-daemonset-rndzb" Jul 27 12:33:09.505268 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:33:09.505206 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6db98b17-8bdb-4103-b5ae-894f21bc4766-podres\") pod \"perf-node-gather-daemonset-rndzb\" (UID: \"6db98b17-8bdb-4103-b5ae-894f21bc4766\") " pod="openshift-must-gather-8d887/perf-node-gather-daemonset-rndzb" Jul 27 12:33:09.505268 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:33:09.505213 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6db98b17-8bdb-4103-b5ae-894f21bc4766-proc\") pod \"perf-node-gather-daemonset-rndzb\" (UID: \"6db98b17-8bdb-4103-b5ae-894f21bc4766\") " pod="openshift-must-gather-8d887/perf-node-gather-daemonset-rndzb" Jul 27 12:33:09.505486 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:33:09.505279 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6db98b17-8bdb-4103-b5ae-894f21bc4766-lib-modules\") pod \"perf-node-gather-daemonset-rndzb\" (UID: \"6db98b17-8bdb-4103-b5ae-894f21bc4766\") " pod="openshift-must-gather-8d887/perf-node-gather-daemonset-rndzb" Jul 27 12:33:09.515510 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:33:09.515490 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wrdz6\" (UniqueName: \"kubernetes.io/projected/6db98b17-8bdb-4103-b5ae-894f21bc4766-kube-api-access-wrdz6\") pod \"perf-node-gather-daemonset-rndzb\" (UID: \"6db98b17-8bdb-4103-b5ae-894f21bc4766\") " pod="openshift-must-gather-8d887/perf-node-gather-daemonset-rndzb" Jul 27 12:33:09.674604 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:33:09.674526 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8d887/perf-node-gather-daemonset-rndzb" Jul 27 12:33:09.797606 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:33:09.797305 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8d887/perf-node-gather-daemonset-rndzb"] Jul 27 12:33:09.800208 ip-10-0-141-3 kubenswrapper[2568]: W0727 12:33:09.800179 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod6db98b17_8bdb_4103_b5ae_894f21bc4766.slice/crio-7454401b2eda021642f4ef4b6cbd245112a1f642c6a5b96872c27c7cf3b85840 WatchSource:0}: Error finding container 7454401b2eda021642f4ef4b6cbd245112a1f642c6a5b96872c27c7cf3b85840: Status 404 returned error can't find the container with id 7454401b2eda021642f4ef4b6cbd245112a1f642c6a5b96872c27c7cf3b85840 Jul 27 12:33:10.223516 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:33:10.223489 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-wc5br_8be6dd92-30a3-4fa3-83f0-a352c43ae37d/dns/0.log" Jul 27 12:33:10.245774 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:33:10.245748 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-wc5br_8be6dd92-30a3-4fa3-83f0-a352c43ae37d/kube-rbac-proxy/0.log" Jul 27 12:33:10.356793 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:33:10.356767 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-rr46t_bf7a8649-39cb-471e-8d6e-2d55bb3d4e68/dns-node-resolver/0.log" Jul 27 12:33:10.757632 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:33:10.757603 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8d887/perf-node-gather-daemonset-rndzb" event={"ID":"6db98b17-8bdb-4103-b5ae-894f21bc4766","Type":"ContainerStarted","Data":"e5170098c95fa226d307e2717ce5ee6d381e076a671120f414d6f6396972346b"} Jul 27 12:33:10.758035 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:33:10.757649 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8d887/perf-node-gather-daemonset-rndzb" event={"ID":"6db98b17-8bdb-4103-b5ae-894f21bc4766","Type":"ContainerStarted","Data":"7454401b2eda021642f4ef4b6cbd245112a1f642c6a5b96872c27c7cf3b85840"} Jul 27 12:33:10.758035 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:33:10.757745 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-8d887/perf-node-gather-daemonset-rndzb" Jul 27 12:33:10.777022 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:33:10.776984 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-8d887/perf-node-gather-daemonset-rndzb" podStartSLOduration=1.776970706 podStartE2EDuration="1.776970706s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 12:33:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 12:33:10.774888235 +0000 UTC m=+625.178023094" watchObservedRunningTime="2026-07-27 12:33:10.776970706 +0000 UTC m=+625.180105563" Jul 27 12:33:10.825229 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:33:10.825204 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-c6p2s_a80003d1-f5f7-442b-83c9-bba4bd72902a/node-ca/0.log" Jul 27 12:33:11.945660 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:33:11.945636 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-h5sgp_2bfeb1e3-aa75-4b3d-90d8-eef715105e77/serve-healthcheck-canary/0.log" Jul 27 12:33:12.420742 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:33:12.420701 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mdfcs_c421b82e-b61e-4a0f-8a1c-055841ac0e4f/kube-rbac-proxy/0.log" Jul 27 12:33:12.444182 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:33:12.444153 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mdfcs_c421b82e-b61e-4a0f-8a1c-055841ac0e4f/exporter/0.log" Jul 27 12:33:12.471196 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:33:12.471172 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mdfcs_c421b82e-b61e-4a0f-8a1c-055841ac0e4f/extractor/0.log" Jul 27 12:33:14.225273 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:33:14.225242 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-jobset-operator_jobset-controller-manager-84f78cfcb9-f9tpg_f381fb85-6f91-463d-bc33-0319156781cd/manager/0.log" Jul 27 12:33:16.771625 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:33:16.771591 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-8d887/perf-node-gather-daemonset-rndzb" Jul 27 12:33:18.767511 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:33:18.767481 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-22ct8_7bd721fb-fc40-4f80-8ed4-0956b5b5343d/kube-multus/0.log" Jul 27 12:33:18.838332 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:33:18.838310 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bzpr5_5fdb7eea-5a10-47dd-930c-89239b36b74e/kube-multus-additional-cni-plugins/0.log" Jul 27 12:33:18.867408 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:33:18.867386 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bzpr5_5fdb7eea-5a10-47dd-930c-89239b36b74e/egress-router-binary-copy/0.log" Jul 27 12:33:18.891525 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:33:18.891468 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bzpr5_5fdb7eea-5a10-47dd-930c-89239b36b74e/cni-plugins/0.log" Jul 27 12:33:18.923634 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:33:18.923613 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bzpr5_5fdb7eea-5a10-47dd-930c-89239b36b74e/bond-cni-plugin/0.log" Jul 27 12:33:18.947688 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:33:18.947672 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bzpr5_5fdb7eea-5a10-47dd-930c-89239b36b74e/routeoverride-cni/0.log" Jul 27 12:33:18.971905 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:33:18.971887 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bzpr5_5fdb7eea-5a10-47dd-930c-89239b36b74e/whereabouts-cni-bincopy/0.log" Jul 27 12:33:18.994035 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:33:18.994019 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bzpr5_5fdb7eea-5a10-47dd-930c-89239b36b74e/whereabouts-cni/0.log" Jul 27 12:33:19.392532 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:33:19.392507 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-4p2n8_ae5989c7-50c7-40bd-aac4-3383a9a9c435/network-metrics-daemon/0.log" Jul 27 12:33:19.413654 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:33:19.413630 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-4p2n8_ae5989c7-50c7-40bd-aac4-3383a9a9c435/kube-rbac-proxy/0.log" Jul 27 12:33:20.504028 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:33:20.503995 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ktgz9_25263f75-a634-43a0-ba16-79930eda24ae/ovn-controller/0.log" Jul 27 12:33:20.524644 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:33:20.524618 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ktgz9_25263f75-a634-43a0-ba16-79930eda24ae/ovn-acl-logging/0.log" Jul 27 12:33:20.546797 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:33:20.546771 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ktgz9_25263f75-a634-43a0-ba16-79930eda24ae/kube-rbac-proxy-node/0.log" Jul 27 12:33:20.567814 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:33:20.567791 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ktgz9_25263f75-a634-43a0-ba16-79930eda24ae/kube-rbac-proxy-ovn-metrics/0.log" Jul 27 12:33:20.589938 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:33:20.589922 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ktgz9_25263f75-a634-43a0-ba16-79930eda24ae/northd/0.log" Jul 27 12:33:20.630116 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:33:20.630097 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ktgz9_25263f75-a634-43a0-ba16-79930eda24ae/nbdb/0.log" Jul 27 12:33:20.671569 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:33:20.671546 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ktgz9_25263f75-a634-43a0-ba16-79930eda24ae/sbdb/0.log" Jul 27 12:33:20.709664 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:33:20.709640 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ktgz9_25263f75-a634-43a0-ba16-79930eda24ae/ovnkube-controller/0.log" Jul 27 12:33:21.872096 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:33:21.872063 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-8vcwp_fdfb006f-abc1-4762-9c0b-15b1159e2d8e/network-check-target-container/0.log" Jul 27 12:33:22.852852 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:33:22.852824 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-lx8jr_82bda458-1d5c-44ae-8cd0-def7ee6470c0/iptables-alerter/0.log" Jul 27 12:33:23.567351 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:33:23.567326 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-pfcwv_41b1b110-9819-4966-966f-8fe838132d71/tuned/0.log" Jul 27 12:33:25.266562 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:33:25.266528 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-6748489656-q4w2k_47c5fef3-31cb-4670-9299-9561ecf16099/cluster-samples-operator/0.log" Jul 27 12:33:25.283582 ip-10-0-141-3 kubenswrapper[2568]: I0727 12:33:25.283556 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-6748489656-q4w2k_47c5fef3-31cb-4670-9299-9561ecf16099/cluster-samples-operator-watch/0.log"