Jul 24 13:41:05.212767 ip-10-0-129-93 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 24 13:41:05.212778 ip-10-0-129-93 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 24 13:41:05.212788 ip-10-0-129-93 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 24 13:41:05.213161 ip-10-0-129-93 systemd[1]: Failed to start Kubernetes Kubelet. Jul 24 13:41:15.214661 ip-10-0-129-93 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 24 13:41:15.214678 ip-10-0-129-93 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot ee6692d009fe4ef08af7d282dcf64e7f -- Jul 24 13:43:12.226712 ip-10-0-129-93 systemd[1]: Starting Kubernetes Kubelet... Jul 24 13:43:12.614610 ip-10-0-129-93 kubenswrapper[2578]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 24 13:43:12.614610 ip-10-0-129-93 kubenswrapper[2578]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 24 13:43:12.614610 ip-10-0-129-93 kubenswrapper[2578]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 24 13:43:12.614610 ip-10-0-129-93 kubenswrapper[2578]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 24 13:43:12.614610 ip-10-0-129-93 kubenswrapper[2578]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 24 13:43:12.616535 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.616452 2578 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 24 13:43:12.622983 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.622961 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 24 13:43:12.622983 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.622980 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 24 13:43:12.622983 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.622984 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 24 13:43:12.622983 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.622987 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 24 13:43:12.622983 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.622990 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 24 13:43:12.623169 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.622993 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 24 13:43:12.623169 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.622997 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 24 13:43:12.623169 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.623000 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 24 13:43:12.623169 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.623003 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 24 13:43:12.623169 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.623005 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 24 13:43:12.623169 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.623008 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 24 13:43:12.623169 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.623010 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 24 13:43:12.623169 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.623013 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 24 13:43:12.623169 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.623016 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 24 13:43:12.623169 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.623019 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 24 13:43:12.623169 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.623022 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 24 13:43:12.623169 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.623025 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 24 13:43:12.623169 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.623027 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 24 13:43:12.623169 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.623030 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 24 13:43:12.623169 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.623038 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 24 13:43:12.623169 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.623041 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 24 13:43:12.623169 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.623044 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 24 13:43:12.623169 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.623047 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 24 13:43:12.623169 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.623050 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 24 13:43:12.623169 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.623052 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 24 13:43:12.623700 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.623055 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 24 13:43:12.623700 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.623058 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 24 13:43:12.623700 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.623060 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 24 13:43:12.623700 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.623063 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 24 13:43:12.623700 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.623066 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 24 13:43:12.623700 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.623068 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 24 13:43:12.623700 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.623071 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 24 13:43:12.623700 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.623073 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 24 13:43:12.623700 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.623075 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 24 13:43:12.623700 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.623078 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 24 13:43:12.623700 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.623081 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 24 13:43:12.623700 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.623084 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 24 13:43:12.623700 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.623087 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 24 13:43:12.623700 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.623090 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 24 13:43:12.623700 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.623092 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 24 13:43:12.623700 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.623095 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 24 13:43:12.623700 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.623098 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 24 13:43:12.623700 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.623100 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 24 13:43:12.623700 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.623103 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 24 13:43:12.623700 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.623106 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 24 13:43:12.624195 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.623108 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 24 13:43:12.624195 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.623111 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 24 13:43:12.624195 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.623113 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 24 13:43:12.624195 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.623116 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 24 13:43:12.624195 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.623118 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 24 13:43:12.624195 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.623121 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 24 13:43:12.624195 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.623124 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 24 13:43:12.624195 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.623126 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 24 13:43:12.624195 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.623129 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 24 13:43:12.624195 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.623131 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 24 13:43:12.624195 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.623134 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 24 13:43:12.624195 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.623136 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 24 13:43:12.624195 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.623139 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 24 13:43:12.624195 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.623141 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 24 13:43:12.624195 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.623144 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 24 13:43:12.624195 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.623148 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 24 13:43:12.624195 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.623152 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 24 13:43:12.624195 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.623155 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 24 13:43:12.624195 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.623157 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 24 13:43:12.624195 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.623160 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 24 13:43:12.624703 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.623163 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 24 13:43:12.624703 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.623166 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 24 13:43:12.624703 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.623170 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 24 13:43:12.624703 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.623172 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 24 13:43:12.624703 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.623176 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 24 13:43:12.624703 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.623179 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 24 13:43:12.624703 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.623183 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 24 13:43:12.624703 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.623186 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 24 13:43:12.624703 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.623188 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 24 13:43:12.624703 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.623191 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 24 13:43:12.624703 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.623195 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 24 13:43:12.624703 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.623198 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 24 13:43:12.624703 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.623201 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 24 13:43:12.624703 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.623204 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 24 13:43:12.624703 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.623206 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 24 13:43:12.624703 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.623209 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 24 13:43:12.624703 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.623214 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 24 13:43:12.624703 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.623218 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 24 13:43:12.624703 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.623222 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 24 13:43:12.625228 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.623225 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 24 13:43:12.625228 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.623227 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 24 13:43:12.625228 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.623230 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 24 13:43:12.625228 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.623232 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 24 13:43:12.625228 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.623235 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 24 13:43:12.625228 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.623237 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 24 13:43:12.625228 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.623240 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 24 13:43:12.625228 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.623242 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 24 13:43:12.625228 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.623245 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 24 13:43:12.625228 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.623248 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 24 13:43:12.625228 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.623250 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 24 13:43:12.625228 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.623253 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 24 13:43:12.625228 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.623256 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 24 13:43:12.625228 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.623258 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 24 13:43:12.625228 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.623260 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 24 13:43:12.625228 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624021 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 24 13:43:12.625228 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624028 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 24 13:43:12.625228 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624032 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 24 13:43:12.625228 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624035 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 24 13:43:12.625712 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624038 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 24 13:43:12.625712 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624041 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 24 13:43:12.625712 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624043 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 24 13:43:12.625712 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624046 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 24 13:43:12.625712 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624049 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 24 13:43:12.625712 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624051 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 24 13:43:12.625712 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624054 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 24 13:43:12.625712 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624057 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 24 13:43:12.625712 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624060 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 24 13:43:12.625712 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624063 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 24 13:43:12.625712 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624065 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 24 13:43:12.625712 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624068 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 24 13:43:12.625712 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624070 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 24 13:43:12.625712 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624073 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 24 13:43:12.625712 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624076 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 24 13:43:12.625712 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624078 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 24 13:43:12.625712 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624081 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 24 13:43:12.625712 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624084 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 24 13:43:12.625712 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624086 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 24 13:43:12.626187 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624089 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 24 13:43:12.626187 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624092 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 24 13:43:12.626187 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624094 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 24 13:43:12.626187 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624096 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 24 13:43:12.626187 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624099 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 24 13:43:12.626187 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624102 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 24 13:43:12.626187 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624104 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 24 13:43:12.626187 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624106 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 24 13:43:12.626187 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624109 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 24 13:43:12.626187 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624111 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 24 13:43:12.626187 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624114 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 24 13:43:12.626187 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624117 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 24 13:43:12.626187 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624120 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 24 13:43:12.626187 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624122 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 24 13:43:12.626187 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624125 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 24 13:43:12.626187 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624127 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 24 13:43:12.626187 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624131 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 24 13:43:12.626187 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624135 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 24 13:43:12.626187 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624138 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 24 13:43:12.626671 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624141 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 24 13:43:12.626671 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624144 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 24 13:43:12.626671 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624146 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 24 13:43:12.626671 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624149 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 24 13:43:12.626671 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624151 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 24 13:43:12.626671 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624154 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 24 13:43:12.626671 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624157 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 24 13:43:12.626671 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624159 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 24 13:43:12.626671 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624163 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 24 13:43:12.626671 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624166 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 24 13:43:12.626671 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624168 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 24 13:43:12.626671 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624171 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 24 13:43:12.626671 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624174 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 24 13:43:12.626671 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624177 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 24 13:43:12.626671 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624179 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 24 13:43:12.626671 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624182 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 24 13:43:12.626671 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624184 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 24 13:43:12.626671 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624186 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 24 13:43:12.626671 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624189 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 24 13:43:12.626671 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624192 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 24 13:43:12.627155 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624195 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 24 13:43:12.627155 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624197 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 24 13:43:12.627155 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624200 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 24 13:43:12.627155 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624203 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 24 13:43:12.627155 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624206 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 24 13:43:12.627155 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624209 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 24 13:43:12.627155 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624212 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 24 13:43:12.627155 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624214 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 24 13:43:12.627155 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624217 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 24 13:43:12.627155 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624220 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 24 13:43:12.627155 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624222 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 24 13:43:12.627155 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624225 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 24 13:43:12.627155 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624227 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 24 13:43:12.627155 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624230 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 24 13:43:12.627155 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624233 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 24 13:43:12.627155 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624235 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 24 13:43:12.627155 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624238 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 24 13:43:12.627155 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624240 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 24 13:43:12.627155 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624243 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 24 13:43:12.627155 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624245 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 24 13:43:12.627656 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624248 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 24 13:43:12.627656 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624252 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 24 13:43:12.627656 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624258 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 24 13:43:12.627656 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624262 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 24 13:43:12.627656 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624265 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 24 13:43:12.627656 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624268 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 24 13:43:12.627656 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624271 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 24 13:43:12.627656 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624274 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 24 13:43:12.627656 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624276 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 24 13:43:12.627656 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624279 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 24 13:43:12.627656 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624282 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 24 13:43:12.627656 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624284 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 24 13:43:12.627656 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624287 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 24 13:43:12.627656 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624290 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 24 13:43:12.627656 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624293 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 24 13:43:12.627656 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624295 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 24 13:43:12.627656 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624298 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 24 13:43:12.627656 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624678 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 24 13:43:12.627656 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624683 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 24 13:43:12.628113 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624686 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 24 13:43:12.628113 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624689 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 24 13:43:12.628113 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624691 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 24 13:43:12.628113 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624694 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 24 13:43:12.628113 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624697 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 24 13:43:12.628113 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624699 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 24 13:43:12.628113 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624702 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 24 13:43:12.628113 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624705 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 24 13:43:12.628113 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624708 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 24 13:43:12.628113 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624710 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 24 13:43:12.628113 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624713 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 24 13:43:12.628113 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624716 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 24 13:43:12.628113 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624719 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 24 13:43:12.628113 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624723 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 24 13:43:12.628113 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624728 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 24 13:43:12.628113 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624731 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 24 13:43:12.628113 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624734 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 24 13:43:12.628113 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624737 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 24 13:43:12.628113 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624742 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 24 13:43:12.628625 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624745 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 24 13:43:12.628625 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624747 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 24 13:43:12.628625 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624750 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 24 13:43:12.628625 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624753 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 24 13:43:12.628625 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624756 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 24 13:43:12.628625 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624758 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 24 13:43:12.628625 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624761 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 24 13:43:12.628625 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624763 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 24 13:43:12.628625 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624766 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 24 13:43:12.628625 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624769 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 24 13:43:12.628625 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624771 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 24 13:43:12.628625 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624774 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 24 13:43:12.628625 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624784 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 24 13:43:12.628625 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624787 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 24 13:43:12.628625 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624789 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 24 13:43:12.628625 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624792 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 24 13:43:12.628625 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624794 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 24 13:43:12.628625 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624797 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 24 13:43:12.628625 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624800 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 24 13:43:12.628625 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624802 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 24 13:43:12.629100 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624805 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 24 13:43:12.629100 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624807 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 24 13:43:12.629100 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624810 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 24 13:43:12.629100 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624813 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 24 13:43:12.629100 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624815 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 24 13:43:12.629100 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624817 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 24 13:43:12.629100 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624820 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 24 13:43:12.629100 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624824 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 24 13:43:12.629100 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624827 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 24 13:43:12.629100 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624830 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 24 13:43:12.629100 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624833 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 24 13:43:12.629100 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624837 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 24 13:43:12.629100 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624839 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 24 13:43:12.629100 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624841 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 24 13:43:12.629100 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624844 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 24 13:43:12.629100 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624847 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 24 13:43:12.629100 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624849 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 24 13:43:12.629100 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624852 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 24 13:43:12.629100 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624854 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 24 13:43:12.629100 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624857 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 24 13:43:12.629601 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624860 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 24 13:43:12.629601 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624862 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 24 13:43:12.629601 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624865 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 24 13:43:12.629601 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624867 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 24 13:43:12.629601 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624870 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 24 13:43:12.629601 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624872 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 24 13:43:12.629601 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624875 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 24 13:43:12.629601 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624877 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 24 13:43:12.629601 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624880 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 24 13:43:12.629601 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624884 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 24 13:43:12.629601 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624886 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 24 13:43:12.629601 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624889 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 24 13:43:12.629601 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624891 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 24 13:43:12.629601 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624894 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 24 13:43:12.629601 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624896 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 24 13:43:12.629601 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624899 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 24 13:43:12.629601 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624901 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 24 13:43:12.629601 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624904 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 24 13:43:12.629601 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624906 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 24 13:43:12.629601 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624910 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 24 13:43:12.630127 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624913 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 24 13:43:12.630127 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624915 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 24 13:43:12.630127 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624918 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 24 13:43:12.630127 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624922 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 24 13:43:12.630127 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624926 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 24 13:43:12.630127 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624930 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 24 13:43:12.630127 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624932 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 24 13:43:12.630127 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624935 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 24 13:43:12.630127 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624938 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 24 13:43:12.630127 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624941 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 24 13:43:12.630127 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624944 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 24 13:43:12.630127 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624946 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 24 13:43:12.630127 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624949 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 24 13:43:12.630127 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624953 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 24 13:43:12.630127 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624956 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 24 13:43:12.630127 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624959 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 24 13:43:12.630127 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624962 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 24 13:43:12.630127 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.624965 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 24 13:43:12.630127 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.625033 2578 flags.go:64] FLAG: --address="0.0.0.0" Jul 24 13:43:12.630603 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.625040 2578 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 24 13:43:12.630603 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.625046 2578 flags.go:64] FLAG: --anonymous-auth="true" Jul 24 13:43:12.630603 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.625050 2578 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 24 13:43:12.630603 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.625054 2578 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 24 13:43:12.630603 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.625057 2578 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 24 13:43:12.630603 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.625061 2578 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 24 13:43:12.630603 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.625065 2578 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 24 13:43:12.630603 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.625068 2578 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 24 13:43:12.630603 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.625071 2578 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 24 13:43:12.630603 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.625075 2578 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 24 13:43:12.630603 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.625078 2578 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 24 13:43:12.630603 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.625081 2578 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 24 13:43:12.630603 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.625088 2578 flags.go:64] FLAG: --cgroup-root="" Jul 24 13:43:12.630603 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.625091 2578 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 24 13:43:12.630603 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.625094 2578 flags.go:64] FLAG: --client-ca-file="" Jul 24 13:43:12.630603 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.625097 2578 flags.go:64] FLAG: --cloud-provider="external" Jul 24 13:43:12.630603 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.625101 2578 flags.go:64] FLAG: --cluster-dns="[]" Jul 24 13:43:12.630603 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.625106 2578 flags.go:64] FLAG: --cluster-domain="" Jul 24 13:43:12.630603 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.625109 2578 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 24 13:43:12.630603 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.625112 2578 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 24 13:43:12.630603 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.625115 2578 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 24 13:43:12.630603 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.625118 2578 flags.go:64] FLAG: --container-log-max-files="5" Jul 24 13:43:12.630603 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.625121 2578 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 24 13:43:12.630603 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.625124 2578 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 24 13:43:12.631159 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.625127 2578 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 24 13:43:12.631159 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.625131 2578 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 24 13:43:12.631159 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.625134 2578 flags.go:64] FLAG: --contention-profiling="false" Jul 24 13:43:12.631159 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.625137 2578 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 24 13:43:12.631159 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.625140 2578 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 24 13:43:12.631159 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.625142 2578 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 24 13:43:12.631159 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.625145 2578 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 24 13:43:12.631159 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.625149 2578 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 24 13:43:12.631159 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.625152 2578 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 24 13:43:12.631159 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.625155 2578 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 24 13:43:12.631159 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.625158 2578 flags.go:64] FLAG: --enable-load-reader="false" Jul 24 13:43:12.631159 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.625161 2578 flags.go:64] FLAG: --enable-server="true" Jul 24 13:43:12.631159 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.625164 2578 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 24 13:43:12.631159 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.625168 2578 flags.go:64] FLAG: --event-burst="100" Jul 24 13:43:12.631159 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.625171 2578 flags.go:64] FLAG: --event-qps="50" Jul 24 13:43:12.631159 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.625174 2578 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 24 13:43:12.631159 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.625177 2578 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 24 13:43:12.631159 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.625180 2578 flags.go:64] FLAG: --eviction-hard="" Jul 24 13:43:12.631159 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.625183 2578 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 24 13:43:12.631159 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.625186 2578 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 24 13:43:12.631159 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.625191 2578 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 24 13:43:12.631159 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.625194 2578 flags.go:64] FLAG: --eviction-soft="" Jul 24 13:43:12.631159 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.625197 2578 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 24 13:43:12.631159 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.625199 2578 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 24 13:43:12.631159 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.625204 2578 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 24 13:43:12.631790 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.625207 2578 flags.go:64] FLAG: --experimental-mounter-path="" Jul 24 13:43:12.631790 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.625210 2578 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 24 13:43:12.631790 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.625213 2578 flags.go:64] FLAG: --fail-swap-on="true" Jul 24 13:43:12.631790 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.625216 2578 flags.go:64] FLAG: --feature-gates="" Jul 24 13:43:12.631790 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.625220 2578 flags.go:64] FLAG: --file-check-frequency="20s" Jul 24 13:43:12.631790 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.625223 2578 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 24 13:43:12.631790 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.625226 2578 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 24 13:43:12.631790 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.625230 2578 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 24 13:43:12.631790 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.625233 2578 flags.go:64] FLAG: --healthz-port="10248" Jul 24 13:43:12.631790 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.625236 2578 flags.go:64] FLAG: --help="false" Jul 24 13:43:12.631790 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.625239 2578 flags.go:64] FLAG: --hostname-override="ip-10-0-129-93.ec2.internal" Jul 24 13:43:12.631790 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.625242 2578 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 24 13:43:12.631790 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.625245 2578 flags.go:64] FLAG: --http-check-frequency="20s" Jul 24 13:43:12.631790 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.625248 2578 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 24 13:43:12.631790 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.625251 2578 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 24 13:43:12.631790 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.625255 2578 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 24 13:43:12.631790 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.625258 2578 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 24 13:43:12.631790 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.625261 2578 flags.go:64] FLAG: --image-service-endpoint="" Jul 24 13:43:12.631790 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.625263 2578 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 24 13:43:12.631790 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.625266 2578 flags.go:64] FLAG: --kube-api-burst="100" Jul 24 13:43:12.631790 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.625269 2578 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 24 13:43:12.631790 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.625272 2578 flags.go:64] FLAG: --kube-api-qps="50" Jul 24 13:43:12.631790 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.625275 2578 flags.go:64] FLAG: --kube-reserved="" Jul 24 13:43:12.631790 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.625278 2578 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 24 13:43:12.632373 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.625281 2578 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 24 13:43:12.632373 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.625283 2578 flags.go:64] FLAG: --kubelet-cgroups="" Jul 24 13:43:12.632373 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.625286 2578 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 24 13:43:12.632373 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.625290 2578 flags.go:64] FLAG: --lock-file="" Jul 24 13:43:12.632373 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.625293 2578 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 24 13:43:12.632373 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.625296 2578 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 24 13:43:12.632373 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.625299 2578 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 24 13:43:12.632373 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.625305 2578 flags.go:64] FLAG: --log-json-split-stream="false" Jul 24 13:43:12.632373 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.625308 2578 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 24 13:43:12.632373 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.625311 2578 flags.go:64] FLAG: --log-text-split-stream="false" Jul 24 13:43:12.632373 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.625314 2578 flags.go:64] FLAG: --logging-format="text" Jul 24 13:43:12.632373 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.625317 2578 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 24 13:43:12.632373 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.625320 2578 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 24 13:43:12.632373 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.625323 2578 flags.go:64] FLAG: --manifest-url="" Jul 24 13:43:12.632373 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.625326 2578 flags.go:64] FLAG: --manifest-url-header="" Jul 24 13:43:12.632373 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.625330 2578 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 24 13:43:12.632373 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.625333 2578 flags.go:64] FLAG: --max-open-files="1000000" Jul 24 13:43:12.632373 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.625337 2578 flags.go:64] FLAG: --max-pods="110" Jul 24 13:43:12.632373 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.625339 2578 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 24 13:43:12.632373 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.625342 2578 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 24 13:43:12.632373 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.625345 2578 flags.go:64] FLAG: --memory-manager-policy="None" Jul 24 13:43:12.632373 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.625348 2578 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 24 13:43:12.632373 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.625351 2578 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 24 13:43:12.632373 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.625354 2578 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 24 13:43:12.632373 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.625357 2578 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 24 13:43:12.633004 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.625364 2578 flags.go:64] FLAG: --node-status-max-images="50" Jul 24 13:43:12.633004 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.625367 2578 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 24 13:43:12.633004 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.625370 2578 flags.go:64] FLAG: --oom-score-adj="-999" Jul 24 13:43:12.633004 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.625373 2578 flags.go:64] FLAG: --pod-cidr="" Jul 24 13:43:12.633004 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.625375 2578 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb" Jul 24 13:43:12.633004 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.625381 2578 flags.go:64] FLAG: --pod-manifest-path="" Jul 24 13:43:12.633004 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.625384 2578 flags.go:64] FLAG: --pod-max-pids="-1" Jul 24 13:43:12.633004 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.625387 2578 flags.go:64] FLAG: --pods-per-core="0" Jul 24 13:43:12.633004 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.625390 2578 flags.go:64] FLAG: --port="10250" Jul 24 13:43:12.633004 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.625393 2578 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 24 13:43:12.633004 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.625396 2578 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0a58800c050231d71" Jul 24 13:43:12.633004 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.625399 2578 flags.go:64] FLAG: --qos-reserved="" Jul 24 13:43:12.633004 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.625415 2578 flags.go:64] FLAG: --read-only-port="10255" Jul 24 13:43:12.633004 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.625419 2578 flags.go:64] FLAG: --register-node="true" Jul 24 13:43:12.633004 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.625422 2578 flags.go:64] FLAG: --register-with-taints="" Jul 24 13:43:12.633004 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.625431 2578 flags.go:64] FLAG: --registry-burst="10" Jul 24 13:43:12.633004 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.625435 2578 flags.go:64] FLAG: --registry-qps="5" Jul 24 13:43:12.633004 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.625438 2578 flags.go:64] FLAG: --reserved-cpus="" Jul 24 13:43:12.633004 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.625441 2578 flags.go:64] FLAG: --reserved-memory="" Jul 24 13:43:12.633004 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.625444 2578 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 24 13:43:12.633004 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.625447 2578 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 24 13:43:12.633004 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.625450 2578 flags.go:64] FLAG: --rotate-certificates="false" Jul 24 13:43:12.633004 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.625453 2578 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 24 13:43:12.633004 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.625456 2578 flags.go:64] FLAG: --runonce="false" Jul 24 13:43:12.633004 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.625459 2578 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 24 13:43:12.633712 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.625462 2578 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 24 13:43:12.633712 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.625465 2578 flags.go:64] FLAG: --seccomp-default="false" Jul 24 13:43:12.633712 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.625467 2578 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 24 13:43:12.633712 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.625470 2578 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 24 13:43:12.633712 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.625473 2578 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 24 13:43:12.633712 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.625476 2578 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 24 13:43:12.633712 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.625479 2578 flags.go:64] FLAG: --storage-driver-password="root" Jul 24 13:43:12.633712 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.625482 2578 flags.go:64] FLAG: --storage-driver-secure="false" Jul 24 13:43:12.633712 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.625485 2578 flags.go:64] FLAG: --storage-driver-table="stats" Jul 24 13:43:12.633712 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.625488 2578 flags.go:64] FLAG: --storage-driver-user="root" Jul 24 13:43:12.633712 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.625490 2578 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 24 13:43:12.633712 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.625493 2578 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 24 13:43:12.633712 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.625496 2578 flags.go:64] FLAG: --system-cgroups="" Jul 24 13:43:12.633712 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.625499 2578 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 24 13:43:12.633712 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.625504 2578 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 24 13:43:12.633712 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.625507 2578 flags.go:64] FLAG: --tls-cert-file="" Jul 24 13:43:12.633712 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.625510 2578 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 24 13:43:12.633712 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.625514 2578 flags.go:64] FLAG: --tls-min-version="" Jul 24 13:43:12.633712 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.625517 2578 flags.go:64] FLAG: --tls-private-key-file="" Jul 24 13:43:12.633712 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.625520 2578 flags.go:64] FLAG: --topology-manager-policy="none" Jul 24 13:43:12.633712 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.625523 2578 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 24 13:43:12.633712 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.625525 2578 flags.go:64] FLAG: --topology-manager-scope="container" Jul 24 13:43:12.633712 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.625529 2578 flags.go:64] FLAG: --v="2" Jul 24 13:43:12.633712 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.625533 2578 flags.go:64] FLAG: --version="false" Jul 24 13:43:12.633712 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.625538 2578 flags.go:64] FLAG: --vmodule="" Jul 24 13:43:12.634342 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.625541 2578 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 24 13:43:12.634342 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.625544 2578 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 24 13:43:12.634342 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.625654 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 24 13:43:12.634342 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.625658 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 24 13:43:12.634342 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.625661 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 24 13:43:12.634342 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.625664 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 24 13:43:12.634342 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.625667 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 24 13:43:12.634342 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.625669 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 24 13:43:12.634342 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.625672 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 24 13:43:12.634342 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.625674 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 24 13:43:12.634342 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.625677 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 24 13:43:12.634342 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.625680 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 24 13:43:12.634342 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.625683 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 24 13:43:12.634342 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.625685 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 24 13:43:12.634342 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.625688 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 24 13:43:12.634342 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.625691 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 24 13:43:12.634342 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.625694 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 24 13:43:12.634342 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.625697 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 24 13:43:12.634342 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.625699 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 24 13:43:12.634342 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.625702 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 24 13:43:12.634849 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.625704 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 24 13:43:12.634849 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.625707 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 24 13:43:12.634849 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.625709 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 24 13:43:12.634849 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.625712 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 24 13:43:12.634849 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.625714 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 24 13:43:12.634849 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.625717 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 24 13:43:12.634849 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.625720 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 24 13:43:12.634849 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.625722 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 24 13:43:12.634849 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.625725 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 24 13:43:12.634849 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.625729 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 24 13:43:12.634849 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.625732 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 24 13:43:12.634849 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.625734 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 24 13:43:12.634849 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.625737 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 24 13:43:12.634849 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.625740 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 24 13:43:12.634849 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.625743 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 24 13:43:12.634849 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.625745 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 24 13:43:12.634849 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.625748 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 24 13:43:12.634849 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.625750 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 24 13:43:12.634849 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.625753 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 24 13:43:12.634849 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.625755 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 24 13:43:12.635337 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.625760 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 24 13:43:12.635337 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.625763 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 24 13:43:12.635337 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.625766 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 24 13:43:12.635337 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.625769 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 24 13:43:12.635337 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.625772 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 24 13:43:12.635337 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.625775 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 24 13:43:12.635337 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.625778 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 24 13:43:12.635337 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.625780 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 24 13:43:12.635337 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.625783 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 24 13:43:12.635337 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.625785 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 24 13:43:12.635337 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.625788 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 24 13:43:12.635337 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.625791 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 24 13:43:12.635337 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.625793 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 24 13:43:12.635337 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.625796 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 24 13:43:12.635337 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.625798 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 24 13:43:12.635337 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.625802 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 24 13:43:12.635337 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.625805 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 24 13:43:12.635337 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.625807 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 24 13:43:12.635337 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.625810 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 24 13:43:12.635813 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.625813 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 24 13:43:12.635813 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.625815 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 24 13:43:12.635813 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.625819 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 24 13:43:12.635813 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.625821 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 24 13:43:12.635813 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.625824 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 24 13:43:12.635813 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.625827 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 24 13:43:12.635813 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.625830 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 24 13:43:12.635813 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.625833 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 24 13:43:12.635813 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.625835 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 24 13:43:12.635813 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.625838 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 24 13:43:12.635813 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.625841 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 24 13:43:12.635813 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.625843 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 24 13:43:12.635813 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.625846 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 24 13:43:12.635813 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.625848 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 24 13:43:12.635813 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.625851 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 24 13:43:12.635813 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.625853 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 24 13:43:12.635813 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.625856 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 24 13:43:12.635813 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.625858 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 24 13:43:12.635813 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.625860 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 24 13:43:12.635813 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.625863 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 24 13:43:12.636291 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.625865 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 24 13:43:12.636291 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.625868 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 24 13:43:12.636291 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.625870 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 24 13:43:12.636291 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.625873 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 24 13:43:12.636291 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.625875 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 24 13:43:12.636291 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.625878 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 24 13:43:12.636291 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.625881 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 24 13:43:12.636291 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.625885 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 24 13:43:12.636291 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.625890 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 24 13:43:12.636291 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.625893 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 24 13:43:12.636291 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.625895 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 24 13:43:12.636291 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.625898 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 24 13:43:12.636291 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.625900 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 24 13:43:12.636291 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.625902 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 24 13:43:12.636291 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.625906 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 24 13:43:12.636291 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.625909 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 24 13:43:12.636291 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.625913 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 24 13:43:12.636291 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.625916 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 24 13:43:12.636291 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.625919 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 24 13:43:12.636770 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.625922 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 24 13:43:12.636770 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.625925 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 24 13:43:12.636770 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.625928 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 24 13:43:12.636770 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.626619 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 24 13:43:12.636770 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.633180 2578 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 24 13:43:12.636770 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.633197 2578 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 24 13:43:12.636770 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.634015 2578 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 24 13:43:12.636770 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.634022 2578 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 24 13:43:12.636770 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634080 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 24 13:43:12.636770 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634086 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 24 13:43:12.636770 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634089 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 24 13:43:12.636770 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634092 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 24 13:43:12.636770 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634095 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 24 13:43:12.636770 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634097 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 24 13:43:12.636770 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634100 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 24 13:43:12.637148 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634103 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 24 13:43:12.637148 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634105 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 24 13:43:12.637148 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634108 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 24 13:43:12.637148 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634110 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 24 13:43:12.637148 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634113 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 24 13:43:12.637148 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634116 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 24 13:43:12.637148 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634119 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 24 13:43:12.637148 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634121 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 24 13:43:12.637148 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634124 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 24 13:43:12.637148 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634127 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 24 13:43:12.637148 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634130 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 24 13:43:12.637148 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634132 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 24 13:43:12.637148 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634135 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 24 13:43:12.637148 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634137 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 24 13:43:12.637148 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634140 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 24 13:43:12.637148 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634142 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 24 13:43:12.637148 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634145 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 24 13:43:12.637148 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634147 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 24 13:43:12.637148 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634150 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 24 13:43:12.637148 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634153 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 24 13:43:12.637636 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634156 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 24 13:43:12.637636 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634159 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 24 13:43:12.637636 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634162 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 24 13:43:12.637636 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634165 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 24 13:43:12.637636 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634167 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 24 13:43:12.637636 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634170 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 24 13:43:12.637636 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634173 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 24 13:43:12.637636 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634175 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 24 13:43:12.637636 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634178 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 24 13:43:12.637636 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634180 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 24 13:43:12.637636 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634183 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 24 13:43:12.637636 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634186 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 24 13:43:12.637636 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634190 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 24 13:43:12.637636 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634193 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 24 13:43:12.637636 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634196 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 24 13:43:12.637636 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634199 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 24 13:43:12.637636 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634202 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 24 13:43:12.637636 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634205 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 24 13:43:12.637636 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634208 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 24 13:43:12.637636 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634211 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 24 13:43:12.638109 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634221 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 24 13:43:12.638109 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634224 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 24 13:43:12.638109 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634227 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 24 13:43:12.638109 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634230 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 24 13:43:12.638109 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634232 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 24 13:43:12.638109 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634235 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 24 13:43:12.638109 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634238 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 24 13:43:12.638109 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634240 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 24 13:43:12.638109 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634243 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 24 13:43:12.638109 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634246 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 24 13:43:12.638109 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634248 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 24 13:43:12.638109 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634252 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 24 13:43:12.638109 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634255 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 24 13:43:12.638109 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634258 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 24 13:43:12.638109 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634261 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 24 13:43:12.638109 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634265 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 24 13:43:12.638109 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634268 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 24 13:43:12.638109 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634271 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 24 13:43:12.638109 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634273 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 24 13:43:12.638605 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634276 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 24 13:43:12.638605 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634278 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 24 13:43:12.638605 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634281 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 24 13:43:12.638605 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634283 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 24 13:43:12.638605 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634286 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 24 13:43:12.638605 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634288 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 24 13:43:12.638605 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634291 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 24 13:43:12.638605 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634293 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 24 13:43:12.638605 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634296 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 24 13:43:12.638605 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634298 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 24 13:43:12.638605 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634301 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 24 13:43:12.638605 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634303 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 24 13:43:12.638605 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634305 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 24 13:43:12.638605 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634308 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 24 13:43:12.638605 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634311 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 24 13:43:12.638605 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634313 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 24 13:43:12.638605 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634316 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 24 13:43:12.638605 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634318 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 24 13:43:12.638605 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634321 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 24 13:43:12.638605 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634323 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 24 13:43:12.639091 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634326 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 24 13:43:12.639091 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634328 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 24 13:43:12.639091 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634331 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 24 13:43:12.639091 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634333 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 24 13:43:12.639091 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634336 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 24 13:43:12.639091 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634338 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 24 13:43:12.639091 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634341 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 24 13:43:12.639091 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634346 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 24 13:43:12.639091 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634349 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 24 13:43:12.639091 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634353 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 24 13:43:12.639091 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634356 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 24 13:43:12.639091 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634360 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 24 13:43:12.639091 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634363 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 24 13:43:12.639091 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.634368 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 24 13:43:12.639451 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634519 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 24 13:43:12.639451 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634524 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 24 13:43:12.639451 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634528 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 24 13:43:12.639451 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634531 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 24 13:43:12.639451 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634534 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 24 13:43:12.639451 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634537 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 24 13:43:12.639451 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634539 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 24 13:43:12.639451 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634542 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 24 13:43:12.639451 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634545 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 24 13:43:12.639451 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634547 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 24 13:43:12.639451 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634550 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 24 13:43:12.639451 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634552 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 24 13:43:12.639451 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634555 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 24 13:43:12.639451 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634558 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 24 13:43:12.639451 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634560 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 24 13:43:12.639451 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634563 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 24 13:43:12.639451 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634565 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 24 13:43:12.639451 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634568 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 24 13:43:12.639451 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634570 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 24 13:43:12.639451 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634573 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 24 13:43:12.639921 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634575 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 24 13:43:12.639921 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634579 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 24 13:43:12.639921 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634583 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 24 13:43:12.639921 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634586 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 24 13:43:12.639921 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634590 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 24 13:43:12.639921 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634593 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 24 13:43:12.639921 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634596 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 24 13:43:12.639921 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634599 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 24 13:43:12.639921 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634602 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 24 13:43:12.639921 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634605 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 24 13:43:12.639921 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634607 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 24 13:43:12.639921 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634610 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 24 13:43:12.639921 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634612 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 24 13:43:12.639921 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634615 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 24 13:43:12.639921 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634618 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 24 13:43:12.639921 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634620 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 24 13:43:12.639921 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634623 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 24 13:43:12.639921 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634625 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 24 13:43:12.639921 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634628 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 24 13:43:12.640377 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634630 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 24 13:43:12.640377 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634632 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 24 13:43:12.640377 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634635 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 24 13:43:12.640377 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634637 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 24 13:43:12.640377 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634640 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 24 13:43:12.640377 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634642 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 24 13:43:12.640377 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634645 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 24 13:43:12.640377 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634647 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 24 13:43:12.640377 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634650 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 24 13:43:12.640377 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634653 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 24 13:43:12.640377 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634655 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 24 13:43:12.640377 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634658 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 24 13:43:12.640377 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634660 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 24 13:43:12.640377 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634662 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 24 13:43:12.640377 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634665 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 24 13:43:12.640377 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634667 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 24 13:43:12.640377 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634670 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 24 13:43:12.640377 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634672 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 24 13:43:12.640377 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634675 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 24 13:43:12.640377 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634677 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 24 13:43:12.640876 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634680 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 24 13:43:12.640876 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634682 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 24 13:43:12.640876 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634686 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 24 13:43:12.640876 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634688 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 24 13:43:12.640876 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634691 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 24 13:43:12.640876 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634693 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 24 13:43:12.640876 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634695 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 24 13:43:12.640876 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634698 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 24 13:43:12.640876 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634702 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 24 13:43:12.640876 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634705 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 24 13:43:12.640876 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634707 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 24 13:43:12.640876 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634710 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 24 13:43:12.640876 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634712 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 24 13:43:12.640876 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634714 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 24 13:43:12.640876 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634717 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 24 13:43:12.640876 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634719 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 24 13:43:12.640876 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634722 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 24 13:43:12.640876 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634724 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 24 13:43:12.640876 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634727 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 24 13:43:12.641336 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634729 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 24 13:43:12.641336 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634732 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 24 13:43:12.641336 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634734 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 24 13:43:12.641336 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634736 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 24 13:43:12.641336 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634739 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 24 13:43:12.641336 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634741 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 24 13:43:12.641336 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634744 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 24 13:43:12.641336 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634746 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 24 13:43:12.641336 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634748 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 24 13:43:12.641336 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634751 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 24 13:43:12.641336 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634753 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 24 13:43:12.641336 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634757 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 24 13:43:12.641336 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634761 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 24 13:43:12.641336 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634763 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 24 13:43:12.641336 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634767 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 24 13:43:12.641336 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634769 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 24 13:43:12.641336 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634773 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 24 13:43:12.641336 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634775 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 24 13:43:12.641336 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634779 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 24 13:43:12.642205 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634781 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 24 13:43:12.642205 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:12.634784 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 24 13:43:12.642205 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.634788 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 24 13:43:12.642205 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.634888 2578 server.go:962] "Client rotation is on, will bootstrap in background" Jul 24 13:43:12.642205 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.636876 2578 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 24 13:43:12.642205 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.638167 2578 server.go:1019] "Starting client certificate rotation" Jul 24 13:43:12.642205 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.638265 2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 24 13:43:12.642205 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.638333 2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 24 13:43:12.642205 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.640606 2578 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 24 13:43:12.645295 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.645275 2578 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 24 13:43:12.656014 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.655992 2578 log.go:25] "Validated CRI v1 runtime API" Jul 24 13:43:12.658333 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.658320 2578 log.go:25] "Validated CRI v1 image API" Jul 24 13:43:12.659166 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.659152 2578 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 24 13:43:12.664434 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.664400 2578 fs.go:135] Filesystem UUIDs: map[29d3c2d4-f46f-458f-9cfd-0a3fe68ecacd:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 ba4eb113-4fc8-423d-98bf-ac819a652025:/dev/nvme0n1p4] Jul 24 13:43:12.664504 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.664432 2578 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 24 13:43:12.666791 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.666775 2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 24 13:43:12.670088 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.669989 2578 manager.go:216] Machine: {Timestamp:2026-07-24 13:43:12.668558909 +0000 UTC m=+0.326536291 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100113 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2dba2711bd527bb124ad3068726bbc SystemUUID:ec2dba27-11bd-527b-b124-ad3068726bbc BootID:ee6692d0-09fe-4ef0-8af7-d282dcf64e7f Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:5c:7e:a3:b6:4f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:5c:7e:a3:b6:4f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:26:3f:00:b2:bb:49 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 24 13:43:12.670088 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.670087 2578 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 24 13:43:12.670222 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.670186 2578 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 24 13:43:12.673469 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.673444 2578 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 24 13:43:12.673594 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.673471 2578 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-129-93.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 24 13:43:12.674149 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.674140 2578 topology_manager.go:138] "Creating topology manager with none policy" Jul 24 13:43:12.674186 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.674151 2578 container_manager_linux.go:309] "Creating device plugin manager" Jul 24 13:43:12.674186 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.674158 2578 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 24 13:43:12.674908 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.674897 2578 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 24 13:43:12.676031 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.676021 2578 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 24 13:43:12.678963 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.678951 2578 state_mem.go:36] "Initialized new in-memory state store" Jul 24 13:43:12.679064 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.679055 2578 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 24 13:43:12.679109 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.679084 2578 kubelet.go:486] "Attempting to sync node with API server" Jul 24 13:43:12.679109 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.679093 2578 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 24 13:43:12.679109 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.679107 2578 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 24 13:43:12.679220 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.679116 2578 kubelet.go:398] "Adding apiserver pod source" Jul 24 13:43:12.679220 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.679125 2578 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 24 13:43:12.679454 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.679442 2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 24 13:43:12.679493 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.679466 2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 24 13:43:12.682016 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.682001 2578 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 24 13:43:12.683736 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.683721 2578 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 24 13:43:12.683791 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.683752 2578 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 24 13:43:12.685938 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.685922 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 24 13:43:12.686003 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.685950 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 24 13:43:12.686003 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.685962 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 24 13:43:12.686003 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.685971 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 24 13:43:12.686003 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.685984 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 24 13:43:12.686003 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.685993 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 24 13:43:12.686205 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.686005 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 24 13:43:12.686205 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.686014 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 24 13:43:12.686205 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.686022 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 24 13:43:12.686205 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.686031 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 24 13:43:12.686205 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.686042 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 24 13:43:12.686205 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.686050 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 24 13:43:12.686878 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.686866 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 24 13:43:12.686878 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.686878 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 24 13:43:12.689840 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.689819 2578 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-129-93.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 24 13:43:12.689915 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:43:12.689848 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 24 13:43:12.689915 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:43:12.689879 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-129-93.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 24 13:43:12.689915 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.689891 2578 server.go:1268] "Started kubelet" Jul 24 13:43:12.690079 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.689916 2578 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 24 13:43:12.690079 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.689979 2578 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 24 13:43:12.694219 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.689965 2578 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 24 13:43:12.694928 ip-10-0-129-93 systemd[1]: Started Kubernetes Kubelet. Jul 24 13:43:12.697194 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.696173 2578 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 24 13:43:12.697941 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.697916 2578 server.go:310] "Adding debug handlers to kubelet server" Jul 24 13:43:12.699822 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:43:12.699806 2578 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 24 13:43:12.705057 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.705043 2578 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 24 13:43:12.705137 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.705099 2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 24 13:43:12.705137 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:43:12.705121 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-93.ec2.internal\" not found" Jul 24 13:43:12.705800 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.705781 2578 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 24 13:43:12.705800 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.705784 2578 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 24 13:43:12.705800 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.705811 2578 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 24 13:43:12.706000 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.705833 2578 factory.go:55] Registering systemd factory Jul 24 13:43:12.706000 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.705846 2578 factory.go:223] Registration of the systemd container factory successfully Jul 24 13:43:12.706000 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.705953 2578 reconstruct.go:97] "Volume reconstruction finished" Jul 24 13:43:12.706000 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.705961 2578 reconciler.go:29] "Reconciler: start to sync state" Jul 24 13:43:12.706179 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.706030 2578 factory.go:153] Registering CRI-O factory Jul 24 13:43:12.706179 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.706044 2578 factory.go:223] Registration of the crio container factory successfully Jul 24 13:43:12.706179 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.706096 2578 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 24 13:43:12.706179 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.706117 2578 factory.go:103] Registering Raw factory Jul 24 13:43:12.706179 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.706129 2578 manager.go:1196] Started watching for new ooms in manager Jul 24 13:43:12.706581 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.706567 2578 manager.go:349] Starting recovery of all containers Jul 24 13:43:12.707850 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:43:12.707826 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 24 13:43:12.707947 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:43:12.707880 2578 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-129-93.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 24 13:43:12.709706 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:43:12.707498 2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-93.ec2.internal.18c53da1daa9e84a default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-93.ec2.internal,UID:ip-10-0-129-93.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-129-93.ec2.internal,},FirstTimestamp:2026-07-24 13:43:12.689866826 +0000 UTC m=+0.347844202,LastTimestamp:2026-07-24 13:43:12.689866826 +0000 UTC m=+0.347844202,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-93.ec2.internal,}" Jul 24 13:43:12.717959 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.717941 2578 manager.go:354] Recovery completed Jul 24 13:43:12.722925 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.722910 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 24 13:43:12.724913 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.724884 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-93.ec2.internal" event="NodeHasSufficientMemory" Jul 24 13:43:12.724985 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.724930 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-93.ec2.internal" event="NodeHasNoDiskPressure" Jul 24 13:43:12.724985 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.724944 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-93.ec2.internal" event="NodeHasSufficientPID" Jul 24 13:43:12.725576 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.725560 2578 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 24 13:43:12.725576 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.725574 2578 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 24 13:43:12.725576 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.725589 2578 state_mem.go:36] "Initialized new in-memory state store" Jul 24 13:43:12.725742 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.725594 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 24 13:43:12.726319 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.726301 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-93.ec2.internal" event="NodeHasSufficientMemory" Jul 24 13:43:12.726377 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.726331 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-93.ec2.internal" event="NodeHasNoDiskPressure" Jul 24 13:43:12.726377 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.726342 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-93.ec2.internal" event="NodeHasSufficientPID" Jul 24 13:43:12.727578 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.727565 2578 policy_none.go:49] "None policy: Start" Jul 24 13:43:12.727630 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.727581 2578 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 24 13:43:12.727630 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.727593 2578 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 24 13:43:12.728602 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.728591 2578 policy_none.go:47] "Start" Jul 24 13:43:12.735960 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:43:12.735881 2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-93.ec2.internal.18c53da1dcc0b40c default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-93.ec2.internal,UID:ip-10-0-129-93.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-129-93.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-129-93.ec2.internal,},FirstTimestamp:2026-07-24 13:43:12.724915212 +0000 UTC m=+0.382892594,LastTimestamp:2026-07-24 13:43:12.724915212 +0000 UTC m=+0.382892594,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-93.ec2.internal,}" Jul 24 13:43:12.748366 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:43:12.748190 2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-93.ec2.internal.18c53da1dcc10854 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-93.ec2.internal,UID:ip-10-0-129-93.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-129-93.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-129-93.ec2.internal,},FirstTimestamp:2026-07-24 13:43:12.724936788 +0000 UTC m=+0.382914167,LastTimestamp:2026-07-24 13:43:12.724936788 +0000 UTC m=+0.382914167,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-93.ec2.internal,}" Jul 24 13:43:12.758720 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:43:12.758650 2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-93.ec2.internal.18c53da1dcc1362b default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-93.ec2.internal,UID:ip-10-0-129-93.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-129-93.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-129-93.ec2.internal,},FirstTimestamp:2026-07-24 13:43:12.724948523 +0000 UTC m=+0.382925902,LastTimestamp:2026-07-24 13:43:12.724948523 +0000 UTC m=+0.382925902,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-93.ec2.internal,}" Jul 24 13:43:12.762120 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.762107 2578 manager.go:337] "Starting Device Plugin manager" Jul 24 13:43:12.762187 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:43:12.762144 2578 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 24 13:43:12.762187 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.762157 2578 server.go:87] "Starting device plugin registration server" Jul 24 13:43:12.762423 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.762410 2578 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 24 13:43:12.762495 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.762426 2578 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 24 13:43:12.762572 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.762555 2578 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 24 13:43:12.762652 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.762640 2578 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 24 13:43:12.762718 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.762653 2578 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 24 13:43:12.763370 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:43:12.763327 2578 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 24 13:43:12.763462 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:43:12.763402 2578 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-129-93.ec2.internal\" not found" Jul 24 13:43:12.763462 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.763333 2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-2smmm" Jul 24 13:43:12.767662 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:43:12.767592 2578 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-129-93.ec2.internal.18c53da1dcc0b40c\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-93.ec2.internal.18c53da1dcc0b40c default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-93.ec2.internal,UID:ip-10-0-129-93.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-129-93.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-129-93.ec2.internal,},FirstTimestamp:2026-07-24 13:43:12.724915212 +0000 UTC m=+0.382892594,LastTimestamp:2026-07-24 13:43:12.726316457 +0000 UTC m=+0.384293836,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-93.ec2.internal,}" Jul 24 13:43:12.772454 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.772438 2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-2smmm" Jul 24 13:43:12.778691 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:43:12.778614 2578 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-129-93.ec2.internal.18c53da1dcc10854\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-93.ec2.internal.18c53da1dcc10854 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-93.ec2.internal,UID:ip-10-0-129-93.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-129-93.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-129-93.ec2.internal,},FirstTimestamp:2026-07-24 13:43:12.724936788 +0000 UTC m=+0.382914167,LastTimestamp:2026-07-24 13:43:12.726335955 +0000 UTC m=+0.384313333,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-93.ec2.internal,}" Jul 24 13:43:12.863868 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.863839 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 24 13:43:12.865209 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.864967 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-93.ec2.internal" event="NodeHasSufficientMemory" Jul 24 13:43:12.865209 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.865000 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-93.ec2.internal" event="NodeHasNoDiskPressure" Jul 24 13:43:12.865209 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.865011 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-93.ec2.internal" event="NodeHasSufficientPID" Jul 24 13:43:12.865209 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.865039 2578 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-129-93.ec2.internal" Jul 24 13:43:12.873767 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.873741 2578 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-129-93.ec2.internal" Jul 24 13:43:12.873767 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:43:12.873766 2578 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-129-93.ec2.internal\": node \"ip-10-0-129-93.ec2.internal\" not found" Jul 24 13:43:12.887539 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:43:12.887517 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-93.ec2.internal\" not found" Jul 24 13:43:12.912715 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.912687 2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 24 13:43:12.914080 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.914056 2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 24 13:43:12.914160 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.914097 2578 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 24 13:43:12.914160 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.914122 2578 kubelet.go:2448] "Starting kubelet main sync loop" Jul 24 13:43:12.914239 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:43:12.914163 2578 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 24 13:43:12.916680 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:12.916649 2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 24 13:43:12.991324 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:43:12.991281 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-93.ec2.internal\" not found" Jul 24 13:43:13.014411 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:13.014379 2578 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-93.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-129-93.ec2.internal"] Jul 24 13:43:13.014485 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:13.014474 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 24 13:43:13.018689 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:13.018674 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-93.ec2.internal" event="NodeHasSufficientMemory" Jul 24 13:43:13.018760 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:13.018706 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-93.ec2.internal" event="NodeHasNoDiskPressure" Jul 24 13:43:13.018760 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:13.018717 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-93.ec2.internal" event="NodeHasSufficientPID" Jul 24 13:43:13.020105 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:13.020092 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 24 13:43:13.020227 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:13.020213 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-93.ec2.internal" Jul 24 13:43:13.020263 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:13.020246 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 24 13:43:13.027444 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:13.027425 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-93.ec2.internal" event="NodeHasSufficientMemory" Jul 24 13:43:13.027545 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:13.027448 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-93.ec2.internal" event="NodeHasSufficientMemory" Jul 24 13:43:13.027545 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:13.027478 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-93.ec2.internal" event="NodeHasNoDiskPressure" Jul 24 13:43:13.027545 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:13.027491 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-93.ec2.internal" event="NodeHasSufficientPID" Jul 24 13:43:13.027693 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:13.027532 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-93.ec2.internal" event="NodeHasNoDiskPressure" Jul 24 13:43:13.027693 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:13.027574 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-93.ec2.internal" event="NodeHasSufficientPID" Jul 24 13:43:13.028995 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:13.028981 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-93.ec2.internal" Jul 24 13:43:13.029058 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:13.029007 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 24 13:43:13.029836 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:13.029816 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-93.ec2.internal" event="NodeHasSufficientMemory" Jul 24 13:43:13.029915 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:13.029851 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-93.ec2.internal" event="NodeHasNoDiskPressure" Jul 24 13:43:13.029915 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:13.029867 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-93.ec2.internal" event="NodeHasSufficientPID" Jul 24 13:43:13.047190 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:43:13.047166 2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-93.ec2.internal\" not found" node="ip-10-0-129-93.ec2.internal" Jul 24 13:43:13.051947 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:43:13.051930 2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-93.ec2.internal\" not found" node="ip-10-0-129-93.ec2.internal" Jul 24 13:43:13.092326 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:43:13.092290 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-93.ec2.internal\" not found" Jul 24 13:43:13.108049 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:13.108024 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8ca0c9160c9c9500cb20dabfbd81e94f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-93.ec2.internal\" (UID: \"8ca0c9160c9c9500cb20dabfbd81e94f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-93.ec2.internal" Jul 24 13:43:13.108143 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:13.108055 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8ca0c9160c9c9500cb20dabfbd81e94f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-93.ec2.internal\" (UID: \"8ca0c9160c9c9500cb20dabfbd81e94f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-93.ec2.internal" Jul 24 13:43:13.108143 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:13.108074 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/263f5bb8d2ec60e406679313252c6a79-config\") pod \"kube-apiserver-proxy-ip-10-0-129-93.ec2.internal\" (UID: \"263f5bb8d2ec60e406679313252c6a79\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-93.ec2.internal" Jul 24 13:43:13.193229 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:43:13.193199 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-93.ec2.internal\" not found" Jul 24 13:43:13.208594 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:13.208558 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8ca0c9160c9c9500cb20dabfbd81e94f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-93.ec2.internal\" (UID: \"8ca0c9160c9c9500cb20dabfbd81e94f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-93.ec2.internal" Jul 24 13:43:13.208710 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:13.208604 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8ca0c9160c9c9500cb20dabfbd81e94f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-93.ec2.internal\" (UID: \"8ca0c9160c9c9500cb20dabfbd81e94f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-93.ec2.internal" Jul 24 13:43:13.208710 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:13.208629 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/263f5bb8d2ec60e406679313252c6a79-config\") pod \"kube-apiserver-proxy-ip-10-0-129-93.ec2.internal\" (UID: \"263f5bb8d2ec60e406679313252c6a79\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-93.ec2.internal" Jul 24 13:43:13.208710 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:13.208675 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8ca0c9160c9c9500cb20dabfbd81e94f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-93.ec2.internal\" (UID: \"8ca0c9160c9c9500cb20dabfbd81e94f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-93.ec2.internal" Jul 24 13:43:13.208828 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:13.208687 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/263f5bb8d2ec60e406679313252c6a79-config\") pod \"kube-apiserver-proxy-ip-10-0-129-93.ec2.internal\" (UID: \"263f5bb8d2ec60e406679313252c6a79\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-93.ec2.internal" Jul 24 13:43:13.208828 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:13.208681 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8ca0c9160c9c9500cb20dabfbd81e94f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-93.ec2.internal\" (UID: \"8ca0c9160c9c9500cb20dabfbd81e94f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-93.ec2.internal" Jul 24 13:43:13.299642 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:43:13.299600 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-93.ec2.internal\" not found" Jul 24 13:43:13.351786 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:13.351749 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-93.ec2.internal" Jul 24 13:43:13.356405 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:13.356379 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-93.ec2.internal" Jul 24 13:43:13.400371 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:43:13.400336 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-93.ec2.internal\" not found" Jul 24 13:43:13.505330 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:43:13.505250 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-93.ec2.internal\" not found" Jul 24 13:43:13.606223 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:43:13.606176 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-93.ec2.internal\" not found" Jul 24 13:43:13.638962 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:13.638937 2578 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 24 13:43:13.639391 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:13.639085 2578 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 24 13:43:13.698233 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:13.698206 2578 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 24 13:43:13.705364 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:13.705338 2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-93.ec2.internal" Jul 24 13:43:13.705458 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:13.705338 2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 24 13:43:13.714844 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:13.714827 2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 24 13:43:13.716740 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:13.716719 2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 24 13:43:13.716859 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:13.716823 2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-93.ec2.internal" Jul 24 13:43:13.728385 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:13.728361 2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 24 13:43:13.735858 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:13.735836 2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-rjmnz" Jul 24 13:43:13.745985 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:13.745967 2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-rjmnz" Jul 24 13:43:13.777082 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:13.777008 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-23 13:38:12 +0000 UTC" deadline="2028-03-08 18:23:22.779236432 +0000 UTC" Jul 24 13:43:13.777082 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:13.777040 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14236h40m9.002200209s" Jul 24 13:43:13.919563 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:13.919521 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod263f5bb8d2ec60e406679313252c6a79.slice/crio-b0af304bafadb8d4395177f368e1ec1013551de3e6ec3c251b733199d0187eda WatchSource:0}: Error finding container b0af304bafadb8d4395177f368e1ec1013551de3e6ec3c251b733199d0187eda: Status 404 returned error can't find the container with id b0af304bafadb8d4395177f368e1ec1013551de3e6ec3c251b733199d0187eda Jul 24 13:43:13.920044 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:13.920021 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ca0c9160c9c9500cb20dabfbd81e94f.slice/crio-ce35840d5d1a0bf7859e1dc33c9be4df2124f41a2fe12c77f8aa995238125554 WatchSource:0}: Error finding container ce35840d5d1a0bf7859e1dc33c9be4df2124f41a2fe12c77f8aa995238125554: Status 404 returned error can't find the container with id ce35840d5d1a0bf7859e1dc33c9be4df2124f41a2fe12c77f8aa995238125554 Jul 24 13:43:13.924673 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:13.924654 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 24 13:43:14.003723 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.003689 2578 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 24 13:43:14.068869 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.068784 2578 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 24 13:43:14.680657 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.680620 2578 apiserver.go:52] "Watching apiserver" Jul 24 13:43:14.687735 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.687709 2578 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 24 13:43:14.690756 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.690725 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-5jqwl","openshift-network-operator/iptables-alerter-782cv","openshift-ovn-kubernetes/ovnkube-node-vfwll","kube-system/global-pull-secret-syncer-n845m","kube-system/konnectivity-agent-txls2","kube-system/kube-apiserver-proxy-ip-10-0-129-93.ec2.internal","openshift-dns/node-resolver-xcdv9","openshift-image-registry/node-ca-n2fq4","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-93.ec2.internal","openshift-multus/multus-additional-cni-plugins-pb4lc","openshift-multus/multus-h26v2","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8x4db","openshift-cluster-node-tuning-operator/tuned-dddtw","openshift-multus/network-metrics-daemon-f8gm6"] Jul 24 13:43:14.692651 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.692626 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5jqwl" Jul 24 13:43:14.692756 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:43:14.692730 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5jqwl" podUID="503c5389-fcf1-4589-904d-1bf1261baace" Jul 24 13:43:14.693683 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.693659 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-782cv" Jul 24 13:43:14.695511 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.695215 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-vfwll" Jul 24 13:43:14.696499 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.696479 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n845m" Jul 24 13:43:14.696621 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:43:14.696598 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n845m" podUID="cb920d79-442e-4835-96ca-66a2c62e6fad" Jul 24 13:43:14.697119 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.697097 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 24 13:43:14.698250 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.697372 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-tnx5g\"" Jul 24 13:43:14.698250 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.697479 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 24 13:43:14.698250 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.697824 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 24 13:43:14.698250 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.697875 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-l5lpk\"" Jul 24 13:43:14.698250 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.698155 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 24 13:43:14.698250 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.698204 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-txls2" Jul 24 13:43:14.698250 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.698223 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 24 13:43:14.698666 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.698255 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 24 13:43:14.698666 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.698416 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 24 13:43:14.698666 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.698581 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 24 13:43:14.698835 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.698726 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 24 13:43:14.699948 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.699698 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-xcdv9" Jul 24 13:43:14.701423 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.701404 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-n2fq4" Jul 24 13:43:14.703138 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.703114 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-pb4lc" Jul 24 13:43:14.704526 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.703371 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 24 13:43:14.704526 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.703644 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-zzl6s\"" Jul 24 13:43:14.704526 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.704013 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 24 13:43:14.704526 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.704117 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 24 13:43:14.704526 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.704326 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 24 13:43:14.704526 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.704409 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-h26v2" Jul 24 13:43:14.705277 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.705071 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-hxkxm\"" Jul 24 13:43:14.705277 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.705101 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 24 13:43:14.705277 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.705145 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 24 13:43:14.705547 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.705281 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-qm7f8\"" Jul 24 13:43:14.705547 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.705369 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 24 13:43:14.705547 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.705412 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-24ckj\"" Jul 24 13:43:14.705750 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.705724 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 24 13:43:14.707166 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.706103 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 24 13:43:14.707166 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.706319 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 24 13:43:14.707166 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.706386 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 24 13:43:14.707166 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.706611 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 24 13:43:14.707166 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.706870 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 24 13:43:14.707166 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.706965 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-5b9zc\"" Jul 24 13:43:14.707584 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.707453 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8x4db" Jul 24 13:43:14.710331 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.709141 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 24 13:43:14.710331 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.709648 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 24 13:43:14.710331 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.709850 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 24 13:43:14.710331 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.710101 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-h8vnj\"" Jul 24 13:43:14.711118 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.711086 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-dddtw" Jul 24 13:43:14.711559 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.711540 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f8gm6" Jul 24 13:43:14.711681 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:43:14.711655 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f8gm6" podUID="20a8559f-d049-4fac-b14a-5a1d2aaa1aa9" Jul 24 13:43:14.713362 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.713343 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 24 13:43:14.713583 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.713354 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-45j66\"" Jul 24 13:43:14.714046 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.714005 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 24 13:43:14.717749 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.717723 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d4f67a92-c219-46a3-8604-387b40ab9ff9-registration-dir\") pod \"aws-ebs-csi-driver-node-8x4db\" (UID: \"d4f67a92-c219-46a3-8604-387b40ab9ff9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8x4db" Jul 24 13:43:14.717858 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.717790 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xt7bv\" (UniqueName: \"kubernetes.io/projected/8d537a43-c31b-4ed7-af8d-bab64bcdbbab-kube-api-access-xt7bv\") pod \"multus-additional-cni-plugins-pb4lc\" (UID: \"8d537a43-c31b-4ed7-af8d-bab64bcdbbab\") " pod="openshift-multus/multus-additional-cni-plugins-pb4lc" Jul 24 13:43:14.717858 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.717818 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cb920d79-442e-4835-96ca-66a2c62e6fad-original-pull-secret\") pod \"global-pull-secret-syncer-n845m\" (UID: \"cb920d79-442e-4835-96ca-66a2c62e6fad\") " pod="kube-system/global-pull-secret-syncer-n845m" Jul 24 13:43:14.717858 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.717843 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ee406d9c-d1b9-4ffb-b506-6d0e74521dec-ovn-node-metrics-cert\") pod \"ovnkube-node-vfwll\" (UID: \"ee406d9c-d1b9-4ffb-b506-6d0e74521dec\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfwll" Jul 24 13:43:14.718017 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.717868 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6e1b6e6b-98de-4c10-b588-219aec745e0d-hostroot\") pod \"multus-h26v2\" (UID: \"6e1b6e6b-98de-4c10-b588-219aec745e0d\") " pod="openshift-multus/multus-h26v2" Jul 24 13:43:14.718017 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.717893 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/cb920d79-442e-4835-96ca-66a2c62e6fad-dbus\") pod \"global-pull-secret-syncer-n845m\" (UID: \"cb920d79-442e-4835-96ca-66a2c62e6fad\") " pod="kube-system/global-pull-secret-syncer-n845m" Jul 24 13:43:14.718017 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.717918 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d4f67a92-c219-46a3-8604-387b40ab9ff9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8x4db\" (UID: \"d4f67a92-c219-46a3-8604-387b40ab9ff9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8x4db" Jul 24 13:43:14.718017 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.717945 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d4f67a92-c219-46a3-8604-387b40ab9ff9-etc-selinux\") pod \"aws-ebs-csi-driver-node-8x4db\" (UID: \"d4f67a92-c219-46a3-8604-387b40ab9ff9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8x4db" Jul 24 13:43:14.718017 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.717973 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ee406d9c-d1b9-4ffb-b506-6d0e74521dec-node-log\") pod \"ovnkube-node-vfwll\" (UID: \"ee406d9c-d1b9-4ffb-b506-6d0e74521dec\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfwll" Jul 24 13:43:14.718017 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.718003 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ee406d9c-d1b9-4ffb-b506-6d0e74521dec-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vfwll\" (UID: \"ee406d9c-d1b9-4ffb-b506-6d0e74521dec\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfwll" Jul 24 13:43:14.718435 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.718034 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/bd2d0507-3736-448c-91f7-a12d0db7cff1-agent-certs\") pod \"konnectivity-agent-txls2\" (UID: \"bd2d0507-3736-448c-91f7-a12d0db7cff1\") " pod="kube-system/konnectivity-agent-txls2" Jul 24 13:43:14.718435 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.718074 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ee406d9c-d1b9-4ffb-b506-6d0e74521dec-host-kubelet\") pod \"ovnkube-node-vfwll\" (UID: \"ee406d9c-d1b9-4ffb-b506-6d0e74521dec\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfwll" Jul 24 13:43:14.718435 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.718101 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ee406d9c-d1b9-4ffb-b506-6d0e74521dec-systemd-units\") pod \"ovnkube-node-vfwll\" (UID: \"ee406d9c-d1b9-4ffb-b506-6d0e74521dec\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfwll" Jul 24 13:43:14.718435 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.718141 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1df394aa-3709-4031-b25f-40bf8b36331a-host\") pod \"node-ca-n2fq4\" (UID: \"1df394aa-3709-4031-b25f-40bf8b36331a\") " pod="openshift-image-registry/node-ca-n2fq4" Jul 24 13:43:14.718435 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.718167 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6e1b6e6b-98de-4c10-b588-219aec745e0d-os-release\") pod \"multus-h26v2\" (UID: \"6e1b6e6b-98de-4c10-b588-219aec745e0d\") " pod="openshift-multus/multus-h26v2" Jul 24 13:43:14.718435 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.718196 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q9b8f\" (UniqueName: \"kubernetes.io/projected/503c5389-fcf1-4589-904d-1bf1261baace-kube-api-access-q9b8f\") pod \"network-check-target-5jqwl\" (UID: \"503c5389-fcf1-4589-904d-1bf1261baace\") " pod="openshift-network-diagnostics/network-check-target-5jqwl" Jul 24 13:43:14.718435 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.718283 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8d537a43-c31b-4ed7-af8d-bab64bcdbbab-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pb4lc\" (UID: \"8d537a43-c31b-4ed7-af8d-bab64bcdbbab\") " pod="openshift-multus/multus-additional-cni-plugins-pb4lc" Jul 24 13:43:14.718819 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.718447 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6e1b6e6b-98de-4c10-b588-219aec745e0d-multus-socket-dir-parent\") pod \"multus-h26v2\" (UID: \"6e1b6e6b-98de-4c10-b588-219aec745e0d\") " pod="openshift-multus/multus-h26v2" Jul 24 13:43:14.718819 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.718484 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/59bcaef9-a21b-4634-a7ad-ed417b8e835a-host-slash\") pod \"iptables-alerter-782cv\" (UID: \"59bcaef9-a21b-4634-a7ad-ed417b8e835a\") " pod="openshift-network-operator/iptables-alerter-782cv" Jul 24 13:43:14.718819 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.718564 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6e1b6e6b-98de-4c10-b588-219aec745e0d-system-cni-dir\") pod \"multus-h26v2\" (UID: \"6e1b6e6b-98de-4c10-b588-219aec745e0d\") " pod="openshift-multus/multus-h26v2" Jul 24 13:43:14.718819 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.718591 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6e1b6e6b-98de-4c10-b588-219aec745e0d-host-run-multus-certs\") pod \"multus-h26v2\" (UID: \"6e1b6e6b-98de-4c10-b588-219aec745e0d\") " pod="openshift-multus/multus-h26v2" Jul 24 13:43:14.718819 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.718617 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ee406d9c-d1b9-4ffb-b506-6d0e74521dec-ovnkube-script-lib\") pod \"ovnkube-node-vfwll\" (UID: \"ee406d9c-d1b9-4ffb-b506-6d0e74521dec\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfwll" Jul 24 13:43:14.718819 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.718649 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/535b3d7b-9b08-4a89-a61c-f44fcff4e888-tmp-dir\") pod \"node-resolver-xcdv9\" (UID: \"535b3d7b-9b08-4a89-a61c-f44fcff4e888\") " pod="openshift-dns/node-resolver-xcdv9" Jul 24 13:43:14.718819 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.718681 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8d537a43-c31b-4ed7-af8d-bab64bcdbbab-cnibin\") pod \"multus-additional-cni-plugins-pb4lc\" (UID: \"8d537a43-c31b-4ed7-af8d-bab64bcdbbab\") " pod="openshift-multus/multus-additional-cni-plugins-pb4lc" Jul 24 13:43:14.718819 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.718741 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6e1b6e6b-98de-4c10-b588-219aec745e0d-etc-kubernetes\") pod \"multus-h26v2\" (UID: \"6e1b6e6b-98de-4c10-b588-219aec745e0d\") " pod="openshift-multus/multus-h26v2" Jul 24 13:43:14.718819 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.718770 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/bd2d0507-3736-448c-91f7-a12d0db7cff1-konnectivity-ca\") pod \"konnectivity-agent-txls2\" (UID: \"bd2d0507-3736-448c-91f7-a12d0db7cff1\") " pod="kube-system/konnectivity-agent-txls2" Jul 24 13:43:14.718819 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.718816 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d4f67a92-c219-46a3-8604-387b40ab9ff9-socket-dir\") pod \"aws-ebs-csi-driver-node-8x4db\" (UID: \"d4f67a92-c219-46a3-8604-387b40ab9ff9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8x4db" Jul 24 13:43:14.719293 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.718842 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ee406d9c-d1b9-4ffb-b506-6d0e74521dec-var-lib-openvswitch\") pod \"ovnkube-node-vfwll\" (UID: \"ee406d9c-d1b9-4ffb-b506-6d0e74521dec\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfwll" Jul 24 13:43:14.719293 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.718877 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ee406d9c-d1b9-4ffb-b506-6d0e74521dec-ovnkube-config\") pod \"ovnkube-node-vfwll\" (UID: \"ee406d9c-d1b9-4ffb-b506-6d0e74521dec\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfwll" Jul 24 13:43:14.719293 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.718901 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ee406d9c-d1b9-4ffb-b506-6d0e74521dec-host-slash\") pod \"ovnkube-node-vfwll\" (UID: \"ee406d9c-d1b9-4ffb-b506-6d0e74521dec\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfwll" Jul 24 13:43:14.719293 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.718951 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ee406d9c-d1b9-4ffb-b506-6d0e74521dec-host-cni-netd\") pod \"ovnkube-node-vfwll\" (UID: \"ee406d9c-d1b9-4ffb-b506-6d0e74521dec\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfwll" Jul 24 13:43:14.719293 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.718978 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8d537a43-c31b-4ed7-af8d-bab64bcdbbab-cni-binary-copy\") pod \"multus-additional-cni-plugins-pb4lc\" (UID: \"8d537a43-c31b-4ed7-af8d-bab64bcdbbab\") " pod="openshift-multus/multus-additional-cni-plugins-pb4lc" Jul 24 13:43:14.719293 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.719004 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6e1b6e6b-98de-4c10-b588-219aec745e0d-host-run-k8s-cni-cncf-io\") pod \"multus-h26v2\" (UID: \"6e1b6e6b-98de-4c10-b588-219aec745e0d\") " pod="openshift-multus/multus-h26v2" Jul 24 13:43:14.719293 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.719030 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6e1b6e6b-98de-4c10-b588-219aec745e0d-host-run-netns\") pod \"multus-h26v2\" (UID: \"6e1b6e6b-98de-4c10-b588-219aec745e0d\") " pod="openshift-multus/multus-h26v2" Jul 24 13:43:14.719293 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.719053 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6e1b6e6b-98de-4c10-b588-219aec745e0d-multus-conf-dir\") pod \"multus-h26v2\" (UID: \"6e1b6e6b-98de-4c10-b588-219aec745e0d\") " pod="openshift-multus/multus-h26v2" Jul 24 13:43:14.719293 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.719076 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pxv7b\" (UniqueName: \"kubernetes.io/projected/6e1b6e6b-98de-4c10-b588-219aec745e0d-kube-api-access-pxv7b\") pod \"multus-h26v2\" (UID: \"6e1b6e6b-98de-4c10-b588-219aec745e0d\") " pod="openshift-multus/multus-h26v2" Jul 24 13:43:14.719293 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.719102 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1df394aa-3709-4031-b25f-40bf8b36331a-serviceca\") pod \"node-ca-n2fq4\" (UID: \"1df394aa-3709-4031-b25f-40bf8b36331a\") " pod="openshift-image-registry/node-ca-n2fq4" Jul 24 13:43:14.719293 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.719138 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8d537a43-c31b-4ed7-af8d-bab64bcdbbab-system-cni-dir\") pod \"multus-additional-cni-plugins-pb4lc\" (UID: \"8d537a43-c31b-4ed7-af8d-bab64bcdbbab\") " pod="openshift-multus/multus-additional-cni-plugins-pb4lc" Jul 24 13:43:14.719293 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.719161 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6e1b6e6b-98de-4c10-b588-219aec745e0d-cni-binary-copy\") pod \"multus-h26v2\" (UID: \"6e1b6e6b-98de-4c10-b588-219aec745e0d\") " pod="openshift-multus/multus-h26v2" Jul 24 13:43:14.719293 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.719183 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6e1b6e6b-98de-4c10-b588-219aec745e0d-host-var-lib-kubelet\") pod \"multus-h26v2\" (UID: \"6e1b6e6b-98de-4c10-b588-219aec745e0d\") " pod="openshift-multus/multus-h26v2" Jul 24 13:43:14.719293 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.719222 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/cb920d79-442e-4835-96ca-66a2c62e6fad-kubelet-config\") pod \"global-pull-secret-syncer-n845m\" (UID: \"cb920d79-442e-4835-96ca-66a2c62e6fad\") " pod="kube-system/global-pull-secret-syncer-n845m" Jul 24 13:43:14.719293 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.719263 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/535b3d7b-9b08-4a89-a61c-f44fcff4e888-hosts-file\") pod \"node-resolver-xcdv9\" (UID: \"535b3d7b-9b08-4a89-a61c-f44fcff4e888\") " pod="openshift-dns/node-resolver-xcdv9" Jul 24 13:43:14.719293 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.719298 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8d537a43-c31b-4ed7-af8d-bab64bcdbbab-os-release\") pod \"multus-additional-cni-plugins-pb4lc\" (UID: \"8d537a43-c31b-4ed7-af8d-bab64bcdbbab\") " pod="openshift-multus/multus-additional-cni-plugins-pb4lc" Jul 24 13:43:14.720158 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.719325 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d4f67a92-c219-46a3-8604-387b40ab9ff9-device-dir\") pod \"aws-ebs-csi-driver-node-8x4db\" (UID: \"d4f67a92-c219-46a3-8604-387b40ab9ff9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8x4db" Jul 24 13:43:14.720158 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.719352 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ee406d9c-d1b9-4ffb-b506-6d0e74521dec-run-openvswitch\") pod \"ovnkube-node-vfwll\" (UID: \"ee406d9c-d1b9-4ffb-b506-6d0e74521dec\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfwll" Jul 24 13:43:14.720158 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.719377 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ee406d9c-d1b9-4ffb-b506-6d0e74521dec-run-ovn\") pod \"ovnkube-node-vfwll\" (UID: \"ee406d9c-d1b9-4ffb-b506-6d0e74521dec\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfwll" Jul 24 13:43:14.720158 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.719403 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ee406d9c-d1b9-4ffb-b506-6d0e74521dec-env-overrides\") pod \"ovnkube-node-vfwll\" (UID: \"ee406d9c-d1b9-4ffb-b506-6d0e74521dec\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfwll" Jul 24 13:43:14.720158 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.719451 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p46n4\" (UniqueName: \"kubernetes.io/projected/535b3d7b-9b08-4a89-a61c-f44fcff4e888-kube-api-access-p46n4\") pod \"node-resolver-xcdv9\" (UID: \"535b3d7b-9b08-4a89-a61c-f44fcff4e888\") " pod="openshift-dns/node-resolver-xcdv9" Jul 24 13:43:14.720158 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.719479 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8d537a43-c31b-4ed7-af8d-bab64bcdbbab-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pb4lc\" (UID: \"8d537a43-c31b-4ed7-af8d-bab64bcdbbab\") " pod="openshift-multus/multus-additional-cni-plugins-pb4lc" Jul 24 13:43:14.720158 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.719506 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6e1b6e6b-98de-4c10-b588-219aec745e0d-host-var-lib-cni-bin\") pod \"multus-h26v2\" (UID: \"6e1b6e6b-98de-4c10-b588-219aec745e0d\") " pod="openshift-multus/multus-h26v2" Jul 24 13:43:14.720158 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.719546 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8qf9l\" (UniqueName: \"kubernetes.io/projected/59bcaef9-a21b-4634-a7ad-ed417b8e835a-kube-api-access-8qf9l\") pod \"iptables-alerter-782cv\" (UID: \"59bcaef9-a21b-4634-a7ad-ed417b8e835a\") " pod="openshift-network-operator/iptables-alerter-782cv" Jul 24 13:43:14.720158 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.719581 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ee406d9c-d1b9-4ffb-b506-6d0e74521dec-run-systemd\") pod \"ovnkube-node-vfwll\" (UID: \"ee406d9c-d1b9-4ffb-b506-6d0e74521dec\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfwll" Jul 24 13:43:14.720158 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.719608 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ee406d9c-d1b9-4ffb-b506-6d0e74521dec-etc-openvswitch\") pod \"ovnkube-node-vfwll\" (UID: \"ee406d9c-d1b9-4ffb-b506-6d0e74521dec\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfwll" Jul 24 13:43:14.720158 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.719634 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d4f67a92-c219-46a3-8604-387b40ab9ff9-sys-fs\") pod \"aws-ebs-csi-driver-node-8x4db\" (UID: \"d4f67a92-c219-46a3-8604-387b40ab9ff9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8x4db" Jul 24 13:43:14.720158 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.719664 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ee406d9c-d1b9-4ffb-b506-6d0e74521dec-host-run-netns\") pod \"ovnkube-node-vfwll\" (UID: \"ee406d9c-d1b9-4ffb-b506-6d0e74521dec\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfwll" Jul 24 13:43:14.720158 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.719687 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ee406d9c-d1b9-4ffb-b506-6d0e74521dec-log-socket\") pod \"ovnkube-node-vfwll\" (UID: \"ee406d9c-d1b9-4ffb-b506-6d0e74521dec\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfwll" Jul 24 13:43:14.720158 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.719724 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ee406d9c-d1b9-4ffb-b506-6d0e74521dec-host-run-ovn-kubernetes\") pod \"ovnkube-node-vfwll\" (UID: \"ee406d9c-d1b9-4ffb-b506-6d0e74521dec\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfwll" Jul 24 13:43:14.720158 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.719769 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9p7cm\" (UniqueName: \"kubernetes.io/projected/ee406d9c-d1b9-4ffb-b506-6d0e74521dec-kube-api-access-9p7cm\") pod \"ovnkube-node-vfwll\" (UID: \"ee406d9c-d1b9-4ffb-b506-6d0e74521dec\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfwll" Jul 24 13:43:14.720158 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.719813 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6e1b6e6b-98de-4c10-b588-219aec745e0d-cnibin\") pod \"multus-h26v2\" (UID: \"6e1b6e6b-98de-4c10-b588-219aec745e0d\") " pod="openshift-multus/multus-h26v2" Jul 24 13:43:14.720966 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.719853 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6e1b6e6b-98de-4c10-b588-219aec745e0d-host-var-lib-cni-multus\") pod \"multus-h26v2\" (UID: \"6e1b6e6b-98de-4c10-b588-219aec745e0d\") " pod="openshift-multus/multus-h26v2" Jul 24 13:43:14.720966 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.719882 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ee406d9c-d1b9-4ffb-b506-6d0e74521dec-host-cni-bin\") pod \"ovnkube-node-vfwll\" (UID: \"ee406d9c-d1b9-4ffb-b506-6d0e74521dec\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfwll" Jul 24 13:43:14.720966 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.719927 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nvkgr\" (UniqueName: \"kubernetes.io/projected/1df394aa-3709-4031-b25f-40bf8b36331a-kube-api-access-nvkgr\") pod \"node-ca-n2fq4\" (UID: \"1df394aa-3709-4031-b25f-40bf8b36331a\") " pod="openshift-image-registry/node-ca-n2fq4" Jul 24 13:43:14.720966 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.719950 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8d537a43-c31b-4ed7-af8d-bab64bcdbbab-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pb4lc\" (UID: \"8d537a43-c31b-4ed7-af8d-bab64bcdbbab\") " pod="openshift-multus/multus-additional-cni-plugins-pb4lc" Jul 24 13:43:14.720966 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.719980 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6e1b6e6b-98de-4c10-b588-219aec745e0d-multus-cni-dir\") pod \"multus-h26v2\" (UID: \"6e1b6e6b-98de-4c10-b588-219aec745e0d\") " pod="openshift-multus/multus-h26v2" Jul 24 13:43:14.720966 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.720004 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6e1b6e6b-98de-4c10-b588-219aec745e0d-multus-daemon-config\") pod \"multus-h26v2\" (UID: \"6e1b6e6b-98de-4c10-b588-219aec745e0d\") " pod="openshift-multus/multus-h26v2" Jul 24 13:43:14.720966 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.720030 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/59bcaef9-a21b-4634-a7ad-ed417b8e835a-iptables-alerter-script\") pod \"iptables-alerter-782cv\" (UID: \"59bcaef9-a21b-4634-a7ad-ed417b8e835a\") " pod="openshift-network-operator/iptables-alerter-782cv" Jul 24 13:43:14.720966 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.720054 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8jcw\" (UniqueName: \"kubernetes.io/projected/d4f67a92-c219-46a3-8604-387b40ab9ff9-kube-api-access-k8jcw\") pod \"aws-ebs-csi-driver-node-8x4db\" (UID: \"d4f67a92-c219-46a3-8604-387b40ab9ff9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8x4db" Jul 24 13:43:14.748626 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.748508 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-23 13:38:13 +0000 UTC" deadline="2028-03-05 18:55:29.42982664 +0000 UTC" Jul 24 13:43:14.748626 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.748560 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14165h12m14.681271015s" Jul 24 13:43:14.807265 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.807237 2578 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 24 13:43:14.820980 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.820945 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8d537a43-c31b-4ed7-af8d-bab64bcdbbab-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pb4lc\" (UID: \"8d537a43-c31b-4ed7-af8d-bab64bcdbbab\") " pod="openshift-multus/multus-additional-cni-plugins-pb4lc" Jul 24 13:43:14.821109 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.820988 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6e1b6e6b-98de-4c10-b588-219aec745e0d-multus-socket-dir-parent\") pod \"multus-h26v2\" (UID: \"6e1b6e6b-98de-4c10-b588-219aec745e0d\") " pod="openshift-multus/multus-h26v2" Jul 24 13:43:14.821109 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.821014 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/59bcaef9-a21b-4634-a7ad-ed417b8e835a-host-slash\") pod \"iptables-alerter-782cv\" (UID: \"59bcaef9-a21b-4634-a7ad-ed417b8e835a\") " pod="openshift-network-operator/iptables-alerter-782cv" Jul 24 13:43:14.821109 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.821042 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6861d7e0-aeed-4f23-9da8-4305dd94ebfa-etc-kubernetes\") pod \"tuned-dddtw\" (UID: \"6861d7e0-aeed-4f23-9da8-4305dd94ebfa\") " pod="openshift-cluster-node-tuning-operator/tuned-dddtw" Jul 24 13:43:14.821109 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.821065 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6861d7e0-aeed-4f23-9da8-4305dd94ebfa-tmp\") pod \"tuned-dddtw\" (UID: \"6861d7e0-aeed-4f23-9da8-4305dd94ebfa\") " pod="openshift-cluster-node-tuning-operator/tuned-dddtw" Jul 24 13:43:14.821109 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.821089 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6e1b6e6b-98de-4c10-b588-219aec745e0d-system-cni-dir\") pod \"multus-h26v2\" (UID: \"6e1b6e6b-98de-4c10-b588-219aec745e0d\") " pod="openshift-multus/multus-h26v2" Jul 24 13:43:14.821323 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.821113 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6e1b6e6b-98de-4c10-b588-219aec745e0d-host-run-multus-certs\") pod \"multus-h26v2\" (UID: \"6e1b6e6b-98de-4c10-b588-219aec745e0d\") " pod="openshift-multus/multus-h26v2" Jul 24 13:43:14.821323 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.821147 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ee406d9c-d1b9-4ffb-b506-6d0e74521dec-ovnkube-script-lib\") pod \"ovnkube-node-vfwll\" (UID: \"ee406d9c-d1b9-4ffb-b506-6d0e74521dec\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfwll" Jul 24 13:43:14.821323 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.821171 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rjtln\" (UniqueName: \"kubernetes.io/projected/6861d7e0-aeed-4f23-9da8-4305dd94ebfa-kube-api-access-rjtln\") pod \"tuned-dddtw\" (UID: \"6861d7e0-aeed-4f23-9da8-4305dd94ebfa\") " pod="openshift-cluster-node-tuning-operator/tuned-dddtw" Jul 24 13:43:14.821323 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.821197 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/535b3d7b-9b08-4a89-a61c-f44fcff4e888-tmp-dir\") pod \"node-resolver-xcdv9\" (UID: \"535b3d7b-9b08-4a89-a61c-f44fcff4e888\") " pod="openshift-dns/node-resolver-xcdv9" Jul 24 13:43:14.821323 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.821221 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8d537a43-c31b-4ed7-af8d-bab64bcdbbab-cnibin\") pod \"multus-additional-cni-plugins-pb4lc\" (UID: \"8d537a43-c31b-4ed7-af8d-bab64bcdbbab\") " pod="openshift-multus/multus-additional-cni-plugins-pb4lc" Jul 24 13:43:14.821323 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.821250 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6e1b6e6b-98de-4c10-b588-219aec745e0d-etc-kubernetes\") pod \"multus-h26v2\" (UID: \"6e1b6e6b-98de-4c10-b588-219aec745e0d\") " pod="openshift-multus/multus-h26v2" Jul 24 13:43:14.821323 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.821273 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/bd2d0507-3736-448c-91f7-a12d0db7cff1-konnectivity-ca\") pod \"konnectivity-agent-txls2\" (UID: \"bd2d0507-3736-448c-91f7-a12d0db7cff1\") " pod="kube-system/konnectivity-agent-txls2" Jul 24 13:43:14.821323 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.821298 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d4f67a92-c219-46a3-8604-387b40ab9ff9-socket-dir\") pod \"aws-ebs-csi-driver-node-8x4db\" (UID: \"d4f67a92-c219-46a3-8604-387b40ab9ff9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8x4db" Jul 24 13:43:14.821717 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.821323 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ee406d9c-d1b9-4ffb-b506-6d0e74521dec-var-lib-openvswitch\") pod \"ovnkube-node-vfwll\" (UID: \"ee406d9c-d1b9-4ffb-b506-6d0e74521dec\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfwll" Jul 24 13:43:14.821717 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.821349 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ee406d9c-d1b9-4ffb-b506-6d0e74521dec-ovnkube-config\") pod \"ovnkube-node-vfwll\" (UID: \"ee406d9c-d1b9-4ffb-b506-6d0e74521dec\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfwll" Jul 24 13:43:14.821717 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.821372 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6861d7e0-aeed-4f23-9da8-4305dd94ebfa-etc-tuned\") pod \"tuned-dddtw\" (UID: \"6861d7e0-aeed-4f23-9da8-4305dd94ebfa\") " pod="openshift-cluster-node-tuning-operator/tuned-dddtw" Jul 24 13:43:14.821717 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.821405 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ee406d9c-d1b9-4ffb-b506-6d0e74521dec-host-slash\") pod \"ovnkube-node-vfwll\" (UID: \"ee406d9c-d1b9-4ffb-b506-6d0e74521dec\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfwll" Jul 24 13:43:14.821717 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.821443 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ee406d9c-d1b9-4ffb-b506-6d0e74521dec-host-cni-netd\") pod \"ovnkube-node-vfwll\" (UID: \"ee406d9c-d1b9-4ffb-b506-6d0e74521dec\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfwll" Jul 24 13:43:14.821717 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.821469 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6861d7e0-aeed-4f23-9da8-4305dd94ebfa-var-lib-kubelet\") pod \"tuned-dddtw\" (UID: \"6861d7e0-aeed-4f23-9da8-4305dd94ebfa\") " pod="openshift-cluster-node-tuning-operator/tuned-dddtw" Jul 24 13:43:14.821717 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.821493 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8d537a43-c31b-4ed7-af8d-bab64bcdbbab-cni-binary-copy\") pod \"multus-additional-cni-plugins-pb4lc\" (UID: \"8d537a43-c31b-4ed7-af8d-bab64bcdbbab\") " pod="openshift-multus/multus-additional-cni-plugins-pb4lc" Jul 24 13:43:14.821717 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.821519 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6e1b6e6b-98de-4c10-b588-219aec745e0d-host-run-k8s-cni-cncf-io\") pod \"multus-h26v2\" (UID: \"6e1b6e6b-98de-4c10-b588-219aec745e0d\") " pod="openshift-multus/multus-h26v2" Jul 24 13:43:14.821717 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.821551 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6e1b6e6b-98de-4c10-b588-219aec745e0d-host-run-netns\") pod \"multus-h26v2\" (UID: \"6e1b6e6b-98de-4c10-b588-219aec745e0d\") " pod="openshift-multus/multus-h26v2" Jul 24 13:43:14.821717 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.821574 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6e1b6e6b-98de-4c10-b588-219aec745e0d-multus-conf-dir\") pod \"multus-h26v2\" (UID: \"6e1b6e6b-98de-4c10-b588-219aec745e0d\") " pod="openshift-multus/multus-h26v2" Jul 24 13:43:14.821717 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.821599 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8d537a43-c31b-4ed7-af8d-bab64bcdbbab-cnibin\") pod \"multus-additional-cni-plugins-pb4lc\" (UID: \"8d537a43-c31b-4ed7-af8d-bab64bcdbbab\") " pod="openshift-multus/multus-additional-cni-plugins-pb4lc" Jul 24 13:43:14.821717 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.821604 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pxv7b\" (UniqueName: \"kubernetes.io/projected/6e1b6e6b-98de-4c10-b588-219aec745e0d-kube-api-access-pxv7b\") pod \"multus-h26v2\" (UID: \"6e1b6e6b-98de-4c10-b588-219aec745e0d\") " pod="openshift-multus/multus-h26v2" Jul 24 13:43:14.821717 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.821712 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1df394aa-3709-4031-b25f-40bf8b36331a-serviceca\") pod \"node-ca-n2fq4\" (UID: \"1df394aa-3709-4031-b25f-40bf8b36331a\") " pod="openshift-image-registry/node-ca-n2fq4" Jul 24 13:43:14.822346 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.821742 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8d537a43-c31b-4ed7-af8d-bab64bcdbbab-system-cni-dir\") pod \"multus-additional-cni-plugins-pb4lc\" (UID: \"8d537a43-c31b-4ed7-af8d-bab64bcdbbab\") " pod="openshift-multus/multus-additional-cni-plugins-pb4lc" Jul 24 13:43:14.822346 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.821771 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6e1b6e6b-98de-4c10-b588-219aec745e0d-cni-binary-copy\") pod \"multus-h26v2\" (UID: \"6e1b6e6b-98de-4c10-b588-219aec745e0d\") " pod="openshift-multus/multus-h26v2" Jul 24 13:43:14.822346 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.821796 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6e1b6e6b-98de-4c10-b588-219aec745e0d-host-var-lib-kubelet\") pod \"multus-h26v2\" (UID: \"6e1b6e6b-98de-4c10-b588-219aec745e0d\") " pod="openshift-multus/multus-h26v2" Jul 24 13:43:14.822346 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.821822 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/cb920d79-442e-4835-96ca-66a2c62e6fad-kubelet-config\") pod \"global-pull-secret-syncer-n845m\" (UID: \"cb920d79-442e-4835-96ca-66a2c62e6fad\") " pod="kube-system/global-pull-secret-syncer-n845m" Jul 24 13:43:14.822346 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.821850 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/20a8559f-d049-4fac-b14a-5a1d2aaa1aa9-metrics-certs\") pod \"network-metrics-daemon-f8gm6\" (UID: \"20a8559f-d049-4fac-b14a-5a1d2aaa1aa9\") " pod="openshift-multus/network-metrics-daemon-f8gm6" Jul 24 13:43:14.822346 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.821900 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6e1b6e6b-98de-4c10-b588-219aec745e0d-etc-kubernetes\") pod \"multus-h26v2\" (UID: \"6e1b6e6b-98de-4c10-b588-219aec745e0d\") " pod="openshift-multus/multus-h26v2" Jul 24 13:43:14.822346 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.822032 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6e1b6e6b-98de-4c10-b588-219aec745e0d-multus-socket-dir-parent\") pod \"multus-h26v2\" (UID: \"6e1b6e6b-98de-4c10-b588-219aec745e0d\") " pod="openshift-multus/multus-h26v2" Jul 24 13:43:14.822346 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.822050 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/535b3d7b-9b08-4a89-a61c-f44fcff4e888-hosts-file\") pod \"node-resolver-xcdv9\" (UID: \"535b3d7b-9b08-4a89-a61c-f44fcff4e888\") " pod="openshift-dns/node-resolver-xcdv9" Jul 24 13:43:14.822346 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.822285 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d4f67a92-c219-46a3-8604-387b40ab9ff9-socket-dir\") pod \"aws-ebs-csi-driver-node-8x4db\" (UID: \"d4f67a92-c219-46a3-8604-387b40ab9ff9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8x4db" Jul 24 13:43:14.822346 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.822328 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ee406d9c-d1b9-4ffb-b506-6d0e74521dec-var-lib-openvswitch\") pod \"ovnkube-node-vfwll\" (UID: \"ee406d9c-d1b9-4ffb-b506-6d0e74521dec\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfwll" Jul 24 13:43:14.822850 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.822710 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/bd2d0507-3736-448c-91f7-a12d0db7cff1-konnectivity-ca\") pod \"konnectivity-agent-txls2\" (UID: \"bd2d0507-3736-448c-91f7-a12d0db7cff1\") " pod="kube-system/konnectivity-agent-txls2" Jul 24 13:43:14.822850 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.822786 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8d537a43-c31b-4ed7-af8d-bab64bcdbbab-os-release\") pod \"multus-additional-cni-plugins-pb4lc\" (UID: \"8d537a43-c31b-4ed7-af8d-bab64bcdbbab\") " pod="openshift-multus/multus-additional-cni-plugins-pb4lc" Jul 24 13:43:14.822850 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.822818 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d4f67a92-c219-46a3-8604-387b40ab9ff9-device-dir\") pod \"aws-ebs-csi-driver-node-8x4db\" (UID: \"d4f67a92-c219-46a3-8604-387b40ab9ff9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8x4db" Jul 24 13:43:14.822850 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.822844 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ee406d9c-d1b9-4ffb-b506-6d0e74521dec-run-openvswitch\") pod \"ovnkube-node-vfwll\" (UID: \"ee406d9c-d1b9-4ffb-b506-6d0e74521dec\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfwll" Jul 24 13:43:14.823045 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.822868 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ee406d9c-d1b9-4ffb-b506-6d0e74521dec-run-ovn\") pod \"ovnkube-node-vfwll\" (UID: \"ee406d9c-d1b9-4ffb-b506-6d0e74521dec\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfwll" Jul 24 13:43:14.823045 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.822892 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ee406d9c-d1b9-4ffb-b506-6d0e74521dec-env-overrides\") pod \"ovnkube-node-vfwll\" (UID: \"ee406d9c-d1b9-4ffb-b506-6d0e74521dec\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfwll" Jul 24 13:43:14.823045 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.822898 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ee406d9c-d1b9-4ffb-b506-6d0e74521dec-ovnkube-config\") pod \"ovnkube-node-vfwll\" (UID: \"ee406d9c-d1b9-4ffb-b506-6d0e74521dec\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfwll" Jul 24 13:43:14.823045 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.822954 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ee406d9c-d1b9-4ffb-b506-6d0e74521dec-host-slash\") pod \"ovnkube-node-vfwll\" (UID: \"ee406d9c-d1b9-4ffb-b506-6d0e74521dec\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfwll" Jul 24 13:43:14.823045 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.822970 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p46n4\" (UniqueName: \"kubernetes.io/projected/535b3d7b-9b08-4a89-a61c-f44fcff4e888-kube-api-access-p46n4\") pod \"node-resolver-xcdv9\" (UID: \"535b3d7b-9b08-4a89-a61c-f44fcff4e888\") " pod="openshift-dns/node-resolver-xcdv9" Jul 24 13:43:14.823045 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.822988 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ee406d9c-d1b9-4ffb-b506-6d0e74521dec-host-cni-netd\") pod \"ovnkube-node-vfwll\" (UID: \"ee406d9c-d1b9-4ffb-b506-6d0e74521dec\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfwll" Jul 24 13:43:14.823045 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.822997 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8d537a43-c31b-4ed7-af8d-bab64bcdbbab-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pb4lc\" (UID: \"8d537a43-c31b-4ed7-af8d-bab64bcdbbab\") " pod="openshift-multus/multus-additional-cni-plugins-pb4lc" Jul 24 13:43:14.823045 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.823026 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6e1b6e6b-98de-4c10-b588-219aec745e0d-host-var-lib-cni-bin\") pod \"multus-h26v2\" (UID: \"6e1b6e6b-98de-4c10-b588-219aec745e0d\") " pod="openshift-multus/multus-h26v2" Jul 24 13:43:14.823326 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.823052 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8qf9l\" (UniqueName: \"kubernetes.io/projected/59bcaef9-a21b-4634-a7ad-ed417b8e835a-kube-api-access-8qf9l\") pod \"iptables-alerter-782cv\" (UID: \"59bcaef9-a21b-4634-a7ad-ed417b8e835a\") " pod="openshift-network-operator/iptables-alerter-782cv" Jul 24 13:43:14.823326 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.823076 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ee406d9c-d1b9-4ffb-b506-6d0e74521dec-run-systemd\") pod \"ovnkube-node-vfwll\" (UID: \"ee406d9c-d1b9-4ffb-b506-6d0e74521dec\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfwll" Jul 24 13:43:14.823326 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.823101 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ee406d9c-d1b9-4ffb-b506-6d0e74521dec-etc-openvswitch\") pod \"ovnkube-node-vfwll\" (UID: \"ee406d9c-d1b9-4ffb-b506-6d0e74521dec\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfwll" Jul 24 13:43:14.823326 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.823128 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6861d7e0-aeed-4f23-9da8-4305dd94ebfa-sys\") pod \"tuned-dddtw\" (UID: \"6861d7e0-aeed-4f23-9da8-4305dd94ebfa\") " pod="openshift-cluster-node-tuning-operator/tuned-dddtw" Jul 24 13:43:14.823326 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.823148 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6e1b6e6b-98de-4c10-b588-219aec745e0d-multus-conf-dir\") pod \"multus-h26v2\" (UID: \"6e1b6e6b-98de-4c10-b588-219aec745e0d\") " pod="openshift-multus/multus-h26v2" Jul 24 13:43:14.823326 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.823153 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d4f67a92-c219-46a3-8604-387b40ab9ff9-sys-fs\") pod \"aws-ebs-csi-driver-node-8x4db\" (UID: \"d4f67a92-c219-46a3-8604-387b40ab9ff9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8x4db" Jul 24 13:43:14.823326 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.823191 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ee406d9c-d1b9-4ffb-b506-6d0e74521dec-host-run-netns\") pod \"ovnkube-node-vfwll\" (UID: \"ee406d9c-d1b9-4ffb-b506-6d0e74521dec\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfwll" Jul 24 13:43:14.823326 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.823209 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d4f67a92-c219-46a3-8604-387b40ab9ff9-sys-fs\") pod \"aws-ebs-csi-driver-node-8x4db\" (UID: \"d4f67a92-c219-46a3-8604-387b40ab9ff9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8x4db" Jul 24 13:43:14.823326 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.823220 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ee406d9c-d1b9-4ffb-b506-6d0e74521dec-log-socket\") pod \"ovnkube-node-vfwll\" (UID: \"ee406d9c-d1b9-4ffb-b506-6d0e74521dec\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfwll" Jul 24 13:43:14.823626 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.823551 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8d537a43-c31b-4ed7-af8d-bab64bcdbbab-cni-binary-copy\") pod \"multus-additional-cni-plugins-pb4lc\" (UID: \"8d537a43-c31b-4ed7-af8d-bab64bcdbbab\") " pod="openshift-multus/multus-additional-cni-plugins-pb4lc" Jul 24 13:43:14.823626 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.823612 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ee406d9c-d1b9-4ffb-b506-6d0e74521dec-env-overrides\") pod \"ovnkube-node-vfwll\" (UID: \"ee406d9c-d1b9-4ffb-b506-6d0e74521dec\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfwll" Jul 24 13:43:14.823693 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.823668 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/535b3d7b-9b08-4a89-a61c-f44fcff4e888-hosts-file\") pod \"node-resolver-xcdv9\" (UID: \"535b3d7b-9b08-4a89-a61c-f44fcff4e888\") " pod="openshift-dns/node-resolver-xcdv9" Jul 24 13:43:14.823693 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.823672 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6e1b6e6b-98de-4c10-b588-219aec745e0d-system-cni-dir\") pod \"multus-h26v2\" (UID: \"6e1b6e6b-98de-4c10-b588-219aec745e0d\") " pod="openshift-multus/multus-h26v2" Jul 24 13:43:14.823753 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.823692 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/cb920d79-442e-4835-96ca-66a2c62e6fad-kubelet-config\") pod \"global-pull-secret-syncer-n845m\" (UID: \"cb920d79-442e-4835-96ca-66a2c62e6fad\") " pod="kube-system/global-pull-secret-syncer-n845m" Jul 24 13:43:14.823753 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.823704 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ee406d9c-d1b9-4ffb-b506-6d0e74521dec-run-systemd\") pod \"ovnkube-node-vfwll\" (UID: \"ee406d9c-d1b9-4ffb-b506-6d0e74521dec\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfwll" Jul 24 13:43:14.823753 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.823711 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6e1b6e6b-98de-4c10-b588-219aec745e0d-host-var-lib-cni-bin\") pod \"multus-h26v2\" (UID: \"6e1b6e6b-98de-4c10-b588-219aec745e0d\") " pod="openshift-multus/multus-h26v2" Jul 24 13:43:14.823753 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.823737 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6861d7e0-aeed-4f23-9da8-4305dd94ebfa-etc-sysctl-d\") pod \"tuned-dddtw\" (UID: \"6861d7e0-aeed-4f23-9da8-4305dd94ebfa\") " pod="openshift-cluster-node-tuning-operator/tuned-dddtw" Jul 24 13:43:14.823753 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.823741 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6e1b6e6b-98de-4c10-b588-219aec745e0d-host-run-multus-certs\") pod \"multus-h26v2\" (UID: \"6e1b6e6b-98de-4c10-b588-219aec745e0d\") " pod="openshift-multus/multus-h26v2" Jul 24 13:43:14.823896 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.823793 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ee406d9c-d1b9-4ffb-b506-6d0e74521dec-host-run-ovn-kubernetes\") pod \"ovnkube-node-vfwll\" (UID: \"ee406d9c-d1b9-4ffb-b506-6d0e74521dec\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfwll" Jul 24 13:43:14.823896 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.823824 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9p7cm\" (UniqueName: \"kubernetes.io/projected/ee406d9c-d1b9-4ffb-b506-6d0e74521dec-kube-api-access-9p7cm\") pod \"ovnkube-node-vfwll\" (UID: \"ee406d9c-d1b9-4ffb-b506-6d0e74521dec\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfwll" Jul 24 13:43:14.823896 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.823848 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6e1b6e6b-98de-4c10-b588-219aec745e0d-cnibin\") pod \"multus-h26v2\" (UID: \"6e1b6e6b-98de-4c10-b588-219aec745e0d\") " pod="openshift-multus/multus-h26v2" Jul 24 13:43:14.823896 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.823874 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6e1b6e6b-98de-4c10-b588-219aec745e0d-host-var-lib-cni-multus\") pod \"multus-h26v2\" (UID: \"6e1b6e6b-98de-4c10-b588-219aec745e0d\") " pod="openshift-multus/multus-h26v2" Jul 24 13:43:14.824034 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.823898 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ee406d9c-d1b9-4ffb-b506-6d0e74521dec-host-cni-bin\") pod \"ovnkube-node-vfwll\" (UID: \"ee406d9c-d1b9-4ffb-b506-6d0e74521dec\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfwll" Jul 24 13:43:14.824034 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.823923 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6861d7e0-aeed-4f23-9da8-4305dd94ebfa-etc-systemd\") pod \"tuned-dddtw\" (UID: \"6861d7e0-aeed-4f23-9da8-4305dd94ebfa\") " pod="openshift-cluster-node-tuning-operator/tuned-dddtw" Jul 24 13:43:14.824034 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.823950 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nvkgr\" (UniqueName: \"kubernetes.io/projected/1df394aa-3709-4031-b25f-40bf8b36331a-kube-api-access-nvkgr\") pod \"node-ca-n2fq4\" (UID: \"1df394aa-3709-4031-b25f-40bf8b36331a\") " pod="openshift-image-registry/node-ca-n2fq4" Jul 24 13:43:14.824034 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.823977 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8d537a43-c31b-4ed7-af8d-bab64bcdbbab-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pb4lc\" (UID: \"8d537a43-c31b-4ed7-af8d-bab64bcdbbab\") " pod="openshift-multus/multus-additional-cni-plugins-pb4lc" Jul 24 13:43:14.824150 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.824027 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8d537a43-c31b-4ed7-af8d-bab64bcdbbab-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pb4lc\" (UID: \"8d537a43-c31b-4ed7-af8d-bab64bcdbbab\") " pod="openshift-multus/multus-additional-cni-plugins-pb4lc" Jul 24 13:43:14.824150 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.824131 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6e1b6e6b-98de-4c10-b588-219aec745e0d-multus-cni-dir\") pod \"multus-h26v2\" (UID: \"6e1b6e6b-98de-4c10-b588-219aec745e0d\") " pod="openshift-multus/multus-h26v2" Jul 24 13:43:14.824211 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.824178 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6e1b6e6b-98de-4c10-b588-219aec745e0d-multus-daemon-config\") pod \"multus-h26v2\" (UID: \"6e1b6e6b-98de-4c10-b588-219aec745e0d\") " pod="openshift-multus/multus-h26v2" Jul 24 13:43:14.824246 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.824206 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/59bcaef9-a21b-4634-a7ad-ed417b8e835a-iptables-alerter-script\") pod \"iptables-alerter-782cv\" (UID: \"59bcaef9-a21b-4634-a7ad-ed417b8e835a\") " pod="openshift-network-operator/iptables-alerter-782cv" Jul 24 13:43:14.824246 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.824230 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ee406d9c-d1b9-4ffb-b506-6d0e74521dec-ovnkube-script-lib\") pod \"ovnkube-node-vfwll\" (UID: \"ee406d9c-d1b9-4ffb-b506-6d0e74521dec\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfwll" Jul 24 13:43:14.824336 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.824234 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8jcw\" (UniqueName: \"kubernetes.io/projected/d4f67a92-c219-46a3-8604-387b40ab9ff9-kube-api-access-k8jcw\") pod \"aws-ebs-csi-driver-node-8x4db\" (UID: \"d4f67a92-c219-46a3-8604-387b40ab9ff9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8x4db" Jul 24 13:43:14.824336 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.824286 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6861d7e0-aeed-4f23-9da8-4305dd94ebfa-etc-sysctl-conf\") pod \"tuned-dddtw\" (UID: \"6861d7e0-aeed-4f23-9da8-4305dd94ebfa\") " pod="openshift-cluster-node-tuning-operator/tuned-dddtw" Jul 24 13:43:14.824336 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.824320 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6861d7e0-aeed-4f23-9da8-4305dd94ebfa-run\") pod \"tuned-dddtw\" (UID: \"6861d7e0-aeed-4f23-9da8-4305dd94ebfa\") " pod="openshift-cluster-node-tuning-operator/tuned-dddtw" Jul 24 13:43:14.824451 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.824356 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d4f67a92-c219-46a3-8604-387b40ab9ff9-registration-dir\") pod \"aws-ebs-csi-driver-node-8x4db\" (UID: \"d4f67a92-c219-46a3-8604-387b40ab9ff9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8x4db" Jul 24 13:43:14.824451 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.824387 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xt7bv\" (UniqueName: \"kubernetes.io/projected/8d537a43-c31b-4ed7-af8d-bab64bcdbbab-kube-api-access-xt7bv\") pod \"multus-additional-cni-plugins-pb4lc\" (UID: \"8d537a43-c31b-4ed7-af8d-bab64bcdbbab\") " pod="openshift-multus/multus-additional-cni-plugins-pb4lc" Jul 24 13:43:14.824451 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.824438 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cb920d79-442e-4835-96ca-66a2c62e6fad-original-pull-secret\") pod \"global-pull-secret-syncer-n845m\" (UID: \"cb920d79-442e-4835-96ca-66a2c62e6fad\") " pod="kube-system/global-pull-secret-syncer-n845m" Jul 24 13:43:14.824451 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.824442 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6e1b6e6b-98de-4c10-b588-219aec745e0d-host-var-lib-cni-multus\") pod \"multus-h26v2\" (UID: \"6e1b6e6b-98de-4c10-b588-219aec745e0d\") " pod="openshift-multus/multus-h26v2" Jul 24 13:43:14.824601 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.824474 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ee406d9c-d1b9-4ffb-b506-6d0e74521dec-ovn-node-metrics-cert\") pod \"ovnkube-node-vfwll\" (UID: \"ee406d9c-d1b9-4ffb-b506-6d0e74521dec\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfwll" Jul 24 13:43:14.824601 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.824507 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6861d7e0-aeed-4f23-9da8-4305dd94ebfa-host\") pod \"tuned-dddtw\" (UID: \"6861d7e0-aeed-4f23-9da8-4305dd94ebfa\") " pod="openshift-cluster-node-tuning-operator/tuned-dddtw" Jul 24 13:43:14.824601 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.824518 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8d537a43-c31b-4ed7-af8d-bab64bcdbbab-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pb4lc\" (UID: \"8d537a43-c31b-4ed7-af8d-bab64bcdbbab\") " pod="openshift-multus/multus-additional-cni-plugins-pb4lc" Jul 24 13:43:14.824601 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:43:14.824553 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 24 13:43:14.824601 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.824551 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ee406d9c-d1b9-4ffb-b506-6d0e74521dec-host-cni-bin\") pod \"ovnkube-node-vfwll\" (UID: \"ee406d9c-d1b9-4ffb-b506-6d0e74521dec\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfwll" Jul 24 13:43:14.824601 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.824580 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d4f67a92-c219-46a3-8604-387b40ab9ff9-registration-dir\") pod \"aws-ebs-csi-driver-node-8x4db\" (UID: \"d4f67a92-c219-46a3-8604-387b40ab9ff9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8x4db" Jul 24 13:43:14.824766 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.824599 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k4zjs\" (UniqueName: \"kubernetes.io/projected/20a8559f-d049-4fac-b14a-5a1d2aaa1aa9-kube-api-access-k4zjs\") pod \"network-metrics-daemon-f8gm6\" (UID: \"20a8559f-d049-4fac-b14a-5a1d2aaa1aa9\") " pod="openshift-multus/network-metrics-daemon-f8gm6" Jul 24 13:43:14.824766 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.824638 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6e1b6e6b-98de-4c10-b588-219aec745e0d-hostroot\") pod \"multus-h26v2\" (UID: \"6e1b6e6b-98de-4c10-b588-219aec745e0d\") " pod="openshift-multus/multus-h26v2" Jul 24 13:43:14.824766 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.824664 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8d537a43-c31b-4ed7-af8d-bab64bcdbbab-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pb4lc\" (UID: \"8d537a43-c31b-4ed7-af8d-bab64bcdbbab\") " pod="openshift-multus/multus-additional-cni-plugins-pb4lc" Jul 24 13:43:14.824766 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.824676 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/cb920d79-442e-4835-96ca-66a2c62e6fad-dbus\") pod \"global-pull-secret-syncer-n845m\" (UID: \"cb920d79-442e-4835-96ca-66a2c62e6fad\") " pod="kube-system/global-pull-secret-syncer-n845m" Jul 24 13:43:14.824766 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:43:14.824722 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb920d79-442e-4835-96ca-66a2c62e6fad-original-pull-secret podName:cb920d79-442e-4835-96ca-66a2c62e6fad nodeName:}" failed. No retries permitted until 2026-07-24 13:43:15.324700505 +0000 UTC m=+2.982677891 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cb920d79-442e-4835-96ca-66a2c62e6fad-original-pull-secret") pod "global-pull-secret-syncer-n845m" (UID: "cb920d79-442e-4835-96ca-66a2c62e6fad") : object "kube-system"/"original-pull-secret" not registered Jul 24 13:43:14.824943 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.824769 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8d537a43-c31b-4ed7-af8d-bab64bcdbbab-os-release\") pod \"multus-additional-cni-plugins-pb4lc\" (UID: \"8d537a43-c31b-4ed7-af8d-bab64bcdbbab\") " pod="openshift-multus/multus-additional-cni-plugins-pb4lc" Jul 24 13:43:14.824943 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.824390 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1df394aa-3709-4031-b25f-40bf8b36331a-serviceca\") pod \"node-ca-n2fq4\" (UID: \"1df394aa-3709-4031-b25f-40bf8b36331a\") " pod="openshift-image-registry/node-ca-n2fq4" Jul 24 13:43:14.824943 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.824814 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d4f67a92-c219-46a3-8604-387b40ab9ff9-device-dir\") pod \"aws-ebs-csi-driver-node-8x4db\" (UID: \"d4f67a92-c219-46a3-8604-387b40ab9ff9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8x4db" Jul 24 13:43:14.824943 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.824853 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ee406d9c-d1b9-4ffb-b506-6d0e74521dec-log-socket\") pod \"ovnkube-node-vfwll\" (UID: \"ee406d9c-d1b9-4ffb-b506-6d0e74521dec\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfwll" Jul 24 13:43:14.824943 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.824862 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6e1b6e6b-98de-4c10-b588-219aec745e0d-host-run-k8s-cni-cncf-io\") pod \"multus-h26v2\" (UID: \"6e1b6e6b-98de-4c10-b588-219aec745e0d\") " pod="openshift-multus/multus-h26v2" Jul 24 13:43:14.824943 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.824883 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ee406d9c-d1b9-4ffb-b506-6d0e74521dec-host-run-ovn-kubernetes\") pod \"ovnkube-node-vfwll\" (UID: \"ee406d9c-d1b9-4ffb-b506-6d0e74521dec\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfwll" Jul 24 13:43:14.824943 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.824917 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6e1b6e6b-98de-4c10-b588-219aec745e0d-cnibin\") pod \"multus-h26v2\" (UID: \"6e1b6e6b-98de-4c10-b588-219aec745e0d\") " pod="openshift-multus/multus-h26v2" Jul 24 13:43:14.824943 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.824924 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6e1b6e6b-98de-4c10-b588-219aec745e0d-host-run-netns\") pod \"multus-h26v2\" (UID: \"6e1b6e6b-98de-4c10-b588-219aec745e0d\") " pod="openshift-multus/multus-h26v2" Jul 24 13:43:14.825203 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.824955 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d4f67a92-c219-46a3-8604-387b40ab9ff9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8x4db\" (UID: \"d4f67a92-c219-46a3-8604-387b40ab9ff9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8x4db" Jul 24 13:43:14.825203 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.824962 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ee406d9c-d1b9-4ffb-b506-6d0e74521dec-host-run-netns\") pod \"ovnkube-node-vfwll\" (UID: \"ee406d9c-d1b9-4ffb-b506-6d0e74521dec\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfwll" Jul 24 13:43:14.825203 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.824984 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d4f67a92-c219-46a3-8604-387b40ab9ff9-etc-selinux\") pod \"aws-ebs-csi-driver-node-8x4db\" (UID: \"d4f67a92-c219-46a3-8604-387b40ab9ff9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8x4db" Jul 24 13:43:14.825203 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.824996 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ee406d9c-d1b9-4ffb-b506-6d0e74521dec-run-ovn\") pod \"ovnkube-node-vfwll\" (UID: \"ee406d9c-d1b9-4ffb-b506-6d0e74521dec\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfwll" Jul 24 13:43:14.825203 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.825031 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ee406d9c-d1b9-4ffb-b506-6d0e74521dec-node-log\") pod \"ovnkube-node-vfwll\" (UID: \"ee406d9c-d1b9-4ffb-b506-6d0e74521dec\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfwll" Jul 24 13:43:14.825203 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.825059 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ee406d9c-d1b9-4ffb-b506-6d0e74521dec-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vfwll\" (UID: \"ee406d9c-d1b9-4ffb-b506-6d0e74521dec\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfwll" Jul 24 13:43:14.825203 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.825086 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/bd2d0507-3736-448c-91f7-a12d0db7cff1-agent-certs\") pod \"konnectivity-agent-txls2\" (UID: \"bd2d0507-3736-448c-91f7-a12d0db7cff1\") " pod="kube-system/konnectivity-agent-txls2" Jul 24 13:43:14.825203 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.825111 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ee406d9c-d1b9-4ffb-b506-6d0e74521dec-host-kubelet\") pod \"ovnkube-node-vfwll\" (UID: \"ee406d9c-d1b9-4ffb-b506-6d0e74521dec\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfwll" Jul 24 13:43:14.825203 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.825138 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ee406d9c-d1b9-4ffb-b506-6d0e74521dec-systemd-units\") pod \"ovnkube-node-vfwll\" (UID: \"ee406d9c-d1b9-4ffb-b506-6d0e74521dec\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfwll" Jul 24 13:43:14.825203 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.825168 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6861d7e0-aeed-4f23-9da8-4305dd94ebfa-lib-modules\") pod \"tuned-dddtw\" (UID: \"6861d7e0-aeed-4f23-9da8-4305dd94ebfa\") " pod="openshift-cluster-node-tuning-operator/tuned-dddtw" Jul 24 13:43:14.825203 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.825194 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1df394aa-3709-4031-b25f-40bf8b36331a-host\") pod \"node-ca-n2fq4\" (UID: \"1df394aa-3709-4031-b25f-40bf8b36331a\") " pod="openshift-image-registry/node-ca-n2fq4" Jul 24 13:43:14.825614 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.825221 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6e1b6e6b-98de-4c10-b588-219aec745e0d-os-release\") pod \"multus-h26v2\" (UID: \"6e1b6e6b-98de-4c10-b588-219aec745e0d\") " pod="openshift-multus/multus-h26v2" Jul 24 13:43:14.825614 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.825244 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/59bcaef9-a21b-4634-a7ad-ed417b8e835a-iptables-alerter-script\") pod \"iptables-alerter-782cv\" (UID: \"59bcaef9-a21b-4634-a7ad-ed417b8e835a\") " pod="openshift-network-operator/iptables-alerter-782cv" Jul 24 13:43:14.825614 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.825251 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q9b8f\" (UniqueName: \"kubernetes.io/projected/503c5389-fcf1-4589-904d-1bf1261baace-kube-api-access-q9b8f\") pod \"network-check-target-5jqwl\" (UID: \"503c5389-fcf1-4589-904d-1bf1261baace\") " pod="openshift-network-diagnostics/network-check-target-5jqwl" Jul 24 13:43:14.825614 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.825294 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ee406d9c-d1b9-4ffb-b506-6d0e74521dec-run-openvswitch\") pod \"ovnkube-node-vfwll\" (UID: \"ee406d9c-d1b9-4ffb-b506-6d0e74521dec\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfwll" Jul 24 13:43:14.825614 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.825325 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/535b3d7b-9b08-4a89-a61c-f44fcff4e888-tmp-dir\") pod \"node-resolver-xcdv9\" (UID: \"535b3d7b-9b08-4a89-a61c-f44fcff4e888\") " pod="openshift-dns/node-resolver-xcdv9" Jul 24 13:43:14.825614 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.825349 2578 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 24 13:43:14.825614 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.825490 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6e1b6e6b-98de-4c10-b588-219aec745e0d-multus-cni-dir\") pod \"multus-h26v2\" (UID: \"6e1b6e6b-98de-4c10-b588-219aec745e0d\") " pod="openshift-multus/multus-h26v2" Jul 24 13:43:14.825614 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.825505 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/cb920d79-442e-4835-96ca-66a2c62e6fad-dbus\") pod \"global-pull-secret-syncer-n845m\" (UID: \"cb920d79-442e-4835-96ca-66a2c62e6fad\") " pod="kube-system/global-pull-secret-syncer-n845m" Jul 24 13:43:14.825614 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.825545 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ee406d9c-d1b9-4ffb-b506-6d0e74521dec-etc-openvswitch\") pod \"ovnkube-node-vfwll\" (UID: \"ee406d9c-d1b9-4ffb-b506-6d0e74521dec\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfwll" Jul 24 13:43:14.825614 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.825551 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ee406d9c-d1b9-4ffb-b506-6d0e74521dec-systemd-units\") pod \"ovnkube-node-vfwll\" (UID: \"ee406d9c-d1b9-4ffb-b506-6d0e74521dec\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfwll" Jul 24 13:43:14.825614 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.825551 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6861d7e0-aeed-4f23-9da8-4305dd94ebfa-etc-modprobe-d\") pod \"tuned-dddtw\" (UID: \"6861d7e0-aeed-4f23-9da8-4305dd94ebfa\") " pod="openshift-cluster-node-tuning-operator/tuned-dddtw" Jul 24 13:43:14.825614 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.825586 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6e1b6e6b-98de-4c10-b588-219aec745e0d-hostroot\") pod \"multus-h26v2\" (UID: \"6e1b6e6b-98de-4c10-b588-219aec745e0d\") " pod="openshift-multus/multus-h26v2" Jul 24 13:43:14.825614 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.825590 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6861d7e0-aeed-4f23-9da8-4305dd94ebfa-etc-sysconfig\") pod \"tuned-dddtw\" (UID: \"6861d7e0-aeed-4f23-9da8-4305dd94ebfa\") " pod="openshift-cluster-node-tuning-operator/tuned-dddtw" Jul 24 13:43:14.826002 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.825657 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ee406d9c-d1b9-4ffb-b506-6d0e74521dec-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vfwll\" (UID: \"ee406d9c-d1b9-4ffb-b506-6d0e74521dec\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfwll" Jul 24 13:43:14.826002 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.825695 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ee406d9c-d1b9-4ffb-b506-6d0e74521dec-node-log\") pod \"ovnkube-node-vfwll\" (UID: \"ee406d9c-d1b9-4ffb-b506-6d0e74521dec\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfwll" Jul 24 13:43:14.826002 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.825699 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/59bcaef9-a21b-4634-a7ad-ed417b8e835a-host-slash\") pod \"iptables-alerter-782cv\" (UID: \"59bcaef9-a21b-4634-a7ad-ed417b8e835a\") " pod="openshift-network-operator/iptables-alerter-782cv" Jul 24 13:43:14.826002 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.825727 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1df394aa-3709-4031-b25f-40bf8b36331a-host\") pod \"node-ca-n2fq4\" (UID: \"1df394aa-3709-4031-b25f-40bf8b36331a\") " pod="openshift-image-registry/node-ca-n2fq4" Jul 24 13:43:14.826002 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.825763 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6e1b6e6b-98de-4c10-b588-219aec745e0d-os-release\") pod \"multus-h26v2\" (UID: \"6e1b6e6b-98de-4c10-b588-219aec745e0d\") " pod="openshift-multus/multus-h26v2" Jul 24 13:43:14.826002 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.825795 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6e1b6e6b-98de-4c10-b588-219aec745e0d-host-var-lib-kubelet\") pod \"multus-h26v2\" (UID: \"6e1b6e6b-98de-4c10-b588-219aec745e0d\") " pod="openshift-multus/multus-h26v2" Jul 24 13:43:14.826002 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.825812 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ee406d9c-d1b9-4ffb-b506-6d0e74521dec-host-kubelet\") pod \"ovnkube-node-vfwll\" (UID: \"ee406d9c-d1b9-4ffb-b506-6d0e74521dec\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfwll" Jul 24 13:43:14.826002 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.825861 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d4f67a92-c219-46a3-8604-387b40ab9ff9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8x4db\" (UID: \"d4f67a92-c219-46a3-8604-387b40ab9ff9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8x4db" Jul 24 13:43:14.826002 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.825932 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d4f67a92-c219-46a3-8604-387b40ab9ff9-etc-selinux\") pod \"aws-ebs-csi-driver-node-8x4db\" (UID: \"d4f67a92-c219-46a3-8604-387b40ab9ff9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8x4db" Jul 24 13:43:14.826350 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.826048 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6e1b6e6b-98de-4c10-b588-219aec745e0d-cni-binary-copy\") pod \"multus-h26v2\" (UID: \"6e1b6e6b-98de-4c10-b588-219aec745e0d\") " pod="openshift-multus/multus-h26v2" Jul 24 13:43:14.826350 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.826105 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8d537a43-c31b-4ed7-af8d-bab64bcdbbab-system-cni-dir\") pod \"multus-additional-cni-plugins-pb4lc\" (UID: \"8d537a43-c31b-4ed7-af8d-bab64bcdbbab\") " pod="openshift-multus/multus-additional-cni-plugins-pb4lc" Jul 24 13:43:14.826571 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.826523 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6e1b6e6b-98de-4c10-b588-219aec745e0d-multus-daemon-config\") pod \"multus-h26v2\" (UID: \"6e1b6e6b-98de-4c10-b588-219aec745e0d\") " pod="openshift-multus/multus-h26v2" Jul 24 13:43:14.829899 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.829622 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ee406d9c-d1b9-4ffb-b506-6d0e74521dec-ovn-node-metrics-cert\") pod \"ovnkube-node-vfwll\" (UID: \"ee406d9c-d1b9-4ffb-b506-6d0e74521dec\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfwll" Jul 24 13:43:14.829899 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.829839 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pxv7b\" (UniqueName: \"kubernetes.io/projected/6e1b6e6b-98de-4c10-b588-219aec745e0d-kube-api-access-pxv7b\") pod \"multus-h26v2\" (UID: \"6e1b6e6b-98de-4c10-b588-219aec745e0d\") " pod="openshift-multus/multus-h26v2" Jul 24 13:43:14.830050 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.829915 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/bd2d0507-3736-448c-91f7-a12d0db7cff1-agent-certs\") pod \"konnectivity-agent-txls2\" (UID: \"bd2d0507-3736-448c-91f7-a12d0db7cff1\") " pod="kube-system/konnectivity-agent-txls2" Jul 24 13:43:14.831571 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:43:14.831550 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 24 13:43:14.831705 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:43:14.831578 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 24 13:43:14.831705 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:43:14.831593 2578 projected.go:196] Error preparing data for projected volume kube-api-access-q9b8f for pod openshift-network-diagnostics/network-check-target-5jqwl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 13:43:14.831705 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:43:14.831661 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/503c5389-fcf1-4589-904d-1bf1261baace-kube-api-access-q9b8f podName:503c5389-fcf1-4589-904d-1bf1261baace nodeName:}" failed. No retries permitted until 2026-07-24 13:43:15.331641797 +0000 UTC m=+2.989619161 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-q9b8f" (UniqueName: "kubernetes.io/projected/503c5389-fcf1-4589-904d-1bf1261baace-kube-api-access-q9b8f") pod "network-check-target-5jqwl" (UID: "503c5389-fcf1-4589-904d-1bf1261baace") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 13:43:14.832246 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.832220 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8qf9l\" (UniqueName: \"kubernetes.io/projected/59bcaef9-a21b-4634-a7ad-ed417b8e835a-kube-api-access-8qf9l\") pod \"iptables-alerter-782cv\" (UID: \"59bcaef9-a21b-4634-a7ad-ed417b8e835a\") " pod="openshift-network-operator/iptables-alerter-782cv" Jul 24 13:43:14.833040 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.833013 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xt7bv\" (UniqueName: \"kubernetes.io/projected/8d537a43-c31b-4ed7-af8d-bab64bcdbbab-kube-api-access-xt7bv\") pod \"multus-additional-cni-plugins-pb4lc\" (UID: \"8d537a43-c31b-4ed7-af8d-bab64bcdbbab\") " pod="openshift-multus/multus-additional-cni-plugins-pb4lc" Jul 24 13:43:14.833369 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.833257 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p46n4\" (UniqueName: \"kubernetes.io/projected/535b3d7b-9b08-4a89-a61c-f44fcff4e888-kube-api-access-p46n4\") pod \"node-resolver-xcdv9\" (UID: \"535b3d7b-9b08-4a89-a61c-f44fcff4e888\") " pod="openshift-dns/node-resolver-xcdv9" Jul 24 13:43:14.833655 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.833638 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nvkgr\" (UniqueName: \"kubernetes.io/projected/1df394aa-3709-4031-b25f-40bf8b36331a-kube-api-access-nvkgr\") pod \"node-ca-n2fq4\" (UID: \"1df394aa-3709-4031-b25f-40bf8b36331a\") " pod="openshift-image-registry/node-ca-n2fq4" Jul 24 13:43:14.833996 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.833975 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8jcw\" (UniqueName: \"kubernetes.io/projected/d4f67a92-c219-46a3-8604-387b40ab9ff9-kube-api-access-k8jcw\") pod \"aws-ebs-csi-driver-node-8x4db\" (UID: \"d4f67a92-c219-46a3-8604-387b40ab9ff9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8x4db" Jul 24 13:43:14.836678 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.836630 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9p7cm\" (UniqueName: \"kubernetes.io/projected/ee406d9c-d1b9-4ffb-b506-6d0e74521dec-kube-api-access-9p7cm\") pod \"ovnkube-node-vfwll\" (UID: \"ee406d9c-d1b9-4ffb-b506-6d0e74521dec\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfwll" Jul 24 13:43:14.919785 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.919726 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-93.ec2.internal" event={"ID":"263f5bb8d2ec60e406679313252c6a79","Type":"ContainerStarted","Data":"b0af304bafadb8d4395177f368e1ec1013551de3e6ec3c251b733199d0187eda"} Jul 24 13:43:14.921205 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.921063 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-93.ec2.internal" event={"ID":"8ca0c9160c9c9500cb20dabfbd81e94f","Type":"ContainerStarted","Data":"ce35840d5d1a0bf7859e1dc33c9be4df2124f41a2fe12c77f8aa995238125554"} Jul 24 13:43:14.926402 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.926368 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6861d7e0-aeed-4f23-9da8-4305dd94ebfa-sys\") pod \"tuned-dddtw\" (UID: \"6861d7e0-aeed-4f23-9da8-4305dd94ebfa\") " pod="openshift-cluster-node-tuning-operator/tuned-dddtw" Jul 24 13:43:14.926550 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.926434 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6861d7e0-aeed-4f23-9da8-4305dd94ebfa-etc-sysctl-d\") pod \"tuned-dddtw\" (UID: \"6861d7e0-aeed-4f23-9da8-4305dd94ebfa\") " pod="openshift-cluster-node-tuning-operator/tuned-dddtw" Jul 24 13:43:14.926550 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.926464 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6861d7e0-aeed-4f23-9da8-4305dd94ebfa-etc-systemd\") pod \"tuned-dddtw\" (UID: \"6861d7e0-aeed-4f23-9da8-4305dd94ebfa\") " pod="openshift-cluster-node-tuning-operator/tuned-dddtw" Jul 24 13:43:14.926550 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.926493 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6861d7e0-aeed-4f23-9da8-4305dd94ebfa-etc-sysctl-conf\") pod \"tuned-dddtw\" (UID: \"6861d7e0-aeed-4f23-9da8-4305dd94ebfa\") " pod="openshift-cluster-node-tuning-operator/tuned-dddtw" Jul 24 13:43:14.926550 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.926503 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6861d7e0-aeed-4f23-9da8-4305dd94ebfa-sys\") pod \"tuned-dddtw\" (UID: \"6861d7e0-aeed-4f23-9da8-4305dd94ebfa\") " pod="openshift-cluster-node-tuning-operator/tuned-dddtw" Jul 24 13:43:14.926550 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.926514 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6861d7e0-aeed-4f23-9da8-4305dd94ebfa-run\") pod \"tuned-dddtw\" (UID: \"6861d7e0-aeed-4f23-9da8-4305dd94ebfa\") " pod="openshift-cluster-node-tuning-operator/tuned-dddtw" Jul 24 13:43:14.926794 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.926568 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6861d7e0-aeed-4f23-9da8-4305dd94ebfa-run\") pod \"tuned-dddtw\" (UID: \"6861d7e0-aeed-4f23-9da8-4305dd94ebfa\") " pod="openshift-cluster-node-tuning-operator/tuned-dddtw" Jul 24 13:43:14.926794 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.926569 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6861d7e0-aeed-4f23-9da8-4305dd94ebfa-host\") pod \"tuned-dddtw\" (UID: \"6861d7e0-aeed-4f23-9da8-4305dd94ebfa\") " pod="openshift-cluster-node-tuning-operator/tuned-dddtw" Jul 24 13:43:14.926794 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.926611 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k4zjs\" (UniqueName: \"kubernetes.io/projected/20a8559f-d049-4fac-b14a-5a1d2aaa1aa9-kube-api-access-k4zjs\") pod \"network-metrics-daemon-f8gm6\" (UID: \"20a8559f-d049-4fac-b14a-5a1d2aaa1aa9\") " pod="openshift-multus/network-metrics-daemon-f8gm6" Jul 24 13:43:14.926794 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.926612 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6861d7e0-aeed-4f23-9da8-4305dd94ebfa-host\") pod \"tuned-dddtw\" (UID: \"6861d7e0-aeed-4f23-9da8-4305dd94ebfa\") " pod="openshift-cluster-node-tuning-operator/tuned-dddtw" Jul 24 13:43:14.926794 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.926635 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6861d7e0-aeed-4f23-9da8-4305dd94ebfa-lib-modules\") pod \"tuned-dddtw\" (UID: \"6861d7e0-aeed-4f23-9da8-4305dd94ebfa\") " pod="openshift-cluster-node-tuning-operator/tuned-dddtw" Jul 24 13:43:14.926794 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.926671 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6861d7e0-aeed-4f23-9da8-4305dd94ebfa-etc-modprobe-d\") pod \"tuned-dddtw\" (UID: \"6861d7e0-aeed-4f23-9da8-4305dd94ebfa\") " pod="openshift-cluster-node-tuning-operator/tuned-dddtw" Jul 24 13:43:14.926794 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.926690 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6861d7e0-aeed-4f23-9da8-4305dd94ebfa-etc-sysconfig\") pod \"tuned-dddtw\" (UID: \"6861d7e0-aeed-4f23-9da8-4305dd94ebfa\") " pod="openshift-cluster-node-tuning-operator/tuned-dddtw" Jul 24 13:43:14.926794 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.926706 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6861d7e0-aeed-4f23-9da8-4305dd94ebfa-etc-kubernetes\") pod \"tuned-dddtw\" (UID: \"6861d7e0-aeed-4f23-9da8-4305dd94ebfa\") " pod="openshift-cluster-node-tuning-operator/tuned-dddtw" Jul 24 13:43:14.926794 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.926740 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6861d7e0-aeed-4f23-9da8-4305dd94ebfa-etc-sysctl-conf\") pod \"tuned-dddtw\" (UID: \"6861d7e0-aeed-4f23-9da8-4305dd94ebfa\") " pod="openshift-cluster-node-tuning-operator/tuned-dddtw" Jul 24 13:43:14.926794 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.926745 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6861d7e0-aeed-4f23-9da8-4305dd94ebfa-tmp\") pod \"tuned-dddtw\" (UID: \"6861d7e0-aeed-4f23-9da8-4305dd94ebfa\") " pod="openshift-cluster-node-tuning-operator/tuned-dddtw" Jul 24 13:43:14.927249 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.926863 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjtln\" (UniqueName: \"kubernetes.io/projected/6861d7e0-aeed-4f23-9da8-4305dd94ebfa-kube-api-access-rjtln\") pod \"tuned-dddtw\" (UID: \"6861d7e0-aeed-4f23-9da8-4305dd94ebfa\") " pod="openshift-cluster-node-tuning-operator/tuned-dddtw" Jul 24 13:43:14.927249 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.926902 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6861d7e0-aeed-4f23-9da8-4305dd94ebfa-etc-tuned\") pod \"tuned-dddtw\" (UID: \"6861d7e0-aeed-4f23-9da8-4305dd94ebfa\") " pod="openshift-cluster-node-tuning-operator/tuned-dddtw" Jul 24 13:43:14.927249 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.926929 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6861d7e0-aeed-4f23-9da8-4305dd94ebfa-var-lib-kubelet\") pod \"tuned-dddtw\" (UID: \"6861d7e0-aeed-4f23-9da8-4305dd94ebfa\") " pod="openshift-cluster-node-tuning-operator/tuned-dddtw" Jul 24 13:43:14.927249 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.926968 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/20a8559f-d049-4fac-b14a-5a1d2aaa1aa9-metrics-certs\") pod \"network-metrics-daemon-f8gm6\" (UID: \"20a8559f-d049-4fac-b14a-5a1d2aaa1aa9\") " pod="openshift-multus/network-metrics-daemon-f8gm6" Jul 24 13:43:14.927249 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:43:14.927086 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 13:43:14.927249 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.927088 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6861d7e0-aeed-4f23-9da8-4305dd94ebfa-lib-modules\") pod \"tuned-dddtw\" (UID: \"6861d7e0-aeed-4f23-9da8-4305dd94ebfa\") " pod="openshift-cluster-node-tuning-operator/tuned-dddtw" Jul 24 13:43:14.927249 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:43:14.927146 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20a8559f-d049-4fac-b14a-5a1d2aaa1aa9-metrics-certs podName:20a8559f-d049-4fac-b14a-5a1d2aaa1aa9 nodeName:}" failed. No retries permitted until 2026-07-24 13:43:15.427125533 +0000 UTC m=+3.085102910 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/20a8559f-d049-4fac-b14a-5a1d2aaa1aa9-metrics-certs") pod "network-metrics-daemon-f8gm6" (UID: "20a8559f-d049-4fac-b14a-5a1d2aaa1aa9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 13:43:14.927249 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.927174 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6861d7e0-aeed-4f23-9da8-4305dd94ebfa-etc-systemd\") pod \"tuned-dddtw\" (UID: \"6861d7e0-aeed-4f23-9da8-4305dd94ebfa\") " pod="openshift-cluster-node-tuning-operator/tuned-dddtw" Jul 24 13:43:14.927663 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.927407 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6861d7e0-aeed-4f23-9da8-4305dd94ebfa-etc-sysconfig\") pod \"tuned-dddtw\" (UID: \"6861d7e0-aeed-4f23-9da8-4305dd94ebfa\") " pod="openshift-cluster-node-tuning-operator/tuned-dddtw" Jul 24 13:43:14.927663 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.927440 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6861d7e0-aeed-4f23-9da8-4305dd94ebfa-etc-sysctl-d\") pod \"tuned-dddtw\" (UID: \"6861d7e0-aeed-4f23-9da8-4305dd94ebfa\") " pod="openshift-cluster-node-tuning-operator/tuned-dddtw" Jul 24 13:43:14.927663 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.927437 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6861d7e0-aeed-4f23-9da8-4305dd94ebfa-etc-modprobe-d\") pod \"tuned-dddtw\" (UID: \"6861d7e0-aeed-4f23-9da8-4305dd94ebfa\") " pod="openshift-cluster-node-tuning-operator/tuned-dddtw" Jul 24 13:43:14.927663 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.927450 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6861d7e0-aeed-4f23-9da8-4305dd94ebfa-etc-kubernetes\") pod \"tuned-dddtw\" (UID: \"6861d7e0-aeed-4f23-9da8-4305dd94ebfa\") " pod="openshift-cluster-node-tuning-operator/tuned-dddtw" Jul 24 13:43:14.927663 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.927529 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6861d7e0-aeed-4f23-9da8-4305dd94ebfa-var-lib-kubelet\") pod \"tuned-dddtw\" (UID: \"6861d7e0-aeed-4f23-9da8-4305dd94ebfa\") " pod="openshift-cluster-node-tuning-operator/tuned-dddtw" Jul 24 13:43:14.929574 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.929550 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6861d7e0-aeed-4f23-9da8-4305dd94ebfa-tmp\") pod \"tuned-dddtw\" (UID: \"6861d7e0-aeed-4f23-9da8-4305dd94ebfa\") " pod="openshift-cluster-node-tuning-operator/tuned-dddtw" Jul 24 13:43:14.929709 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.929683 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6861d7e0-aeed-4f23-9da8-4305dd94ebfa-etc-tuned\") pod \"tuned-dddtw\" (UID: \"6861d7e0-aeed-4f23-9da8-4305dd94ebfa\") " pod="openshift-cluster-node-tuning-operator/tuned-dddtw" Jul 24 13:43:14.939365 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.939304 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k4zjs\" (UniqueName: \"kubernetes.io/projected/20a8559f-d049-4fac-b14a-5a1d2aaa1aa9-kube-api-access-k4zjs\") pod \"network-metrics-daemon-f8gm6\" (UID: \"20a8559f-d049-4fac-b14a-5a1d2aaa1aa9\") " pod="openshift-multus/network-metrics-daemon-f8gm6" Jul 24 13:43:14.939365 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:14.939346 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rjtln\" (UniqueName: \"kubernetes.io/projected/6861d7e0-aeed-4f23-9da8-4305dd94ebfa-kube-api-access-rjtln\") pod \"tuned-dddtw\" (UID: \"6861d7e0-aeed-4f23-9da8-4305dd94ebfa\") " pod="openshift-cluster-node-tuning-operator/tuned-dddtw" Jul 24 13:43:15.015361 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:15.015327 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-782cv" Jul 24 13:43:15.022452 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:15.022422 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-vfwll" Jul 24 13:43:15.034544 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:15.034517 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-txls2" Jul 24 13:43:15.041625 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:15.041598 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-xcdv9" Jul 24 13:43:15.049674 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:15.049641 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-n2fq4" Jul 24 13:43:15.058739 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:15.058717 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-pb4lc" Jul 24 13:43:15.067031 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:15.067010 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-h26v2" Jul 24 13:43:15.076237 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:15.076215 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8x4db" Jul 24 13:43:15.082578 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:15.082559 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-dddtw" Jul 24 13:43:15.213792 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:15.213710 2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 24 13:43:15.329813 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:15.329777 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cb920d79-442e-4835-96ca-66a2c62e6fad-original-pull-secret\") pod \"global-pull-secret-syncer-n845m\" (UID: \"cb920d79-442e-4835-96ca-66a2c62e6fad\") " pod="kube-system/global-pull-secret-syncer-n845m" Jul 24 13:43:15.329981 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:43:15.329954 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 24 13:43:15.330049 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:43:15.330032 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb920d79-442e-4835-96ca-66a2c62e6fad-original-pull-secret podName:cb920d79-442e-4835-96ca-66a2c62e6fad nodeName:}" failed. No retries permitted until 2026-07-24 13:43:16.330014339 +0000 UTC m=+3.987991720 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cb920d79-442e-4835-96ca-66a2c62e6fad-original-pull-secret") pod "global-pull-secret-syncer-n845m" (UID: "cb920d79-442e-4835-96ca-66a2c62e6fad") : object "kube-system"/"original-pull-secret" not registered Jul 24 13:43:15.430310 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:15.430274 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q9b8f\" (UniqueName: \"kubernetes.io/projected/503c5389-fcf1-4589-904d-1bf1261baace-kube-api-access-q9b8f\") pod \"network-check-target-5jqwl\" (UID: \"503c5389-fcf1-4589-904d-1bf1261baace\") " pod="openshift-network-diagnostics/network-check-target-5jqwl" Jul 24 13:43:15.430501 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:15.430324 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/20a8559f-d049-4fac-b14a-5a1d2aaa1aa9-metrics-certs\") pod \"network-metrics-daemon-f8gm6\" (UID: \"20a8559f-d049-4fac-b14a-5a1d2aaa1aa9\") " pod="openshift-multus/network-metrics-daemon-f8gm6" Jul 24 13:43:15.430501 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:43:15.430440 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 13:43:15.430501 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:43:15.430467 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 24 13:43:15.430501 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:43:15.430493 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20a8559f-d049-4fac-b14a-5a1d2aaa1aa9-metrics-certs podName:20a8559f-d049-4fac-b14a-5a1d2aaa1aa9 nodeName:}" failed. No retries permitted until 2026-07-24 13:43:16.430478847 +0000 UTC m=+4.088456211 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/20a8559f-d049-4fac-b14a-5a1d2aaa1aa9-metrics-certs") pod "network-metrics-daemon-f8gm6" (UID: "20a8559f-d049-4fac-b14a-5a1d2aaa1aa9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 13:43:15.430710 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:43:15.430510 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 24 13:43:15.430710 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:43:15.430524 2578 projected.go:196] Error preparing data for projected volume kube-api-access-q9b8f for pod openshift-network-diagnostics/network-check-target-5jqwl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 13:43:15.430710 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:43:15.430582 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/503c5389-fcf1-4589-904d-1bf1261baace-kube-api-access-q9b8f podName:503c5389-fcf1-4589-904d-1bf1261baace nodeName:}" failed. No retries permitted until 2026-07-24 13:43:16.430564651 +0000 UTC m=+4.088542032 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-q9b8f" (UniqueName: "kubernetes.io/projected/503c5389-fcf1-4589-904d-1bf1261baace-kube-api-access-q9b8f") pod "network-check-target-5jqwl" (UID: "503c5389-fcf1-4589-904d-1bf1261baace") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 13:43:15.748986 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:15.748917 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-23 13:38:13 +0000 UTC" deadline="2028-05-05 18:37:17.231277834 +0000 UTC" Jul 24 13:43:15.748986 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:15.748979 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15628h54m1.482302796s" Jul 24 13:43:15.962935 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:15.962904 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59bcaef9_a21b_4634_a7ad_ed417b8e835a.slice/crio-e83cdd3aac1c1bed89d477f4584fd0829f535c69d71d746ac7f22f55f0d211b9 WatchSource:0}: Error finding container e83cdd3aac1c1bed89d477f4584fd0829f535c69d71d746ac7f22f55f0d211b9: Status 404 returned error can't find the container with id e83cdd3aac1c1bed89d477f4584fd0829f535c69d71d746ac7f22f55f0d211b9 Jul 24 13:43:15.964352 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:15.964327 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1df394aa_3709_4031_b25f_40bf8b36331a.slice/crio-6a32f38811841695dd6894f798585ec773e85466962624b998632a387d56a06a WatchSource:0}: Error finding container 6a32f38811841695dd6894f798585ec773e85466962624b998632a387d56a06a: Status 404 returned error can't find the container with id 6a32f38811841695dd6894f798585ec773e85466962624b998632a387d56a06a Jul 24 13:43:15.967925 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:15.967846 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee406d9c_d1b9_4ffb_b506_6d0e74521dec.slice/crio-38d39c11a16f5aa97a2ade2f8a3b3d4b9b3ce5e0b5fe02fcaed6ac79ebb7d8c4 WatchSource:0}: Error finding container 38d39c11a16f5aa97a2ade2f8a3b3d4b9b3ce5e0b5fe02fcaed6ac79ebb7d8c4: Status 404 returned error can't find the container with id 38d39c11a16f5aa97a2ade2f8a3b3d4b9b3ce5e0b5fe02fcaed6ac79ebb7d8c4 Jul 24 13:43:15.968687 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:15.968666 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d537a43_c31b_4ed7_af8d_bab64bcdbbab.slice/crio-c6bd95bb4702f0cad1cdb708c2ee0e6727e6e3634ea66b8aef82bdb0e7c1f88c WatchSource:0}: Error finding container c6bd95bb4702f0cad1cdb708c2ee0e6727e6e3634ea66b8aef82bdb0e7c1f88c: Status 404 returned error can't find the container with id c6bd95bb4702f0cad1cdb708c2ee0e6727e6e3634ea66b8aef82bdb0e7c1f88c Jul 24 13:43:15.969682 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:15.969595 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e1b6e6b_98de_4c10_b588_219aec745e0d.slice/crio-37a4fc115b08d2144b0670128812a076fca6c47de4d74058c61b135ab1eff2b6 WatchSource:0}: Error finding container 37a4fc115b08d2144b0670128812a076fca6c47de4d74058c61b135ab1eff2b6: Status 404 returned error can't find the container with id 37a4fc115b08d2144b0670128812a076fca6c47de4d74058c61b135ab1eff2b6 Jul 24 13:43:15.970391 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:15.970354 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4f67a92_c219_46a3_8604_387b40ab9ff9.slice/crio-d9f76e33f0bd64b71463daabaef60e96cfbb6a70ea586892fe3cb43fb769be7b WatchSource:0}: Error finding container d9f76e33f0bd64b71463daabaef60e96cfbb6a70ea586892fe3cb43fb769be7b: Status 404 returned error can't find the container with id d9f76e33f0bd64b71463daabaef60e96cfbb6a70ea586892fe3cb43fb769be7b Jul 24 13:43:15.972607 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:15.972520 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd2d0507_3736_448c_91f7_a12d0db7cff1.slice/crio-0a3b7e58d3544a6b76755e9397d3fd458d76612d71221d308d321e4e35e091f0 WatchSource:0}: Error finding container 0a3b7e58d3544a6b76755e9397d3fd458d76612d71221d308d321e4e35e091f0: Status 404 returned error can't find the container with id 0a3b7e58d3544a6b76755e9397d3fd458d76612d71221d308d321e4e35e091f0 Jul 24 13:43:15.974213 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:15.974191 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6861d7e0_aeed_4f23_9da8_4305dd94ebfa.slice/crio-49a7516e34504ac10863205cf668ee47cf819797b853d5aabb9f0fda2244668c WatchSource:0}: Error finding container 49a7516e34504ac10863205cf668ee47cf819797b853d5aabb9f0fda2244668c: Status 404 returned error can't find the container with id 49a7516e34504ac10863205cf668ee47cf819797b853d5aabb9f0fda2244668c Jul 24 13:43:15.975963 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:15.975859 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod535b3d7b_9b08_4a89_a61c_f44fcff4e888.slice/crio-2c9d9a1d7758daa34eba45a202cfb74a628fee4727946ba819e787154696e582 WatchSource:0}: Error finding container 2c9d9a1d7758daa34eba45a202cfb74a628fee4727946ba819e787154696e582: Status 404 returned error can't find the container with id 2c9d9a1d7758daa34eba45a202cfb74a628fee4727946ba819e787154696e582 Jul 24 13:43:16.336712 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:16.336464 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cb920d79-442e-4835-96ca-66a2c62e6fad-original-pull-secret\") pod \"global-pull-secret-syncer-n845m\" (UID: \"cb920d79-442e-4835-96ca-66a2c62e6fad\") " pod="kube-system/global-pull-secret-syncer-n845m" Jul 24 13:43:16.336712 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:43:16.336636 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 24 13:43:16.336712 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:43:16.336710 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb920d79-442e-4835-96ca-66a2c62e6fad-original-pull-secret podName:cb920d79-442e-4835-96ca-66a2c62e6fad nodeName:}" failed. No retries permitted until 2026-07-24 13:43:18.336691701 +0000 UTC m=+5.994669068 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cb920d79-442e-4835-96ca-66a2c62e6fad-original-pull-secret") pod "global-pull-secret-syncer-n845m" (UID: "cb920d79-442e-4835-96ca-66a2c62e6fad") : object "kube-system"/"original-pull-secret" not registered Jul 24 13:43:16.437324 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:16.437275 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q9b8f\" (UniqueName: \"kubernetes.io/projected/503c5389-fcf1-4589-904d-1bf1261baace-kube-api-access-q9b8f\") pod \"network-check-target-5jqwl\" (UID: \"503c5389-fcf1-4589-904d-1bf1261baace\") " pod="openshift-network-diagnostics/network-check-target-5jqwl" Jul 24 13:43:16.437515 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:16.437354 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/20a8559f-d049-4fac-b14a-5a1d2aaa1aa9-metrics-certs\") pod \"network-metrics-daemon-f8gm6\" (UID: \"20a8559f-d049-4fac-b14a-5a1d2aaa1aa9\") " pod="openshift-multus/network-metrics-daemon-f8gm6" Jul 24 13:43:16.437515 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:43:16.437451 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 24 13:43:16.437515 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:43:16.437477 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 13:43:16.437515 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:43:16.437478 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 24 13:43:16.437515 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:43:16.437498 2578 projected.go:196] Error preparing data for projected volume kube-api-access-q9b8f for pod openshift-network-diagnostics/network-check-target-5jqwl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 13:43:16.437736 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:43:16.437537 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20a8559f-d049-4fac-b14a-5a1d2aaa1aa9-metrics-certs podName:20a8559f-d049-4fac-b14a-5a1d2aaa1aa9 nodeName:}" failed. No retries permitted until 2026-07-24 13:43:18.437518667 +0000 UTC m=+6.095496036 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/20a8559f-d049-4fac-b14a-5a1d2aaa1aa9-metrics-certs") pod "network-metrics-daemon-f8gm6" (UID: "20a8559f-d049-4fac-b14a-5a1d2aaa1aa9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 13:43:16.437736 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:43:16.437555 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/503c5389-fcf1-4589-904d-1bf1261baace-kube-api-access-q9b8f podName:503c5389-fcf1-4589-904d-1bf1261baace nodeName:}" failed. No retries permitted until 2026-07-24 13:43:18.437545773 +0000 UTC m=+6.095523142 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-q9b8f" (UniqueName: "kubernetes.io/projected/503c5389-fcf1-4589-904d-1bf1261baace-kube-api-access-q9b8f") pod "network-check-target-5jqwl" (UID: "503c5389-fcf1-4589-904d-1bf1261baace") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 13:43:16.919772 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:16.919742 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f8gm6" Jul 24 13:43:16.920447 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:43:16.919873 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f8gm6" podUID="20a8559f-d049-4fac-b14a-5a1d2aaa1aa9" Jul 24 13:43:16.920447 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:16.920335 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5jqwl" Jul 24 13:43:16.920447 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:43:16.920434 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5jqwl" podUID="503c5389-fcf1-4589-904d-1bf1261baace" Jul 24 13:43:16.920620 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:16.920515 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n845m" Jul 24 13:43:16.920620 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:43:16.920589 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n845m" podUID="cb920d79-442e-4835-96ca-66a2c62e6fad" Jul 24 13:43:16.961515 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:16.960237 2578 generic.go:356] "Generic (PLEG): container finished" podID="8ca0c9160c9c9500cb20dabfbd81e94f" containerID="264944f3106799a10a85399b47bac9390a75d073d021eb6e7edffc919e1618f0" exitCode=0 Jul 24 13:43:16.961890 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:16.961171 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-93.ec2.internal" event={"ID":"8ca0c9160c9c9500cb20dabfbd81e94f","Type":"ContainerDied","Data":"264944f3106799a10a85399b47bac9390a75d073d021eb6e7edffc919e1618f0"} Jul 24 13:43:16.966046 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:16.965979 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-xcdv9" event={"ID":"535b3d7b-9b08-4a89-a61c-f44fcff4e888","Type":"ContainerStarted","Data":"2c9d9a1d7758daa34eba45a202cfb74a628fee4727946ba819e787154696e582"} Jul 24 13:43:16.968325 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:16.968242 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-dddtw" event={"ID":"6861d7e0-aeed-4f23-9da8-4305dd94ebfa","Type":"ContainerStarted","Data":"49a7516e34504ac10863205cf668ee47cf819797b853d5aabb9f0fda2244668c"} Jul 24 13:43:16.981501 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:16.981475 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-txls2" event={"ID":"bd2d0507-3736-448c-91f7-a12d0db7cff1","Type":"ContainerStarted","Data":"0a3b7e58d3544a6b76755e9397d3fd458d76612d71221d308d321e4e35e091f0"} Jul 24 13:43:16.994467 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:16.994440 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8x4db" event={"ID":"d4f67a92-c219-46a3-8604-387b40ab9ff9","Type":"ContainerStarted","Data":"d9f76e33f0bd64b71463daabaef60e96cfbb6a70ea586892fe3cb43fb769be7b"} Jul 24 13:43:17.011454 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:17.011362 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pb4lc" event={"ID":"8d537a43-c31b-4ed7-af8d-bab64bcdbbab","Type":"ContainerStarted","Data":"c6bd95bb4702f0cad1cdb708c2ee0e6727e6e3634ea66b8aef82bdb0e7c1f88c"} Jul 24 13:43:17.031386 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:17.031262 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vfwll" event={"ID":"ee406d9c-d1b9-4ffb-b506-6d0e74521dec","Type":"ContainerStarted","Data":"38d39c11a16f5aa97a2ade2f8a3b3d4b9b3ce5e0b5fe02fcaed6ac79ebb7d8c4"} Jul 24 13:43:17.045879 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:17.045804 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-782cv" event={"ID":"59bcaef9-a21b-4634-a7ad-ed417b8e835a","Type":"ContainerStarted","Data":"e83cdd3aac1c1bed89d477f4584fd0829f535c69d71d746ac7f22f55f0d211b9"} Jul 24 13:43:17.054254 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:17.054209 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-93.ec2.internal" event={"ID":"263f5bb8d2ec60e406679313252c6a79","Type":"ContainerStarted","Data":"a1969d2f36a5dfc20aa0c36594522d8a850e29034dd0170444db24cefa05b6b2"} Jul 24 13:43:17.066742 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:17.066706 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-h26v2" event={"ID":"6e1b6e6b-98de-4c10-b588-219aec745e0d","Type":"ContainerStarted","Data":"37a4fc115b08d2144b0670128812a076fca6c47de4d74058c61b135ab1eff2b6"} Jul 24 13:43:17.076628 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:17.076587 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-n2fq4" event={"ID":"1df394aa-3709-4031-b25f-40bf8b36331a","Type":"ContainerStarted","Data":"6a32f38811841695dd6894f798585ec773e85466962624b998632a387d56a06a"} Jul 24 13:43:18.091328 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:18.091225 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-93.ec2.internal" event={"ID":"8ca0c9160c9c9500cb20dabfbd81e94f","Type":"ContainerStarted","Data":"d80980b40d5856016978999b61cd649f4906bea117ae9b519266d3742e6adcb9"} Jul 24 13:43:18.107823 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:18.107006 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-93.ec2.internal" podStartSLOduration=5.106985174 podStartE2EDuration="5.106985174s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 13:43:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:43:17.068868234 +0000 UTC m=+4.726845621" watchObservedRunningTime="2026-07-24 13:43:18.106985174 +0000 UTC m=+5.764962560" Jul 24 13:43:18.357019 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:18.356253 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cb920d79-442e-4835-96ca-66a2c62e6fad-original-pull-secret\") pod \"global-pull-secret-syncer-n845m\" (UID: \"cb920d79-442e-4835-96ca-66a2c62e6fad\") " pod="kube-system/global-pull-secret-syncer-n845m" Jul 24 13:43:18.357019 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:43:18.356459 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 24 13:43:18.357019 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:43:18.356519 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb920d79-442e-4835-96ca-66a2c62e6fad-original-pull-secret podName:cb920d79-442e-4835-96ca-66a2c62e6fad nodeName:}" failed. No retries permitted until 2026-07-24 13:43:22.356501514 +0000 UTC m=+10.014478881 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cb920d79-442e-4835-96ca-66a2c62e6fad-original-pull-secret") pod "global-pull-secret-syncer-n845m" (UID: "cb920d79-442e-4835-96ca-66a2c62e6fad") : object "kube-system"/"original-pull-secret" not registered Jul 24 13:43:18.457015 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:18.456972 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/20a8559f-d049-4fac-b14a-5a1d2aaa1aa9-metrics-certs\") pod \"network-metrics-daemon-f8gm6\" (UID: \"20a8559f-d049-4fac-b14a-5a1d2aaa1aa9\") " pod="openshift-multus/network-metrics-daemon-f8gm6" Jul 24 13:43:18.457200 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:18.457070 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q9b8f\" (UniqueName: \"kubernetes.io/projected/503c5389-fcf1-4589-904d-1bf1261baace-kube-api-access-q9b8f\") pod \"network-check-target-5jqwl\" (UID: \"503c5389-fcf1-4589-904d-1bf1261baace\") " pod="openshift-network-diagnostics/network-check-target-5jqwl" Jul 24 13:43:18.457264 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:43:18.457241 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 24 13:43:18.457264 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:43:18.457260 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 24 13:43:18.457361 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:43:18.457273 2578 projected.go:196] Error preparing data for projected volume kube-api-access-q9b8f for pod openshift-network-diagnostics/network-check-target-5jqwl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 13:43:18.457361 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:43:18.457332 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/503c5389-fcf1-4589-904d-1bf1261baace-kube-api-access-q9b8f podName:503c5389-fcf1-4589-904d-1bf1261baace nodeName:}" failed. No retries permitted until 2026-07-24 13:43:22.457314606 +0000 UTC m=+10.115291972 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-q9b8f" (UniqueName: "kubernetes.io/projected/503c5389-fcf1-4589-904d-1bf1261baace-kube-api-access-q9b8f") pod "network-check-target-5jqwl" (UID: "503c5389-fcf1-4589-904d-1bf1261baace") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 13:43:18.457836 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:43:18.457743 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 13:43:18.457836 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:43:18.457795 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20a8559f-d049-4fac-b14a-5a1d2aaa1aa9-metrics-certs podName:20a8559f-d049-4fac-b14a-5a1d2aaa1aa9 nodeName:}" failed. No retries permitted until 2026-07-24 13:43:22.457780955 +0000 UTC m=+10.115758324 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/20a8559f-d049-4fac-b14a-5a1d2aaa1aa9-metrics-certs") pod "network-metrics-daemon-f8gm6" (UID: "20a8559f-d049-4fac-b14a-5a1d2aaa1aa9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 13:43:18.917758 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:18.914829 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n845m" Jul 24 13:43:18.917758 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:43:18.914964 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n845m" podUID="cb920d79-442e-4835-96ca-66a2c62e6fad" Jul 24 13:43:18.917758 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:18.915367 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f8gm6" Jul 24 13:43:18.917758 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:43:18.915482 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f8gm6" podUID="20a8559f-d049-4fac-b14a-5a1d2aaa1aa9" Jul 24 13:43:18.917758 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:18.915536 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5jqwl" Jul 24 13:43:18.917758 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:43:18.915594 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5jqwl" podUID="503c5389-fcf1-4589-904d-1bf1261baace" Jul 24 13:43:20.914341 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:20.914306 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n845m" Jul 24 13:43:20.914818 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:20.914456 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f8gm6" Jul 24 13:43:20.914818 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:20.914456 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5jqwl" Jul 24 13:43:20.914818 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:43:20.914605 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f8gm6" podUID="20a8559f-d049-4fac-b14a-5a1d2aaa1aa9" Jul 24 13:43:20.914818 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:43:20.914668 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5jqwl" podUID="503c5389-fcf1-4589-904d-1bf1261baace" Jul 24 13:43:20.914818 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:43:20.914450 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n845m" podUID="cb920d79-442e-4835-96ca-66a2c62e6fad" Jul 24 13:43:22.391658 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:22.391612 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cb920d79-442e-4835-96ca-66a2c62e6fad-original-pull-secret\") pod \"global-pull-secret-syncer-n845m\" (UID: \"cb920d79-442e-4835-96ca-66a2c62e6fad\") " pod="kube-system/global-pull-secret-syncer-n845m" Jul 24 13:43:22.392135 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:43:22.391810 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 24 13:43:22.392135 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:43:22.391876 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb920d79-442e-4835-96ca-66a2c62e6fad-original-pull-secret podName:cb920d79-442e-4835-96ca-66a2c62e6fad nodeName:}" failed. No retries permitted until 2026-07-24 13:43:30.391857594 +0000 UTC m=+18.049834958 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cb920d79-442e-4835-96ca-66a2c62e6fad-original-pull-secret") pod "global-pull-secret-syncer-n845m" (UID: "cb920d79-442e-4835-96ca-66a2c62e6fad") : object "kube-system"/"original-pull-secret" not registered Jul 24 13:43:22.493183 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:22.492913 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/20a8559f-d049-4fac-b14a-5a1d2aaa1aa9-metrics-certs\") pod \"network-metrics-daemon-f8gm6\" (UID: \"20a8559f-d049-4fac-b14a-5a1d2aaa1aa9\") " pod="openshift-multus/network-metrics-daemon-f8gm6" Jul 24 13:43:22.493183 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:22.492995 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q9b8f\" (UniqueName: \"kubernetes.io/projected/503c5389-fcf1-4589-904d-1bf1261baace-kube-api-access-q9b8f\") pod \"network-check-target-5jqwl\" (UID: \"503c5389-fcf1-4589-904d-1bf1261baace\") " pod="openshift-network-diagnostics/network-check-target-5jqwl" Jul 24 13:43:22.493183 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:43:22.493077 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 13:43:22.493183 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:43:22.493098 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 24 13:43:22.493183 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:43:22.493110 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 24 13:43:22.493183 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:43:22.493122 2578 projected.go:196] Error preparing data for projected volume kube-api-access-q9b8f for pod openshift-network-diagnostics/network-check-target-5jqwl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 13:43:22.493183 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:43:22.493141 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20a8559f-d049-4fac-b14a-5a1d2aaa1aa9-metrics-certs podName:20a8559f-d049-4fac-b14a-5a1d2aaa1aa9 nodeName:}" failed. No retries permitted until 2026-07-24 13:43:30.493123059 +0000 UTC m=+18.151100423 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/20a8559f-d049-4fac-b14a-5a1d2aaa1aa9-metrics-certs") pod "network-metrics-daemon-f8gm6" (UID: "20a8559f-d049-4fac-b14a-5a1d2aaa1aa9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 13:43:22.493183 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:43:22.493157 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/503c5389-fcf1-4589-904d-1bf1261baace-kube-api-access-q9b8f podName:503c5389-fcf1-4589-904d-1bf1261baace nodeName:}" failed. No retries permitted until 2026-07-24 13:43:30.49314777 +0000 UTC m=+18.151125139 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-q9b8f" (UniqueName: "kubernetes.io/projected/503c5389-fcf1-4589-904d-1bf1261baace-kube-api-access-q9b8f") pod "network-check-target-5jqwl" (UID: "503c5389-fcf1-4589-904d-1bf1261baace") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 13:43:22.917752 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:22.917721 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n845m" Jul 24 13:43:22.917752 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:22.917739 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f8gm6" Jul 24 13:43:22.917994 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:43:22.917851 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n845m" podUID="cb920d79-442e-4835-96ca-66a2c62e6fad" Jul 24 13:43:22.917994 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:43:22.917912 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f8gm6" podUID="20a8559f-d049-4fac-b14a-5a1d2aaa1aa9" Jul 24 13:43:22.917994 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:22.917976 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5jqwl" Jul 24 13:43:22.918149 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:43:22.918048 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5jqwl" podUID="503c5389-fcf1-4589-904d-1bf1261baace" Jul 24 13:43:24.914567 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:24.914534 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f8gm6" Jul 24 13:43:24.915006 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:24.914578 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n845m" Jul 24 13:43:24.915006 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:43:24.914687 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f8gm6" podUID="20a8559f-d049-4fac-b14a-5a1d2aaa1aa9" Jul 24 13:43:24.915006 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:24.914757 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5jqwl" Jul 24 13:43:24.915006 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:43:24.914878 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n845m" podUID="cb920d79-442e-4835-96ca-66a2c62e6fad" Jul 24 13:43:24.915006 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:43:24.914969 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5jqwl" podUID="503c5389-fcf1-4589-904d-1bf1261baace" Jul 24 13:43:26.914578 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:26.914534 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f8gm6" Jul 24 13:43:26.914994 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:26.914534 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5jqwl" Jul 24 13:43:26.914994 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:43:26.914680 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f8gm6" podUID="20a8559f-d049-4fac-b14a-5a1d2aaa1aa9" Jul 24 13:43:26.914994 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:26.914691 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n845m" Jul 24 13:43:26.914994 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:43:26.914786 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5jqwl" podUID="503c5389-fcf1-4589-904d-1bf1261baace" Jul 24 13:43:26.914994 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:43:26.914875 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n845m" podUID="cb920d79-442e-4835-96ca-66a2c62e6fad" Jul 24 13:43:28.915102 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:28.915064 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5jqwl" Jul 24 13:43:28.915580 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:28.915126 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n845m" Jul 24 13:43:28.915580 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:28.915135 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f8gm6" Jul 24 13:43:28.915580 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:43:28.915239 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5jqwl" podUID="503c5389-fcf1-4589-904d-1bf1261baace" Jul 24 13:43:28.915580 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:43:28.915341 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n845m" podUID="cb920d79-442e-4835-96ca-66a2c62e6fad" Jul 24 13:43:28.915580 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:43:28.915441 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f8gm6" podUID="20a8559f-d049-4fac-b14a-5a1d2aaa1aa9" Jul 24 13:43:30.448658 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:30.448621 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cb920d79-442e-4835-96ca-66a2c62e6fad-original-pull-secret\") pod \"global-pull-secret-syncer-n845m\" (UID: \"cb920d79-442e-4835-96ca-66a2c62e6fad\") " pod="kube-system/global-pull-secret-syncer-n845m" Jul 24 13:43:30.449109 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:43:30.448762 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 24 13:43:30.449109 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:43:30.448826 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb920d79-442e-4835-96ca-66a2c62e6fad-original-pull-secret podName:cb920d79-442e-4835-96ca-66a2c62e6fad nodeName:}" failed. No retries permitted until 2026-07-24 13:43:46.448810618 +0000 UTC m=+34.106787980 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cb920d79-442e-4835-96ca-66a2c62e6fad-original-pull-secret") pod "global-pull-secret-syncer-n845m" (UID: "cb920d79-442e-4835-96ca-66a2c62e6fad") : object "kube-system"/"original-pull-secret" not registered Jul 24 13:43:30.549969 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:30.549930 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/20a8559f-d049-4fac-b14a-5a1d2aaa1aa9-metrics-certs\") pod \"network-metrics-daemon-f8gm6\" (UID: \"20a8559f-d049-4fac-b14a-5a1d2aaa1aa9\") " pod="openshift-multus/network-metrics-daemon-f8gm6" Jul 24 13:43:30.550133 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:30.550024 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q9b8f\" (UniqueName: \"kubernetes.io/projected/503c5389-fcf1-4589-904d-1bf1261baace-kube-api-access-q9b8f\") pod \"network-check-target-5jqwl\" (UID: \"503c5389-fcf1-4589-904d-1bf1261baace\") " pod="openshift-network-diagnostics/network-check-target-5jqwl" Jul 24 13:43:30.550176 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:43:30.550130 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 13:43:30.550176 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:43:30.550161 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 24 13:43:30.550266 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:43:30.550177 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 24 13:43:30.550266 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:43:30.550190 2578 projected.go:196] Error preparing data for projected volume kube-api-access-q9b8f for pod openshift-network-diagnostics/network-check-target-5jqwl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 13:43:30.550266 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:43:30.550203 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20a8559f-d049-4fac-b14a-5a1d2aaa1aa9-metrics-certs podName:20a8559f-d049-4fac-b14a-5a1d2aaa1aa9 nodeName:}" failed. No retries permitted until 2026-07-24 13:43:46.550182785 +0000 UTC m=+34.208160154 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/20a8559f-d049-4fac-b14a-5a1d2aaa1aa9-metrics-certs") pod "network-metrics-daemon-f8gm6" (UID: "20a8559f-d049-4fac-b14a-5a1d2aaa1aa9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 13:43:30.550266 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:43:30.550239 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/503c5389-fcf1-4589-904d-1bf1261baace-kube-api-access-q9b8f podName:503c5389-fcf1-4589-904d-1bf1261baace nodeName:}" failed. No retries permitted until 2026-07-24 13:43:46.550223078 +0000 UTC m=+34.208200463 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-q9b8f" (UniqueName: "kubernetes.io/projected/503c5389-fcf1-4589-904d-1bf1261baace-kube-api-access-q9b8f") pod "network-check-target-5jqwl" (UID: "503c5389-fcf1-4589-904d-1bf1261baace") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 13:43:30.914486 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:30.914460 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f8gm6" Jul 24 13:43:30.914659 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:30.914460 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5jqwl" Jul 24 13:43:30.914659 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:30.914473 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n845m" Jul 24 13:43:30.914659 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:43:30.914611 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f8gm6" podUID="20a8559f-d049-4fac-b14a-5a1d2aaa1aa9" Jul 24 13:43:30.914822 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:43:30.914697 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5jqwl" podUID="503c5389-fcf1-4589-904d-1bf1261baace" Jul 24 13:43:30.914872 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:43:30.914810 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n845m" podUID="cb920d79-442e-4835-96ca-66a2c62e6fad" Jul 24 13:43:32.915209 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:32.915167 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f8gm6" Jul 24 13:43:32.915714 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:43:32.915285 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f8gm6" podUID="20a8559f-d049-4fac-b14a-5a1d2aaa1aa9" Jul 24 13:43:32.915714 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:32.915370 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5jqwl" Jul 24 13:43:32.915714 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:43:32.915497 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5jqwl" podUID="503c5389-fcf1-4589-904d-1bf1261baace" Jul 24 13:43:32.915714 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:32.915548 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n845m" Jul 24 13:43:32.915714 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:43:32.915626 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n845m" podUID="cb920d79-442e-4835-96ca-66a2c62e6fad" Jul 24 13:43:34.914950 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:34.914498 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5jqwl" Jul 24 13:43:34.915793 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:34.914498 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f8gm6" Jul 24 13:43:34.915793 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:43:34.915071 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5jqwl" podUID="503c5389-fcf1-4589-904d-1bf1261baace" Jul 24 13:43:34.915793 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:34.914536 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n845m" Jul 24 13:43:34.915793 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:43:34.915148 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f8gm6" podUID="20a8559f-d049-4fac-b14a-5a1d2aaa1aa9" Jul 24 13:43:34.915793 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:43:34.915231 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n845m" podUID="cb920d79-442e-4835-96ca-66a2c62e6fad" Jul 24 13:43:35.124891 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:35.124856 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-dddtw" event={"ID":"6861d7e0-aeed-4f23-9da8-4305dd94ebfa","Type":"ContainerStarted","Data":"472e5453355f2a2d46da4f4fe2613fab566f0028b2669c1133f949ff0bbeb6c1"} Jul 24 13:43:35.126258 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:35.126221 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-txls2" event={"ID":"bd2d0507-3736-448c-91f7-a12d0db7cff1","Type":"ContainerStarted","Data":"5df224e69227f27e6957c83b08b577ae13edef85ae082dea72e9aec794a1ed47"} Jul 24 13:43:35.127622 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:35.127598 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8x4db" event={"ID":"d4f67a92-c219-46a3-8604-387b40ab9ff9","Type":"ContainerStarted","Data":"671da292fb948a2f57a0effef6f7464d6973cbc950c9180bf21d917748890623"} Jul 24 13:43:35.129136 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:35.129113 2578 generic.go:356] "Generic (PLEG): container finished" podID="8d537a43-c31b-4ed7-af8d-bab64bcdbbab" containerID="b4d98778d14098b4cb499ed86ac00ca6abde082a727367c44339944da071eb0b" exitCode=0 Jul 24 13:43:35.129236 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:35.129182 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pb4lc" event={"ID":"8d537a43-c31b-4ed7-af8d-bab64bcdbbab","Type":"ContainerDied","Data":"b4d98778d14098b4cb499ed86ac00ca6abde082a727367c44339944da071eb0b"} Jul 24 13:43:35.131981 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:35.131897 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vfwll" event={"ID":"ee406d9c-d1b9-4ffb-b506-6d0e74521dec","Type":"ContainerStarted","Data":"db63f27f1ac6c7184a9af6c4185765bdad6772cf6f3c930e7874e14f3ef17e31"} Jul 24 13:43:35.131981 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:35.131956 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vfwll" event={"ID":"ee406d9c-d1b9-4ffb-b506-6d0e74521dec","Type":"ContainerStarted","Data":"7000a5c89f87496668ac879934ec08b0b9a028403602cef6cea05571410deef9"} Jul 24 13:43:35.132095 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:35.131990 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vfwll" event={"ID":"ee406d9c-d1b9-4ffb-b506-6d0e74521dec","Type":"ContainerStarted","Data":"2c9f28b135d916ef71c86c05e5e721499f944ad3662f03a2d4cd0626f3db40d6"} Jul 24 13:43:35.132095 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:35.132035 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vfwll" event={"ID":"ee406d9c-d1b9-4ffb-b506-6d0e74521dec","Type":"ContainerStarted","Data":"ec6aa086750f94de9dd8fc8b56c32eca3fe05691660f94ea24110dc37fd5022c"} Jul 24 13:43:35.133448 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:35.133331 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-h26v2" event={"ID":"6e1b6e6b-98de-4c10-b588-219aec745e0d","Type":"ContainerStarted","Data":"b6ac6b98b0cf577b87d89294f6d2ecdcf51e76e96f235b3afab35e21f8599097"} Jul 24 13:43:35.134971 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:35.134935 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-n2fq4" event={"ID":"1df394aa-3709-4031-b25f-40bf8b36331a","Type":"ContainerStarted","Data":"3e0d9dacc4da2e9ca1d3755464f6c237a771239c3831c9bdeb348cd996ca0994"} Jul 24 13:43:35.136587 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:35.136562 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-xcdv9" event={"ID":"535b3d7b-9b08-4a89-a61c-f44fcff4e888","Type":"ContainerStarted","Data":"54ee9b8625bc9ae957c3e7ef666443af02598445e291ce68e58ea5eb5e566012"} Jul 24 13:43:35.140096 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:35.140053 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-93.ec2.internal" podStartSLOduration=22.140040568 podStartE2EDuration="22.140040568s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 13:43:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:43:18.10780765 +0000 UTC m=+5.765785036" watchObservedRunningTime="2026-07-24 13:43:35.140040568 +0000 UTC m=+22.798017954" Jul 24 13:43:35.140315 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:35.140295 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-dddtw" podStartSLOduration=3.51255019 podStartE2EDuration="22.140291074s" totalImagesPullingTime="18.627740884s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 13:43:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:43:35.139726316 +0000 UTC m=+22.797703700" watchObservedRunningTime="2026-07-24 13:43:35.140291074 +0000 UTC m=+22.798268459" Jul 24 13:43:35.154398 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:35.154359 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-h26v2" podStartSLOduration=3.481257205 podStartE2EDuration="22.154342478s" totalImagesPullingTime="18.673085273s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 13:43:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:43:35.154203469 +0000 UTC m=+22.812180853" watchObservedRunningTime="2026-07-24 13:43:35.154342478 +0000 UTC m=+22.812319862" Jul 24 13:43:35.166764 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:35.166717 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-txls2" podStartSLOduration=7.689333334 podStartE2EDuration="22.166700543s" totalImagesPullingTime="14.477367209s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 13:43:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:43:35.166047252 +0000 UTC m=+22.824024639" watchObservedRunningTime="2026-07-24 13:43:35.166700543 +0000 UTC m=+22.824677928" Jul 24 13:43:35.178459 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:35.178393 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-xcdv9" podStartSLOduration=3.5713726059999997 podStartE2EDuration="22.178375589s" totalImagesPullingTime="18.607002983s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 13:43:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:43:35.177784378 +0000 UTC m=+22.835761764" watchObservedRunningTime="2026-07-24 13:43:35.178375589 +0000 UTC m=+22.836352973" Jul 24 13:43:35.191209 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:35.191165 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-n2fq4" podStartSLOduration=3.57169321 podStartE2EDuration="22.191149453s" totalImagesPullingTime="18.619456243s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 13:43:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:43:35.190577975 +0000 UTC m=+22.848555360" watchObservedRunningTime="2026-07-24 13:43:35.191149453 +0000 UTC m=+22.849126837" Jul 24 13:43:36.073092 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:36.073069 2578 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 24 13:43:36.142051 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:36.142012 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8x4db" event={"ID":"d4f67a92-c219-46a3-8604-387b40ab9ff9","Type":"ContainerStarted","Data":"110daec8739c929814bac3163e6ad112e0a9b1152715db1d3f1cda50ada75870"} Jul 24 13:43:36.145392 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:36.145364 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vfwll" event={"ID":"ee406d9c-d1b9-4ffb-b506-6d0e74521dec","Type":"ContainerStarted","Data":"c1de1e6f4a3d5a8f27b3ff5bc5d1d528252a70cdc13375745757b1e1547e3c7c"} Jul 24 13:43:36.145518 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:36.145476 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vfwll" event={"ID":"ee406d9c-d1b9-4ffb-b506-6d0e74521dec","Type":"ContainerStarted","Data":"7f89e9e07ccab79914ebd465e41ad51de8d3ec61de272bb476189bf9d8561535"} Jul 24 13:43:36.146962 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:36.146907 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-782cv" event={"ID":"59bcaef9-a21b-4634-a7ad-ed417b8e835a","Type":"ContainerStarted","Data":"0354fde033949b683f86acce13f8dcfb23c0d3220179f3b87aab7e5ea60c4a15"} Jul 24 13:43:36.163982 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:36.161782 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-782cv" podStartSLOduration=4.54177836 podStartE2EDuration="23.161758831s" totalImagesPullingTime="18.619980471s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 13:43:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:43:36.161540084 +0000 UTC m=+23.819517483" watchObservedRunningTime="2026-07-24 13:43:36.161758831 +0000 UTC m=+23.819736220" Jul 24 13:43:36.775662 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:36.775553 2578 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-24T13:43:36.073086042Z","UUID":"2f03c99b-0614-4b3f-a4de-557db10380ef","Handler":null,"Name":"","Endpoint":""} Jul 24 13:43:36.777209 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:36.777184 2578 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 24 13:43:36.777349 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:36.777225 2578 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 24 13:43:36.915271 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:36.915238 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f8gm6" Jul 24 13:43:36.915465 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:43:36.915379 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f8gm6" podUID="20a8559f-d049-4fac-b14a-5a1d2aaa1aa9" Jul 24 13:43:36.915835 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:36.915813 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5jqwl" Jul 24 13:43:36.916013 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:43:36.915905 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5jqwl" podUID="503c5389-fcf1-4589-904d-1bf1261baace" Jul 24 13:43:36.916013 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:36.916000 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n845m" Jul 24 13:43:36.916149 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:43:36.916084 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n845m" podUID="cb920d79-442e-4835-96ca-66a2c62e6fad" Jul 24 13:43:37.247997 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:37.247961 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-txls2" Jul 24 13:43:37.248543 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:37.248527 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-txls2" Jul 24 13:43:38.153977 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:38.153938 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8x4db" event={"ID":"d4f67a92-c219-46a3-8604-387b40ab9ff9","Type":"ContainerStarted","Data":"c94939cef723c6093f416adfa73a2cf6fc2ba1bc9bebc2219bc0055262d87490"} Jul 24 13:43:38.157793 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:38.157766 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vfwll" event={"ID":"ee406d9c-d1b9-4ffb-b506-6d0e74521dec","Type":"ContainerStarted","Data":"12d209c9f29d2f62e86da22f03c934a02ed8423f5eeaf36702e57fb8d6bc34c8"} Jul 24 13:43:38.157922 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:38.157848 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-txls2" Jul 24 13:43:38.158437 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:38.158395 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-txls2" Jul 24 13:43:38.170672 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:38.170627 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8x4db" podStartSLOduration=4.351770441 podStartE2EDuration="25.17060929s" totalImagesPullingTime="20.818838849s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 13:43:13 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:43:38.170150191 +0000 UTC m=+25.828127576" watchObservedRunningTime="2026-07-24 13:43:38.17060929 +0000 UTC m=+25.828586676" Jul 24 13:43:38.914701 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:38.914671 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5jqwl" Jul 24 13:43:38.914701 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:38.914692 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f8gm6" Jul 24 13:43:38.915236 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:38.914717 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n845m" Jul 24 13:43:38.915236 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:43:38.914813 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f8gm6" podUID="20a8559f-d049-4fac-b14a-5a1d2aaa1aa9" Jul 24 13:43:38.915236 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:43:38.914883 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n845m" podUID="cb920d79-442e-4835-96ca-66a2c62e6fad" Jul 24 13:43:38.915236 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:43:38.914962 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5jqwl" podUID="503c5389-fcf1-4589-904d-1bf1261baace" Jul 24 13:43:40.163691 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:40.163461 2578 generic.go:356] "Generic (PLEG): container finished" podID="8d537a43-c31b-4ed7-af8d-bab64bcdbbab" containerID="14fe71c38bc86ae5c34f5b197e3bc60e347fd71570b512c97fdc315d9ef139be" exitCode=0 Jul 24 13:43:40.164517 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:40.163542 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pb4lc" event={"ID":"8d537a43-c31b-4ed7-af8d-bab64bcdbbab","Type":"ContainerDied","Data":"14fe71c38bc86ae5c34f5b197e3bc60e347fd71570b512c97fdc315d9ef139be"} Jul 24 13:43:40.169460 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:40.169437 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vfwll" event={"ID":"ee406d9c-d1b9-4ffb-b506-6d0e74521dec","Type":"ContainerStarted","Data":"d8e00afbb5849b5742b63308423b3379ea16dafb3ff8bc6716cb820c79f402e8"} Jul 24 13:43:40.205849 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:40.205792 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-vfwll" podStartSLOduration=8.526454399 podStartE2EDuration="27.205774983s" totalImagesPullingTime="18.679320584s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 13:43:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:43:40.205599227 +0000 UTC m=+27.863576612" watchObservedRunningTime="2026-07-24 13:43:40.205774983 +0000 UTC m=+27.863752367" Jul 24 13:43:40.917418 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:40.917377 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n845m" Jul 24 13:43:40.917573 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:40.917491 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f8gm6" Jul 24 13:43:40.917573 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:43:40.917503 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n845m" podUID="cb920d79-442e-4835-96ca-66a2c62e6fad" Jul 24 13:43:40.917573 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:40.917518 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5jqwl" Jul 24 13:43:40.917674 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:43:40.917584 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f8gm6" podUID="20a8559f-d049-4fac-b14a-5a1d2aaa1aa9" Jul 24 13:43:40.917674 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:43:40.917640 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5jqwl" podUID="503c5389-fcf1-4589-904d-1bf1261baace" Jul 24 13:43:41.171714 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:41.171682 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vfwll" Jul 24 13:43:41.172151 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:41.171767 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vfwll" Jul 24 13:43:41.172151 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:41.171811 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vfwll" Jul 24 13:43:41.188240 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:41.188083 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vfwll" Jul 24 13:43:41.188385 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:41.188334 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vfwll" Jul 24 13:43:42.175478 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:42.175447 2578 generic.go:356] "Generic (PLEG): container finished" podID="8d537a43-c31b-4ed7-af8d-bab64bcdbbab" containerID="04f4f9559c8fcdfba61877fdac7fa9d745bbe36fda8900257d69f86ed7e35cc7" exitCode=0 Jul 24 13:43:42.175898 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:42.175540 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pb4lc" event={"ID":"8d537a43-c31b-4ed7-af8d-bab64bcdbbab","Type":"ContainerDied","Data":"04f4f9559c8fcdfba61877fdac7fa9d745bbe36fda8900257d69f86ed7e35cc7"} Jul 24 13:43:42.915298 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:42.915266 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f8gm6" Jul 24 13:43:42.915491 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:42.915341 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n845m" Jul 24 13:43:42.915491 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:42.915390 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5jqwl" Jul 24 13:43:42.915491 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:43:42.915392 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f8gm6" podUID="20a8559f-d049-4fac-b14a-5a1d2aaa1aa9" Jul 24 13:43:42.915761 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:43:42.915512 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5jqwl" podUID="503c5389-fcf1-4589-904d-1bf1261baace" Jul 24 13:43:42.915761 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:43:42.915607 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n845m" podUID="cb920d79-442e-4835-96ca-66a2c62e6fad" Jul 24 13:43:43.180422 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:43.180331 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pb4lc" event={"ID":"8d537a43-c31b-4ed7-af8d-bab64bcdbbab","Type":"ContainerStarted","Data":"3359959add988e57460516da6f2675d8a4a98254122280a9e9b4708703a5add4"} Jul 24 13:43:44.185094 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:44.185050 2578 generic.go:356] "Generic (PLEG): container finished" podID="8d537a43-c31b-4ed7-af8d-bab64bcdbbab" containerID="3359959add988e57460516da6f2675d8a4a98254122280a9e9b4708703a5add4" exitCode=0 Jul 24 13:43:44.185486 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:44.185115 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pb4lc" event={"ID":"8d537a43-c31b-4ed7-af8d-bab64bcdbbab","Type":"ContainerDied","Data":"3359959add988e57460516da6f2675d8a4a98254122280a9e9b4708703a5add4"} Jul 24 13:43:44.914948 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:44.914909 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f8gm6" Jul 24 13:43:44.915173 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:44.914909 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5jqwl" Jul 24 13:43:44.915173 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:43:44.915051 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f8gm6" podUID="20a8559f-d049-4fac-b14a-5a1d2aaa1aa9" Jul 24 13:43:44.915292 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:43:44.915186 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5jqwl" podUID="503c5389-fcf1-4589-904d-1bf1261baace" Jul 24 13:43:44.915292 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:44.915203 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n845m" Jul 24 13:43:44.915393 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:43:44.915295 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n845m" podUID="cb920d79-442e-4835-96ca-66a2c62e6fad" Jul 24 13:43:46.476335 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:46.476299 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cb920d79-442e-4835-96ca-66a2c62e6fad-original-pull-secret\") pod \"global-pull-secret-syncer-n845m\" (UID: \"cb920d79-442e-4835-96ca-66a2c62e6fad\") " pod="kube-system/global-pull-secret-syncer-n845m" Jul 24 13:43:46.476778 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:43:46.476489 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 24 13:43:46.476778 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:43:46.476567 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb920d79-442e-4835-96ca-66a2c62e6fad-original-pull-secret podName:cb920d79-442e-4835-96ca-66a2c62e6fad nodeName:}" failed. No retries permitted until 2026-07-24 13:44:18.476545411 +0000 UTC m=+66.134522793 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cb920d79-442e-4835-96ca-66a2c62e6fad-original-pull-secret") pod "global-pull-secret-syncer-n845m" (UID: "cb920d79-442e-4835-96ca-66a2c62e6fad") : object "kube-system"/"original-pull-secret" not registered Jul 24 13:43:46.577621 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:46.577581 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/20a8559f-d049-4fac-b14a-5a1d2aaa1aa9-metrics-certs\") pod \"network-metrics-daemon-f8gm6\" (UID: \"20a8559f-d049-4fac-b14a-5a1d2aaa1aa9\") " pod="openshift-multus/network-metrics-daemon-f8gm6" Jul 24 13:43:46.577805 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:46.577724 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q9b8f\" (UniqueName: \"kubernetes.io/projected/503c5389-fcf1-4589-904d-1bf1261baace-kube-api-access-q9b8f\") pod \"network-check-target-5jqwl\" (UID: \"503c5389-fcf1-4589-904d-1bf1261baace\") " pod="openshift-network-diagnostics/network-check-target-5jqwl" Jul 24 13:43:46.577805 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:43:46.577746 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 13:43:46.577919 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:43:46.577819 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20a8559f-d049-4fac-b14a-5a1d2aaa1aa9-metrics-certs podName:20a8559f-d049-4fac-b14a-5a1d2aaa1aa9 nodeName:}" failed. No retries permitted until 2026-07-24 13:44:18.577795607 +0000 UTC m=+66.235772994 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/20a8559f-d049-4fac-b14a-5a1d2aaa1aa9-metrics-certs") pod "network-metrics-daemon-f8gm6" (UID: "20a8559f-d049-4fac-b14a-5a1d2aaa1aa9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 13:43:46.577919 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:43:46.577861 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 24 13:43:46.577919 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:43:46.577884 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 24 13:43:46.577919 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:43:46.577896 2578 projected.go:196] Error preparing data for projected volume kube-api-access-q9b8f for pod openshift-network-diagnostics/network-check-target-5jqwl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 13:43:46.578078 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:43:46.577948 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/503c5389-fcf1-4589-904d-1bf1261baace-kube-api-access-q9b8f podName:503c5389-fcf1-4589-904d-1bf1261baace nodeName:}" failed. No retries permitted until 2026-07-24 13:44:18.577932929 +0000 UTC m=+66.235910297 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-q9b8f" (UniqueName: "kubernetes.io/projected/503c5389-fcf1-4589-904d-1bf1261baace-kube-api-access-q9b8f") pod "network-check-target-5jqwl" (UID: "503c5389-fcf1-4589-904d-1bf1261baace") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 13:43:46.915313 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:46.915278 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5jqwl" Jul 24 13:43:46.915522 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:46.915279 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f8gm6" Jul 24 13:43:46.915522 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:43:46.915419 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5jqwl" podUID="503c5389-fcf1-4589-904d-1bf1261baace" Jul 24 13:43:46.915522 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:46.915279 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n845m" Jul 24 13:43:46.915522 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:43:46.915497 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f8gm6" podUID="20a8559f-d049-4fac-b14a-5a1d2aaa1aa9" Jul 24 13:43:46.915743 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:43:46.915561 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n845m" podUID="cb920d79-442e-4835-96ca-66a2c62e6fad" Jul 24 13:43:48.914465 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:48.914429 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5jqwl" Jul 24 13:43:48.914842 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:48.914426 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f8gm6" Jul 24 13:43:48.914842 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:43:48.914543 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5jqwl" podUID="503c5389-fcf1-4589-904d-1bf1261baace" Jul 24 13:43:48.914842 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:48.914442 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n845m" Jul 24 13:43:48.914842 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:43:48.914622 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f8gm6" podUID="20a8559f-d049-4fac-b14a-5a1d2aaa1aa9" Jul 24 13:43:48.914842 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:43:48.914699 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n845m" podUID="cb920d79-442e-4835-96ca-66a2c62e6fad" Jul 24 13:43:49.199204 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:49.199112 2578 generic.go:356] "Generic (PLEG): container finished" podID="8d537a43-c31b-4ed7-af8d-bab64bcdbbab" containerID="8ae87c2e3f1951130c4976af0378e9d15e077be70ca1626276b2ec740801ee2f" exitCode=0 Jul 24 13:43:49.199204 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:49.199181 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pb4lc" event={"ID":"8d537a43-c31b-4ed7-af8d-bab64bcdbbab","Type":"ContainerDied","Data":"8ae87c2e3f1951130c4976af0378e9d15e077be70ca1626276b2ec740801ee2f"} Jul 24 13:43:50.207195 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:50.207157 2578 generic.go:356] "Generic (PLEG): container finished" podID="8d537a43-c31b-4ed7-af8d-bab64bcdbbab" containerID="42c12d94f292948c8455ab85c322b2b32aa8582e67fd5e9a89a72ae1c4c79f1c" exitCode=0 Jul 24 13:43:50.207583 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:50.207212 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pb4lc" event={"ID":"8d537a43-c31b-4ed7-af8d-bab64bcdbbab","Type":"ContainerDied","Data":"42c12d94f292948c8455ab85c322b2b32aa8582e67fd5e9a89a72ae1c4c79f1c"} Jul 24 13:43:50.915316 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:50.915275 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5jqwl" Jul 24 13:43:50.915530 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:50.915273 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f8gm6" Jul 24 13:43:50.915530 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:50.915287 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n845m" Jul 24 13:43:50.915530 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:43:50.915480 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5jqwl" podUID="503c5389-fcf1-4589-904d-1bf1261baace" Jul 24 13:43:50.915690 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:43:50.915602 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n845m" podUID="cb920d79-442e-4835-96ca-66a2c62e6fad" Jul 24 13:43:50.915746 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:43:50.915703 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f8gm6" podUID="20a8559f-d049-4fac-b14a-5a1d2aaa1aa9" Jul 24 13:43:51.213452 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:51.213360 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pb4lc" event={"ID":"8d537a43-c31b-4ed7-af8d-bab64bcdbbab","Type":"ContainerStarted","Data":"5c09a0a88042302031afa97ed30faf1b8e89c68e264b581cc342ff191d626169"} Jul 24 13:43:51.260875 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:51.260825 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-pb4lc" podStartSLOduration=8.401754066 podStartE2EDuration="38.260808677s" totalImagesPullingTime="29.859054611s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 13:43:13 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:43:51.259285519 +0000 UTC m=+38.917262904" watchObservedRunningTime="2026-07-24 13:43:51.260808677 +0000 UTC m=+38.918786061" Jul 24 13:43:52.241813 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:52.241564 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-n845m"] Jul 24 13:43:52.242482 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:52.241921 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n845m" Jul 24 13:43:52.242482 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:43:52.242045 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n845m" podUID="cb920d79-442e-4835-96ca-66a2c62e6fad" Jul 24 13:43:52.242482 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:52.242472 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-5jqwl"] Jul 24 13:43:52.242808 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:52.242574 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5jqwl" Jul 24 13:43:52.242808 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:43:52.242673 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5jqwl" podUID="503c5389-fcf1-4589-904d-1bf1261baace" Jul 24 13:43:52.244503 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:52.244478 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-f8gm6"] Jul 24 13:43:52.244718 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:52.244700 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f8gm6" Jul 24 13:43:52.244847 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:43:52.244821 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f8gm6" podUID="20a8559f-d049-4fac-b14a-5a1d2aaa1aa9" Jul 24 13:43:53.914587 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:53.914551 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n845m" Jul 24 13:43:53.915049 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:53.914606 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5jqwl" Jul 24 13:43:53.915049 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:53.914564 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f8gm6" Jul 24 13:43:53.915049 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:43:53.914680 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n845m" podUID="cb920d79-442e-4835-96ca-66a2c62e6fad" Jul 24 13:43:53.915049 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:43:53.914731 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f8gm6" podUID="20a8559f-d049-4fac-b14a-5a1d2aaa1aa9" Jul 24 13:43:53.915049 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:43:53.914802 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5jqwl" podUID="503c5389-fcf1-4589-904d-1bf1261baace" Jul 24 13:43:55.914938 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:55.914907 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n845m" Jul 24 13:43:55.915452 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:55.914911 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5jqwl" Jul 24 13:43:55.915452 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:43:55.915016 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n845m" podUID="cb920d79-442e-4835-96ca-66a2c62e6fad" Jul 24 13:43:55.915452 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:43:55.915117 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5jqwl" podUID="503c5389-fcf1-4589-904d-1bf1261baace" Jul 24 13:43:55.915452 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:55.914911 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f8gm6" Jul 24 13:43:55.915452 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:43:55.915236 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f8gm6" podUID="20a8559f-d049-4fac-b14a-5a1d2aaa1aa9" Jul 24 13:43:56.117880 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:56.117857 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-93.ec2.internal" event="NodeReady" Jul 24 13:43:56.118015 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:56.118004 2578 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 24 13:43:56.163636 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:56.163609 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-t8cnk"] Jul 24 13:43:56.183157 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:56.182705 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-4c9r4"] Jul 24 13:43:56.183157 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:56.182856 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-t8cnk" Jul 24 13:43:56.184759 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:56.184741 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-rdndh\"" Jul 24 13:43:56.185043 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:56.185017 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 24 13:43:56.185144 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:56.185017 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 24 13:43:56.193638 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:56.193621 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-t8cnk"] Jul 24 13:43:56.193701 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:56.193650 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-4c9r4"] Jul 24 13:43:56.193732 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:56.193706 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-4c9r4" Jul 24 13:43:56.195479 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:56.195459 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 24 13:43:56.195685 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:56.195671 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 24 13:43:56.195767 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:56.195708 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 24 13:43:56.195767 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:56.195708 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-c9hpz\"" Jul 24 13:43:56.275436 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:56.275394 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-brx7p"] Jul 24 13:43:56.295553 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:56.295530 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-brx7p" Jul 24 13:43:56.298050 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:56.298032 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 24 13:43:56.298445 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:56.298427 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 24 13:43:56.298542 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:56.298511 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-n5ltr\"" Jul 24 13:43:56.298542 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:56.298534 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 24 13:43:56.299057 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:56.299038 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 24 13:43:56.300437 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:56.300420 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-brx7p"] Jul 24 13:43:56.347510 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:56.347491 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/110c903e-620c-4347-94f2-6ba9507a5eed-config-volume\") pod \"dns-default-t8cnk\" (UID: \"110c903e-620c-4347-94f2-6ba9507a5eed\") " pod="openshift-dns/dns-default-t8cnk" Jul 24 13:43:56.347598 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:56.347516 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/110c903e-620c-4347-94f2-6ba9507a5eed-metrics-tls\") pod \"dns-default-t8cnk\" (UID: \"110c903e-620c-4347-94f2-6ba9507a5eed\") " pod="openshift-dns/dns-default-t8cnk" Jul 24 13:43:56.347598 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:56.347557 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/110c903e-620c-4347-94f2-6ba9507a5eed-tmp-dir\") pod \"dns-default-t8cnk\" (UID: \"110c903e-620c-4347-94f2-6ba9507a5eed\") " pod="openshift-dns/dns-default-t8cnk" Jul 24 13:43:56.347688 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:56.347600 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b25l9\" (UniqueName: \"kubernetes.io/projected/110c903e-620c-4347-94f2-6ba9507a5eed-kube-api-access-b25l9\") pod \"dns-default-t8cnk\" (UID: \"110c903e-620c-4347-94f2-6ba9507a5eed\") " pod="openshift-dns/dns-default-t8cnk" Jul 24 13:43:56.347688 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:56.347637 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c59fc\" (UniqueName: \"kubernetes.io/projected/177883b4-be88-4410-b00a-036caa467bc4-kube-api-access-c59fc\") pod \"ingress-canary-4c9r4\" (UID: \"177883b4-be88-4410-b00a-036caa467bc4\") " pod="openshift-ingress-canary/ingress-canary-4c9r4" Jul 24 13:43:56.347688 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:56.347661 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/177883b4-be88-4410-b00a-036caa467bc4-cert\") pod \"ingress-canary-4c9r4\" (UID: \"177883b4-be88-4410-b00a-036caa467bc4\") " pod="openshift-ingress-canary/ingress-canary-4c9r4" Jul 24 13:43:56.448896 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:56.448807 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b25l9\" (UniqueName: \"kubernetes.io/projected/110c903e-620c-4347-94f2-6ba9507a5eed-kube-api-access-b25l9\") pod \"dns-default-t8cnk\" (UID: \"110c903e-620c-4347-94f2-6ba9507a5eed\") " pod="openshift-dns/dns-default-t8cnk" Jul 24 13:43:56.448896 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:56.448847 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c59fc\" (UniqueName: \"kubernetes.io/projected/177883b4-be88-4410-b00a-036caa467bc4-kube-api-access-c59fc\") pod \"ingress-canary-4c9r4\" (UID: \"177883b4-be88-4410-b00a-036caa467bc4\") " pod="openshift-ingress-canary/ingress-canary-4c9r4" Jul 24 13:43:56.449116 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:56.449090 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/40a228a1-d1c2-44eb-b851-f3f49460a3aa-crio-socket\") pod \"insights-runtime-extractor-brx7p\" (UID: \"40a228a1-d1c2-44eb-b851-f3f49460a3aa\") " pod="openshift-insights/insights-runtime-extractor-brx7p" Jul 24 13:43:56.449190 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:56.449132 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/177883b4-be88-4410-b00a-036caa467bc4-cert\") pod \"ingress-canary-4c9r4\" (UID: \"177883b4-be88-4410-b00a-036caa467bc4\") " pod="openshift-ingress-canary/ingress-canary-4c9r4" Jul 24 13:43:56.449252 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:56.449187 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/40a228a1-d1c2-44eb-b851-f3f49460a3aa-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-brx7p\" (UID: \"40a228a1-d1c2-44eb-b851-f3f49460a3aa\") " pod="openshift-insights/insights-runtime-extractor-brx7p" Jul 24 13:43:56.449315 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:56.449253 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/110c903e-620c-4347-94f2-6ba9507a5eed-config-volume\") pod \"dns-default-t8cnk\" (UID: \"110c903e-620c-4347-94f2-6ba9507a5eed\") " pod="openshift-dns/dns-default-t8cnk" Jul 24 13:43:56.449315 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:56.449286 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/40a228a1-d1c2-44eb-b851-f3f49460a3aa-data-volume\") pod \"insights-runtime-extractor-brx7p\" (UID: \"40a228a1-d1c2-44eb-b851-f3f49460a3aa\") " pod="openshift-insights/insights-runtime-extractor-brx7p" Jul 24 13:43:56.449442 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:56.449314 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/40a228a1-d1c2-44eb-b851-f3f49460a3aa-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-brx7p\" (UID: \"40a228a1-d1c2-44eb-b851-f3f49460a3aa\") " pod="openshift-insights/insights-runtime-extractor-brx7p" Jul 24 13:43:56.449442 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:56.449346 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/110c903e-620c-4347-94f2-6ba9507a5eed-metrics-tls\") pod \"dns-default-t8cnk\" (UID: \"110c903e-620c-4347-94f2-6ba9507a5eed\") " pod="openshift-dns/dns-default-t8cnk" Jul 24 13:43:56.449542 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:56.449463 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xc6bn\" (UniqueName: \"kubernetes.io/projected/40a228a1-d1c2-44eb-b851-f3f49460a3aa-kube-api-access-xc6bn\") pod \"insights-runtime-extractor-brx7p\" (UID: \"40a228a1-d1c2-44eb-b851-f3f49460a3aa\") " pod="openshift-insights/insights-runtime-extractor-brx7p" Jul 24 13:43:56.449542 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:56.449500 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/110c903e-620c-4347-94f2-6ba9507a5eed-tmp-dir\") pod \"dns-default-t8cnk\" (UID: \"110c903e-620c-4347-94f2-6ba9507a5eed\") " pod="openshift-dns/dns-default-t8cnk" Jul 24 13:43:56.449745 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:56.449724 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/110c903e-620c-4347-94f2-6ba9507a5eed-config-volume\") pod \"dns-default-t8cnk\" (UID: \"110c903e-620c-4347-94f2-6ba9507a5eed\") " pod="openshift-dns/dns-default-t8cnk" Jul 24 13:43:56.449823 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:56.449757 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/110c903e-620c-4347-94f2-6ba9507a5eed-tmp-dir\") pod \"dns-default-t8cnk\" (UID: \"110c903e-620c-4347-94f2-6ba9507a5eed\") " pod="openshift-dns/dns-default-t8cnk" Jul 24 13:43:56.453064 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:56.453046 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/177883b4-be88-4410-b00a-036caa467bc4-cert\") pod \"ingress-canary-4c9r4\" (UID: \"177883b4-be88-4410-b00a-036caa467bc4\") " pod="openshift-ingress-canary/ingress-canary-4c9r4" Jul 24 13:43:56.453146 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:56.453062 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/110c903e-620c-4347-94f2-6ba9507a5eed-metrics-tls\") pod \"dns-default-t8cnk\" (UID: \"110c903e-620c-4347-94f2-6ba9507a5eed\") " pod="openshift-dns/dns-default-t8cnk" Jul 24 13:43:56.457172 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:56.457151 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b25l9\" (UniqueName: \"kubernetes.io/projected/110c903e-620c-4347-94f2-6ba9507a5eed-kube-api-access-b25l9\") pod \"dns-default-t8cnk\" (UID: \"110c903e-620c-4347-94f2-6ba9507a5eed\") " pod="openshift-dns/dns-default-t8cnk" Jul 24 13:43:56.466836 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:56.466818 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c59fc\" (UniqueName: \"kubernetes.io/projected/177883b4-be88-4410-b00a-036caa467bc4-kube-api-access-c59fc\") pod \"ingress-canary-4c9r4\" (UID: \"177883b4-be88-4410-b00a-036caa467bc4\") " pod="openshift-ingress-canary/ingress-canary-4c9r4" Jul 24 13:43:56.492100 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:56.492070 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-t8cnk" Jul 24 13:43:56.501128 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:56.501105 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-4c9r4" Jul 24 13:43:56.550554 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:56.550511 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xc6bn\" (UniqueName: \"kubernetes.io/projected/40a228a1-d1c2-44eb-b851-f3f49460a3aa-kube-api-access-xc6bn\") pod \"insights-runtime-extractor-brx7p\" (UID: \"40a228a1-d1c2-44eb-b851-f3f49460a3aa\") " pod="openshift-insights/insights-runtime-extractor-brx7p" Jul 24 13:43:56.550660 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:56.550577 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/40a228a1-d1c2-44eb-b851-f3f49460a3aa-crio-socket\") pod \"insights-runtime-extractor-brx7p\" (UID: \"40a228a1-d1c2-44eb-b851-f3f49460a3aa\") " pod="openshift-insights/insights-runtime-extractor-brx7p" Jul 24 13:43:56.550660 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:56.550607 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/40a228a1-d1c2-44eb-b851-f3f49460a3aa-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-brx7p\" (UID: \"40a228a1-d1c2-44eb-b851-f3f49460a3aa\") " pod="openshift-insights/insights-runtime-extractor-brx7p" Jul 24 13:43:56.550660 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:56.550627 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/40a228a1-d1c2-44eb-b851-f3f49460a3aa-data-volume\") pod \"insights-runtime-extractor-brx7p\" (UID: \"40a228a1-d1c2-44eb-b851-f3f49460a3aa\") " pod="openshift-insights/insights-runtime-extractor-brx7p" Jul 24 13:43:56.550660 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:56.550643 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/40a228a1-d1c2-44eb-b851-f3f49460a3aa-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-brx7p\" (UID: \"40a228a1-d1c2-44eb-b851-f3f49460a3aa\") " pod="openshift-insights/insights-runtime-extractor-brx7p" Jul 24 13:43:56.550839 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:56.550764 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/40a228a1-d1c2-44eb-b851-f3f49460a3aa-crio-socket\") pod \"insights-runtime-extractor-brx7p\" (UID: \"40a228a1-d1c2-44eb-b851-f3f49460a3aa\") " pod="openshift-insights/insights-runtime-extractor-brx7p" Jul 24 13:43:56.551228 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:56.551174 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/40a228a1-d1c2-44eb-b851-f3f49460a3aa-data-volume\") pod \"insights-runtime-extractor-brx7p\" (UID: \"40a228a1-d1c2-44eb-b851-f3f49460a3aa\") " pod="openshift-insights/insights-runtime-extractor-brx7p" Jul 24 13:43:56.551228 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:56.551212 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/40a228a1-d1c2-44eb-b851-f3f49460a3aa-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-brx7p\" (UID: \"40a228a1-d1c2-44eb-b851-f3f49460a3aa\") " pod="openshift-insights/insights-runtime-extractor-brx7p" Jul 24 13:43:56.552966 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:56.552948 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/40a228a1-d1c2-44eb-b851-f3f49460a3aa-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-brx7p\" (UID: \"40a228a1-d1c2-44eb-b851-f3f49460a3aa\") " pod="openshift-insights/insights-runtime-extractor-brx7p" Jul 24 13:43:56.559357 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:56.559324 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xc6bn\" (UniqueName: \"kubernetes.io/projected/40a228a1-d1c2-44eb-b851-f3f49460a3aa-kube-api-access-xc6bn\") pod \"insights-runtime-extractor-brx7p\" (UID: \"40a228a1-d1c2-44eb-b851-f3f49460a3aa\") " pod="openshift-insights/insights-runtime-extractor-brx7p" Jul 24 13:43:56.605361 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:56.605107 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-brx7p" Jul 24 13:43:56.646354 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:56.646232 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-kkmd2"] Jul 24 13:43:56.654516 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:56.654399 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-kkmd2" Jul 24 13:43:56.656747 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:56.656708 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 24 13:43:56.656747 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:56.656737 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-qpncw\"" Jul 24 13:43:56.660898 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:56.660838 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-kkmd2"] Jul 24 13:43:56.694464 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:56.694436 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-4c9r4"] Jul 24 13:43:56.698426 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:56.698371 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod177883b4_be88_4410_b00a_036caa467bc4.slice/crio-4e1d5a9e76ab22101b0157d1797ddc61878d8c839167b02200e22e8c36b2ddde WatchSource:0}: Error finding container 4e1d5a9e76ab22101b0157d1797ddc61878d8c839167b02200e22e8c36b2ddde: Status 404 returned error can't find the container with id 4e1d5a9e76ab22101b0157d1797ddc61878d8c839167b02200e22e8c36b2ddde Jul 24 13:43:56.699543 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:56.699442 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-t8cnk"] Jul 24 13:43:56.703947 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:56.703924 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod110c903e_620c_4347_94f2_6ba9507a5eed.slice/crio-522154de4bfb510924af5215fd8f91525439a06402d323b7d305f86c68e114ef WatchSource:0}: Error finding container 522154de4bfb510924af5215fd8f91525439a06402d323b7d305f86c68e114ef: Status 404 returned error can't find the container with id 522154de4bfb510924af5215fd8f91525439a06402d323b7d305f86c68e114ef Jul 24 13:43:56.751981 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:56.751944 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/4133be4d-4143-4c3b-8fcc-db08a10b92b6-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-kkmd2\" (UID: \"4133be4d-4143-4c3b-8fcc-db08a10b92b6\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-kkmd2" Jul 24 13:43:56.753935 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:56.753906 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-brx7p"] Jul 24 13:43:56.757400 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:43:56.757380 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40a228a1_d1c2_44eb_b851_f3f49460a3aa.slice/crio-bb802fc854da47dd4da835638d4960ef9f236a11b27beba561f90ea69e61c0c1 WatchSource:0}: Error finding container bb802fc854da47dd4da835638d4960ef9f236a11b27beba561f90ea69e61c0c1: Status 404 returned error can't find the container with id bb802fc854da47dd4da835638d4960ef9f236a11b27beba561f90ea69e61c0c1 Jul 24 13:43:56.852731 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:56.852695 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/4133be4d-4143-4c3b-8fcc-db08a10b92b6-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-kkmd2\" (UID: \"4133be4d-4143-4c3b-8fcc-db08a10b92b6\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-kkmd2" Jul 24 13:43:56.852899 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:43:56.852847 2578 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jul 24 13:43:56.852937 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:43:56.852916 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4133be4d-4143-4c3b-8fcc-db08a10b92b6-tls-certificates podName:4133be4d-4143-4c3b-8fcc-db08a10b92b6 nodeName:}" failed. No retries permitted until 2026-07-24 13:43:57.352900301 +0000 UTC m=+45.010877664 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/4133be4d-4143-4c3b-8fcc-db08a10b92b6-tls-certificates") pod "prometheus-operator-admission-webhook-7f8d78f54b-kkmd2" (UID: "4133be4d-4143-4c3b-8fcc-db08a10b92b6") : secret "prometheus-operator-admission-webhook-tls" not found Jul 24 13:43:57.228006 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:57.227970 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-brx7p" event={"ID":"40a228a1-d1c2-44eb-b851-f3f49460a3aa","Type":"ContainerStarted","Data":"bb802fc854da47dd4da835638d4960ef9f236a11b27beba561f90ea69e61c0c1"} Jul 24 13:43:57.229108 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:57.229082 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-4c9r4" event={"ID":"177883b4-be88-4410-b00a-036caa467bc4","Type":"ContainerStarted","Data":"4e1d5a9e76ab22101b0157d1797ddc61878d8c839167b02200e22e8c36b2ddde"} Jul 24 13:43:57.229992 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:57.229971 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-t8cnk" event={"ID":"110c903e-620c-4347-94f2-6ba9507a5eed","Type":"ContainerStarted","Data":"522154de4bfb510924af5215fd8f91525439a06402d323b7d305f86c68e114ef"} Jul 24 13:43:57.356369 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:57.356329 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/4133be4d-4143-4c3b-8fcc-db08a10b92b6-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-kkmd2\" (UID: \"4133be4d-4143-4c3b-8fcc-db08a10b92b6\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-kkmd2" Jul 24 13:43:57.360620 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:57.360587 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/4133be4d-4143-4c3b-8fcc-db08a10b92b6-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-kkmd2\" (UID: \"4133be4d-4143-4c3b-8fcc-db08a10b92b6\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-kkmd2" Jul 24 13:43:57.566347 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:57.566262 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-kkmd2" Jul 24 13:43:57.760218 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:57.760174 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-kkmd2"] Jul 24 13:43:57.916139 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:57.914841 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n845m" Jul 24 13:43:57.916139 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:57.915487 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f8gm6" Jul 24 13:43:57.919125 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:57.916512 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5jqwl" Jul 24 13:43:57.922701 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:57.921001 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 24 13:43:57.922701 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:57.921234 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-cbzbq\"" Jul 24 13:43:57.922701 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:57.921439 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 24 13:43:57.922701 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:57.921709 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 24 13:43:57.922701 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:57.921922 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 24 13:43:57.922701 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:57.922118 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-l5jkr\"" Jul 24 13:43:58.235738 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:58.235638 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-kkmd2" event={"ID":"4133be4d-4143-4c3b-8fcc-db08a10b92b6","Type":"ContainerStarted","Data":"d98126a8a93dfee09414dffdca6d165bd9c925c25d9bec5796b08979b1c29156"} Jul 24 13:43:58.317602 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:58.316651 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-67b4749744-k56g2"] Jul 24 13:43:58.330177 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:58.330144 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67b4749744-k56g2" Jul 24 13:43:58.331351 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:58.331325 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-67b4749744-k56g2"] Jul 24 13:43:58.333723 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:58.333429 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 24 13:43:58.333723 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:58.333549 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 24 13:43:58.333919 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:58.333781 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 24 13:43:58.333919 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:58.333828 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-wstls\"" Jul 24 13:43:58.334232 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:58.333964 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 24 13:43:58.334232 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:58.334189 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 24 13:43:58.334232 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:58.334218 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 24 13:43:58.334647 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:58.334629 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 24 13:43:58.365774 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:58.365730 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9a0379f3-a079-420c-a31b-9722b74f6c3f-console-oauth-config\") pod \"console-67b4749744-k56g2\" (UID: \"9a0379f3-a079-420c-a31b-9722b74f6c3f\") " pod="openshift-console/console-67b4749744-k56g2" Jul 24 13:43:58.365995 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:58.365789 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ppwn9\" (UniqueName: \"kubernetes.io/projected/9a0379f3-a079-420c-a31b-9722b74f6c3f-kube-api-access-ppwn9\") pod \"console-67b4749744-k56g2\" (UID: \"9a0379f3-a079-420c-a31b-9722b74f6c3f\") " pod="openshift-console/console-67b4749744-k56g2" Jul 24 13:43:58.365995 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:58.365818 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9a0379f3-a079-420c-a31b-9722b74f6c3f-console-config\") pod \"console-67b4749744-k56g2\" (UID: \"9a0379f3-a079-420c-a31b-9722b74f6c3f\") " pod="openshift-console/console-67b4749744-k56g2" Jul 24 13:43:58.365995 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:58.365863 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9a0379f3-a079-420c-a31b-9722b74f6c3f-console-serving-cert\") pod \"console-67b4749744-k56g2\" (UID: \"9a0379f3-a079-420c-a31b-9722b74f6c3f\") " pod="openshift-console/console-67b4749744-k56g2" Jul 24 13:43:58.365995 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:58.365917 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9a0379f3-a079-420c-a31b-9722b74f6c3f-service-ca\") pod \"console-67b4749744-k56g2\" (UID: \"9a0379f3-a079-420c-a31b-9722b74f6c3f\") " pod="openshift-console/console-67b4749744-k56g2" Jul 24 13:43:58.366223 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:58.366025 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9a0379f3-a079-420c-a31b-9722b74f6c3f-oauth-serving-cert\") pod \"console-67b4749744-k56g2\" (UID: \"9a0379f3-a079-420c-a31b-9722b74f6c3f\") " pod="openshift-console/console-67b4749744-k56g2" Jul 24 13:43:58.467075 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:58.467037 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9a0379f3-a079-420c-a31b-9722b74f6c3f-console-serving-cert\") pod \"console-67b4749744-k56g2\" (UID: \"9a0379f3-a079-420c-a31b-9722b74f6c3f\") " pod="openshift-console/console-67b4749744-k56g2" Jul 24 13:43:58.467261 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:58.467090 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9a0379f3-a079-420c-a31b-9722b74f6c3f-service-ca\") pod \"console-67b4749744-k56g2\" (UID: \"9a0379f3-a079-420c-a31b-9722b74f6c3f\") " pod="openshift-console/console-67b4749744-k56g2" Jul 24 13:43:58.467261 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:58.467154 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9a0379f3-a079-420c-a31b-9722b74f6c3f-oauth-serving-cert\") pod \"console-67b4749744-k56g2\" (UID: \"9a0379f3-a079-420c-a31b-9722b74f6c3f\") " pod="openshift-console/console-67b4749744-k56g2" Jul 24 13:43:58.467261 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:58.467216 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9a0379f3-a079-420c-a31b-9722b74f6c3f-console-oauth-config\") pod \"console-67b4749744-k56g2\" (UID: \"9a0379f3-a079-420c-a31b-9722b74f6c3f\") " pod="openshift-console/console-67b4749744-k56g2" Jul 24 13:43:58.467261 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:58.467241 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ppwn9\" (UniqueName: \"kubernetes.io/projected/9a0379f3-a079-420c-a31b-9722b74f6c3f-kube-api-access-ppwn9\") pod \"console-67b4749744-k56g2\" (UID: \"9a0379f3-a079-420c-a31b-9722b74f6c3f\") " pod="openshift-console/console-67b4749744-k56g2" Jul 24 13:43:58.467493 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:58.467267 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9a0379f3-a079-420c-a31b-9722b74f6c3f-console-config\") pod \"console-67b4749744-k56g2\" (UID: \"9a0379f3-a079-420c-a31b-9722b74f6c3f\") " pod="openshift-console/console-67b4749744-k56g2" Jul 24 13:43:58.481235 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:58.480908 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9a0379f3-a079-420c-a31b-9722b74f6c3f-oauth-serving-cert\") pod \"console-67b4749744-k56g2\" (UID: \"9a0379f3-a079-420c-a31b-9722b74f6c3f\") " pod="openshift-console/console-67b4749744-k56g2" Jul 24 13:43:58.481235 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:58.481006 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9a0379f3-a079-420c-a31b-9722b74f6c3f-console-config\") pod \"console-67b4749744-k56g2\" (UID: \"9a0379f3-a079-420c-a31b-9722b74f6c3f\") " pod="openshift-console/console-67b4749744-k56g2" Jul 24 13:43:58.481235 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:58.481050 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9a0379f3-a079-420c-a31b-9722b74f6c3f-service-ca\") pod \"console-67b4749744-k56g2\" (UID: \"9a0379f3-a079-420c-a31b-9722b74f6c3f\") " pod="openshift-console/console-67b4749744-k56g2" Jul 24 13:43:58.481235 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:58.481173 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9a0379f3-a079-420c-a31b-9722b74f6c3f-console-oauth-config\") pod \"console-67b4749744-k56g2\" (UID: \"9a0379f3-a079-420c-a31b-9722b74f6c3f\") " pod="openshift-console/console-67b4749744-k56g2" Jul 24 13:43:58.481577 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:58.481352 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9a0379f3-a079-420c-a31b-9722b74f6c3f-console-serving-cert\") pod \"console-67b4749744-k56g2\" (UID: \"9a0379f3-a079-420c-a31b-9722b74f6c3f\") " pod="openshift-console/console-67b4749744-k56g2" Jul 24 13:43:58.481577 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:58.481458 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ppwn9\" (UniqueName: \"kubernetes.io/projected/9a0379f3-a079-420c-a31b-9722b74f6c3f-kube-api-access-ppwn9\") pod \"console-67b4749744-k56g2\" (UID: \"9a0379f3-a079-420c-a31b-9722b74f6c3f\") " pod="openshift-console/console-67b4749744-k56g2" Jul 24 13:43:58.651485 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:43:58.651432 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67b4749744-k56g2" Jul 24 13:44:03.402709 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:03.402505 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-67b4749744-k56g2"] Jul 24 13:44:03.856457 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:44:03.856424 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a0379f3_a079_420c_a31b_9722b74f6c3f.slice/crio-5dcd1437466f599a9b2e2dd854e5300813ec0dd079eff642eef523317e93c380 WatchSource:0}: Error finding container 5dcd1437466f599a9b2e2dd854e5300813ec0dd079eff642eef523317e93c380: Status 404 returned error can't find the container with id 5dcd1437466f599a9b2e2dd854e5300813ec0dd079eff642eef523317e93c380 Jul 24 13:44:04.253603 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:04.253528 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-kkmd2" event={"ID":"4133be4d-4143-4c3b-8fcc-db08a10b92b6","Type":"ContainerStarted","Data":"34ec2459891a8d86492479f02155f49ab45d4c60ed888cfc620a382bf9615084"} Jul 24 13:44:04.255280 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:04.255243 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-4c9r4" event={"ID":"177883b4-be88-4410-b00a-036caa467bc4","Type":"ContainerStarted","Data":"25255c0debb8b4eb8368c5cb992c0ec8c94d25439956cff4574de6cfb11c684b"} Jul 24 13:44:04.257120 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:04.257087 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-brx7p" event={"ID":"40a228a1-d1c2-44eb-b851-f3f49460a3aa","Type":"ContainerStarted","Data":"3101000814b73863ccf1402924fe3590fa4245937bcd2bc4b1f3b548bbdd6673"} Jul 24 13:44:04.258882 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:04.258827 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-t8cnk" event={"ID":"110c903e-620c-4347-94f2-6ba9507a5eed","Type":"ContainerStarted","Data":"6669177896d8891247cafe2e0cd3f1489d8804338e69c7fe2c7c21d26ed35ddd"} Jul 24 13:44:04.260154 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:04.260117 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67b4749744-k56g2" event={"ID":"9a0379f3-a079-420c-a31b-9722b74f6c3f","Type":"ContainerStarted","Data":"5dcd1437466f599a9b2e2dd854e5300813ec0dd079eff642eef523317e93c380"} Jul 24 13:44:04.267442 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:04.267372 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-kkmd2" Jul 24 13:44:04.272263 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:04.272223 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-kkmd2" Jul 24 13:44:04.304224 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:04.303974 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-kkmd2" podStartSLOduration=2.017572191 podStartE2EDuration="8.303953105s" totalImagesPullingTime="6.286380914s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 13:43:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:44:04.28259681 +0000 UTC m=+51.940574196" watchObservedRunningTime="2026-07-24 13:44:04.303953105 +0000 UTC m=+51.961930473" Jul 24 13:44:04.304769 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:04.304735 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-4c9r4" podStartSLOduration=1.756520146 podStartE2EDuration="8.304716871s" totalImagesPullingTime="6.548196725s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 13:43:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:44:04.303672564 +0000 UTC m=+51.961649953" watchObservedRunningTime="2026-07-24 13:44:04.304716871 +0000 UTC m=+51.962694259" Jul 24 13:44:04.734197 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:04.734020 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-7rlng"] Jul 24 13:44:04.747096 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:04.747025 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-7rlng" Jul 24 13:44:04.747942 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:04.747917 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-7rlng"] Jul 24 13:44:04.749284 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:04.749133 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 24 13:44:04.749284 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:04.749189 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 24 13:44:04.749284 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:04.749247 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 24 13:44:04.749745 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:04.749720 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-4cjdk\"" Jul 24 13:44:04.750076 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:04.750059 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 24 13:44:04.750327 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:04.750289 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 24 13:44:04.820199 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:04.820160 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/df45a5db-87e1-4ee4-9c58-0f1e61b53767-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-7rlng\" (UID: \"df45a5db-87e1-4ee4-9c58-0f1e61b53767\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-7rlng" Jul 24 13:44:04.820199 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:04.820209 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/df45a5db-87e1-4ee4-9c58-0f1e61b53767-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-7rlng\" (UID: \"df45a5db-87e1-4ee4-9c58-0f1e61b53767\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-7rlng" Jul 24 13:44:04.820508 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:04.820319 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/df45a5db-87e1-4ee4-9c58-0f1e61b53767-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-7rlng\" (UID: \"df45a5db-87e1-4ee4-9c58-0f1e61b53767\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-7rlng" Jul 24 13:44:04.820508 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:04.820361 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z9cm6\" (UniqueName: \"kubernetes.io/projected/df45a5db-87e1-4ee4-9c58-0f1e61b53767-kube-api-access-z9cm6\") pod \"prometheus-operator-84d69f794d-7rlng\" (UID: \"df45a5db-87e1-4ee4-9c58-0f1e61b53767\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-7rlng" Jul 24 13:44:04.921149 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:04.921084 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/df45a5db-87e1-4ee4-9c58-0f1e61b53767-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-7rlng\" (UID: \"df45a5db-87e1-4ee4-9c58-0f1e61b53767\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-7rlng" Jul 24 13:44:04.921375 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:04.921352 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z9cm6\" (UniqueName: \"kubernetes.io/projected/df45a5db-87e1-4ee4-9c58-0f1e61b53767-kube-api-access-z9cm6\") pod \"prometheus-operator-84d69f794d-7rlng\" (UID: \"df45a5db-87e1-4ee4-9c58-0f1e61b53767\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-7rlng" Jul 24 13:44:04.921526 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:04.921508 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/df45a5db-87e1-4ee4-9c58-0f1e61b53767-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-7rlng\" (UID: \"df45a5db-87e1-4ee4-9c58-0f1e61b53767\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-7rlng" Jul 24 13:44:04.921605 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:04.921541 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/df45a5db-87e1-4ee4-9c58-0f1e61b53767-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-7rlng\" (UID: \"df45a5db-87e1-4ee4-9c58-0f1e61b53767\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-7rlng" Jul 24 13:44:04.922430 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:04.922392 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/df45a5db-87e1-4ee4-9c58-0f1e61b53767-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-7rlng\" (UID: \"df45a5db-87e1-4ee4-9c58-0f1e61b53767\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-7rlng" Jul 24 13:44:04.926170 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:04.926140 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/df45a5db-87e1-4ee4-9c58-0f1e61b53767-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-7rlng\" (UID: \"df45a5db-87e1-4ee4-9c58-0f1e61b53767\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-7rlng" Jul 24 13:44:04.926762 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:04.926724 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/df45a5db-87e1-4ee4-9c58-0f1e61b53767-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-7rlng\" (UID: \"df45a5db-87e1-4ee4-9c58-0f1e61b53767\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-7rlng" Jul 24 13:44:04.930966 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:04.930942 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z9cm6\" (UniqueName: \"kubernetes.io/projected/df45a5db-87e1-4ee4-9c58-0f1e61b53767-kube-api-access-z9cm6\") pod \"prometheus-operator-84d69f794d-7rlng\" (UID: \"df45a5db-87e1-4ee4-9c58-0f1e61b53767\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-7rlng" Jul 24 13:44:05.058958 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:05.058858 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-7rlng" Jul 24 13:44:05.257958 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:05.257919 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-7rlng"] Jul 24 13:44:05.263910 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:44:05.263877 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf45a5db_87e1_4ee4_9c58_0f1e61b53767.slice/crio-8a8d7a855266275087da2191b3f36eb7ea8c5e3b917b3f9cb39cd2dab05bf32d WatchSource:0}: Error finding container 8a8d7a855266275087da2191b3f36eb7ea8c5e3b917b3f9cb39cd2dab05bf32d: Status 404 returned error can't find the container with id 8a8d7a855266275087da2191b3f36eb7ea8c5e3b917b3f9cb39cd2dab05bf32d Jul 24 13:44:05.267827 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:05.267762 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-t8cnk" event={"ID":"110c903e-620c-4347-94f2-6ba9507a5eed","Type":"ContainerStarted","Data":"a3826d58d4bda2ca37a9bf2d45060fe471d44c3fb9a3b75e185c1a6073b6c230"} Jul 24 13:44:05.286574 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:05.285629 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-t8cnk" podStartSLOduration=2.322004932 podStartE2EDuration="9.285605432s" totalImagesPullingTime="6.9636005s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 13:43:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:44:05.284765565 +0000 UTC m=+52.942742949" watchObservedRunningTime="2026-07-24 13:44:05.285605432 +0000 UTC m=+52.943582800" Jul 24 13:44:05.694160 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:05.694126 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-698c986d56-5hd2x"] Jul 24 13:44:05.708603 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:05.708041 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-698c986d56-5hd2x"] Jul 24 13:44:05.708603 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:05.708160 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-698c986d56-5hd2x" Jul 24 13:44:05.716139 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:05.716080 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 24 13:44:05.729862 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:05.729826 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dbfee0b6-4cc6-48ab-a5d4-d9d3810a7947-console-config\") pod \"console-698c986d56-5hd2x\" (UID: \"dbfee0b6-4cc6-48ab-a5d4-d9d3810a7947\") " pod="openshift-console/console-698c986d56-5hd2x" Jul 24 13:44:05.729862 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:05.729868 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-57t2m\" (UniqueName: \"kubernetes.io/projected/dbfee0b6-4cc6-48ab-a5d4-d9d3810a7947-kube-api-access-57t2m\") pod \"console-698c986d56-5hd2x\" (UID: \"dbfee0b6-4cc6-48ab-a5d4-d9d3810a7947\") " pod="openshift-console/console-698c986d56-5hd2x" Jul 24 13:44:05.730081 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:05.729907 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dbfee0b6-4cc6-48ab-a5d4-d9d3810a7947-service-ca\") pod \"console-698c986d56-5hd2x\" (UID: \"dbfee0b6-4cc6-48ab-a5d4-d9d3810a7947\") " pod="openshift-console/console-698c986d56-5hd2x" Jul 24 13:44:05.730081 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:05.729950 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dbfee0b6-4cc6-48ab-a5d4-d9d3810a7947-trusted-ca-bundle\") pod \"console-698c986d56-5hd2x\" (UID: \"dbfee0b6-4cc6-48ab-a5d4-d9d3810a7947\") " pod="openshift-console/console-698c986d56-5hd2x" Jul 24 13:44:05.730081 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:05.729981 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dbfee0b6-4cc6-48ab-a5d4-d9d3810a7947-console-oauth-config\") pod \"console-698c986d56-5hd2x\" (UID: \"dbfee0b6-4cc6-48ab-a5d4-d9d3810a7947\") " pod="openshift-console/console-698c986d56-5hd2x" Jul 24 13:44:05.730081 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:05.730044 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dbfee0b6-4cc6-48ab-a5d4-d9d3810a7947-console-serving-cert\") pod \"console-698c986d56-5hd2x\" (UID: \"dbfee0b6-4cc6-48ab-a5d4-d9d3810a7947\") " pod="openshift-console/console-698c986d56-5hd2x" Jul 24 13:44:05.730275 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:05.730116 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dbfee0b6-4cc6-48ab-a5d4-d9d3810a7947-oauth-serving-cert\") pod \"console-698c986d56-5hd2x\" (UID: \"dbfee0b6-4cc6-48ab-a5d4-d9d3810a7947\") " pod="openshift-console/console-698c986d56-5hd2x" Jul 24 13:44:05.832077 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:05.830986 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dbfee0b6-4cc6-48ab-a5d4-d9d3810a7947-trusted-ca-bundle\") pod \"console-698c986d56-5hd2x\" (UID: \"dbfee0b6-4cc6-48ab-a5d4-d9d3810a7947\") " pod="openshift-console/console-698c986d56-5hd2x" Jul 24 13:44:05.832077 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:05.831037 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dbfee0b6-4cc6-48ab-a5d4-d9d3810a7947-console-oauth-config\") pod \"console-698c986d56-5hd2x\" (UID: \"dbfee0b6-4cc6-48ab-a5d4-d9d3810a7947\") " pod="openshift-console/console-698c986d56-5hd2x" Jul 24 13:44:05.832077 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:05.831074 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dbfee0b6-4cc6-48ab-a5d4-d9d3810a7947-console-serving-cert\") pod \"console-698c986d56-5hd2x\" (UID: \"dbfee0b6-4cc6-48ab-a5d4-d9d3810a7947\") " pod="openshift-console/console-698c986d56-5hd2x" Jul 24 13:44:05.832077 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:05.831134 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dbfee0b6-4cc6-48ab-a5d4-d9d3810a7947-oauth-serving-cert\") pod \"console-698c986d56-5hd2x\" (UID: \"dbfee0b6-4cc6-48ab-a5d4-d9d3810a7947\") " pod="openshift-console/console-698c986d56-5hd2x" Jul 24 13:44:05.832077 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:05.831190 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dbfee0b6-4cc6-48ab-a5d4-d9d3810a7947-console-config\") pod \"console-698c986d56-5hd2x\" (UID: \"dbfee0b6-4cc6-48ab-a5d4-d9d3810a7947\") " pod="openshift-console/console-698c986d56-5hd2x" Jul 24 13:44:05.832077 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:05.831214 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-57t2m\" (UniqueName: \"kubernetes.io/projected/dbfee0b6-4cc6-48ab-a5d4-d9d3810a7947-kube-api-access-57t2m\") pod \"console-698c986d56-5hd2x\" (UID: \"dbfee0b6-4cc6-48ab-a5d4-d9d3810a7947\") " pod="openshift-console/console-698c986d56-5hd2x" Jul 24 13:44:05.832077 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:05.831255 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dbfee0b6-4cc6-48ab-a5d4-d9d3810a7947-service-ca\") pod \"console-698c986d56-5hd2x\" (UID: \"dbfee0b6-4cc6-48ab-a5d4-d9d3810a7947\") " pod="openshift-console/console-698c986d56-5hd2x" Jul 24 13:44:05.832077 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:05.832021 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dbfee0b6-4cc6-48ab-a5d4-d9d3810a7947-service-ca\") pod \"console-698c986d56-5hd2x\" (UID: \"dbfee0b6-4cc6-48ab-a5d4-d9d3810a7947\") " pod="openshift-console/console-698c986d56-5hd2x" Jul 24 13:44:05.832908 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:05.832727 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dbfee0b6-4cc6-48ab-a5d4-d9d3810a7947-console-config\") pod \"console-698c986d56-5hd2x\" (UID: \"dbfee0b6-4cc6-48ab-a5d4-d9d3810a7947\") " pod="openshift-console/console-698c986d56-5hd2x" Jul 24 13:44:05.832908 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:05.832868 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dbfee0b6-4cc6-48ab-a5d4-d9d3810a7947-oauth-serving-cert\") pod \"console-698c986d56-5hd2x\" (UID: \"dbfee0b6-4cc6-48ab-a5d4-d9d3810a7947\") " pod="openshift-console/console-698c986d56-5hd2x" Jul 24 13:44:05.833010 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:05.832971 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dbfee0b6-4cc6-48ab-a5d4-d9d3810a7947-trusted-ca-bundle\") pod \"console-698c986d56-5hd2x\" (UID: \"dbfee0b6-4cc6-48ab-a5d4-d9d3810a7947\") " pod="openshift-console/console-698c986d56-5hd2x" Jul 24 13:44:05.835217 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:05.835172 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dbfee0b6-4cc6-48ab-a5d4-d9d3810a7947-console-serving-cert\") pod \"console-698c986d56-5hd2x\" (UID: \"dbfee0b6-4cc6-48ab-a5d4-d9d3810a7947\") " pod="openshift-console/console-698c986d56-5hd2x" Jul 24 13:44:05.835813 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:05.835771 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dbfee0b6-4cc6-48ab-a5d4-d9d3810a7947-console-oauth-config\") pod \"console-698c986d56-5hd2x\" (UID: \"dbfee0b6-4cc6-48ab-a5d4-d9d3810a7947\") " pod="openshift-console/console-698c986d56-5hd2x" Jul 24 13:44:05.841252 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:05.841203 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-57t2m\" (UniqueName: \"kubernetes.io/projected/dbfee0b6-4cc6-48ab-a5d4-d9d3810a7947-kube-api-access-57t2m\") pod \"console-698c986d56-5hd2x\" (UID: \"dbfee0b6-4cc6-48ab-a5d4-d9d3810a7947\") " pod="openshift-console/console-698c986d56-5hd2x" Jul 24 13:44:06.020973 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:06.020633 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-698c986d56-5hd2x" Jul 24 13:44:06.203156 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:06.203083 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-698c986d56-5hd2x"] Jul 24 13:44:06.274244 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:06.273539 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-7rlng" event={"ID":"df45a5db-87e1-4ee4-9c58-0f1e61b53767","Type":"ContainerStarted","Data":"8a8d7a855266275087da2191b3f36eb7ea8c5e3b917b3f9cb39cd2dab05bf32d"} Jul 24 13:44:06.274244 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:06.273795 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-t8cnk" Jul 24 13:44:07.511569 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:44:07.511533 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbfee0b6_4cc6_48ab_a5d4_d9d3810a7947.slice/crio-b4619fcb78e346cfc252a3befc96d4a0434fc916a7ae89bba38d3d50a45d8ae7 WatchSource:0}: Error finding container b4619fcb78e346cfc252a3befc96d4a0434fc916a7ae89bba38d3d50a45d8ae7: Status 404 returned error can't find the container with id b4619fcb78e346cfc252a3befc96d4a0434fc916a7ae89bba38d3d50a45d8ae7 Jul 24 13:44:08.280978 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:08.280776 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-698c986d56-5hd2x" event={"ID":"dbfee0b6-4cc6-48ab-a5d4-d9d3810a7947","Type":"ContainerStarted","Data":"b4619fcb78e346cfc252a3befc96d4a0434fc916a7ae89bba38d3d50a45d8ae7"} Jul 24 13:44:10.289591 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:10.289543 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-7rlng" event={"ID":"df45a5db-87e1-4ee4-9c58-0f1e61b53767","Type":"ContainerStarted","Data":"6c895ec1040c8316c88f6c495a50968adbd9a28d03fdd83515afba4dec4c6384"} Jul 24 13:44:10.290039 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:10.289645 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-7rlng" event={"ID":"df45a5db-87e1-4ee4-9c58-0f1e61b53767","Type":"ContainerStarted","Data":"300335bf87bc52cad62aff6b7340bbd0f4b575a5870d84f86608775801a09b3d"} Jul 24 13:44:10.291497 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:10.291472 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-brx7p" event={"ID":"40a228a1-d1c2-44eb-b851-f3f49460a3aa","Type":"ContainerStarted","Data":"55e9f2a8bfb1bdd01bb2ee79c24dbebaf3662c47bb25edc4da36d64430dccfb8"} Jul 24 13:44:10.293232 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:10.293203 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67b4749744-k56g2" event={"ID":"9a0379f3-a079-420c-a31b-9722b74f6c3f","Type":"ContainerStarted","Data":"836bb2cd673ee578fc2771946ffcabc12215da2384f9b007995af43bae2ce1b9"} Jul 24 13:44:10.294990 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:10.294967 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-698c986d56-5hd2x" event={"ID":"dbfee0b6-4cc6-48ab-a5d4-d9d3810a7947","Type":"ContainerStarted","Data":"7886ebf1a1a3e3c197fca2c4c8f53bfa6de3be2f80517d3b84ae75681f3eaef1"} Jul 24 13:44:10.309255 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:10.309210 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-84d69f794d-7rlng" podStartSLOduration=2.06102413 podStartE2EDuration="6.3091934s" totalImagesPullingTime="4.24816927s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 13:44:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:44:10.308162147 +0000 UTC m=+57.966139533" watchObservedRunningTime="2026-07-24 13:44:10.3091934 +0000 UTC m=+57.967170785" Jul 24 13:44:10.330921 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:10.330697 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-698c986d56-5hd2x" podStartSLOduration=3.295979145 podStartE2EDuration="5.330685138s" totalImagesPullingTime="2.034705993s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 13:44:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:44:10.330293505 +0000 UTC m=+57.988270904" watchObservedRunningTime="2026-07-24 13:44:10.330685138 +0000 UTC m=+57.988662524" Jul 24 13:44:10.345942 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:10.345883 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-67b4749744-k56g2" podStartSLOduration=6.889220646 podStartE2EDuration="12.34586443s" totalImagesPullingTime="5.456643784s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 13:43:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:44:10.345159473 +0000 UTC m=+58.003136858" watchObservedRunningTime="2026-07-24 13:44:10.34586443 +0000 UTC m=+58.003841797" Jul 24 13:44:12.086479 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:12.086433 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-f8nsv"] Jul 24 13:44:12.096076 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:12.096052 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-fbs2h"] Jul 24 13:44:12.096222 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:12.096187 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-f8nsv" Jul 24 13:44:12.098372 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:12.098352 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-q8wnd\"" Jul 24 13:44:12.098534 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:12.098384 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 24 13:44:12.098534 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:12.098422 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 24 13:44:12.098534 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:12.098500 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 24 13:44:12.098694 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:12.098614 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-4hqf8"] Jul 24 13:44:12.098748 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:12.098714 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-fbs2h" Jul 24 13:44:12.100531 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:12.100511 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 24 13:44:12.100778 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:12.100756 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 24 13:44:12.100957 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:12.100940 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-4hqf8" Jul 24 13:44:12.101306 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:12.101030 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-6mjj2\"" Jul 24 13:44:12.101545 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:12.101530 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 24 13:44:12.102993 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:12.102975 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 24 13:44:12.103421 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:12.103393 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-89kw6\"" Jul 24 13:44:12.103753 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:12.103720 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 24 13:44:12.104439 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:12.104239 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-4hqf8"] Jul 24 13:44:12.105418 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:12.105375 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-fbs2h"] Jul 24 13:44:12.187764 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:12.187730 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5c25c2f3-916a-404e-9e15-bff7a2511cf8-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-4hqf8\" (UID: \"5c25c2f3-916a-404e-9e15-bff7a2511cf8\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-4hqf8" Jul 24 13:44:12.187938 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:12.187777 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6v4xw\" (UniqueName: \"kubernetes.io/projected/67f0a71c-4582-4205-8e6d-9f2624778cd6-kube-api-access-6v4xw\") pod \"kube-state-metrics-56d9f944b4-fbs2h\" (UID: \"67f0a71c-4582-4205-8e6d-9f2624778cd6\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-fbs2h" Jul 24 13:44:12.187938 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:12.187845 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/67f0a71c-4582-4205-8e6d-9f2624778cd6-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-fbs2h\" (UID: \"67f0a71c-4582-4205-8e6d-9f2624778cd6\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-fbs2h" Jul 24 13:44:12.187938 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:12.187888 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9435272f-fb70-453f-b34f-3c5782f622db-sys\") pod \"node-exporter-f8nsv\" (UID: \"9435272f-fb70-453f-b34f-3c5782f622db\") " pod="openshift-monitoring/node-exporter-f8nsv" Jul 24 13:44:12.188112 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:12.187938 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9435272f-fb70-453f-b34f-3c5782f622db-node-exporter-accelerators-collector-config\") pod \"node-exporter-f8nsv\" (UID: \"9435272f-fb70-453f-b34f-3c5782f622db\") " pod="openshift-monitoring/node-exporter-f8nsv" Jul 24 13:44:12.188112 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:12.187966 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4b77t\" (UniqueName: \"kubernetes.io/projected/9435272f-fb70-453f-b34f-3c5782f622db-kube-api-access-4b77t\") pod \"node-exporter-f8nsv\" (UID: \"9435272f-fb70-453f-b34f-3c5782f622db\") " pod="openshift-monitoring/node-exporter-f8nsv" Jul 24 13:44:12.188112 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:12.187995 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9435272f-fb70-453f-b34f-3c5782f622db-node-exporter-textfile\") pod \"node-exporter-f8nsv\" (UID: \"9435272f-fb70-453f-b34f-3c5782f622db\") " pod="openshift-monitoring/node-exporter-f8nsv" Jul 24 13:44:12.188112 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:12.188058 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5c25c2f3-916a-404e-9e15-bff7a2511cf8-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-4hqf8\" (UID: \"5c25c2f3-916a-404e-9e15-bff7a2511cf8\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-4hqf8" Jul 24 13:44:12.188112 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:12.188095 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9435272f-fb70-453f-b34f-3c5782f622db-root\") pod \"node-exporter-f8nsv\" (UID: \"9435272f-fb70-453f-b34f-3c5782f622db\") " pod="openshift-monitoring/node-exporter-f8nsv" Jul 24 13:44:12.188333 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:12.188161 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/67f0a71c-4582-4205-8e6d-9f2624778cd6-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-fbs2h\" (UID: \"67f0a71c-4582-4205-8e6d-9f2624778cd6\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-fbs2h" Jul 24 13:44:12.188333 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:12.188202 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9435272f-fb70-453f-b34f-3c5782f622db-node-exporter-wtmp\") pod \"node-exporter-f8nsv\" (UID: \"9435272f-fb70-453f-b34f-3c5782f622db\") " pod="openshift-monitoring/node-exporter-f8nsv" Jul 24 13:44:12.188333 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:12.188265 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9435272f-fb70-453f-b34f-3c5782f622db-metrics-client-ca\") pod \"node-exporter-f8nsv\" (UID: \"9435272f-fb70-453f-b34f-3c5782f622db\") " pod="openshift-monitoring/node-exporter-f8nsv" Jul 24 13:44:12.188333 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:12.188300 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/67f0a71c-4582-4205-8e6d-9f2624778cd6-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-fbs2h\" (UID: \"67f0a71c-4582-4205-8e6d-9f2624778cd6\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-fbs2h" Jul 24 13:44:12.188333 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:12.188329 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/67f0a71c-4582-4205-8e6d-9f2624778cd6-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-fbs2h\" (UID: \"67f0a71c-4582-4205-8e6d-9f2624778cd6\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-fbs2h" Jul 24 13:44:12.188558 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:12.188354 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qc98s\" (UniqueName: \"kubernetes.io/projected/5c25c2f3-916a-404e-9e15-bff7a2511cf8-kube-api-access-qc98s\") pod \"openshift-state-metrics-b8f49f5c6-4hqf8\" (UID: \"5c25c2f3-916a-404e-9e15-bff7a2511cf8\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-4hqf8" Jul 24 13:44:12.188558 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:12.188428 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/67f0a71c-4582-4205-8e6d-9f2624778cd6-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-fbs2h\" (UID: \"67f0a71c-4582-4205-8e6d-9f2624778cd6\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-fbs2h" Jul 24 13:44:12.188558 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:12.188475 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5c25c2f3-916a-404e-9e15-bff7a2511cf8-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-4hqf8\" (UID: \"5c25c2f3-916a-404e-9e15-bff7a2511cf8\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-4hqf8" Jul 24 13:44:12.188558 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:12.188502 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9435272f-fb70-453f-b34f-3c5782f622db-node-exporter-tls\") pod \"node-exporter-f8nsv\" (UID: \"9435272f-fb70-453f-b34f-3c5782f622db\") " pod="openshift-monitoring/node-exporter-f8nsv" Jul 24 13:44:12.188558 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:12.188527 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9435272f-fb70-453f-b34f-3c5782f622db-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-f8nsv\" (UID: \"9435272f-fb70-453f-b34f-3c5782f622db\") " pod="openshift-monitoring/node-exporter-f8nsv" Jul 24 13:44:12.289886 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:12.289843 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9435272f-fb70-453f-b34f-3c5782f622db-node-exporter-accelerators-collector-config\") pod \"node-exporter-f8nsv\" (UID: \"9435272f-fb70-453f-b34f-3c5782f622db\") " pod="openshift-monitoring/node-exporter-f8nsv" Jul 24 13:44:12.289886 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:12.289893 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4b77t\" (UniqueName: \"kubernetes.io/projected/9435272f-fb70-453f-b34f-3c5782f622db-kube-api-access-4b77t\") pod \"node-exporter-f8nsv\" (UID: \"9435272f-fb70-453f-b34f-3c5782f622db\") " pod="openshift-monitoring/node-exporter-f8nsv" Jul 24 13:44:12.290129 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:12.290020 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9435272f-fb70-453f-b34f-3c5782f622db-node-exporter-textfile\") pod \"node-exporter-f8nsv\" (UID: \"9435272f-fb70-453f-b34f-3c5782f622db\") " pod="openshift-monitoring/node-exporter-f8nsv" Jul 24 13:44:12.290129 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:12.290072 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5c25c2f3-916a-404e-9e15-bff7a2511cf8-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-4hqf8\" (UID: \"5c25c2f3-916a-404e-9e15-bff7a2511cf8\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-4hqf8" Jul 24 13:44:12.290129 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:12.290099 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9435272f-fb70-453f-b34f-3c5782f622db-root\") pod \"node-exporter-f8nsv\" (UID: \"9435272f-fb70-453f-b34f-3c5782f622db\") " pod="openshift-monitoring/node-exporter-f8nsv" Jul 24 13:44:12.290291 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:12.290160 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/67f0a71c-4582-4205-8e6d-9f2624778cd6-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-fbs2h\" (UID: \"67f0a71c-4582-4205-8e6d-9f2624778cd6\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-fbs2h" Jul 24 13:44:12.290291 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:44:12.290187 2578 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jul 24 13:44:12.290291 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:12.290225 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9435272f-fb70-453f-b34f-3c5782f622db-root\") pod \"node-exporter-f8nsv\" (UID: \"9435272f-fb70-453f-b34f-3c5782f622db\") " pod="openshift-monitoring/node-exporter-f8nsv" Jul 24 13:44:12.290291 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:44:12.290250 2578 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jul 24 13:44:12.290291 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:44:12.290254 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c25c2f3-916a-404e-9e15-bff7a2511cf8-openshift-state-metrics-tls podName:5c25c2f3-916a-404e-9e15-bff7a2511cf8 nodeName:}" failed. No retries permitted until 2026-07-24 13:44:12.790233898 +0000 UTC m=+60.448211264 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/5c25c2f3-916a-404e-9e15-bff7a2511cf8-openshift-state-metrics-tls") pod "openshift-state-metrics-b8f49f5c6-4hqf8" (UID: "5c25c2f3-916a-404e-9e15-bff7a2511cf8") : secret "openshift-state-metrics-tls" not found Jul 24 13:44:12.290291 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:12.290281 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9435272f-fb70-453f-b34f-3c5782f622db-node-exporter-wtmp\") pod \"node-exporter-f8nsv\" (UID: \"9435272f-fb70-453f-b34f-3c5782f622db\") " pod="openshift-monitoring/node-exporter-f8nsv" Jul 24 13:44:12.290291 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:44:12.290297 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67f0a71c-4582-4205-8e6d-9f2624778cd6-kube-state-metrics-tls podName:67f0a71c-4582-4205-8e6d-9f2624778cd6 nodeName:}" failed. No retries permitted until 2026-07-24 13:44:12.790283047 +0000 UTC m=+60.448260423 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/67f0a71c-4582-4205-8e6d-9f2624778cd6-kube-state-metrics-tls") pod "kube-state-metrics-56d9f944b4-fbs2h" (UID: "67f0a71c-4582-4205-8e6d-9f2624778cd6") : secret "kube-state-metrics-tls" not found Jul 24 13:44:12.290682 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:12.290334 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9435272f-fb70-453f-b34f-3c5782f622db-metrics-client-ca\") pod \"node-exporter-f8nsv\" (UID: \"9435272f-fb70-453f-b34f-3c5782f622db\") " pod="openshift-monitoring/node-exporter-f8nsv" Jul 24 13:44:12.290682 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:12.290361 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/67f0a71c-4582-4205-8e6d-9f2624778cd6-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-fbs2h\" (UID: \"67f0a71c-4582-4205-8e6d-9f2624778cd6\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-fbs2h" Jul 24 13:44:12.290682 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:12.290378 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9435272f-fb70-453f-b34f-3c5782f622db-node-exporter-textfile\") pod \"node-exporter-f8nsv\" (UID: \"9435272f-fb70-453f-b34f-3c5782f622db\") " pod="openshift-monitoring/node-exporter-f8nsv" Jul 24 13:44:12.290682 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:12.290398 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9435272f-fb70-453f-b34f-3c5782f622db-node-exporter-wtmp\") pod \"node-exporter-f8nsv\" (UID: \"9435272f-fb70-453f-b34f-3c5782f622db\") " pod="openshift-monitoring/node-exporter-f8nsv" Jul 24 13:44:12.290682 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:12.290386 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/67f0a71c-4582-4205-8e6d-9f2624778cd6-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-fbs2h\" (UID: \"67f0a71c-4582-4205-8e6d-9f2624778cd6\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-fbs2h" Jul 24 13:44:12.290682 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:12.290471 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qc98s\" (UniqueName: \"kubernetes.io/projected/5c25c2f3-916a-404e-9e15-bff7a2511cf8-kube-api-access-qc98s\") pod \"openshift-state-metrics-b8f49f5c6-4hqf8\" (UID: \"5c25c2f3-916a-404e-9e15-bff7a2511cf8\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-4hqf8" Jul 24 13:44:12.290682 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:12.290473 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9435272f-fb70-453f-b34f-3c5782f622db-node-exporter-accelerators-collector-config\") pod \"node-exporter-f8nsv\" (UID: \"9435272f-fb70-453f-b34f-3c5782f622db\") " pod="openshift-monitoring/node-exporter-f8nsv" Jul 24 13:44:12.290682 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:12.290515 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/67f0a71c-4582-4205-8e6d-9f2624778cd6-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-fbs2h\" (UID: \"67f0a71c-4582-4205-8e6d-9f2624778cd6\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-fbs2h" Jul 24 13:44:12.290682 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:12.290549 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5c25c2f3-916a-404e-9e15-bff7a2511cf8-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-4hqf8\" (UID: \"5c25c2f3-916a-404e-9e15-bff7a2511cf8\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-4hqf8" Jul 24 13:44:12.290682 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:12.290575 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9435272f-fb70-453f-b34f-3c5782f622db-node-exporter-tls\") pod \"node-exporter-f8nsv\" (UID: \"9435272f-fb70-453f-b34f-3c5782f622db\") " pod="openshift-monitoring/node-exporter-f8nsv" Jul 24 13:44:12.291121 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:12.290727 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9435272f-fb70-453f-b34f-3c5782f622db-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-f8nsv\" (UID: \"9435272f-fb70-453f-b34f-3c5782f622db\") " pod="openshift-monitoring/node-exporter-f8nsv" Jul 24 13:44:12.291121 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:12.290782 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5c25c2f3-916a-404e-9e15-bff7a2511cf8-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-4hqf8\" (UID: \"5c25c2f3-916a-404e-9e15-bff7a2511cf8\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-4hqf8" Jul 24 13:44:12.291121 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:12.290815 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6v4xw\" (UniqueName: \"kubernetes.io/projected/67f0a71c-4582-4205-8e6d-9f2624778cd6-kube-api-access-6v4xw\") pod \"kube-state-metrics-56d9f944b4-fbs2h\" (UID: \"67f0a71c-4582-4205-8e6d-9f2624778cd6\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-fbs2h" Jul 24 13:44:12.291121 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:12.290845 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/67f0a71c-4582-4205-8e6d-9f2624778cd6-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-fbs2h\" (UID: \"67f0a71c-4582-4205-8e6d-9f2624778cd6\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-fbs2h" Jul 24 13:44:12.291121 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:12.290877 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9435272f-fb70-453f-b34f-3c5782f622db-sys\") pod \"node-exporter-f8nsv\" (UID: \"9435272f-fb70-453f-b34f-3c5782f622db\") " pod="openshift-monitoring/node-exporter-f8nsv" Jul 24 13:44:12.291121 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:12.290958 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9435272f-fb70-453f-b34f-3c5782f622db-sys\") pod \"node-exporter-f8nsv\" (UID: \"9435272f-fb70-453f-b34f-3c5782f622db\") " pod="openshift-monitoring/node-exporter-f8nsv" Jul 24 13:44:12.291121 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:12.290985 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9435272f-fb70-453f-b34f-3c5782f622db-metrics-client-ca\") pod \"node-exporter-f8nsv\" (UID: \"9435272f-fb70-453f-b34f-3c5782f622db\") " pod="openshift-monitoring/node-exporter-f8nsv" Jul 24 13:44:12.291121 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:12.291063 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/67f0a71c-4582-4205-8e6d-9f2624778cd6-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-fbs2h\" (UID: \"67f0a71c-4582-4205-8e6d-9f2624778cd6\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-fbs2h" Jul 24 13:44:12.291500 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:12.290845 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/67f0a71c-4582-4205-8e6d-9f2624778cd6-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-fbs2h\" (UID: \"67f0a71c-4582-4205-8e6d-9f2624778cd6\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-fbs2h" Jul 24 13:44:12.291500 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:12.291363 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/67f0a71c-4582-4205-8e6d-9f2624778cd6-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-fbs2h\" (UID: \"67f0a71c-4582-4205-8e6d-9f2624778cd6\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-fbs2h" Jul 24 13:44:12.291500 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:12.291475 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5c25c2f3-916a-404e-9e15-bff7a2511cf8-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-4hqf8\" (UID: \"5c25c2f3-916a-404e-9e15-bff7a2511cf8\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-4hqf8" Jul 24 13:44:12.294468 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:12.294440 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9435272f-fb70-453f-b34f-3c5782f622db-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-f8nsv\" (UID: \"9435272f-fb70-453f-b34f-3c5782f622db\") " pod="openshift-monitoring/node-exporter-f8nsv" Jul 24 13:44:12.294775 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:12.294750 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5c25c2f3-916a-404e-9e15-bff7a2511cf8-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-4hqf8\" (UID: \"5c25c2f3-916a-404e-9e15-bff7a2511cf8\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-4hqf8" Jul 24 13:44:12.295055 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:12.295010 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/67f0a71c-4582-4205-8e6d-9f2624778cd6-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-fbs2h\" (UID: \"67f0a71c-4582-4205-8e6d-9f2624778cd6\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-fbs2h" Jul 24 13:44:12.295393 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:12.295369 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9435272f-fb70-453f-b34f-3c5782f622db-node-exporter-tls\") pod \"node-exporter-f8nsv\" (UID: \"9435272f-fb70-453f-b34f-3c5782f622db\") " pod="openshift-monitoring/node-exporter-f8nsv" Jul 24 13:44:12.298125 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:12.298081 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4b77t\" (UniqueName: \"kubernetes.io/projected/9435272f-fb70-453f-b34f-3c5782f622db-kube-api-access-4b77t\") pod \"node-exporter-f8nsv\" (UID: \"9435272f-fb70-453f-b34f-3c5782f622db\") " pod="openshift-monitoring/node-exporter-f8nsv" Jul 24 13:44:12.298641 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:12.298618 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qc98s\" (UniqueName: \"kubernetes.io/projected/5c25c2f3-916a-404e-9e15-bff7a2511cf8-kube-api-access-qc98s\") pod \"openshift-state-metrics-b8f49f5c6-4hqf8\" (UID: \"5c25c2f3-916a-404e-9e15-bff7a2511cf8\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-4hqf8" Jul 24 13:44:12.298851 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:12.298830 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6v4xw\" (UniqueName: \"kubernetes.io/projected/67f0a71c-4582-4205-8e6d-9f2624778cd6-kube-api-access-6v4xw\") pod \"kube-state-metrics-56d9f944b4-fbs2h\" (UID: \"67f0a71c-4582-4205-8e6d-9f2624778cd6\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-fbs2h" Jul 24 13:44:12.409754 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:12.409717 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-f8nsv" Jul 24 13:44:12.796758 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:12.796673 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5c25c2f3-916a-404e-9e15-bff7a2511cf8-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-4hqf8\" (UID: \"5c25c2f3-916a-404e-9e15-bff7a2511cf8\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-4hqf8" Jul 24 13:44:12.796758 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:12.796735 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/67f0a71c-4582-4205-8e6d-9f2624778cd6-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-fbs2h\" (UID: \"67f0a71c-4582-4205-8e6d-9f2624778cd6\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-fbs2h" Jul 24 13:44:12.799784 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:12.799755 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5c25c2f3-916a-404e-9e15-bff7a2511cf8-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-4hqf8\" (UID: \"5c25c2f3-916a-404e-9e15-bff7a2511cf8\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-4hqf8" Jul 24 13:44:12.799913 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:12.799834 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/67f0a71c-4582-4205-8e6d-9f2624778cd6-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-fbs2h\" (UID: \"67f0a71c-4582-4205-8e6d-9f2624778cd6\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-fbs2h" Jul 24 13:44:13.021186 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:13.021158 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-6mjj2\"" Jul 24 13:44:13.027378 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:13.027347 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-89kw6\"" Jul 24 13:44:13.030016 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:13.029994 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-fbs2h" Jul 24 13:44:13.037653 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:13.037596 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-4hqf8" Jul 24 13:44:13.161028 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:13.160995 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 24 13:44:13.193763 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:13.193732 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 24 13:44:13.193939 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:13.193857 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 24 13:44:13.196201 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:13.196178 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vfwll" Jul 24 13:44:13.197717 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:13.197450 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 24 13:44:13.197717 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:13.197521 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 24 13:44:13.197717 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:13.197523 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 24 13:44:13.197984 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:13.197736 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 24 13:44:13.197984 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:13.197797 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 24 13:44:13.197984 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:13.197822 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 24 13:44:13.198116 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:13.198054 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 24 13:44:13.198116 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:13.198086 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 24 13:44:13.198219 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:13.198160 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-4gnj8\"" Jul 24 13:44:13.198323 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:13.198299 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 24 13:44:13.244970 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:44:13.244935 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9435272f_fb70_453f_b34f_3c5782f622db.slice/crio-af56095c5da0cc9bad9f27b9d48623791bf62373b39e26763d0e5c264c8eb12d WatchSource:0}: Error finding container af56095c5da0cc9bad9f27b9d48623791bf62373b39e26763d0e5c264c8eb12d: Status 404 returned error can't find the container with id af56095c5da0cc9bad9f27b9d48623791bf62373b39e26763d0e5c264c8eb12d Jul 24 13:44:13.302102 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:13.300550 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/64f1b2c7-305c-44bc-b2c6-6080196f5269-tls-assets\") pod \"alertmanager-main-0\" (UID: \"64f1b2c7-305c-44bc-b2c6-6080196f5269\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 13:44:13.302102 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:13.300696 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/64f1b2c7-305c-44bc-b2c6-6080196f5269-config-out\") pod \"alertmanager-main-0\" (UID: \"64f1b2c7-305c-44bc-b2c6-6080196f5269\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 13:44:13.302102 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:13.300726 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/64f1b2c7-305c-44bc-b2c6-6080196f5269-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"64f1b2c7-305c-44bc-b2c6-6080196f5269\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 13:44:13.302102 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:13.300754 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/64f1b2c7-305c-44bc-b2c6-6080196f5269-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"64f1b2c7-305c-44bc-b2c6-6080196f5269\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 13:44:13.302102 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:13.300793 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/64f1b2c7-305c-44bc-b2c6-6080196f5269-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"64f1b2c7-305c-44bc-b2c6-6080196f5269\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 13:44:13.302102 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:13.300836 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/64f1b2c7-305c-44bc-b2c6-6080196f5269-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"64f1b2c7-305c-44bc-b2c6-6080196f5269\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 13:44:13.302102 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:13.300874 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/64f1b2c7-305c-44bc-b2c6-6080196f5269-config-volume\") pod \"alertmanager-main-0\" (UID: \"64f1b2c7-305c-44bc-b2c6-6080196f5269\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 13:44:13.302102 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:13.300908 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2jjh7\" (UniqueName: \"kubernetes.io/projected/64f1b2c7-305c-44bc-b2c6-6080196f5269-kube-api-access-2jjh7\") pod \"alertmanager-main-0\" (UID: \"64f1b2c7-305c-44bc-b2c6-6080196f5269\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 13:44:13.302102 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:13.300940 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/64f1b2c7-305c-44bc-b2c6-6080196f5269-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"64f1b2c7-305c-44bc-b2c6-6080196f5269\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 13:44:13.302102 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:13.300979 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/64f1b2c7-305c-44bc-b2c6-6080196f5269-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"64f1b2c7-305c-44bc-b2c6-6080196f5269\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 13:44:13.302102 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:13.301004 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/64f1b2c7-305c-44bc-b2c6-6080196f5269-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"64f1b2c7-305c-44bc-b2c6-6080196f5269\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 13:44:13.302102 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:13.301033 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/64f1b2c7-305c-44bc-b2c6-6080196f5269-web-config\") pod \"alertmanager-main-0\" (UID: \"64f1b2c7-305c-44bc-b2c6-6080196f5269\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 13:44:13.302102 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:13.301090 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/64f1b2c7-305c-44bc-b2c6-6080196f5269-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"64f1b2c7-305c-44bc-b2c6-6080196f5269\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 13:44:13.312090 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:13.310915 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-f8nsv" event={"ID":"9435272f-fb70-453f-b34f-3c5782f622db","Type":"ContainerStarted","Data":"af56095c5da0cc9bad9f27b9d48623791bf62373b39e26763d0e5c264c8eb12d"} Jul 24 13:44:13.386126 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:13.386095 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-4hqf8"] Jul 24 13:44:13.393177 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:13.393136 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-fbs2h"] Jul 24 13:44:13.402228 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:13.402200 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/64f1b2c7-305c-44bc-b2c6-6080196f5269-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"64f1b2c7-305c-44bc-b2c6-6080196f5269\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 13:44:13.402323 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:13.402231 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/64f1b2c7-305c-44bc-b2c6-6080196f5269-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"64f1b2c7-305c-44bc-b2c6-6080196f5269\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 13:44:13.402323 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:13.402251 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/64f1b2c7-305c-44bc-b2c6-6080196f5269-web-config\") pod \"alertmanager-main-0\" (UID: \"64f1b2c7-305c-44bc-b2c6-6080196f5269\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 13:44:13.402323 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:13.402291 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/64f1b2c7-305c-44bc-b2c6-6080196f5269-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"64f1b2c7-305c-44bc-b2c6-6080196f5269\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 13:44:13.402478 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:13.402325 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/64f1b2c7-305c-44bc-b2c6-6080196f5269-tls-assets\") pod \"alertmanager-main-0\" (UID: \"64f1b2c7-305c-44bc-b2c6-6080196f5269\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 13:44:13.402546 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:13.402522 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/64f1b2c7-305c-44bc-b2c6-6080196f5269-config-out\") pod \"alertmanager-main-0\" (UID: \"64f1b2c7-305c-44bc-b2c6-6080196f5269\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 13:44:13.402599 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:13.402570 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/64f1b2c7-305c-44bc-b2c6-6080196f5269-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"64f1b2c7-305c-44bc-b2c6-6080196f5269\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 13:44:13.402651 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:13.402613 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/64f1b2c7-305c-44bc-b2c6-6080196f5269-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"64f1b2c7-305c-44bc-b2c6-6080196f5269\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 13:44:13.402702 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:13.402656 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/64f1b2c7-305c-44bc-b2c6-6080196f5269-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"64f1b2c7-305c-44bc-b2c6-6080196f5269\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 13:44:13.402702 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:13.402672 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/64f1b2c7-305c-44bc-b2c6-6080196f5269-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"64f1b2c7-305c-44bc-b2c6-6080196f5269\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 13:44:13.402702 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:13.402695 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/64f1b2c7-305c-44bc-b2c6-6080196f5269-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"64f1b2c7-305c-44bc-b2c6-6080196f5269\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 13:44:13.402843 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:13.402740 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/64f1b2c7-305c-44bc-b2c6-6080196f5269-config-volume\") pod \"alertmanager-main-0\" (UID: \"64f1b2c7-305c-44bc-b2c6-6080196f5269\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 13:44:13.402843 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:13.402772 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2jjh7\" (UniqueName: \"kubernetes.io/projected/64f1b2c7-305c-44bc-b2c6-6080196f5269-kube-api-access-2jjh7\") pod \"alertmanager-main-0\" (UID: \"64f1b2c7-305c-44bc-b2c6-6080196f5269\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 13:44:13.402843 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:13.402802 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/64f1b2c7-305c-44bc-b2c6-6080196f5269-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"64f1b2c7-305c-44bc-b2c6-6080196f5269\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 13:44:13.403897 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:13.403680 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/64f1b2c7-305c-44bc-b2c6-6080196f5269-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"64f1b2c7-305c-44bc-b2c6-6080196f5269\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 13:44:13.404201 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:44:13.404178 2578 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jul 24 13:44:13.404282 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:44:13.404265 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64f1b2c7-305c-44bc-b2c6-6080196f5269-secret-alertmanager-main-tls podName:64f1b2c7-305c-44bc-b2c6-6080196f5269 nodeName:}" failed. No retries permitted until 2026-07-24 13:44:13.904236012 +0000 UTC m=+61.562213386 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/64f1b2c7-305c-44bc-b2c6-6080196f5269-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "64f1b2c7-305c-44bc-b2c6-6080196f5269") : secret "alertmanager-main-tls" not found Jul 24 13:44:13.406470 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:13.405775 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/64f1b2c7-305c-44bc-b2c6-6080196f5269-tls-assets\") pod \"alertmanager-main-0\" (UID: \"64f1b2c7-305c-44bc-b2c6-6080196f5269\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 13:44:13.406470 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:13.406160 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/64f1b2c7-305c-44bc-b2c6-6080196f5269-web-config\") pod \"alertmanager-main-0\" (UID: \"64f1b2c7-305c-44bc-b2c6-6080196f5269\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 13:44:13.406621 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:13.406521 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/64f1b2c7-305c-44bc-b2c6-6080196f5269-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"64f1b2c7-305c-44bc-b2c6-6080196f5269\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 13:44:13.406862 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:13.406843 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/64f1b2c7-305c-44bc-b2c6-6080196f5269-config-out\") pod \"alertmanager-main-0\" (UID: \"64f1b2c7-305c-44bc-b2c6-6080196f5269\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 13:44:13.407265 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:13.407241 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/64f1b2c7-305c-44bc-b2c6-6080196f5269-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"64f1b2c7-305c-44bc-b2c6-6080196f5269\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 13:44:13.409196 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:13.409168 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/64f1b2c7-305c-44bc-b2c6-6080196f5269-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"64f1b2c7-305c-44bc-b2c6-6080196f5269\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 13:44:13.411177 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:13.411116 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/64f1b2c7-305c-44bc-b2c6-6080196f5269-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"64f1b2c7-305c-44bc-b2c6-6080196f5269\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 13:44:13.411177 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:13.411131 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/64f1b2c7-305c-44bc-b2c6-6080196f5269-config-volume\") pod \"alertmanager-main-0\" (UID: \"64f1b2c7-305c-44bc-b2c6-6080196f5269\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 13:44:13.411516 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:13.411494 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/64f1b2c7-305c-44bc-b2c6-6080196f5269-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"64f1b2c7-305c-44bc-b2c6-6080196f5269\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 13:44:13.412072 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:13.412052 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2jjh7\" (UniqueName: \"kubernetes.io/projected/64f1b2c7-305c-44bc-b2c6-6080196f5269-kube-api-access-2jjh7\") pod \"alertmanager-main-0\" (UID: \"64f1b2c7-305c-44bc-b2c6-6080196f5269\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 13:44:13.554596 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:44:13.554552 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c25c2f3_916a_404e_9e15_bff7a2511cf8.slice/crio-37207679ec364824b569807a25a862799223536b423a1a7dd96e1326e18390d2 WatchSource:0}: Error finding container 37207679ec364824b569807a25a862799223536b423a1a7dd96e1326e18390d2: Status 404 returned error can't find the container with id 37207679ec364824b569807a25a862799223536b423a1a7dd96e1326e18390d2 Jul 24 13:44:13.557703 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:44:13.557393 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67f0a71c_4582_4205_8e6d_9f2624778cd6.slice/crio-b282af3fcf841d067fe4d5327abd5dc2f45f91f156a702551b2caf9114940831 WatchSource:0}: Error finding container b282af3fcf841d067fe4d5327abd5dc2f45f91f156a702551b2caf9114940831: Status 404 returned error can't find the container with id b282af3fcf841d067fe4d5327abd5dc2f45f91f156a702551b2caf9114940831 Jul 24 13:44:13.907291 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:13.907252 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/64f1b2c7-305c-44bc-b2c6-6080196f5269-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"64f1b2c7-305c-44bc-b2c6-6080196f5269\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 13:44:13.909800 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:13.909775 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/64f1b2c7-305c-44bc-b2c6-6080196f5269-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"64f1b2c7-305c-44bc-b2c6-6080196f5269\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 13:44:14.066599 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:14.066513 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-5c889495d8-xh2tt"] Jul 24 13:44:14.087335 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:14.087242 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5c889495d8-xh2tt"] Jul 24 13:44:14.087517 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:14.087390 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5c889495d8-xh2tt" Jul 24 13:44:14.090194 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:14.089671 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 24 13:44:14.090194 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:14.089722 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 24 13:44:14.090194 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:14.089767 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 24 13:44:14.090194 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:14.089900 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 24 13:44:14.090194 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:14.089991 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-6ftdf41qm5h0s\"" Jul 24 13:44:14.090194 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:14.090035 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 24 13:44:14.090194 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:14.090123 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-m8pt6\"" Jul 24 13:44:14.104735 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:14.104712 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 24 13:44:14.210253 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:14.210098 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/01b4f880-e852-4297-98e9-077c6de3cb93-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5c889495d8-xh2tt\" (UID: \"01b4f880-e852-4297-98e9-077c6de3cb93\") " pod="openshift-monitoring/thanos-querier-5c889495d8-xh2tt" Jul 24 13:44:14.210253 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:14.210153 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/01b4f880-e852-4297-98e9-077c6de3cb93-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5c889495d8-xh2tt\" (UID: \"01b4f880-e852-4297-98e9-077c6de3cb93\") " pod="openshift-monitoring/thanos-querier-5c889495d8-xh2tt" Jul 24 13:44:14.210253 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:14.210199 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/01b4f880-e852-4297-98e9-077c6de3cb93-secret-grpc-tls\") pod \"thanos-querier-5c889495d8-xh2tt\" (UID: \"01b4f880-e852-4297-98e9-077c6de3cb93\") " pod="openshift-monitoring/thanos-querier-5c889495d8-xh2tt" Jul 24 13:44:14.210253 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:14.210228 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r8frh\" (UniqueName: \"kubernetes.io/projected/01b4f880-e852-4297-98e9-077c6de3cb93-kube-api-access-r8frh\") pod \"thanos-querier-5c889495d8-xh2tt\" (UID: \"01b4f880-e852-4297-98e9-077c6de3cb93\") " pod="openshift-monitoring/thanos-querier-5c889495d8-xh2tt" Jul 24 13:44:14.210776 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:14.210327 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/01b4f880-e852-4297-98e9-077c6de3cb93-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5c889495d8-xh2tt\" (UID: \"01b4f880-e852-4297-98e9-077c6de3cb93\") " pod="openshift-monitoring/thanos-querier-5c889495d8-xh2tt" Jul 24 13:44:14.210776 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:14.210428 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/01b4f880-e852-4297-98e9-077c6de3cb93-metrics-client-ca\") pod \"thanos-querier-5c889495d8-xh2tt\" (UID: \"01b4f880-e852-4297-98e9-077c6de3cb93\") " pod="openshift-monitoring/thanos-querier-5c889495d8-xh2tt" Jul 24 13:44:14.210776 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:14.210480 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/01b4f880-e852-4297-98e9-077c6de3cb93-secret-thanos-querier-tls\") pod \"thanos-querier-5c889495d8-xh2tt\" (UID: \"01b4f880-e852-4297-98e9-077c6de3cb93\") " pod="openshift-monitoring/thanos-querier-5c889495d8-xh2tt" Jul 24 13:44:14.210776 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:14.210512 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/01b4f880-e852-4297-98e9-077c6de3cb93-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5c889495d8-xh2tt\" (UID: \"01b4f880-e852-4297-98e9-077c6de3cb93\") " pod="openshift-monitoring/thanos-querier-5c889495d8-xh2tt" Jul 24 13:44:14.269807 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:14.269773 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 24 13:44:14.311365 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:14.311329 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/01b4f880-e852-4297-98e9-077c6de3cb93-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5c889495d8-xh2tt\" (UID: \"01b4f880-e852-4297-98e9-077c6de3cb93\") " pod="openshift-monitoring/thanos-querier-5c889495d8-xh2tt" Jul 24 13:44:14.311544 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:14.311378 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/01b4f880-e852-4297-98e9-077c6de3cb93-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5c889495d8-xh2tt\" (UID: \"01b4f880-e852-4297-98e9-077c6de3cb93\") " pod="openshift-monitoring/thanos-querier-5c889495d8-xh2tt" Jul 24 13:44:14.311544 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:14.311439 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/01b4f880-e852-4297-98e9-077c6de3cb93-secret-grpc-tls\") pod \"thanos-querier-5c889495d8-xh2tt\" (UID: \"01b4f880-e852-4297-98e9-077c6de3cb93\") " pod="openshift-monitoring/thanos-querier-5c889495d8-xh2tt" Jul 24 13:44:14.311544 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:14.311467 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r8frh\" (UniqueName: \"kubernetes.io/projected/01b4f880-e852-4297-98e9-077c6de3cb93-kube-api-access-r8frh\") pod \"thanos-querier-5c889495d8-xh2tt\" (UID: \"01b4f880-e852-4297-98e9-077c6de3cb93\") " pod="openshift-monitoring/thanos-querier-5c889495d8-xh2tt" Jul 24 13:44:14.311544 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:14.311526 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/01b4f880-e852-4297-98e9-077c6de3cb93-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5c889495d8-xh2tt\" (UID: \"01b4f880-e852-4297-98e9-077c6de3cb93\") " pod="openshift-monitoring/thanos-querier-5c889495d8-xh2tt" Jul 24 13:44:14.311816 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:14.311577 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/01b4f880-e852-4297-98e9-077c6de3cb93-metrics-client-ca\") pod \"thanos-querier-5c889495d8-xh2tt\" (UID: \"01b4f880-e852-4297-98e9-077c6de3cb93\") " pod="openshift-monitoring/thanos-querier-5c889495d8-xh2tt" Jul 24 13:44:14.311816 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:14.311620 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/01b4f880-e852-4297-98e9-077c6de3cb93-secret-thanos-querier-tls\") pod \"thanos-querier-5c889495d8-xh2tt\" (UID: \"01b4f880-e852-4297-98e9-077c6de3cb93\") " pod="openshift-monitoring/thanos-querier-5c889495d8-xh2tt" Jul 24 13:44:14.311816 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:14.311651 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/01b4f880-e852-4297-98e9-077c6de3cb93-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5c889495d8-xh2tt\" (UID: \"01b4f880-e852-4297-98e9-077c6de3cb93\") " pod="openshift-monitoring/thanos-querier-5c889495d8-xh2tt" Jul 24 13:44:14.312922 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:14.312889 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/01b4f880-e852-4297-98e9-077c6de3cb93-metrics-client-ca\") pod \"thanos-querier-5c889495d8-xh2tt\" (UID: \"01b4f880-e852-4297-98e9-077c6de3cb93\") " pod="openshift-monitoring/thanos-querier-5c889495d8-xh2tt" Jul 24 13:44:14.315138 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:14.315109 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/01b4f880-e852-4297-98e9-077c6de3cb93-secret-thanos-querier-tls\") pod \"thanos-querier-5c889495d8-xh2tt\" (UID: \"01b4f880-e852-4297-98e9-077c6de3cb93\") " pod="openshift-monitoring/thanos-querier-5c889495d8-xh2tt" Jul 24 13:44:14.315567 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:14.315514 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/01b4f880-e852-4297-98e9-077c6de3cb93-secret-grpc-tls\") pod \"thanos-querier-5c889495d8-xh2tt\" (UID: \"01b4f880-e852-4297-98e9-077c6de3cb93\") " pod="openshift-monitoring/thanos-querier-5c889495d8-xh2tt" Jul 24 13:44:14.316381 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:14.316204 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/01b4f880-e852-4297-98e9-077c6de3cb93-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5c889495d8-xh2tt\" (UID: \"01b4f880-e852-4297-98e9-077c6de3cb93\") " pod="openshift-monitoring/thanos-querier-5c889495d8-xh2tt" Jul 24 13:44:14.316381 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:14.316336 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/01b4f880-e852-4297-98e9-077c6de3cb93-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5c889495d8-xh2tt\" (UID: \"01b4f880-e852-4297-98e9-077c6de3cb93\") " pod="openshift-monitoring/thanos-querier-5c889495d8-xh2tt" Jul 24 13:44:14.317459 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:14.317386 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/01b4f880-e852-4297-98e9-077c6de3cb93-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5c889495d8-xh2tt\" (UID: \"01b4f880-e852-4297-98e9-077c6de3cb93\") " pod="openshift-monitoring/thanos-querier-5c889495d8-xh2tt" Jul 24 13:44:14.318627 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:14.318584 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/01b4f880-e852-4297-98e9-077c6de3cb93-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5c889495d8-xh2tt\" (UID: \"01b4f880-e852-4297-98e9-077c6de3cb93\") " pod="openshift-monitoring/thanos-querier-5c889495d8-xh2tt" Jul 24 13:44:14.319611 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:14.319100 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-fbs2h" event={"ID":"67f0a71c-4582-4205-8e6d-9f2624778cd6","Type":"ContainerStarted","Data":"b282af3fcf841d067fe4d5327abd5dc2f45f91f156a702551b2caf9114940831"} Jul 24 13:44:14.319717 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:14.319624 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r8frh\" (UniqueName: \"kubernetes.io/projected/01b4f880-e852-4297-98e9-077c6de3cb93-kube-api-access-r8frh\") pod \"thanos-querier-5c889495d8-xh2tt\" (UID: \"01b4f880-e852-4297-98e9-077c6de3cb93\") " pod="openshift-monitoring/thanos-querier-5c889495d8-xh2tt" Jul 24 13:44:14.322556 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:14.322269 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-brx7p" event={"ID":"40a228a1-d1c2-44eb-b851-f3f49460a3aa","Type":"ContainerStarted","Data":"2c7db00a7380dc75065869d02588e2c6b156e67bec5160e90fc2461b3a053b31"} Jul 24 13:44:14.325831 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:14.325804 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-4hqf8" event={"ID":"5c25c2f3-916a-404e-9e15-bff7a2511cf8","Type":"ContainerStarted","Data":"5708e1ba84be2d0f75fbb0ac2272b59902c284d4daa0e49f88084d30fdca98b0"} Jul 24 13:44:14.325927 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:14.325867 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-4hqf8" event={"ID":"5c25c2f3-916a-404e-9e15-bff7a2511cf8","Type":"ContainerStarted","Data":"af800f1b852f3d7126537b129ee068116bdf8660323a35e37d91a093638a0185"} Jul 24 13:44:14.325927 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:14.325901 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-4hqf8" event={"ID":"5c25c2f3-916a-404e-9e15-bff7a2511cf8","Type":"ContainerStarted","Data":"37207679ec364824b569807a25a862799223536b423a1a7dd96e1326e18390d2"} Jul 24 13:44:14.339230 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:14.339191 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-brx7p" podStartSLOduration=1.743741142 podStartE2EDuration="18.339174649s" totalImagesPullingTime="16.595433507s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 13:43:56 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:44:14.337628209 +0000 UTC m=+61.995605595" watchObservedRunningTime="2026-07-24 13:44:14.339174649 +0000 UTC m=+61.997152037" Jul 24 13:44:14.399687 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:14.399646 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5c889495d8-xh2tt" Jul 24 13:44:14.539605 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:44:14.539514 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64f1b2c7_305c_44bc_b2c6_6080196f5269.slice/crio-a1808673252eff176f7b1f051c2bc7e40201cf651c9c7c9e382decfc35c5be10 WatchSource:0}: Error finding container a1808673252eff176f7b1f051c2bc7e40201cf651c9c7c9e382decfc35c5be10: Status 404 returned error can't find the container with id a1808673252eff176f7b1f051c2bc7e40201cf651c9c7c9e382decfc35c5be10 Jul 24 13:44:14.695823 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:14.695790 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5c889495d8-xh2tt"] Jul 24 13:44:14.892423 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:44:14.892374 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01b4f880_e852_4297_98e9_077c6de3cb93.slice/crio-94adc5ff01af0e6b86b1ea66c3d9f86fc4c0f3da7b0c630a1c19a9c5885080bb WatchSource:0}: Error finding container 94adc5ff01af0e6b86b1ea66c3d9f86fc4c0f3da7b0c630a1c19a9c5885080bb: Status 404 returned error can't find the container with id 94adc5ff01af0e6b86b1ea66c3d9f86fc4c0f3da7b0c630a1c19a9c5885080bb Jul 24 13:44:15.343002 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:15.342957 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-fbs2h" event={"ID":"67f0a71c-4582-4205-8e6d-9f2624778cd6","Type":"ContainerStarted","Data":"db3cc603b9926889a3c1f6ee30652eed19fc697a877ab28389a9b907efb2dba5"} Jul 24 13:44:15.343661 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:15.343635 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-fbs2h" event={"ID":"67f0a71c-4582-4205-8e6d-9f2624778cd6","Type":"ContainerStarted","Data":"dd2c85cec4812059e614d4c108698a019c601da183aa21dc7ecfda3fb59141ab"} Jul 24 13:44:15.348211 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:15.348182 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-4hqf8" event={"ID":"5c25c2f3-916a-404e-9e15-bff7a2511cf8","Type":"ContainerStarted","Data":"126786758abfa4df03a46088654e0be33b8d433bd05e66dde54a9a04c72978ee"} Jul 24 13:44:15.351251 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:15.351227 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5c889495d8-xh2tt" event={"ID":"01b4f880-e852-4297-98e9-077c6de3cb93","Type":"ContainerStarted","Data":"94adc5ff01af0e6b86b1ea66c3d9f86fc4c0f3da7b0c630a1c19a9c5885080bb"} Jul 24 13:44:15.354128 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:15.354048 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"64f1b2c7-305c-44bc-b2c6-6080196f5269","Type":"ContainerStarted","Data":"a1808673252eff176f7b1f051c2bc7e40201cf651c9c7c9e382decfc35c5be10"} Jul 24 13:44:15.356538 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:15.356509 2578 generic.go:356] "Generic (PLEG): container finished" podID="9435272f-fb70-453f-b34f-3c5782f622db" containerID="c3d97a03c830064bb3300f06ffc320926a7d6155a4d7f9f8b4b8bb4d123b08c2" exitCode=0 Jul 24 13:44:15.359396 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:15.357787 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-f8nsv" event={"ID":"9435272f-fb70-453f-b34f-3c5782f622db","Type":"ContainerDied","Data":"c3d97a03c830064bb3300f06ffc320926a7d6155a4d7f9f8b4b8bb4d123b08c2"} Jul 24 13:44:15.366737 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:15.366682 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-4hqf8" podStartSLOduration=2.038863502 podStartE2EDuration="3.366662646s" totalImagesPullingTime="1.327799144s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 13:44:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:44:15.364773012 +0000 UTC m=+63.022750399" watchObservedRunningTime="2026-07-24 13:44:15.366662646 +0000 UTC m=+63.024640036" Jul 24 13:44:16.021028 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:16.021000 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-698c986d56-5hd2x" Jul 24 13:44:16.021138 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:16.021086 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-698c986d56-5hd2x" Jul 24 13:44:16.027002 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:16.026979 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-698c986d56-5hd2x" Jul 24 13:44:16.279614 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:16.279534 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-t8cnk" Jul 24 13:44:16.363583 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:16.363548 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-f8nsv" event={"ID":"9435272f-fb70-453f-b34f-3c5782f622db","Type":"ContainerStarted","Data":"3b38f9ef273aea9ff25d4c7f2d11d38ea3c441ce20b14e5d25879e6d3a3c25d5"} Jul 24 13:44:16.364031 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:16.363614 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-f8nsv" event={"ID":"9435272f-fb70-453f-b34f-3c5782f622db","Type":"ContainerStarted","Data":"51e23d549c1eb22dd66a3aafb010d77d9fcbcb3dddb53e25ba485a19d2cdf187"} Jul 24 13:44:16.366477 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:16.366437 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-fbs2h" event={"ID":"67f0a71c-4582-4205-8e6d-9f2624778cd6","Type":"ContainerStarted","Data":"14f9e3a42148243a74644d5a4cffc847cf12e9919c54204ce011d25225f76c2d"} Jul 24 13:44:16.368131 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:16.368102 2578 generic.go:356] "Generic (PLEG): container finished" podID="64f1b2c7-305c-44bc-b2c6-6080196f5269" containerID="8dcaca6c38b49ab59a6226261cebd888dface0ffa0ce58d108b72a70e90ffef0" exitCode=0 Jul 24 13:44:16.368255 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:16.368182 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"64f1b2c7-305c-44bc-b2c6-6080196f5269","Type":"ContainerDied","Data":"8dcaca6c38b49ab59a6226261cebd888dface0ffa0ce58d108b72a70e90ffef0"} Jul 24 13:44:16.372954 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:16.372933 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-698c986d56-5hd2x" Jul 24 13:44:16.385191 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:16.385150 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-f8nsv" podStartSLOduration=2.969703198 podStartE2EDuration="4.385134672s" totalImagesPullingTime="1.31954673s" totalInitContainerRuntime="95.884744ms" isStatefulPod=true podCreationTimestamp="2026-07-24 13:44:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:44:16.383344099 +0000 UTC m=+64.041321483" watchObservedRunningTime="2026-07-24 13:44:16.385134672 +0000 UTC m=+64.043112057" Jul 24 13:44:16.399932 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:16.399884 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-fbs2h" podStartSLOduration=2.847496761 podStartE2EDuration="4.399864291s" totalImagesPullingTime="1.55236753s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 13:44:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:44:16.399380187 +0000 UTC m=+64.057357598" watchObservedRunningTime="2026-07-24 13:44:16.399864291 +0000 UTC m=+64.057841677" Jul 24 13:44:16.465200 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:16.465148 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-67b4749744-k56g2"] Jul 24 13:44:16.524026 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:16.523994 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-65b9c965dd-j9lg5"] Jul 24 13:44:16.528312 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:16.528282 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-65b9c965dd-j9lg5" Jul 24 13:44:16.530930 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:16.530730 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-e3d7on0r9urbd\"" Jul 24 13:44:16.530930 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:16.530816 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 24 13:44:16.530930 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:16.530819 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-bzph2\"" Jul 24 13:44:16.531144 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:16.531058 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 24 13:44:16.531144 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:16.531125 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 24 13:44:16.531246 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:16.531126 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 24 13:44:16.539116 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:16.539090 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-65b9c965dd-j9lg5"] Jul 24 13:44:16.639198 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:16.639162 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/2556ad58-b40c-4826-9c84-6e2e1690ce81-metrics-server-audit-profiles\") pod \"metrics-server-65b9c965dd-j9lg5\" (UID: \"2556ad58-b40c-4826-9c84-6e2e1690ce81\") " pod="openshift-monitoring/metrics-server-65b9c965dd-j9lg5" Jul 24 13:44:16.639356 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:16.639216 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2556ad58-b40c-4826-9c84-6e2e1690ce81-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-65b9c965dd-j9lg5\" (UID: \"2556ad58-b40c-4826-9c84-6e2e1690ce81\") " pod="openshift-monitoring/metrics-server-65b9c965dd-j9lg5" Jul 24 13:44:16.639356 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:16.639264 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/2556ad58-b40c-4826-9c84-6e2e1690ce81-audit-log\") pod \"metrics-server-65b9c965dd-j9lg5\" (UID: \"2556ad58-b40c-4826-9c84-6e2e1690ce81\") " pod="openshift-monitoring/metrics-server-65b9c965dd-j9lg5" Jul 24 13:44:16.639356 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:16.639325 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/2556ad58-b40c-4826-9c84-6e2e1690ce81-secret-metrics-server-tls\") pod \"metrics-server-65b9c965dd-j9lg5\" (UID: \"2556ad58-b40c-4826-9c84-6e2e1690ce81\") " pod="openshift-monitoring/metrics-server-65b9c965dd-j9lg5" Jul 24 13:44:16.639508 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:16.639460 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7fp9\" (UniqueName: \"kubernetes.io/projected/2556ad58-b40c-4826-9c84-6e2e1690ce81-kube-api-access-q7fp9\") pod \"metrics-server-65b9c965dd-j9lg5\" (UID: \"2556ad58-b40c-4826-9c84-6e2e1690ce81\") " pod="openshift-monitoring/metrics-server-65b9c965dd-j9lg5" Jul 24 13:44:16.639566 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:16.639504 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/2556ad58-b40c-4826-9c84-6e2e1690ce81-secret-metrics-server-client-certs\") pod \"metrics-server-65b9c965dd-j9lg5\" (UID: \"2556ad58-b40c-4826-9c84-6e2e1690ce81\") " pod="openshift-monitoring/metrics-server-65b9c965dd-j9lg5" Jul 24 13:44:16.639601 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:16.639564 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2556ad58-b40c-4826-9c84-6e2e1690ce81-client-ca-bundle\") pod \"metrics-server-65b9c965dd-j9lg5\" (UID: \"2556ad58-b40c-4826-9c84-6e2e1690ce81\") " pod="openshift-monitoring/metrics-server-65b9c965dd-j9lg5" Jul 24 13:44:16.740992 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:16.740955 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2556ad58-b40c-4826-9c84-6e2e1690ce81-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-65b9c965dd-j9lg5\" (UID: \"2556ad58-b40c-4826-9c84-6e2e1690ce81\") " pod="openshift-monitoring/metrics-server-65b9c965dd-j9lg5" Jul 24 13:44:16.740992 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:16.740993 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/2556ad58-b40c-4826-9c84-6e2e1690ce81-audit-log\") pod \"metrics-server-65b9c965dd-j9lg5\" (UID: \"2556ad58-b40c-4826-9c84-6e2e1690ce81\") " pod="openshift-monitoring/metrics-server-65b9c965dd-j9lg5" Jul 24 13:44:16.741184 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:16.741034 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/2556ad58-b40c-4826-9c84-6e2e1690ce81-secret-metrics-server-tls\") pod \"metrics-server-65b9c965dd-j9lg5\" (UID: \"2556ad58-b40c-4826-9c84-6e2e1690ce81\") " pod="openshift-monitoring/metrics-server-65b9c965dd-j9lg5" Jul 24 13:44:16.741184 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:16.741094 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q7fp9\" (UniqueName: \"kubernetes.io/projected/2556ad58-b40c-4826-9c84-6e2e1690ce81-kube-api-access-q7fp9\") pod \"metrics-server-65b9c965dd-j9lg5\" (UID: \"2556ad58-b40c-4826-9c84-6e2e1690ce81\") " pod="openshift-monitoring/metrics-server-65b9c965dd-j9lg5" Jul 24 13:44:16.741184 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:16.741130 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/2556ad58-b40c-4826-9c84-6e2e1690ce81-secret-metrics-server-client-certs\") pod \"metrics-server-65b9c965dd-j9lg5\" (UID: \"2556ad58-b40c-4826-9c84-6e2e1690ce81\") " pod="openshift-monitoring/metrics-server-65b9c965dd-j9lg5" Jul 24 13:44:16.741184 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:16.741172 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2556ad58-b40c-4826-9c84-6e2e1690ce81-client-ca-bundle\") pod \"metrics-server-65b9c965dd-j9lg5\" (UID: \"2556ad58-b40c-4826-9c84-6e2e1690ce81\") " pod="openshift-monitoring/metrics-server-65b9c965dd-j9lg5" Jul 24 13:44:16.741358 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:16.741203 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/2556ad58-b40c-4826-9c84-6e2e1690ce81-metrics-server-audit-profiles\") pod \"metrics-server-65b9c965dd-j9lg5\" (UID: \"2556ad58-b40c-4826-9c84-6e2e1690ce81\") " pod="openshift-monitoring/metrics-server-65b9c965dd-j9lg5" Jul 24 13:44:16.741471 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:16.741433 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/2556ad58-b40c-4826-9c84-6e2e1690ce81-audit-log\") pod \"metrics-server-65b9c965dd-j9lg5\" (UID: \"2556ad58-b40c-4826-9c84-6e2e1690ce81\") " pod="openshift-monitoring/metrics-server-65b9c965dd-j9lg5" Jul 24 13:44:16.741838 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:16.741810 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2556ad58-b40c-4826-9c84-6e2e1690ce81-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-65b9c965dd-j9lg5\" (UID: \"2556ad58-b40c-4826-9c84-6e2e1690ce81\") " pod="openshift-monitoring/metrics-server-65b9c965dd-j9lg5" Jul 24 13:44:16.742073 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:16.742053 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/2556ad58-b40c-4826-9c84-6e2e1690ce81-metrics-server-audit-profiles\") pod \"metrics-server-65b9c965dd-j9lg5\" (UID: \"2556ad58-b40c-4826-9c84-6e2e1690ce81\") " pod="openshift-monitoring/metrics-server-65b9c965dd-j9lg5" Jul 24 13:44:16.743632 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:16.743598 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/2556ad58-b40c-4826-9c84-6e2e1690ce81-secret-metrics-server-tls\") pod \"metrics-server-65b9c965dd-j9lg5\" (UID: \"2556ad58-b40c-4826-9c84-6e2e1690ce81\") " pod="openshift-monitoring/metrics-server-65b9c965dd-j9lg5" Jul 24 13:44:16.743811 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:16.743657 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2556ad58-b40c-4826-9c84-6e2e1690ce81-client-ca-bundle\") pod \"metrics-server-65b9c965dd-j9lg5\" (UID: \"2556ad58-b40c-4826-9c84-6e2e1690ce81\") " pod="openshift-monitoring/metrics-server-65b9c965dd-j9lg5" Jul 24 13:44:16.743811 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:16.743795 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/2556ad58-b40c-4826-9c84-6e2e1690ce81-secret-metrics-server-client-certs\") pod \"metrics-server-65b9c965dd-j9lg5\" (UID: \"2556ad58-b40c-4826-9c84-6e2e1690ce81\") " pod="openshift-monitoring/metrics-server-65b9c965dd-j9lg5" Jul 24 13:44:16.749053 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:16.749032 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7fp9\" (UniqueName: \"kubernetes.io/projected/2556ad58-b40c-4826-9c84-6e2e1690ce81-kube-api-access-q7fp9\") pod \"metrics-server-65b9c965dd-j9lg5\" (UID: \"2556ad58-b40c-4826-9c84-6e2e1690ce81\") " pod="openshift-monitoring/metrics-server-65b9c965dd-j9lg5" Jul 24 13:44:16.841488 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:16.841454 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-65b9c965dd-j9lg5" Jul 24 13:44:16.861251 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:16.861220 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-cdcvd"] Jul 24 13:44:16.866348 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:16.865956 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-cdcvd" Jul 24 13:44:16.868149 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:16.868129 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-6krd5\"" Jul 24 13:44:16.868252 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:16.868161 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 24 13:44:16.872729 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:16.872705 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-cdcvd"] Jul 24 13:44:16.942504 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:16.942198 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tj99f\" (UniqueName: \"kubernetes.io/projected/d867d4e3-35bd-4ed8-8859-3134ef837c92-kube-api-access-tj99f\") pod \"monitoring-plugin-68b7fc9574-cdcvd\" (UID: \"d867d4e3-35bd-4ed8-8859-3134ef837c92\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-cdcvd" Jul 24 13:44:16.942504 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:16.942373 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d867d4e3-35bd-4ed8-8859-3134ef837c92-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-cdcvd\" (UID: \"d867d4e3-35bd-4ed8-8859-3134ef837c92\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-cdcvd" Jul 24 13:44:16.998068 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:16.998040 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-65b9c965dd-j9lg5"] Jul 24 13:44:17.000695 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:44:17.000661 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2556ad58_b40c_4826_9c84_6e2e1690ce81.slice/crio-ed7fd92333657a13fb4879b8fbf95f2a73e91f5a92271ab67ccf055467d13a7e WatchSource:0}: Error finding container ed7fd92333657a13fb4879b8fbf95f2a73e91f5a92271ab67ccf055467d13a7e: Status 404 returned error can't find the container with id ed7fd92333657a13fb4879b8fbf95f2a73e91f5a92271ab67ccf055467d13a7e Jul 24 13:44:17.043943 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:17.043868 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d867d4e3-35bd-4ed8-8859-3134ef837c92-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-cdcvd\" (UID: \"d867d4e3-35bd-4ed8-8859-3134ef837c92\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-cdcvd" Jul 24 13:44:17.044165 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:17.044147 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tj99f\" (UniqueName: \"kubernetes.io/projected/d867d4e3-35bd-4ed8-8859-3134ef837c92-kube-api-access-tj99f\") pod \"monitoring-plugin-68b7fc9574-cdcvd\" (UID: \"d867d4e3-35bd-4ed8-8859-3134ef837c92\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-cdcvd" Jul 24 13:44:17.044447 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:44:17.044055 2578 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jul 24 13:44:17.044447 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:44:17.044342 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d867d4e3-35bd-4ed8-8859-3134ef837c92-monitoring-plugin-cert podName:d867d4e3-35bd-4ed8-8859-3134ef837c92 nodeName:}" failed. No retries permitted until 2026-07-24 13:44:17.544325367 +0000 UTC m=+65.202302733 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/d867d4e3-35bd-4ed8-8859-3134ef837c92-monitoring-plugin-cert") pod "monitoring-plugin-68b7fc9574-cdcvd" (UID: "d867d4e3-35bd-4ed8-8859-3134ef837c92") : secret "monitoring-plugin-cert" not found Jul 24 13:44:17.053141 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:17.053085 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tj99f\" (UniqueName: \"kubernetes.io/projected/d867d4e3-35bd-4ed8-8859-3134ef837c92-kube-api-access-tj99f\") pod \"monitoring-plugin-68b7fc9574-cdcvd\" (UID: \"d867d4e3-35bd-4ed8-8859-3134ef837c92\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-cdcvd" Jul 24 13:44:17.304680 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:17.304587 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-f89574b4f-wh9mj"] Jul 24 13:44:17.308706 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:17.308683 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-f89574b4f-wh9mj" Jul 24 13:44:17.311268 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:17.311216 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 24 13:44:17.311429 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:17.311384 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-z44sz\"" Jul 24 13:44:17.311914 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:17.311877 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 24 13:44:17.312041 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:17.312013 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 24 13:44:17.312151 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:17.312056 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 24 13:44:17.312344 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:17.312325 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 24 13:44:17.318592 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:17.318491 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 24 13:44:17.322380 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:17.322356 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-f89574b4f-wh9mj"] Jul 24 13:44:17.373870 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:17.373783 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-65b9c965dd-j9lg5" event={"ID":"2556ad58-b40c-4826-9c84-6e2e1690ce81","Type":"ContainerStarted","Data":"ed7fd92333657a13fb4879b8fbf95f2a73e91f5a92271ab67ccf055467d13a7e"} Jul 24 13:44:17.376420 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:17.376380 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5c889495d8-xh2tt" event={"ID":"01b4f880-e852-4297-98e9-077c6de3cb93","Type":"ContainerStarted","Data":"ffe82652f7bcb5c2d4b9700164162887827a1417ceb53f00494487cea1f5ee2a"} Jul 24 13:44:17.376547 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:17.376484 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5c889495d8-xh2tt" event={"ID":"01b4f880-e852-4297-98e9-077c6de3cb93","Type":"ContainerStarted","Data":"c64605a52b39245393928a41dffa7866b85a9addba91e107640bc47b88fdb83e"} Jul 24 13:44:17.376547 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:17.376527 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5c889495d8-xh2tt" event={"ID":"01b4f880-e852-4297-98e9-077c6de3cb93","Type":"ContainerStarted","Data":"4aa7e3a6000cae623ab7055159b143134ae20f5fd4eb1882cf7679b3d7c60fe0"} Jul 24 13:44:17.447963 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:17.447915 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/406823af-954f-446d-b47b-a71d3e709f17-telemeter-trusted-ca-bundle\") pod \"telemeter-client-f89574b4f-wh9mj\" (UID: \"406823af-954f-446d-b47b-a71d3e709f17\") " pod="openshift-monitoring/telemeter-client-f89574b4f-wh9mj" Jul 24 13:44:17.447963 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:17.447969 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/406823af-954f-446d-b47b-a71d3e709f17-telemeter-client-tls\") pod \"telemeter-client-f89574b4f-wh9mj\" (UID: \"406823af-954f-446d-b47b-a71d3e709f17\") " pod="openshift-monitoring/telemeter-client-f89574b4f-wh9mj" Jul 24 13:44:17.448227 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:17.448085 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/406823af-954f-446d-b47b-a71d3e709f17-metrics-client-ca\") pod \"telemeter-client-f89574b4f-wh9mj\" (UID: \"406823af-954f-446d-b47b-a71d3e709f17\") " pod="openshift-monitoring/telemeter-client-f89574b4f-wh9mj" Jul 24 13:44:17.448566 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:17.448519 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/406823af-954f-446d-b47b-a71d3e709f17-serving-certs-ca-bundle\") pod \"telemeter-client-f89574b4f-wh9mj\" (UID: \"406823af-954f-446d-b47b-a71d3e709f17\") " pod="openshift-monitoring/telemeter-client-f89574b4f-wh9mj" Jul 24 13:44:17.448718 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:17.448651 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/406823af-954f-446d-b47b-a71d3e709f17-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-f89574b4f-wh9mj\" (UID: \"406823af-954f-446d-b47b-a71d3e709f17\") " pod="openshift-monitoring/telemeter-client-f89574b4f-wh9mj" Jul 24 13:44:17.448792 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:17.448740 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xmbdr\" (UniqueName: \"kubernetes.io/projected/406823af-954f-446d-b47b-a71d3e709f17-kube-api-access-xmbdr\") pod \"telemeter-client-f89574b4f-wh9mj\" (UID: \"406823af-954f-446d-b47b-a71d3e709f17\") " pod="openshift-monitoring/telemeter-client-f89574b4f-wh9mj" Jul 24 13:44:17.448792 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:17.448774 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/406823af-954f-446d-b47b-a71d3e709f17-secret-telemeter-client\") pod \"telemeter-client-f89574b4f-wh9mj\" (UID: \"406823af-954f-446d-b47b-a71d3e709f17\") " pod="openshift-monitoring/telemeter-client-f89574b4f-wh9mj" Jul 24 13:44:17.448893 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:17.448805 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/406823af-954f-446d-b47b-a71d3e709f17-federate-client-tls\") pod \"telemeter-client-f89574b4f-wh9mj\" (UID: \"406823af-954f-446d-b47b-a71d3e709f17\") " pod="openshift-monitoring/telemeter-client-f89574b4f-wh9mj" Jul 24 13:44:17.549842 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:17.549797 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/406823af-954f-446d-b47b-a71d3e709f17-telemeter-client-tls\") pod \"telemeter-client-f89574b4f-wh9mj\" (UID: \"406823af-954f-446d-b47b-a71d3e709f17\") " pod="openshift-monitoring/telemeter-client-f89574b4f-wh9mj" Jul 24 13:44:17.550041 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:17.549892 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/406823af-954f-446d-b47b-a71d3e709f17-metrics-client-ca\") pod \"telemeter-client-f89574b4f-wh9mj\" (UID: \"406823af-954f-446d-b47b-a71d3e709f17\") " pod="openshift-monitoring/telemeter-client-f89574b4f-wh9mj" Jul 24 13:44:17.550041 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:17.549963 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/406823af-954f-446d-b47b-a71d3e709f17-serving-certs-ca-bundle\") pod \"telemeter-client-f89574b4f-wh9mj\" (UID: \"406823af-954f-446d-b47b-a71d3e709f17\") " pod="openshift-monitoring/telemeter-client-f89574b4f-wh9mj" Jul 24 13:44:17.550041 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:17.550025 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/406823af-954f-446d-b47b-a71d3e709f17-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-f89574b4f-wh9mj\" (UID: \"406823af-954f-446d-b47b-a71d3e709f17\") " pod="openshift-monitoring/telemeter-client-f89574b4f-wh9mj" Jul 24 13:44:17.550209 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:17.550069 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmbdr\" (UniqueName: \"kubernetes.io/projected/406823af-954f-446d-b47b-a71d3e709f17-kube-api-access-xmbdr\") pod \"telemeter-client-f89574b4f-wh9mj\" (UID: \"406823af-954f-446d-b47b-a71d3e709f17\") " pod="openshift-monitoring/telemeter-client-f89574b4f-wh9mj" Jul 24 13:44:17.550209 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:17.550094 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/406823af-954f-446d-b47b-a71d3e709f17-secret-telemeter-client\") pod \"telemeter-client-f89574b4f-wh9mj\" (UID: \"406823af-954f-446d-b47b-a71d3e709f17\") " pod="openshift-monitoring/telemeter-client-f89574b4f-wh9mj" Jul 24 13:44:17.550209 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:17.550117 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/406823af-954f-446d-b47b-a71d3e709f17-federate-client-tls\") pod \"telemeter-client-f89574b4f-wh9mj\" (UID: \"406823af-954f-446d-b47b-a71d3e709f17\") " pod="openshift-monitoring/telemeter-client-f89574b4f-wh9mj" Jul 24 13:44:17.550209 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:17.550168 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d867d4e3-35bd-4ed8-8859-3134ef837c92-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-cdcvd\" (UID: \"d867d4e3-35bd-4ed8-8859-3134ef837c92\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-cdcvd" Jul 24 13:44:17.550209 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:17.550202 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/406823af-954f-446d-b47b-a71d3e709f17-telemeter-trusted-ca-bundle\") pod \"telemeter-client-f89574b4f-wh9mj\" (UID: \"406823af-954f-446d-b47b-a71d3e709f17\") " pod="openshift-monitoring/telemeter-client-f89574b4f-wh9mj" Jul 24 13:44:17.550843 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:17.550811 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/406823af-954f-446d-b47b-a71d3e709f17-serving-certs-ca-bundle\") pod \"telemeter-client-f89574b4f-wh9mj\" (UID: \"406823af-954f-446d-b47b-a71d3e709f17\") " pod="openshift-monitoring/telemeter-client-f89574b4f-wh9mj" Jul 24 13:44:17.550952 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:17.550836 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/406823af-954f-446d-b47b-a71d3e709f17-metrics-client-ca\") pod \"telemeter-client-f89574b4f-wh9mj\" (UID: \"406823af-954f-446d-b47b-a71d3e709f17\") " pod="openshift-monitoring/telemeter-client-f89574b4f-wh9mj" Jul 24 13:44:17.551937 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:17.551118 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/406823af-954f-446d-b47b-a71d3e709f17-telemeter-trusted-ca-bundle\") pod \"telemeter-client-f89574b4f-wh9mj\" (UID: \"406823af-954f-446d-b47b-a71d3e709f17\") " pod="openshift-monitoring/telemeter-client-f89574b4f-wh9mj" Jul 24 13:44:17.551937 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:44:17.551211 2578 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jul 24 13:44:17.551937 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:44:17.551271 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d867d4e3-35bd-4ed8-8859-3134ef837c92-monitoring-plugin-cert podName:d867d4e3-35bd-4ed8-8859-3134ef837c92 nodeName:}" failed. No retries permitted until 2026-07-24 13:44:18.551252802 +0000 UTC m=+66.209230171 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/d867d4e3-35bd-4ed8-8859-3134ef837c92-monitoring-plugin-cert") pod "monitoring-plugin-68b7fc9574-cdcvd" (UID: "d867d4e3-35bd-4ed8-8859-3134ef837c92") : secret "monitoring-plugin-cert" not found Jul 24 13:44:17.553644 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:17.553594 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/406823af-954f-446d-b47b-a71d3e709f17-secret-telemeter-client\") pod \"telemeter-client-f89574b4f-wh9mj\" (UID: \"406823af-954f-446d-b47b-a71d3e709f17\") " pod="openshift-monitoring/telemeter-client-f89574b4f-wh9mj" Jul 24 13:44:17.553826 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:17.553800 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/406823af-954f-446d-b47b-a71d3e709f17-telemeter-client-tls\") pod \"telemeter-client-f89574b4f-wh9mj\" (UID: \"406823af-954f-446d-b47b-a71d3e709f17\") " pod="openshift-monitoring/telemeter-client-f89574b4f-wh9mj" Jul 24 13:44:17.554251 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:17.554209 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/406823af-954f-446d-b47b-a71d3e709f17-federate-client-tls\") pod \"telemeter-client-f89574b4f-wh9mj\" (UID: \"406823af-954f-446d-b47b-a71d3e709f17\") " pod="openshift-monitoring/telemeter-client-f89574b4f-wh9mj" Jul 24 13:44:17.554728 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:17.554655 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/406823af-954f-446d-b47b-a71d3e709f17-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-f89574b4f-wh9mj\" (UID: \"406823af-954f-446d-b47b-a71d3e709f17\") " pod="openshift-monitoring/telemeter-client-f89574b4f-wh9mj" Jul 24 13:44:17.559946 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:17.559923 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xmbdr\" (UniqueName: \"kubernetes.io/projected/406823af-954f-446d-b47b-a71d3e709f17-kube-api-access-xmbdr\") pod \"telemeter-client-f89574b4f-wh9mj\" (UID: \"406823af-954f-446d-b47b-a71d3e709f17\") " pod="openshift-monitoring/telemeter-client-f89574b4f-wh9mj" Jul 24 13:44:17.621030 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:17.620758 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-f89574b4f-wh9mj" Jul 24 13:44:18.129648 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:18.129608 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-74cd5954f5-pswsk"] Jul 24 13:44:18.133592 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:18.133564 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74cd5954f5-pswsk" Jul 24 13:44:18.141753 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:18.141688 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-74cd5954f5-pswsk"] Jul 24 13:44:18.258596 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:18.258389 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f17d7b72-b345-4430-a8e0-a4c01424f48d-trusted-ca-bundle\") pod \"console-74cd5954f5-pswsk\" (UID: \"f17d7b72-b345-4430-a8e0-a4c01424f48d\") " pod="openshift-console/console-74cd5954f5-pswsk" Jul 24 13:44:18.258596 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:18.258477 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z92wr\" (UniqueName: \"kubernetes.io/projected/f17d7b72-b345-4430-a8e0-a4c01424f48d-kube-api-access-z92wr\") pod \"console-74cd5954f5-pswsk\" (UID: \"f17d7b72-b345-4430-a8e0-a4c01424f48d\") " pod="openshift-console/console-74cd5954f5-pswsk" Jul 24 13:44:18.258596 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:18.258547 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f17d7b72-b345-4430-a8e0-a4c01424f48d-console-serving-cert\") pod \"console-74cd5954f5-pswsk\" (UID: \"f17d7b72-b345-4430-a8e0-a4c01424f48d\") " pod="openshift-console/console-74cd5954f5-pswsk" Jul 24 13:44:18.258880 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:18.258632 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f17d7b72-b345-4430-a8e0-a4c01424f48d-oauth-serving-cert\") pod \"console-74cd5954f5-pswsk\" (UID: \"f17d7b72-b345-4430-a8e0-a4c01424f48d\") " pod="openshift-console/console-74cd5954f5-pswsk" Jul 24 13:44:18.258880 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:18.258681 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f17d7b72-b345-4430-a8e0-a4c01424f48d-service-ca\") pod \"console-74cd5954f5-pswsk\" (UID: \"f17d7b72-b345-4430-a8e0-a4c01424f48d\") " pod="openshift-console/console-74cd5954f5-pswsk" Jul 24 13:44:18.258880 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:18.258710 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f17d7b72-b345-4430-a8e0-a4c01424f48d-console-oauth-config\") pod \"console-74cd5954f5-pswsk\" (UID: \"f17d7b72-b345-4430-a8e0-a4c01424f48d\") " pod="openshift-console/console-74cd5954f5-pswsk" Jul 24 13:44:18.258880 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:18.258779 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f17d7b72-b345-4430-a8e0-a4c01424f48d-console-config\") pod \"console-74cd5954f5-pswsk\" (UID: \"f17d7b72-b345-4430-a8e0-a4c01424f48d\") " pod="openshift-console/console-74cd5954f5-pswsk" Jul 24 13:44:18.330093 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:18.329959 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 24 13:44:18.337913 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:18.337883 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:44:18.342235 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:18.341522 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 24 13:44:18.342235 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:18.341823 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 24 13:44:18.342235 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:18.341840 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 24 13:44:18.342235 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:18.342040 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 24 13:44:18.342235 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:18.342118 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 24 13:44:18.344919 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:18.342628 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 24 13:44:18.344919 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:18.343780 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-5764vp0ikm5j7\"" Jul 24 13:44:18.344919 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:18.343985 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 24 13:44:18.344919 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:18.344162 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 24 13:44:18.344919 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:18.344359 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 24 13:44:18.345450 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:18.345249 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 24 13:44:18.353298 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:18.349195 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 24 13:44:18.356364 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:18.354996 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 24 13:44:18.356364 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:18.355286 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 24 13:44:18.356364 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:18.355515 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-2glqd\"" Jul 24 13:44:18.356364 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:18.355861 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 24 13:44:18.361567 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:18.361007 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z92wr\" (UniqueName: \"kubernetes.io/projected/f17d7b72-b345-4430-a8e0-a4c01424f48d-kube-api-access-z92wr\") pod \"console-74cd5954f5-pswsk\" (UID: \"f17d7b72-b345-4430-a8e0-a4c01424f48d\") " pod="openshift-console/console-74cd5954f5-pswsk" Jul 24 13:44:18.361567 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:18.361073 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f17d7b72-b345-4430-a8e0-a4c01424f48d-console-serving-cert\") pod \"console-74cd5954f5-pswsk\" (UID: \"f17d7b72-b345-4430-a8e0-a4c01424f48d\") " pod="openshift-console/console-74cd5954f5-pswsk" Jul 24 13:44:18.361567 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:18.361127 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f17d7b72-b345-4430-a8e0-a4c01424f48d-oauth-serving-cert\") pod \"console-74cd5954f5-pswsk\" (UID: \"f17d7b72-b345-4430-a8e0-a4c01424f48d\") " pod="openshift-console/console-74cd5954f5-pswsk" Jul 24 13:44:18.361567 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:18.361170 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f17d7b72-b345-4430-a8e0-a4c01424f48d-service-ca\") pod \"console-74cd5954f5-pswsk\" (UID: \"f17d7b72-b345-4430-a8e0-a4c01424f48d\") " pod="openshift-console/console-74cd5954f5-pswsk" Jul 24 13:44:18.361567 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:18.361199 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f17d7b72-b345-4430-a8e0-a4c01424f48d-console-oauth-config\") pod \"console-74cd5954f5-pswsk\" (UID: \"f17d7b72-b345-4430-a8e0-a4c01424f48d\") " pod="openshift-console/console-74cd5954f5-pswsk" Jul 24 13:44:18.361567 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:18.361257 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f17d7b72-b345-4430-a8e0-a4c01424f48d-console-config\") pod \"console-74cd5954f5-pswsk\" (UID: \"f17d7b72-b345-4430-a8e0-a4c01424f48d\") " pod="openshift-console/console-74cd5954f5-pswsk" Jul 24 13:44:18.361567 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:18.361285 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f17d7b72-b345-4430-a8e0-a4c01424f48d-trusted-ca-bundle\") pod \"console-74cd5954f5-pswsk\" (UID: \"f17d7b72-b345-4430-a8e0-a4c01424f48d\") " pod="openshift-console/console-74cd5954f5-pswsk" Jul 24 13:44:18.363388 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:18.362787 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f17d7b72-b345-4430-a8e0-a4c01424f48d-trusted-ca-bundle\") pod \"console-74cd5954f5-pswsk\" (UID: \"f17d7b72-b345-4430-a8e0-a4c01424f48d\") " pod="openshift-console/console-74cd5954f5-pswsk" Jul 24 13:44:18.364841 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:18.364035 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f17d7b72-b345-4430-a8e0-a4c01424f48d-service-ca\") pod \"console-74cd5954f5-pswsk\" (UID: \"f17d7b72-b345-4430-a8e0-a4c01424f48d\") " pod="openshift-console/console-74cd5954f5-pswsk" Jul 24 13:44:18.364841 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:18.364552 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f17d7b72-b345-4430-a8e0-a4c01424f48d-oauth-serving-cert\") pod \"console-74cd5954f5-pswsk\" (UID: \"f17d7b72-b345-4430-a8e0-a4c01424f48d\") " pod="openshift-console/console-74cd5954f5-pswsk" Jul 24 13:44:18.369980 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:18.369844 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 24 13:44:18.373382 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:18.373084 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f17d7b72-b345-4430-a8e0-a4c01424f48d-console-oauth-config\") pod \"console-74cd5954f5-pswsk\" (UID: \"f17d7b72-b345-4430-a8e0-a4c01424f48d\") " pod="openshift-console/console-74cd5954f5-pswsk" Jul 24 13:44:18.373382 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:18.373342 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z92wr\" (UniqueName: \"kubernetes.io/projected/f17d7b72-b345-4430-a8e0-a4c01424f48d-kube-api-access-z92wr\") pod \"console-74cd5954f5-pswsk\" (UID: \"f17d7b72-b345-4430-a8e0-a4c01424f48d\") " pod="openshift-console/console-74cd5954f5-pswsk" Jul 24 13:44:18.385236 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:18.385003 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f17d7b72-b345-4430-a8e0-a4c01424f48d-console-serving-cert\") pod \"console-74cd5954f5-pswsk\" (UID: \"f17d7b72-b345-4430-a8e0-a4c01424f48d\") " pod="openshift-console/console-74cd5954f5-pswsk" Jul 24 13:44:18.385728 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:18.385315 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f17d7b72-b345-4430-a8e0-a4c01424f48d-console-config\") pod \"console-74cd5954f5-pswsk\" (UID: \"f17d7b72-b345-4430-a8e0-a4c01424f48d\") " pod="openshift-console/console-74cd5954f5-pswsk" Jul 24 13:44:18.447319 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:18.447275 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74cd5954f5-pswsk" Jul 24 13:44:18.462484 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:18.462443 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83e86524-4fef-468f-9f50-fb75629c89f9-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"83e86524-4fef-468f-9f50-fb75629c89f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:44:18.462641 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:18.462518 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/83e86524-4fef-468f-9f50-fb75629c89f9-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"83e86524-4fef-468f-9f50-fb75629c89f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:44:18.462641 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:18.462546 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/83e86524-4fef-468f-9f50-fb75629c89f9-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"83e86524-4fef-468f-9f50-fb75629c89f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:44:18.462641 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:18.462589 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/83e86524-4fef-468f-9f50-fb75629c89f9-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"83e86524-4fef-468f-9f50-fb75629c89f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:44:18.462813 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:18.462670 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/83e86524-4fef-468f-9f50-fb75629c89f9-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"83e86524-4fef-468f-9f50-fb75629c89f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:44:18.462813 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:18.462761 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/83e86524-4fef-468f-9f50-fb75629c89f9-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"83e86524-4fef-468f-9f50-fb75629c89f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:44:18.462813 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:18.462789 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/83e86524-4fef-468f-9f50-fb75629c89f9-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"83e86524-4fef-468f-9f50-fb75629c89f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:44:18.462955 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:18.462825 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/83e86524-4fef-468f-9f50-fb75629c89f9-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"83e86524-4fef-468f-9f50-fb75629c89f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:44:18.462955 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:18.462858 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/83e86524-4fef-468f-9f50-fb75629c89f9-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"83e86524-4fef-468f-9f50-fb75629c89f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:44:18.463045 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:18.462965 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/83e86524-4fef-468f-9f50-fb75629c89f9-config-out\") pod \"prometheus-k8s-0\" (UID: \"83e86524-4fef-468f-9f50-fb75629c89f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:44:18.463045 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:18.463002 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/83e86524-4fef-468f-9f50-fb75629c89f9-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"83e86524-4fef-468f-9f50-fb75629c89f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:44:18.463045 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:18.463028 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83e86524-4fef-468f-9f50-fb75629c89f9-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"83e86524-4fef-468f-9f50-fb75629c89f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:44:18.463181 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:18.463084 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/83e86524-4fef-468f-9f50-fb75629c89f9-config\") pod \"prometheus-k8s-0\" (UID: \"83e86524-4fef-468f-9f50-fb75629c89f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:44:18.463181 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:18.463151 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/83e86524-4fef-468f-9f50-fb75629c89f9-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"83e86524-4fef-468f-9f50-fb75629c89f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:44:18.463280 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:18.463204 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83e86524-4fef-468f-9f50-fb75629c89f9-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"83e86524-4fef-468f-9f50-fb75629c89f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:44:18.463280 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:18.463245 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/83e86524-4fef-468f-9f50-fb75629c89f9-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"83e86524-4fef-468f-9f50-fb75629c89f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:44:18.463280 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:18.463268 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/83e86524-4fef-468f-9f50-fb75629c89f9-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"83e86524-4fef-468f-9f50-fb75629c89f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:44:18.463472 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:18.463294 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fff76\" (UniqueName: \"kubernetes.io/projected/83e86524-4fef-468f-9f50-fb75629c89f9-kube-api-access-fff76\") pod \"prometheus-k8s-0\" (UID: \"83e86524-4fef-468f-9f50-fb75629c89f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:44:18.463472 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:18.463322 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/83e86524-4fef-468f-9f50-fb75629c89f9-web-config\") pod \"prometheus-k8s-0\" (UID: \"83e86524-4fef-468f-9f50-fb75629c89f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:44:18.463472 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:18.463344 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/83e86524-4fef-468f-9f50-fb75629c89f9-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"83e86524-4fef-468f-9f50-fb75629c89f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:44:18.564329 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:18.564161 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/83e86524-4fef-468f-9f50-fb75629c89f9-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"83e86524-4fef-468f-9f50-fb75629c89f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:44:18.564329 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:18.564199 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/83e86524-4fef-468f-9f50-fb75629c89f9-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"83e86524-4fef-468f-9f50-fb75629c89f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:44:18.564329 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:18.564238 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/83e86524-4fef-468f-9f50-fb75629c89f9-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"83e86524-4fef-468f-9f50-fb75629c89f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:44:18.564329 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:18.564266 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/83e86524-4fef-468f-9f50-fb75629c89f9-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"83e86524-4fef-468f-9f50-fb75629c89f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:44:18.566429 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:18.564307 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cb920d79-442e-4835-96ca-66a2c62e6fad-original-pull-secret\") pod \"global-pull-secret-syncer-n845m\" (UID: \"cb920d79-442e-4835-96ca-66a2c62e6fad\") " pod="kube-system/global-pull-secret-syncer-n845m" Jul 24 13:44:18.566429 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:18.565578 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d867d4e3-35bd-4ed8-8859-3134ef837c92-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-cdcvd\" (UID: \"d867d4e3-35bd-4ed8-8859-3134ef837c92\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-cdcvd" Jul 24 13:44:18.566429 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:18.565661 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/83e86524-4fef-468f-9f50-fb75629c89f9-config-out\") pod \"prometheus-k8s-0\" (UID: \"83e86524-4fef-468f-9f50-fb75629c89f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:44:18.566429 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:18.565716 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/83e86524-4fef-468f-9f50-fb75629c89f9-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"83e86524-4fef-468f-9f50-fb75629c89f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:44:18.566429 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:18.565740 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83e86524-4fef-468f-9f50-fb75629c89f9-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"83e86524-4fef-468f-9f50-fb75629c89f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:44:18.566429 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:18.565801 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/83e86524-4fef-468f-9f50-fb75629c89f9-config\") pod \"prometheus-k8s-0\" (UID: \"83e86524-4fef-468f-9f50-fb75629c89f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:44:18.566429 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:18.565854 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/83e86524-4fef-468f-9f50-fb75629c89f9-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"83e86524-4fef-468f-9f50-fb75629c89f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:44:18.566429 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:18.565896 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83e86524-4fef-468f-9f50-fb75629c89f9-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"83e86524-4fef-468f-9f50-fb75629c89f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:44:18.566429 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:18.565930 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/83e86524-4fef-468f-9f50-fb75629c89f9-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"83e86524-4fef-468f-9f50-fb75629c89f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:44:18.566429 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:18.565954 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/83e86524-4fef-468f-9f50-fb75629c89f9-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"83e86524-4fef-468f-9f50-fb75629c89f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:44:18.566429 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:18.565983 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fff76\" (UniqueName: \"kubernetes.io/projected/83e86524-4fef-468f-9f50-fb75629c89f9-kube-api-access-fff76\") pod \"prometheus-k8s-0\" (UID: \"83e86524-4fef-468f-9f50-fb75629c89f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:44:18.566429 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:18.566010 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/83e86524-4fef-468f-9f50-fb75629c89f9-web-config\") pod \"prometheus-k8s-0\" (UID: \"83e86524-4fef-468f-9f50-fb75629c89f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:44:18.566429 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:18.566030 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/83e86524-4fef-468f-9f50-fb75629c89f9-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"83e86524-4fef-468f-9f50-fb75629c89f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:44:18.566429 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:18.566083 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83e86524-4fef-468f-9f50-fb75629c89f9-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"83e86524-4fef-468f-9f50-fb75629c89f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:44:18.566429 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:18.566125 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/83e86524-4fef-468f-9f50-fb75629c89f9-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"83e86524-4fef-468f-9f50-fb75629c89f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:44:18.566429 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:18.566154 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/83e86524-4fef-468f-9f50-fb75629c89f9-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"83e86524-4fef-468f-9f50-fb75629c89f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:44:18.566429 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:18.566195 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/83e86524-4fef-468f-9f50-fb75629c89f9-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"83e86524-4fef-468f-9f50-fb75629c89f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:44:18.567503 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:18.566235 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/83e86524-4fef-468f-9f50-fb75629c89f9-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"83e86524-4fef-468f-9f50-fb75629c89f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:44:18.573012 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:18.570947 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 24 13:44:18.573012 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:18.570981 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/83e86524-4fef-468f-9f50-fb75629c89f9-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"83e86524-4fef-468f-9f50-fb75629c89f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:44:18.573012 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:18.571518 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/83e86524-4fef-468f-9f50-fb75629c89f9-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"83e86524-4fef-468f-9f50-fb75629c89f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:44:18.573012 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:18.572102 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83e86524-4fef-468f-9f50-fb75629c89f9-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"83e86524-4fef-468f-9f50-fb75629c89f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:44:18.573012 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:18.572263 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/83e86524-4fef-468f-9f50-fb75629c89f9-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"83e86524-4fef-468f-9f50-fb75629c89f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:44:18.573304 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:18.573110 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/83e86524-4fef-468f-9f50-fb75629c89f9-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"83e86524-4fef-468f-9f50-fb75629c89f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:44:18.573364 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:18.573320 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83e86524-4fef-468f-9f50-fb75629c89f9-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"83e86524-4fef-468f-9f50-fb75629c89f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:44:18.575130 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:18.575070 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/83e86524-4fef-468f-9f50-fb75629c89f9-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"83e86524-4fef-468f-9f50-fb75629c89f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:44:18.579369 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:18.577457 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/83e86524-4fef-468f-9f50-fb75629c89f9-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"83e86524-4fef-468f-9f50-fb75629c89f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:44:18.579369 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:18.577982 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83e86524-4fef-468f-9f50-fb75629c89f9-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"83e86524-4fef-468f-9f50-fb75629c89f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:44:18.579369 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:18.579004 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/83e86524-4fef-468f-9f50-fb75629c89f9-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"83e86524-4fef-468f-9f50-fb75629c89f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:44:18.580035 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:18.579893 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cb920d79-442e-4835-96ca-66a2c62e6fad-original-pull-secret\") pod \"global-pull-secret-syncer-n845m\" (UID: \"cb920d79-442e-4835-96ca-66a2c62e6fad\") " pod="kube-system/global-pull-secret-syncer-n845m" Jul 24 13:44:18.582275 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:18.582217 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/83e86524-4fef-468f-9f50-fb75629c89f9-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"83e86524-4fef-468f-9f50-fb75629c89f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:44:18.582364 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:18.582282 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/83e86524-4fef-468f-9f50-fb75629c89f9-web-config\") pod \"prometheus-k8s-0\" (UID: \"83e86524-4fef-468f-9f50-fb75629c89f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:44:18.584255 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:18.584227 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/83e86524-4fef-468f-9f50-fb75629c89f9-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"83e86524-4fef-468f-9f50-fb75629c89f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:44:18.586246 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:18.584732 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/83e86524-4fef-468f-9f50-fb75629c89f9-config\") pod \"prometheus-k8s-0\" (UID: \"83e86524-4fef-468f-9f50-fb75629c89f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:44:18.586246 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:18.585202 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d867d4e3-35bd-4ed8-8859-3134ef837c92-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-cdcvd\" (UID: \"d867d4e3-35bd-4ed8-8859-3134ef837c92\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-cdcvd" Jul 24 13:44:18.586246 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:18.585758 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/83e86524-4fef-468f-9f50-fb75629c89f9-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"83e86524-4fef-468f-9f50-fb75629c89f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:44:18.586246 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:18.586131 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/83e86524-4fef-468f-9f50-fb75629c89f9-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"83e86524-4fef-468f-9f50-fb75629c89f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:44:18.588319 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:18.587517 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/83e86524-4fef-468f-9f50-fb75629c89f9-config-out\") pod \"prometheus-k8s-0\" (UID: \"83e86524-4fef-468f-9f50-fb75629c89f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:44:18.588319 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:18.587827 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fff76\" (UniqueName: \"kubernetes.io/projected/83e86524-4fef-468f-9f50-fb75629c89f9-kube-api-access-fff76\") pod \"prometheus-k8s-0\" (UID: \"83e86524-4fef-468f-9f50-fb75629c89f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:44:18.588319 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:18.587914 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/83e86524-4fef-468f-9f50-fb75629c89f9-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"83e86524-4fef-468f-9f50-fb75629c89f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:44:18.588559 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:18.588456 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/83e86524-4fef-468f-9f50-fb75629c89f9-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"83e86524-4fef-468f-9f50-fb75629c89f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:44:18.635762 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:18.635564 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n845m" Jul 24 13:44:18.652705 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:18.652605 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-67b4749744-k56g2" Jul 24 13:44:18.661798 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:18.660955 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:44:18.667369 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:18.666865 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/20a8559f-d049-4fac-b14a-5a1d2aaa1aa9-metrics-certs\") pod \"network-metrics-daemon-f8gm6\" (UID: \"20a8559f-d049-4fac-b14a-5a1d2aaa1aa9\") " pod="openshift-multus/network-metrics-daemon-f8gm6" Jul 24 13:44:18.667369 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:18.666944 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q9b8f\" (UniqueName: \"kubernetes.io/projected/503c5389-fcf1-4589-904d-1bf1261baace-kube-api-access-q9b8f\") pod \"network-check-target-5jqwl\" (UID: \"503c5389-fcf1-4589-904d-1bf1261baace\") " pod="openshift-network-diagnostics/network-check-target-5jqwl" Jul 24 13:44:18.670056 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:18.669137 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 24 13:44:18.670761 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:18.670572 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 24 13:44:18.683047 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:18.680072 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 24 13:44:18.683652 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:18.683623 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/20a8559f-d049-4fac-b14a-5a1d2aaa1aa9-metrics-certs\") pod \"network-metrics-daemon-f8gm6\" (UID: \"20a8559f-d049-4fac-b14a-5a1d2aaa1aa9\") " pod="openshift-multus/network-metrics-daemon-f8gm6" Jul 24 13:44:18.705592 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:18.699424 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-cdcvd" Jul 24 13:44:18.710514 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:18.710454 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9b8f\" (UniqueName: \"kubernetes.io/projected/503c5389-fcf1-4589-904d-1bf1261baace-kube-api-access-q9b8f\") pod \"network-check-target-5jqwl\" (UID: \"503c5389-fcf1-4589-904d-1bf1261baace\") " pod="openshift-network-diagnostics/network-check-target-5jqwl" Jul 24 13:44:18.800924 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:18.800837 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-f89574b4f-wh9mj"] Jul 24 13:44:18.834641 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:18.831050 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-74cd5954f5-pswsk"] Jul 24 13:44:18.947568 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:18.947502 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-n845m"] Jul 24 13:44:18.956319 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:18.955007 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-cbzbq\"" Jul 24 13:44:18.963996 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:18.963969 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-l5jkr\"" Jul 24 13:44:18.968462 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:18.968194 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f8gm6" Jul 24 13:44:18.972255 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:18.972233 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5jqwl" Jul 24 13:44:18.989277 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:18.989157 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 24 13:44:18.995680 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:18.995503 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-cdcvd"] Jul 24 13:44:19.013218 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:44:19.013178 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd867d4e3_35bd_4ed8_8859_3134ef837c92.slice/crio-e742ee88533acf91aa3f502513d77e552786a2684f9b9693e1633b444985898c WatchSource:0}: Error finding container e742ee88533acf91aa3f502513d77e552786a2684f9b9693e1633b444985898c: Status 404 returned error can't find the container with id e742ee88533acf91aa3f502513d77e552786a2684f9b9693e1633b444985898c Jul 24 13:44:19.204720 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:19.203778 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-f8gm6"] Jul 24 13:44:19.235297 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:44:19.235263 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20a8559f_d049_4fac_b14a_5a1d2aaa1aa9.slice/crio-bb7b8c0b1138ad3283f53b4fc548b231ccf0e237fb0097690feedb5ad45453ec WatchSource:0}: Error finding container bb7b8c0b1138ad3283f53b4fc548b231ccf0e237fb0097690feedb5ad45453ec: Status 404 returned error can't find the container with id bb7b8c0b1138ad3283f53b4fc548b231ccf0e237fb0097690feedb5ad45453ec Jul 24 13:44:19.242541 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:19.242514 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-5jqwl"] Jul 24 13:44:19.262016 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:44:19.261985 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod503c5389_fcf1_4589_904d_1bf1261baace.slice/crio-978c1a218996acfce1db2e0856ba200328efcddb8e7dcf0395c9ccad3ba6eadd WatchSource:0}: Error finding container 978c1a218996acfce1db2e0856ba200328efcddb8e7dcf0395c9ccad3ba6eadd: Status 404 returned error can't find the container with id 978c1a218996acfce1db2e0856ba200328efcddb8e7dcf0395c9ccad3ba6eadd Jul 24 13:44:19.397216 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:19.397108 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-f8gm6" event={"ID":"20a8559f-d049-4fac-b14a-5a1d2aaa1aa9","Type":"ContainerStarted","Data":"bb7b8c0b1138ad3283f53b4fc548b231ccf0e237fb0097690feedb5ad45453ec"} Jul 24 13:44:19.398833 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:19.398801 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74cd5954f5-pswsk" event={"ID":"f17d7b72-b345-4430-a8e0-a4c01424f48d","Type":"ContainerStarted","Data":"27b23dffab1fe7ea264c0a4184054cbf9536be8b53c2718be52f6e5eb4339538"} Jul 24 13:44:19.398970 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:19.398854 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74cd5954f5-pswsk" event={"ID":"f17d7b72-b345-4430-a8e0-a4c01424f48d","Type":"ContainerStarted","Data":"e8678df43cb15f08df138eb9a866b9d8ac062b221a175a1c2550be92592a236c"} Jul 24 13:44:19.400123 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:19.400097 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-5jqwl" event={"ID":"503c5389-fcf1-4589-904d-1bf1261baace","Type":"ContainerStarted","Data":"978c1a218996acfce1db2e0856ba200328efcddb8e7dcf0395c9ccad3ba6eadd"} Jul 24 13:44:19.401619 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:19.401594 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-65b9c965dd-j9lg5" event={"ID":"2556ad58-b40c-4826-9c84-6e2e1690ce81","Type":"ContainerStarted","Data":"61160b92b23db99a4cf0db7a192e25e29d301d78676d47f7a41ef50112d4d6c1"} Jul 24 13:44:19.403237 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:19.403214 2578 generic.go:356] "Generic (PLEG): container finished" podID="83e86524-4fef-468f-9f50-fb75629c89f9" containerID="ce8d584b8237efcfe623a4fe4bc957e41a1a0281b6ba2b5a539715f7f3602a32" exitCode=0 Jul 24 13:44:19.403344 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:19.403289 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"83e86524-4fef-468f-9f50-fb75629c89f9","Type":"ContainerDied","Data":"ce8d584b8237efcfe623a4fe4bc957e41a1a0281b6ba2b5a539715f7f3602a32"} Jul 24 13:44:19.403416 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:19.403351 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"83e86524-4fef-468f-9f50-fb75629c89f9","Type":"ContainerStarted","Data":"e84da8ed01ceacf4a30843e604736f4b30f7b2e8381d7b6ca527b0fe4c83fd2b"} Jul 24 13:44:19.406807 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:19.406778 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5c889495d8-xh2tt" event={"ID":"01b4f880-e852-4297-98e9-077c6de3cb93","Type":"ContainerStarted","Data":"c546f95ca487ecadb351d3b15ac8206ca93093032732a8be0420ad4d3fac7e0c"} Jul 24 13:44:19.406915 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:19.406860 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5c889495d8-xh2tt" event={"ID":"01b4f880-e852-4297-98e9-077c6de3cb93","Type":"ContainerStarted","Data":"ed46d8d2e1cd59f8fc87d9c9d5f1236f953ee0ffb3b36ff0ab519ba79a388906"} Jul 24 13:44:19.406915 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:19.406903 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-5c889495d8-xh2tt" Jul 24 13:44:19.407010 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:19.406944 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5c889495d8-xh2tt" event={"ID":"01b4f880-e852-4297-98e9-077c6de3cb93","Type":"ContainerStarted","Data":"3b9c11bed2364950c362ee24c1c0efd8225da9a13448a27bc39fa271245f8d8c"} Jul 24 13:44:19.411242 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:19.411218 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"64f1b2c7-305c-44bc-b2c6-6080196f5269","Type":"ContainerStarted","Data":"e7b45e6eca0c2e9c324d85e3056115dd0b1aa2a2265b6c009e8d794e96b3d62f"} Jul 24 13:44:19.411361 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:19.411282 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"64f1b2c7-305c-44bc-b2c6-6080196f5269","Type":"ContainerStarted","Data":"582a87136659b862324938f73ac20608ce5bd1cee3f7f6f3263230bce58ccc88"} Jul 24 13:44:19.411361 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:19.411313 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"64f1b2c7-305c-44bc-b2c6-6080196f5269","Type":"ContainerStarted","Data":"1a9b6d9fd9bf3a3d14467bbca6b3c583d40762ab4b96b331cf9081b75d8955b4"} Jul 24 13:44:19.411361 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:19.411349 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"64f1b2c7-305c-44bc-b2c6-6080196f5269","Type":"ContainerStarted","Data":"dc0090f7685cc6b06f80d07527147a14208e6009eb48d61da1f30941ed96a2c0"} Jul 24 13:44:19.411522 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:19.411382 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"64f1b2c7-305c-44bc-b2c6-6080196f5269","Type":"ContainerStarted","Data":"4f39cb2e92be863e594e49efb8f02050b94606e4929ab948ace9e4056cd22b80"} Jul 24 13:44:19.411522 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:19.411435 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"64f1b2c7-305c-44bc-b2c6-6080196f5269","Type":"ContainerStarted","Data":"8950f65524f53aff7e1b6472fd13a30d2f04c41bfe1b3b42b0828d682f03a913"} Jul 24 13:44:19.412650 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:19.412628 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-n845m" event={"ID":"cb920d79-442e-4835-96ca-66a2c62e6fad","Type":"ContainerStarted","Data":"a30dfff2a2c5c8a83fd4dd61bb3af6175c53c9c351fac90c9ee4a0add37741e9"} Jul 24 13:44:19.413880 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:19.413860 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-f89574b4f-wh9mj" event={"ID":"406823af-954f-446d-b47b-a71d3e709f17","Type":"ContainerStarted","Data":"e1a974a4e56ffb2154047d7720326d987e0dbc58be12b034bf1ba1aa6ecc51ce"} Jul 24 13:44:19.415247 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:19.415201 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-74cd5954f5-pswsk" podStartSLOduration=1.415186159 podStartE2EDuration="1.415186159s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 13:44:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:44:19.415169643 +0000 UTC m=+67.073147053" watchObservedRunningTime="2026-07-24 13:44:19.415186159 +0000 UTC m=+67.073163546" Jul 24 13:44:19.415359 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:19.415307 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-cdcvd" event={"ID":"d867d4e3-35bd-4ed8-8859-3134ef837c92","Type":"ContainerStarted","Data":"e742ee88533acf91aa3f502513d77e552786a2684f9b9693e1633b444985898c"} Jul 24 13:44:19.459375 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:19.459320 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-5c889495d8-xh2tt" podStartSLOduration=2.037911515 podStartE2EDuration="5.459304471s" totalImagesPullingTime="3.421392956s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 13:44:14 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:44:19.458445757 +0000 UTC m=+67.116423142" watchObservedRunningTime="2026-07-24 13:44:19.459304471 +0000 UTC m=+67.117281859" Jul 24 13:44:19.485069 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:19.484967 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.833973303 podStartE2EDuration="6.484913869s" totalImagesPullingTime="3.633303995s" totalInitContainerRuntime="17.636571ms" isStatefulPod=false podCreationTimestamp="2026-07-24 13:44:13 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:44:19.482840625 +0000 UTC m=+67.140818047" watchObservedRunningTime="2026-07-24 13:44:19.484913869 +0000 UTC m=+67.142891252" Jul 24 13:44:19.502914 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:19.502843 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-65b9c965dd-j9lg5" podStartSLOduration=1.850929393 podStartE2EDuration="3.502816544s" totalImagesPullingTime="1.651887151s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 13:44:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:44:19.501247053 +0000 UTC m=+67.159224439" watchObservedRunningTime="2026-07-24 13:44:19.502816544 +0000 UTC m=+67.160793930" Jul 24 13:44:25.432717 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:25.432684 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-5c889495d8-xh2tt" Jul 24 13:44:27.462312 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:27.462174 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-cdcvd" event={"ID":"d867d4e3-35bd-4ed8-8859-3134ef837c92","Type":"ContainerStarted","Data":"9c11423e8afca29106992df78c87cc2056d446abef12592a7b2b9fec0204c346"} Jul 24 13:44:27.462312 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:27.462237 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-cdcvd" Jul 24 13:44:27.464107 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:27.464082 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-f8gm6" event={"ID":"20a8559f-d049-4fac-b14a-5a1d2aaa1aa9","Type":"ContainerStarted","Data":"dfdaf1fb1f48b7a101d607ed54fff3def0abb932f977bfaaa30003175016e7c8"} Jul 24 13:44:27.464239 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:27.464134 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-f8gm6" event={"ID":"20a8559f-d049-4fac-b14a-5a1d2aaa1aa9","Type":"ContainerStarted","Data":"7a334040a71a3e87111c6ac1ee0b4693be381272c19c182e78f9c54670f86c84"} Jul 24 13:44:27.465933 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:27.465911 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-5jqwl" event={"ID":"503c5389-fcf1-4589-904d-1bf1261baace","Type":"ContainerStarted","Data":"a5e0f4cb4535cca83f06af4fd1c9bbfeb0bad854067a630541a790ef22f9cf5e"} Jul 24 13:44:27.465933 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:27.465976 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-5jqwl" Jul 24 13:44:27.468080 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:27.468061 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-cdcvd" Jul 24 13:44:27.469463 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:27.469441 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"83e86524-4fef-468f-9f50-fb75629c89f9","Type":"ContainerStarted","Data":"ce1a9caada6c68ff2c3ccf378c74167ba2c2ea7bf3d090d76248ee2141dee080"} Jul 24 13:44:27.469550 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:27.469491 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"83e86524-4fef-468f-9f50-fb75629c89f9","Type":"ContainerStarted","Data":"560a4f9d9cbac862a6f2be9ea3f19a4dd9da1810d980a5252e06482e79c7bf38"} Jul 24 13:44:27.469550 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:27.469527 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"83e86524-4fef-468f-9f50-fb75629c89f9","Type":"ContainerStarted","Data":"be88ca44b69f44996a0bbc179d31eec6093b4cf17a027700155fb6c971f440d0"} Jul 24 13:44:27.469637 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:27.469565 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"83e86524-4fef-468f-9f50-fb75629c89f9","Type":"ContainerStarted","Data":"b90f84f1b0c6a3e170a446748ae8415851ca04462dd9493decff9077d59c4ebc"} Jul 24 13:44:27.469637 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:27.469599 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"83e86524-4fef-468f-9f50-fb75629c89f9","Type":"ContainerStarted","Data":"96ad57f2496014ffd54597a7b955576a8554d1e5e0e93f1dcf50701e4c687c1f"} Jul 24 13:44:27.469637 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:27.469622 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"83e86524-4fef-468f-9f50-fb75629c89f9","Type":"ContainerStarted","Data":"6578acc7b6cf32f95e365f104b06354e730175fc34142d39338bbe9c0db38816"} Jul 24 13:44:27.470918 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:27.470899 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-n845m" event={"ID":"cb920d79-442e-4835-96ca-66a2c62e6fad","Type":"ContainerStarted","Data":"284078dcb14ba165e7624ddcbdcd8768d23207cc415f268eaf183b05d8ccbc43"} Jul 24 13:44:27.472928 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:27.472910 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-f89574b4f-wh9mj" event={"ID":"406823af-954f-446d-b47b-a71d3e709f17","Type":"ContainerStarted","Data":"209d9d15eda8bf561246b6681bee1d40fad4f67fe750bcff9c5fefffcfccb337"} Jul 24 13:44:27.473010 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:27.472946 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-f89574b4f-wh9mj" event={"ID":"406823af-954f-446d-b47b-a71d3e709f17","Type":"ContainerStarted","Data":"3af999b83005ebafb7e5cf42eb1ee811d127120237931e5fb6d791e1ad29b6b8"} Jul 24 13:44:27.473010 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:27.472965 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-f89574b4f-wh9mj" event={"ID":"406823af-954f-446d-b47b-a71d3e709f17","Type":"ContainerStarted","Data":"ce01214827ef61def64f25865a3c36954a05aa0bd248b31a1676bc9cb519dc55"} Jul 24 13:44:27.478518 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:27.478472 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-cdcvd" podStartSLOduration=4.137254345 podStartE2EDuration="11.47845555s" totalImagesPullingTime="7.341201205s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 13:44:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:44:27.476223689 +0000 UTC m=+75.134201071" watchObservedRunningTime="2026-07-24 13:44:27.47845555 +0000 UTC m=+75.136432935" Jul 24 13:44:27.493263 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:27.493212 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-n845m" podStartSLOduration=66.982925593 podStartE2EDuration="1m14.493195091s" totalImagesPullingTime="7.510269498s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 13:43:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:44:27.492999203 +0000 UTC m=+75.150976589" watchObservedRunningTime="2026-07-24 13:44:27.493195091 +0000 UTC m=+75.151172475" Jul 24 13:44:27.507122 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:27.507084 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-5jqwl" podStartSLOduration=67.34145555 podStartE2EDuration="1m14.507067335s" totalImagesPullingTime="7.165611785s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 13:43:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:44:27.506255453 +0000 UTC m=+75.164232838" watchObservedRunningTime="2026-07-24 13:44:27.507067335 +0000 UTC m=+75.165044698" Jul 24 13:44:27.527254 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:27.527211 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-f8gm6" podStartSLOduration=67.334782711 podStartE2EDuration="1m14.527197845s" totalImagesPullingTime="7.192415134s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 13:43:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:44:27.526835341 +0000 UTC m=+75.184812725" watchObservedRunningTime="2026-07-24 13:44:27.527197845 +0000 UTC m=+75.185175231" Jul 24 13:44:27.563575 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:27.563511 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-f89574b4f-wh9mj" podStartSLOduration=2.925602402 podStartE2EDuration="10.563490287s" totalImagesPullingTime="7.637887885s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 13:44:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:44:27.560220247 +0000 UTC m=+75.218197631" watchObservedRunningTime="2026-07-24 13:44:27.563490287 +0000 UTC m=+75.221467675" Jul 24 13:44:27.587917 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:27.587856 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.503919828 podStartE2EDuration="9.587837579s" totalImagesPullingTime="7.026320641s" totalInitContainerRuntime="57.59711ms" isStatefulPod=false podCreationTimestamp="2026-07-24 13:44:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:44:27.586298925 +0000 UTC m=+75.244276309" watchObservedRunningTime="2026-07-24 13:44:27.587837579 +0000 UTC m=+75.245814964" Jul 24 13:44:28.202501 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:28.202462 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-74cd5954f5-pswsk"] Jul 24 13:44:28.245440 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:28.245392 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-75d9687d6c-j9ns4"] Jul 24 13:44:28.276079 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:28.276055 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-75d9687d6c-j9ns4"] Jul 24 13:44:28.276225 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:28.276160 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75d9687d6c-j9ns4" Jul 24 13:44:28.378832 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:28.378784 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4e8099a9-2b87-472a-89a4-49befc2d2fc3-service-ca\") pod \"console-75d9687d6c-j9ns4\" (UID: \"4e8099a9-2b87-472a-89a4-49befc2d2fc3\") " pod="openshift-console/console-75d9687d6c-j9ns4" Jul 24 13:44:28.378995 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:28.378845 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4e8099a9-2b87-472a-89a4-49befc2d2fc3-console-oauth-config\") pod \"console-75d9687d6c-j9ns4\" (UID: \"4e8099a9-2b87-472a-89a4-49befc2d2fc3\") " pod="openshift-console/console-75d9687d6c-j9ns4" Jul 24 13:44:28.378995 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:28.378906 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4e8099a9-2b87-472a-89a4-49befc2d2fc3-console-serving-cert\") pod \"console-75d9687d6c-j9ns4\" (UID: \"4e8099a9-2b87-472a-89a4-49befc2d2fc3\") " pod="openshift-console/console-75d9687d6c-j9ns4" Jul 24 13:44:28.378995 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:28.378966 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4e8099a9-2b87-472a-89a4-49befc2d2fc3-console-config\") pod \"console-75d9687d6c-j9ns4\" (UID: \"4e8099a9-2b87-472a-89a4-49befc2d2fc3\") " pod="openshift-console/console-75d9687d6c-j9ns4" Jul 24 13:44:28.379089 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:28.379016 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4e8099a9-2b87-472a-89a4-49befc2d2fc3-oauth-serving-cert\") pod \"console-75d9687d6c-j9ns4\" (UID: \"4e8099a9-2b87-472a-89a4-49befc2d2fc3\") " pod="openshift-console/console-75d9687d6c-j9ns4" Jul 24 13:44:28.379089 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:28.379035 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-25g5n\" (UniqueName: \"kubernetes.io/projected/4e8099a9-2b87-472a-89a4-49befc2d2fc3-kube-api-access-25g5n\") pod \"console-75d9687d6c-j9ns4\" (UID: \"4e8099a9-2b87-472a-89a4-49befc2d2fc3\") " pod="openshift-console/console-75d9687d6c-j9ns4" Jul 24 13:44:28.379160 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:28.379145 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e8099a9-2b87-472a-89a4-49befc2d2fc3-trusted-ca-bundle\") pod \"console-75d9687d6c-j9ns4\" (UID: \"4e8099a9-2b87-472a-89a4-49befc2d2fc3\") " pod="openshift-console/console-75d9687d6c-j9ns4" Jul 24 13:44:28.447904 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:28.447869 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-74cd5954f5-pswsk" Jul 24 13:44:28.480325 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:28.480249 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e8099a9-2b87-472a-89a4-49befc2d2fc3-trusted-ca-bundle\") pod \"console-75d9687d6c-j9ns4\" (UID: \"4e8099a9-2b87-472a-89a4-49befc2d2fc3\") " pod="openshift-console/console-75d9687d6c-j9ns4" Jul 24 13:44:28.480888 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:28.480867 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4e8099a9-2b87-472a-89a4-49befc2d2fc3-service-ca\") pod \"console-75d9687d6c-j9ns4\" (UID: \"4e8099a9-2b87-472a-89a4-49befc2d2fc3\") " pod="openshift-console/console-75d9687d6c-j9ns4" Jul 24 13:44:28.481624 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:28.481603 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4e8099a9-2b87-472a-89a4-49befc2d2fc3-console-oauth-config\") pod \"console-75d9687d6c-j9ns4\" (UID: \"4e8099a9-2b87-472a-89a4-49befc2d2fc3\") " pod="openshift-console/console-75d9687d6c-j9ns4" Jul 24 13:44:28.481781 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:28.481766 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4e8099a9-2b87-472a-89a4-49befc2d2fc3-console-serving-cert\") pod \"console-75d9687d6c-j9ns4\" (UID: \"4e8099a9-2b87-472a-89a4-49befc2d2fc3\") " pod="openshift-console/console-75d9687d6c-j9ns4" Jul 24 13:44:28.481876 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:28.481864 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4e8099a9-2b87-472a-89a4-49befc2d2fc3-console-config\") pod \"console-75d9687d6c-j9ns4\" (UID: \"4e8099a9-2b87-472a-89a4-49befc2d2fc3\") " pod="openshift-console/console-75d9687d6c-j9ns4" Jul 24 13:44:28.481967 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:28.481956 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4e8099a9-2b87-472a-89a4-49befc2d2fc3-oauth-serving-cert\") pod \"console-75d9687d6c-j9ns4\" (UID: \"4e8099a9-2b87-472a-89a4-49befc2d2fc3\") " pod="openshift-console/console-75d9687d6c-j9ns4" Jul 24 13:44:28.482051 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:28.482039 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-25g5n\" (UniqueName: \"kubernetes.io/projected/4e8099a9-2b87-472a-89a4-49befc2d2fc3-kube-api-access-25g5n\") pod \"console-75d9687d6c-j9ns4\" (UID: \"4e8099a9-2b87-472a-89a4-49befc2d2fc3\") " pod="openshift-console/console-75d9687d6c-j9ns4" Jul 24 13:44:28.482117 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:28.481394 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e8099a9-2b87-472a-89a4-49befc2d2fc3-trusted-ca-bundle\") pod \"console-75d9687d6c-j9ns4\" (UID: \"4e8099a9-2b87-472a-89a4-49befc2d2fc3\") " pod="openshift-console/console-75d9687d6c-j9ns4" Jul 24 13:44:28.482169 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:28.481553 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4e8099a9-2b87-472a-89a4-49befc2d2fc3-service-ca\") pod \"console-75d9687d6c-j9ns4\" (UID: \"4e8099a9-2b87-472a-89a4-49befc2d2fc3\") " pod="openshift-console/console-75d9687d6c-j9ns4" Jul 24 13:44:28.482820 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:28.482796 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4e8099a9-2b87-472a-89a4-49befc2d2fc3-console-config\") pod \"console-75d9687d6c-j9ns4\" (UID: \"4e8099a9-2b87-472a-89a4-49befc2d2fc3\") " pod="openshift-console/console-75d9687d6c-j9ns4" Jul 24 13:44:28.483149 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:28.483127 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4e8099a9-2b87-472a-89a4-49befc2d2fc3-oauth-serving-cert\") pod \"console-75d9687d6c-j9ns4\" (UID: \"4e8099a9-2b87-472a-89a4-49befc2d2fc3\") " pod="openshift-console/console-75d9687d6c-j9ns4" Jul 24 13:44:28.484618 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:28.484596 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4e8099a9-2b87-472a-89a4-49befc2d2fc3-console-oauth-config\") pod \"console-75d9687d6c-j9ns4\" (UID: \"4e8099a9-2b87-472a-89a4-49befc2d2fc3\") " pod="openshift-console/console-75d9687d6c-j9ns4" Jul 24 13:44:28.485047 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:28.485031 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4e8099a9-2b87-472a-89a4-49befc2d2fc3-console-serving-cert\") pod \"console-75d9687d6c-j9ns4\" (UID: \"4e8099a9-2b87-472a-89a4-49befc2d2fc3\") " pod="openshift-console/console-75d9687d6c-j9ns4" Jul 24 13:44:28.489585 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:28.489563 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-25g5n\" (UniqueName: \"kubernetes.io/projected/4e8099a9-2b87-472a-89a4-49befc2d2fc3-kube-api-access-25g5n\") pod \"console-75d9687d6c-j9ns4\" (UID: \"4e8099a9-2b87-472a-89a4-49befc2d2fc3\") " pod="openshift-console/console-75d9687d6c-j9ns4" Jul 24 13:44:28.585828 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:28.585794 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75d9687d6c-j9ns4" Jul 24 13:44:28.662678 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:28.662562 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:44:28.755509 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:28.755485 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-75d9687d6c-j9ns4"] Jul 24 13:44:28.759466 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:44:28.759438 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e8099a9_2b87_472a_89a4_49befc2d2fc3.slice/crio-fcf53c7c0ff34ca82a229d171bebe1808d4f691004ed3c05422f9991cb906ae0 WatchSource:0}: Error finding container fcf53c7c0ff34ca82a229d171bebe1808d4f691004ed3c05422f9991cb906ae0: Status 404 returned error can't find the container with id fcf53c7c0ff34ca82a229d171bebe1808d4f691004ed3c05422f9991cb906ae0 Jul 24 13:44:29.483738 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:29.483695 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75d9687d6c-j9ns4" event={"ID":"4e8099a9-2b87-472a-89a4-49befc2d2fc3","Type":"ContainerStarted","Data":"66272280054d6d0008124a3cce55c2a538da621b19ce9033702dcd98b56665b7"} Jul 24 13:44:29.484131 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:29.483791 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75d9687d6c-j9ns4" event={"ID":"4e8099a9-2b87-472a-89a4-49befc2d2fc3","Type":"ContainerStarted","Data":"fcf53c7c0ff34ca82a229d171bebe1808d4f691004ed3c05422f9991cb906ae0"} Jul 24 13:44:29.499320 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:29.499256 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-75d9687d6c-j9ns4" podStartSLOduration=1.499239104 podStartE2EDuration="1.499239104s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 13:44:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:44:29.49850692 +0000 UTC m=+77.156484305" watchObservedRunningTime="2026-07-24 13:44:29.499239104 +0000 UTC m=+77.157216489" Jul 24 13:44:36.842655 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:36.842542 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-65b9c965dd-j9lg5" Jul 24 13:44:36.842655 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:36.842611 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-65b9c965dd-j9lg5" Jul 24 13:44:38.586364 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:38.586321 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-75d9687d6c-j9ns4" Jul 24 13:44:38.586871 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:38.586466 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-75d9687d6c-j9ns4" Jul 24 13:44:38.591099 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:38.591075 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-75d9687d6c-j9ns4" Jul 24 13:44:39.531118 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:39.531089 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-75d9687d6c-j9ns4" Jul 24 13:44:39.578476 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:39.578432 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-698c986d56-5hd2x"] Jul 24 13:44:41.487930 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:41.487888 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-67b4749744-k56g2" podUID="9a0379f3-a079-420c-a31b-9722b74f6c3f" containerName="console" containerID="cri-o://836bb2cd673ee578fc2771946ffcabc12215da2384f9b007995af43bae2ce1b9" gracePeriod=15 Jul 24 13:44:41.766023 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:41.765955 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67b4749744-k56g2" Jul 24 13:44:41.803577 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:41.803544 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9a0379f3-a079-420c-a31b-9722b74f6c3f-console-serving-cert\") pod \"9a0379f3-a079-420c-a31b-9722b74f6c3f\" (UID: \"9a0379f3-a079-420c-a31b-9722b74f6c3f\") " Jul 24 13:44:41.803761 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:41.803603 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9a0379f3-a079-420c-a31b-9722b74f6c3f-console-oauth-config\") pod \"9a0379f3-a079-420c-a31b-9722b74f6c3f\" (UID: \"9a0379f3-a079-420c-a31b-9722b74f6c3f\") " Jul 24 13:44:41.803761 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:41.803666 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9a0379f3-a079-420c-a31b-9722b74f6c3f-service-ca\") pod \"9a0379f3-a079-420c-a31b-9722b74f6c3f\" (UID: \"9a0379f3-a079-420c-a31b-9722b74f6c3f\") " Jul 24 13:44:41.803761 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:41.803709 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9a0379f3-a079-420c-a31b-9722b74f6c3f-oauth-serving-cert\") pod \"9a0379f3-a079-420c-a31b-9722b74f6c3f\" (UID: \"9a0379f3-a079-420c-a31b-9722b74f6c3f\") " Jul 24 13:44:41.803761 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:41.803748 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9a0379f3-a079-420c-a31b-9722b74f6c3f-console-config\") pod \"9a0379f3-a079-420c-a31b-9722b74f6c3f\" (UID: \"9a0379f3-a079-420c-a31b-9722b74f6c3f\") " Jul 24 13:44:41.803970 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:41.803790 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ppwn9\" (UniqueName: \"kubernetes.io/projected/9a0379f3-a079-420c-a31b-9722b74f6c3f-kube-api-access-ppwn9\") pod \"9a0379f3-a079-420c-a31b-9722b74f6c3f\" (UID: \"9a0379f3-a079-420c-a31b-9722b74f6c3f\") " Jul 24 13:44:41.804119 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:41.804065 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9a0379f3-a079-420c-a31b-9722b74f6c3f-service-ca" (OuterVolumeSpecName: "service-ca") pod "9a0379f3-a079-420c-a31b-9722b74f6c3f" (UID: "9a0379f3-a079-420c-a31b-9722b74f6c3f"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 13:44:41.804251 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:41.804123 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9a0379f3-a079-420c-a31b-9722b74f6c3f-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "9a0379f3-a079-420c-a31b-9722b74f6c3f" (UID: "9a0379f3-a079-420c-a31b-9722b74f6c3f"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 13:44:41.804251 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:41.804229 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9a0379f3-a079-420c-a31b-9722b74f6c3f-console-config" (OuterVolumeSpecName: "console-config") pod "9a0379f3-a079-420c-a31b-9722b74f6c3f" (UID: "9a0379f3-a079-420c-a31b-9722b74f6c3f"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 13:44:41.806186 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:41.806158 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a0379f3-a079-420c-a31b-9722b74f6c3f-kube-api-access-ppwn9" (OuterVolumeSpecName: "kube-api-access-ppwn9") pod "9a0379f3-a079-420c-a31b-9722b74f6c3f" (UID: "9a0379f3-a079-420c-a31b-9722b74f6c3f"). InnerVolumeSpecName "kube-api-access-ppwn9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 13:44:41.806335 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:41.806312 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9a0379f3-a079-420c-a31b-9722b74f6c3f-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "9a0379f3-a079-420c-a31b-9722b74f6c3f" (UID: "9a0379f3-a079-420c-a31b-9722b74f6c3f"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 13:44:41.806374 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:41.806345 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9a0379f3-a079-420c-a31b-9722b74f6c3f-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "9a0379f3-a079-420c-a31b-9722b74f6c3f" (UID: "9a0379f3-a079-420c-a31b-9722b74f6c3f"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 13:44:41.905026 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:41.904988 2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9a0379f3-a079-420c-a31b-9722b74f6c3f-service-ca\") on node \"ip-10-0-129-93.ec2.internal\" DevicePath \"\"" Jul 24 13:44:41.905026 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:41.905019 2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9a0379f3-a079-420c-a31b-9722b74f6c3f-oauth-serving-cert\") on node \"ip-10-0-129-93.ec2.internal\" DevicePath \"\"" Jul 24 13:44:41.905026 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:41.905029 2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9a0379f3-a079-420c-a31b-9722b74f6c3f-console-config\") on node \"ip-10-0-129-93.ec2.internal\" DevicePath \"\"" Jul 24 13:44:41.905026 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:41.905038 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ppwn9\" (UniqueName: \"kubernetes.io/projected/9a0379f3-a079-420c-a31b-9722b74f6c3f-kube-api-access-ppwn9\") on node \"ip-10-0-129-93.ec2.internal\" DevicePath \"\"" Jul 24 13:44:41.905294 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:41.905047 2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9a0379f3-a079-420c-a31b-9722b74f6c3f-console-serving-cert\") on node \"ip-10-0-129-93.ec2.internal\" DevicePath \"\"" Jul 24 13:44:41.905294 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:41.905057 2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9a0379f3-a079-420c-a31b-9722b74f6c3f-console-oauth-config\") on node \"ip-10-0-129-93.ec2.internal\" DevicePath \"\"" Jul 24 13:44:42.543858 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:42.543825 2578 generic.go:356] "Generic (PLEG): container finished" podID="9a0379f3-a079-420c-a31b-9722b74f6c3f" containerID="836bb2cd673ee578fc2771946ffcabc12215da2384f9b007995af43bae2ce1b9" exitCode=0 Jul 24 13:44:42.544217 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:42.543887 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67b4749744-k56g2" Jul 24 13:44:42.544217 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:42.543902 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67b4749744-k56g2" event={"ID":"9a0379f3-a079-420c-a31b-9722b74f6c3f","Type":"ContainerDied","Data":"836bb2cd673ee578fc2771946ffcabc12215da2384f9b007995af43bae2ce1b9"} Jul 24 13:44:42.544217 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:42.543974 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67b4749744-k56g2" event={"ID":"9a0379f3-a079-420c-a31b-9722b74f6c3f","Type":"ContainerDied","Data":"5dcd1437466f599a9b2e2dd854e5300813ec0dd079eff642eef523317e93c380"} Jul 24 13:44:42.544217 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:42.543995 2578 scope.go:117] "RemoveContainer" containerID="836bb2cd673ee578fc2771946ffcabc12215da2384f9b007995af43bae2ce1b9" Jul 24 13:44:42.552665 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:42.552649 2578 scope.go:117] "RemoveContainer" containerID="836bb2cd673ee578fc2771946ffcabc12215da2384f9b007995af43bae2ce1b9" Jul 24 13:44:42.552903 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:44:42.552886 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"836bb2cd673ee578fc2771946ffcabc12215da2384f9b007995af43bae2ce1b9\": container with ID starting with 836bb2cd673ee578fc2771946ffcabc12215da2384f9b007995af43bae2ce1b9 not found: ID does not exist" containerID="836bb2cd673ee578fc2771946ffcabc12215da2384f9b007995af43bae2ce1b9" Jul 24 13:44:42.552940 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:42.552910 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"836bb2cd673ee578fc2771946ffcabc12215da2384f9b007995af43bae2ce1b9"} err="failed to get container status \"836bb2cd673ee578fc2771946ffcabc12215da2384f9b007995af43bae2ce1b9\": rpc error: code = NotFound desc = could not find container \"836bb2cd673ee578fc2771946ffcabc12215da2384f9b007995af43bae2ce1b9\": container with ID starting with 836bb2cd673ee578fc2771946ffcabc12215da2384f9b007995af43bae2ce1b9 not found: ID does not exist" Jul 24 13:44:42.563115 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:42.563093 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-67b4749744-k56g2"] Jul 24 13:44:42.565304 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:42.565282 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-67b4749744-k56g2"] Jul 24 13:44:42.919796 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:42.919766 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9a0379f3-a079-420c-a31b-9722b74f6c3f" path="/var/lib/kubelet/pods/9a0379f3-a079-420c-a31b-9722b74f6c3f/volumes" Jul 24 13:44:53.222536 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:53.222473 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-74cd5954f5-pswsk" podUID="f17d7b72-b345-4430-a8e0-a4c01424f48d" containerName="console" containerID="cri-o://27b23dffab1fe7ea264c0a4184054cbf9536be8b53c2718be52f6e5eb4339538" gracePeriod=15 Jul 24 13:44:53.485517 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:53.485459 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74cd5954f5-pswsk" Jul 24 13:44:53.593948 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:53.593920 2578 generic.go:356] "Generic (PLEG): container finished" podID="f17d7b72-b345-4430-a8e0-a4c01424f48d" containerID="27b23dffab1fe7ea264c0a4184054cbf9536be8b53c2718be52f6e5eb4339538" exitCode=0 Jul 24 13:44:53.594126 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:53.593958 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74cd5954f5-pswsk" event={"ID":"f17d7b72-b345-4430-a8e0-a4c01424f48d","Type":"ContainerDied","Data":"27b23dffab1fe7ea264c0a4184054cbf9536be8b53c2718be52f6e5eb4339538"} Jul 24 13:44:53.594126 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:53.593964 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74cd5954f5-pswsk" Jul 24 13:44:53.594126 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:53.593993 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74cd5954f5-pswsk" event={"ID":"f17d7b72-b345-4430-a8e0-a4c01424f48d","Type":"ContainerDied","Data":"e8678df43cb15f08df138eb9a866b9d8ac062b221a175a1c2550be92592a236c"} Jul 24 13:44:53.594126 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:53.594013 2578 scope.go:117] "RemoveContainer" containerID="27b23dffab1fe7ea264c0a4184054cbf9536be8b53c2718be52f6e5eb4339538" Jul 24 13:44:53.602111 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:53.602095 2578 scope.go:117] "RemoveContainer" containerID="27b23dffab1fe7ea264c0a4184054cbf9536be8b53c2718be52f6e5eb4339538" Jul 24 13:44:53.602375 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:44:53.602352 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"27b23dffab1fe7ea264c0a4184054cbf9536be8b53c2718be52f6e5eb4339538\": container with ID starting with 27b23dffab1fe7ea264c0a4184054cbf9536be8b53c2718be52f6e5eb4339538 not found: ID does not exist" containerID="27b23dffab1fe7ea264c0a4184054cbf9536be8b53c2718be52f6e5eb4339538" Jul 24 13:44:53.602488 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:53.602385 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"27b23dffab1fe7ea264c0a4184054cbf9536be8b53c2718be52f6e5eb4339538"} err="failed to get container status \"27b23dffab1fe7ea264c0a4184054cbf9536be8b53c2718be52f6e5eb4339538\": rpc error: code = NotFound desc = could not find container \"27b23dffab1fe7ea264c0a4184054cbf9536be8b53c2718be52f6e5eb4339538\": container with ID starting with 27b23dffab1fe7ea264c0a4184054cbf9536be8b53c2718be52f6e5eb4339538 not found: ID does not exist" Jul 24 13:44:53.606656 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:53.606640 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f17d7b72-b345-4430-a8e0-a4c01424f48d-oauth-serving-cert\") pod \"f17d7b72-b345-4430-a8e0-a4c01424f48d\" (UID: \"f17d7b72-b345-4430-a8e0-a4c01424f48d\") " Jul 24 13:44:53.606711 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:53.606680 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f17d7b72-b345-4430-a8e0-a4c01424f48d-service-ca\") pod \"f17d7b72-b345-4430-a8e0-a4c01424f48d\" (UID: \"f17d7b72-b345-4430-a8e0-a4c01424f48d\") " Jul 24 13:44:53.606748 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:53.606723 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z92wr\" (UniqueName: \"kubernetes.io/projected/f17d7b72-b345-4430-a8e0-a4c01424f48d-kube-api-access-z92wr\") pod \"f17d7b72-b345-4430-a8e0-a4c01424f48d\" (UID: \"f17d7b72-b345-4430-a8e0-a4c01424f48d\") " Jul 24 13:44:53.606782 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:53.606749 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f17d7b72-b345-4430-a8e0-a4c01424f48d-console-serving-cert\") pod \"f17d7b72-b345-4430-a8e0-a4c01424f48d\" (UID: \"f17d7b72-b345-4430-a8e0-a4c01424f48d\") " Jul 24 13:44:53.606825 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:53.606784 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f17d7b72-b345-4430-a8e0-a4c01424f48d-console-oauth-config\") pod \"f17d7b72-b345-4430-a8e0-a4c01424f48d\" (UID: \"f17d7b72-b345-4430-a8e0-a4c01424f48d\") " Jul 24 13:44:53.606825 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:53.606811 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f17d7b72-b345-4430-a8e0-a4c01424f48d-console-config\") pod \"f17d7b72-b345-4430-a8e0-a4c01424f48d\" (UID: \"f17d7b72-b345-4430-a8e0-a4c01424f48d\") " Jul 24 13:44:53.606920 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:53.606846 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f17d7b72-b345-4430-a8e0-a4c01424f48d-trusted-ca-bundle\") pod \"f17d7b72-b345-4430-a8e0-a4c01424f48d\" (UID: \"f17d7b72-b345-4430-a8e0-a4c01424f48d\") " Jul 24 13:44:53.607037 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:53.607010 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f17d7b72-b345-4430-a8e0-a4c01424f48d-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "f17d7b72-b345-4430-a8e0-a4c01424f48d" (UID: "f17d7b72-b345-4430-a8e0-a4c01424f48d"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 13:44:53.607191 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:53.607117 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f17d7b72-b345-4430-a8e0-a4c01424f48d-service-ca" (OuterVolumeSpecName: "service-ca") pod "f17d7b72-b345-4430-a8e0-a4c01424f48d" (UID: "f17d7b72-b345-4430-a8e0-a4c01424f48d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 13:44:53.607269 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:53.607216 2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f17d7b72-b345-4430-a8e0-a4c01424f48d-service-ca\") on node \"ip-10-0-129-93.ec2.internal\" DevicePath \"\"" Jul 24 13:44:53.607269 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:53.607237 2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f17d7b72-b345-4430-a8e0-a4c01424f48d-oauth-serving-cert\") on node \"ip-10-0-129-93.ec2.internal\" DevicePath \"\"" Jul 24 13:44:53.607269 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:53.607217 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f17d7b72-b345-4430-a8e0-a4c01424f48d-console-config" (OuterVolumeSpecName: "console-config") pod "f17d7b72-b345-4430-a8e0-a4c01424f48d" (UID: "f17d7b72-b345-4430-a8e0-a4c01424f48d"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 13:44:53.607533 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:53.607477 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f17d7b72-b345-4430-a8e0-a4c01424f48d-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "f17d7b72-b345-4430-a8e0-a4c01424f48d" (UID: "f17d7b72-b345-4430-a8e0-a4c01424f48d"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 13:44:53.609010 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:53.608989 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f17d7b72-b345-4430-a8e0-a4c01424f48d-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "f17d7b72-b345-4430-a8e0-a4c01424f48d" (UID: "f17d7b72-b345-4430-a8e0-a4c01424f48d"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 13:44:53.609339 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:53.609307 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f17d7b72-b345-4430-a8e0-a4c01424f48d-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "f17d7b72-b345-4430-a8e0-a4c01424f48d" (UID: "f17d7b72-b345-4430-a8e0-a4c01424f48d"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 13:44:53.609472 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:53.609338 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f17d7b72-b345-4430-a8e0-a4c01424f48d-kube-api-access-z92wr" (OuterVolumeSpecName: "kube-api-access-z92wr") pod "f17d7b72-b345-4430-a8e0-a4c01424f48d" (UID: "f17d7b72-b345-4430-a8e0-a4c01424f48d"). InnerVolumeSpecName "kube-api-access-z92wr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 13:44:53.708475 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:53.708434 2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f17d7b72-b345-4430-a8e0-a4c01424f48d-console-serving-cert\") on node \"ip-10-0-129-93.ec2.internal\" DevicePath \"\"" Jul 24 13:44:53.708475 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:53.708468 2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f17d7b72-b345-4430-a8e0-a4c01424f48d-console-oauth-config\") on node \"ip-10-0-129-93.ec2.internal\" DevicePath \"\"" Jul 24 13:44:53.708475 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:53.708478 2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f17d7b72-b345-4430-a8e0-a4c01424f48d-console-config\") on node \"ip-10-0-129-93.ec2.internal\" DevicePath \"\"" Jul 24 13:44:53.708700 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:53.708487 2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f17d7b72-b345-4430-a8e0-a4c01424f48d-trusted-ca-bundle\") on node \"ip-10-0-129-93.ec2.internal\" DevicePath \"\"" Jul 24 13:44:53.708700 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:53.708498 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z92wr\" (UniqueName: \"kubernetes.io/projected/f17d7b72-b345-4430-a8e0-a4c01424f48d-kube-api-access-z92wr\") on node \"ip-10-0-129-93.ec2.internal\" DevicePath \"\"" Jul 24 13:44:53.915190 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:53.915156 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-74cd5954f5-pswsk"] Jul 24 13:44:53.918976 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:53.918947 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-74cd5954f5-pswsk"] Jul 24 13:44:54.922846 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:54.922803 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f17d7b72-b345-4430-a8e0-a4c01424f48d" path="/var/lib/kubelet/pods/f17d7b72-b345-4430-a8e0-a4c01424f48d/volumes" Jul 24 13:44:56.846902 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:56.846870 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-65b9c965dd-j9lg5" Jul 24 13:44:56.850769 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:56.850747 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-65b9c965dd-j9lg5" Jul 24 13:44:58.481049 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:44:58.481023 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-5jqwl" Jul 24 13:45:04.597979 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:04.597911 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-698c986d56-5hd2x" podUID="dbfee0b6-4cc6-48ab-a5d4-d9d3810a7947" containerName="console" containerID="cri-o://7886ebf1a1a3e3c197fca2c4c8f53bfa6de3be2f80517d3b84ae75681f3eaef1" gracePeriod=15 Jul 24 13:45:04.873921 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:04.873843 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-698c986d56-5hd2x" Jul 24 13:45:05.032091 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:05.032051 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dbfee0b6-4cc6-48ab-a5d4-d9d3810a7947-console-config\") pod \"dbfee0b6-4cc6-48ab-a5d4-d9d3810a7947\" (UID: \"dbfee0b6-4cc6-48ab-a5d4-d9d3810a7947\") " Jul 24 13:45:05.033604 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:05.032763 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dbfee0b6-4cc6-48ab-a5d4-d9d3810a7947-service-ca\") pod \"dbfee0b6-4cc6-48ab-a5d4-d9d3810a7947\" (UID: \"dbfee0b6-4cc6-48ab-a5d4-d9d3810a7947\") " Jul 24 13:45:05.033604 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:05.032816 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dbfee0b6-4cc6-48ab-a5d4-d9d3810a7947-oauth-serving-cert\") pod \"dbfee0b6-4cc6-48ab-a5d4-d9d3810a7947\" (UID: \"dbfee0b6-4cc6-48ab-a5d4-d9d3810a7947\") " Jul 24 13:45:05.033604 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:05.032844 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dbfee0b6-4cc6-48ab-a5d4-d9d3810a7947-trusted-ca-bundle\") pod \"dbfee0b6-4cc6-48ab-a5d4-d9d3810a7947\" (UID: \"dbfee0b6-4cc6-48ab-a5d4-d9d3810a7947\") " Jul 24 13:45:05.033604 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:05.032899 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dbfee0b6-4cc6-48ab-a5d4-d9d3810a7947-console-oauth-config\") pod \"dbfee0b6-4cc6-48ab-a5d4-d9d3810a7947\" (UID: \"dbfee0b6-4cc6-48ab-a5d4-d9d3810a7947\") " Jul 24 13:45:05.033604 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:05.032935 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dbfee0b6-4cc6-48ab-a5d4-d9d3810a7947-console-serving-cert\") pod \"dbfee0b6-4cc6-48ab-a5d4-d9d3810a7947\" (UID: \"dbfee0b6-4cc6-48ab-a5d4-d9d3810a7947\") " Jul 24 13:45:05.033604 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:05.032970 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-57t2m\" (UniqueName: \"kubernetes.io/projected/dbfee0b6-4cc6-48ab-a5d4-d9d3810a7947-kube-api-access-57t2m\") pod \"dbfee0b6-4cc6-48ab-a5d4-d9d3810a7947\" (UID: \"dbfee0b6-4cc6-48ab-a5d4-d9d3810a7947\") " Jul 24 13:45:05.034805 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:05.032668 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dbfee0b6-4cc6-48ab-a5d4-d9d3810a7947-console-config" (OuterVolumeSpecName: "console-config") pod "dbfee0b6-4cc6-48ab-a5d4-d9d3810a7947" (UID: "dbfee0b6-4cc6-48ab-a5d4-d9d3810a7947"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 13:45:05.034805 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:05.034262 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dbfee0b6-4cc6-48ab-a5d4-d9d3810a7947-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "dbfee0b6-4cc6-48ab-a5d4-d9d3810a7947" (UID: "dbfee0b6-4cc6-48ab-a5d4-d9d3810a7947"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 13:45:05.034805 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:05.034553 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dbfee0b6-4cc6-48ab-a5d4-d9d3810a7947-service-ca" (OuterVolumeSpecName: "service-ca") pod "dbfee0b6-4cc6-48ab-a5d4-d9d3810a7947" (UID: "dbfee0b6-4cc6-48ab-a5d4-d9d3810a7947"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 13:45:05.036540 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:05.036343 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dbfee0b6-4cc6-48ab-a5d4-d9d3810a7947-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "dbfee0b6-4cc6-48ab-a5d4-d9d3810a7947" (UID: "dbfee0b6-4cc6-48ab-a5d4-d9d3810a7947"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 13:45:05.043655 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:05.043610 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dbfee0b6-4cc6-48ab-a5d4-d9d3810a7947-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "dbfee0b6-4cc6-48ab-a5d4-d9d3810a7947" (UID: "dbfee0b6-4cc6-48ab-a5d4-d9d3810a7947"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 13:45:05.045703 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:05.045678 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dbfee0b6-4cc6-48ab-a5d4-d9d3810a7947-kube-api-access-57t2m" (OuterVolumeSpecName: "kube-api-access-57t2m") pod "dbfee0b6-4cc6-48ab-a5d4-d9d3810a7947" (UID: "dbfee0b6-4cc6-48ab-a5d4-d9d3810a7947"). InnerVolumeSpecName "kube-api-access-57t2m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 13:45:05.047330 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:05.047311 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dbfee0b6-4cc6-48ab-a5d4-d9d3810a7947-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "dbfee0b6-4cc6-48ab-a5d4-d9d3810a7947" (UID: "dbfee0b6-4cc6-48ab-a5d4-d9d3810a7947"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 13:45:05.134768 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:05.134693 2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dbfee0b6-4cc6-48ab-a5d4-d9d3810a7947-console-config\") on node \"ip-10-0-129-93.ec2.internal\" DevicePath \"\"" Jul 24 13:45:05.134768 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:05.134722 2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dbfee0b6-4cc6-48ab-a5d4-d9d3810a7947-service-ca\") on node \"ip-10-0-129-93.ec2.internal\" DevicePath \"\"" Jul 24 13:45:05.134768 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:05.134731 2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dbfee0b6-4cc6-48ab-a5d4-d9d3810a7947-oauth-serving-cert\") on node \"ip-10-0-129-93.ec2.internal\" DevicePath \"\"" Jul 24 13:45:05.134768 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:05.134740 2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dbfee0b6-4cc6-48ab-a5d4-d9d3810a7947-trusted-ca-bundle\") on node \"ip-10-0-129-93.ec2.internal\" DevicePath \"\"" Jul 24 13:45:05.134768 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:05.134751 2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dbfee0b6-4cc6-48ab-a5d4-d9d3810a7947-console-oauth-config\") on node \"ip-10-0-129-93.ec2.internal\" DevicePath \"\"" Jul 24 13:45:05.134768 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:05.134759 2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dbfee0b6-4cc6-48ab-a5d4-d9d3810a7947-console-serving-cert\") on node \"ip-10-0-129-93.ec2.internal\" DevicePath \"\"" Jul 24 13:45:05.134768 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:05.134767 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-57t2m\" (UniqueName: \"kubernetes.io/projected/dbfee0b6-4cc6-48ab-a5d4-d9d3810a7947-kube-api-access-57t2m\") on node \"ip-10-0-129-93.ec2.internal\" DevicePath \"\"" Jul 24 13:45:05.648809 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:05.648768 2578 generic.go:356] "Generic (PLEG): container finished" podID="dbfee0b6-4cc6-48ab-a5d4-d9d3810a7947" containerID="7886ebf1a1a3e3c197fca2c4c8f53bfa6de3be2f80517d3b84ae75681f3eaef1" exitCode=0 Jul 24 13:45:05.649217 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:05.648874 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-698c986d56-5hd2x" event={"ID":"dbfee0b6-4cc6-48ab-a5d4-d9d3810a7947","Type":"ContainerDied","Data":"7886ebf1a1a3e3c197fca2c4c8f53bfa6de3be2f80517d3b84ae75681f3eaef1"} Jul 24 13:45:05.649217 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:05.648888 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-698c986d56-5hd2x" Jul 24 13:45:05.649217 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:05.648933 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-698c986d56-5hd2x" event={"ID":"dbfee0b6-4cc6-48ab-a5d4-d9d3810a7947","Type":"ContainerDied","Data":"b4619fcb78e346cfc252a3befc96d4a0434fc916a7ae89bba38d3d50a45d8ae7"} Jul 24 13:45:05.649217 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:05.648965 2578 scope.go:117] "RemoveContainer" containerID="7886ebf1a1a3e3c197fca2c4c8f53bfa6de3be2f80517d3b84ae75681f3eaef1" Jul 24 13:45:05.657683 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:05.657659 2578 scope.go:117] "RemoveContainer" containerID="7886ebf1a1a3e3c197fca2c4c8f53bfa6de3be2f80517d3b84ae75681f3eaef1" Jul 24 13:45:05.658049 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:45:05.658023 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7886ebf1a1a3e3c197fca2c4c8f53bfa6de3be2f80517d3b84ae75681f3eaef1\": container with ID starting with 7886ebf1a1a3e3c197fca2c4c8f53bfa6de3be2f80517d3b84ae75681f3eaef1 not found: ID does not exist" containerID="7886ebf1a1a3e3c197fca2c4c8f53bfa6de3be2f80517d3b84ae75681f3eaef1" Jul 24 13:45:05.658146 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:05.658056 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7886ebf1a1a3e3c197fca2c4c8f53bfa6de3be2f80517d3b84ae75681f3eaef1"} err="failed to get container status \"7886ebf1a1a3e3c197fca2c4c8f53bfa6de3be2f80517d3b84ae75681f3eaef1\": rpc error: code = NotFound desc = could not find container \"7886ebf1a1a3e3c197fca2c4c8f53bfa6de3be2f80517d3b84ae75681f3eaef1\": container with ID starting with 7886ebf1a1a3e3c197fca2c4c8f53bfa6de3be2f80517d3b84ae75681f3eaef1 not found: ID does not exist" Jul 24 13:45:05.671899 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:05.671868 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-698c986d56-5hd2x"] Jul 24 13:45:05.673624 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:05.673569 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-698c986d56-5hd2x"] Jul 24 13:45:06.920710 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:06.920676 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dbfee0b6-4cc6-48ab-a5d4-d9d3810a7947" path="/var/lib/kubelet/pods/dbfee0b6-4cc6-48ab-a5d4-d9d3810a7947/volumes" Jul 24 13:45:18.661455 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:18.661394 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:45:18.681208 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:18.681166 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:45:18.719148 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:18.719121 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:45:32.415696 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:32.415660 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 24 13:45:32.416662 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:32.416609 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="64f1b2c7-305c-44bc-b2c6-6080196f5269" containerName="alertmanager" containerID="cri-o://8950f65524f53aff7e1b6472fd13a30d2f04c41bfe1b3b42b0828d682f03a913" gracePeriod=120 Jul 24 13:45:32.417222 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:32.416831 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="64f1b2c7-305c-44bc-b2c6-6080196f5269" containerName="kube-rbac-proxy-web" containerID="cri-o://dc0090f7685cc6b06f80d07527147a14208e6009eb48d61da1f30941ed96a2c0" gracePeriod=120 Jul 24 13:45:32.417428 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:32.416867 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="64f1b2c7-305c-44bc-b2c6-6080196f5269" containerName="kube-rbac-proxy" containerID="cri-o://1a9b6d9fd9bf3a3d14467bbca6b3c583d40762ab4b96b331cf9081b75d8955b4" gracePeriod=120 Jul 24 13:45:32.417428 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:32.417076 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="64f1b2c7-305c-44bc-b2c6-6080196f5269" containerName="config-reloader" containerID="cri-o://4f39cb2e92be863e594e49efb8f02050b94606e4929ab948ace9e4056cd22b80" gracePeriod=120 Jul 24 13:45:32.417428 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:32.417122 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="64f1b2c7-305c-44bc-b2c6-6080196f5269" containerName="prom-label-proxy" containerID="cri-o://e7b45e6eca0c2e9c324d85e3056115dd0b1aa2a2265b6c009e8d794e96b3d62f" gracePeriod=120 Jul 24 13:45:32.417428 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:32.417133 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="64f1b2c7-305c-44bc-b2c6-6080196f5269" containerName="kube-rbac-proxy-metric" containerID="cri-o://582a87136659b862324938f73ac20608ce5bd1cee3f7f6f3263230bce58ccc88" gracePeriod=120 Jul 24 13:45:32.762433 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:32.762330 2578 generic.go:356] "Generic (PLEG): container finished" podID="64f1b2c7-305c-44bc-b2c6-6080196f5269" containerID="e7b45e6eca0c2e9c324d85e3056115dd0b1aa2a2265b6c009e8d794e96b3d62f" exitCode=0 Jul 24 13:45:32.762433 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:32.762354 2578 generic.go:356] "Generic (PLEG): container finished" podID="64f1b2c7-305c-44bc-b2c6-6080196f5269" containerID="1a9b6d9fd9bf3a3d14467bbca6b3c583d40762ab4b96b331cf9081b75d8955b4" exitCode=0 Jul 24 13:45:32.762433 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:32.762362 2578 generic.go:356] "Generic (PLEG): container finished" podID="64f1b2c7-305c-44bc-b2c6-6080196f5269" containerID="4f39cb2e92be863e594e49efb8f02050b94606e4929ab948ace9e4056cd22b80" exitCode=0 Jul 24 13:45:32.762433 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:32.762367 2578 generic.go:356] "Generic (PLEG): container finished" podID="64f1b2c7-305c-44bc-b2c6-6080196f5269" containerID="8950f65524f53aff7e1b6472fd13a30d2f04c41bfe1b3b42b0828d682f03a913" exitCode=0 Jul 24 13:45:32.762433 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:32.762396 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"64f1b2c7-305c-44bc-b2c6-6080196f5269","Type":"ContainerDied","Data":"e7b45e6eca0c2e9c324d85e3056115dd0b1aa2a2265b6c009e8d794e96b3d62f"} Jul 24 13:45:32.762722 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:32.762481 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"64f1b2c7-305c-44bc-b2c6-6080196f5269","Type":"ContainerDied","Data":"1a9b6d9fd9bf3a3d14467bbca6b3c583d40762ab4b96b331cf9081b75d8955b4"} Jul 24 13:45:32.762722 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:32.762510 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"64f1b2c7-305c-44bc-b2c6-6080196f5269","Type":"ContainerDied","Data":"4f39cb2e92be863e594e49efb8f02050b94606e4929ab948ace9e4056cd22b80"} Jul 24 13:45:32.762722 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:32.762535 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"64f1b2c7-305c-44bc-b2c6-6080196f5269","Type":"ContainerDied","Data":"8950f65524f53aff7e1b6472fd13a30d2f04c41bfe1b3b42b0828d682f03a913"} Jul 24 13:45:33.664302 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:33.664269 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 24 13:45:33.769967 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:33.769878 2578 generic.go:356] "Generic (PLEG): container finished" podID="64f1b2c7-305c-44bc-b2c6-6080196f5269" containerID="582a87136659b862324938f73ac20608ce5bd1cee3f7f6f3263230bce58ccc88" exitCode=0 Jul 24 13:45:33.769967 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:33.769902 2578 generic.go:356] "Generic (PLEG): container finished" podID="64f1b2c7-305c-44bc-b2c6-6080196f5269" containerID="dc0090f7685cc6b06f80d07527147a14208e6009eb48d61da1f30941ed96a2c0" exitCode=0 Jul 24 13:45:33.769967 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:33.769940 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"64f1b2c7-305c-44bc-b2c6-6080196f5269","Type":"ContainerDied","Data":"582a87136659b862324938f73ac20608ce5bd1cee3f7f6f3263230bce58ccc88"} Jul 24 13:45:33.770205 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:33.769954 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 24 13:45:33.770205 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:33.770067 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"64f1b2c7-305c-44bc-b2c6-6080196f5269","Type":"ContainerDied","Data":"dc0090f7685cc6b06f80d07527147a14208e6009eb48d61da1f30941ed96a2c0"} Jul 24 13:45:33.770205 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:33.770111 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"64f1b2c7-305c-44bc-b2c6-6080196f5269","Type":"ContainerDied","Data":"a1808673252eff176f7b1f051c2bc7e40201cf651c9c7c9e382decfc35c5be10"} Jul 24 13:45:33.770205 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:33.770127 2578 scope.go:117] "RemoveContainer" containerID="e7b45e6eca0c2e9c324d85e3056115dd0b1aa2a2265b6c009e8d794e96b3d62f" Jul 24 13:45:33.775435 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:33.775398 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/64f1b2c7-305c-44bc-b2c6-6080196f5269-config-volume\") pod \"64f1b2c7-305c-44bc-b2c6-6080196f5269\" (UID: \"64f1b2c7-305c-44bc-b2c6-6080196f5269\") " Jul 24 13:45:33.775560 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:33.775454 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/64f1b2c7-305c-44bc-b2c6-6080196f5269-alertmanager-trusted-ca-bundle\") pod \"64f1b2c7-305c-44bc-b2c6-6080196f5269\" (UID: \"64f1b2c7-305c-44bc-b2c6-6080196f5269\") " Jul 24 13:45:33.775560 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:33.775486 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/64f1b2c7-305c-44bc-b2c6-6080196f5269-web-config\") pod \"64f1b2c7-305c-44bc-b2c6-6080196f5269\" (UID: \"64f1b2c7-305c-44bc-b2c6-6080196f5269\") " Jul 24 13:45:33.775560 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:33.775530 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/64f1b2c7-305c-44bc-b2c6-6080196f5269-secret-alertmanager-kube-rbac-proxy-web\") pod \"64f1b2c7-305c-44bc-b2c6-6080196f5269\" (UID: \"64f1b2c7-305c-44bc-b2c6-6080196f5269\") " Jul 24 13:45:33.775722 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:33.775570 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/64f1b2c7-305c-44bc-b2c6-6080196f5269-config-out\") pod \"64f1b2c7-305c-44bc-b2c6-6080196f5269\" (UID: \"64f1b2c7-305c-44bc-b2c6-6080196f5269\") " Jul 24 13:45:33.775777 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:33.775728 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2jjh7\" (UniqueName: \"kubernetes.io/projected/64f1b2c7-305c-44bc-b2c6-6080196f5269-kube-api-access-2jjh7\") pod \"64f1b2c7-305c-44bc-b2c6-6080196f5269\" (UID: \"64f1b2c7-305c-44bc-b2c6-6080196f5269\") " Jul 24 13:45:33.775833 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:33.775777 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/64f1b2c7-305c-44bc-b2c6-6080196f5269-secret-alertmanager-main-tls\") pod \"64f1b2c7-305c-44bc-b2c6-6080196f5269\" (UID: \"64f1b2c7-305c-44bc-b2c6-6080196f5269\") " Jul 24 13:45:33.775833 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:33.775805 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/64f1b2c7-305c-44bc-b2c6-6080196f5269-cluster-tls-config\") pod \"64f1b2c7-305c-44bc-b2c6-6080196f5269\" (UID: \"64f1b2c7-305c-44bc-b2c6-6080196f5269\") " Jul 24 13:45:33.775947 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:33.775847 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/64f1b2c7-305c-44bc-b2c6-6080196f5269-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "64f1b2c7-305c-44bc-b2c6-6080196f5269" (UID: "64f1b2c7-305c-44bc-b2c6-6080196f5269"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 13:45:33.775947 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:33.775860 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/64f1b2c7-305c-44bc-b2c6-6080196f5269-secret-alertmanager-kube-rbac-proxy\") pod \"64f1b2c7-305c-44bc-b2c6-6080196f5269\" (UID: \"64f1b2c7-305c-44bc-b2c6-6080196f5269\") " Jul 24 13:45:33.775947 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:33.775892 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/64f1b2c7-305c-44bc-b2c6-6080196f5269-alertmanager-main-db\") pod \"64f1b2c7-305c-44bc-b2c6-6080196f5269\" (UID: \"64f1b2c7-305c-44bc-b2c6-6080196f5269\") " Jul 24 13:45:33.775947 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:33.775925 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/64f1b2c7-305c-44bc-b2c6-6080196f5269-secret-alertmanager-kube-rbac-proxy-metric\") pod \"64f1b2c7-305c-44bc-b2c6-6080196f5269\" (UID: \"64f1b2c7-305c-44bc-b2c6-6080196f5269\") " Jul 24 13:45:33.776148 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:33.775961 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/64f1b2c7-305c-44bc-b2c6-6080196f5269-metrics-client-ca\") pod \"64f1b2c7-305c-44bc-b2c6-6080196f5269\" (UID: \"64f1b2c7-305c-44bc-b2c6-6080196f5269\") " Jul 24 13:45:33.776148 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:33.776030 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/64f1b2c7-305c-44bc-b2c6-6080196f5269-tls-assets\") pod \"64f1b2c7-305c-44bc-b2c6-6080196f5269\" (UID: \"64f1b2c7-305c-44bc-b2c6-6080196f5269\") " Jul 24 13:45:33.776587 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:33.776342 2578 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/64f1b2c7-305c-44bc-b2c6-6080196f5269-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-129-93.ec2.internal\" DevicePath \"\"" Jul 24 13:45:33.776703 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:33.776683 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64f1b2c7-305c-44bc-b2c6-6080196f5269-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "64f1b2c7-305c-44bc-b2c6-6080196f5269" (UID: "64f1b2c7-305c-44bc-b2c6-6080196f5269"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 13:45:33.777458 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:33.777398 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/64f1b2c7-305c-44bc-b2c6-6080196f5269-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "64f1b2c7-305c-44bc-b2c6-6080196f5269" (UID: "64f1b2c7-305c-44bc-b2c6-6080196f5269"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 13:45:33.779117 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:33.779079 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/64f1b2c7-305c-44bc-b2c6-6080196f5269-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "64f1b2c7-305c-44bc-b2c6-6080196f5269" (UID: "64f1b2c7-305c-44bc-b2c6-6080196f5269"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 13:45:33.779420 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:33.779369 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64f1b2c7-305c-44bc-b2c6-6080196f5269-config-out" (OuterVolumeSpecName: "config-out") pod "64f1b2c7-305c-44bc-b2c6-6080196f5269" (UID: "64f1b2c7-305c-44bc-b2c6-6080196f5269"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 13:45:33.779645 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:33.779622 2578 scope.go:117] "RemoveContainer" containerID="582a87136659b862324938f73ac20608ce5bd1cee3f7f6f3263230bce58ccc88" Jul 24 13:45:33.779982 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:33.779955 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/64f1b2c7-305c-44bc-b2c6-6080196f5269-config-volume" (OuterVolumeSpecName: "config-volume") pod "64f1b2c7-305c-44bc-b2c6-6080196f5269" (UID: "64f1b2c7-305c-44bc-b2c6-6080196f5269"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 13:45:33.780216 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:33.780092 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/64f1b2c7-305c-44bc-b2c6-6080196f5269-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "64f1b2c7-305c-44bc-b2c6-6080196f5269" (UID: "64f1b2c7-305c-44bc-b2c6-6080196f5269"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 13:45:33.780298 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:33.780236 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/64f1b2c7-305c-44bc-b2c6-6080196f5269-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "64f1b2c7-305c-44bc-b2c6-6080196f5269" (UID: "64f1b2c7-305c-44bc-b2c6-6080196f5269"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 13:45:33.780460 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:33.780358 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/64f1b2c7-305c-44bc-b2c6-6080196f5269-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "64f1b2c7-305c-44bc-b2c6-6080196f5269" (UID: "64f1b2c7-305c-44bc-b2c6-6080196f5269"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 13:45:33.780460 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:33.780383 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/64f1b2c7-305c-44bc-b2c6-6080196f5269-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "64f1b2c7-305c-44bc-b2c6-6080196f5269" (UID: "64f1b2c7-305c-44bc-b2c6-6080196f5269"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 13:45:33.780667 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:33.780639 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/64f1b2c7-305c-44bc-b2c6-6080196f5269-kube-api-access-2jjh7" (OuterVolumeSpecName: "kube-api-access-2jjh7") pod "64f1b2c7-305c-44bc-b2c6-6080196f5269" (UID: "64f1b2c7-305c-44bc-b2c6-6080196f5269"). InnerVolumeSpecName "kube-api-access-2jjh7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 13:45:33.784163 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:33.784138 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/64f1b2c7-305c-44bc-b2c6-6080196f5269-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "64f1b2c7-305c-44bc-b2c6-6080196f5269" (UID: "64f1b2c7-305c-44bc-b2c6-6080196f5269"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 13:45:33.790878 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:33.790850 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/64f1b2c7-305c-44bc-b2c6-6080196f5269-web-config" (OuterVolumeSpecName: "web-config") pod "64f1b2c7-305c-44bc-b2c6-6080196f5269" (UID: "64f1b2c7-305c-44bc-b2c6-6080196f5269"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 13:45:33.792776 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:33.792763 2578 scope.go:117] "RemoveContainer" containerID="1a9b6d9fd9bf3a3d14467bbca6b3c583d40762ab4b96b331cf9081b75d8955b4" Jul 24 13:45:33.799319 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:33.799302 2578 scope.go:117] "RemoveContainer" containerID="dc0090f7685cc6b06f80d07527147a14208e6009eb48d61da1f30941ed96a2c0" Jul 24 13:45:33.805606 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:33.805590 2578 scope.go:117] "RemoveContainer" containerID="4f39cb2e92be863e594e49efb8f02050b94606e4929ab948ace9e4056cd22b80" Jul 24 13:45:33.812244 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:33.812229 2578 scope.go:117] "RemoveContainer" containerID="8950f65524f53aff7e1b6472fd13a30d2f04c41bfe1b3b42b0828d682f03a913" Jul 24 13:45:33.818828 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:33.818813 2578 scope.go:117] "RemoveContainer" containerID="8dcaca6c38b49ab59a6226261cebd888dface0ffa0ce58d108b72a70e90ffef0" Jul 24 13:45:33.825183 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:33.825168 2578 scope.go:117] "RemoveContainer" containerID="e7b45e6eca0c2e9c324d85e3056115dd0b1aa2a2265b6c009e8d794e96b3d62f" Jul 24 13:45:33.825467 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:45:33.825445 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e7b45e6eca0c2e9c324d85e3056115dd0b1aa2a2265b6c009e8d794e96b3d62f\": container with ID starting with e7b45e6eca0c2e9c324d85e3056115dd0b1aa2a2265b6c009e8d794e96b3d62f not found: ID does not exist" containerID="e7b45e6eca0c2e9c324d85e3056115dd0b1aa2a2265b6c009e8d794e96b3d62f" Jul 24 13:45:33.825548 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:33.825473 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e7b45e6eca0c2e9c324d85e3056115dd0b1aa2a2265b6c009e8d794e96b3d62f"} err="failed to get container status \"e7b45e6eca0c2e9c324d85e3056115dd0b1aa2a2265b6c009e8d794e96b3d62f\": rpc error: code = NotFound desc = could not find container \"e7b45e6eca0c2e9c324d85e3056115dd0b1aa2a2265b6c009e8d794e96b3d62f\": container with ID starting with e7b45e6eca0c2e9c324d85e3056115dd0b1aa2a2265b6c009e8d794e96b3d62f not found: ID does not exist" Jul 24 13:45:33.825548 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:33.825490 2578 scope.go:117] "RemoveContainer" containerID="582a87136659b862324938f73ac20608ce5bd1cee3f7f6f3263230bce58ccc88" Jul 24 13:45:33.825715 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:45:33.825698 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"582a87136659b862324938f73ac20608ce5bd1cee3f7f6f3263230bce58ccc88\": container with ID starting with 582a87136659b862324938f73ac20608ce5bd1cee3f7f6f3263230bce58ccc88 not found: ID does not exist" containerID="582a87136659b862324938f73ac20608ce5bd1cee3f7f6f3263230bce58ccc88" Jul 24 13:45:33.825752 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:33.825721 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"582a87136659b862324938f73ac20608ce5bd1cee3f7f6f3263230bce58ccc88"} err="failed to get container status \"582a87136659b862324938f73ac20608ce5bd1cee3f7f6f3263230bce58ccc88\": rpc error: code = NotFound desc = could not find container \"582a87136659b862324938f73ac20608ce5bd1cee3f7f6f3263230bce58ccc88\": container with ID starting with 582a87136659b862324938f73ac20608ce5bd1cee3f7f6f3263230bce58ccc88 not found: ID does not exist" Jul 24 13:45:33.825752 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:33.825738 2578 scope.go:117] "RemoveContainer" containerID="1a9b6d9fd9bf3a3d14467bbca6b3c583d40762ab4b96b331cf9081b75d8955b4" Jul 24 13:45:33.825951 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:45:33.825934 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1a9b6d9fd9bf3a3d14467bbca6b3c583d40762ab4b96b331cf9081b75d8955b4\": container with ID starting with 1a9b6d9fd9bf3a3d14467bbca6b3c583d40762ab4b96b331cf9081b75d8955b4 not found: ID does not exist" containerID="1a9b6d9fd9bf3a3d14467bbca6b3c583d40762ab4b96b331cf9081b75d8955b4" Jul 24 13:45:33.825988 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:33.825958 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a9b6d9fd9bf3a3d14467bbca6b3c583d40762ab4b96b331cf9081b75d8955b4"} err="failed to get container status \"1a9b6d9fd9bf3a3d14467bbca6b3c583d40762ab4b96b331cf9081b75d8955b4\": rpc error: code = NotFound desc = could not find container \"1a9b6d9fd9bf3a3d14467bbca6b3c583d40762ab4b96b331cf9081b75d8955b4\": container with ID starting with 1a9b6d9fd9bf3a3d14467bbca6b3c583d40762ab4b96b331cf9081b75d8955b4 not found: ID does not exist" Jul 24 13:45:33.825988 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:33.825975 2578 scope.go:117] "RemoveContainer" containerID="dc0090f7685cc6b06f80d07527147a14208e6009eb48d61da1f30941ed96a2c0" Jul 24 13:45:33.826186 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:45:33.826171 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dc0090f7685cc6b06f80d07527147a14208e6009eb48d61da1f30941ed96a2c0\": container with ID starting with dc0090f7685cc6b06f80d07527147a14208e6009eb48d61da1f30941ed96a2c0 not found: ID does not exist" containerID="dc0090f7685cc6b06f80d07527147a14208e6009eb48d61da1f30941ed96a2c0" Jul 24 13:45:33.826226 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:33.826188 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc0090f7685cc6b06f80d07527147a14208e6009eb48d61da1f30941ed96a2c0"} err="failed to get container status \"dc0090f7685cc6b06f80d07527147a14208e6009eb48d61da1f30941ed96a2c0\": rpc error: code = NotFound desc = could not find container \"dc0090f7685cc6b06f80d07527147a14208e6009eb48d61da1f30941ed96a2c0\": container with ID starting with dc0090f7685cc6b06f80d07527147a14208e6009eb48d61da1f30941ed96a2c0 not found: ID does not exist" Jul 24 13:45:33.826226 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:33.826201 2578 scope.go:117] "RemoveContainer" containerID="4f39cb2e92be863e594e49efb8f02050b94606e4929ab948ace9e4056cd22b80" Jul 24 13:45:33.826447 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:45:33.826431 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4f39cb2e92be863e594e49efb8f02050b94606e4929ab948ace9e4056cd22b80\": container with ID starting with 4f39cb2e92be863e594e49efb8f02050b94606e4929ab948ace9e4056cd22b80 not found: ID does not exist" containerID="4f39cb2e92be863e594e49efb8f02050b94606e4929ab948ace9e4056cd22b80" Jul 24 13:45:33.826508 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:33.826451 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f39cb2e92be863e594e49efb8f02050b94606e4929ab948ace9e4056cd22b80"} err="failed to get container status \"4f39cb2e92be863e594e49efb8f02050b94606e4929ab948ace9e4056cd22b80\": rpc error: code = NotFound desc = could not find container \"4f39cb2e92be863e594e49efb8f02050b94606e4929ab948ace9e4056cd22b80\": container with ID starting with 4f39cb2e92be863e594e49efb8f02050b94606e4929ab948ace9e4056cd22b80 not found: ID does not exist" Jul 24 13:45:33.826508 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:33.826465 2578 scope.go:117] "RemoveContainer" containerID="8950f65524f53aff7e1b6472fd13a30d2f04c41bfe1b3b42b0828d682f03a913" Jul 24 13:45:33.826675 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:45:33.826661 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8950f65524f53aff7e1b6472fd13a30d2f04c41bfe1b3b42b0828d682f03a913\": container with ID starting with 8950f65524f53aff7e1b6472fd13a30d2f04c41bfe1b3b42b0828d682f03a913 not found: ID does not exist" containerID="8950f65524f53aff7e1b6472fd13a30d2f04c41bfe1b3b42b0828d682f03a913" Jul 24 13:45:33.826709 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:33.826679 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8950f65524f53aff7e1b6472fd13a30d2f04c41bfe1b3b42b0828d682f03a913"} err="failed to get container status \"8950f65524f53aff7e1b6472fd13a30d2f04c41bfe1b3b42b0828d682f03a913\": rpc error: code = NotFound desc = could not find container \"8950f65524f53aff7e1b6472fd13a30d2f04c41bfe1b3b42b0828d682f03a913\": container with ID starting with 8950f65524f53aff7e1b6472fd13a30d2f04c41bfe1b3b42b0828d682f03a913 not found: ID does not exist" Jul 24 13:45:33.826709 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:33.826690 2578 scope.go:117] "RemoveContainer" containerID="8dcaca6c38b49ab59a6226261cebd888dface0ffa0ce58d108b72a70e90ffef0" Jul 24 13:45:33.826895 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:45:33.826882 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8dcaca6c38b49ab59a6226261cebd888dface0ffa0ce58d108b72a70e90ffef0\": container with ID starting with 8dcaca6c38b49ab59a6226261cebd888dface0ffa0ce58d108b72a70e90ffef0 not found: ID does not exist" containerID="8dcaca6c38b49ab59a6226261cebd888dface0ffa0ce58d108b72a70e90ffef0" Jul 24 13:45:33.826943 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:33.826896 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8dcaca6c38b49ab59a6226261cebd888dface0ffa0ce58d108b72a70e90ffef0"} err="failed to get container status \"8dcaca6c38b49ab59a6226261cebd888dface0ffa0ce58d108b72a70e90ffef0\": rpc error: code = NotFound desc = could not find container \"8dcaca6c38b49ab59a6226261cebd888dface0ffa0ce58d108b72a70e90ffef0\": container with ID starting with 8dcaca6c38b49ab59a6226261cebd888dface0ffa0ce58d108b72a70e90ffef0 not found: ID does not exist" Jul 24 13:45:33.826943 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:33.826908 2578 scope.go:117] "RemoveContainer" containerID="e7b45e6eca0c2e9c324d85e3056115dd0b1aa2a2265b6c009e8d794e96b3d62f" Jul 24 13:45:33.827081 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:33.827066 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e7b45e6eca0c2e9c324d85e3056115dd0b1aa2a2265b6c009e8d794e96b3d62f"} err="failed to get container status \"e7b45e6eca0c2e9c324d85e3056115dd0b1aa2a2265b6c009e8d794e96b3d62f\": rpc error: code = NotFound desc = could not find container \"e7b45e6eca0c2e9c324d85e3056115dd0b1aa2a2265b6c009e8d794e96b3d62f\": container with ID starting with e7b45e6eca0c2e9c324d85e3056115dd0b1aa2a2265b6c009e8d794e96b3d62f not found: ID does not exist" Jul 24 13:45:33.827120 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:33.827081 2578 scope.go:117] "RemoveContainer" containerID="582a87136659b862324938f73ac20608ce5bd1cee3f7f6f3263230bce58ccc88" Jul 24 13:45:33.827299 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:33.827284 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"582a87136659b862324938f73ac20608ce5bd1cee3f7f6f3263230bce58ccc88"} err="failed to get container status \"582a87136659b862324938f73ac20608ce5bd1cee3f7f6f3263230bce58ccc88\": rpc error: code = NotFound desc = could not find container \"582a87136659b862324938f73ac20608ce5bd1cee3f7f6f3263230bce58ccc88\": container with ID starting with 582a87136659b862324938f73ac20608ce5bd1cee3f7f6f3263230bce58ccc88 not found: ID does not exist" Jul 24 13:45:33.827338 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:33.827299 2578 scope.go:117] "RemoveContainer" containerID="1a9b6d9fd9bf3a3d14467bbca6b3c583d40762ab4b96b331cf9081b75d8955b4" Jul 24 13:45:33.827513 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:33.827490 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a9b6d9fd9bf3a3d14467bbca6b3c583d40762ab4b96b331cf9081b75d8955b4"} err="failed to get container status \"1a9b6d9fd9bf3a3d14467bbca6b3c583d40762ab4b96b331cf9081b75d8955b4\": rpc error: code = NotFound desc = could not find container \"1a9b6d9fd9bf3a3d14467bbca6b3c583d40762ab4b96b331cf9081b75d8955b4\": container with ID starting with 1a9b6d9fd9bf3a3d14467bbca6b3c583d40762ab4b96b331cf9081b75d8955b4 not found: ID does not exist" Jul 24 13:45:33.827513 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:33.827508 2578 scope.go:117] "RemoveContainer" containerID="dc0090f7685cc6b06f80d07527147a14208e6009eb48d61da1f30941ed96a2c0" Jul 24 13:45:33.827746 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:33.827723 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc0090f7685cc6b06f80d07527147a14208e6009eb48d61da1f30941ed96a2c0"} err="failed to get container status \"dc0090f7685cc6b06f80d07527147a14208e6009eb48d61da1f30941ed96a2c0\": rpc error: code = NotFound desc = could not find container \"dc0090f7685cc6b06f80d07527147a14208e6009eb48d61da1f30941ed96a2c0\": container with ID starting with dc0090f7685cc6b06f80d07527147a14208e6009eb48d61da1f30941ed96a2c0 not found: ID does not exist" Jul 24 13:45:33.827794 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:33.827747 2578 scope.go:117] "RemoveContainer" containerID="4f39cb2e92be863e594e49efb8f02050b94606e4929ab948ace9e4056cd22b80" Jul 24 13:45:33.827978 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:33.827954 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f39cb2e92be863e594e49efb8f02050b94606e4929ab948ace9e4056cd22b80"} err="failed to get container status \"4f39cb2e92be863e594e49efb8f02050b94606e4929ab948ace9e4056cd22b80\": rpc error: code = NotFound desc = could not find container \"4f39cb2e92be863e594e49efb8f02050b94606e4929ab948ace9e4056cd22b80\": container with ID starting with 4f39cb2e92be863e594e49efb8f02050b94606e4929ab948ace9e4056cd22b80 not found: ID does not exist" Jul 24 13:45:33.827978 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:33.827977 2578 scope.go:117] "RemoveContainer" containerID="8950f65524f53aff7e1b6472fd13a30d2f04c41bfe1b3b42b0828d682f03a913" Jul 24 13:45:33.828193 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:33.828178 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8950f65524f53aff7e1b6472fd13a30d2f04c41bfe1b3b42b0828d682f03a913"} err="failed to get container status \"8950f65524f53aff7e1b6472fd13a30d2f04c41bfe1b3b42b0828d682f03a913\": rpc error: code = NotFound desc = could not find container \"8950f65524f53aff7e1b6472fd13a30d2f04c41bfe1b3b42b0828d682f03a913\": container with ID starting with 8950f65524f53aff7e1b6472fd13a30d2f04c41bfe1b3b42b0828d682f03a913 not found: ID does not exist" Jul 24 13:45:33.828193 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:33.828193 2578 scope.go:117] "RemoveContainer" containerID="8dcaca6c38b49ab59a6226261cebd888dface0ffa0ce58d108b72a70e90ffef0" Jul 24 13:45:33.828386 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:33.828364 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8dcaca6c38b49ab59a6226261cebd888dface0ffa0ce58d108b72a70e90ffef0"} err="failed to get container status \"8dcaca6c38b49ab59a6226261cebd888dface0ffa0ce58d108b72a70e90ffef0\": rpc error: code = NotFound desc = could not find container \"8dcaca6c38b49ab59a6226261cebd888dface0ffa0ce58d108b72a70e90ffef0\": container with ID starting with 8dcaca6c38b49ab59a6226261cebd888dface0ffa0ce58d108b72a70e90ffef0 not found: ID does not exist" Jul 24 13:45:33.877123 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:33.877094 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2jjh7\" (UniqueName: \"kubernetes.io/projected/64f1b2c7-305c-44bc-b2c6-6080196f5269-kube-api-access-2jjh7\") on node \"ip-10-0-129-93.ec2.internal\" DevicePath \"\"" Jul 24 13:45:33.877123 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:33.877119 2578 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/64f1b2c7-305c-44bc-b2c6-6080196f5269-secret-alertmanager-main-tls\") on node \"ip-10-0-129-93.ec2.internal\" DevicePath \"\"" Jul 24 13:45:33.877123 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:33.877129 2578 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/64f1b2c7-305c-44bc-b2c6-6080196f5269-cluster-tls-config\") on node \"ip-10-0-129-93.ec2.internal\" DevicePath \"\"" Jul 24 13:45:33.877299 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:33.877139 2578 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/64f1b2c7-305c-44bc-b2c6-6080196f5269-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-129-93.ec2.internal\" DevicePath \"\"" Jul 24 13:45:33.877299 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:33.877148 2578 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/64f1b2c7-305c-44bc-b2c6-6080196f5269-alertmanager-main-db\") on node \"ip-10-0-129-93.ec2.internal\" DevicePath \"\"" Jul 24 13:45:33.877299 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:33.877158 2578 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/64f1b2c7-305c-44bc-b2c6-6080196f5269-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-129-93.ec2.internal\" DevicePath \"\"" Jul 24 13:45:33.877299 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:33.877166 2578 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/64f1b2c7-305c-44bc-b2c6-6080196f5269-metrics-client-ca\") on node \"ip-10-0-129-93.ec2.internal\" DevicePath \"\"" Jul 24 13:45:33.877299 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:33.877175 2578 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/64f1b2c7-305c-44bc-b2c6-6080196f5269-tls-assets\") on node \"ip-10-0-129-93.ec2.internal\" DevicePath \"\"" Jul 24 13:45:33.877299 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:33.877183 2578 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/64f1b2c7-305c-44bc-b2c6-6080196f5269-config-volume\") on node \"ip-10-0-129-93.ec2.internal\" DevicePath \"\"" Jul 24 13:45:33.877299 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:33.877190 2578 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/64f1b2c7-305c-44bc-b2c6-6080196f5269-web-config\") on node \"ip-10-0-129-93.ec2.internal\" DevicePath \"\"" Jul 24 13:45:33.877299 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:33.877197 2578 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/64f1b2c7-305c-44bc-b2c6-6080196f5269-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-129-93.ec2.internal\" DevicePath \"\"" Jul 24 13:45:33.877299 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:33.877207 2578 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/64f1b2c7-305c-44bc-b2c6-6080196f5269-config-out\") on node \"ip-10-0-129-93.ec2.internal\" DevicePath \"\"" Jul 24 13:45:34.094106 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:34.094075 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 24 13:45:34.097809 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:34.097783 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 24 13:45:34.125149 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:34.125124 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 24 13:45:34.125436 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:34.125424 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="64f1b2c7-305c-44bc-b2c6-6080196f5269" containerName="prom-label-proxy" Jul 24 13:45:34.125481 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:34.125438 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="64f1b2c7-305c-44bc-b2c6-6080196f5269" containerName="prom-label-proxy" Jul 24 13:45:34.125481 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:34.125448 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="64f1b2c7-305c-44bc-b2c6-6080196f5269" containerName="kube-rbac-proxy" Jul 24 13:45:34.125481 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:34.125454 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="64f1b2c7-305c-44bc-b2c6-6080196f5269" containerName="kube-rbac-proxy" Jul 24 13:45:34.125481 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:34.125465 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="64f1b2c7-305c-44bc-b2c6-6080196f5269" containerName="init-config-reloader" Jul 24 13:45:34.125481 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:34.125470 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="64f1b2c7-305c-44bc-b2c6-6080196f5269" containerName="init-config-reloader" Jul 24 13:45:34.125481 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:34.125476 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="64f1b2c7-305c-44bc-b2c6-6080196f5269" containerName="alertmanager" Jul 24 13:45:34.125481 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:34.125482 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="64f1b2c7-305c-44bc-b2c6-6080196f5269" containerName="alertmanager" Jul 24 13:45:34.125678 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:34.125492 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dbfee0b6-4cc6-48ab-a5d4-d9d3810a7947" containerName="console" Jul 24 13:45:34.125678 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:34.125497 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="dbfee0b6-4cc6-48ab-a5d4-d9d3810a7947" containerName="console" Jul 24 13:45:34.125678 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:34.125509 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a0379f3-a079-420c-a31b-9722b74f6c3f" containerName="console" Jul 24 13:45:34.125678 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:34.125514 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a0379f3-a079-420c-a31b-9722b74f6c3f" containerName="console" Jul 24 13:45:34.125678 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:34.125521 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="64f1b2c7-305c-44bc-b2c6-6080196f5269" containerName="kube-rbac-proxy-metric" Jul 24 13:45:34.125678 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:34.125527 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="64f1b2c7-305c-44bc-b2c6-6080196f5269" containerName="kube-rbac-proxy-metric" Jul 24 13:45:34.125678 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:34.125533 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f17d7b72-b345-4430-a8e0-a4c01424f48d" containerName="console" Jul 24 13:45:34.125678 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:34.125538 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="f17d7b72-b345-4430-a8e0-a4c01424f48d" containerName="console" Jul 24 13:45:34.125678 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:34.125545 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="64f1b2c7-305c-44bc-b2c6-6080196f5269" containerName="config-reloader" Jul 24 13:45:34.125678 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:34.125550 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="64f1b2c7-305c-44bc-b2c6-6080196f5269" containerName="config-reloader" Jul 24 13:45:34.125678 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:34.125555 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="64f1b2c7-305c-44bc-b2c6-6080196f5269" containerName="kube-rbac-proxy-web" Jul 24 13:45:34.125678 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:34.125560 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="64f1b2c7-305c-44bc-b2c6-6080196f5269" containerName="kube-rbac-proxy-web" Jul 24 13:45:34.125678 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:34.125607 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="dbfee0b6-4cc6-48ab-a5d4-d9d3810a7947" containerName="console" Jul 24 13:45:34.125678 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:34.125615 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="f17d7b72-b345-4430-a8e0-a4c01424f48d" containerName="console" Jul 24 13:45:34.125678 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:34.125621 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="64f1b2c7-305c-44bc-b2c6-6080196f5269" containerName="kube-rbac-proxy-web" Jul 24 13:45:34.125678 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:34.125627 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="64f1b2c7-305c-44bc-b2c6-6080196f5269" containerName="prom-label-proxy" Jul 24 13:45:34.125678 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:34.125634 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="64f1b2c7-305c-44bc-b2c6-6080196f5269" containerName="alertmanager" Jul 24 13:45:34.125678 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:34.125640 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="64f1b2c7-305c-44bc-b2c6-6080196f5269" containerName="kube-rbac-proxy-metric" Jul 24 13:45:34.125678 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:34.125647 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="64f1b2c7-305c-44bc-b2c6-6080196f5269" containerName="config-reloader" Jul 24 13:45:34.125678 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:34.125653 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="9a0379f3-a079-420c-a31b-9722b74f6c3f" containerName="console" Jul 24 13:45:34.125678 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:34.125658 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="64f1b2c7-305c-44bc-b2c6-6080196f5269" containerName="kube-rbac-proxy" Jul 24 13:45:34.131628 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:34.131610 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 24 13:45:34.133864 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:34.133829 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 24 13:45:34.133864 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:34.133854 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 24 13:45:34.133864 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:34.133869 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-4gnj8\"" Jul 24 13:45:34.133864 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:34.133835 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 24 13:45:34.133864 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:34.133909 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 24 13:45:34.133864 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:34.133956 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 24 13:45:34.134427 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:34.134245 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 24 13:45:34.134427 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:34.134268 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 24 13:45:34.134570 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:34.134551 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 24 13:45:34.139594 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:34.139575 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 24 13:45:34.142272 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:34.142252 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 24 13:45:34.179841 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:34.179806 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7b121b48-dbe3-4f21-82c7-2cfba18a9bad-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7b121b48-dbe3-4f21-82c7-2cfba18a9bad\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 13:45:34.180044 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:34.179882 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7b121b48-dbe3-4f21-82c7-2cfba18a9bad-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7b121b48-dbe3-4f21-82c7-2cfba18a9bad\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 13:45:34.180044 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:34.179967 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7b121b48-dbe3-4f21-82c7-2cfba18a9bad-config-volume\") pod \"alertmanager-main-0\" (UID: \"7b121b48-dbe3-4f21-82c7-2cfba18a9bad\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 13:45:34.180044 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:34.179996 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7b121b48-dbe3-4f21-82c7-2cfba18a9bad-web-config\") pod \"alertmanager-main-0\" (UID: \"7b121b48-dbe3-4f21-82c7-2cfba18a9bad\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 13:45:34.180044 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:34.180022 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7b121b48-dbe3-4f21-82c7-2cfba18a9bad-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7b121b48-dbe3-4f21-82c7-2cfba18a9bad\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 13:45:34.180262 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:34.180054 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4ck6r\" (UniqueName: \"kubernetes.io/projected/7b121b48-dbe3-4f21-82c7-2cfba18a9bad-kube-api-access-4ck6r\") pod \"alertmanager-main-0\" (UID: \"7b121b48-dbe3-4f21-82c7-2cfba18a9bad\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 13:45:34.180262 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:34.180097 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7b121b48-dbe3-4f21-82c7-2cfba18a9bad-config-out\") pod \"alertmanager-main-0\" (UID: \"7b121b48-dbe3-4f21-82c7-2cfba18a9bad\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 13:45:34.180262 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:34.180122 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7b121b48-dbe3-4f21-82c7-2cfba18a9bad-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7b121b48-dbe3-4f21-82c7-2cfba18a9bad\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 13:45:34.180262 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:34.180160 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7b121b48-dbe3-4f21-82c7-2cfba18a9bad-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7b121b48-dbe3-4f21-82c7-2cfba18a9bad\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 13:45:34.180262 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:34.180207 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7b121b48-dbe3-4f21-82c7-2cfba18a9bad-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7b121b48-dbe3-4f21-82c7-2cfba18a9bad\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 13:45:34.180262 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:34.180231 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7b121b48-dbe3-4f21-82c7-2cfba18a9bad-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7b121b48-dbe3-4f21-82c7-2cfba18a9bad\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 13:45:34.180576 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:34.180297 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7b121b48-dbe3-4f21-82c7-2cfba18a9bad-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7b121b48-dbe3-4f21-82c7-2cfba18a9bad\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 13:45:34.180576 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:34.180321 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7b121b48-dbe3-4f21-82c7-2cfba18a9bad-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7b121b48-dbe3-4f21-82c7-2cfba18a9bad\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 13:45:34.281426 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:34.281380 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7b121b48-dbe3-4f21-82c7-2cfba18a9bad-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7b121b48-dbe3-4f21-82c7-2cfba18a9bad\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 13:45:34.281426 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:34.281431 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7b121b48-dbe3-4f21-82c7-2cfba18a9bad-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7b121b48-dbe3-4f21-82c7-2cfba18a9bad\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 13:45:34.281650 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:34.281472 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7b121b48-dbe3-4f21-82c7-2cfba18a9bad-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7b121b48-dbe3-4f21-82c7-2cfba18a9bad\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 13:45:34.281650 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:34.281489 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7b121b48-dbe3-4f21-82c7-2cfba18a9bad-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7b121b48-dbe3-4f21-82c7-2cfba18a9bad\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 13:45:34.281650 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:34.281523 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7b121b48-dbe3-4f21-82c7-2cfba18a9bad-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7b121b48-dbe3-4f21-82c7-2cfba18a9bad\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 13:45:34.281650 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:34.281549 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7b121b48-dbe3-4f21-82c7-2cfba18a9bad-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7b121b48-dbe3-4f21-82c7-2cfba18a9bad\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 13:45:34.281650 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:34.281587 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7b121b48-dbe3-4f21-82c7-2cfba18a9bad-config-volume\") pod \"alertmanager-main-0\" (UID: \"7b121b48-dbe3-4f21-82c7-2cfba18a9bad\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 13:45:34.281650 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:34.281612 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7b121b48-dbe3-4f21-82c7-2cfba18a9bad-web-config\") pod \"alertmanager-main-0\" (UID: \"7b121b48-dbe3-4f21-82c7-2cfba18a9bad\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 13:45:34.281650 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:34.281637 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7b121b48-dbe3-4f21-82c7-2cfba18a9bad-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7b121b48-dbe3-4f21-82c7-2cfba18a9bad\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 13:45:34.281975 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:34.281665 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4ck6r\" (UniqueName: \"kubernetes.io/projected/7b121b48-dbe3-4f21-82c7-2cfba18a9bad-kube-api-access-4ck6r\") pod \"alertmanager-main-0\" (UID: \"7b121b48-dbe3-4f21-82c7-2cfba18a9bad\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 13:45:34.281975 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:34.281701 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7b121b48-dbe3-4f21-82c7-2cfba18a9bad-config-out\") pod \"alertmanager-main-0\" (UID: \"7b121b48-dbe3-4f21-82c7-2cfba18a9bad\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 13:45:34.281975 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:34.281720 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7b121b48-dbe3-4f21-82c7-2cfba18a9bad-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7b121b48-dbe3-4f21-82c7-2cfba18a9bad\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 13:45:34.281975 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:34.281744 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7b121b48-dbe3-4f21-82c7-2cfba18a9bad-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7b121b48-dbe3-4f21-82c7-2cfba18a9bad\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 13:45:34.281975 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:34.281815 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7b121b48-dbe3-4f21-82c7-2cfba18a9bad-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7b121b48-dbe3-4f21-82c7-2cfba18a9bad\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 13:45:34.282220 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:34.282189 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7b121b48-dbe3-4f21-82c7-2cfba18a9bad-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7b121b48-dbe3-4f21-82c7-2cfba18a9bad\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 13:45:34.282835 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:34.282807 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7b121b48-dbe3-4f21-82c7-2cfba18a9bad-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7b121b48-dbe3-4f21-82c7-2cfba18a9bad\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 13:45:34.284449 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:34.284429 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7b121b48-dbe3-4f21-82c7-2cfba18a9bad-config-out\") pod \"alertmanager-main-0\" (UID: \"7b121b48-dbe3-4f21-82c7-2cfba18a9bad\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 13:45:34.284852 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:34.284824 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7b121b48-dbe3-4f21-82c7-2cfba18a9bad-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7b121b48-dbe3-4f21-82c7-2cfba18a9bad\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 13:45:34.285003 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:34.284831 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7b121b48-dbe3-4f21-82c7-2cfba18a9bad-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7b121b48-dbe3-4f21-82c7-2cfba18a9bad\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 13:45:34.285003 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:34.284831 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7b121b48-dbe3-4f21-82c7-2cfba18a9bad-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7b121b48-dbe3-4f21-82c7-2cfba18a9bad\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 13:45:34.285003 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:34.284893 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7b121b48-dbe3-4f21-82c7-2cfba18a9bad-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7b121b48-dbe3-4f21-82c7-2cfba18a9bad\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 13:45:34.285186 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:34.285166 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7b121b48-dbe3-4f21-82c7-2cfba18a9bad-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7b121b48-dbe3-4f21-82c7-2cfba18a9bad\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 13:45:34.285186 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:34.285178 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7b121b48-dbe3-4f21-82c7-2cfba18a9bad-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7b121b48-dbe3-4f21-82c7-2cfba18a9bad\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 13:45:34.286037 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:34.286020 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7b121b48-dbe3-4f21-82c7-2cfba18a9bad-config-volume\") pod \"alertmanager-main-0\" (UID: \"7b121b48-dbe3-4f21-82c7-2cfba18a9bad\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 13:45:34.286142 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:34.286126 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7b121b48-dbe3-4f21-82c7-2cfba18a9bad-web-config\") pod \"alertmanager-main-0\" (UID: \"7b121b48-dbe3-4f21-82c7-2cfba18a9bad\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 13:45:34.291511 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:34.291492 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4ck6r\" (UniqueName: \"kubernetes.io/projected/7b121b48-dbe3-4f21-82c7-2cfba18a9bad-kube-api-access-4ck6r\") pod \"alertmanager-main-0\" (UID: \"7b121b48-dbe3-4f21-82c7-2cfba18a9bad\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 13:45:34.441614 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:34.441561 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 24 13:45:34.581375 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:34.581241 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 24 13:45:34.584128 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:45:34.584092 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b121b48_dbe3_4f21_82c7_2cfba18a9bad.slice/crio-5bdb893ebffaaf63f8dcb901331e29d78e815d863af906d979c0a24e2e9394a7 WatchSource:0}: Error finding container 5bdb893ebffaaf63f8dcb901331e29d78e815d863af906d979c0a24e2e9394a7: Status 404 returned error can't find the container with id 5bdb893ebffaaf63f8dcb901331e29d78e815d863af906d979c0a24e2e9394a7 Jul 24 13:45:34.776803 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:34.776712 2578 generic.go:356] "Generic (PLEG): container finished" podID="7b121b48-dbe3-4f21-82c7-2cfba18a9bad" containerID="c0f643cd8a7d72a3c5e39c46f901a194f1594dcdf75548e15f6c7f656f37ce8a" exitCode=0 Jul 24 13:45:34.776803 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:34.776770 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7b121b48-dbe3-4f21-82c7-2cfba18a9bad","Type":"ContainerDied","Data":"c0f643cd8a7d72a3c5e39c46f901a194f1594dcdf75548e15f6c7f656f37ce8a"} Jul 24 13:45:34.777203 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:34.776833 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7b121b48-dbe3-4f21-82c7-2cfba18a9bad","Type":"ContainerStarted","Data":"5bdb893ebffaaf63f8dcb901331e29d78e815d863af906d979c0a24e2e9394a7"} Jul 24 13:45:34.922014 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:34.921962 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="64f1b2c7-305c-44bc-b2c6-6080196f5269" path="/var/lib/kubelet/pods/64f1b2c7-305c-44bc-b2c6-6080196f5269/volumes" Jul 24 13:45:35.785301 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:35.785210 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7b121b48-dbe3-4f21-82c7-2cfba18a9bad","Type":"ContainerStarted","Data":"6bc34e0c4d86c63e840d0f8c4e3dfa75cba8d70b11233cd5c1174c0b52a2ea3a"} Jul 24 13:45:35.785301 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:35.785278 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7b121b48-dbe3-4f21-82c7-2cfba18a9bad","Type":"ContainerStarted","Data":"d641f5a077b6ffb97266214cf8965bca018023020c8d9507b0fd4655b015e26a"} Jul 24 13:45:35.785725 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:35.785305 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7b121b48-dbe3-4f21-82c7-2cfba18a9bad","Type":"ContainerStarted","Data":"913f581a01906127122207abfc86dfe2a1fc7a7b7e73a75e37fea7b5a4c39175"} Jul 24 13:45:35.785725 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:35.785330 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7b121b48-dbe3-4f21-82c7-2cfba18a9bad","Type":"ContainerStarted","Data":"dea58fc0714cf0aac74487670e7082ea59cac27242286d0bf4a732ceeb383548"} Jul 24 13:45:35.785725 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:35.785352 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7b121b48-dbe3-4f21-82c7-2cfba18a9bad","Type":"ContainerStarted","Data":"eb96e9d871d0ebb8c725cab1ba64d3d945303c5a790e7d50804b8c5a3d685bd6"} Jul 24 13:45:35.785725 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:35.785373 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7b121b48-dbe3-4f21-82c7-2cfba18a9bad","Type":"ContainerStarted","Data":"5d73c75a877fe7b938853ff5ffefb97b909922a4830b0a64447ca9dc26281e90"} Jul 24 13:45:35.809763 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:35.809711 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=1.794523152 podStartE2EDuration="1.809692604s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.169452ms" isStatefulPod=false podCreationTimestamp="2026-07-24 13:45:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:45:35.808563268 +0000 UTC m=+143.466540653" watchObservedRunningTime="2026-07-24 13:45:35.809692604 +0000 UTC m=+143.467670040" Jul 24 13:45:36.641982 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:36.641932 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 24 13:45:36.642680 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:36.642645 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="83e86524-4fef-468f-9f50-fb75629c89f9" containerName="kube-rbac-proxy-thanos" containerID="cri-o://ce1a9caada6c68ff2c3ccf378c74167ba2c2ea7bf3d090d76248ee2141dee080" gracePeriod=600 Jul 24 13:45:36.643224 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:36.643200 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="83e86524-4fef-468f-9f50-fb75629c89f9" containerName="kube-rbac-proxy-web" containerID="cri-o://be88ca44b69f44996a0bbc179d31eec6093b4cf17a027700155fb6c971f440d0" gracePeriod=600 Jul 24 13:45:36.643918 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:36.643350 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="83e86524-4fef-468f-9f50-fb75629c89f9" containerName="kube-rbac-proxy" containerID="cri-o://560a4f9d9cbac862a6f2be9ea3f19a4dd9da1810d980a5252e06482e79c7bf38" gracePeriod=600 Jul 24 13:45:36.643982 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:36.643377 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="83e86524-4fef-468f-9f50-fb75629c89f9" containerName="thanos-sidecar" containerID="cri-o://b90f84f1b0c6a3e170a446748ae8415851ca04462dd9493decff9077d59c4ebc" gracePeriod=600 Jul 24 13:45:36.644029 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:36.643396 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="83e86524-4fef-468f-9f50-fb75629c89f9" containerName="config-reloader" containerID="cri-o://96ad57f2496014ffd54597a7b955576a8554d1e5e0e93f1dcf50701e4c687c1f" gracePeriod=600 Jul 24 13:45:36.644142 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:36.643497 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="83e86524-4fef-468f-9f50-fb75629c89f9" containerName="prometheus" containerID="cri-o://6578acc7b6cf32f95e365f104b06354e730175fc34142d39338bbe9c0db38816" gracePeriod=600 Jul 24 13:45:36.793957 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:36.793925 2578 generic.go:356] "Generic (PLEG): container finished" podID="83e86524-4fef-468f-9f50-fb75629c89f9" containerID="ce1a9caada6c68ff2c3ccf378c74167ba2c2ea7bf3d090d76248ee2141dee080" exitCode=0 Jul 24 13:45:36.793957 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:36.793953 2578 generic.go:356] "Generic (PLEG): container finished" podID="83e86524-4fef-468f-9f50-fb75629c89f9" containerID="560a4f9d9cbac862a6f2be9ea3f19a4dd9da1810d980a5252e06482e79c7bf38" exitCode=0 Jul 24 13:45:36.793957 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:36.793960 2578 generic.go:356] "Generic (PLEG): container finished" podID="83e86524-4fef-468f-9f50-fb75629c89f9" containerID="be88ca44b69f44996a0bbc179d31eec6093b4cf17a027700155fb6c971f440d0" exitCode=0 Jul 24 13:45:36.793957 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:36.793966 2578 generic.go:356] "Generic (PLEG): container finished" podID="83e86524-4fef-468f-9f50-fb75629c89f9" containerID="b90f84f1b0c6a3e170a446748ae8415851ca04462dd9493decff9077d59c4ebc" exitCode=0 Jul 24 13:45:36.794446 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:36.793973 2578 generic.go:356] "Generic (PLEG): container finished" podID="83e86524-4fef-468f-9f50-fb75629c89f9" containerID="96ad57f2496014ffd54597a7b955576a8554d1e5e0e93f1dcf50701e4c687c1f" exitCode=0 Jul 24 13:45:36.794446 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:36.793978 2578 generic.go:356] "Generic (PLEG): container finished" podID="83e86524-4fef-468f-9f50-fb75629c89f9" containerID="6578acc7b6cf32f95e365f104b06354e730175fc34142d39338bbe9c0db38816" exitCode=0 Jul 24 13:45:36.794446 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:36.793995 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"83e86524-4fef-468f-9f50-fb75629c89f9","Type":"ContainerDied","Data":"ce1a9caada6c68ff2c3ccf378c74167ba2c2ea7bf3d090d76248ee2141dee080"} Jul 24 13:45:36.794446 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:36.794068 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"83e86524-4fef-468f-9f50-fb75629c89f9","Type":"ContainerDied","Data":"560a4f9d9cbac862a6f2be9ea3f19a4dd9da1810d980a5252e06482e79c7bf38"} Jul 24 13:45:36.794446 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:36.794097 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"83e86524-4fef-468f-9f50-fb75629c89f9","Type":"ContainerDied","Data":"be88ca44b69f44996a0bbc179d31eec6093b4cf17a027700155fb6c971f440d0"} Jul 24 13:45:36.794446 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:36.794129 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"83e86524-4fef-468f-9f50-fb75629c89f9","Type":"ContainerDied","Data":"b90f84f1b0c6a3e170a446748ae8415851ca04462dd9493decff9077d59c4ebc"} Jul 24 13:45:36.794446 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:36.794171 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"83e86524-4fef-468f-9f50-fb75629c89f9","Type":"ContainerDied","Data":"96ad57f2496014ffd54597a7b955576a8554d1e5e0e93f1dcf50701e4c687c1f"} Jul 24 13:45:36.794446 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:36.794212 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"83e86524-4fef-468f-9f50-fb75629c89f9","Type":"ContainerDied","Data":"6578acc7b6cf32f95e365f104b06354e730175fc34142d39338bbe9c0db38816"} Jul 24 13:45:36.897562 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:36.897494 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:45:37.007019 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:37.006982 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/83e86524-4fef-468f-9f50-fb75629c89f9-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"83e86524-4fef-468f-9f50-fb75629c89f9\" (UID: \"83e86524-4fef-468f-9f50-fb75629c89f9\") " Jul 24 13:45:37.007019 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:37.007021 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/83e86524-4fef-468f-9f50-fb75629c89f9-tls-assets\") pod \"83e86524-4fef-468f-9f50-fb75629c89f9\" (UID: \"83e86524-4fef-468f-9f50-fb75629c89f9\") " Jul 24 13:45:37.007242 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:37.007041 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/83e86524-4fef-468f-9f50-fb75629c89f9-prometheus-k8s-rulefiles-0\") pod \"83e86524-4fef-468f-9f50-fb75629c89f9\" (UID: \"83e86524-4fef-468f-9f50-fb75629c89f9\") " Jul 24 13:45:37.007242 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:37.007059 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83e86524-4fef-468f-9f50-fb75629c89f9-configmap-serving-certs-ca-bundle\") pod \"83e86524-4fef-468f-9f50-fb75629c89f9\" (UID: \"83e86524-4fef-468f-9f50-fb75629c89f9\") " Jul 24 13:45:37.007242 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:37.007090 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/83e86524-4fef-468f-9f50-fb75629c89f9-secret-kube-rbac-proxy\") pod \"83e86524-4fef-468f-9f50-fb75629c89f9\" (UID: \"83e86524-4fef-468f-9f50-fb75629c89f9\") " Jul 24 13:45:37.007242 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:37.007125 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/83e86524-4fef-468f-9f50-fb75629c89f9-prometheus-k8s-rulefiles-1\") pod \"83e86524-4fef-468f-9f50-fb75629c89f9\" (UID: \"83e86524-4fef-468f-9f50-fb75629c89f9\") " Jul 24 13:45:37.007242 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:37.007158 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/83e86524-4fef-468f-9f50-fb75629c89f9-secret-grpc-tls\") pod \"83e86524-4fef-468f-9f50-fb75629c89f9\" (UID: \"83e86524-4fef-468f-9f50-fb75629c89f9\") " Jul 24 13:45:37.007242 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:37.007192 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83e86524-4fef-468f-9f50-fb75629c89f9-configmap-kubelet-serving-ca-bundle\") pod \"83e86524-4fef-468f-9f50-fb75629c89f9\" (UID: \"83e86524-4fef-468f-9f50-fb75629c89f9\") " Jul 24 13:45:37.007242 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:37.007232 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83e86524-4fef-468f-9f50-fb75629c89f9-prometheus-trusted-ca-bundle\") pod \"83e86524-4fef-468f-9f50-fb75629c89f9\" (UID: \"83e86524-4fef-468f-9f50-fb75629c89f9\") " Jul 24 13:45:37.007553 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:37.007278 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/83e86524-4fef-468f-9f50-fb75629c89f9-thanos-prometheus-http-client-file\") pod \"83e86524-4fef-468f-9f50-fb75629c89f9\" (UID: \"83e86524-4fef-468f-9f50-fb75629c89f9\") " Jul 24 13:45:37.007553 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:37.007302 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/83e86524-4fef-468f-9f50-fb75629c89f9-config\") pod \"83e86524-4fef-468f-9f50-fb75629c89f9\" (UID: \"83e86524-4fef-468f-9f50-fb75629c89f9\") " Jul 24 13:45:37.007553 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:37.007326 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/83e86524-4fef-468f-9f50-fb75629c89f9-prometheus-k8s-db\") pod \"83e86524-4fef-468f-9f50-fb75629c89f9\" (UID: \"83e86524-4fef-468f-9f50-fb75629c89f9\") " Jul 24 13:45:37.007553 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:37.007372 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/83e86524-4fef-468f-9f50-fb75629c89f9-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"83e86524-4fef-468f-9f50-fb75629c89f9\" (UID: \"83e86524-4fef-468f-9f50-fb75629c89f9\") " Jul 24 13:45:37.007553 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:37.007459 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/83e86524-4fef-468f-9f50-fb75629c89f9-prometheus-k8s-rulefiles-2\") pod \"83e86524-4fef-468f-9f50-fb75629c89f9\" (UID: \"83e86524-4fef-468f-9f50-fb75629c89f9\") " Jul 24 13:45:37.007553 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:37.007494 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/83e86524-4fef-468f-9f50-fb75629c89f9-configmap-metrics-client-ca\") pod \"83e86524-4fef-468f-9f50-fb75629c89f9\" (UID: \"83e86524-4fef-468f-9f50-fb75629c89f9\") " Jul 24 13:45:37.007553 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:37.007520 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/83e86524-4fef-468f-9f50-fb75629c89f9-secret-metrics-client-certs\") pod \"83e86524-4fef-468f-9f50-fb75629c89f9\" (UID: \"83e86524-4fef-468f-9f50-fb75629c89f9\") " Jul 24 13:45:37.007553 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:37.007550 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/83e86524-4fef-468f-9f50-fb75629c89f9-web-config\") pod \"83e86524-4fef-468f-9f50-fb75629c89f9\" (UID: \"83e86524-4fef-468f-9f50-fb75629c89f9\") " Jul 24 13:45:37.007963 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:37.007576 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fff76\" (UniqueName: \"kubernetes.io/projected/83e86524-4fef-468f-9f50-fb75629c89f9-kube-api-access-fff76\") pod \"83e86524-4fef-468f-9f50-fb75629c89f9\" (UID: \"83e86524-4fef-468f-9f50-fb75629c89f9\") " Jul 24 13:45:37.007963 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:37.007609 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/83e86524-4fef-468f-9f50-fb75629c89f9-config-out\") pod \"83e86524-4fef-468f-9f50-fb75629c89f9\" (UID: \"83e86524-4fef-468f-9f50-fb75629c89f9\") " Jul 24 13:45:37.007963 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:37.007668 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/83e86524-4fef-468f-9f50-fb75629c89f9-secret-prometheus-k8s-tls\") pod \"83e86524-4fef-468f-9f50-fb75629c89f9\" (UID: \"83e86524-4fef-468f-9f50-fb75629c89f9\") " Jul 24 13:45:37.007963 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:37.007758 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/83e86524-4fef-468f-9f50-fb75629c89f9-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "83e86524-4fef-468f-9f50-fb75629c89f9" (UID: "83e86524-4fef-468f-9f50-fb75629c89f9"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 13:45:37.007963 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:37.007794 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/83e86524-4fef-468f-9f50-fb75629c89f9-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "83e86524-4fef-468f-9f50-fb75629c89f9" (UID: "83e86524-4fef-468f-9f50-fb75629c89f9"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 13:45:37.008223 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:37.008007 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/83e86524-4fef-468f-9f50-fb75629c89f9-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "83e86524-4fef-468f-9f50-fb75629c89f9" (UID: "83e86524-4fef-468f-9f50-fb75629c89f9"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 13:45:37.008223 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:37.008122 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/83e86524-4fef-468f-9f50-fb75629c89f9-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "83e86524-4fef-468f-9f50-fb75629c89f9" (UID: "83e86524-4fef-468f-9f50-fb75629c89f9"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 13:45:37.009185 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:37.008458 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/83e86524-4fef-468f-9f50-fb75629c89f9-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "83e86524-4fef-468f-9f50-fb75629c89f9" (UID: "83e86524-4fef-468f-9f50-fb75629c89f9"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 13:45:37.009185 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:37.008951 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/83e86524-4fef-468f-9f50-fb75629c89f9-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "83e86524-4fef-468f-9f50-fb75629c89f9" (UID: "83e86524-4fef-468f-9f50-fb75629c89f9"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 13:45:37.009185 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:37.008985 2578 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/83e86524-4fef-468f-9f50-fb75629c89f9-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-129-93.ec2.internal\" DevicePath \"\"" Jul 24 13:45:37.009185 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:37.009008 2578 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/83e86524-4fef-468f-9f50-fb75629c89f9-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-129-93.ec2.internal\" DevicePath \"\"" Jul 24 13:45:37.009185 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:37.009026 2578 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83e86524-4fef-468f-9f50-fb75629c89f9-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-129-93.ec2.internal\" DevicePath \"\"" Jul 24 13:45:37.009185 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:37.009041 2578 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/83e86524-4fef-468f-9f50-fb75629c89f9-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-129-93.ec2.internal\" DevicePath \"\"" Jul 24 13:45:37.009185 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:37.009057 2578 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83e86524-4fef-468f-9f50-fb75629c89f9-prometheus-trusted-ca-bundle\") on node \"ip-10-0-129-93.ec2.internal\" DevicePath \"\"" Jul 24 13:45:37.009185 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:37.009148 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/83e86524-4fef-468f-9f50-fb75629c89f9-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "83e86524-4fef-468f-9f50-fb75629c89f9" (UID: "83e86524-4fef-468f-9f50-fb75629c89f9"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 13:45:37.009971 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:37.009940 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/83e86524-4fef-468f-9f50-fb75629c89f9-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "83e86524-4fef-468f-9f50-fb75629c89f9" (UID: "83e86524-4fef-468f-9f50-fb75629c89f9"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 13:45:37.010324 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:37.010277 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/83e86524-4fef-468f-9f50-fb75629c89f9-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "83e86524-4fef-468f-9f50-fb75629c89f9" (UID: "83e86524-4fef-468f-9f50-fb75629c89f9"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 13:45:37.010454 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:37.010363 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/83e86524-4fef-468f-9f50-fb75629c89f9-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "83e86524-4fef-468f-9f50-fb75629c89f9" (UID: "83e86524-4fef-468f-9f50-fb75629c89f9"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 13:45:37.011288 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:37.011211 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/83e86524-4fef-468f-9f50-fb75629c89f9-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "83e86524-4fef-468f-9f50-fb75629c89f9" (UID: "83e86524-4fef-468f-9f50-fb75629c89f9"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 13:45:37.011681 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:37.011645 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/83e86524-4fef-468f-9f50-fb75629c89f9-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "83e86524-4fef-468f-9f50-fb75629c89f9" (UID: "83e86524-4fef-468f-9f50-fb75629c89f9"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 13:45:37.011886 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:37.011856 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/83e86524-4fef-468f-9f50-fb75629c89f9-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "83e86524-4fef-468f-9f50-fb75629c89f9" (UID: "83e86524-4fef-468f-9f50-fb75629c89f9"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 13:45:37.011978 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:37.011860 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/83e86524-4fef-468f-9f50-fb75629c89f9-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "83e86524-4fef-468f-9f50-fb75629c89f9" (UID: "83e86524-4fef-468f-9f50-fb75629c89f9"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 13:45:37.011978 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:37.011964 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/83e86524-4fef-468f-9f50-fb75629c89f9-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "83e86524-4fef-468f-9f50-fb75629c89f9" (UID: "83e86524-4fef-468f-9f50-fb75629c89f9"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 13:45:37.012108 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:37.012090 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/83e86524-4fef-468f-9f50-fb75629c89f9-config" (OuterVolumeSpecName: "config") pod "83e86524-4fef-468f-9f50-fb75629c89f9" (UID: "83e86524-4fef-468f-9f50-fb75629c89f9"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 13:45:37.012228 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:37.012208 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/83e86524-4fef-468f-9f50-fb75629c89f9-kube-api-access-fff76" (OuterVolumeSpecName: "kube-api-access-fff76") pod "83e86524-4fef-468f-9f50-fb75629c89f9" (UID: "83e86524-4fef-468f-9f50-fb75629c89f9"). InnerVolumeSpecName "kube-api-access-fff76". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 13:45:37.012594 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:37.012570 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/83e86524-4fef-468f-9f50-fb75629c89f9-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "83e86524-4fef-468f-9f50-fb75629c89f9" (UID: "83e86524-4fef-468f-9f50-fb75629c89f9"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 13:45:37.013202 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:37.013183 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/83e86524-4fef-468f-9f50-fb75629c89f9-config-out" (OuterVolumeSpecName: "config-out") pod "83e86524-4fef-468f-9f50-fb75629c89f9" (UID: "83e86524-4fef-468f-9f50-fb75629c89f9"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 13:45:37.024335 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:37.024303 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/83e86524-4fef-468f-9f50-fb75629c89f9-web-config" (OuterVolumeSpecName: "web-config") pod "83e86524-4fef-468f-9f50-fb75629c89f9" (UID: "83e86524-4fef-468f-9f50-fb75629c89f9"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 13:45:37.109873 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:37.109830 2578 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/83e86524-4fef-468f-9f50-fb75629c89f9-secret-prometheus-k8s-tls\") on node \"ip-10-0-129-93.ec2.internal\" DevicePath \"\"" Jul 24 13:45:37.109873 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:37.109869 2578 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/83e86524-4fef-468f-9f50-fb75629c89f9-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-129-93.ec2.internal\" DevicePath \"\"" Jul 24 13:45:37.109873 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:37.109879 2578 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/83e86524-4fef-468f-9f50-fb75629c89f9-tls-assets\") on node \"ip-10-0-129-93.ec2.internal\" DevicePath \"\"" Jul 24 13:45:37.110106 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:37.109891 2578 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/83e86524-4fef-468f-9f50-fb75629c89f9-secret-kube-rbac-proxy\") on node \"ip-10-0-129-93.ec2.internal\" DevicePath \"\"" Jul 24 13:45:37.110106 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:37.109900 2578 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/83e86524-4fef-468f-9f50-fb75629c89f9-secret-grpc-tls\") on node \"ip-10-0-129-93.ec2.internal\" DevicePath \"\"" Jul 24 13:45:37.110106 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:37.109909 2578 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83e86524-4fef-468f-9f50-fb75629c89f9-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-129-93.ec2.internal\" DevicePath \"\"" Jul 24 13:45:37.110106 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:37.109918 2578 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/83e86524-4fef-468f-9f50-fb75629c89f9-thanos-prometheus-http-client-file\") on node \"ip-10-0-129-93.ec2.internal\" DevicePath \"\"" Jul 24 13:45:37.110106 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:37.109926 2578 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/83e86524-4fef-468f-9f50-fb75629c89f9-config\") on node \"ip-10-0-129-93.ec2.internal\" DevicePath \"\"" Jul 24 13:45:37.110106 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:37.109936 2578 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/83e86524-4fef-468f-9f50-fb75629c89f9-prometheus-k8s-db\") on node \"ip-10-0-129-93.ec2.internal\" DevicePath \"\"" Jul 24 13:45:37.110106 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:37.109946 2578 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/83e86524-4fef-468f-9f50-fb75629c89f9-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-129-93.ec2.internal\" DevicePath \"\"" Jul 24 13:45:37.110106 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:37.109954 2578 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/83e86524-4fef-468f-9f50-fb75629c89f9-configmap-metrics-client-ca\") on node \"ip-10-0-129-93.ec2.internal\" DevicePath \"\"" Jul 24 13:45:37.110106 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:37.109963 2578 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/83e86524-4fef-468f-9f50-fb75629c89f9-secret-metrics-client-certs\") on node \"ip-10-0-129-93.ec2.internal\" DevicePath \"\"" Jul 24 13:45:37.110106 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:37.109986 2578 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/83e86524-4fef-468f-9f50-fb75629c89f9-web-config\") on node \"ip-10-0-129-93.ec2.internal\" DevicePath \"\"" Jul 24 13:45:37.110106 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:37.109995 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fff76\" (UniqueName: \"kubernetes.io/projected/83e86524-4fef-468f-9f50-fb75629c89f9-kube-api-access-fff76\") on node \"ip-10-0-129-93.ec2.internal\" DevicePath \"\"" Jul 24 13:45:37.110106 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:37.110004 2578 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/83e86524-4fef-468f-9f50-fb75629c89f9-config-out\") on node \"ip-10-0-129-93.ec2.internal\" DevicePath \"\"" Jul 24 13:45:37.800747 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:37.800711 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"83e86524-4fef-468f-9f50-fb75629c89f9","Type":"ContainerDied","Data":"e84da8ed01ceacf4a30843e604736f4b30f7b2e8381d7b6ca527b0fe4c83fd2b"} Jul 24 13:45:37.800747 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:37.800736 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:45:37.801211 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:37.800804 2578 scope.go:117] "RemoveContainer" containerID="ce1a9caada6c68ff2c3ccf378c74167ba2c2ea7bf3d090d76248ee2141dee080" Jul 24 13:45:37.812946 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:37.812926 2578 scope.go:117] "RemoveContainer" containerID="560a4f9d9cbac862a6f2be9ea3f19a4dd9da1810d980a5252e06482e79c7bf38" Jul 24 13:45:37.820596 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:37.820579 2578 scope.go:117] "RemoveContainer" containerID="be88ca44b69f44996a0bbc179d31eec6093b4cf17a027700155fb6c971f440d0" Jul 24 13:45:37.827544 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:37.827521 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 24 13:45:37.827629 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:37.827565 2578 scope.go:117] "RemoveContainer" containerID="b90f84f1b0c6a3e170a446748ae8415851ca04462dd9493decff9077d59c4ebc" Jul 24 13:45:37.833633 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:37.833612 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 24 13:45:37.835029 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:37.835014 2578 scope.go:117] "RemoveContainer" containerID="96ad57f2496014ffd54597a7b955576a8554d1e5e0e93f1dcf50701e4c687c1f" Jul 24 13:45:37.841699 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:37.841685 2578 scope.go:117] "RemoveContainer" containerID="6578acc7b6cf32f95e365f104b06354e730175fc34142d39338bbe9c0db38816" Jul 24 13:45:37.849080 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:37.849060 2578 scope.go:117] "RemoveContainer" containerID="ce8d584b8237efcfe623a4fe4bc957e41a1a0281b6ba2b5a539715f7f3602a32" Jul 24 13:45:37.858965 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:37.858944 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 24 13:45:37.859297 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:37.859284 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="83e86524-4fef-468f-9f50-fb75629c89f9" containerName="init-config-reloader" Jul 24 13:45:37.859341 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:37.859298 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="83e86524-4fef-468f-9f50-fb75629c89f9" containerName="init-config-reloader" Jul 24 13:45:37.859341 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:37.859308 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="83e86524-4fef-468f-9f50-fb75629c89f9" containerName="kube-rbac-proxy" Jul 24 13:45:37.859341 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:37.859313 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="83e86524-4fef-468f-9f50-fb75629c89f9" containerName="kube-rbac-proxy" Jul 24 13:45:37.859341 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:37.859327 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="83e86524-4fef-468f-9f50-fb75629c89f9" containerName="config-reloader" Jul 24 13:45:37.859341 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:37.859332 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="83e86524-4fef-468f-9f50-fb75629c89f9" containerName="config-reloader" Jul 24 13:45:37.859341 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:37.859340 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="83e86524-4fef-468f-9f50-fb75629c89f9" containerName="prometheus" Jul 24 13:45:37.859526 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:37.859346 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="83e86524-4fef-468f-9f50-fb75629c89f9" containerName="prometheus" Jul 24 13:45:37.859526 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:37.859353 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="83e86524-4fef-468f-9f50-fb75629c89f9" containerName="kube-rbac-proxy-thanos" Jul 24 13:45:37.859526 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:37.859358 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="83e86524-4fef-468f-9f50-fb75629c89f9" containerName="kube-rbac-proxy-thanos" Jul 24 13:45:37.859526 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:37.859365 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="83e86524-4fef-468f-9f50-fb75629c89f9" containerName="kube-rbac-proxy-web" Jul 24 13:45:37.859526 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:37.859370 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="83e86524-4fef-468f-9f50-fb75629c89f9" containerName="kube-rbac-proxy-web" Jul 24 13:45:37.859526 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:37.859380 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="83e86524-4fef-468f-9f50-fb75629c89f9" containerName="thanos-sidecar" Jul 24 13:45:37.859526 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:37.859384 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="83e86524-4fef-468f-9f50-fb75629c89f9" containerName="thanos-sidecar" Jul 24 13:45:37.859526 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:37.859448 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="83e86524-4fef-468f-9f50-fb75629c89f9" containerName="kube-rbac-proxy-web" Jul 24 13:45:37.859526 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:37.859455 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="83e86524-4fef-468f-9f50-fb75629c89f9" containerName="kube-rbac-proxy" Jul 24 13:45:37.859526 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:37.859461 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="83e86524-4fef-468f-9f50-fb75629c89f9" containerName="prometheus" Jul 24 13:45:37.859526 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:37.859468 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="83e86524-4fef-468f-9f50-fb75629c89f9" containerName="kube-rbac-proxy-thanos" Jul 24 13:45:37.859526 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:37.859474 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="83e86524-4fef-468f-9f50-fb75629c89f9" containerName="thanos-sidecar" Jul 24 13:45:37.859526 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:37.859480 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="83e86524-4fef-468f-9f50-fb75629c89f9" containerName="config-reloader" Jul 24 13:45:37.864227 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:37.864206 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:45:37.866204 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:37.866181 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 24 13:45:37.866292 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:37.866204 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-2glqd\"" Jul 24 13:45:37.866292 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:37.866210 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 24 13:45:37.866292 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:37.866253 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 24 13:45:37.866604 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:37.866587 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 24 13:45:37.866681 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:37.866612 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 24 13:45:37.866681 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:37.866643 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 24 13:45:37.866783 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:37.866699 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 24 13:45:37.866836 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:37.866798 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 24 13:45:37.866952 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:37.866935 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 24 13:45:37.867116 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:37.867102 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 24 13:45:37.867490 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:37.867469 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 24 13:45:37.867738 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:37.867720 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 24 13:45:37.867816 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:37.867793 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-5764vp0ikm5j7\"" Jul 24 13:45:37.870823 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:37.870801 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 24 13:45:37.873365 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:37.873345 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 24 13:45:37.878852 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:37.878831 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 24 13:45:37.917581 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:37.917486 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5545b094-3366-4571-970f-280c1a0d4ae0-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"5545b094-3366-4571-970f-280c1a0d4ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:45:37.917581 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:37.917523 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5545b094-3366-4571-970f-280c1a0d4ae0-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5545b094-3366-4571-970f-280c1a0d4ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:45:37.917581 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:37.917558 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5545b094-3366-4571-970f-280c1a0d4ae0-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"5545b094-3366-4571-970f-280c1a0d4ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:45:37.917790 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:37.917603 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5545b094-3366-4571-970f-280c1a0d4ae0-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"5545b094-3366-4571-970f-280c1a0d4ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:45:37.917790 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:37.917667 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5545b094-3366-4571-970f-280c1a0d4ae0-web-config\") pod \"prometheus-k8s-0\" (UID: \"5545b094-3366-4571-970f-280c1a0d4ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:45:37.917790 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:37.917690 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5545b094-3366-4571-970f-280c1a0d4ae0-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"5545b094-3366-4571-970f-280c1a0d4ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:45:37.917790 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:37.917716 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5545b094-3366-4571-970f-280c1a0d4ae0-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"5545b094-3366-4571-970f-280c1a0d4ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:45:37.917790 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:37.917734 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5545b094-3366-4571-970f-280c1a0d4ae0-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"5545b094-3366-4571-970f-280c1a0d4ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:45:37.917968 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:37.917787 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/5545b094-3366-4571-970f-280c1a0d4ae0-config\") pod \"prometheus-k8s-0\" (UID: \"5545b094-3366-4571-970f-280c1a0d4ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:45:37.917968 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:37.917810 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5545b094-3366-4571-970f-280c1a0d4ae0-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"5545b094-3366-4571-970f-280c1a0d4ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:45:37.917968 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:37.917829 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5545b094-3366-4571-970f-280c1a0d4ae0-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"5545b094-3366-4571-970f-280c1a0d4ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:45:37.917968 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:37.917855 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5545b094-3366-4571-970f-280c1a0d4ae0-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"5545b094-3366-4571-970f-280c1a0d4ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:45:37.917968 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:37.917876 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5545b094-3366-4571-970f-280c1a0d4ae0-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"5545b094-3366-4571-970f-280c1a0d4ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:45:37.917968 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:37.917890 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7cc4r\" (UniqueName: \"kubernetes.io/projected/5545b094-3366-4571-970f-280c1a0d4ae0-kube-api-access-7cc4r\") pod \"prometheus-k8s-0\" (UID: \"5545b094-3366-4571-970f-280c1a0d4ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:45:37.917968 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:37.917928 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5545b094-3366-4571-970f-280c1a0d4ae0-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"5545b094-3366-4571-970f-280c1a0d4ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:45:37.918159 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:37.917971 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5545b094-3366-4571-970f-280c1a0d4ae0-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5545b094-3366-4571-970f-280c1a0d4ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:45:37.918159 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:37.917993 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5545b094-3366-4571-970f-280c1a0d4ae0-config-out\") pod \"prometheus-k8s-0\" (UID: \"5545b094-3366-4571-970f-280c1a0d4ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:45:37.918159 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:37.918015 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5545b094-3366-4571-970f-280c1a0d4ae0-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"5545b094-3366-4571-970f-280c1a0d4ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:45:37.918159 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:37.918040 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5545b094-3366-4571-970f-280c1a0d4ae0-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5545b094-3366-4571-970f-280c1a0d4ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:45:37.918159 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:37.918073 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5545b094-3366-4571-970f-280c1a0d4ae0-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"5545b094-3366-4571-970f-280c1a0d4ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:45:38.019550 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:38.019507 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5545b094-3366-4571-970f-280c1a0d4ae0-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"5545b094-3366-4571-970f-280c1a0d4ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:45:38.019550 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:38.019550 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7cc4r\" (UniqueName: \"kubernetes.io/projected/5545b094-3366-4571-970f-280c1a0d4ae0-kube-api-access-7cc4r\") pod \"prometheus-k8s-0\" (UID: \"5545b094-3366-4571-970f-280c1a0d4ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:45:38.019745 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:38.019661 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5545b094-3366-4571-970f-280c1a0d4ae0-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"5545b094-3366-4571-970f-280c1a0d4ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:45:38.019745 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:38.019697 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5545b094-3366-4571-970f-280c1a0d4ae0-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5545b094-3366-4571-970f-280c1a0d4ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:45:38.019745 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:38.019717 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5545b094-3366-4571-970f-280c1a0d4ae0-config-out\") pod \"prometheus-k8s-0\" (UID: \"5545b094-3366-4571-970f-280c1a0d4ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:45:38.019923 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:38.019849 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5545b094-3366-4571-970f-280c1a0d4ae0-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"5545b094-3366-4571-970f-280c1a0d4ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:45:38.019923 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:38.019897 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5545b094-3366-4571-970f-280c1a0d4ae0-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5545b094-3366-4571-970f-280c1a0d4ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:45:38.020024 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:38.019941 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5545b094-3366-4571-970f-280c1a0d4ae0-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"5545b094-3366-4571-970f-280c1a0d4ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:45:38.020024 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:38.019984 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5545b094-3366-4571-970f-280c1a0d4ae0-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"5545b094-3366-4571-970f-280c1a0d4ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:45:38.020024 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:38.020007 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5545b094-3366-4571-970f-280c1a0d4ae0-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5545b094-3366-4571-970f-280c1a0d4ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:45:38.020179 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:38.020046 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5545b094-3366-4571-970f-280c1a0d4ae0-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"5545b094-3366-4571-970f-280c1a0d4ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:45:38.020179 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:38.020078 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5545b094-3366-4571-970f-280c1a0d4ae0-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"5545b094-3366-4571-970f-280c1a0d4ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:45:38.020179 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:38.020118 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5545b094-3366-4571-970f-280c1a0d4ae0-web-config\") pod \"prometheus-k8s-0\" (UID: \"5545b094-3366-4571-970f-280c1a0d4ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:45:38.020179 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:38.020141 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5545b094-3366-4571-970f-280c1a0d4ae0-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"5545b094-3366-4571-970f-280c1a0d4ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:45:38.020179 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:38.020155 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5545b094-3366-4571-970f-280c1a0d4ae0-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"5545b094-3366-4571-970f-280c1a0d4ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:45:38.020399 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:38.020207 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5545b094-3366-4571-970f-280c1a0d4ae0-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"5545b094-3366-4571-970f-280c1a0d4ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:45:38.020399 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:38.020245 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5545b094-3366-4571-970f-280c1a0d4ae0-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"5545b094-3366-4571-970f-280c1a0d4ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:45:38.020399 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:38.020280 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/5545b094-3366-4571-970f-280c1a0d4ae0-config\") pod \"prometheus-k8s-0\" (UID: \"5545b094-3366-4571-970f-280c1a0d4ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:45:38.020399 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:38.020300 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5545b094-3366-4571-970f-280c1a0d4ae0-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"5545b094-3366-4571-970f-280c1a0d4ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:45:38.020399 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:38.020322 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5545b094-3366-4571-970f-280c1a0d4ae0-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"5545b094-3366-4571-970f-280c1a0d4ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:45:38.020399 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:38.020352 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5545b094-3366-4571-970f-280c1a0d4ae0-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"5545b094-3366-4571-970f-280c1a0d4ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:45:38.020720 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:38.020465 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5545b094-3366-4571-970f-280c1a0d4ae0-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5545b094-3366-4571-970f-280c1a0d4ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:45:38.020720 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:38.020602 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5545b094-3366-4571-970f-280c1a0d4ae0-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5545b094-3366-4571-970f-280c1a0d4ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:45:38.021158 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:38.020859 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5545b094-3366-4571-970f-280c1a0d4ae0-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"5545b094-3366-4571-970f-280c1a0d4ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:45:38.021158 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:38.020933 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5545b094-3366-4571-970f-280c1a0d4ae0-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5545b094-3366-4571-970f-280c1a0d4ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:45:38.021850 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:38.021749 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5545b094-3366-4571-970f-280c1a0d4ae0-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"5545b094-3366-4571-970f-280c1a0d4ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:45:38.022577 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:38.022317 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5545b094-3366-4571-970f-280c1a0d4ae0-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"5545b094-3366-4571-970f-280c1a0d4ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:45:38.022961 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:38.022932 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5545b094-3366-4571-970f-280c1a0d4ae0-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"5545b094-3366-4571-970f-280c1a0d4ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:45:38.023515 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:38.023460 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5545b094-3366-4571-970f-280c1a0d4ae0-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"5545b094-3366-4571-970f-280c1a0d4ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:45:38.023628 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:38.023605 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5545b094-3366-4571-970f-280c1a0d4ae0-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"5545b094-3366-4571-970f-280c1a0d4ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:45:38.023736 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:38.023686 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5545b094-3366-4571-970f-280c1a0d4ae0-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"5545b094-3366-4571-970f-280c1a0d4ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:45:38.024087 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:38.024062 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5545b094-3366-4571-970f-280c1a0d4ae0-config-out\") pod \"prometheus-k8s-0\" (UID: \"5545b094-3366-4571-970f-280c1a0d4ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:45:38.024388 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:38.024362 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5545b094-3366-4571-970f-280c1a0d4ae0-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"5545b094-3366-4571-970f-280c1a0d4ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:45:38.024524 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:38.024501 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5545b094-3366-4571-970f-280c1a0d4ae0-web-config\") pod \"prometheus-k8s-0\" (UID: \"5545b094-3366-4571-970f-280c1a0d4ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:45:38.025106 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:38.025073 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/5545b094-3366-4571-970f-280c1a0d4ae0-config\") pod \"prometheus-k8s-0\" (UID: \"5545b094-3366-4571-970f-280c1a0d4ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:45:38.025810 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:38.025785 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5545b094-3366-4571-970f-280c1a0d4ae0-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"5545b094-3366-4571-970f-280c1a0d4ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:45:38.025909 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:38.025879 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5545b094-3366-4571-970f-280c1a0d4ae0-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"5545b094-3366-4571-970f-280c1a0d4ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:45:38.025909 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:38.025898 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5545b094-3366-4571-970f-280c1a0d4ae0-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"5545b094-3366-4571-970f-280c1a0d4ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:45:38.026048 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:38.026027 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5545b094-3366-4571-970f-280c1a0d4ae0-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"5545b094-3366-4571-970f-280c1a0d4ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:45:38.027488 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:38.027467 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7cc4r\" (UniqueName: \"kubernetes.io/projected/5545b094-3366-4571-970f-280c1a0d4ae0-kube-api-access-7cc4r\") pod \"prometheus-k8s-0\" (UID: \"5545b094-3366-4571-970f-280c1a0d4ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:45:38.175230 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:38.175142 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:45:38.319532 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:38.319503 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 24 13:45:38.321343 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:45:38.321311 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5545b094_3366_4571_970f_280c1a0d4ae0.slice/crio-224f128bbc8574ae619bf94725297e22db5856860da9f1f9b3da587746cbc1b2 WatchSource:0}: Error finding container 224f128bbc8574ae619bf94725297e22db5856860da9f1f9b3da587746cbc1b2: Status 404 returned error can't find the container with id 224f128bbc8574ae619bf94725297e22db5856860da9f1f9b3da587746cbc1b2 Jul 24 13:45:38.806228 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:38.806189 2578 generic.go:356] "Generic (PLEG): container finished" podID="5545b094-3366-4571-970f-280c1a0d4ae0" containerID="232f893c47cff1cdf4af8137661125de61e60ff9e92035b133c884106226619b" exitCode=0 Jul 24 13:45:38.806679 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:38.806272 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5545b094-3366-4571-970f-280c1a0d4ae0","Type":"ContainerDied","Data":"232f893c47cff1cdf4af8137661125de61e60ff9e92035b133c884106226619b"} Jul 24 13:45:38.806679 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:38.806335 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5545b094-3366-4571-970f-280c1a0d4ae0","Type":"ContainerStarted","Data":"224f128bbc8574ae619bf94725297e22db5856860da9f1f9b3da587746cbc1b2"} Jul 24 13:45:38.921618 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:38.921587 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="83e86524-4fef-468f-9f50-fb75629c89f9" path="/var/lib/kubelet/pods/83e86524-4fef-468f-9f50-fb75629c89f9/volumes" Jul 24 13:45:39.815200 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:39.815160 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5545b094-3366-4571-970f-280c1a0d4ae0","Type":"ContainerStarted","Data":"6cbcfdcc0081905b08e0189235b1adb2d41b56ed2af8da18825e89218cef8e88"} Jul 24 13:45:39.815603 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:39.815261 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5545b094-3366-4571-970f-280c1a0d4ae0","Type":"ContainerStarted","Data":"38da582c52303cfa282804be3aee08762efab74fbd83cccef177f8e2502fb6ef"} Jul 24 13:45:39.815603 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:39.815290 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5545b094-3366-4571-970f-280c1a0d4ae0","Type":"ContainerStarted","Data":"93f3b97896da331dfae3e37833f9b5ff5c56e25b72e7a8dba284441ca348e9c6"} Jul 24 13:45:39.815603 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:39.815315 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5545b094-3366-4571-970f-280c1a0d4ae0","Type":"ContainerStarted","Data":"798208d1ff704d68fade1f6cfa14359003edd6c612d77b7cf9ddaeabed31abe9"} Jul 24 13:45:39.815603 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:39.815339 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5545b094-3366-4571-970f-280c1a0d4ae0","Type":"ContainerStarted","Data":"ea833d3495a7e43c232acf629bead7673e83336463d994bd5b93c7f5275f729f"} Jul 24 13:45:39.815603 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:39.815362 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5545b094-3366-4571-970f-280c1a0d4ae0","Type":"ContainerStarted","Data":"632448fc6745e5d627903fc2ef7ab203408b4160a0727a5b9dff6c77588b7a94"} Jul 24 13:45:39.845466 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:39.845390 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.82624333 podStartE2EDuration="2.845367082s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.123752ms" isStatefulPod=false podCreationTimestamp="2026-07-24 13:45:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:45:39.84357817 +0000 UTC m=+147.501555557" watchObservedRunningTime="2026-07-24 13:45:39.845367082 +0000 UTC m=+147.503344470" Jul 24 13:45:40.440117 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:40.440084 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5ddccf588-8rx7m"] Jul 24 13:45:40.443572 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:40.443550 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5ddccf588-8rx7m" Jul 24 13:45:40.456358 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:40.456326 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5ddccf588-8rx7m"] Jul 24 13:45:40.544701 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:40.544658 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3783a9bb-fffa-4e91-994c-c2688f211063-service-ca\") pod \"console-5ddccf588-8rx7m\" (UID: \"3783a9bb-fffa-4e91-994c-c2688f211063\") " pod="openshift-console/console-5ddccf588-8rx7m" Jul 24 13:45:40.544701 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:40.544695 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tgw4r\" (UniqueName: \"kubernetes.io/projected/3783a9bb-fffa-4e91-994c-c2688f211063-kube-api-access-tgw4r\") pod \"console-5ddccf588-8rx7m\" (UID: \"3783a9bb-fffa-4e91-994c-c2688f211063\") " pod="openshift-console/console-5ddccf588-8rx7m" Jul 24 13:45:40.544881 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:40.544740 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3783a9bb-fffa-4e91-994c-c2688f211063-trusted-ca-bundle\") pod \"console-5ddccf588-8rx7m\" (UID: \"3783a9bb-fffa-4e91-994c-c2688f211063\") " pod="openshift-console/console-5ddccf588-8rx7m" Jul 24 13:45:40.544881 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:40.544765 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3783a9bb-fffa-4e91-994c-c2688f211063-console-oauth-config\") pod \"console-5ddccf588-8rx7m\" (UID: \"3783a9bb-fffa-4e91-994c-c2688f211063\") " pod="openshift-console/console-5ddccf588-8rx7m" Jul 24 13:45:40.544881 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:40.544791 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3783a9bb-fffa-4e91-994c-c2688f211063-console-serving-cert\") pod \"console-5ddccf588-8rx7m\" (UID: \"3783a9bb-fffa-4e91-994c-c2688f211063\") " pod="openshift-console/console-5ddccf588-8rx7m" Jul 24 13:45:40.544881 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:40.544842 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3783a9bb-fffa-4e91-994c-c2688f211063-console-config\") pod \"console-5ddccf588-8rx7m\" (UID: \"3783a9bb-fffa-4e91-994c-c2688f211063\") " pod="openshift-console/console-5ddccf588-8rx7m" Jul 24 13:45:40.544881 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:40.544859 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3783a9bb-fffa-4e91-994c-c2688f211063-oauth-serving-cert\") pod \"console-5ddccf588-8rx7m\" (UID: \"3783a9bb-fffa-4e91-994c-c2688f211063\") " pod="openshift-console/console-5ddccf588-8rx7m" Jul 24 13:45:40.646038 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:40.645990 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3783a9bb-fffa-4e91-994c-c2688f211063-trusted-ca-bundle\") pod \"console-5ddccf588-8rx7m\" (UID: \"3783a9bb-fffa-4e91-994c-c2688f211063\") " pod="openshift-console/console-5ddccf588-8rx7m" Jul 24 13:45:40.646038 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:40.646045 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3783a9bb-fffa-4e91-994c-c2688f211063-console-oauth-config\") pod \"console-5ddccf588-8rx7m\" (UID: \"3783a9bb-fffa-4e91-994c-c2688f211063\") " pod="openshift-console/console-5ddccf588-8rx7m" Jul 24 13:45:40.646180 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:40.646077 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3783a9bb-fffa-4e91-994c-c2688f211063-console-serving-cert\") pod \"console-5ddccf588-8rx7m\" (UID: \"3783a9bb-fffa-4e91-994c-c2688f211063\") " pod="openshift-console/console-5ddccf588-8rx7m" Jul 24 13:45:40.646180 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:40.646107 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3783a9bb-fffa-4e91-994c-c2688f211063-console-config\") pod \"console-5ddccf588-8rx7m\" (UID: \"3783a9bb-fffa-4e91-994c-c2688f211063\") " pod="openshift-console/console-5ddccf588-8rx7m" Jul 24 13:45:40.646180 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:40.646124 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3783a9bb-fffa-4e91-994c-c2688f211063-oauth-serving-cert\") pod \"console-5ddccf588-8rx7m\" (UID: \"3783a9bb-fffa-4e91-994c-c2688f211063\") " pod="openshift-console/console-5ddccf588-8rx7m" Jul 24 13:45:40.646180 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:40.646160 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3783a9bb-fffa-4e91-994c-c2688f211063-service-ca\") pod \"console-5ddccf588-8rx7m\" (UID: \"3783a9bb-fffa-4e91-994c-c2688f211063\") " pod="openshift-console/console-5ddccf588-8rx7m" Jul 24 13:45:40.646358 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:40.646179 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tgw4r\" (UniqueName: \"kubernetes.io/projected/3783a9bb-fffa-4e91-994c-c2688f211063-kube-api-access-tgw4r\") pod \"console-5ddccf588-8rx7m\" (UID: \"3783a9bb-fffa-4e91-994c-c2688f211063\") " pod="openshift-console/console-5ddccf588-8rx7m" Jul 24 13:45:40.646942 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:40.646917 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3783a9bb-fffa-4e91-994c-c2688f211063-oauth-serving-cert\") pod \"console-5ddccf588-8rx7m\" (UID: \"3783a9bb-fffa-4e91-994c-c2688f211063\") " pod="openshift-console/console-5ddccf588-8rx7m" Jul 24 13:45:40.647030 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:40.646913 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3783a9bb-fffa-4e91-994c-c2688f211063-console-config\") pod \"console-5ddccf588-8rx7m\" (UID: \"3783a9bb-fffa-4e91-994c-c2688f211063\") " pod="openshift-console/console-5ddccf588-8rx7m" Jul 24 13:45:40.647030 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:40.646974 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3783a9bb-fffa-4e91-994c-c2688f211063-trusted-ca-bundle\") pod \"console-5ddccf588-8rx7m\" (UID: \"3783a9bb-fffa-4e91-994c-c2688f211063\") " pod="openshift-console/console-5ddccf588-8rx7m" Jul 24 13:45:40.647111 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:40.647015 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3783a9bb-fffa-4e91-994c-c2688f211063-service-ca\") pod \"console-5ddccf588-8rx7m\" (UID: \"3783a9bb-fffa-4e91-994c-c2688f211063\") " pod="openshift-console/console-5ddccf588-8rx7m" Jul 24 13:45:40.648677 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:40.648652 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3783a9bb-fffa-4e91-994c-c2688f211063-console-serving-cert\") pod \"console-5ddccf588-8rx7m\" (UID: \"3783a9bb-fffa-4e91-994c-c2688f211063\") " pod="openshift-console/console-5ddccf588-8rx7m" Jul 24 13:45:40.648770 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:40.648699 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3783a9bb-fffa-4e91-994c-c2688f211063-console-oauth-config\") pod \"console-5ddccf588-8rx7m\" (UID: \"3783a9bb-fffa-4e91-994c-c2688f211063\") " pod="openshift-console/console-5ddccf588-8rx7m" Jul 24 13:45:40.653705 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:40.653685 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tgw4r\" (UniqueName: \"kubernetes.io/projected/3783a9bb-fffa-4e91-994c-c2688f211063-kube-api-access-tgw4r\") pod \"console-5ddccf588-8rx7m\" (UID: \"3783a9bb-fffa-4e91-994c-c2688f211063\") " pod="openshift-console/console-5ddccf588-8rx7m" Jul 24 13:45:40.753574 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:40.753480 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5ddccf588-8rx7m" Jul 24 13:45:40.885758 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:40.885724 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5ddccf588-8rx7m"] Jul 24 13:45:40.888727 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:45:40.888685 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3783a9bb_fffa_4e91_994c_c2688f211063.slice/crio-ee0b473a78cd5d8140d34dfb1866d729f2325854fec410ef8acb01da5d24e30d WatchSource:0}: Error finding container ee0b473a78cd5d8140d34dfb1866d729f2325854fec410ef8acb01da5d24e30d: Status 404 returned error can't find the container with id ee0b473a78cd5d8140d34dfb1866d729f2325854fec410ef8acb01da5d24e30d Jul 24 13:45:41.830762 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:41.830726 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5ddccf588-8rx7m" event={"ID":"3783a9bb-fffa-4e91-994c-c2688f211063","Type":"ContainerStarted","Data":"cf258b2bce57bbaddbbe9ced72dcc45b83347e5ab7a1de26a765ac6ebd6e0c5d"} Jul 24 13:45:41.830912 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:41.830804 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5ddccf588-8rx7m" event={"ID":"3783a9bb-fffa-4e91-994c-c2688f211063","Type":"ContainerStarted","Data":"ee0b473a78cd5d8140d34dfb1866d729f2325854fec410ef8acb01da5d24e30d"} Jul 24 13:45:41.852013 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:41.851956 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5ddccf588-8rx7m" podStartSLOduration=1.8519372920000001 podStartE2EDuration="1.851937292s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 13:45:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:45:41.850490826 +0000 UTC m=+149.508468213" watchObservedRunningTime="2026-07-24 13:45:41.851937292 +0000 UTC m=+149.509914676" Jul 24 13:45:43.175280 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:43.175239 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:45:50.754472 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:50.754431 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5ddccf588-8rx7m" Jul 24 13:45:50.754844 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:50.754528 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5ddccf588-8rx7m" Jul 24 13:45:50.759363 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:50.759337 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5ddccf588-8rx7m" Jul 24 13:45:50.872928 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:50.872900 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5ddccf588-8rx7m" Jul 24 13:45:50.921713 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:45:50.921685 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-75d9687d6c-j9ns4"] Jul 24 13:46:15.940882 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:46:15.940821 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-75d9687d6c-j9ns4" podUID="4e8099a9-2b87-472a-89a4-49befc2d2fc3" containerName="console" containerID="cri-o://66272280054d6d0008124a3cce55c2a538da621b19ce9033702dcd98b56665b7" gracePeriod=15 Jul 24 13:46:16.196721 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:46:16.196657 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75d9687d6c-j9ns4" Jul 24 13:46:16.277632 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:46:16.277600 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4e8099a9-2b87-472a-89a4-49befc2d2fc3-console-serving-cert\") pod \"4e8099a9-2b87-472a-89a4-49befc2d2fc3\" (UID: \"4e8099a9-2b87-472a-89a4-49befc2d2fc3\") " Jul 24 13:46:16.277816 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:46:16.277644 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4e8099a9-2b87-472a-89a4-49befc2d2fc3-console-oauth-config\") pod \"4e8099a9-2b87-472a-89a4-49befc2d2fc3\" (UID: \"4e8099a9-2b87-472a-89a4-49befc2d2fc3\") " Jul 24 13:46:16.277816 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:46:16.277674 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4e8099a9-2b87-472a-89a4-49befc2d2fc3-console-config\") pod \"4e8099a9-2b87-472a-89a4-49befc2d2fc3\" (UID: \"4e8099a9-2b87-472a-89a4-49befc2d2fc3\") " Jul 24 13:46:16.277816 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:46:16.277716 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e8099a9-2b87-472a-89a4-49befc2d2fc3-trusted-ca-bundle\") pod \"4e8099a9-2b87-472a-89a4-49befc2d2fc3\" (UID: \"4e8099a9-2b87-472a-89a4-49befc2d2fc3\") " Jul 24 13:46:16.277816 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:46:16.277755 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4e8099a9-2b87-472a-89a4-49befc2d2fc3-oauth-serving-cert\") pod \"4e8099a9-2b87-472a-89a4-49befc2d2fc3\" (UID: \"4e8099a9-2b87-472a-89a4-49befc2d2fc3\") " Jul 24 13:46:16.277816 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:46:16.277798 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4e8099a9-2b87-472a-89a4-49befc2d2fc3-service-ca\") pod \"4e8099a9-2b87-472a-89a4-49befc2d2fc3\" (UID: \"4e8099a9-2b87-472a-89a4-49befc2d2fc3\") " Jul 24 13:46:16.278056 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:46:16.277833 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-25g5n\" (UniqueName: \"kubernetes.io/projected/4e8099a9-2b87-472a-89a4-49befc2d2fc3-kube-api-access-25g5n\") pod \"4e8099a9-2b87-472a-89a4-49befc2d2fc3\" (UID: \"4e8099a9-2b87-472a-89a4-49befc2d2fc3\") " Jul 24 13:46:16.278172 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:46:16.278138 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4e8099a9-2b87-472a-89a4-49befc2d2fc3-console-config" (OuterVolumeSpecName: "console-config") pod "4e8099a9-2b87-472a-89a4-49befc2d2fc3" (UID: "4e8099a9-2b87-472a-89a4-49befc2d2fc3"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 13:46:16.278172 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:46:16.278154 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4e8099a9-2b87-472a-89a4-49befc2d2fc3-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "4e8099a9-2b87-472a-89a4-49befc2d2fc3" (UID: "4e8099a9-2b87-472a-89a4-49befc2d2fc3"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 13:46:16.278172 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:46:16.278147 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4e8099a9-2b87-472a-89a4-49befc2d2fc3-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "4e8099a9-2b87-472a-89a4-49befc2d2fc3" (UID: "4e8099a9-2b87-472a-89a4-49befc2d2fc3"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 13:46:16.278348 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:46:16.278211 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4e8099a9-2b87-472a-89a4-49befc2d2fc3-service-ca" (OuterVolumeSpecName: "service-ca") pod "4e8099a9-2b87-472a-89a4-49befc2d2fc3" (UID: "4e8099a9-2b87-472a-89a4-49befc2d2fc3"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 13:46:16.279862 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:46:16.279836 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4e8099a9-2b87-472a-89a4-49befc2d2fc3-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "4e8099a9-2b87-472a-89a4-49befc2d2fc3" (UID: "4e8099a9-2b87-472a-89a4-49befc2d2fc3"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 13:46:16.279945 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:46:16.279888 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4e8099a9-2b87-472a-89a4-49befc2d2fc3-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "4e8099a9-2b87-472a-89a4-49befc2d2fc3" (UID: "4e8099a9-2b87-472a-89a4-49befc2d2fc3"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 13:46:16.280038 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:46:16.280021 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4e8099a9-2b87-472a-89a4-49befc2d2fc3-kube-api-access-25g5n" (OuterVolumeSpecName: "kube-api-access-25g5n") pod "4e8099a9-2b87-472a-89a4-49befc2d2fc3" (UID: "4e8099a9-2b87-472a-89a4-49befc2d2fc3"). InnerVolumeSpecName "kube-api-access-25g5n". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 13:46:16.378630 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:46:16.378579 2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4e8099a9-2b87-472a-89a4-49befc2d2fc3-oauth-serving-cert\") on node \"ip-10-0-129-93.ec2.internal\" DevicePath \"\"" Jul 24 13:46:16.378630 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:46:16.378624 2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4e8099a9-2b87-472a-89a4-49befc2d2fc3-service-ca\") on node \"ip-10-0-129-93.ec2.internal\" DevicePath \"\"" Jul 24 13:46:16.378630 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:46:16.378637 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-25g5n\" (UniqueName: \"kubernetes.io/projected/4e8099a9-2b87-472a-89a4-49befc2d2fc3-kube-api-access-25g5n\") on node \"ip-10-0-129-93.ec2.internal\" DevicePath \"\"" Jul 24 13:46:16.378630 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:46:16.378646 2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4e8099a9-2b87-472a-89a4-49befc2d2fc3-console-serving-cert\") on node \"ip-10-0-129-93.ec2.internal\" DevicePath \"\"" Jul 24 13:46:16.378892 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:46:16.378656 2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4e8099a9-2b87-472a-89a4-49befc2d2fc3-console-oauth-config\") on node \"ip-10-0-129-93.ec2.internal\" DevicePath \"\"" Jul 24 13:46:16.378892 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:46:16.378665 2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4e8099a9-2b87-472a-89a4-49befc2d2fc3-console-config\") on node \"ip-10-0-129-93.ec2.internal\" DevicePath \"\"" Jul 24 13:46:16.378892 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:46:16.378674 2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e8099a9-2b87-472a-89a4-49befc2d2fc3-trusted-ca-bundle\") on node \"ip-10-0-129-93.ec2.internal\" DevicePath \"\"" Jul 24 13:46:16.979335 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:46:16.979304 2578 generic.go:356] "Generic (PLEG): container finished" podID="4e8099a9-2b87-472a-89a4-49befc2d2fc3" containerID="66272280054d6d0008124a3cce55c2a538da621b19ce9033702dcd98b56665b7" exitCode=0 Jul 24 13:46:16.979765 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:46:16.979350 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75d9687d6c-j9ns4" Jul 24 13:46:16.979765 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:46:16.979370 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75d9687d6c-j9ns4" event={"ID":"4e8099a9-2b87-472a-89a4-49befc2d2fc3","Type":"ContainerDied","Data":"66272280054d6d0008124a3cce55c2a538da621b19ce9033702dcd98b56665b7"} Jul 24 13:46:16.979765 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:46:16.979425 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75d9687d6c-j9ns4" event={"ID":"4e8099a9-2b87-472a-89a4-49befc2d2fc3","Type":"ContainerDied","Data":"fcf53c7c0ff34ca82a229d171bebe1808d4f691004ed3c05422f9991cb906ae0"} Jul 24 13:46:16.979765 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:46:16.979446 2578 scope.go:117] "RemoveContainer" containerID="66272280054d6d0008124a3cce55c2a538da621b19ce9033702dcd98b56665b7" Jul 24 13:46:16.988007 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:46:16.987982 2578 scope.go:117] "RemoveContainer" containerID="66272280054d6d0008124a3cce55c2a538da621b19ce9033702dcd98b56665b7" Jul 24 13:46:16.988283 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:46:16.988264 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"66272280054d6d0008124a3cce55c2a538da621b19ce9033702dcd98b56665b7\": container with ID starting with 66272280054d6d0008124a3cce55c2a538da621b19ce9033702dcd98b56665b7 not found: ID does not exist" containerID="66272280054d6d0008124a3cce55c2a538da621b19ce9033702dcd98b56665b7" Jul 24 13:46:16.988334 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:46:16.988292 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66272280054d6d0008124a3cce55c2a538da621b19ce9033702dcd98b56665b7"} err="failed to get container status \"66272280054d6d0008124a3cce55c2a538da621b19ce9033702dcd98b56665b7\": rpc error: code = NotFound desc = could not find container \"66272280054d6d0008124a3cce55c2a538da621b19ce9033702dcd98b56665b7\": container with ID starting with 66272280054d6d0008124a3cce55c2a538da621b19ce9033702dcd98b56665b7 not found: ID does not exist" Jul 24 13:46:16.994089 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:46:16.994065 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-75d9687d6c-j9ns4"] Jul 24 13:46:16.998135 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:46:16.998112 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-75d9687d6c-j9ns4"] Jul 24 13:46:18.919852 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:46:18.919817 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4e8099a9-2b87-472a-89a4-49befc2d2fc3" path="/var/lib/kubelet/pods/4e8099a9-2b87-472a-89a4-49befc2d2fc3/volumes" Jul 24 13:46:38.176151 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:46:38.176120 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:46:38.191263 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:46:38.191242 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:46:39.087619 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:46:39.087593 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:47:01.424221 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:47:01.424186 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-58dq5"] Jul 24 13:47:01.424692 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:47:01.424552 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e8099a9-2b87-472a-89a4-49befc2d2fc3" containerName="console" Jul 24 13:47:01.424692 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:47:01.424564 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e8099a9-2b87-472a-89a4-49befc2d2fc3" containerName="console" Jul 24 13:47:01.424692 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:47:01.424647 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="4e8099a9-2b87-472a-89a4-49befc2d2fc3" containerName="console" Jul 24 13:47:01.429334 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:47:01.429316 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-58dq5" Jul 24 13:47:01.431527 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:47:01.431504 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 24 13:47:01.432049 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:47:01.432028 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-8wtnf\"" Jul 24 13:47:01.432049 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:47:01.432044 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 24 13:47:01.434925 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:47:01.434901 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-58dq5"] Jul 24 13:47:01.571538 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:47:01.571502 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/58f16072-4219-4df4-b5aa-8307ba4fbec2-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-58dq5\" (UID: \"58f16072-4219-4df4-b5aa-8307ba4fbec2\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-58dq5" Jul 24 13:47:01.571538 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:47:01.571539 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-crnwx\" (UniqueName: \"kubernetes.io/projected/58f16072-4219-4df4-b5aa-8307ba4fbec2-kube-api-access-crnwx\") pod \"cert-manager-cainjector-559cdd8c87-58dq5\" (UID: \"58f16072-4219-4df4-b5aa-8307ba4fbec2\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-58dq5" Jul 24 13:47:01.672652 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:47:01.672611 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/58f16072-4219-4df4-b5aa-8307ba4fbec2-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-58dq5\" (UID: \"58f16072-4219-4df4-b5aa-8307ba4fbec2\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-58dq5" Jul 24 13:47:01.672826 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:47:01.672657 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-crnwx\" (UniqueName: \"kubernetes.io/projected/58f16072-4219-4df4-b5aa-8307ba4fbec2-kube-api-access-crnwx\") pod \"cert-manager-cainjector-559cdd8c87-58dq5\" (UID: \"58f16072-4219-4df4-b5aa-8307ba4fbec2\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-58dq5" Jul 24 13:47:01.680989 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:47:01.680917 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/58f16072-4219-4df4-b5aa-8307ba4fbec2-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-58dq5\" (UID: \"58f16072-4219-4df4-b5aa-8307ba4fbec2\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-58dq5" Jul 24 13:47:01.680989 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:47:01.680964 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-crnwx\" (UniqueName: \"kubernetes.io/projected/58f16072-4219-4df4-b5aa-8307ba4fbec2-kube-api-access-crnwx\") pod \"cert-manager-cainjector-559cdd8c87-58dq5\" (UID: \"58f16072-4219-4df4-b5aa-8307ba4fbec2\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-58dq5" Jul 24 13:47:01.754954 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:47:01.754923 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-58dq5" Jul 24 13:47:01.882159 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:47:01.882129 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-58dq5"] Jul 24 13:47:01.884836 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:47:01.884808 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod58f16072_4219_4df4_b5aa_8307ba4fbec2.slice/crio-4c46e8a8b0563c660cacfab88d840d92088800ca4aece2e9623d847848705ea9 WatchSource:0}: Error finding container 4c46e8a8b0563c660cacfab88d840d92088800ca4aece2e9623d847848705ea9: Status 404 returned error can't find the container with id 4c46e8a8b0563c660cacfab88d840d92088800ca4aece2e9623d847848705ea9 Jul 24 13:47:02.166167 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:47:02.166136 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-58dq5" event={"ID":"58f16072-4219-4df4-b5aa-8307ba4fbec2","Type":"ContainerStarted","Data":"4c46e8a8b0563c660cacfab88d840d92088800ca4aece2e9623d847848705ea9"} Jul 24 13:47:05.181519 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:47:05.181473 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-58dq5" event={"ID":"58f16072-4219-4df4-b5aa-8307ba4fbec2","Type":"ContainerStarted","Data":"4f653a4ecfecea4830bfe2c7e33930f91e9b613199394307d2089a16bdf9006a"} Jul 24 13:47:05.198963 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:47:05.198910 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-58dq5" podStartSLOduration=1.275079628 podStartE2EDuration="4.19889435s" totalImagesPullingTime="2.923814722s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 13:47:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:47:05.197217914 +0000 UTC m=+232.855195299" watchObservedRunningTime="2026-07-24 13:47:05.19889435 +0000 UTC m=+232.856871735" Jul 24 13:47:11.058969 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:47:11.058926 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-c4zjp"] Jul 24 13:47:11.062303 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:47:11.062283 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-c4zjp" Jul 24 13:47:11.064227 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:47:11.064209 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-m8p55\"" Jul 24 13:47:11.071853 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:47:11.071830 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-c4zjp"] Jul 24 13:47:11.160698 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:47:11.160662 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/58636bb9-4e4b-4c9c-b53c-0bd526f231c3-bound-sa-token\") pod \"cert-manager-55b4d954d5-c4zjp\" (UID: \"58636bb9-4e4b-4c9c-b53c-0bd526f231c3\") " pod="cert-manager/cert-manager-55b4d954d5-c4zjp" Jul 24 13:47:11.160698 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:47:11.160697 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4dnhf\" (UniqueName: \"kubernetes.io/projected/58636bb9-4e4b-4c9c-b53c-0bd526f231c3-kube-api-access-4dnhf\") pod \"cert-manager-55b4d954d5-c4zjp\" (UID: \"58636bb9-4e4b-4c9c-b53c-0bd526f231c3\") " pod="cert-manager/cert-manager-55b4d954d5-c4zjp" Jul 24 13:47:11.261466 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:47:11.261434 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/58636bb9-4e4b-4c9c-b53c-0bd526f231c3-bound-sa-token\") pod \"cert-manager-55b4d954d5-c4zjp\" (UID: \"58636bb9-4e4b-4c9c-b53c-0bd526f231c3\") " pod="cert-manager/cert-manager-55b4d954d5-c4zjp" Jul 24 13:47:11.261466 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:47:11.261467 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4dnhf\" (UniqueName: \"kubernetes.io/projected/58636bb9-4e4b-4c9c-b53c-0bd526f231c3-kube-api-access-4dnhf\") pod \"cert-manager-55b4d954d5-c4zjp\" (UID: \"58636bb9-4e4b-4c9c-b53c-0bd526f231c3\") " pod="cert-manager/cert-manager-55b4d954d5-c4zjp" Jul 24 13:47:11.269826 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:47:11.269801 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/58636bb9-4e4b-4c9c-b53c-0bd526f231c3-bound-sa-token\") pod \"cert-manager-55b4d954d5-c4zjp\" (UID: \"58636bb9-4e4b-4c9c-b53c-0bd526f231c3\") " pod="cert-manager/cert-manager-55b4d954d5-c4zjp" Jul 24 13:47:11.269932 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:47:11.269840 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4dnhf\" (UniqueName: \"kubernetes.io/projected/58636bb9-4e4b-4c9c-b53c-0bd526f231c3-kube-api-access-4dnhf\") pod \"cert-manager-55b4d954d5-c4zjp\" (UID: \"58636bb9-4e4b-4c9c-b53c-0bd526f231c3\") " pod="cert-manager/cert-manager-55b4d954d5-c4zjp" Jul 24 13:47:11.371712 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:47:11.371629 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-c4zjp" Jul 24 13:47:11.504002 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:47:11.503983 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-c4zjp"] Jul 24 13:47:11.506828 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:47:11.506799 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod58636bb9_4e4b_4c9c_b53c_0bd526f231c3.slice/crio-aa86bde4a5985f3bcaee48344d6c64ca9f0b87f77f30dbea79d48c2a7fe1cdba WatchSource:0}: Error finding container aa86bde4a5985f3bcaee48344d6c64ca9f0b87f77f30dbea79d48c2a7fe1cdba: Status 404 returned error can't find the container with id aa86bde4a5985f3bcaee48344d6c64ca9f0b87f77f30dbea79d48c2a7fe1cdba Jul 24 13:47:12.210876 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:47:12.210838 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-c4zjp" event={"ID":"58636bb9-4e4b-4c9c-b53c-0bd526f231c3","Type":"ContainerStarted","Data":"6ada9c28ff49c7395bbff0e9b292ae61d2e118e8645773db40b436d44c74bec4"} Jul 24 13:47:12.211248 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:47:12.210889 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-c4zjp" event={"ID":"58636bb9-4e4b-4c9c-b53c-0bd526f231c3","Type":"ContainerStarted","Data":"aa86bde4a5985f3bcaee48344d6c64ca9f0b87f77f30dbea79d48c2a7fe1cdba"} Jul 24 13:47:12.227899 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:47:12.227852 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-c4zjp" podStartSLOduration=1.22783534 podStartE2EDuration="1.22783534s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 13:47:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:47:12.22582818 +0000 UTC m=+239.883805565" watchObservedRunningTime="2026-07-24 13:47:12.22783534 +0000 UTC m=+239.885812724" Jul 24 13:47:31.150873 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:47:31.150832 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-674cffbf7-glh2v"] Jul 24 13:47:31.155926 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:47:31.155901 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-674cffbf7-glh2v" Jul 24 13:47:31.162167 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:47:31.162137 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 24 13:47:31.162305 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:47:31.162200 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 24 13:47:31.162382 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:47:31.162330 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 24 13:47:31.162382 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:47:31.162327 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 24 13:47:31.162946 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:47:31.162926 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-665mt\"" Jul 24 13:47:31.181931 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:47:31.181907 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-674cffbf7-glh2v"] Jul 24 13:47:31.234482 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:47:31.234451 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/447af81e-0c84-44c7-83e7-d2da205b57e5-tmp\") pod \"opendatahub-operator-controller-manager-674cffbf7-glh2v\" (UID: \"447af81e-0c84-44c7-83e7-d2da205b57e5\") " pod="opendatahub/opendatahub-operator-controller-manager-674cffbf7-glh2v" Jul 24 13:47:31.234655 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:47:31.234494 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/447af81e-0c84-44c7-83e7-d2da205b57e5-webhook-cert\") pod \"opendatahub-operator-controller-manager-674cffbf7-glh2v\" (UID: \"447af81e-0c84-44c7-83e7-d2da205b57e5\") " pod="opendatahub/opendatahub-operator-controller-manager-674cffbf7-glh2v" Jul 24 13:47:31.234655 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:47:31.234627 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/447af81e-0c84-44c7-83e7-d2da205b57e5-manifests\") pod \"opendatahub-operator-controller-manager-674cffbf7-glh2v\" (UID: \"447af81e-0c84-44c7-83e7-d2da205b57e5\") " pod="opendatahub/opendatahub-operator-controller-manager-674cffbf7-glh2v" Jul 24 13:47:31.234729 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:47:31.234660 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/447af81e-0c84-44c7-83e7-d2da205b57e5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-674cffbf7-glh2v\" (UID: \"447af81e-0c84-44c7-83e7-d2da205b57e5\") " pod="opendatahub/opendatahub-operator-controller-manager-674cffbf7-glh2v" Jul 24 13:47:31.234729 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:47:31.234691 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nd9hb\" (UniqueName: \"kubernetes.io/projected/447af81e-0c84-44c7-83e7-d2da205b57e5-kube-api-access-nd9hb\") pod \"opendatahub-operator-controller-manager-674cffbf7-glh2v\" (UID: \"447af81e-0c84-44c7-83e7-d2da205b57e5\") " pod="opendatahub/opendatahub-operator-controller-manager-674cffbf7-glh2v" Jul 24 13:47:31.335392 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:47:31.335357 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/447af81e-0c84-44c7-83e7-d2da205b57e5-manifests\") pod \"opendatahub-operator-controller-manager-674cffbf7-glh2v\" (UID: \"447af81e-0c84-44c7-83e7-d2da205b57e5\") " pod="opendatahub/opendatahub-operator-controller-manager-674cffbf7-glh2v" Jul 24 13:47:31.335392 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:47:31.335393 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/447af81e-0c84-44c7-83e7-d2da205b57e5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-674cffbf7-glh2v\" (UID: \"447af81e-0c84-44c7-83e7-d2da205b57e5\") " pod="opendatahub/opendatahub-operator-controller-manager-674cffbf7-glh2v" Jul 24 13:47:31.335655 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:47:31.335437 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nd9hb\" (UniqueName: \"kubernetes.io/projected/447af81e-0c84-44c7-83e7-d2da205b57e5-kube-api-access-nd9hb\") pod \"opendatahub-operator-controller-manager-674cffbf7-glh2v\" (UID: \"447af81e-0c84-44c7-83e7-d2da205b57e5\") " pod="opendatahub/opendatahub-operator-controller-manager-674cffbf7-glh2v" Jul 24 13:47:31.335655 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:47:31.335465 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/447af81e-0c84-44c7-83e7-d2da205b57e5-tmp\") pod \"opendatahub-operator-controller-manager-674cffbf7-glh2v\" (UID: \"447af81e-0c84-44c7-83e7-d2da205b57e5\") " pod="opendatahub/opendatahub-operator-controller-manager-674cffbf7-glh2v" Jul 24 13:47:31.335655 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:47:31.335492 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/447af81e-0c84-44c7-83e7-d2da205b57e5-webhook-cert\") pod \"opendatahub-operator-controller-manager-674cffbf7-glh2v\" (UID: \"447af81e-0c84-44c7-83e7-d2da205b57e5\") " pod="opendatahub/opendatahub-operator-controller-manager-674cffbf7-glh2v" Jul 24 13:47:31.335831 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:47:31.335808 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/447af81e-0c84-44c7-83e7-d2da205b57e5-manifests\") pod \"opendatahub-operator-controller-manager-674cffbf7-glh2v\" (UID: \"447af81e-0c84-44c7-83e7-d2da205b57e5\") " pod="opendatahub/opendatahub-operator-controller-manager-674cffbf7-glh2v" Jul 24 13:47:31.337680 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:47:31.337652 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/447af81e-0c84-44c7-83e7-d2da205b57e5-tmp\") pod \"opendatahub-operator-controller-manager-674cffbf7-glh2v\" (UID: \"447af81e-0c84-44c7-83e7-d2da205b57e5\") " pod="opendatahub/opendatahub-operator-controller-manager-674cffbf7-glh2v" Jul 24 13:47:31.337880 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:47:31.337862 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/447af81e-0c84-44c7-83e7-d2da205b57e5-webhook-cert\") pod \"opendatahub-operator-controller-manager-674cffbf7-glh2v\" (UID: \"447af81e-0c84-44c7-83e7-d2da205b57e5\") " pod="opendatahub/opendatahub-operator-controller-manager-674cffbf7-glh2v" Jul 24 13:47:31.337925 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:47:31.337885 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/447af81e-0c84-44c7-83e7-d2da205b57e5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-674cffbf7-glh2v\" (UID: \"447af81e-0c84-44c7-83e7-d2da205b57e5\") " pod="opendatahub/opendatahub-operator-controller-manager-674cffbf7-glh2v" Jul 24 13:47:31.349571 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:47:31.349539 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nd9hb\" (UniqueName: \"kubernetes.io/projected/447af81e-0c84-44c7-83e7-d2da205b57e5-kube-api-access-nd9hb\") pod \"opendatahub-operator-controller-manager-674cffbf7-glh2v\" (UID: \"447af81e-0c84-44c7-83e7-d2da205b57e5\") " pod="opendatahub/opendatahub-operator-controller-manager-674cffbf7-glh2v" Jul 24 13:47:31.472482 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:47:31.472356 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-674cffbf7-glh2v" Jul 24 13:47:31.610365 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:47:31.610340 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-674cffbf7-glh2v"] Jul 24 13:47:31.614210 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:47:31.614182 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod447af81e_0c84_44c7_83e7_d2da205b57e5.slice/crio-a02364cbb63cc6fafb8d662683df2c3f60131c7c88c7f7df478a1b9c1e366503 WatchSource:0}: Error finding container a02364cbb63cc6fafb8d662683df2c3f60131c7c88c7f7df478a1b9c1e366503: Status 404 returned error can't find the container with id a02364cbb63cc6fafb8d662683df2c3f60131c7c88c7f7df478a1b9c1e366503 Jul 24 13:47:32.304384 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:47:32.304346 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-674cffbf7-glh2v" event={"ID":"447af81e-0c84-44c7-83e7-d2da205b57e5","Type":"ContainerStarted","Data":"a02364cbb63cc6fafb8d662683df2c3f60131c7c88c7f7df478a1b9c1e366503"} Jul 24 13:47:35.324373 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:47:35.324334 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-674cffbf7-glh2v" event={"ID":"447af81e-0c84-44c7-83e7-d2da205b57e5","Type":"ContainerStarted","Data":"cf77d812334427fdaec792bf6858c756d7929bfa66de0a1cc1233e351ee21a46"} Jul 24 13:47:36.331711 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:47:36.331668 2578 generic.go:356] "Generic (PLEG): container finished" podID="447af81e-0c84-44c7-83e7-d2da205b57e5" containerID="cf77d812334427fdaec792bf6858c756d7929bfa66de0a1cc1233e351ee21a46" exitCode=0 Jul 24 13:47:36.332115 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:47:36.331759 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-674cffbf7-glh2v" event={"ID":"447af81e-0c84-44c7-83e7-d2da205b57e5","Type":"ContainerDied","Data":"cf77d812334427fdaec792bf6858c756d7929bfa66de0a1cc1233e351ee21a46"} Jul 24 13:47:37.338388 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:47:37.338346 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-674cffbf7-glh2v" event={"ID":"447af81e-0c84-44c7-83e7-d2da205b57e5","Type":"ContainerStarted","Data":"68ac41a7f725cc936da13c0dcc6c2035b6078a20ee5982a8a99477cb8c7e621f"} Jul 24 13:47:37.338817 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:47:37.338466 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-674cffbf7-glh2v" Jul 24 13:47:37.361083 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:47:37.360998 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-674cffbf7-glh2v" podStartSLOduration=1.92548486 podStartE2EDuration="6.360983994s" totalImagesPullingTime="3.347953552s" totalInitContainerRuntime="1.087545582s" isStatefulPod=false podCreationTimestamp="2026-07-24 13:47:31 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:47:37.360122609 +0000 UTC m=+265.018099995" watchObservedRunningTime="2026-07-24 13:47:37.360983994 +0000 UTC m=+265.018961379" Jul 24 13:47:48.344885 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:47:48.344856 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-674cffbf7-glh2v" Jul 24 13:47:59.128533 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:47:59.128496 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-78d5cc8c46-z527r"] Jul 24 13:47:59.139454 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:47:59.139431 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-78d5cc8c46-z527r" Jul 24 13:47:59.142450 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:47:59.142424 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-78d5cc8c46-z527r"] Jul 24 13:47:59.144356 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:47:59.144333 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 24 13:47:59.145034 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:47:59.145013 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 24 13:47:59.145288 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:47:59.145264 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 24 13:47:59.145376 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:47:59.145333 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 24 13:47:59.145463 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:47:59.145396 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 24 13:47:59.145944 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:47:59.145918 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-nbxhg\"" Jul 24 13:47:59.307309 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:47:59.307265 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/599a43d4-b4c3-4275-8c4e-35c20f3fb2cb-manager-config\") pod \"lws-controller-manager-78d5cc8c46-z527r\" (UID: \"599a43d4-b4c3-4275-8c4e-35c20f3fb2cb\") " pod="openshift-lws-operator/lws-controller-manager-78d5cc8c46-z527r" Jul 24 13:47:59.307309 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:47:59.307309 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/599a43d4-b4c3-4275-8c4e-35c20f3fb2cb-cert\") pod \"lws-controller-manager-78d5cc8c46-z527r\" (UID: \"599a43d4-b4c3-4275-8c4e-35c20f3fb2cb\") " pod="openshift-lws-operator/lws-controller-manager-78d5cc8c46-z527r" Jul 24 13:47:59.307576 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:47:59.307330 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f9n84\" (UniqueName: \"kubernetes.io/projected/599a43d4-b4c3-4275-8c4e-35c20f3fb2cb-kube-api-access-f9n84\") pod \"lws-controller-manager-78d5cc8c46-z527r\" (UID: \"599a43d4-b4c3-4275-8c4e-35c20f3fb2cb\") " pod="openshift-lws-operator/lws-controller-manager-78d5cc8c46-z527r" Jul 24 13:47:59.307576 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:47:59.307444 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/599a43d4-b4c3-4275-8c4e-35c20f3fb2cb-metrics-cert\") pod \"lws-controller-manager-78d5cc8c46-z527r\" (UID: \"599a43d4-b4c3-4275-8c4e-35c20f3fb2cb\") " pod="openshift-lws-operator/lws-controller-manager-78d5cc8c46-z527r" Jul 24 13:47:59.408599 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:47:59.408568 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/599a43d4-b4c3-4275-8c4e-35c20f3fb2cb-metrics-cert\") pod \"lws-controller-manager-78d5cc8c46-z527r\" (UID: \"599a43d4-b4c3-4275-8c4e-35c20f3fb2cb\") " pod="openshift-lws-operator/lws-controller-manager-78d5cc8c46-z527r" Jul 24 13:47:59.408722 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:47:59.408638 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/599a43d4-b4c3-4275-8c4e-35c20f3fb2cb-manager-config\") pod \"lws-controller-manager-78d5cc8c46-z527r\" (UID: \"599a43d4-b4c3-4275-8c4e-35c20f3fb2cb\") " pod="openshift-lws-operator/lws-controller-manager-78d5cc8c46-z527r" Jul 24 13:47:59.408722 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:47:59.408660 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/599a43d4-b4c3-4275-8c4e-35c20f3fb2cb-cert\") pod \"lws-controller-manager-78d5cc8c46-z527r\" (UID: \"599a43d4-b4c3-4275-8c4e-35c20f3fb2cb\") " pod="openshift-lws-operator/lws-controller-manager-78d5cc8c46-z527r" Jul 24 13:47:59.408722 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:47:59.408677 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f9n84\" (UniqueName: \"kubernetes.io/projected/599a43d4-b4c3-4275-8c4e-35c20f3fb2cb-kube-api-access-f9n84\") pod \"lws-controller-manager-78d5cc8c46-z527r\" (UID: \"599a43d4-b4c3-4275-8c4e-35c20f3fb2cb\") " pod="openshift-lws-operator/lws-controller-manager-78d5cc8c46-z527r" Jul 24 13:47:59.409474 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:47:59.409451 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/599a43d4-b4c3-4275-8c4e-35c20f3fb2cb-manager-config\") pod \"lws-controller-manager-78d5cc8c46-z527r\" (UID: \"599a43d4-b4c3-4275-8c4e-35c20f3fb2cb\") " pod="openshift-lws-operator/lws-controller-manager-78d5cc8c46-z527r" Jul 24 13:47:59.411043 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:47:59.411023 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/599a43d4-b4c3-4275-8c4e-35c20f3fb2cb-cert\") pod \"lws-controller-manager-78d5cc8c46-z527r\" (UID: \"599a43d4-b4c3-4275-8c4e-35c20f3fb2cb\") " pod="openshift-lws-operator/lws-controller-manager-78d5cc8c46-z527r" Jul 24 13:47:59.411120 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:47:59.411071 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/599a43d4-b4c3-4275-8c4e-35c20f3fb2cb-metrics-cert\") pod \"lws-controller-manager-78d5cc8c46-z527r\" (UID: \"599a43d4-b4c3-4275-8c4e-35c20f3fb2cb\") " pod="openshift-lws-operator/lws-controller-manager-78d5cc8c46-z527r" Jul 24 13:47:59.428549 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:47:59.428520 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f9n84\" (UniqueName: \"kubernetes.io/projected/599a43d4-b4c3-4275-8c4e-35c20f3fb2cb-kube-api-access-f9n84\") pod \"lws-controller-manager-78d5cc8c46-z527r\" (UID: \"599a43d4-b4c3-4275-8c4e-35c20f3fb2cb\") " pod="openshift-lws-operator/lws-controller-manager-78d5cc8c46-z527r" Jul 24 13:47:59.450103 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:47:59.450081 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-78d5cc8c46-z527r" Jul 24 13:47:59.586475 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:47:59.586437 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-78d5cc8c46-z527r"] Jul 24 13:47:59.590214 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:47:59.590179 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod599a43d4_b4c3_4275_8c4e_35c20f3fb2cb.slice/crio-58883023d0c88ae53c0310345755346e0b80c671248e583ad70b2fae50de4be3 WatchSource:0}: Error finding container 58883023d0c88ae53c0310345755346e0b80c671248e583ad70b2fae50de4be3: Status 404 returned error can't find the container with id 58883023d0c88ae53c0310345755346e0b80c671248e583ad70b2fae50de4be3 Jul 24 13:48:00.450035 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:48:00.449921 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-78d5cc8c46-z527r" event={"ID":"599a43d4-b4c3-4275-8c4e-35c20f3fb2cb","Type":"ContainerStarted","Data":"58883023d0c88ae53c0310345755346e0b80c671248e583ad70b2fae50de4be3"} Jul 24 13:48:00.484223 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:48:00.483800 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-d5qvz"] Jul 24 13:48:00.487774 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:48:00.487754 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-d5qvz" Jul 24 13:48:00.504858 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:48:00.504730 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 24 13:48:00.504858 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:48:00.504766 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 24 13:48:00.505762 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:48:00.505630 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 24 13:48:00.505762 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:48:00.505644 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 24 13:48:00.507932 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:48:00.507911 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 24 13:48:00.508038 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:48:00.507966 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 24 13:48:00.509110 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:48:00.509089 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-jfc2f\"" Jul 24 13:48:00.519555 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:48:00.519528 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1e1f60ae-98f7-4d09-ae53-4dbc0acb1528-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-d5qvz\" (UID: \"1e1f60ae-98f7-4d09-ae53-4dbc0acb1528\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-d5qvz" Jul 24 13:48:00.519678 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:48:00.519593 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7jszx\" (UniqueName: \"kubernetes.io/projected/1e1f60ae-98f7-4d09-ae53-4dbc0acb1528-kube-api-access-7jszx\") pod \"istiod-openshift-gateway-5677ccb49b-d5qvz\" (UID: \"1e1f60ae-98f7-4d09-ae53-4dbc0acb1528\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-d5qvz" Jul 24 13:48:00.519678 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:48:00.519635 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1e1f60ae-98f7-4d09-ae53-4dbc0acb1528-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-d5qvz\" (UID: \"1e1f60ae-98f7-4d09-ae53-4dbc0acb1528\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-d5qvz" Jul 24 13:48:00.519678 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:48:00.519665 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1e1f60ae-98f7-4d09-ae53-4dbc0acb1528-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-d5qvz\" (UID: \"1e1f60ae-98f7-4d09-ae53-4dbc0acb1528\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-d5qvz" Jul 24 13:48:00.519847 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:48:00.519709 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1e1f60ae-98f7-4d09-ae53-4dbc0acb1528-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-d5qvz\" (UID: \"1e1f60ae-98f7-4d09-ae53-4dbc0acb1528\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-d5qvz" Jul 24 13:48:00.519847 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:48:00.519739 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1e1f60ae-98f7-4d09-ae53-4dbc0acb1528-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-d5qvz\" (UID: \"1e1f60ae-98f7-4d09-ae53-4dbc0acb1528\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-d5qvz" Jul 24 13:48:00.519847 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:48:00.519779 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1e1f60ae-98f7-4d09-ae53-4dbc0acb1528-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-d5qvz\" (UID: \"1e1f60ae-98f7-4d09-ae53-4dbc0acb1528\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-d5qvz" Jul 24 13:48:00.520145 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:48:00.520123 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-d5qvz"] Jul 24 13:48:00.621474 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:48:00.621122 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7jszx\" (UniqueName: \"kubernetes.io/projected/1e1f60ae-98f7-4d09-ae53-4dbc0acb1528-kube-api-access-7jszx\") pod \"istiod-openshift-gateway-5677ccb49b-d5qvz\" (UID: \"1e1f60ae-98f7-4d09-ae53-4dbc0acb1528\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-d5qvz" Jul 24 13:48:00.621474 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:48:00.621182 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1e1f60ae-98f7-4d09-ae53-4dbc0acb1528-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-d5qvz\" (UID: \"1e1f60ae-98f7-4d09-ae53-4dbc0acb1528\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-d5qvz" Jul 24 13:48:00.621474 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:48:00.621211 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1e1f60ae-98f7-4d09-ae53-4dbc0acb1528-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-d5qvz\" (UID: \"1e1f60ae-98f7-4d09-ae53-4dbc0acb1528\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-d5qvz" Jul 24 13:48:00.621474 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:48:00.621257 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1e1f60ae-98f7-4d09-ae53-4dbc0acb1528-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-d5qvz\" (UID: \"1e1f60ae-98f7-4d09-ae53-4dbc0acb1528\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-d5qvz" Jul 24 13:48:00.621474 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:48:00.621293 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1e1f60ae-98f7-4d09-ae53-4dbc0acb1528-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-d5qvz\" (UID: \"1e1f60ae-98f7-4d09-ae53-4dbc0acb1528\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-d5qvz" Jul 24 13:48:00.621474 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:48:00.621450 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1e1f60ae-98f7-4d09-ae53-4dbc0acb1528-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-d5qvz\" (UID: \"1e1f60ae-98f7-4d09-ae53-4dbc0acb1528\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-d5qvz" Jul 24 13:48:00.621988 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:48:00.621551 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1e1f60ae-98f7-4d09-ae53-4dbc0acb1528-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-d5qvz\" (UID: \"1e1f60ae-98f7-4d09-ae53-4dbc0acb1528\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-d5qvz" Jul 24 13:48:00.622085 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:48:00.622057 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1e1f60ae-98f7-4d09-ae53-4dbc0acb1528-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-d5qvz\" (UID: \"1e1f60ae-98f7-4d09-ae53-4dbc0acb1528\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-d5qvz" Jul 24 13:48:00.625219 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:48:00.625066 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1e1f60ae-98f7-4d09-ae53-4dbc0acb1528-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-d5qvz\" (UID: \"1e1f60ae-98f7-4d09-ae53-4dbc0acb1528\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-d5qvz" Jul 24 13:48:00.625219 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:48:00.625150 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1e1f60ae-98f7-4d09-ae53-4dbc0acb1528-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-d5qvz\" (UID: \"1e1f60ae-98f7-4d09-ae53-4dbc0acb1528\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-d5qvz" Jul 24 13:48:00.625219 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:48:00.625157 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1e1f60ae-98f7-4d09-ae53-4dbc0acb1528-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-d5qvz\" (UID: \"1e1f60ae-98f7-4d09-ae53-4dbc0acb1528\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-d5qvz" Jul 24 13:48:00.625468 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:48:00.625315 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1e1f60ae-98f7-4d09-ae53-4dbc0acb1528-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-d5qvz\" (UID: \"1e1f60ae-98f7-4d09-ae53-4dbc0acb1528\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-d5qvz" Jul 24 13:48:00.641774 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:48:00.641731 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1e1f60ae-98f7-4d09-ae53-4dbc0acb1528-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-d5qvz\" (UID: \"1e1f60ae-98f7-4d09-ae53-4dbc0acb1528\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-d5qvz" Jul 24 13:48:00.643560 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:48:00.643537 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7jszx\" (UniqueName: \"kubernetes.io/projected/1e1f60ae-98f7-4d09-ae53-4dbc0acb1528-kube-api-access-7jszx\") pod \"istiod-openshift-gateway-5677ccb49b-d5qvz\" (UID: \"1e1f60ae-98f7-4d09-ae53-4dbc0acb1528\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-d5qvz" Jul 24 13:48:00.800883 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:48:00.800796 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-d5qvz" Jul 24 13:48:00.957601 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:48:00.957564 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-d5qvz"] Jul 24 13:48:01.925186 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:48:01.925146 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e1f60ae_98f7_4d09_ae53_4dbc0acb1528.slice/crio-a34cf7b70d8efac8afa8a22dbeb183a297842937400e2ddfe8a4f5da1f5279da WatchSource:0}: Error finding container a34cf7b70d8efac8afa8a22dbeb183a297842937400e2ddfe8a4f5da1f5279da: Status 404 returned error can't find the container with id a34cf7b70d8efac8afa8a22dbeb183a297842937400e2ddfe8a4f5da1f5279da Jul 24 13:48:02.461714 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:48:02.461674 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-78d5cc8c46-z527r" event={"ID":"599a43d4-b4c3-4275-8c4e-35c20f3fb2cb","Type":"ContainerStarted","Data":"f1e2673c465fb075c828f3de7071f30f1359c4ccc22ad0ad0aa344cd9f21c75c"} Jul 24 13:48:02.461921 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:48:02.461845 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-78d5cc8c46-z527r" Jul 24 13:48:02.462881 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:48:02.462861 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-d5qvz" event={"ID":"1e1f60ae-98f7-4d09-ae53-4dbc0acb1528","Type":"ContainerStarted","Data":"a34cf7b70d8efac8afa8a22dbeb183a297842937400e2ddfe8a4f5da1f5279da"} Jul 24 13:48:02.494970 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:48:02.494917 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-78d5cc8c46-z527r" podStartSLOduration=1.102247498 podStartE2EDuration="3.494899987s" totalImagesPullingTime="2.392652489s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 13:47:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:48:02.493133913 +0000 UTC m=+290.151111310" watchObservedRunningTime="2026-07-24 13:48:02.494899987 +0000 UTC m=+290.152877373" Jul 24 13:48:04.612352 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:48:04.612306 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 24 13:48:04.612650 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:48:04.612380 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 24 13:48:05.480079 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:48:05.480038 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-d5qvz" event={"ID":"1e1f60ae-98f7-4d09-ae53-4dbc0acb1528","Type":"ContainerStarted","Data":"b3951aa9f9911e785ca30fceeb8dfc8bfd31fafd5fa5ea4461a50906c5eb1533"} Jul 24 13:48:05.480290 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:48:05.480184 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-d5qvz" Jul 24 13:48:05.481863 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:48:05.481836 2578 patch_prober.go:28] interesting pod/istiod-openshift-gateway-5677ccb49b-d5qvz container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 24 13:48:05.481966 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:48:05.481895 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-d5qvz" podUID="1e1f60ae-98f7-4d09-ae53-4dbc0acb1528" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 24 13:48:05.503208 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:48:05.503147 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-d5qvz" podStartSLOduration=2.818297111 podStartE2EDuration="5.503131446s" totalImagesPullingTime="2.684834335s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 13:48:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:48:05.501681091 +0000 UTC m=+293.159658479" watchObservedRunningTime="2026-07-24 13:48:05.503131446 +0000 UTC m=+293.161108831" Jul 24 13:48:06.485477 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:48:06.485446 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-d5qvz" Jul 24 13:48:12.736705 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:48:12.736678 2578 kubelet.go:1648] "Image garbage collection succeeded" Jul 24 13:48:13.471765 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:48:13.471735 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-78d5cc8c46-z527r" Jul 24 13:49:30.348881 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:49:30.348797 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-76ffdf9bf9-2z5nt"] Jul 24 13:49:30.352908 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:49:30.352888 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76ffdf9bf9-2z5nt" Jul 24 13:49:30.370750 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:49:30.370723 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-76ffdf9bf9-2z5nt"] Jul 24 13:49:30.533218 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:49:30.533179 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1bed5e85-0d23-43b0-ac3a-7fb9c80f3bfd-oauth-serving-cert\") pod \"console-76ffdf9bf9-2z5nt\" (UID: \"1bed5e85-0d23-43b0-ac3a-7fb9c80f3bfd\") " pod="openshift-console/console-76ffdf9bf9-2z5nt" Jul 24 13:49:30.533464 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:49:30.533283 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1bed5e85-0d23-43b0-ac3a-7fb9c80f3bfd-console-oauth-config\") pod \"console-76ffdf9bf9-2z5nt\" (UID: \"1bed5e85-0d23-43b0-ac3a-7fb9c80f3bfd\") " pod="openshift-console/console-76ffdf9bf9-2z5nt" Jul 24 13:49:30.533464 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:49:30.533336 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1bed5e85-0d23-43b0-ac3a-7fb9c80f3bfd-trusted-ca-bundle\") pod \"console-76ffdf9bf9-2z5nt\" (UID: \"1bed5e85-0d23-43b0-ac3a-7fb9c80f3bfd\") " pod="openshift-console/console-76ffdf9bf9-2z5nt" Jul 24 13:49:30.533464 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:49:30.533379 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2mtf4\" (UniqueName: \"kubernetes.io/projected/1bed5e85-0d23-43b0-ac3a-7fb9c80f3bfd-kube-api-access-2mtf4\") pod \"console-76ffdf9bf9-2z5nt\" (UID: \"1bed5e85-0d23-43b0-ac3a-7fb9c80f3bfd\") " pod="openshift-console/console-76ffdf9bf9-2z5nt" Jul 24 13:49:30.533464 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:49:30.533427 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1bed5e85-0d23-43b0-ac3a-7fb9c80f3bfd-console-serving-cert\") pod \"console-76ffdf9bf9-2z5nt\" (UID: \"1bed5e85-0d23-43b0-ac3a-7fb9c80f3bfd\") " pod="openshift-console/console-76ffdf9bf9-2z5nt" Jul 24 13:49:30.533464 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:49:30.533447 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1bed5e85-0d23-43b0-ac3a-7fb9c80f3bfd-service-ca\") pod \"console-76ffdf9bf9-2z5nt\" (UID: \"1bed5e85-0d23-43b0-ac3a-7fb9c80f3bfd\") " pod="openshift-console/console-76ffdf9bf9-2z5nt" Jul 24 13:49:30.533695 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:49:30.533543 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1bed5e85-0d23-43b0-ac3a-7fb9c80f3bfd-console-config\") pod \"console-76ffdf9bf9-2z5nt\" (UID: \"1bed5e85-0d23-43b0-ac3a-7fb9c80f3bfd\") " pod="openshift-console/console-76ffdf9bf9-2z5nt" Jul 24 13:49:30.634848 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:49:30.634765 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1bed5e85-0d23-43b0-ac3a-7fb9c80f3bfd-console-config\") pod \"console-76ffdf9bf9-2z5nt\" (UID: \"1bed5e85-0d23-43b0-ac3a-7fb9c80f3bfd\") " pod="openshift-console/console-76ffdf9bf9-2z5nt" Jul 24 13:49:30.634848 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:49:30.634811 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1bed5e85-0d23-43b0-ac3a-7fb9c80f3bfd-oauth-serving-cert\") pod \"console-76ffdf9bf9-2z5nt\" (UID: \"1bed5e85-0d23-43b0-ac3a-7fb9c80f3bfd\") " pod="openshift-console/console-76ffdf9bf9-2z5nt" Jul 24 13:49:30.634848 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:49:30.634850 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1bed5e85-0d23-43b0-ac3a-7fb9c80f3bfd-console-oauth-config\") pod \"console-76ffdf9bf9-2z5nt\" (UID: \"1bed5e85-0d23-43b0-ac3a-7fb9c80f3bfd\") " pod="openshift-console/console-76ffdf9bf9-2z5nt" Jul 24 13:49:30.635134 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:49:30.634870 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1bed5e85-0d23-43b0-ac3a-7fb9c80f3bfd-trusted-ca-bundle\") pod \"console-76ffdf9bf9-2z5nt\" (UID: \"1bed5e85-0d23-43b0-ac3a-7fb9c80f3bfd\") " pod="openshift-console/console-76ffdf9bf9-2z5nt" Jul 24 13:49:30.635134 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:49:30.634886 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2mtf4\" (UniqueName: \"kubernetes.io/projected/1bed5e85-0d23-43b0-ac3a-7fb9c80f3bfd-kube-api-access-2mtf4\") pod \"console-76ffdf9bf9-2z5nt\" (UID: \"1bed5e85-0d23-43b0-ac3a-7fb9c80f3bfd\") " pod="openshift-console/console-76ffdf9bf9-2z5nt" Jul 24 13:49:30.635134 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:49:30.634914 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1bed5e85-0d23-43b0-ac3a-7fb9c80f3bfd-console-serving-cert\") pod \"console-76ffdf9bf9-2z5nt\" (UID: \"1bed5e85-0d23-43b0-ac3a-7fb9c80f3bfd\") " pod="openshift-console/console-76ffdf9bf9-2z5nt" Jul 24 13:49:30.635134 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:49:30.634936 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1bed5e85-0d23-43b0-ac3a-7fb9c80f3bfd-service-ca\") pod \"console-76ffdf9bf9-2z5nt\" (UID: \"1bed5e85-0d23-43b0-ac3a-7fb9c80f3bfd\") " pod="openshift-console/console-76ffdf9bf9-2z5nt" Jul 24 13:49:30.635698 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:49:30.635671 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1bed5e85-0d23-43b0-ac3a-7fb9c80f3bfd-oauth-serving-cert\") pod \"console-76ffdf9bf9-2z5nt\" (UID: \"1bed5e85-0d23-43b0-ac3a-7fb9c80f3bfd\") " pod="openshift-console/console-76ffdf9bf9-2z5nt" Jul 24 13:49:30.635825 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:49:30.635704 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1bed5e85-0d23-43b0-ac3a-7fb9c80f3bfd-console-config\") pod \"console-76ffdf9bf9-2z5nt\" (UID: \"1bed5e85-0d23-43b0-ac3a-7fb9c80f3bfd\") " pod="openshift-console/console-76ffdf9bf9-2z5nt" Jul 24 13:49:30.635867 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:49:30.635833 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1bed5e85-0d23-43b0-ac3a-7fb9c80f3bfd-trusted-ca-bundle\") pod \"console-76ffdf9bf9-2z5nt\" (UID: \"1bed5e85-0d23-43b0-ac3a-7fb9c80f3bfd\") " pod="openshift-console/console-76ffdf9bf9-2z5nt" Jul 24 13:49:30.635948 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:49:30.635929 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1bed5e85-0d23-43b0-ac3a-7fb9c80f3bfd-service-ca\") pod \"console-76ffdf9bf9-2z5nt\" (UID: \"1bed5e85-0d23-43b0-ac3a-7fb9c80f3bfd\") " pod="openshift-console/console-76ffdf9bf9-2z5nt" Jul 24 13:49:30.637474 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:49:30.637446 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1bed5e85-0d23-43b0-ac3a-7fb9c80f3bfd-console-serving-cert\") pod \"console-76ffdf9bf9-2z5nt\" (UID: \"1bed5e85-0d23-43b0-ac3a-7fb9c80f3bfd\") " pod="openshift-console/console-76ffdf9bf9-2z5nt" Jul 24 13:49:30.637611 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:49:30.637471 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1bed5e85-0d23-43b0-ac3a-7fb9c80f3bfd-console-oauth-config\") pod \"console-76ffdf9bf9-2z5nt\" (UID: \"1bed5e85-0d23-43b0-ac3a-7fb9c80f3bfd\") " pod="openshift-console/console-76ffdf9bf9-2z5nt" Jul 24 13:49:30.674964 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:49:30.674939 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2mtf4\" (UniqueName: \"kubernetes.io/projected/1bed5e85-0d23-43b0-ac3a-7fb9c80f3bfd-kube-api-access-2mtf4\") pod \"console-76ffdf9bf9-2z5nt\" (UID: \"1bed5e85-0d23-43b0-ac3a-7fb9c80f3bfd\") " pod="openshift-console/console-76ffdf9bf9-2z5nt" Jul 24 13:49:30.962426 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:49:30.962368 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76ffdf9bf9-2z5nt" Jul 24 13:49:31.129485 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:49:31.129457 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-76ffdf9bf9-2z5nt"] Jul 24 13:49:31.131762 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:49:31.131737 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1bed5e85_0d23_43b0_ac3a_7fb9c80f3bfd.slice/crio-ef3a51cc69237b11c12ce30964dca4f72b4360271bf3defb929e75496be27fce WatchSource:0}: Error finding container ef3a51cc69237b11c12ce30964dca4f72b4360271bf3defb929e75496be27fce: Status 404 returned error can't find the container with id ef3a51cc69237b11c12ce30964dca4f72b4360271bf3defb929e75496be27fce Jul 24 13:49:31.876010 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:49:31.875970 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76ffdf9bf9-2z5nt" event={"ID":"1bed5e85-0d23-43b0-ac3a-7fb9c80f3bfd","Type":"ContainerStarted","Data":"44d5adf5472bf4c935900a7c4952a5abb3d839f37a47947b04bfc02d9e863866"} Jul 24 13:49:31.876439 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:49:31.876029 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76ffdf9bf9-2z5nt" event={"ID":"1bed5e85-0d23-43b0-ac3a-7fb9c80f3bfd","Type":"ContainerStarted","Data":"ef3a51cc69237b11c12ce30964dca4f72b4360271bf3defb929e75496be27fce"} Jul 24 13:49:31.927705 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:49:31.927641 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-76ffdf9bf9-2z5nt" podStartSLOduration=1.927560668 podStartE2EDuration="1.927560668s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 13:49:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:49:31.927300169 +0000 UTC m=+379.585277556" watchObservedRunningTime="2026-07-24 13:49:31.927560668 +0000 UTC m=+379.585538053" Jul 24 13:49:40.963359 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:49:40.963324 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-76ffdf9bf9-2z5nt" Jul 24 13:49:40.963862 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:49:40.963388 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-76ffdf9bf9-2z5nt" Jul 24 13:49:40.967737 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:49:40.967716 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-76ffdf9bf9-2z5nt" Jul 24 13:49:41.923701 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:49:41.923672 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-76ffdf9bf9-2z5nt" Jul 24 13:49:41.995811 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:49:41.995778 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5ddccf588-8rx7m"] Jul 24 13:49:53.939170 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:49:53.939133 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-49tbh"] Jul 24 13:49:53.942526 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:49:53.942498 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-49tbh" Jul 24 13:49:53.944973 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:49:53.944949 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 24 13:49:53.945210 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:49:53.945193 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 24 13:49:53.945272 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:49:53.945198 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-rxt8m\"" Jul 24 13:49:53.957525 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:49:53.957499 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-49tbh"] Jul 24 13:49:54.032255 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:49:54.032222 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-knlkz\" (UniqueName: \"kubernetes.io/projected/973f081e-8980-4d38-a5a9-511f433ee71e-kube-api-access-knlkz\") pod \"limitador-operator-controller-manager-859d7b78bd-49tbh\" (UID: \"973f081e-8980-4d38-a5a9-511f433ee71e\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-49tbh" Jul 24 13:49:54.133782 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:49:54.133750 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-knlkz\" (UniqueName: \"kubernetes.io/projected/973f081e-8980-4d38-a5a9-511f433ee71e-kube-api-access-knlkz\") pod \"limitador-operator-controller-manager-859d7b78bd-49tbh\" (UID: \"973f081e-8980-4d38-a5a9-511f433ee71e\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-49tbh" Jul 24 13:49:54.153212 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:49:54.153179 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-knlkz\" (UniqueName: \"kubernetes.io/projected/973f081e-8980-4d38-a5a9-511f433ee71e-kube-api-access-knlkz\") pod \"limitador-operator-controller-manager-859d7b78bd-49tbh\" (UID: \"973f081e-8980-4d38-a5a9-511f433ee71e\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-49tbh" Jul 24 13:49:54.253579 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:49:54.253500 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-49tbh" Jul 24 13:49:54.400234 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:49:54.400201 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-49tbh"] Jul 24 13:49:54.402590 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:49:54.402557 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod973f081e_8980_4d38_a5a9_511f433ee71e.slice/crio-4f9f6bf9c8c213655ab6e4ebfab504f34755bd55f6bd956d1977617b9b091cc5 WatchSource:0}: Error finding container 4f9f6bf9c8c213655ab6e4ebfab504f34755bd55f6bd956d1977617b9b091cc5: Status 404 returned error can't find the container with id 4f9f6bf9c8c213655ab6e4ebfab504f34755bd55f6bd956d1977617b9b091cc5 Jul 24 13:49:54.404901 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:49:54.404882 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 24 13:49:54.982767 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:49:54.982717 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-49tbh" event={"ID":"973f081e-8980-4d38-a5a9-511f433ee71e","Type":"ContainerStarted","Data":"4f9f6bf9c8c213655ab6e4ebfab504f34755bd55f6bd956d1977617b9b091cc5"} Jul 24 13:49:56.994581 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:49:56.994538 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-49tbh" event={"ID":"973f081e-8980-4d38-a5a9-511f433ee71e","Type":"ContainerStarted","Data":"5da0e45c328f5ae87b2930b3defd674eb07930c53f0de279f01c7403cba13212"} Jul 24 13:49:56.994969 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:49:56.994713 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-49tbh" Jul 24 13:49:57.014960 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:49:57.014911 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-49tbh" podStartSLOduration=2.30097782 podStartE2EDuration="4.014896435s" totalImagesPullingTime="1.713918615s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 13:49:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:49:57.01311522 +0000 UTC m=+404.671092605" watchObservedRunningTime="2026-07-24 13:49:57.014896435 +0000 UTC m=+404.672873820" Jul 24 13:50:07.014781 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:50:07.014708 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5ddccf588-8rx7m" podUID="3783a9bb-fffa-4e91-994c-c2688f211063" containerName="console" containerID="cri-o://cf258b2bce57bbaddbbe9ced72dcc45b83347e5ab7a1de26a765ac6ebd6e0c5d" gracePeriod=15 Jul 24 13:50:07.271764 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:50:07.271698 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5ddccf588-8rx7m" Jul 24 13:50:07.357192 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:50:07.357153 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3783a9bb-fffa-4e91-994c-c2688f211063-console-oauth-config\") pod \"3783a9bb-fffa-4e91-994c-c2688f211063\" (UID: \"3783a9bb-fffa-4e91-994c-c2688f211063\") " Jul 24 13:50:07.357435 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:50:07.357267 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3783a9bb-fffa-4e91-994c-c2688f211063-console-serving-cert\") pod \"3783a9bb-fffa-4e91-994c-c2688f211063\" (UID: \"3783a9bb-fffa-4e91-994c-c2688f211063\") " Jul 24 13:50:07.357435 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:50:07.357324 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3783a9bb-fffa-4e91-994c-c2688f211063-service-ca\") pod \"3783a9bb-fffa-4e91-994c-c2688f211063\" (UID: \"3783a9bb-fffa-4e91-994c-c2688f211063\") " Jul 24 13:50:07.357435 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:50:07.357342 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tgw4r\" (UniqueName: \"kubernetes.io/projected/3783a9bb-fffa-4e91-994c-c2688f211063-kube-api-access-tgw4r\") pod \"3783a9bb-fffa-4e91-994c-c2688f211063\" (UID: \"3783a9bb-fffa-4e91-994c-c2688f211063\") " Jul 24 13:50:07.357435 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:50:07.357365 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3783a9bb-fffa-4e91-994c-c2688f211063-console-config\") pod \"3783a9bb-fffa-4e91-994c-c2688f211063\" (UID: \"3783a9bb-fffa-4e91-994c-c2688f211063\") " Jul 24 13:50:07.357668 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:50:07.357450 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3783a9bb-fffa-4e91-994c-c2688f211063-trusted-ca-bundle\") pod \"3783a9bb-fffa-4e91-994c-c2688f211063\" (UID: \"3783a9bb-fffa-4e91-994c-c2688f211063\") " Jul 24 13:50:07.357668 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:50:07.357469 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3783a9bb-fffa-4e91-994c-c2688f211063-oauth-serving-cert\") pod \"3783a9bb-fffa-4e91-994c-c2688f211063\" (UID: \"3783a9bb-fffa-4e91-994c-c2688f211063\") " Jul 24 13:50:07.357931 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:50:07.357901 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3783a9bb-fffa-4e91-994c-c2688f211063-console-config" (OuterVolumeSpecName: "console-config") pod "3783a9bb-fffa-4e91-994c-c2688f211063" (UID: "3783a9bb-fffa-4e91-994c-c2688f211063"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 13:50:07.358058 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:50:07.357945 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3783a9bb-fffa-4e91-994c-c2688f211063-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "3783a9bb-fffa-4e91-994c-c2688f211063" (UID: "3783a9bb-fffa-4e91-994c-c2688f211063"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 13:50:07.358058 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:50:07.357982 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3783a9bb-fffa-4e91-994c-c2688f211063-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "3783a9bb-fffa-4e91-994c-c2688f211063" (UID: "3783a9bb-fffa-4e91-994c-c2688f211063"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 13:50:07.358259 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:50:07.358236 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3783a9bb-fffa-4e91-994c-c2688f211063-service-ca" (OuterVolumeSpecName: "service-ca") pod "3783a9bb-fffa-4e91-994c-c2688f211063" (UID: "3783a9bb-fffa-4e91-994c-c2688f211063"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 13:50:07.359493 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:50:07.359474 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3783a9bb-fffa-4e91-994c-c2688f211063-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "3783a9bb-fffa-4e91-994c-c2688f211063" (UID: "3783a9bb-fffa-4e91-994c-c2688f211063"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 13:50:07.359573 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:50:07.359556 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3783a9bb-fffa-4e91-994c-c2688f211063-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "3783a9bb-fffa-4e91-994c-c2688f211063" (UID: "3783a9bb-fffa-4e91-994c-c2688f211063"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 13:50:07.359671 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:50:07.359647 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3783a9bb-fffa-4e91-994c-c2688f211063-kube-api-access-tgw4r" (OuterVolumeSpecName: "kube-api-access-tgw4r") pod "3783a9bb-fffa-4e91-994c-c2688f211063" (UID: "3783a9bb-fffa-4e91-994c-c2688f211063"). InnerVolumeSpecName "kube-api-access-tgw4r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 13:50:07.458929 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:50:07.458887 2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3783a9bb-fffa-4e91-994c-c2688f211063-console-serving-cert\") on node \"ip-10-0-129-93.ec2.internal\" DevicePath \"\"" Jul 24 13:50:07.458929 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:50:07.458918 2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3783a9bb-fffa-4e91-994c-c2688f211063-service-ca\") on node \"ip-10-0-129-93.ec2.internal\" DevicePath \"\"" Jul 24 13:50:07.458929 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:50:07.458930 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tgw4r\" (UniqueName: \"kubernetes.io/projected/3783a9bb-fffa-4e91-994c-c2688f211063-kube-api-access-tgw4r\") on node \"ip-10-0-129-93.ec2.internal\" DevicePath \"\"" Jul 24 13:50:07.458929 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:50:07.458939 2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3783a9bb-fffa-4e91-994c-c2688f211063-console-config\") on node \"ip-10-0-129-93.ec2.internal\" DevicePath \"\"" Jul 24 13:50:07.459225 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:50:07.458947 2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3783a9bb-fffa-4e91-994c-c2688f211063-trusted-ca-bundle\") on node \"ip-10-0-129-93.ec2.internal\" DevicePath \"\"" Jul 24 13:50:07.459225 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:50:07.458955 2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3783a9bb-fffa-4e91-994c-c2688f211063-oauth-serving-cert\") on node \"ip-10-0-129-93.ec2.internal\" DevicePath \"\"" Jul 24 13:50:07.459225 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:50:07.458963 2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3783a9bb-fffa-4e91-994c-c2688f211063-console-oauth-config\") on node \"ip-10-0-129-93.ec2.internal\" DevicePath \"\"" Jul 24 13:50:08.001842 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:50:08.001807 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-49tbh" Jul 24 13:50:08.046355 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:50:08.046322 2578 generic.go:356] "Generic (PLEG): container finished" podID="3783a9bb-fffa-4e91-994c-c2688f211063" containerID="cf258b2bce57bbaddbbe9ced72dcc45b83347e5ab7a1de26a765ac6ebd6e0c5d" exitCode=0 Jul 24 13:50:08.046760 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:50:08.046364 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5ddccf588-8rx7m" Jul 24 13:50:08.046760 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:50:08.046422 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5ddccf588-8rx7m" event={"ID":"3783a9bb-fffa-4e91-994c-c2688f211063","Type":"ContainerDied","Data":"cf258b2bce57bbaddbbe9ced72dcc45b83347e5ab7a1de26a765ac6ebd6e0c5d"} Jul 24 13:50:08.046760 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:50:08.046473 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5ddccf588-8rx7m" event={"ID":"3783a9bb-fffa-4e91-994c-c2688f211063","Type":"ContainerDied","Data":"ee0b473a78cd5d8140d34dfb1866d729f2325854fec410ef8acb01da5d24e30d"} Jul 24 13:50:08.046760 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:50:08.046495 2578 scope.go:117] "RemoveContainer" containerID="cf258b2bce57bbaddbbe9ced72dcc45b83347e5ab7a1de26a765ac6ebd6e0c5d" Jul 24 13:50:08.058565 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:50:08.058535 2578 scope.go:117] "RemoveContainer" containerID="cf258b2bce57bbaddbbe9ced72dcc45b83347e5ab7a1de26a765ac6ebd6e0c5d" Jul 24 13:50:08.058915 ip-10-0-129-93 kubenswrapper[2578]: E0724 13:50:08.058891 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cf258b2bce57bbaddbbe9ced72dcc45b83347e5ab7a1de26a765ac6ebd6e0c5d\": container with ID starting with cf258b2bce57bbaddbbe9ced72dcc45b83347e5ab7a1de26a765ac6ebd6e0c5d not found: ID does not exist" containerID="cf258b2bce57bbaddbbe9ced72dcc45b83347e5ab7a1de26a765ac6ebd6e0c5d" Jul 24 13:50:08.059004 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:50:08.058929 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cf258b2bce57bbaddbbe9ced72dcc45b83347e5ab7a1de26a765ac6ebd6e0c5d"} err="failed to get container status \"cf258b2bce57bbaddbbe9ced72dcc45b83347e5ab7a1de26a765ac6ebd6e0c5d\": rpc error: code = NotFound desc = could not find container \"cf258b2bce57bbaddbbe9ced72dcc45b83347e5ab7a1de26a765ac6ebd6e0c5d\": container with ID starting with cf258b2bce57bbaddbbe9ced72dcc45b83347e5ab7a1de26a765ac6ebd6e0c5d not found: ID does not exist" Jul 24 13:50:08.073970 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:50:08.073938 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5ddccf588-8rx7m"] Jul 24 13:50:08.078625 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:50:08.078597 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5ddccf588-8rx7m"] Jul 24 13:50:08.920265 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:50:08.920233 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3783a9bb-fffa-4e91-994c-c2688f211063" path="/var/lib/kubelet/pods/3783a9bb-fffa-4e91-994c-c2688f211063/volumes" Jul 24 13:51:03.351493 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:51:03.351459 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-4bs65"] Jul 24 13:51:03.351885 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:51:03.351812 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3783a9bb-fffa-4e91-994c-c2688f211063" containerName="console" Jul 24 13:51:03.351885 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:51:03.351822 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="3783a9bb-fffa-4e91-994c-c2688f211063" containerName="console" Jul 24 13:51:03.351961 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:51:03.351911 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="3783a9bb-fffa-4e91-994c-c2688f211063" containerName="console" Jul 24 13:51:03.355015 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:51:03.354994 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-4bs65" Jul 24 13:51:03.357096 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:51:03.357074 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\"" Jul 24 13:51:03.357220 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:51:03.357114 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 24 13:51:03.357220 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:51:03.357175 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 24 13:51:03.357220 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:51:03.357206 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-rmf8w\"" Jul 24 13:51:03.364764 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:51:03.364743 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-4bs65"] Jul 24 13:51:03.450667 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:51:03.450625 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/7b8a34ec-03ed-489c-bae2-23bfb0e8ef14-data\") pod \"postgres-69fb4594cf-4bs65\" (UID: \"7b8a34ec-03ed-489c-bae2-23bfb0e8ef14\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-4bs65" Jul 24 13:51:03.450857 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:51:03.450754 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l24tx\" (UniqueName: \"kubernetes.io/projected/7b8a34ec-03ed-489c-bae2-23bfb0e8ef14-kube-api-access-l24tx\") pod \"postgres-69fb4594cf-4bs65\" (UID: \"7b8a34ec-03ed-489c-bae2-23bfb0e8ef14\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-4bs65" Jul 24 13:51:03.551675 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:51:03.551640 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/7b8a34ec-03ed-489c-bae2-23bfb0e8ef14-data\") pod \"postgres-69fb4594cf-4bs65\" (UID: \"7b8a34ec-03ed-489c-bae2-23bfb0e8ef14\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-4bs65" Jul 24 13:51:03.551846 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:51:03.551740 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l24tx\" (UniqueName: \"kubernetes.io/projected/7b8a34ec-03ed-489c-bae2-23bfb0e8ef14-kube-api-access-l24tx\") pod \"postgres-69fb4594cf-4bs65\" (UID: \"7b8a34ec-03ed-489c-bae2-23bfb0e8ef14\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-4bs65" Jul 24 13:51:03.552093 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:51:03.552072 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/7b8a34ec-03ed-489c-bae2-23bfb0e8ef14-data\") pod \"postgres-69fb4594cf-4bs65\" (UID: \"7b8a34ec-03ed-489c-bae2-23bfb0e8ef14\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-4bs65" Jul 24 13:51:03.559997 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:51:03.559977 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l24tx\" (UniqueName: \"kubernetes.io/projected/7b8a34ec-03ed-489c-bae2-23bfb0e8ef14-kube-api-access-l24tx\") pod \"postgres-69fb4594cf-4bs65\" (UID: \"7b8a34ec-03ed-489c-bae2-23bfb0e8ef14\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-4bs65" Jul 24 13:51:03.666227 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:51:03.666179 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-4bs65" Jul 24 13:51:03.803326 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:51:03.803167 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-4bs65"] Jul 24 13:51:03.806097 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:51:03.806061 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b8a34ec_03ed_489c_bae2_23bfb0e8ef14.slice/crio-b7ba00bd234010c343b0ed26f34c22dfbae5976ed141eccf89fbc0d6e2926159 WatchSource:0}: Error finding container b7ba00bd234010c343b0ed26f34c22dfbae5976ed141eccf89fbc0d6e2926159: Status 404 returned error can't find the container with id b7ba00bd234010c343b0ed26f34c22dfbae5976ed141eccf89fbc0d6e2926159 Jul 24 13:51:04.315056 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:51:04.315023 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-4bs65" event={"ID":"7b8a34ec-03ed-489c-bae2-23bfb0e8ef14","Type":"ContainerStarted","Data":"b7ba00bd234010c343b0ed26f34c22dfbae5976ed141eccf89fbc0d6e2926159"} Jul 24 13:51:09.345818 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:51:09.345784 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-4bs65" event={"ID":"7b8a34ec-03ed-489c-bae2-23bfb0e8ef14","Type":"ContainerStarted","Data":"6af0443fd54059bd2805630c989a3682c1ba3b5dccce9e54bdfac94d970a1cf5"} Jul 24 13:51:09.346233 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:51:09.345884 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-4bs65" Jul 24 13:51:15.379955 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:51:15.379922 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-4bs65" Jul 24 13:51:15.397618 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:51:15.397551 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-4bs65" podStartSLOduration=7.505572271 podStartE2EDuration="12.397532591s" totalImagesPullingTime="4.89196032s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 13:51:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:51:09.35954696 +0000 UTC m=+477.017524343" watchObservedRunningTime="2026-07-24 13:51:15.397532591 +0000 UTC m=+483.055509978" Jul 24 13:52:27.396823 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:52:27.396740 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p27x7"] Jul 24 13:52:27.400641 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:52:27.400616 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p27x7" Jul 24 13:52:27.402715 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:52:27.402693 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 24 13:52:27.403012 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:52:27.402993 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jul 24 13:52:27.403067 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:52:27.403004 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 24 13:52:27.403111 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:52:27.403071 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-hrqmm\"" Jul 24 13:52:27.410121 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:52:27.410092 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p27x7"] Jul 24 13:52:27.502480 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:52:27.502439 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4b8fdb53-f17d-454f-a506-f0c7f2302aab-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-p27x7\" (UID: \"4b8fdb53-f17d-454f-a506-f0c7f2302aab\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p27x7" Jul 24 13:52:27.502480 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:52:27.502485 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4b8fdb53-f17d-454f-a506-f0c7f2302aab-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-p27x7\" (UID: \"4b8fdb53-f17d-454f-a506-f0c7f2302aab\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p27x7" Jul 24 13:52:27.502711 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:52:27.502600 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6fvrv\" (UniqueName: \"kubernetes.io/projected/4b8fdb53-f17d-454f-a506-f0c7f2302aab-kube-api-access-6fvrv\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-p27x7\" (UID: \"4b8fdb53-f17d-454f-a506-f0c7f2302aab\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p27x7" Jul 24 13:52:27.502711 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:52:27.502633 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4b8fdb53-f17d-454f-a506-f0c7f2302aab-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-p27x7\" (UID: \"4b8fdb53-f17d-454f-a506-f0c7f2302aab\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p27x7" Jul 24 13:52:27.502790 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:52:27.502714 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4b8fdb53-f17d-454f-a506-f0c7f2302aab-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-p27x7\" (UID: \"4b8fdb53-f17d-454f-a506-f0c7f2302aab\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p27x7" Jul 24 13:52:27.502790 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:52:27.502751 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4b8fdb53-f17d-454f-a506-f0c7f2302aab-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-p27x7\" (UID: \"4b8fdb53-f17d-454f-a506-f0c7f2302aab\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p27x7" Jul 24 13:52:27.603810 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:52:27.603769 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4b8fdb53-f17d-454f-a506-f0c7f2302aab-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-p27x7\" (UID: \"4b8fdb53-f17d-454f-a506-f0c7f2302aab\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p27x7" Jul 24 13:52:27.603810 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:52:27.603809 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4b8fdb53-f17d-454f-a506-f0c7f2302aab-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-p27x7\" (UID: \"4b8fdb53-f17d-454f-a506-f0c7f2302aab\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p27x7" Jul 24 13:52:27.604032 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:52:27.603859 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6fvrv\" (UniqueName: \"kubernetes.io/projected/4b8fdb53-f17d-454f-a506-f0c7f2302aab-kube-api-access-6fvrv\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-p27x7\" (UID: \"4b8fdb53-f17d-454f-a506-f0c7f2302aab\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p27x7" Jul 24 13:52:27.604032 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:52:27.603877 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4b8fdb53-f17d-454f-a506-f0c7f2302aab-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-p27x7\" (UID: \"4b8fdb53-f17d-454f-a506-f0c7f2302aab\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p27x7" Jul 24 13:52:27.604032 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:52:27.603941 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4b8fdb53-f17d-454f-a506-f0c7f2302aab-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-p27x7\" (UID: \"4b8fdb53-f17d-454f-a506-f0c7f2302aab\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p27x7" Jul 24 13:52:27.604032 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:52:27.603973 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4b8fdb53-f17d-454f-a506-f0c7f2302aab-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-p27x7\" (UID: \"4b8fdb53-f17d-454f-a506-f0c7f2302aab\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p27x7" Jul 24 13:52:27.604371 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:52:27.604340 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4b8fdb53-f17d-454f-a506-f0c7f2302aab-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-p27x7\" (UID: \"4b8fdb53-f17d-454f-a506-f0c7f2302aab\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p27x7" Jul 24 13:52:27.604511 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:52:27.604391 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4b8fdb53-f17d-454f-a506-f0c7f2302aab-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-p27x7\" (UID: \"4b8fdb53-f17d-454f-a506-f0c7f2302aab\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p27x7" Jul 24 13:52:27.604511 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:52:27.604401 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4b8fdb53-f17d-454f-a506-f0c7f2302aab-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-p27x7\" (UID: \"4b8fdb53-f17d-454f-a506-f0c7f2302aab\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p27x7" Jul 24 13:52:27.606176 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:52:27.606154 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4b8fdb53-f17d-454f-a506-f0c7f2302aab-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-p27x7\" (UID: \"4b8fdb53-f17d-454f-a506-f0c7f2302aab\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p27x7" Jul 24 13:52:27.606347 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:52:27.606330 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4b8fdb53-f17d-454f-a506-f0c7f2302aab-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-p27x7\" (UID: \"4b8fdb53-f17d-454f-a506-f0c7f2302aab\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p27x7" Jul 24 13:52:27.611348 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:52:27.611328 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6fvrv\" (UniqueName: \"kubernetes.io/projected/4b8fdb53-f17d-454f-a506-f0c7f2302aab-kube-api-access-6fvrv\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-p27x7\" (UID: \"4b8fdb53-f17d-454f-a506-f0c7f2302aab\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p27x7" Jul 24 13:52:27.711600 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:52:27.711560 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p27x7" Jul 24 13:52:27.847602 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:52:27.847488 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p27x7"] Jul 24 13:52:27.850175 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:52:27.850133 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b8fdb53_f17d_454f_a506_f0c7f2302aab.slice/crio-30ba9a39390103616083d5f70a11b602ce524c3f938d18f7ce92d51bebe258df WatchSource:0}: Error finding container 30ba9a39390103616083d5f70a11b602ce524c3f938d18f7ce92d51bebe258df: Status 404 returned error can't find the container with id 30ba9a39390103616083d5f70a11b602ce524c3f938d18f7ce92d51bebe258df Jul 24 13:52:28.722634 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:52:28.722590 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p27x7" event={"ID":"4b8fdb53-f17d-454f-a506-f0c7f2302aab","Type":"ContainerStarted","Data":"30ba9a39390103616083d5f70a11b602ce524c3f938d18f7ce92d51bebe258df"} Jul 24 13:52:29.729634 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:52:29.729595 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p27x7" event={"ID":"4b8fdb53-f17d-454f-a506-f0c7f2302aab","Type":"ContainerStarted","Data":"fde80aeaa5dc4d033b1ab84f2fa07da65b29fbfbfd3ad7a25af6dba93b98bde3"} Jul 24 13:52:29.760439 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:52:29.760376 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p27x7" podStartSLOduration=1.36246146 podStartE2EDuration="2.760358398s" totalImagesPullingTime="1.397896938s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 13:52:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:52:29.752053744 +0000 UTC m=+557.410031128" watchObservedRunningTime="2026-07-24 13:52:29.760358398 +0000 UTC m=+557.418335783" Jul 24 13:52:37.712283 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:52:37.712240 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p27x7" Jul 24 13:52:37.712733 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:52:37.712317 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p27x7" Jul 24 13:52:37.724823 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:52:37.724796 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p27x7" Jul 24 13:52:37.779332 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:52:37.779304 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p27x7" Jul 24 13:52:57.101443 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:52:57.101385 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnwtzb"] Jul 24 13:52:57.105037 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:52:57.105017 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnwtzb" Jul 24 13:52:57.107107 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:52:57.107086 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jul 24 13:52:57.117558 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:52:57.117536 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnwtzb"] Jul 24 13:52:57.184799 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:52:57.184764 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/663882f1-a2af-4cce-88cf-6bdbe3bbe9b7-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnwtzb\" (UID: \"663882f1-a2af-4cce-88cf-6bdbe3bbe9b7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnwtzb" Jul 24 13:52:57.184799 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:52:57.184805 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gb4rs\" (UniqueName: \"kubernetes.io/projected/663882f1-a2af-4cce-88cf-6bdbe3bbe9b7-kube-api-access-gb4rs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnwtzb\" (UID: \"663882f1-a2af-4cce-88cf-6bdbe3bbe9b7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnwtzb" Jul 24 13:52:57.184994 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:52:57.184841 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/663882f1-a2af-4cce-88cf-6bdbe3bbe9b7-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnwtzb\" (UID: \"663882f1-a2af-4cce-88cf-6bdbe3bbe9b7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnwtzb" Jul 24 13:52:57.184994 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:52:57.184919 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/663882f1-a2af-4cce-88cf-6bdbe3bbe9b7-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnwtzb\" (UID: \"663882f1-a2af-4cce-88cf-6bdbe3bbe9b7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnwtzb" Jul 24 13:52:57.184994 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:52:57.184976 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/663882f1-a2af-4cce-88cf-6bdbe3bbe9b7-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnwtzb\" (UID: \"663882f1-a2af-4cce-88cf-6bdbe3bbe9b7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnwtzb" Jul 24 13:52:57.185093 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:52:57.185015 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/663882f1-a2af-4cce-88cf-6bdbe3bbe9b7-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnwtzb\" (UID: \"663882f1-a2af-4cce-88cf-6bdbe3bbe9b7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnwtzb" Jul 24 13:52:57.286218 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:52:57.286172 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/663882f1-a2af-4cce-88cf-6bdbe3bbe9b7-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnwtzb\" (UID: \"663882f1-a2af-4cce-88cf-6bdbe3bbe9b7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnwtzb" Jul 24 13:52:57.286360 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:52:57.286223 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/663882f1-a2af-4cce-88cf-6bdbe3bbe9b7-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnwtzb\" (UID: \"663882f1-a2af-4cce-88cf-6bdbe3bbe9b7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnwtzb" Jul 24 13:52:57.286360 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:52:57.286269 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/663882f1-a2af-4cce-88cf-6bdbe3bbe9b7-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnwtzb\" (UID: \"663882f1-a2af-4cce-88cf-6bdbe3bbe9b7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnwtzb" Jul 24 13:52:57.286360 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:52:57.286319 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/663882f1-a2af-4cce-88cf-6bdbe3bbe9b7-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnwtzb\" (UID: \"663882f1-a2af-4cce-88cf-6bdbe3bbe9b7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnwtzb" Jul 24 13:52:57.286576 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:52:57.286394 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/663882f1-a2af-4cce-88cf-6bdbe3bbe9b7-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnwtzb\" (UID: \"663882f1-a2af-4cce-88cf-6bdbe3bbe9b7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnwtzb" Jul 24 13:52:57.286576 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:52:57.286450 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gb4rs\" (UniqueName: \"kubernetes.io/projected/663882f1-a2af-4cce-88cf-6bdbe3bbe9b7-kube-api-access-gb4rs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnwtzb\" (UID: \"663882f1-a2af-4cce-88cf-6bdbe3bbe9b7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnwtzb" Jul 24 13:52:57.286672 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:52:57.286620 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/663882f1-a2af-4cce-88cf-6bdbe3bbe9b7-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnwtzb\" (UID: \"663882f1-a2af-4cce-88cf-6bdbe3bbe9b7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnwtzb" Jul 24 13:52:57.286672 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:52:57.286605 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/663882f1-a2af-4cce-88cf-6bdbe3bbe9b7-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnwtzb\" (UID: \"663882f1-a2af-4cce-88cf-6bdbe3bbe9b7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnwtzb" Jul 24 13:52:57.286764 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:52:57.286673 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/663882f1-a2af-4cce-88cf-6bdbe3bbe9b7-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnwtzb\" (UID: \"663882f1-a2af-4cce-88cf-6bdbe3bbe9b7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnwtzb" Jul 24 13:52:57.288525 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:52:57.288505 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/663882f1-a2af-4cce-88cf-6bdbe3bbe9b7-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnwtzb\" (UID: \"663882f1-a2af-4cce-88cf-6bdbe3bbe9b7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnwtzb" Jul 24 13:52:57.288780 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:52:57.288761 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/663882f1-a2af-4cce-88cf-6bdbe3bbe9b7-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnwtzb\" (UID: \"663882f1-a2af-4cce-88cf-6bdbe3bbe9b7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnwtzb" Jul 24 13:52:57.295475 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:52:57.295396 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gb4rs\" (UniqueName: \"kubernetes.io/projected/663882f1-a2af-4cce-88cf-6bdbe3bbe9b7-kube-api-access-gb4rs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnwtzb\" (UID: \"663882f1-a2af-4cce-88cf-6bdbe3bbe9b7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnwtzb" Jul 24 13:52:57.415046 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:52:57.415012 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnwtzb" Jul 24 13:52:57.567053 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:52:57.567029 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnwtzb"] Jul 24 13:52:57.570177 ip-10-0-129-93 kubenswrapper[2578]: W0724 13:52:57.570153 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod663882f1_a2af_4cce_88cf_6bdbe3bbe9b7.slice/crio-9db3b811296a9974d748274039a6c1f28994e3d9aa49c28068bfdd8c12d6686c WatchSource:0}: Error finding container 9db3b811296a9974d748274039a6c1f28994e3d9aa49c28068bfdd8c12d6686c: Status 404 returned error can't find the container with id 9db3b811296a9974d748274039a6c1f28994e3d9aa49c28068bfdd8c12d6686c Jul 24 13:52:57.866535 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:52:57.866503 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnwtzb" event={"ID":"663882f1-a2af-4cce-88cf-6bdbe3bbe9b7","Type":"ContainerStarted","Data":"58de71b884633d779d6e6ee51cce86964f9d9a6d3aebf27d7ad201120249719f"} Jul 24 13:52:57.866646 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:52:57.866566 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnwtzb" event={"ID":"663882f1-a2af-4cce-88cf-6bdbe3bbe9b7","Type":"ContainerStarted","Data":"9db3b811296a9974d748274039a6c1f28994e3d9aa49c28068bfdd8c12d6686c"} Jul 24 13:52:57.887657 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:52:57.887614 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnwtzb" podStartSLOduration=0.669076869 podStartE2EDuration="887.597885ms" totalImagesPullingTime="218.521016ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 13:52:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:52:57.884947221 +0000 UTC m=+585.542924607" watchObservedRunningTime="2026-07-24 13:52:57.887597885 +0000 UTC m=+585.545575269" Jul 24 13:53:07.415514 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:53:07.415466 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnwtzb" Jul 24 13:53:07.415957 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:53:07.415537 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnwtzb" Jul 24 13:53:07.427976 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:53:07.427943 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnwtzb" Jul 24 13:53:07.924523 ip-10-0-129-93 kubenswrapper[2578]: I0724 13:53:07.924493 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnwtzb" Jul 24 14:08:11.871485 ip-10-0-129-93 kubenswrapper[2578]: I0724 14:08:11.871458 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-674cffbf7-glh2v_447af81e-0c84-44c7-83e7-d2da205b57e5/copy-manifests/0.log" Jul 24 14:08:11.878745 ip-10-0-129-93 kubenswrapper[2578]: I0724 14:08:11.878722 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-674cffbf7-glh2v_447af81e-0c84-44c7-83e7-d2da205b57e5/manager/0.log" Jul 24 14:08:12.664206 ip-10-0-129-93 kubenswrapper[2578]: I0724 14:08:12.664177 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-4bs65_7b8a34ec-03ed-489c-bae2-23bfb0e8ef14/postgres/0.log" Jul 24 14:08:15.011586 ip-10-0-129-93 kubenswrapper[2578]: I0724 14:08:15.011552 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-49tbh_973f081e-8980-4d38-a5a9-511f433ee71e/manager/0.log" Jul 24 14:08:15.530424 ip-10-0-129-93 kubenswrapper[2578]: I0724 14:08:15.530383 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-d5qvz_1e1f60ae-98f7-4d09-ae53-4dbc0acb1528/discovery/0.log" Jul 24 14:08:16.579322 ip-10-0-129-93 kubenswrapper[2578]: I0724 14:08:16.579294 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-p27x7_4b8fdb53-f17d-454f-a506-f0c7f2302aab/main/0.log" Jul 24 14:08:16.928900 ip-10-0-129-93 kubenswrapper[2578]: I0724 14:08:16.928870 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnwtzb_663882f1-a2af-4cce-88cf-6bdbe3bbe9b7/main/0.log" Jul 24 14:08:25.646563 ip-10-0-129-93 kubenswrapper[2578]: I0724 14:08:25.646533 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-n845m_cb920d79-442e-4835-96ca-66a2c62e6fad/global-pull-secret-syncer/0.log" Jul 24 14:08:25.817050 ip-10-0-129-93 kubenswrapper[2578]: I0724 14:08:25.817021 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-txls2_bd2d0507-3736-448c-91f7-a12d0db7cff1/konnectivity-agent/0.log" Jul 24 14:08:25.860078 ip-10-0-129-93 kubenswrapper[2578]: I0724 14:08:25.860053 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-129-93.ec2.internal_263f5bb8d2ec60e406679313252c6a79/haproxy/0.log" Jul 24 14:08:31.301421 ip-10-0-129-93 kubenswrapper[2578]: I0724 14:08:31.301387 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-49tbh_973f081e-8980-4d38-a5a9-511f433ee71e/manager/0.log" Jul 24 14:08:32.766104 ip-10-0-129-93 kubenswrapper[2578]: I0724 14:08:32.766074 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7b121b48-dbe3-4f21-82c7-2cfba18a9bad/alertmanager/0.log" Jul 24 14:08:32.792737 ip-10-0-129-93 kubenswrapper[2578]: I0724 14:08:32.792706 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7b121b48-dbe3-4f21-82c7-2cfba18a9bad/config-reloader/0.log" Jul 24 14:08:32.824818 ip-10-0-129-93 kubenswrapper[2578]: I0724 14:08:32.824793 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7b121b48-dbe3-4f21-82c7-2cfba18a9bad/kube-rbac-proxy-web/0.log" Jul 24 14:08:32.855334 ip-10-0-129-93 kubenswrapper[2578]: I0724 14:08:32.855309 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7b121b48-dbe3-4f21-82c7-2cfba18a9bad/kube-rbac-proxy/0.log" Jul 24 14:08:32.880875 ip-10-0-129-93 kubenswrapper[2578]: I0724 14:08:32.880844 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7b121b48-dbe3-4f21-82c7-2cfba18a9bad/kube-rbac-proxy-metric/0.log" Jul 24 14:08:32.913849 ip-10-0-129-93 kubenswrapper[2578]: I0724 14:08:32.913826 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7b121b48-dbe3-4f21-82c7-2cfba18a9bad/prom-label-proxy/0.log" Jul 24 14:08:32.943707 ip-10-0-129-93 kubenswrapper[2578]: I0724 14:08:32.943681 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7b121b48-dbe3-4f21-82c7-2cfba18a9bad/init-config-reloader/0.log" Jul 24 14:08:33.018731 ip-10-0-129-93 kubenswrapper[2578]: I0724 14:08:33.018646 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-fbs2h_67f0a71c-4582-4205-8e6d-9f2624778cd6/kube-state-metrics/0.log" Jul 24 14:08:33.038902 ip-10-0-129-93 kubenswrapper[2578]: I0724 14:08:33.038873 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-fbs2h_67f0a71c-4582-4205-8e6d-9f2624778cd6/kube-rbac-proxy-main/0.log" Jul 24 14:08:33.070445 ip-10-0-129-93 kubenswrapper[2578]: I0724 14:08:33.070391 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-fbs2h_67f0a71c-4582-4205-8e6d-9f2624778cd6/kube-rbac-proxy-self/0.log" Jul 24 14:08:33.096347 ip-10-0-129-93 kubenswrapper[2578]: I0724 14:08:33.096318 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-65b9c965dd-j9lg5_2556ad58-b40c-4826-9c84-6e2e1690ce81/metrics-server/0.log" Jul 24 14:08:33.118181 ip-10-0-129-93 kubenswrapper[2578]: I0724 14:08:33.118154 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-68b7fc9574-cdcvd_d867d4e3-35bd-4ed8-8859-3134ef837c92/monitoring-plugin/0.log" Jul 24 14:08:33.232732 ip-10-0-129-93 kubenswrapper[2578]: I0724 14:08:33.232696 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-f8nsv_9435272f-fb70-453f-b34f-3c5782f622db/node-exporter/0.log" Jul 24 14:08:33.251108 ip-10-0-129-93 kubenswrapper[2578]: I0724 14:08:33.251080 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-f8nsv_9435272f-fb70-453f-b34f-3c5782f622db/kube-rbac-proxy/0.log" Jul 24 14:08:33.268139 ip-10-0-129-93 kubenswrapper[2578]: I0724 14:08:33.268116 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-f8nsv_9435272f-fb70-453f-b34f-3c5782f622db/init-textfile/0.log" Jul 24 14:08:33.349579 ip-10-0-129-93 kubenswrapper[2578]: I0724 14:08:33.349477 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-4hqf8_5c25c2f3-916a-404e-9e15-bff7a2511cf8/kube-rbac-proxy-main/0.log" Jul 24 14:08:33.371032 ip-10-0-129-93 kubenswrapper[2578]: I0724 14:08:33.371007 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-4hqf8_5c25c2f3-916a-404e-9e15-bff7a2511cf8/kube-rbac-proxy-self/0.log" Jul 24 14:08:33.392247 ip-10-0-129-93 kubenswrapper[2578]: I0724 14:08:33.392223 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-4hqf8_5c25c2f3-916a-404e-9e15-bff7a2511cf8/openshift-state-metrics/0.log" Jul 24 14:08:33.430524 ip-10-0-129-93 kubenswrapper[2578]: I0724 14:08:33.430501 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5545b094-3366-4571-970f-280c1a0d4ae0/prometheus/0.log" Jul 24 14:08:33.458773 ip-10-0-129-93 kubenswrapper[2578]: I0724 14:08:33.458751 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5545b094-3366-4571-970f-280c1a0d4ae0/config-reloader/0.log" Jul 24 14:08:33.475978 ip-10-0-129-93 kubenswrapper[2578]: I0724 14:08:33.475959 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5545b094-3366-4571-970f-280c1a0d4ae0/thanos-sidecar/0.log" Jul 24 14:08:33.492109 ip-10-0-129-93 kubenswrapper[2578]: I0724 14:08:33.492088 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5545b094-3366-4571-970f-280c1a0d4ae0/kube-rbac-proxy-web/0.log" Jul 24 14:08:33.509167 ip-10-0-129-93 kubenswrapper[2578]: I0724 14:08:33.509148 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5545b094-3366-4571-970f-280c1a0d4ae0/kube-rbac-proxy/0.log" Jul 24 14:08:33.526895 ip-10-0-129-93 kubenswrapper[2578]: I0724 14:08:33.526873 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5545b094-3366-4571-970f-280c1a0d4ae0/kube-rbac-proxy-thanos/0.log" Jul 24 14:08:33.544020 ip-10-0-129-93 kubenswrapper[2578]: I0724 14:08:33.543998 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5545b094-3366-4571-970f-280c1a0d4ae0/init-config-reloader/0.log" Jul 24 14:08:33.566724 ip-10-0-129-93 kubenswrapper[2578]: I0724 14:08:33.566693 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-7rlng_df45a5db-87e1-4ee4-9c58-0f1e61b53767/prometheus-operator/0.log" Jul 24 14:08:33.582095 ip-10-0-129-93 kubenswrapper[2578]: I0724 14:08:33.582067 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-7rlng_df45a5db-87e1-4ee4-9c58-0f1e61b53767/kube-rbac-proxy/0.log" Jul 24 14:08:33.603973 ip-10-0-129-93 kubenswrapper[2578]: I0724 14:08:33.603917 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-7f8d78f54b-kkmd2_4133be4d-4143-4c3b-8fcc-db08a10b92b6/prometheus-operator-admission-webhook/0.log" Jul 24 14:08:33.629971 ip-10-0-129-93 kubenswrapper[2578]: I0724 14:08:33.629951 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-f89574b4f-wh9mj_406823af-954f-446d-b47b-a71d3e709f17/telemeter-client/0.log" Jul 24 14:08:33.646139 ip-10-0-129-93 kubenswrapper[2578]: I0724 14:08:33.646115 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-f89574b4f-wh9mj_406823af-954f-446d-b47b-a71d3e709f17/reload/0.log" Jul 24 14:08:33.663968 ip-10-0-129-93 kubenswrapper[2578]: I0724 14:08:33.663946 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-f89574b4f-wh9mj_406823af-954f-446d-b47b-a71d3e709f17/kube-rbac-proxy/0.log" Jul 24 14:08:33.693062 ip-10-0-129-93 kubenswrapper[2578]: I0724 14:08:33.693035 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5c889495d8-xh2tt_01b4f880-e852-4297-98e9-077c6de3cb93/thanos-query/0.log" Jul 24 14:08:33.711468 ip-10-0-129-93 kubenswrapper[2578]: I0724 14:08:33.711445 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5c889495d8-xh2tt_01b4f880-e852-4297-98e9-077c6de3cb93/kube-rbac-proxy-web/0.log" Jul 24 14:08:33.728927 ip-10-0-129-93 kubenswrapper[2578]: I0724 14:08:33.728901 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5c889495d8-xh2tt_01b4f880-e852-4297-98e9-077c6de3cb93/kube-rbac-proxy/0.log" Jul 24 14:08:33.745325 ip-10-0-129-93 kubenswrapper[2578]: I0724 14:08:33.745304 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5c889495d8-xh2tt_01b4f880-e852-4297-98e9-077c6de3cb93/prom-label-proxy/0.log" Jul 24 14:08:33.762422 ip-10-0-129-93 kubenswrapper[2578]: I0724 14:08:33.762370 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5c889495d8-xh2tt_01b4f880-e852-4297-98e9-077c6de3cb93/kube-rbac-proxy-rules/0.log" Jul 24 14:08:33.779545 ip-10-0-129-93 kubenswrapper[2578]: I0724 14:08:33.779524 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5c889495d8-xh2tt_01b4f880-e852-4297-98e9-077c6de3cb93/kube-rbac-proxy-metrics/0.log" Jul 24 14:08:35.148579 ip-10-0-129-93 kubenswrapper[2578]: I0724 14:08:35.148494 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-t2qd9/perf-node-gather-daemonset-jdxch"] Jul 24 14:08:35.152428 ip-10-0-129-93 kubenswrapper[2578]: I0724 14:08:35.152392 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-t2qd9/perf-node-gather-daemonset-jdxch" Jul 24 14:08:35.154252 ip-10-0-129-93 kubenswrapper[2578]: I0724 14:08:35.154233 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-t2qd9\"/\"kube-root-ca.crt\"" Jul 24 14:08:35.154697 ip-10-0-129-93 kubenswrapper[2578]: I0724 14:08:35.154677 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-t2qd9\"/\"openshift-service-ca.crt\"" Jul 24 14:08:35.154784 ip-10-0-129-93 kubenswrapper[2578]: I0724 14:08:35.154734 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-t2qd9\"/\"default-dockercfg-2jftm\"" Jul 24 14:08:35.161473 ip-10-0-129-93 kubenswrapper[2578]: I0724 14:08:35.161449 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-t2qd9/perf-node-gather-daemonset-jdxch"] Jul 24 14:08:35.226795 ip-10-0-129-93 kubenswrapper[2578]: I0724 14:08:35.226764 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hdftd\" (UniqueName: \"kubernetes.io/projected/238a8ddb-87e9-44e9-88bb-f1d0d5df7d5d-kube-api-access-hdftd\") pod \"perf-node-gather-daemonset-jdxch\" (UID: \"238a8ddb-87e9-44e9-88bb-f1d0d5df7d5d\") " pod="openshift-must-gather-t2qd9/perf-node-gather-daemonset-jdxch" Jul 24 14:08:35.226969 ip-10-0-129-93 kubenswrapper[2578]: I0724 14:08:35.226807 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/238a8ddb-87e9-44e9-88bb-f1d0d5df7d5d-sys\") pod \"perf-node-gather-daemonset-jdxch\" (UID: \"238a8ddb-87e9-44e9-88bb-f1d0d5df7d5d\") " pod="openshift-must-gather-t2qd9/perf-node-gather-daemonset-jdxch" Jul 24 14:08:35.226969 ip-10-0-129-93 kubenswrapper[2578]: I0724 14:08:35.226840 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/238a8ddb-87e9-44e9-88bb-f1d0d5df7d5d-podres\") pod \"perf-node-gather-daemonset-jdxch\" (UID: \"238a8ddb-87e9-44e9-88bb-f1d0d5df7d5d\") " pod="openshift-must-gather-t2qd9/perf-node-gather-daemonset-jdxch" Jul 24 14:08:35.226969 ip-10-0-129-93 kubenswrapper[2578]: I0724 14:08:35.226857 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/238a8ddb-87e9-44e9-88bb-f1d0d5df7d5d-lib-modules\") pod \"perf-node-gather-daemonset-jdxch\" (UID: \"238a8ddb-87e9-44e9-88bb-f1d0d5df7d5d\") " pod="openshift-must-gather-t2qd9/perf-node-gather-daemonset-jdxch" Jul 24 14:08:35.226969 ip-10-0-129-93 kubenswrapper[2578]: I0724 14:08:35.226878 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/238a8ddb-87e9-44e9-88bb-f1d0d5df7d5d-proc\") pod \"perf-node-gather-daemonset-jdxch\" (UID: \"238a8ddb-87e9-44e9-88bb-f1d0d5df7d5d\") " pod="openshift-must-gather-t2qd9/perf-node-gather-daemonset-jdxch" Jul 24 14:08:35.327968 ip-10-0-129-93 kubenswrapper[2578]: I0724 14:08:35.327927 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hdftd\" (UniqueName: \"kubernetes.io/projected/238a8ddb-87e9-44e9-88bb-f1d0d5df7d5d-kube-api-access-hdftd\") pod \"perf-node-gather-daemonset-jdxch\" (UID: \"238a8ddb-87e9-44e9-88bb-f1d0d5df7d5d\") " pod="openshift-must-gather-t2qd9/perf-node-gather-daemonset-jdxch" Jul 24 14:08:35.328175 ip-10-0-129-93 kubenswrapper[2578]: I0724 14:08:35.327986 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/238a8ddb-87e9-44e9-88bb-f1d0d5df7d5d-sys\") pod \"perf-node-gather-daemonset-jdxch\" (UID: \"238a8ddb-87e9-44e9-88bb-f1d0d5df7d5d\") " pod="openshift-must-gather-t2qd9/perf-node-gather-daemonset-jdxch" Jul 24 14:08:35.328175 ip-10-0-129-93 kubenswrapper[2578]: I0724 14:08:35.328041 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/238a8ddb-87e9-44e9-88bb-f1d0d5df7d5d-podres\") pod \"perf-node-gather-daemonset-jdxch\" (UID: \"238a8ddb-87e9-44e9-88bb-f1d0d5df7d5d\") " pod="openshift-must-gather-t2qd9/perf-node-gather-daemonset-jdxch" Jul 24 14:08:35.328175 ip-10-0-129-93 kubenswrapper[2578]: I0724 14:08:35.328048 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/238a8ddb-87e9-44e9-88bb-f1d0d5df7d5d-sys\") pod \"perf-node-gather-daemonset-jdxch\" (UID: \"238a8ddb-87e9-44e9-88bb-f1d0d5df7d5d\") " pod="openshift-must-gather-t2qd9/perf-node-gather-daemonset-jdxch" Jul 24 14:08:35.328175 ip-10-0-129-93 kubenswrapper[2578]: I0724 14:08:35.328069 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/238a8ddb-87e9-44e9-88bb-f1d0d5df7d5d-lib-modules\") pod \"perf-node-gather-daemonset-jdxch\" (UID: \"238a8ddb-87e9-44e9-88bb-f1d0d5df7d5d\") " pod="openshift-must-gather-t2qd9/perf-node-gather-daemonset-jdxch" Jul 24 14:08:35.328175 ip-10-0-129-93 kubenswrapper[2578]: I0724 14:08:35.328097 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/238a8ddb-87e9-44e9-88bb-f1d0d5df7d5d-proc\") pod \"perf-node-gather-daemonset-jdxch\" (UID: \"238a8ddb-87e9-44e9-88bb-f1d0d5df7d5d\") " pod="openshift-must-gather-t2qd9/perf-node-gather-daemonset-jdxch" Jul 24 14:08:35.328175 ip-10-0-129-93 kubenswrapper[2578]: I0724 14:08:35.328132 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/238a8ddb-87e9-44e9-88bb-f1d0d5df7d5d-podres\") pod \"perf-node-gather-daemonset-jdxch\" (UID: \"238a8ddb-87e9-44e9-88bb-f1d0d5df7d5d\") " pod="openshift-must-gather-t2qd9/perf-node-gather-daemonset-jdxch" Jul 24 14:08:35.328441 ip-10-0-129-93 kubenswrapper[2578]: I0724 14:08:35.328188 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/238a8ddb-87e9-44e9-88bb-f1d0d5df7d5d-proc\") pod \"perf-node-gather-daemonset-jdxch\" (UID: \"238a8ddb-87e9-44e9-88bb-f1d0d5df7d5d\") " pod="openshift-must-gather-t2qd9/perf-node-gather-daemonset-jdxch" Jul 24 14:08:35.328441 ip-10-0-129-93 kubenswrapper[2578]: I0724 14:08:35.328194 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/238a8ddb-87e9-44e9-88bb-f1d0d5df7d5d-lib-modules\") pod \"perf-node-gather-daemonset-jdxch\" (UID: \"238a8ddb-87e9-44e9-88bb-f1d0d5df7d5d\") " pod="openshift-must-gather-t2qd9/perf-node-gather-daemonset-jdxch" Jul 24 14:08:35.335736 ip-10-0-129-93 kubenswrapper[2578]: I0724 14:08:35.335717 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hdftd\" (UniqueName: \"kubernetes.io/projected/238a8ddb-87e9-44e9-88bb-f1d0d5df7d5d-kube-api-access-hdftd\") pod \"perf-node-gather-daemonset-jdxch\" (UID: \"238a8ddb-87e9-44e9-88bb-f1d0d5df7d5d\") " pod="openshift-must-gather-t2qd9/perf-node-gather-daemonset-jdxch" Jul 24 14:08:35.463539 ip-10-0-129-93 kubenswrapper[2578]: I0724 14:08:35.463514 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-t2qd9/perf-node-gather-daemonset-jdxch" Jul 24 14:08:35.596223 ip-10-0-129-93 kubenswrapper[2578]: I0724 14:08:35.596192 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-t2qd9/perf-node-gather-daemonset-jdxch"] Jul 24 14:08:35.599511 ip-10-0-129-93 kubenswrapper[2578]: W0724 14:08:35.599481 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod238a8ddb_87e9_44e9_88bb_f1d0d5df7d5d.slice/crio-ccff8c94de3f95ee6eabdd33b1a988285c520a08f8ac980994b5f2b0ceb798a9 WatchSource:0}: Error finding container ccff8c94de3f95ee6eabdd33b1a988285c520a08f8ac980994b5f2b0ceb798a9: Status 404 returned error can't find the container with id ccff8c94de3f95ee6eabdd33b1a988285c520a08f8ac980994b5f2b0ceb798a9 Jul 24 14:08:36.029031 ip-10-0-129-93 kubenswrapper[2578]: I0724 14:08:36.028942 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-76ffdf9bf9-2z5nt_1bed5e85-0d23-43b0-ac3a-7fb9c80f3bfd/console/0.log" Jul 24 14:08:36.351889 ip-10-0-129-93 kubenswrapper[2578]: I0724 14:08:36.351801 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-t2qd9/perf-node-gather-daemonset-jdxch" event={"ID":"238a8ddb-87e9-44e9-88bb-f1d0d5df7d5d","Type":"ContainerStarted","Data":"d5f3c05c5f33cd181fbec5c74130a3ccbdce258c54b386193bd92a173f1bc9cd"} Jul 24 14:08:36.351889 ip-10-0-129-93 kubenswrapper[2578]: I0724 14:08:36.351852 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-t2qd9/perf-node-gather-daemonset-jdxch" event={"ID":"238a8ddb-87e9-44e9-88bb-f1d0d5df7d5d","Type":"ContainerStarted","Data":"ccff8c94de3f95ee6eabdd33b1a988285c520a08f8ac980994b5f2b0ceb798a9"} Jul 24 14:08:36.352274 ip-10-0-129-93 kubenswrapper[2578]: I0724 14:08:36.351893 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-t2qd9/perf-node-gather-daemonset-jdxch" Jul 24 14:08:36.366358 ip-10-0-129-93 kubenswrapper[2578]: I0724 14:08:36.366314 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-t2qd9/perf-node-gather-daemonset-jdxch" podStartSLOduration=1.366301344 podStartE2EDuration="1.366301344s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 14:08:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:08:36.364934571 +0000 UTC m=+1524.022911955" watchObservedRunningTime="2026-07-24 14:08:36.366301344 +0000 UTC m=+1524.024278728" Jul 24 14:08:37.660066 ip-10-0-129-93 kubenswrapper[2578]: I0724 14:08:37.660035 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-t8cnk_110c903e-620c-4347-94f2-6ba9507a5eed/dns/0.log" Jul 24 14:08:37.679353 ip-10-0-129-93 kubenswrapper[2578]: I0724 14:08:37.679322 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-t8cnk_110c903e-620c-4347-94f2-6ba9507a5eed/kube-rbac-proxy/0.log" Jul 24 14:08:37.738679 ip-10-0-129-93 kubenswrapper[2578]: I0724 14:08:37.738646 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-xcdv9_535b3d7b-9b08-4a89-a61c-f44fcff4e888/dns-node-resolver/0.log" Jul 24 14:08:38.256313 ip-10-0-129-93 kubenswrapper[2578]: I0724 14:08:38.256284 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-n2fq4_1df394aa-3709-4031-b25f-40bf8b36331a/node-ca/0.log" Jul 24 14:08:39.211304 ip-10-0-129-93 kubenswrapper[2578]: I0724 14:08:39.211270 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-d5qvz_1e1f60ae-98f7-4d09-ae53-4dbc0acb1528/discovery/0.log" Jul 24 14:08:40.119294 ip-10-0-129-93 kubenswrapper[2578]: I0724 14:08:40.119260 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-4c9r4_177883b4-be88-4410-b00a-036caa467bc4/serve-healthcheck-canary/0.log" Jul 24 14:08:40.624878 ip-10-0-129-93 kubenswrapper[2578]: I0724 14:08:40.624841 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-brx7p_40a228a1-d1c2-44eb-b851-f3f49460a3aa/kube-rbac-proxy/0.log" Jul 24 14:08:40.643555 ip-10-0-129-93 kubenswrapper[2578]: I0724 14:08:40.643528 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-brx7p_40a228a1-d1c2-44eb-b851-f3f49460a3aa/exporter/0.log" Jul 24 14:08:40.662863 ip-10-0-129-93 kubenswrapper[2578]: I0724 14:08:40.662834 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-brx7p_40a228a1-d1c2-44eb-b851-f3f49460a3aa/extractor/0.log" Jul 24 14:08:42.367226 ip-10-0-129-93 kubenswrapper[2578]: I0724 14:08:42.367196 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-t2qd9/perf-node-gather-daemonset-jdxch" Jul 24 14:08:43.099393 ip-10-0-129-93 kubenswrapper[2578]: I0724 14:08:43.099361 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-674cffbf7-glh2v_447af81e-0c84-44c7-83e7-d2da205b57e5/manager/0.log" Jul 24 14:08:43.116303 ip-10-0-129-93 kubenswrapper[2578]: I0724 14:08:43.116280 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-674cffbf7-glh2v_447af81e-0c84-44c7-83e7-d2da205b57e5/copy-manifests/0.log" Jul 24 14:08:44.524574 ip-10-0-129-93 kubenswrapper[2578]: I0724 14:08:44.524541 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-78d5cc8c46-z527r_599a43d4-b4c3-4275-8c4e-35c20f3fb2cb/manager/0.log" Jul 24 14:08:45.177771 ip-10-0-129-93 kubenswrapper[2578]: I0724 14:08:45.177740 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-d5qvz_1e1f60ae-98f7-4d09-ae53-4dbc0acb1528/discovery/0.log" Jul 24 14:08:46.305672 ip-10-0-129-93 kubenswrapper[2578]: I0724 14:08:46.305634 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-d5qvz_1e1f60ae-98f7-4d09-ae53-4dbc0acb1528/discovery/0.log" Jul 24 14:08:50.985740 ip-10-0-129-93 kubenswrapper[2578]: I0724 14:08:50.985712 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pb4lc_8d537a43-c31b-4ed7-af8d-bab64bcdbbab/kube-multus-additional-cni-plugins/0.log" Jul 24 14:08:51.005556 ip-10-0-129-93 kubenswrapper[2578]: I0724 14:08:51.005530 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pb4lc_8d537a43-c31b-4ed7-af8d-bab64bcdbbab/egress-router-binary-copy/0.log" Jul 24 14:08:51.025189 ip-10-0-129-93 kubenswrapper[2578]: I0724 14:08:51.025167 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pb4lc_8d537a43-c31b-4ed7-af8d-bab64bcdbbab/cni-plugins/0.log" Jul 24 14:08:51.046626 ip-10-0-129-93 kubenswrapper[2578]: I0724 14:08:51.046608 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pb4lc_8d537a43-c31b-4ed7-af8d-bab64bcdbbab/bond-cni-plugin/0.log" Jul 24 14:08:51.065478 ip-10-0-129-93 kubenswrapper[2578]: I0724 14:08:51.065457 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pb4lc_8d537a43-c31b-4ed7-af8d-bab64bcdbbab/routeoverride-cni/0.log" Jul 24 14:08:51.083008 ip-10-0-129-93 kubenswrapper[2578]: I0724 14:08:51.082986 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pb4lc_8d537a43-c31b-4ed7-af8d-bab64bcdbbab/whereabouts-cni-bincopy/0.log" Jul 24 14:08:51.102738 ip-10-0-129-93 kubenswrapper[2578]: I0724 14:08:51.102705 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pb4lc_8d537a43-c31b-4ed7-af8d-bab64bcdbbab/whereabouts-cni/0.log" Jul 24 14:08:51.153566 ip-10-0-129-93 kubenswrapper[2578]: I0724 14:08:51.153534 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-h26v2_6e1b6e6b-98de-4c10-b588-219aec745e0d/kube-multus/0.log" Jul 24 14:08:51.197932 ip-10-0-129-93 kubenswrapper[2578]: I0724 14:08:51.197909 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-f8gm6_20a8559f-d049-4fac-b14a-5a1d2aaa1aa9/network-metrics-daemon/0.log" Jul 24 14:08:51.213803 ip-10-0-129-93 kubenswrapper[2578]: I0724 14:08:51.213778 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-f8gm6_20a8559f-d049-4fac-b14a-5a1d2aaa1aa9/kube-rbac-proxy/0.log"