Jul 28 17:20:34.327380 ip-10-0-129-31 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 28 17:20:34.327394 ip-10-0-129-31 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 28 17:20:34.327404 ip-10-0-129-31 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 28 17:20:34.327733 ip-10-0-129-31 systemd[1]: Failed to start Kubernetes Kubelet. Jul 28 17:20:45.874562 ip-10-0-129-31 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 28 17:20:45.874581 ip-10-0-129-31 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 0d625e9cca0d485ea99d8ab35db2fa46 -- Jul 28 17:22:43.524408 ip-10-0-129-31 systemd[1]: Starting Kubernetes Kubelet... Jul 28 17:22:43.963460 ip-10-0-129-31 kubenswrapper[2576]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 28 17:22:43.963460 ip-10-0-129-31 kubenswrapper[2576]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 28 17:22:43.963460 ip-10-0-129-31 kubenswrapper[2576]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 28 17:22:43.963460 ip-10-0-129-31 kubenswrapper[2576]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 28 17:22:43.963460 ip-10-0-129-31 kubenswrapper[2576]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 28 17:22:43.965112 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:43.964927 2576 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 28 17:22:43.970092 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.970075 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 17:22:43.970092 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.970093 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 17:22:43.970161 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.970097 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 17:22:43.970161 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.970100 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 17:22:43.970161 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.970103 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 17:22:43.970161 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.970107 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 17:22:43.970161 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.970110 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 17:22:43.970161 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.970113 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 17:22:43.970161 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.970115 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 17:22:43.970161 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.970118 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 17:22:43.970161 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.970122 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 17:22:43.970161 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.970124 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 17:22:43.970161 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.970127 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 17:22:43.970161 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.970132 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 17:22:43.970161 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.970135 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 17:22:43.970161 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.970138 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 17:22:43.970161 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.970140 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 17:22:43.970161 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.970143 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 17:22:43.970161 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.970146 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 17:22:43.970161 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.970149 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 17:22:43.970161 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.970155 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 17:22:43.970161 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.970158 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 17:22:43.970685 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.970162 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 17:22:43.970685 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.970165 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 17:22:43.970685 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.970168 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 17:22:43.970685 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.970171 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 17:22:43.970685 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.970174 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 28 17:22:43.970685 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.970177 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 17:22:43.970685 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.970180 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 17:22:43.970685 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.970203 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 17:22:43.970685 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.970206 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 17:22:43.970685 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.970209 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 17:22:43.970685 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.970212 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 17:22:43.970685 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.970215 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 17:22:43.970685 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.970217 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 17:22:43.970685 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.970220 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 17:22:43.970685 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.970223 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 17:22:43.970685 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.970226 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 17:22:43.970685 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.970229 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 17:22:43.970685 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.970232 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 17:22:43.970685 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.970234 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 17:22:43.970685 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.970237 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 17:22:43.971267 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.970240 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 17:22:43.971267 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.970243 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 17:22:43.971267 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.970245 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 17:22:43.971267 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.970248 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 17:22:43.971267 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.970252 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 17:22:43.971267 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.970255 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 17:22:43.971267 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.970258 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 17:22:43.971267 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.970261 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 17:22:43.971267 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.970264 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 17:22:43.971267 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.970266 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 17:22:43.971267 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.970269 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 17:22:43.971267 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.970272 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 17:22:43.971267 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.970274 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 17:22:43.971267 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.970278 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 17:22:43.971267 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.970281 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 17:22:43.971267 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.970285 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 17:22:43.971267 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.970287 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 17:22:43.971267 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.970290 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 17:22:43.971267 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.970293 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 17:22:43.971267 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.970296 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 17:22:43.971790 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.970300 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 17:22:43.971790 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.970304 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 17:22:43.971790 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.970307 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 17:22:43.971790 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.970310 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 17:22:43.971790 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.970313 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 17:22:43.971790 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.970317 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 17:22:43.971790 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.970320 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 17:22:43.971790 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.970323 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 17:22:43.971790 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.970326 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 17:22:43.971790 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.970329 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 17:22:43.971790 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.970333 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 17:22:43.971790 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.970337 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 17:22:43.971790 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.970340 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 17:22:43.971790 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.970343 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 17:22:43.971790 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.970346 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 17:22:43.971790 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.970349 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 17:22:43.971790 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.970352 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 17:22:43.971790 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.970355 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 17:22:43.971790 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.970358 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 17:22:43.972450 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.970361 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 17:22:43.972450 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.970363 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 17:22:43.972450 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.970366 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 17:22:43.972450 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.970369 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 17:22:43.972450 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.970372 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 17:22:43.972450 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.970376 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 17:22:43.972450 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.970381 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 17:22:43.972450 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.970384 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 17:22:43.972450 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.970387 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 17:22:43.972450 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.970390 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 17:22:43.972450 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.970393 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 17:22:43.972450 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.970396 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 17:22:43.972450 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.970399 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 17:22:43.972450 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.970401 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 17:22:43.972450 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.970404 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 17:22:43.972450 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.970407 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 17:22:43.972450 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.970410 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 17:22:43.972450 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.970412 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 17:22:43.972450 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.971181 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 17:22:43.972450 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.971189 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 17:22:43.972988 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.971207 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 17:22:43.972988 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.971211 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 17:22:43.972988 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.971214 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 17:22:43.972988 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.971217 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 17:22:43.972988 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.971220 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 17:22:43.972988 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.971223 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 17:22:43.972988 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.971226 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 17:22:43.972988 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.971229 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 17:22:43.972988 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.971231 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 17:22:43.972988 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.971234 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 17:22:43.972988 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.971237 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 17:22:43.972988 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.971241 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 17:22:43.972988 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.971244 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 17:22:43.972988 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.971247 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 17:22:43.972988 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.971250 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 17:22:43.972988 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.971252 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 17:22:43.972988 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.971255 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 17:22:43.972988 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.971258 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 17:22:43.972988 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.971264 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 17:22:43.973530 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.971270 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 17:22:43.973530 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.971273 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 17:22:43.973530 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.971276 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 28 17:22:43.973530 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.971280 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 17:22:43.973530 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.971283 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 17:22:43.973530 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.971287 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 17:22:43.973530 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.971290 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 17:22:43.973530 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.971293 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 17:22:43.973530 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.971296 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 17:22:43.973530 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.971299 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 17:22:43.973530 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.971302 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 17:22:43.973530 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.971305 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 17:22:43.973530 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.971307 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 17:22:43.973530 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.971310 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 17:22:43.973530 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.971313 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 17:22:43.973530 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.971316 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 17:22:43.973530 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.971319 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 17:22:43.973530 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.971321 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 17:22:43.973530 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.971324 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 17:22:43.973530 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.971327 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 17:22:43.974060 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.971329 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 17:22:43.974060 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.971332 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 17:22:43.974060 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.971335 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 17:22:43.974060 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.971337 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 17:22:43.974060 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.971340 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 17:22:43.974060 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.971343 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 17:22:43.974060 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.971346 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 17:22:43.974060 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.971349 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 17:22:43.974060 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.971352 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 17:22:43.974060 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.971354 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 17:22:43.974060 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.971357 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 17:22:43.974060 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.971360 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 17:22:43.974060 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.971363 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 17:22:43.974060 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.971366 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 17:22:43.974060 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.971369 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 17:22:43.974060 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.971372 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 17:22:43.974060 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.971375 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 17:22:43.974060 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.971378 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 17:22:43.974060 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.971382 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 17:22:43.974060 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.971385 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 17:22:43.974615 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.971388 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 17:22:43.974615 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.971391 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 17:22:43.974615 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.971393 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 17:22:43.974615 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.971396 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 17:22:43.974615 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.971399 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 17:22:43.974615 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.971402 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 17:22:43.974615 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.971404 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 17:22:43.974615 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.971407 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 17:22:43.974615 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.971410 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 17:22:43.974615 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.971412 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 17:22:43.974615 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.971415 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 17:22:43.974615 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.971418 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 17:22:43.974615 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.971421 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 17:22:43.974615 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.971424 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 17:22:43.974615 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.971427 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 17:22:43.974615 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.971430 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 17:22:43.974615 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.971432 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 17:22:43.974615 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.971435 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 17:22:43.974615 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.971438 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 17:22:43.974615 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.971441 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 17:22:43.975146 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.971444 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 17:22:43.975146 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.971447 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 17:22:43.975146 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.971450 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 17:22:43.975146 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.971454 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 17:22:43.975146 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.971456 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 17:22:43.975146 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.971460 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 17:22:43.975146 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.971462 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 17:22:43.975146 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.971465 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 17:22:43.975146 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.971468 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 17:22:43.975146 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.971471 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 17:22:43.975146 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.971473 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 17:22:43.975146 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.971476 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 17:22:43.975146 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.971479 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 17:22:43.975146 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.971482 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 17:22:43.975146 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.971486 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 17:22:43.975146 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.971490 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 17:22:43.975146 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.971493 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 17:22:43.975146 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.971497 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 17:22:43.975146 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.971904 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 17:22:43.975675 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.971910 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 17:22:43.975675 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.971913 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 17:22:43.975675 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.971917 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 17:22:43.975675 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.971920 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 17:22:43.975675 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.971923 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 17:22:43.975675 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.971927 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 17:22:43.975675 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.971930 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 17:22:43.975675 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.971933 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 17:22:43.975675 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.971936 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 17:22:43.975675 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.971939 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 17:22:43.975675 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.971942 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 17:22:43.975675 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.971945 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 17:22:43.975675 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.971948 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 17:22:43.975675 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.971951 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 17:22:43.975675 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.971954 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 17:22:43.975675 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.971957 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 17:22:43.975675 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.971960 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 17:22:43.975675 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.971962 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 17:22:43.975675 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.971965 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 17:22:43.975675 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.971968 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 17:22:43.976188 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.971971 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 17:22:43.976188 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.971974 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 17:22:43.976188 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.971977 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 17:22:43.976188 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.971980 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 17:22:43.976188 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.971982 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 17:22:43.976188 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.971985 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 17:22:43.976188 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.971988 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 17:22:43.976188 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.971992 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 17:22:43.976188 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.971997 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 17:22:43.976188 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.972001 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 17:22:43.976188 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.972004 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 17:22:43.976188 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.972007 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 17:22:43.976188 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.972010 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 17:22:43.976188 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.972014 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 17:22:43.976188 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.972017 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 17:22:43.976188 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.972020 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 17:22:43.976188 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.972023 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 17:22:43.976188 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.972027 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 17:22:43.976680 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.972032 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 17:22:43.976680 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.972035 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 17:22:43.976680 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.972039 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 17:22:43.976680 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.972042 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 17:22:43.976680 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.972045 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 17:22:43.976680 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.972048 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 17:22:43.976680 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.972051 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 17:22:43.976680 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.972054 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 17:22:43.976680 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.972058 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 17:22:43.976680 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.972060 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 17:22:43.976680 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.972064 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 17:22:43.976680 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.972067 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 17:22:43.976680 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.972069 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 17:22:43.976680 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.972072 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 17:22:43.976680 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.972075 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 17:22:43.976680 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.972078 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 17:22:43.976680 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.972081 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 17:22:43.976680 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.972083 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 17:22:43.976680 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.972086 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 17:22:43.976680 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.972089 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 17:22:43.977250 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.972091 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 17:22:43.977250 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.972094 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 17:22:43.977250 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.972097 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 17:22:43.977250 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.972099 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 17:22:43.977250 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.972102 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 17:22:43.977250 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.972105 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 17:22:43.977250 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.972108 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 17:22:43.977250 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.972111 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 17:22:43.977250 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.972113 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 17:22:43.977250 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.972116 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 17:22:43.977250 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.972119 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 17:22:43.977250 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.972122 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 17:22:43.977250 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.972125 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 17:22:43.977250 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.972127 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 17:22:43.977250 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.972130 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 17:22:43.977250 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.972133 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 17:22:43.977250 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.972135 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 17:22:43.977250 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.972138 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 17:22:43.977250 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.972140 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 17:22:43.977250 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.972145 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 17:22:43.977768 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.972147 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 17:22:43.977768 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.972150 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 17:22:43.977768 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.972153 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 17:22:43.977768 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.972159 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 17:22:43.977768 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.972162 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 17:22:43.977768 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.972165 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 17:22:43.977768 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.972167 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 17:22:43.977768 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.972170 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 17:22:43.977768 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.972173 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 17:22:43.977768 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.972176 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 17:22:43.977768 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.972179 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 17:22:43.977768 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.972181 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 28 17:22:43.977768 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.972184 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 17:22:43.977768 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.972187 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 17:22:43.977768 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.972190 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 17:22:43.977768 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.972209 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 17:22:43.977768 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.972212 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 17:22:43.977768 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.972215 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 17:22:43.977768 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.972218 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 17:22:43.978282 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.972221 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 17:22:43.978282 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:43.972300 2576 flags.go:64] FLAG: --address="0.0.0.0" Jul 28 17:22:43.978282 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:43.972308 2576 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 28 17:22:43.978282 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:43.972316 2576 flags.go:64] FLAG: --anonymous-auth="true" Jul 28 17:22:43.978282 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:43.972321 2576 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 28 17:22:43.978282 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:43.972325 2576 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 28 17:22:43.978282 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:43.972329 2576 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 28 17:22:43.978282 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:43.972333 2576 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 28 17:22:43.978282 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:43.972338 2576 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 28 17:22:43.978282 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:43.972341 2576 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 28 17:22:43.978282 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:43.972345 2576 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 28 17:22:43.978282 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:43.972349 2576 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 28 17:22:43.978282 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:43.972353 2576 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 28 17:22:43.978282 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:43.972357 2576 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 28 17:22:43.978282 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:43.972361 2576 flags.go:64] FLAG: --cgroup-root="" Jul 28 17:22:43.978282 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:43.972366 2576 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 28 17:22:43.978282 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:43.972371 2576 flags.go:64] FLAG: --client-ca-file="" Jul 28 17:22:43.978282 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:43.972374 2576 flags.go:64] FLAG: --cloud-provider="external" Jul 28 17:22:43.978282 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:43.972378 2576 flags.go:64] FLAG: --cluster-dns="[]" Jul 28 17:22:43.978282 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:43.972382 2576 flags.go:64] FLAG: --cluster-domain="" Jul 28 17:22:43.978282 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:43.972385 2576 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 28 17:22:43.978282 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:43.972389 2576 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 28 17:22:43.978282 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:43.972393 2576 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 28 17:22:43.978282 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:43.972397 2576 flags.go:64] FLAG: --container-log-max-files="5" Jul 28 17:22:43.978996 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:43.972401 2576 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 28 17:22:43.978996 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:43.972405 2576 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 28 17:22:43.978996 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:43.972408 2576 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 28 17:22:43.978996 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:43.972412 2576 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 28 17:22:43.978996 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:43.972415 2576 flags.go:64] FLAG: --contention-profiling="false" Jul 28 17:22:43.978996 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:43.972418 2576 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 28 17:22:43.978996 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:43.972421 2576 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 28 17:22:43.978996 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:43.972425 2576 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 28 17:22:43.978996 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:43.972428 2576 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 28 17:22:43.978996 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:43.972435 2576 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 28 17:22:43.978996 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:43.972438 2576 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 28 17:22:43.978996 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:43.972441 2576 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 28 17:22:43.978996 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:43.972444 2576 flags.go:64] FLAG: --enable-load-reader="false" Jul 28 17:22:43.978996 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:43.972448 2576 flags.go:64] FLAG: --enable-server="true" Jul 28 17:22:43.978996 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:43.972451 2576 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 28 17:22:43.978996 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:43.972457 2576 flags.go:64] FLAG: --event-burst="100" Jul 28 17:22:43.978996 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:43.972460 2576 flags.go:64] FLAG: --event-qps="50" Jul 28 17:22:43.978996 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:43.972464 2576 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 28 17:22:43.978996 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:43.972468 2576 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 28 17:22:43.978996 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:43.972471 2576 flags.go:64] FLAG: --eviction-hard="" Jul 28 17:22:43.978996 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:43.972475 2576 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 28 17:22:43.978996 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:43.972478 2576 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 28 17:22:43.978996 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:43.972482 2576 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 28 17:22:43.978996 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:43.972487 2576 flags.go:64] FLAG: --eviction-soft="" Jul 28 17:22:43.978996 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:43.972491 2576 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 28 17:22:43.979654 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:43.972494 2576 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 28 17:22:43.979654 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:43.972497 2576 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 28 17:22:43.979654 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:43.972500 2576 flags.go:64] FLAG: --experimental-mounter-path="" Jul 28 17:22:43.979654 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:43.972504 2576 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 28 17:22:43.979654 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:43.972507 2576 flags.go:64] FLAG: --fail-swap-on="true" Jul 28 17:22:43.979654 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:43.972510 2576 flags.go:64] FLAG: --feature-gates="" Jul 28 17:22:43.979654 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:43.972514 2576 flags.go:64] FLAG: --file-check-frequency="20s" Jul 28 17:22:43.979654 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:43.972517 2576 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 28 17:22:43.979654 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:43.972520 2576 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 28 17:22:43.979654 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:43.972524 2576 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 28 17:22:43.979654 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:43.972527 2576 flags.go:64] FLAG: --healthz-port="10248" Jul 28 17:22:43.979654 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:43.972531 2576 flags.go:64] FLAG: --help="false" Jul 28 17:22:43.979654 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:43.972533 2576 flags.go:64] FLAG: --hostname-override="ip-10-0-129-31.ec2.internal" Jul 28 17:22:43.979654 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:43.972537 2576 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 28 17:22:43.979654 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:43.972540 2576 flags.go:64] FLAG: --http-check-frequency="20s" Jul 28 17:22:43.979654 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:43.972543 2576 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 28 17:22:43.979654 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:43.972547 2576 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 28 17:22:43.979654 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:43.972550 2576 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 28 17:22:43.979654 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:43.972554 2576 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 28 17:22:43.979654 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:43.972557 2576 flags.go:64] FLAG: --image-service-endpoint="" Jul 28 17:22:43.979654 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:43.972560 2576 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 28 17:22:43.979654 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:43.972563 2576 flags.go:64] FLAG: --kube-api-burst="100" Jul 28 17:22:43.979654 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:43.972566 2576 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 28 17:22:43.980320 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:43.972569 2576 flags.go:64] FLAG: --kube-api-qps="50" Jul 28 17:22:43.980320 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:43.972572 2576 flags.go:64] FLAG: --kube-reserved="" Jul 28 17:22:43.980320 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:43.972575 2576 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 28 17:22:43.980320 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:43.972578 2576 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 28 17:22:43.980320 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:43.972581 2576 flags.go:64] FLAG: --kubelet-cgroups="" Jul 28 17:22:43.980320 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:43.972584 2576 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 28 17:22:43.980320 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:43.972587 2576 flags.go:64] FLAG: --lock-file="" Jul 28 17:22:43.980320 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:43.972591 2576 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 28 17:22:43.980320 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:43.972596 2576 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 28 17:22:43.980320 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:43.972599 2576 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 28 17:22:43.980320 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:43.972605 2576 flags.go:64] FLAG: --log-json-split-stream="false" Jul 28 17:22:43.980320 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:43.972609 2576 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 28 17:22:43.980320 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:43.972612 2576 flags.go:64] FLAG: --log-text-split-stream="false" Jul 28 17:22:43.980320 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:43.972615 2576 flags.go:64] FLAG: --logging-format="text" Jul 28 17:22:43.980320 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:43.972618 2576 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 28 17:22:43.980320 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:43.972622 2576 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 28 17:22:43.980320 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:43.972625 2576 flags.go:64] FLAG: --manifest-url="" Jul 28 17:22:43.980320 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:43.972628 2576 flags.go:64] FLAG: --manifest-url-header="" Jul 28 17:22:43.980320 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:43.972645 2576 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 28 17:22:43.980320 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:43.972648 2576 flags.go:64] FLAG: --max-open-files="1000000" Jul 28 17:22:43.980320 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:43.972653 2576 flags.go:64] FLAG: --max-pods="110" Jul 28 17:22:43.980320 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:43.972656 2576 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 28 17:22:43.980320 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:43.972659 2576 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 28 17:22:43.980320 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:43.972663 2576 flags.go:64] FLAG: --memory-manager-policy="None" Jul 28 17:22:43.980320 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:43.972666 2576 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 28 17:22:43.980993 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:43.972669 2576 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 28 17:22:43.980993 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:43.972673 2576 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 28 17:22:43.980993 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:43.972676 2576 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 28 17:22:43.980993 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:43.972683 2576 flags.go:64] FLAG: --node-status-max-images="50" Jul 28 17:22:43.980993 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:43.972686 2576 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 28 17:22:43.980993 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:43.972689 2576 flags.go:64] FLAG: --oom-score-adj="-999" Jul 28 17:22:43.980993 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:43.972693 2576 flags.go:64] FLAG: --pod-cidr="" Jul 28 17:22:43.980993 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:43.972696 2576 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb" Jul 28 17:22:43.980993 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:43.972703 2576 flags.go:64] FLAG: --pod-manifest-path="" Jul 28 17:22:43.980993 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:43.972706 2576 flags.go:64] FLAG: --pod-max-pids="-1" Jul 28 17:22:43.980993 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:43.972709 2576 flags.go:64] FLAG: --pods-per-core="0" Jul 28 17:22:43.980993 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:43.972713 2576 flags.go:64] FLAG: --port="10250" Jul 28 17:22:43.980993 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:43.972716 2576 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 28 17:22:43.980993 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:43.972719 2576 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0170cd4f5f73dd75c" Jul 28 17:22:43.980993 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:43.972723 2576 flags.go:64] FLAG: --qos-reserved="" Jul 28 17:22:43.980993 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:43.972728 2576 flags.go:64] FLAG: --read-only-port="10255" Jul 28 17:22:43.980993 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:43.972731 2576 flags.go:64] FLAG: --register-node="true" Jul 28 17:22:43.980993 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:43.972735 2576 flags.go:64] FLAG: --register-with-taints="" Jul 28 17:22:43.980993 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:43.972738 2576 flags.go:64] FLAG: --registry-burst="10" Jul 28 17:22:43.980993 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:43.972742 2576 flags.go:64] FLAG: --registry-qps="5" Jul 28 17:22:43.980993 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:43.972745 2576 flags.go:64] FLAG: --reserved-cpus="" Jul 28 17:22:43.980993 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:43.972748 2576 flags.go:64] FLAG: --reserved-memory="" Jul 28 17:22:43.980993 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:43.972752 2576 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 28 17:22:43.980993 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:43.972755 2576 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 28 17:22:43.980993 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:43.972758 2576 flags.go:64] FLAG: --rotate-certificates="false" Jul 28 17:22:43.981662 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:43.972762 2576 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 28 17:22:43.981662 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:43.972765 2576 flags.go:64] FLAG: --runonce="false" Jul 28 17:22:43.981662 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:43.972768 2576 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 28 17:22:43.981662 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:43.972771 2576 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 28 17:22:43.981662 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:43.972774 2576 flags.go:64] FLAG: --seccomp-default="false" Jul 28 17:22:43.981662 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:43.972778 2576 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 28 17:22:43.981662 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:43.972781 2576 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 28 17:22:43.981662 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:43.972784 2576 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 28 17:22:43.981662 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:43.972787 2576 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 28 17:22:43.981662 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:43.972791 2576 flags.go:64] FLAG: --storage-driver-password="root" Jul 28 17:22:43.981662 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:43.972794 2576 flags.go:64] FLAG: --storage-driver-secure="false" Jul 28 17:22:43.981662 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:43.972797 2576 flags.go:64] FLAG: --storage-driver-table="stats" Jul 28 17:22:43.981662 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:43.972800 2576 flags.go:64] FLAG: --storage-driver-user="root" Jul 28 17:22:43.981662 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:43.972803 2576 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 28 17:22:43.981662 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:43.972807 2576 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 28 17:22:43.981662 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:43.972810 2576 flags.go:64] FLAG: --system-cgroups="" Jul 28 17:22:43.981662 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:43.972813 2576 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 28 17:22:43.981662 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:43.972818 2576 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 28 17:22:43.981662 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:43.972821 2576 flags.go:64] FLAG: --tls-cert-file="" Jul 28 17:22:43.981662 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:43.972824 2576 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 28 17:22:43.981662 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:43.972829 2576 flags.go:64] FLAG: --tls-min-version="" Jul 28 17:22:43.981662 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:43.972832 2576 flags.go:64] FLAG: --tls-private-key-file="" Jul 28 17:22:43.981662 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:43.972836 2576 flags.go:64] FLAG: --topology-manager-policy="none" Jul 28 17:22:43.981662 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:43.972840 2576 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 28 17:22:43.981662 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:43.972843 2576 flags.go:64] FLAG: --topology-manager-scope="container" Jul 28 17:22:43.982393 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:43.972847 2576 flags.go:64] FLAG: --v="2" Jul 28 17:22:43.982393 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:43.972851 2576 flags.go:64] FLAG: --version="false" Jul 28 17:22:43.982393 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:43.972855 2576 flags.go:64] FLAG: --vmodule="" Jul 28 17:22:43.982393 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:43.972859 2576 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 28 17:22:43.982393 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:43.972863 2576 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 28 17:22:43.982393 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.973001 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 17:22:43.982393 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.973005 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 17:22:43.982393 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.973009 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 17:22:43.982393 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.973012 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 17:22:43.982393 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.973015 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 17:22:43.982393 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.973017 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 17:22:43.982393 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.973020 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 17:22:43.982393 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.973023 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 17:22:43.982393 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.973025 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 17:22:43.982393 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.973028 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 17:22:43.982393 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.973031 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 17:22:43.982393 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.973034 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 17:22:43.982393 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.973037 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 17:22:43.982393 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.973040 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 17:22:43.982393 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.973043 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 17:22:43.982393 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.973045 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 17:22:43.982945 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.973048 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 17:22:43.982945 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.973051 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 17:22:43.982945 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.973054 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 17:22:43.982945 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.973056 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 17:22:43.982945 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.973059 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 17:22:43.982945 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.973062 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 17:22:43.982945 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.973064 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 28 17:22:43.982945 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.973067 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 17:22:43.982945 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.973073 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 17:22:43.982945 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.973076 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 17:22:43.982945 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.973079 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 17:22:43.982945 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.973082 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 17:22:43.982945 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.973085 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 17:22:43.982945 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.973088 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 17:22:43.982945 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.973091 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 17:22:43.982945 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.973093 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 17:22:43.982945 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.973100 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 17:22:43.982945 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.973103 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 17:22:43.982945 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.973106 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 17:22:43.982945 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.973109 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 17:22:43.983553 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.973112 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 17:22:43.983553 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.973115 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 17:22:43.983553 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.973117 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 17:22:43.983553 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.973120 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 17:22:43.983553 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.973123 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 17:22:43.983553 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.973125 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 17:22:43.983553 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.973128 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 17:22:43.983553 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.973131 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 17:22:43.983553 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.973134 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 17:22:43.983553 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.973137 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 17:22:43.983553 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.973139 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 17:22:43.983553 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.973143 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 17:22:43.983553 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.973145 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 17:22:43.983553 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.973148 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 17:22:43.983553 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.973151 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 17:22:43.983553 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.973153 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 17:22:43.983553 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.973156 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 17:22:43.983553 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.973160 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 17:22:43.983553 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.973164 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 17:22:43.984050 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.973167 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 17:22:43.984050 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.973173 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 17:22:43.984050 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.973176 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 17:22:43.984050 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.973179 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 17:22:43.984050 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.973182 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 17:22:43.984050 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.973185 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 17:22:43.984050 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.973188 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 17:22:43.984050 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.973206 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 17:22:43.984050 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.973209 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 17:22:43.984050 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.973212 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 17:22:43.984050 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.973215 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 17:22:43.984050 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.973218 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 17:22:43.984050 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.973220 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 17:22:43.984050 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.973223 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 17:22:43.984050 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.973226 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 17:22:43.984050 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.973229 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 17:22:43.984050 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.973231 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 17:22:43.984050 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.973234 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 17:22:43.984050 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.973237 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 17:22:43.984050 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.973240 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 17:22:43.984593 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.973243 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 17:22:43.984593 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.973245 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 17:22:43.984593 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.973248 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 17:22:43.984593 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.973251 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 17:22:43.984593 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.973253 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 17:22:43.984593 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.973256 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 17:22:43.984593 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.973260 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 17:22:43.984593 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.973264 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 17:22:43.984593 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.973267 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 17:22:43.984593 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.973270 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 17:22:43.984593 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.973273 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 17:22:43.984593 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.973276 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 17:22:43.984593 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.973278 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 17:22:43.984593 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.973285 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 17:22:43.984593 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.973287 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 17:22:43.984593 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.973291 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 17:22:43.984593 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.973294 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 17:22:43.984593 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.973302 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 17:22:43.984593 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.973305 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 17:22:43.985084 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.973308 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 17:22:43.985084 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.973311 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 17:22:43.985084 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.973315 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 17:22:43.985084 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.973319 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 17:22:43.985084 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.973322 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 17:22:43.985084 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:43.974824 2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 28 17:22:43.985084 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:43.982701 2576 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 28 17:22:43.985084 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:43.982718 2576 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 28 17:22:43.985084 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:43.982739 2576 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 28 17:22:43.985084 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:43.982745 2576 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 28 17:22:43.985084 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.982809 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 17:22:43.985084 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.982815 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 17:22:43.985084 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.982819 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 17:22:43.985084 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.982823 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 17:22:43.985479 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.982826 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 17:22:43.985479 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.982829 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 17:22:43.985479 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.982832 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 17:22:43.985479 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.982835 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 17:22:43.985479 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.982838 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 17:22:43.985479 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.982841 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 17:22:43.985479 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.982844 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 17:22:43.985479 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.982847 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 17:22:43.985479 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.982850 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 17:22:43.985479 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.982853 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 17:22:43.985479 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.982856 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 17:22:43.985479 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.982858 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 17:22:43.985479 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.982861 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 17:22:43.985479 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.982864 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 17:22:43.985479 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.982867 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 17:22:43.985479 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.982870 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 17:22:43.985479 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.982873 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 17:22:43.985479 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.982876 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 17:22:43.985479 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.982879 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 17:22:43.985479 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.982882 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 17:22:43.986009 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.982885 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 17:22:43.986009 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.982888 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 17:22:43.986009 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.982890 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 17:22:43.986009 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.982893 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 17:22:43.986009 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.982896 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 17:22:43.986009 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.982900 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 17:22:43.986009 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.982905 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 17:22:43.986009 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.982908 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 17:22:43.986009 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.982912 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 17:22:43.986009 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.982915 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 17:22:43.986009 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.982918 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 17:22:43.986009 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.982921 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 17:22:43.986009 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.982924 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 17:22:43.986009 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.982927 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 17:22:43.986009 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.982930 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 17:22:43.986009 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.982932 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 17:22:43.986009 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.982935 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 17:22:43.986009 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.982938 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 17:22:43.986009 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.982941 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 17:22:43.986514 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.982944 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 17:22:43.986514 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.982947 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 17:22:43.986514 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.982951 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 17:22:43.986514 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.982953 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 17:22:43.986514 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.982956 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 17:22:43.986514 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.982959 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 17:22:43.986514 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.982962 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 28 17:22:43.986514 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.982965 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 17:22:43.986514 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.982968 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 17:22:43.986514 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.982971 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 17:22:43.986514 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.982974 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 17:22:43.986514 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.982977 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 17:22:43.986514 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.982980 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 17:22:43.986514 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.982983 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 17:22:43.986514 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.982986 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 17:22:43.986514 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.982988 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 17:22:43.986514 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.982991 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 17:22:43.986514 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.982994 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 17:22:43.986514 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.982997 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 17:22:43.986514 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.983001 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 17:22:43.987037 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.983004 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 17:22:43.987037 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.983007 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 17:22:43.987037 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.983010 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 17:22:43.987037 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.983013 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 17:22:43.987037 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.983015 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 17:22:43.987037 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.983020 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 17:22:43.987037 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.983023 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 17:22:43.987037 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.983029 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 17:22:43.987037 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.983032 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 17:22:43.987037 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.983035 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 17:22:43.987037 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.983038 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 17:22:43.987037 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.983041 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 17:22:43.987037 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.983044 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 17:22:43.987037 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.983046 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 17:22:43.987037 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.983049 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 17:22:43.987037 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.983052 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 17:22:43.987037 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.983054 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 17:22:43.987037 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.983057 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 17:22:43.987037 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.983060 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 17:22:43.987037 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.983063 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 17:22:43.987579 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.983066 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 17:22:43.987579 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.983070 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 17:22:43.987579 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.983073 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 17:22:43.987579 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.983077 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 17:22:43.987579 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.983080 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 17:22:43.987579 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.983083 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 17:22:43.987579 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.983086 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 17:22:43.987579 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.983089 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 17:22:43.987579 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.983092 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 17:22:43.987579 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.983095 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 17:22:43.987579 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.983099 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 17:22:43.987579 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.983102 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 17:22:43.987579 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.983104 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 17:22:43.987579 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.983107 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 17:22:43.987579 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.983110 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 17:22:43.987579 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.983113 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 17:22:43.987993 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:43.983118 2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 28 17:22:43.987993 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.983265 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 17:22:43.987993 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.983272 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 17:22:43.987993 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.983277 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 17:22:43.987993 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.983281 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 17:22:43.987993 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.983285 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 17:22:43.987993 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.983288 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 17:22:43.987993 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.983291 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 17:22:43.987993 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.983294 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 17:22:43.987993 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.983297 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 17:22:43.987993 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.983300 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 17:22:43.987993 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.983303 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 17:22:43.987993 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.983305 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 17:22:43.987993 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.983308 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 17:22:43.987993 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.983311 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 17:22:43.988465 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.983314 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 17:22:43.988465 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.983317 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 17:22:43.988465 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.983320 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 17:22:43.988465 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.983323 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 17:22:43.988465 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.983326 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 17:22:43.988465 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.983329 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 17:22:43.988465 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.983332 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 17:22:43.988465 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.983335 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 17:22:43.988465 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.983338 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 17:22:43.988465 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.983341 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 17:22:43.988465 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.983343 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 17:22:43.988465 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.983347 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 17:22:43.988465 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.983351 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 17:22:43.988465 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.983354 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 17:22:43.988465 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.983357 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 28 17:22:43.988465 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.983359 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 17:22:43.988465 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.983362 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 17:22:43.988465 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.983365 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 17:22:43.988465 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.983368 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 17:22:43.988465 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.983372 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 17:22:43.988988 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.983376 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 17:22:43.988988 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.983379 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 17:22:43.988988 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.983382 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 17:22:43.988988 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.983385 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 17:22:43.988988 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.983388 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 17:22:43.988988 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.983391 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 17:22:43.988988 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.983393 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 17:22:43.988988 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.983396 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 17:22:43.988988 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.983399 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 17:22:43.988988 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.983401 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 17:22:43.988988 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.983404 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 17:22:43.988988 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.983407 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 17:22:43.988988 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.983410 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 17:22:43.988988 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.983413 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 17:22:43.988988 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.983416 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 17:22:43.988988 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.983419 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 17:22:43.988988 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.983421 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 17:22:43.988988 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.983424 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 17:22:43.988988 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.983428 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 17:22:43.989485 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.983430 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 17:22:43.989485 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.983433 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 17:22:43.989485 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.983436 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 17:22:43.989485 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.983438 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 17:22:43.989485 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.983441 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 17:22:43.989485 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.983445 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 17:22:43.989485 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.983448 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 17:22:43.989485 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.983452 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 17:22:43.989485 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.983456 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 17:22:43.989485 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.983459 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 17:22:43.989485 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.983462 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 17:22:43.989485 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.983465 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 17:22:43.989485 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.983468 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 17:22:43.989485 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.983471 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 17:22:43.989485 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.983475 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 17:22:43.989485 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.983478 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 17:22:43.989485 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.983481 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 17:22:43.989485 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.983484 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 17:22:43.989485 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.983487 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 17:22:43.989970 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.983490 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 17:22:43.989970 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.983493 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 17:22:43.989970 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.983496 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 17:22:43.989970 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.983499 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 17:22:43.989970 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.983502 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 17:22:43.989970 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.983504 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 17:22:43.989970 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.983507 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 17:22:43.989970 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.983510 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 17:22:43.989970 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.983513 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 17:22:43.989970 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.983515 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 17:22:43.989970 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.983518 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 17:22:43.989970 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.983521 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 17:22:43.989970 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.983524 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 17:22:43.989970 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.983527 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 17:22:43.989970 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.983530 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 17:22:43.989970 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.983532 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 17:22:43.989970 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.983535 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 17:22:43.989970 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.983538 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 17:22:43.989970 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.983541 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 17:22:43.989970 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.983544 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 17:22:43.990506 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.983547 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 17:22:43.990506 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.983549 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 17:22:43.990506 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.983554 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 17:22:43.990506 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.983558 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 17:22:43.990506 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.983561 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 17:22:43.990506 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.983564 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 17:22:43.990506 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:43.983567 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 17:22:43.990506 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:43.983573 2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 28 17:22:43.990506 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:43.983674 2576 server.go:962] "Client rotation is on, will bootstrap in background" Jul 28 17:22:43.990506 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:43.985837 2576 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 28 17:22:43.990506 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:43.987221 2576 server.go:1019] "Starting client certificate rotation" Jul 28 17:22:43.990506 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:43.987327 2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 28 17:22:43.990506 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:43.988441 2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 28 17:22:43.990867 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:43.990477 2576 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 28 17:22:43.991954 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:43.991930 2576 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 28 17:22:44.003660 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:44.003641 2576 log.go:25] "Validated CRI v1 runtime API" Jul 28 17:22:44.005745 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:44.005728 2576 log.go:25] "Validated CRI v1 image API" Jul 28 17:22:44.009355 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:44.009339 2576 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 28 17:22:44.012061 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:44.012036 2576 fs.go:135] Filesystem UUIDs: map[20c68538-71d0-4749-b9dc-fc6c95a8ea7c:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 d3d81e16-0395-46d7-8b65-00bbf70a0ee3:/dev/nvme0n1p3] Jul 28 17:22:44.012138 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:44.012061 2576 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 28 17:22:44.017832 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:44.017702 2576 manager.go:216] Machine: {Timestamp:2026-07-28 17:22:44.016092657 +0000 UTC m=+0.368446000 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099908 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2143d52a5b47ddfb7703333c03e47d SystemUUID:ec2143d5-2a5b-47dd-fb77-03333c03e47d BootID:0d625e9c-ca0d-485e-a99d-8ab35db2fa46 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:d5:1a:6a:76:cf Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:d5:1a:6a:76:cf Speed:0 Mtu:9001} {Name:ovs-system MacAddress:5a:e0:a9:9b:1e:7e Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 28 17:22:44.017832 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:44.017825 2576 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 28 17:22:44.018005 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:44.017936 2576 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 28 17:22:44.021506 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:44.021476 2576 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 28 17:22:44.021653 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:44.021511 2576 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-129-31.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 28 17:22:44.023320 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:44.023308 2576 topology_manager.go:138] "Creating topology manager with none policy" Jul 28 17:22:44.023356 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:44.023322 2576 container_manager_linux.go:309] "Creating device plugin manager" Jul 28 17:22:44.023356 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:44.023330 2576 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 28 17:22:44.024292 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:44.024278 2576 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 28 17:22:44.025273 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:44.025262 2576 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 28 17:22:44.027302 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:44.027289 2576 state_mem.go:36] "Initialized new in-memory state store" Jul 28 17:22:44.027427 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:44.027417 2576 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 28 17:22:44.027469 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:44.027448 2576 kubelet.go:486] "Attempting to sync node with API server" Jul 28 17:22:44.027469 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:44.027459 2576 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 28 17:22:44.027525 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:44.027475 2576 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 28 17:22:44.027525 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:44.027485 2576 kubelet.go:398] "Adding apiserver pod source" Jul 28 17:22:44.027525 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:44.027494 2576 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 28 17:22:44.027919 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:44.027906 2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 28 17:22:44.027965 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:44.027926 2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 28 17:22:44.029947 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:44.029927 2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 28 17:22:44.030495 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:44.030480 2576 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 28 17:22:44.032790 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:44.032772 2576 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 28 17:22:44.032870 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:44.032813 2576 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 28 17:22:44.034518 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:44.034503 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 28 17:22:44.034600 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:44.034523 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 28 17:22:44.034600 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:44.034535 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 28 17:22:44.034600 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:44.034544 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 28 17:22:44.034600 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:44.034558 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 28 17:22:44.034600 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:44.034567 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 28 17:22:44.034600 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:44.034581 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 28 17:22:44.034600 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:44.034590 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 28 17:22:44.034600 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:44.034600 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 28 17:22:44.034865 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:44.034609 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 28 17:22:44.034865 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:44.034641 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 28 17:22:44.034865 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:44.034651 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 28 17:22:44.035687 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:44.035674 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 28 17:22:44.035756 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:44.035690 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 28 17:22:44.039136 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:44.039119 2576 server.go:1268] "Started kubelet" Jul 28 17:22:44.039282 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:44.039222 2576 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 28 17:22:44.039397 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:44.039233 2576 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 28 17:22:44.039397 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:44.039327 2576 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 28 17:22:44.040168 ip-10-0-129-31 systemd[1]: Started Kubernetes Kubelet. Jul 28 17:22:44.044934 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:44.044282 2576 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-129-31.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 28 17:22:44.044934 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:22:44.044722 2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-129-31.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 28 17:22:44.044934 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:44.044769 2576 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 28 17:22:44.045186 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:22:44.045156 2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 28 17:22:44.045309 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:44.045270 2576 server.go:310] "Adding debug handlers to kubelet server" Jul 28 17:22:44.046264 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:22:44.046242 2576 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 28 17:22:44.051498 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:22:44.049793 2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-31.ec2.internal.18c683eed17d6150 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-31.ec2.internal,UID:ip-10-0-129-31.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-129-31.ec2.internal,},FirstTimestamp:2026-07-28 17:22:44.039090512 +0000 UTC m=+0.391443891,LastTimestamp:2026-07-28 17:22:44.039090512 +0000 UTC m=+0.391443891,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-31.ec2.internal,}" Jul 28 17:22:44.060437 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:44.060419 2576 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 28 17:22:44.060513 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:44.060439 2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 28 17:22:44.060829 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:22:44.060603 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-31.ec2.internal\" not found" Jul 28 17:22:44.061233 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:44.061214 2576 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 28 17:22:44.061233 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:44.061216 2576 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 28 17:22:44.061369 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:44.061245 2576 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 28 17:22:44.061421 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:44.061370 2576 reconstruct.go:97] "Volume reconstruction finished" Jul 28 17:22:44.061421 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:44.061381 2576 reconciler.go:29] "Reconciler: start to sync state" Jul 28 17:22:44.061421 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:44.061387 2576 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 28 17:22:44.061421 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:44.061404 2576 factory.go:55] Registering systemd factory Jul 28 17:22:44.061421 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:44.061414 2576 factory.go:223] Registration of the systemd container factory successfully Jul 28 17:22:44.061686 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:44.061669 2576 factory.go:153] Registering CRI-O factory Jul 28 17:22:44.061750 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:44.061690 2576 factory.go:223] Registration of the crio container factory successfully Jul 28 17:22:44.061750 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:44.061717 2576 factory.go:103] Registering Raw factory Jul 28 17:22:44.061750 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:44.061732 2576 manager.go:1196] Started watching for new ooms in manager Jul 28 17:22:44.061868 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:44.061802 2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-cf5lc" Jul 28 17:22:44.062550 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:44.062467 2576 manager.go:349] Starting recovery of all containers Jul 28 17:22:44.071007 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:44.070981 2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-cf5lc" Jul 28 17:22:44.072663 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:44.072643 2576 manager.go:354] Recovery completed Jul 28 17:22:44.074669 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:22:44.074643 2576 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-129-31.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 28 17:22:44.074775 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:22:44.074684 2576 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 28 17:22:44.077696 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:44.077681 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 17:22:44.079846 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:44.079831 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-31.ec2.internal" event="NodeHasSufficientMemory" Jul 28 17:22:44.079908 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:44.079862 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-31.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 17:22:44.079908 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:44.079875 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-31.ec2.internal" event="NodeHasSufficientPID" Jul 28 17:22:44.080428 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:44.080408 2576 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 28 17:22:44.080428 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:44.080424 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 17:22:44.080588 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:44.080425 2576 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 28 17:22:44.080588 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:44.080486 2576 state_mem.go:36] "Initialized new in-memory state store" Jul 28 17:22:44.081266 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:44.081249 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-31.ec2.internal" event="NodeHasSufficientMemory" Jul 28 17:22:44.081350 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:44.081285 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-31.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 17:22:44.081350 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:44.081302 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-31.ec2.internal" event="NodeHasSufficientPID" Jul 28 17:22:44.082294 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:44.082279 2576 policy_none.go:49] "None policy: Start" Jul 28 17:22:44.082294 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:44.082297 2576 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 28 17:22:44.082387 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:44.082309 2576 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 28 17:22:44.083570 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:44.083559 2576 policy_none.go:47] "Start" Jul 28 17:22:44.124002 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:44.123780 2576 manager.go:337] "Starting Device Plugin manager" Jul 28 17:22:44.124112 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:22:44.124022 2576 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 28 17:22:44.124253 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:44.124035 2576 server.go:87] "Starting device plugin registration server" Jul 28 17:22:44.124586 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:44.124561 2576 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 28 17:22:44.124678 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:44.124585 2576 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 28 17:22:44.126656 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:44.124853 2576 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 28 17:22:44.126656 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:44.124948 2576 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 28 17:22:44.126656 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:44.124957 2576 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 28 17:22:44.126656 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:22:44.125771 2576 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 28 17:22:44.126656 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:22:44.125833 2576 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-129-31.ec2.internal\" not found" Jul 28 17:22:44.229318 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:44.229280 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 17:22:44.230578 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:44.230447 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-31.ec2.internal" event="NodeHasSufficientMemory" Jul 28 17:22:44.230578 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:44.230483 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-31.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 17:22:44.230578 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:44.230495 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-31.ec2.internal" event="NodeHasSufficientPID" Jul 28 17:22:44.230578 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:44.230524 2576 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-129-31.ec2.internal" Jul 28 17:22:44.231985 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:44.231957 2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 28 17:22:44.233307 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:44.233288 2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 28 17:22:44.233408 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:44.233328 2576 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 28 17:22:44.233408 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:44.233351 2576 kubelet.go:2448] "Starting kubelet main sync loop" Jul 28 17:22:44.233408 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:22:44.233389 2576 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 28 17:22:44.235545 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:44.235523 2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 17:22:44.237904 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:44.237885 2576 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-129-31.ec2.internal" Jul 28 17:22:44.237987 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:22:44.237910 2576 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-129-31.ec2.internal\": node \"ip-10-0-129-31.ec2.internal\" not found" Jul 28 17:22:44.266528 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:22:44.266507 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-31.ec2.internal\" not found" Jul 28 17:22:44.334518 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:44.334434 2576 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-31.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-129-31.ec2.internal"] Jul 28 17:22:44.334619 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:44.334527 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 17:22:44.335606 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:44.335589 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-31.ec2.internal" event="NodeHasSufficientMemory" Jul 28 17:22:44.335691 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:44.335624 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-31.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 17:22:44.335691 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:44.335635 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-31.ec2.internal" event="NodeHasSufficientPID" Jul 28 17:22:44.337269 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:44.337255 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 17:22:44.337383 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:44.337368 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-31.ec2.internal" Jul 28 17:22:44.337434 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:44.337406 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 17:22:44.338091 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:44.338073 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-31.ec2.internal" event="NodeHasSufficientMemory" Jul 28 17:22:44.338183 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:44.338132 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-31.ec2.internal" event="NodeHasSufficientMemory" Jul 28 17:22:44.338183 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:44.338164 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-31.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 17:22:44.338183 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:44.338174 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-31.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 17:22:44.338183 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:44.338180 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-31.ec2.internal" event="NodeHasSufficientPID" Jul 28 17:22:44.338313 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:44.338190 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-31.ec2.internal" event="NodeHasSufficientPID" Jul 28 17:22:44.339255 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:44.339239 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-31.ec2.internal" Jul 28 17:22:44.339314 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:44.339266 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 17:22:44.340050 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:44.340033 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-31.ec2.internal" event="NodeHasSufficientMemory" Jul 28 17:22:44.340139 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:44.340059 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-31.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 17:22:44.340139 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:44.340069 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-31.ec2.internal" event="NodeHasSufficientPID" Jul 28 17:22:44.359907 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:22:44.359887 2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-31.ec2.internal\" not found" node="ip-10-0-129-31.ec2.internal" Jul 28 17:22:44.364872 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:22:44.364852 2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-31.ec2.internal\" not found" node="ip-10-0-129-31.ec2.internal" Jul 28 17:22:44.367092 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:22:44.367074 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-31.ec2.internal\" not found" Jul 28 17:22:44.462765 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:44.462736 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/bf5d45a3473f9607ff7c933ffd8b119c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-31.ec2.internal\" (UID: \"bf5d45a3473f9607ff7c933ffd8b119c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-31.ec2.internal" Jul 28 17:22:44.462765 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:44.462768 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bf5d45a3473f9607ff7c933ffd8b119c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-31.ec2.internal\" (UID: \"bf5d45a3473f9607ff7c933ffd8b119c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-31.ec2.internal" Jul 28 17:22:44.462947 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:44.462791 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/85547fd26d62ca170d8549b389f25e88-config\") pod \"kube-apiserver-proxy-ip-10-0-129-31.ec2.internal\" (UID: \"85547fd26d62ca170d8549b389f25e88\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-31.ec2.internal" Jul 28 17:22:44.468215 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:22:44.468198 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-31.ec2.internal\" not found" Jul 28 17:22:44.563223 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:44.563182 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/85547fd26d62ca170d8549b389f25e88-config\") pod \"kube-apiserver-proxy-ip-10-0-129-31.ec2.internal\" (UID: \"85547fd26d62ca170d8549b389f25e88\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-31.ec2.internal" Jul 28 17:22:44.563407 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:44.563233 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/bf5d45a3473f9607ff7c933ffd8b119c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-31.ec2.internal\" (UID: \"bf5d45a3473f9607ff7c933ffd8b119c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-31.ec2.internal" Jul 28 17:22:44.563407 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:44.563263 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/85547fd26d62ca170d8549b389f25e88-config\") pod \"kube-apiserver-proxy-ip-10-0-129-31.ec2.internal\" (UID: \"85547fd26d62ca170d8549b389f25e88\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-31.ec2.internal" Jul 28 17:22:44.563407 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:44.563299 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/bf5d45a3473f9607ff7c933ffd8b119c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-31.ec2.internal\" (UID: \"bf5d45a3473f9607ff7c933ffd8b119c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-31.ec2.internal" Jul 28 17:22:44.563407 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:44.563290 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bf5d45a3473f9607ff7c933ffd8b119c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-31.ec2.internal\" (UID: \"bf5d45a3473f9607ff7c933ffd8b119c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-31.ec2.internal" Jul 28 17:22:44.563407 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:44.563334 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bf5d45a3473f9607ff7c933ffd8b119c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-31.ec2.internal\" (UID: \"bf5d45a3473f9607ff7c933ffd8b119c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-31.ec2.internal" Jul 28 17:22:44.568575 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:22:44.568558 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-31.ec2.internal\" not found" Jul 28 17:22:44.663790 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:44.663711 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-31.ec2.internal" Jul 28 17:22:44.669013 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:44.668978 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-31.ec2.internal" Jul 28 17:22:44.669152 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:22:44.668983 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-31.ec2.internal\" not found" Jul 28 17:22:44.770157 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:22:44.770104 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-31.ec2.internal\" not found" Jul 28 17:22:44.870474 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:22:44.870442 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-31.ec2.internal\" not found" Jul 28 17:22:44.874446 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:44.874429 2576 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 17:22:44.971578 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:22:44.971496 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-31.ec2.internal\" not found" Jul 28 17:22:44.986771 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:44.986745 2576 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 28 17:22:44.986909 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:44.986891 2576 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 28 17:22:44.986951 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:44.986925 2576 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 28 17:22:45.071883 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:22:45.071848 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-31.ec2.internal\" not found" Jul 28 17:22:45.076300 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:45.076270 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-27 17:17:44 +0000 UTC" deadline="2028-01-13 13:42:40.528611754 +0000 UTC" Jul 28 17:22:45.076366 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:45.076301 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12812h19m55.452314688s" Jul 28 17:22:45.173090 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:22:45.173055 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-31.ec2.internal\" not found" Jul 28 17:22:45.274099 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:22:45.274067 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-31.ec2.internal\" not found" Jul 28 17:22:45.374968 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:22:45.374944 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-31.ec2.internal\" not found" Jul 28 17:22:45.384704 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:45.384651 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85547fd26d62ca170d8549b389f25e88.slice/crio-251d00db2c00e675269f0dc58640f2ac7bb02a49b08cec0ce57ad260a4c91583 WatchSource:0}: Error finding container 251d00db2c00e675269f0dc58640f2ac7bb02a49b08cec0ce57ad260a4c91583: Status 404 returned error can't find the container with id 251d00db2c00e675269f0dc58640f2ac7bb02a49b08cec0ce57ad260a4c91583 Jul 28 17:22:45.385069 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:45.385051 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf5d45a3473f9607ff7c933ffd8b119c.slice/crio-ec8372aa6085c0ec42e7dcbac980309d3926b1b1235ab496396c152184f6ec10 WatchSource:0}: Error finding container ec8372aa6085c0ec42e7dcbac980309d3926b1b1235ab496396c152184f6ec10: Status 404 returned error can't find the container with id ec8372aa6085c0ec42e7dcbac980309d3926b1b1235ab496396c152184f6ec10 Jul 28 17:22:45.390941 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:45.390922 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 28 17:22:45.475211 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:22:45.475165 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-31.ec2.internal\" not found" Jul 28 17:22:45.484322 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:45.484298 2576 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 17:22:45.561171 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:45.561089 2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-31.ec2.internal" Jul 28 17:22:45.575352 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:45.575328 2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 28 17:22:45.576455 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:45.576435 2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-31.ec2.internal" Jul 28 17:22:45.584491 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:45.584477 2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 28 17:22:45.640844 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:45.640810 2576 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 17:22:46.028730 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.028647 2576 apiserver.go:52] "Watching apiserver" Jul 28 17:22:46.039836 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.039620 2576 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 28 17:22:46.042787 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.042555 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-mh4wt","openshift-ovn-kubernetes/ovnkube-node-kprz5","kube-system/global-pull-secret-syncer-7krxm","openshift-cluster-node-tuning-operator/tuned-f8w4n","openshift-dns/node-resolver-66rwd","openshift-image-registry/node-ca-brrsh","openshift-multus/multus-additional-cni-plugins-nbcx6","openshift-network-diagnostics/network-check-target-j2hsj","openshift-network-operator/iptables-alerter-5gbk6","kube-system/konnectivity-agent-tb4pl","kube-system/kube-apiserver-proxy-ip-10-0-129-31.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jf6qs","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-31.ec2.internal","openshift-multus/multus-cgwb8"] Jul 28 17:22:46.045696 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.045672 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-nbcx6" Jul 28 17:22:46.049155 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.048981 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 28 17:22:46.049155 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.049001 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 28 17:22:46.049155 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.049024 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 28 17:22:46.049155 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.049058 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 28 17:22:46.049445 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.049235 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-zqbcx\"" Jul 28 17:22:46.049445 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.049281 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j2hsj" Jul 28 17:22:46.049445 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.049372 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 28 17:22:46.049445 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:22:46.049368 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j2hsj" podUID="17d12e69-fb0c-4161-a579-875ca2f629a6" Jul 28 17:22:46.053645 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.052371 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7krxm" Jul 28 17:22:46.053645 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:22:46.052477 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7krxm" podUID="98a4008a-5635-4697-abdf-0dc44f6e3b87" Jul 28 17:22:46.056409 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.056385 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-f8w4n" Jul 28 17:22:46.057984 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.057959 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-66rwd" Jul 28 17:22:46.061387 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.059636 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 28 17:22:46.061387 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.059777 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-qmrw5\"" Jul 28 17:22:46.061387 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.060053 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 28 17:22:46.061387 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.060057 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-brrsh" Jul 28 17:22:46.061387 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.060312 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-rp5v4\"" Jul 28 17:22:46.061387 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.060480 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 28 17:22:46.061387 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.060596 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 28 17:22:46.062587 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.061460 2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 28 17:22:46.062587 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.062564 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-5gbk6" Jul 28 17:22:46.062762 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.062742 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 28 17:22:46.064540 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.063279 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 28 17:22:46.064540 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.063399 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 28 17:22:46.064540 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.063475 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-m86cn\"" Jul 28 17:22:46.064842 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.064824 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 28 17:22:46.065320 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.065256 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 28 17:22:46.065408 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.065342 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mh4wt" Jul 28 17:22:46.065464 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:22:46.065439 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mh4wt" podUID="de584b57-28d6-4931-b323-1e262b172270" Jul 28 17:22:46.065521 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.065496 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-sbhfs\"" Jul 28 17:22:46.065521 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.065509 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 28 17:22:46.067832 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.067544 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-kprz5" Jul 28 17:22:46.069902 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.069853 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d3519015-daca-4781-ac23-4156cb19876f-os-release\") pod \"multus-additional-cni-plugins-nbcx6\" (UID: \"d3519015-daca-4781-ac23-4156cb19876f\") " pod="openshift-multus/multus-additional-cni-plugins-nbcx6" Jul 28 17:22:46.070062 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.070043 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d3519015-daca-4781-ac23-4156cb19876f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-nbcx6\" (UID: \"d3519015-daca-4781-ac23-4156cb19876f\") " pod="openshift-multus/multus-additional-cni-plugins-nbcx6" Jul 28 17:22:46.070214 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.070176 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d3519015-daca-4781-ac23-4156cb19876f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-nbcx6\" (UID: \"d3519015-daca-4781-ac23-4156cb19876f\") " pod="openshift-multus/multus-additional-cni-plugins-nbcx6" Jul 28 17:22:46.070317 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.070300 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-tb4pl" Jul 28 17:22:46.070426 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.070409 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2224n\" (UniqueName: \"kubernetes.io/projected/d3519015-daca-4781-ac23-4156cb19876f-kube-api-access-2224n\") pod \"multus-additional-cni-plugins-nbcx6\" (UID: \"d3519015-daca-4781-ac23-4156cb19876f\") " pod="openshift-multus/multus-additional-cni-plugins-nbcx6" Jul 28 17:22:46.070541 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.070523 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/98a4008a-5635-4697-abdf-0dc44f6e3b87-dbus\") pod \"global-pull-secret-syncer-7krxm\" (UID: \"98a4008a-5635-4697-abdf-0dc44f6e3b87\") " pod="kube-system/global-pull-secret-syncer-7krxm" Jul 28 17:22:46.070651 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.070636 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0b73fe8a-a195-4bbb-a5c8-481a196280af-host-slash\") pod \"iptables-alerter-5gbk6\" (UID: \"0b73fe8a-a195-4bbb-a5c8-481a196280af\") " pod="openshift-network-operator/iptables-alerter-5gbk6" Jul 28 17:22:46.070776 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.070760 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2ccb0274-cef0-4595-9bb1-6a478e4d7d21-etc-kubernetes\") pod \"tuned-f8w4n\" (UID: \"2ccb0274-cef0-4595-9bb1-6a478e4d7d21\") " pod="openshift-cluster-node-tuning-operator/tuned-f8w4n" Jul 28 17:22:46.070899 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.070883 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2ccb0274-cef0-4595-9bb1-6a478e4d7d21-etc-sysctl-d\") pod \"tuned-f8w4n\" (UID: \"2ccb0274-cef0-4595-9bb1-6a478e4d7d21\") " pod="openshift-cluster-node-tuning-operator/tuned-f8w4n" Jul 28 17:22:46.071008 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.070992 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/269df47c-be5d-458f-8423-f032804bc81a-hosts-file\") pod \"node-resolver-66rwd\" (UID: \"269df47c-be5d-458f-8423-f032804bc81a\") " pod="openshift-dns/node-resolver-66rwd" Jul 28 17:22:46.071123 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.071107 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0b73fe8a-a195-4bbb-a5c8-481a196280af-iptables-alerter-script\") pod \"iptables-alerter-5gbk6\" (UID: \"0b73fe8a-a195-4bbb-a5c8-481a196280af\") " pod="openshift-network-operator/iptables-alerter-5gbk6" Jul 28 17:22:46.071264 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.071248 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2ccb0274-cef0-4595-9bb1-6a478e4d7d21-etc-modprobe-d\") pod \"tuned-f8w4n\" (UID: \"2ccb0274-cef0-4595-9bb1-6a478e4d7d21\") " pod="openshift-cluster-node-tuning-operator/tuned-f8w4n" Jul 28 17:22:46.071384 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.071369 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2ccb0274-cef0-4595-9bb1-6a478e4d7d21-host\") pod \"tuned-f8w4n\" (UID: \"2ccb0274-cef0-4595-9bb1-6a478e4d7d21\") " pod="openshift-cluster-node-tuning-operator/tuned-f8w4n" Jul 28 17:22:46.071487 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.071471 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d3519015-daca-4781-ac23-4156cb19876f-system-cni-dir\") pod \"multus-additional-cni-plugins-nbcx6\" (UID: \"d3519015-daca-4781-ac23-4156cb19876f\") " pod="openshift-multus/multus-additional-cni-plugins-nbcx6" Jul 28 17:22:46.071601 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.071584 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 28 17:22:46.071674 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.071600 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 28 17:22:46.071753 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.071487 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 28 17:22:46.071886 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.071868 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-6z56z\"" Jul 28 17:22:46.071958 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.071924 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 28 17:22:46.072016 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.071586 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/98a4008a-5635-4697-abdf-0dc44f6e3b87-original-pull-secret\") pod \"global-pull-secret-syncer-7krxm\" (UID: \"98a4008a-5635-4697-abdf-0dc44f6e3b87\") " pod="kube-system/global-pull-secret-syncer-7krxm" Jul 28 17:22:46.072073 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.072034 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9ptnh\" (UniqueName: \"kubernetes.io/projected/269df47c-be5d-458f-8423-f032804bc81a-kube-api-access-9ptnh\") pod \"node-resolver-66rwd\" (UID: \"269df47c-be5d-458f-8423-f032804bc81a\") " pod="openshift-dns/node-resolver-66rwd" Jul 28 17:22:46.072073 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.072053 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d8e62687-ca38-4624-ab1c-70a23dbe0140-serviceca\") pod \"node-ca-brrsh\" (UID: \"d8e62687-ca38-4624-ab1c-70a23dbe0140\") " pod="openshift-image-registry/node-ca-brrsh" Jul 28 17:22:46.072182 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.072076 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2ccb0274-cef0-4595-9bb1-6a478e4d7d21-tmp\") pod \"tuned-f8w4n\" (UID: \"2ccb0274-cef0-4595-9bb1-6a478e4d7d21\") " pod="openshift-cluster-node-tuning-operator/tuned-f8w4n" Jul 28 17:22:46.072182 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.072103 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2ccb0274-cef0-4595-9bb1-6a478e4d7d21-etc-sysctl-conf\") pod \"tuned-f8w4n\" (UID: \"2ccb0274-cef0-4595-9bb1-6a478e4d7d21\") " pod="openshift-cluster-node-tuning-operator/tuned-f8w4n" Jul 28 17:22:46.072182 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.072124 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d3519015-daca-4781-ac23-4156cb19876f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-nbcx6\" (UID: \"d3519015-daca-4781-ac23-4156cb19876f\") " pod="openshift-multus/multus-additional-cni-plugins-nbcx6" Jul 28 17:22:46.072182 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.072146 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2ccb0274-cef0-4595-9bb1-6a478e4d7d21-etc-tuned\") pod \"tuned-f8w4n\" (UID: \"2ccb0274-cef0-4595-9bb1-6a478e4d7d21\") " pod="openshift-cluster-node-tuning-operator/tuned-f8w4n" Jul 28 17:22:46.072182 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.072157 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 28 17:22:46.072461 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.071547 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 28 17:22:46.072461 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.072161 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2ccb0274-cef0-4595-9bb1-6a478e4d7d21-run\") pod \"tuned-f8w4n\" (UID: \"2ccb0274-cef0-4595-9bb1-6a478e4d7d21\") " pod="openshift-cluster-node-tuning-operator/tuned-f8w4n" Jul 28 17:22:46.072461 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.072363 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/98a4008a-5635-4697-abdf-0dc44f6e3b87-kubelet-config\") pod \"global-pull-secret-syncer-7krxm\" (UID: \"98a4008a-5635-4697-abdf-0dc44f6e3b87\") " pod="kube-system/global-pull-secret-syncer-7krxm" Jul 28 17:22:46.072461 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.072393 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2ccb0274-cef0-4595-9bb1-6a478e4d7d21-etc-sysconfig\") pod \"tuned-f8w4n\" (UID: \"2ccb0274-cef0-4595-9bb1-6a478e4d7d21\") " pod="openshift-cluster-node-tuning-operator/tuned-f8w4n" Jul 28 17:22:46.072461 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.072451 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d3519015-daca-4781-ac23-4156cb19876f-cnibin\") pod \"multus-additional-cni-plugins-nbcx6\" (UID: \"d3519015-daca-4781-ac23-4156cb19876f\") " pod="openshift-multus/multus-additional-cni-plugins-nbcx6" Jul 28 17:22:46.072767 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.072483 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/269df47c-be5d-458f-8423-f032804bc81a-tmp-dir\") pod \"node-resolver-66rwd\" (UID: \"269df47c-be5d-458f-8423-f032804bc81a\") " pod="openshift-dns/node-resolver-66rwd" Jul 28 17:22:46.072767 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.072513 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xmhp8\" (UniqueName: \"kubernetes.io/projected/0b73fe8a-a195-4bbb-a5c8-481a196280af-kube-api-access-xmhp8\") pod \"iptables-alerter-5gbk6\" (UID: \"0b73fe8a-a195-4bbb-a5c8-481a196280af\") " pod="openshift-network-operator/iptables-alerter-5gbk6" Jul 28 17:22:46.072767 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.072530 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-cgwb8" Jul 28 17:22:46.072767 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.072542 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-94f42\" (UniqueName: \"kubernetes.io/projected/17d12e69-fb0c-4161-a579-875ca2f629a6-kube-api-access-94f42\") pod \"network-check-target-j2hsj\" (UID: \"17d12e69-fb0c-4161-a579-875ca2f629a6\") " pod="openshift-network-diagnostics/network-check-target-j2hsj" Jul 28 17:22:46.072767 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.072569 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2ccb0274-cef0-4595-9bb1-6a478e4d7d21-etc-systemd\") pod \"tuned-f8w4n\" (UID: \"2ccb0274-cef0-4595-9bb1-6a478e4d7d21\") " pod="openshift-cluster-node-tuning-operator/tuned-f8w4n" Jul 28 17:22:46.072767 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.072595 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2ccb0274-cef0-4595-9bb1-6a478e4d7d21-lib-modules\") pod \"tuned-f8w4n\" (UID: \"2ccb0274-cef0-4595-9bb1-6a478e4d7d21\") " pod="openshift-cluster-node-tuning-operator/tuned-f8w4n" Jul 28 17:22:46.072767 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.072618 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2ccb0274-cef0-4595-9bb1-6a478e4d7d21-var-lib-kubelet\") pod \"tuned-f8w4n\" (UID: \"2ccb0274-cef0-4595-9bb1-6a478e4d7d21\") " pod="openshift-cluster-node-tuning-operator/tuned-f8w4n" Jul 28 17:22:46.072767 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.072644 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ltgvt\" (UniqueName: \"kubernetes.io/projected/2ccb0274-cef0-4595-9bb1-6a478e4d7d21-kube-api-access-ltgvt\") pod \"tuned-f8w4n\" (UID: \"2ccb0274-cef0-4595-9bb1-6a478e4d7d21\") " pod="openshift-cluster-node-tuning-operator/tuned-f8w4n" Jul 28 17:22:46.072767 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.072673 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d3519015-daca-4781-ac23-4156cb19876f-cni-binary-copy\") pod \"multus-additional-cni-plugins-nbcx6\" (UID: \"d3519015-daca-4781-ac23-4156cb19876f\") " pod="openshift-multus/multus-additional-cni-plugins-nbcx6" Jul 28 17:22:46.072767 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.072699 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2ccb0274-cef0-4595-9bb1-6a478e4d7d21-sys\") pod \"tuned-f8w4n\" (UID: \"2ccb0274-cef0-4595-9bb1-6a478e4d7d21\") " pod="openshift-cluster-node-tuning-operator/tuned-f8w4n" Jul 28 17:22:46.072767 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.072723 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d8e62687-ca38-4624-ab1c-70a23dbe0140-host\") pod \"node-ca-brrsh\" (UID: \"d8e62687-ca38-4624-ab1c-70a23dbe0140\") " pod="openshift-image-registry/node-ca-brrsh" Jul 28 17:22:46.073339 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.072772 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6m92s\" (UniqueName: \"kubernetes.io/projected/d8e62687-ca38-4624-ab1c-70a23dbe0140-kube-api-access-6m92s\") pod \"node-ca-brrsh\" (UID: \"d8e62687-ca38-4624-ab1c-70a23dbe0140\") " pod="openshift-image-registry/node-ca-brrsh" Jul 28 17:22:46.073339 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.073056 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 28 17:22:46.075760 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.075071 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jf6qs" Jul 28 17:22:46.075760 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.075191 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 28 17:22:46.075760 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.075304 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-6sbkk\"" Jul 28 17:22:46.075760 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.075683 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-wgj8t\"" Jul 28 17:22:46.076069 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.075807 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 28 17:22:46.079716 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.079693 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 28 17:22:46.079960 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.079942 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 28 17:22:46.080228 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.080211 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 28 17:22:46.080498 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.080481 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-wbp8p\"" Jul 28 17:22:46.082957 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.082927 2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 28 17:22:46.100932 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.100904 2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-jb2qg" Jul 28 17:22:46.111798 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.111726 2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-jb2qg" Jul 28 17:22:46.162526 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.162495 2576 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 28 17:22:46.173874 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.173841 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7b971e2f-14bd-4ff9-a4ee-c3a81e63a311-multus-conf-dir\") pod \"multus-cgwb8\" (UID: \"7b971e2f-14bd-4ff9-a4ee-c3a81e63a311\") " pod="openshift-multus/multus-cgwb8" Jul 28 17:22:46.174026 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.173893 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a44a458c-3e2b-4eff-aaa4-04496e296ff2-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kprz5\" (UID: \"a44a458c-3e2b-4eff-aaa4-04496e296ff2\") " pod="openshift-ovn-kubernetes/ovnkube-node-kprz5" Jul 28 17:22:46.174026 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.173976 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2ccb0274-cef0-4595-9bb1-6a478e4d7d21-etc-tuned\") pod \"tuned-f8w4n\" (UID: \"2ccb0274-cef0-4595-9bb1-6a478e4d7d21\") " pod="openshift-cluster-node-tuning-operator/tuned-f8w4n" Jul 28 17:22:46.174156 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.174024 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7b971e2f-14bd-4ff9-a4ee-c3a81e63a311-hostroot\") pod \"multus-cgwb8\" (UID: \"7b971e2f-14bd-4ff9-a4ee-c3a81e63a311\") " pod="openshift-multus/multus-cgwb8" Jul 28 17:22:46.174156 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.174055 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/de584b57-28d6-4931-b323-1e262b172270-metrics-certs\") pod \"network-metrics-daemon-mh4wt\" (UID: \"de584b57-28d6-4931-b323-1e262b172270\") " pod="openshift-multus/network-metrics-daemon-mh4wt" Jul 28 17:22:46.174156 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.174083 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a44a458c-3e2b-4eff-aaa4-04496e296ff2-ovnkube-script-lib\") pod \"ovnkube-node-kprz5\" (UID: \"a44a458c-3e2b-4eff-aaa4-04496e296ff2\") " pod="openshift-ovn-kubernetes/ovnkube-node-kprz5" Jul 28 17:22:46.174156 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.174119 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2ccb0274-cef0-4595-9bb1-6a478e4d7d21-etc-sysconfig\") pod \"tuned-f8w4n\" (UID: \"2ccb0274-cef0-4595-9bb1-6a478e4d7d21\") " pod="openshift-cluster-node-tuning-operator/tuned-f8w4n" Jul 28 17:22:46.174393 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.174146 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a44a458c-3e2b-4eff-aaa4-04496e296ff2-log-socket\") pod \"ovnkube-node-kprz5\" (UID: \"a44a458c-3e2b-4eff-aaa4-04496e296ff2\") " pod="openshift-ovn-kubernetes/ovnkube-node-kprz5" Jul 28 17:22:46.174393 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.174189 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a44a458c-3e2b-4eff-aaa4-04496e296ff2-host-run-ovn-kubernetes\") pod \"ovnkube-node-kprz5\" (UID: \"a44a458c-3e2b-4eff-aaa4-04496e296ff2\") " pod="openshift-ovn-kubernetes/ovnkube-node-kprz5" Jul 28 17:22:46.174393 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.174216 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a44a458c-3e2b-4eff-aaa4-04496e296ff2-env-overrides\") pod \"ovnkube-node-kprz5\" (UID: \"a44a458c-3e2b-4eff-aaa4-04496e296ff2\") " pod="openshift-ovn-kubernetes/ovnkube-node-kprz5" Jul 28 17:22:46.174393 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.174244 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d3519015-daca-4781-ac23-4156cb19876f-cnibin\") pod \"multus-additional-cni-plugins-nbcx6\" (UID: \"d3519015-daca-4781-ac23-4156cb19876f\") " pod="openshift-multus/multus-additional-cni-plugins-nbcx6" Jul 28 17:22:46.174393 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.174269 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/269df47c-be5d-458f-8423-f032804bc81a-tmp-dir\") pod \"node-resolver-66rwd\" (UID: \"269df47c-be5d-458f-8423-f032804bc81a\") " pod="openshift-dns/node-resolver-66rwd" Jul 28 17:22:46.174393 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.174296 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-94f42\" (UniqueName: \"kubernetes.io/projected/17d12e69-fb0c-4161-a579-875ca2f629a6-kube-api-access-94f42\") pod \"network-check-target-j2hsj\" (UID: \"17d12e69-fb0c-4161-a579-875ca2f629a6\") " pod="openshift-network-diagnostics/network-check-target-j2hsj" Jul 28 17:22:46.174393 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.174299 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2ccb0274-cef0-4595-9bb1-6a478e4d7d21-etc-sysconfig\") pod \"tuned-f8w4n\" (UID: \"2ccb0274-cef0-4595-9bb1-6a478e4d7d21\") " pod="openshift-cluster-node-tuning-operator/tuned-f8w4n" Jul 28 17:22:46.174393 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.174324 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2ccb0274-cef0-4595-9bb1-6a478e4d7d21-lib-modules\") pod \"tuned-f8w4n\" (UID: \"2ccb0274-cef0-4595-9bb1-6a478e4d7d21\") " pod="openshift-cluster-node-tuning-operator/tuned-f8w4n" Jul 28 17:22:46.174393 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.174350 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2ccb0274-cef0-4595-9bb1-6a478e4d7d21-var-lib-kubelet\") pod \"tuned-f8w4n\" (UID: \"2ccb0274-cef0-4595-9bb1-6a478e4d7d21\") " pod="openshift-cluster-node-tuning-operator/tuned-f8w4n" Jul 28 17:22:46.174393 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.174374 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7b971e2f-14bd-4ff9-a4ee-c3a81e63a311-os-release\") pod \"multus-cgwb8\" (UID: \"7b971e2f-14bd-4ff9-a4ee-c3a81e63a311\") " pod="openshift-multus/multus-cgwb8" Jul 28 17:22:46.174860 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.174399 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a44a458c-3e2b-4eff-aaa4-04496e296ff2-host-cni-netd\") pod \"ovnkube-node-kprz5\" (UID: \"a44a458c-3e2b-4eff-aaa4-04496e296ff2\") " pod="openshift-ovn-kubernetes/ovnkube-node-kprz5" Jul 28 17:22:46.174860 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.174429 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2ccb0274-cef0-4595-9bb1-6a478e4d7d21-sys\") pod \"tuned-f8w4n\" (UID: \"2ccb0274-cef0-4595-9bb1-6a478e4d7d21\") " pod="openshift-cluster-node-tuning-operator/tuned-f8w4n" Jul 28 17:22:46.174860 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.174454 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6m92s\" (UniqueName: \"kubernetes.io/projected/d8e62687-ca38-4624-ab1c-70a23dbe0140-kube-api-access-6m92s\") pod \"node-ca-brrsh\" (UID: \"d8e62687-ca38-4624-ab1c-70a23dbe0140\") " pod="openshift-image-registry/node-ca-brrsh" Jul 28 17:22:46.174860 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.174485 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7b971e2f-14bd-4ff9-a4ee-c3a81e63a311-cni-binary-copy\") pod \"multus-cgwb8\" (UID: \"7b971e2f-14bd-4ff9-a4ee-c3a81e63a311\") " pod="openshift-multus/multus-cgwb8" Jul 28 17:22:46.174860 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.174518 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d3519015-daca-4781-ac23-4156cb19876f-cnibin\") pod \"multus-additional-cni-plugins-nbcx6\" (UID: \"d3519015-daca-4781-ac23-4156cb19876f\") " pod="openshift-multus/multus-additional-cni-plugins-nbcx6" Jul 28 17:22:46.174860 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.174557 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2ccb0274-cef0-4595-9bb1-6a478e4d7d21-var-lib-kubelet\") pod \"tuned-f8w4n\" (UID: \"2ccb0274-cef0-4595-9bb1-6a478e4d7d21\") " pod="openshift-cluster-node-tuning-operator/tuned-f8w4n" Jul 28 17:22:46.174860 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.174587 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2ccb0274-cef0-4595-9bb1-6a478e4d7d21-sys\") pod \"tuned-f8w4n\" (UID: \"2ccb0274-cef0-4595-9bb1-6a478e4d7d21\") " pod="openshift-cluster-node-tuning-operator/tuned-f8w4n" Jul 28 17:22:46.174860 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.174613 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a44a458c-3e2b-4eff-aaa4-04496e296ff2-node-log\") pod \"ovnkube-node-kprz5\" (UID: \"a44a458c-3e2b-4eff-aaa4-04496e296ff2\") " pod="openshift-ovn-kubernetes/ovnkube-node-kprz5" Jul 28 17:22:46.174860 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.174649 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7b971e2f-14bd-4ff9-a4ee-c3a81e63a311-host-var-lib-cni-multus\") pod \"multus-cgwb8\" (UID: \"7b971e2f-14bd-4ff9-a4ee-c3a81e63a311\") " pod="openshift-multus/multus-cgwb8" Jul 28 17:22:46.174860 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.174665 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/269df47c-be5d-458f-8423-f032804bc81a-tmp-dir\") pod \"node-resolver-66rwd\" (UID: \"269df47c-be5d-458f-8423-f032804bc81a\") " pod="openshift-dns/node-resolver-66rwd" Jul 28 17:22:46.174860 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.174683 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7b971e2f-14bd-4ff9-a4ee-c3a81e63a311-multus-daemon-config\") pod \"multus-cgwb8\" (UID: \"7b971e2f-14bd-4ff9-a4ee-c3a81e63a311\") " pod="openshift-multus/multus-cgwb8" Jul 28 17:22:46.174860 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.174627 2576 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 28 17:22:46.174860 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.174711 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7b971e2f-14bd-4ff9-a4ee-c3a81e63a311-etc-kubernetes\") pod \"multus-cgwb8\" (UID: \"7b971e2f-14bd-4ff9-a4ee-c3a81e63a311\") " pod="openshift-multus/multus-cgwb8" Jul 28 17:22:46.174860 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.174737 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xl5z7\" (UniqueName: \"kubernetes.io/projected/7b971e2f-14bd-4ff9-a4ee-c3a81e63a311-kube-api-access-xl5z7\") pod \"multus-cgwb8\" (UID: \"7b971e2f-14bd-4ff9-a4ee-c3a81e63a311\") " pod="openshift-multus/multus-cgwb8" Jul 28 17:22:46.174860 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.174768 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d3519015-daca-4781-ac23-4156cb19876f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-nbcx6\" (UID: \"d3519015-daca-4781-ac23-4156cb19876f\") " pod="openshift-multus/multus-additional-cni-plugins-nbcx6" Jul 28 17:22:46.174860 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.174807 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d3519015-daca-4781-ac23-4156cb19876f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-nbcx6\" (UID: \"d3519015-daca-4781-ac23-4156cb19876f\") " pod="openshift-multus/multus-additional-cni-plugins-nbcx6" Jul 28 17:22:46.174860 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.174846 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2ccb0274-cef0-4595-9bb1-6a478e4d7d21-lib-modules\") pod \"tuned-f8w4n\" (UID: \"2ccb0274-cef0-4595-9bb1-6a478e4d7d21\") " pod="openshift-cluster-node-tuning-operator/tuned-f8w4n" Jul 28 17:22:46.175813 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.174877 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2224n\" (UniqueName: \"kubernetes.io/projected/d3519015-daca-4781-ac23-4156cb19876f-kube-api-access-2224n\") pod \"multus-additional-cni-plugins-nbcx6\" (UID: \"d3519015-daca-4781-ac23-4156cb19876f\") " pod="openshift-multus/multus-additional-cni-plugins-nbcx6" Jul 28 17:22:46.175813 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.174914 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/98a4008a-5635-4697-abdf-0dc44f6e3b87-dbus\") pod \"global-pull-secret-syncer-7krxm\" (UID: \"98a4008a-5635-4697-abdf-0dc44f6e3b87\") " pod="kube-system/global-pull-secret-syncer-7krxm" Jul 28 17:22:46.175813 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.174958 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0b73fe8a-a195-4bbb-a5c8-481a196280af-host-slash\") pod \"iptables-alerter-5gbk6\" (UID: \"0b73fe8a-a195-4bbb-a5c8-481a196280af\") " pod="openshift-network-operator/iptables-alerter-5gbk6" Jul 28 17:22:46.175813 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.174989 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/269df47c-be5d-458f-8423-f032804bc81a-hosts-file\") pod \"node-resolver-66rwd\" (UID: \"269df47c-be5d-458f-8423-f032804bc81a\") " pod="openshift-dns/node-resolver-66rwd" Jul 28 17:22:46.175813 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.174995 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d3519015-daca-4781-ac23-4156cb19876f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-nbcx6\" (UID: \"d3519015-daca-4781-ac23-4156cb19876f\") " pod="openshift-multus/multus-additional-cni-plugins-nbcx6" Jul 28 17:22:46.175813 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.175016 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0b73fe8a-a195-4bbb-a5c8-481a196280af-iptables-alerter-script\") pod \"iptables-alerter-5gbk6\" (UID: \"0b73fe8a-a195-4bbb-a5c8-481a196280af\") " pod="openshift-network-operator/iptables-alerter-5gbk6" Jul 28 17:22:46.175813 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.175035 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/98a4008a-5635-4697-abdf-0dc44f6e3b87-dbus\") pod \"global-pull-secret-syncer-7krxm\" (UID: \"98a4008a-5635-4697-abdf-0dc44f6e3b87\") " pod="kube-system/global-pull-secret-syncer-7krxm" Jul 28 17:22:46.175813 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.175089 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0b73fe8a-a195-4bbb-a5c8-481a196280af-host-slash\") pod \"iptables-alerter-5gbk6\" (UID: \"0b73fe8a-a195-4bbb-a5c8-481a196280af\") " pod="openshift-network-operator/iptables-alerter-5gbk6" Jul 28 17:22:46.175813 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.175138 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/269df47c-be5d-458f-8423-f032804bc81a-hosts-file\") pod \"node-resolver-66rwd\" (UID: \"269df47c-be5d-458f-8423-f032804bc81a\") " pod="openshift-dns/node-resolver-66rwd" Jul 28 17:22:46.175813 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.175166 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2ccb0274-cef0-4595-9bb1-6a478e4d7d21-etc-modprobe-d\") pod \"tuned-f8w4n\" (UID: \"2ccb0274-cef0-4595-9bb1-6a478e4d7d21\") " pod="openshift-cluster-node-tuning-operator/tuned-f8w4n" Jul 28 17:22:46.175813 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.175212 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7b971e2f-14bd-4ff9-a4ee-c3a81e63a311-cnibin\") pod \"multus-cgwb8\" (UID: \"7b971e2f-14bd-4ff9-a4ee-c3a81e63a311\") " pod="openshift-multus/multus-cgwb8" Jul 28 17:22:46.175813 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.175245 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7b971e2f-14bd-4ff9-a4ee-c3a81e63a311-host-run-netns\") pod \"multus-cgwb8\" (UID: \"7b971e2f-14bd-4ff9-a4ee-c3a81e63a311\") " pod="openshift-multus/multus-cgwb8" Jul 28 17:22:46.175813 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.175271 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a44a458c-3e2b-4eff-aaa4-04496e296ff2-etc-openvswitch\") pod \"ovnkube-node-kprz5\" (UID: \"a44a458c-3e2b-4eff-aaa4-04496e296ff2\") " pod="openshift-ovn-kubernetes/ovnkube-node-kprz5" Jul 28 17:22:46.175813 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.175297 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a44a458c-3e2b-4eff-aaa4-04496e296ff2-run-ovn\") pod \"ovnkube-node-kprz5\" (UID: \"a44a458c-3e2b-4eff-aaa4-04496e296ff2\") " pod="openshift-ovn-kubernetes/ovnkube-node-kprz5" Jul 28 17:22:46.175813 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.175327 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d3519015-daca-4781-ac23-4156cb19876f-system-cni-dir\") pod \"multus-additional-cni-plugins-nbcx6\" (UID: \"d3519015-daca-4781-ac23-4156cb19876f\") " pod="openshift-multus/multus-additional-cni-plugins-nbcx6" Jul 28 17:22:46.175813 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.175353 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2ccb0274-cef0-4595-9bb1-6a478e4d7d21-etc-modprobe-d\") pod \"tuned-f8w4n\" (UID: \"2ccb0274-cef0-4595-9bb1-6a478e4d7d21\") " pod="openshift-cluster-node-tuning-operator/tuned-f8w4n" Jul 28 17:22:46.175813 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.175353 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d8e62687-ca38-4624-ab1c-70a23dbe0140-serviceca\") pod \"node-ca-brrsh\" (UID: \"d8e62687-ca38-4624-ab1c-70a23dbe0140\") " pod="openshift-image-registry/node-ca-brrsh" Jul 28 17:22:46.176672 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.175445 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7b971e2f-14bd-4ff9-a4ee-c3a81e63a311-multus-socket-dir-parent\") pod \"multus-cgwb8\" (UID: \"7b971e2f-14bd-4ff9-a4ee-c3a81e63a311\") " pod="openshift-multus/multus-cgwb8" Jul 28 17:22:46.176672 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.175464 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d3519015-daca-4781-ac23-4156cb19876f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-nbcx6\" (UID: \"d3519015-daca-4781-ac23-4156cb19876f\") " pod="openshift-multus/multus-additional-cni-plugins-nbcx6" Jul 28 17:22:46.176672 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.175448 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d3519015-daca-4781-ac23-4156cb19876f-system-cni-dir\") pod \"multus-additional-cni-plugins-nbcx6\" (UID: \"d3519015-daca-4781-ac23-4156cb19876f\") " pod="openshift-multus/multus-additional-cni-plugins-nbcx6" Jul 28 17:22:46.176672 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.175506 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/31ac4453-76a9-4596-ac57-682b8417c6e7-konnectivity-ca\") pod \"konnectivity-agent-tb4pl\" (UID: \"31ac4453-76a9-4596-ac57-682b8417c6e7\") " pod="kube-system/konnectivity-agent-tb4pl" Jul 28 17:22:46.176672 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.175547 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2ccb0274-cef0-4595-9bb1-6a478e4d7d21-tmp\") pod \"tuned-f8w4n\" (UID: \"2ccb0274-cef0-4595-9bb1-6a478e4d7d21\") " pod="openshift-cluster-node-tuning-operator/tuned-f8w4n" Jul 28 17:22:46.176672 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.175580 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0b73fe8a-a195-4bbb-a5c8-481a196280af-iptables-alerter-script\") pod \"iptables-alerter-5gbk6\" (UID: \"0b73fe8a-a195-4bbb-a5c8-481a196280af\") " pod="openshift-network-operator/iptables-alerter-5gbk6" Jul 28 17:22:46.176672 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.175615 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9c048132-0256-43ad-8bae-b6c155d48b6d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jf6qs\" (UID: \"9c048132-0256-43ad-8bae-b6c155d48b6d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jf6qs" Jul 28 17:22:46.176672 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.175659 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c5d6p\" (UniqueName: \"kubernetes.io/projected/9c048132-0256-43ad-8bae-b6c155d48b6d-kube-api-access-c5d6p\") pod \"aws-ebs-csi-driver-node-jf6qs\" (UID: \"9c048132-0256-43ad-8bae-b6c155d48b6d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jf6qs" Jul 28 17:22:46.176672 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.175699 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a44a458c-3e2b-4eff-aaa4-04496e296ff2-host-run-netns\") pod \"ovnkube-node-kprz5\" (UID: \"a44a458c-3e2b-4eff-aaa4-04496e296ff2\") " pod="openshift-ovn-kubernetes/ovnkube-node-kprz5" Jul 28 17:22:46.176672 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.175726 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a44a458c-3e2b-4eff-aaa4-04496e296ff2-ovnkube-config\") pod \"ovnkube-node-kprz5\" (UID: \"a44a458c-3e2b-4eff-aaa4-04496e296ff2\") " pod="openshift-ovn-kubernetes/ovnkube-node-kprz5" Jul 28 17:22:46.176672 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.175763 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a44a458c-3e2b-4eff-aaa4-04496e296ff2-ovn-node-metrics-cert\") pod \"ovnkube-node-kprz5\" (UID: \"a44a458c-3e2b-4eff-aaa4-04496e296ff2\") " pod="openshift-ovn-kubernetes/ovnkube-node-kprz5" Jul 28 17:22:46.176672 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.175790 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xnbfk\" (UniqueName: \"kubernetes.io/projected/a44a458c-3e2b-4eff-aaa4-04496e296ff2-kube-api-access-xnbfk\") pod \"ovnkube-node-kprz5\" (UID: \"a44a458c-3e2b-4eff-aaa4-04496e296ff2\") " pod="openshift-ovn-kubernetes/ovnkube-node-kprz5" Jul 28 17:22:46.176672 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.175819 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2ccb0274-cef0-4595-9bb1-6a478e4d7d21-etc-sysctl-conf\") pod \"tuned-f8w4n\" (UID: \"2ccb0274-cef0-4595-9bb1-6a478e4d7d21\") " pod="openshift-cluster-node-tuning-operator/tuned-f8w4n" Jul 28 17:22:46.176672 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.175854 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d3519015-daca-4781-ac23-4156cb19876f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-nbcx6\" (UID: \"d3519015-daca-4781-ac23-4156cb19876f\") " pod="openshift-multus/multus-additional-cni-plugins-nbcx6" Jul 28 17:22:46.176672 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.175860 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d8e62687-ca38-4624-ab1c-70a23dbe0140-serviceca\") pod \"node-ca-brrsh\" (UID: \"d8e62687-ca38-4624-ab1c-70a23dbe0140\") " pod="openshift-image-registry/node-ca-brrsh" Jul 28 17:22:46.176672 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.175927 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9c048132-0256-43ad-8bae-b6c155d48b6d-registration-dir\") pod \"aws-ebs-csi-driver-node-jf6qs\" (UID: \"9c048132-0256-43ad-8bae-b6c155d48b6d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jf6qs" Jul 28 17:22:46.177501 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.175974 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2ccb0274-cef0-4595-9bb1-6a478e4d7d21-run\") pod \"tuned-f8w4n\" (UID: \"2ccb0274-cef0-4595-9bb1-6a478e4d7d21\") " pod="openshift-cluster-node-tuning-operator/tuned-f8w4n" Jul 28 17:22:46.177501 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.176011 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2ccb0274-cef0-4595-9bb1-6a478e4d7d21-etc-sysctl-conf\") pod \"tuned-f8w4n\" (UID: \"2ccb0274-cef0-4595-9bb1-6a478e4d7d21\") " pod="openshift-cluster-node-tuning-operator/tuned-f8w4n" Jul 28 17:22:46.177501 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.176027 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/98a4008a-5635-4697-abdf-0dc44f6e3b87-kubelet-config\") pod \"global-pull-secret-syncer-7krxm\" (UID: \"98a4008a-5635-4697-abdf-0dc44f6e3b87\") " pod="kube-system/global-pull-secret-syncer-7krxm" Jul 28 17:22:46.177501 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.176033 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2ccb0274-cef0-4595-9bb1-6a478e4d7d21-run\") pod \"tuned-f8w4n\" (UID: \"2ccb0274-cef0-4595-9bb1-6a478e4d7d21\") " pod="openshift-cluster-node-tuning-operator/tuned-f8w4n" Jul 28 17:22:46.177501 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.176064 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j45jf\" (UniqueName: \"kubernetes.io/projected/de584b57-28d6-4931-b323-1e262b172270-kube-api-access-j45jf\") pod \"network-metrics-daemon-mh4wt\" (UID: \"de584b57-28d6-4931-b323-1e262b172270\") " pod="openshift-multus/network-metrics-daemon-mh4wt" Jul 28 17:22:46.177501 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.176092 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/98a4008a-5635-4697-abdf-0dc44f6e3b87-kubelet-config\") pod \"global-pull-secret-syncer-7krxm\" (UID: \"98a4008a-5635-4697-abdf-0dc44f6e3b87\") " pod="kube-system/global-pull-secret-syncer-7krxm" Jul 28 17:22:46.177501 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.176098 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a44a458c-3e2b-4eff-aaa4-04496e296ff2-host-cni-bin\") pod \"ovnkube-node-kprz5\" (UID: \"a44a458c-3e2b-4eff-aaa4-04496e296ff2\") " pod="openshift-ovn-kubernetes/ovnkube-node-kprz5" Jul 28 17:22:46.177501 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.176165 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7b971e2f-14bd-4ff9-a4ee-c3a81e63a311-host-var-lib-kubelet\") pod \"multus-cgwb8\" (UID: \"7b971e2f-14bd-4ff9-a4ee-c3a81e63a311\") " pod="openshift-multus/multus-cgwb8" Jul 28 17:22:46.177501 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.176201 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmhp8\" (UniqueName: \"kubernetes.io/projected/0b73fe8a-a195-4bbb-a5c8-481a196280af-kube-api-access-xmhp8\") pod \"iptables-alerter-5gbk6\" (UID: \"0b73fe8a-a195-4bbb-a5c8-481a196280af\") " pod="openshift-network-operator/iptables-alerter-5gbk6" Jul 28 17:22:46.177501 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.176228 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2ccb0274-cef0-4595-9bb1-6a478e4d7d21-etc-systemd\") pod \"tuned-f8w4n\" (UID: \"2ccb0274-cef0-4595-9bb1-6a478e4d7d21\") " pod="openshift-cluster-node-tuning-operator/tuned-f8w4n" Jul 28 17:22:46.177501 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.176253 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ltgvt\" (UniqueName: \"kubernetes.io/projected/2ccb0274-cef0-4595-9bb1-6a478e4d7d21-kube-api-access-ltgvt\") pod \"tuned-f8w4n\" (UID: \"2ccb0274-cef0-4595-9bb1-6a478e4d7d21\") " pod="openshift-cluster-node-tuning-operator/tuned-f8w4n" Jul 28 17:22:46.177501 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.176279 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7b971e2f-14bd-4ff9-a4ee-c3a81e63a311-host-run-k8s-cni-cncf-io\") pod \"multus-cgwb8\" (UID: \"7b971e2f-14bd-4ff9-a4ee-c3a81e63a311\") " pod="openshift-multus/multus-cgwb8" Jul 28 17:22:46.177501 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.176306 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7b971e2f-14bd-4ff9-a4ee-c3a81e63a311-host-var-lib-cni-bin\") pod \"multus-cgwb8\" (UID: \"7b971e2f-14bd-4ff9-a4ee-c3a81e63a311\") " pod="openshift-multus/multus-cgwb8" Jul 28 17:22:46.177501 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.176317 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2ccb0274-cef0-4595-9bb1-6a478e4d7d21-etc-systemd\") pod \"tuned-f8w4n\" (UID: \"2ccb0274-cef0-4595-9bb1-6a478e4d7d21\") " pod="openshift-cluster-node-tuning-operator/tuned-f8w4n" Jul 28 17:22:46.177501 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.176331 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a44a458c-3e2b-4eff-aaa4-04496e296ff2-host-kubelet\") pod \"ovnkube-node-kprz5\" (UID: \"a44a458c-3e2b-4eff-aaa4-04496e296ff2\") " pod="openshift-ovn-kubernetes/ovnkube-node-kprz5" Jul 28 17:22:46.177501 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.176357 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7b971e2f-14bd-4ff9-a4ee-c3a81e63a311-host-run-multus-certs\") pod \"multus-cgwb8\" (UID: \"7b971e2f-14bd-4ff9-a4ee-c3a81e63a311\") " pod="openshift-multus/multus-cgwb8" Jul 28 17:22:46.177501 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.176380 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d3519015-daca-4781-ac23-4156cb19876f-cni-binary-copy\") pod \"multus-additional-cni-plugins-nbcx6\" (UID: \"d3519015-daca-4781-ac23-4156cb19876f\") " pod="openshift-multus/multus-additional-cni-plugins-nbcx6" Jul 28 17:22:46.178376 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.176402 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d8e62687-ca38-4624-ab1c-70a23dbe0140-host\") pod \"node-ca-brrsh\" (UID: \"d8e62687-ca38-4624-ab1c-70a23dbe0140\") " pod="openshift-image-registry/node-ca-brrsh" Jul 28 17:22:46.178376 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.176416 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d3519015-daca-4781-ac23-4156cb19876f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-nbcx6\" (UID: \"d3519015-daca-4781-ac23-4156cb19876f\") " pod="openshift-multus/multus-additional-cni-plugins-nbcx6" Jul 28 17:22:46.178376 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.176424 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9c048132-0256-43ad-8bae-b6c155d48b6d-socket-dir\") pod \"aws-ebs-csi-driver-node-jf6qs\" (UID: \"9c048132-0256-43ad-8bae-b6c155d48b6d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jf6qs" Jul 28 17:22:46.178376 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.176447 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9c048132-0256-43ad-8bae-b6c155d48b6d-sys-fs\") pod \"aws-ebs-csi-driver-node-jf6qs\" (UID: \"9c048132-0256-43ad-8bae-b6c155d48b6d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jf6qs" Jul 28 17:22:46.178376 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.176480 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a44a458c-3e2b-4eff-aaa4-04496e296ff2-run-systemd\") pod \"ovnkube-node-kprz5\" (UID: \"a44a458c-3e2b-4eff-aaa4-04496e296ff2\") " pod="openshift-ovn-kubernetes/ovnkube-node-kprz5" Jul 28 17:22:46.178376 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.176508 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a44a458c-3e2b-4eff-aaa4-04496e296ff2-run-openvswitch\") pod \"ovnkube-node-kprz5\" (UID: \"a44a458c-3e2b-4eff-aaa4-04496e296ff2\") " pod="openshift-ovn-kubernetes/ovnkube-node-kprz5" Jul 28 17:22:46.178376 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.176516 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d8e62687-ca38-4624-ab1c-70a23dbe0140-host\") pod \"node-ca-brrsh\" (UID: \"d8e62687-ca38-4624-ab1c-70a23dbe0140\") " pod="openshift-image-registry/node-ca-brrsh" Jul 28 17:22:46.178376 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.176554 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d3519015-daca-4781-ac23-4156cb19876f-os-release\") pod \"multus-additional-cni-plugins-nbcx6\" (UID: \"d3519015-daca-4781-ac23-4156cb19876f\") " pod="openshift-multus/multus-additional-cni-plugins-nbcx6" Jul 28 17:22:46.178376 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.176600 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2ccb0274-cef0-4595-9bb1-6a478e4d7d21-etc-kubernetes\") pod \"tuned-f8w4n\" (UID: \"2ccb0274-cef0-4595-9bb1-6a478e4d7d21\") " pod="openshift-cluster-node-tuning-operator/tuned-f8w4n" Jul 28 17:22:46.178376 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.176653 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2ccb0274-cef0-4595-9bb1-6a478e4d7d21-etc-kubernetes\") pod \"tuned-f8w4n\" (UID: \"2ccb0274-cef0-4595-9bb1-6a478e4d7d21\") " pod="openshift-cluster-node-tuning-operator/tuned-f8w4n" Jul 28 17:22:46.178376 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.176686 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7b971e2f-14bd-4ff9-a4ee-c3a81e63a311-multus-cni-dir\") pod \"multus-cgwb8\" (UID: \"7b971e2f-14bd-4ff9-a4ee-c3a81e63a311\") " pod="openshift-multus/multus-cgwb8" Jul 28 17:22:46.178376 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.176689 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d3519015-daca-4781-ac23-4156cb19876f-os-release\") pod \"multus-additional-cni-plugins-nbcx6\" (UID: \"d3519015-daca-4781-ac23-4156cb19876f\") " pod="openshift-multus/multus-additional-cni-plugins-nbcx6" Jul 28 17:22:46.178376 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.176722 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9c048132-0256-43ad-8bae-b6c155d48b6d-etc-selinux\") pod \"aws-ebs-csi-driver-node-jf6qs\" (UID: \"9c048132-0256-43ad-8bae-b6c155d48b6d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jf6qs" Jul 28 17:22:46.178376 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.176751 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/31ac4453-76a9-4596-ac57-682b8417c6e7-agent-certs\") pod \"konnectivity-agent-tb4pl\" (UID: \"31ac4453-76a9-4596-ac57-682b8417c6e7\") " pod="kube-system/konnectivity-agent-tb4pl" Jul 28 17:22:46.178376 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.176783 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2ccb0274-cef0-4595-9bb1-6a478e4d7d21-etc-sysctl-d\") pod \"tuned-f8w4n\" (UID: \"2ccb0274-cef0-4595-9bb1-6a478e4d7d21\") " pod="openshift-cluster-node-tuning-operator/tuned-f8w4n" Jul 28 17:22:46.178376 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.176813 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2ccb0274-cef0-4595-9bb1-6a478e4d7d21-host\") pod \"tuned-f8w4n\" (UID: \"2ccb0274-cef0-4595-9bb1-6a478e4d7d21\") " pod="openshift-cluster-node-tuning-operator/tuned-f8w4n" Jul 28 17:22:46.178376 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.176852 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d3519015-daca-4781-ac23-4156cb19876f-cni-binary-copy\") pod \"multus-additional-cni-plugins-nbcx6\" (UID: \"d3519015-daca-4781-ac23-4156cb19876f\") " pod="openshift-multus/multus-additional-cni-plugins-nbcx6" Jul 28 17:22:46.179284 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.176853 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a44a458c-3e2b-4eff-aaa4-04496e296ff2-systemd-units\") pod \"ovnkube-node-kprz5\" (UID: \"a44a458c-3e2b-4eff-aaa4-04496e296ff2\") " pod="openshift-ovn-kubernetes/ovnkube-node-kprz5" Jul 28 17:22:46.179284 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.176891 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a44a458c-3e2b-4eff-aaa4-04496e296ff2-var-lib-openvswitch\") pod \"ovnkube-node-kprz5\" (UID: \"a44a458c-3e2b-4eff-aaa4-04496e296ff2\") " pod="openshift-ovn-kubernetes/ovnkube-node-kprz5" Jul 28 17:22:46.179284 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.176938 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/98a4008a-5635-4697-abdf-0dc44f6e3b87-original-pull-secret\") pod \"global-pull-secret-syncer-7krxm\" (UID: \"98a4008a-5635-4697-abdf-0dc44f6e3b87\") " pod="kube-system/global-pull-secret-syncer-7krxm" Jul 28 17:22:46.179284 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.176962 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9ptnh\" (UniqueName: \"kubernetes.io/projected/269df47c-be5d-458f-8423-f032804bc81a-kube-api-access-9ptnh\") pod \"node-resolver-66rwd\" (UID: \"269df47c-be5d-458f-8423-f032804bc81a\") " pod="openshift-dns/node-resolver-66rwd" Jul 28 17:22:46.179284 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.176984 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9c048132-0256-43ad-8bae-b6c155d48b6d-device-dir\") pod \"aws-ebs-csi-driver-node-jf6qs\" (UID: \"9c048132-0256-43ad-8bae-b6c155d48b6d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jf6qs" Jul 28 17:22:46.179284 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.176995 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2ccb0274-cef0-4595-9bb1-6a478e4d7d21-etc-sysctl-d\") pod \"tuned-f8w4n\" (UID: \"2ccb0274-cef0-4595-9bb1-6a478e4d7d21\") " pod="openshift-cluster-node-tuning-operator/tuned-f8w4n" Jul 28 17:22:46.179284 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.176999 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a44a458c-3e2b-4eff-aaa4-04496e296ff2-host-slash\") pod \"ovnkube-node-kprz5\" (UID: \"a44a458c-3e2b-4eff-aaa4-04496e296ff2\") " pod="openshift-ovn-kubernetes/ovnkube-node-kprz5" Jul 28 17:22:46.179284 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.177027 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2ccb0274-cef0-4595-9bb1-6a478e4d7d21-host\") pod \"tuned-f8w4n\" (UID: \"2ccb0274-cef0-4595-9bb1-6a478e4d7d21\") " pod="openshift-cluster-node-tuning-operator/tuned-f8w4n" Jul 28 17:22:46.179284 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.177048 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7b971e2f-14bd-4ff9-a4ee-c3a81e63a311-system-cni-dir\") pod \"multus-cgwb8\" (UID: \"7b971e2f-14bd-4ff9-a4ee-c3a81e63a311\") " pod="openshift-multus/multus-cgwb8" Jul 28 17:22:46.179284 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:22:46.177075 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 17:22:46.179284 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:22:46.177142 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/98a4008a-5635-4697-abdf-0dc44f6e3b87-original-pull-secret podName:98a4008a-5635-4697-abdf-0dc44f6e3b87 nodeName:}" failed. No retries permitted until 2026-07-28 17:22:46.677121584 +0000 UTC m=+3.029474914 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/98a4008a-5635-4697-abdf-0dc44f6e3b87-original-pull-secret") pod "global-pull-secret-syncer-7krxm" (UID: "98a4008a-5635-4697-abdf-0dc44f6e3b87") : object "kube-system"/"original-pull-secret" not registered Jul 28 17:22:46.179917 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.179897 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2ccb0274-cef0-4595-9bb1-6a478e4d7d21-etc-tuned\") pod \"tuned-f8w4n\" (UID: \"2ccb0274-cef0-4595-9bb1-6a478e4d7d21\") " pod="openshift-cluster-node-tuning-operator/tuned-f8w4n" Jul 28 17:22:46.182923 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:22:46.182777 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 17:22:46.182923 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:22:46.182801 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 17:22:46.182923 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:22:46.182831 2576 projected.go:196] Error preparing data for projected volume kube-api-access-94f42 for pod openshift-network-diagnostics/network-check-target-j2hsj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 17:22:46.182923 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:22:46.182886 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/17d12e69-fb0c-4161-a579-875ca2f629a6-kube-api-access-94f42 podName:17d12e69-fb0c-4161-a579-875ca2f629a6 nodeName:}" failed. No retries permitted until 2026-07-28 17:22:46.682870263 +0000 UTC m=+3.035223631 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-94f42" (UniqueName: "kubernetes.io/projected/17d12e69-fb0c-4161-a579-875ca2f629a6-kube-api-access-94f42") pod "network-check-target-j2hsj" (UID: "17d12e69-fb0c-4161-a579-875ca2f629a6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 17:22:46.184353 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.184328 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2ccb0274-cef0-4595-9bb1-6a478e4d7d21-tmp\") pod \"tuned-f8w4n\" (UID: \"2ccb0274-cef0-4595-9bb1-6a478e4d7d21\") " pod="openshift-cluster-node-tuning-operator/tuned-f8w4n" Jul 28 17:22:46.186255 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.186229 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2224n\" (UniqueName: \"kubernetes.io/projected/d3519015-daca-4781-ac23-4156cb19876f-kube-api-access-2224n\") pod \"multus-additional-cni-plugins-nbcx6\" (UID: \"d3519015-daca-4781-ac23-4156cb19876f\") " pod="openshift-multus/multus-additional-cni-plugins-nbcx6" Jul 28 17:22:46.186367 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.186234 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6m92s\" (UniqueName: \"kubernetes.io/projected/d8e62687-ca38-4624-ab1c-70a23dbe0140-kube-api-access-6m92s\") pod \"node-ca-brrsh\" (UID: \"d8e62687-ca38-4624-ab1c-70a23dbe0140\") " pod="openshift-image-registry/node-ca-brrsh" Jul 28 17:22:46.188084 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.188059 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9ptnh\" (UniqueName: \"kubernetes.io/projected/269df47c-be5d-458f-8423-f032804bc81a-kube-api-access-9ptnh\") pod \"node-resolver-66rwd\" (UID: \"269df47c-be5d-458f-8423-f032804bc81a\") " pod="openshift-dns/node-resolver-66rwd" Jul 28 17:22:46.188250 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.188226 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ltgvt\" (UniqueName: \"kubernetes.io/projected/2ccb0274-cef0-4595-9bb1-6a478e4d7d21-kube-api-access-ltgvt\") pod \"tuned-f8w4n\" (UID: \"2ccb0274-cef0-4595-9bb1-6a478e4d7d21\") " pod="openshift-cluster-node-tuning-operator/tuned-f8w4n" Jul 28 17:22:46.189751 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.189725 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xmhp8\" (UniqueName: \"kubernetes.io/projected/0b73fe8a-a195-4bbb-a5c8-481a196280af-kube-api-access-xmhp8\") pod \"iptables-alerter-5gbk6\" (UID: \"0b73fe8a-a195-4bbb-a5c8-481a196280af\") " pod="openshift-network-operator/iptables-alerter-5gbk6" Jul 28 17:22:46.238800 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.238688 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-31.ec2.internal" event={"ID":"85547fd26d62ca170d8549b389f25e88","Type":"ContainerStarted","Data":"251d00db2c00e675269f0dc58640f2ac7bb02a49b08cec0ce57ad260a4c91583"} Jul 28 17:22:46.240259 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.240226 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-31.ec2.internal" event={"ID":"bf5d45a3473f9607ff7c933ffd8b119c","Type":"ContainerStarted","Data":"ec8372aa6085c0ec42e7dcbac980309d3926b1b1235ab496396c152184f6ec10"} Jul 28 17:22:46.277678 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.277641 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7b971e2f-14bd-4ff9-a4ee-c3a81e63a311-cnibin\") pod \"multus-cgwb8\" (UID: \"7b971e2f-14bd-4ff9-a4ee-c3a81e63a311\") " pod="openshift-multus/multus-cgwb8" Jul 28 17:22:46.277852 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.277691 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7b971e2f-14bd-4ff9-a4ee-c3a81e63a311-host-run-netns\") pod \"multus-cgwb8\" (UID: \"7b971e2f-14bd-4ff9-a4ee-c3a81e63a311\") " pod="openshift-multus/multus-cgwb8" Jul 28 17:22:46.277852 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.277721 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a44a458c-3e2b-4eff-aaa4-04496e296ff2-etc-openvswitch\") pod \"ovnkube-node-kprz5\" (UID: \"a44a458c-3e2b-4eff-aaa4-04496e296ff2\") " pod="openshift-ovn-kubernetes/ovnkube-node-kprz5" Jul 28 17:22:46.277852 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.277745 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a44a458c-3e2b-4eff-aaa4-04496e296ff2-run-ovn\") pod \"ovnkube-node-kprz5\" (UID: \"a44a458c-3e2b-4eff-aaa4-04496e296ff2\") " pod="openshift-ovn-kubernetes/ovnkube-node-kprz5" Jul 28 17:22:46.277852 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.277771 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7b971e2f-14bd-4ff9-a4ee-c3a81e63a311-multus-socket-dir-parent\") pod \"multus-cgwb8\" (UID: \"7b971e2f-14bd-4ff9-a4ee-c3a81e63a311\") " pod="openshift-multus/multus-cgwb8" Jul 28 17:22:46.277852 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.277795 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/31ac4453-76a9-4596-ac57-682b8417c6e7-konnectivity-ca\") pod \"konnectivity-agent-tb4pl\" (UID: \"31ac4453-76a9-4596-ac57-682b8417c6e7\") " pod="kube-system/konnectivity-agent-tb4pl" Jul 28 17:22:46.277852 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.277822 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9c048132-0256-43ad-8bae-b6c155d48b6d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jf6qs\" (UID: \"9c048132-0256-43ad-8bae-b6c155d48b6d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jf6qs" Jul 28 17:22:46.277852 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.277847 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c5d6p\" (UniqueName: \"kubernetes.io/projected/9c048132-0256-43ad-8bae-b6c155d48b6d-kube-api-access-c5d6p\") pod \"aws-ebs-csi-driver-node-jf6qs\" (UID: \"9c048132-0256-43ad-8bae-b6c155d48b6d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jf6qs" Jul 28 17:22:46.278250 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.277872 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a44a458c-3e2b-4eff-aaa4-04496e296ff2-host-run-netns\") pod \"ovnkube-node-kprz5\" (UID: \"a44a458c-3e2b-4eff-aaa4-04496e296ff2\") " pod="openshift-ovn-kubernetes/ovnkube-node-kprz5" Jul 28 17:22:46.278250 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.277897 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a44a458c-3e2b-4eff-aaa4-04496e296ff2-ovnkube-config\") pod \"ovnkube-node-kprz5\" (UID: \"a44a458c-3e2b-4eff-aaa4-04496e296ff2\") " pod="openshift-ovn-kubernetes/ovnkube-node-kprz5" Jul 28 17:22:46.278250 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.277929 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a44a458c-3e2b-4eff-aaa4-04496e296ff2-ovn-node-metrics-cert\") pod \"ovnkube-node-kprz5\" (UID: \"a44a458c-3e2b-4eff-aaa4-04496e296ff2\") " pod="openshift-ovn-kubernetes/ovnkube-node-kprz5" Jul 28 17:22:46.278250 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.277956 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xnbfk\" (UniqueName: \"kubernetes.io/projected/a44a458c-3e2b-4eff-aaa4-04496e296ff2-kube-api-access-xnbfk\") pod \"ovnkube-node-kprz5\" (UID: \"a44a458c-3e2b-4eff-aaa4-04496e296ff2\") " pod="openshift-ovn-kubernetes/ovnkube-node-kprz5" Jul 28 17:22:46.278250 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.277989 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9c048132-0256-43ad-8bae-b6c155d48b6d-registration-dir\") pod \"aws-ebs-csi-driver-node-jf6qs\" (UID: \"9c048132-0256-43ad-8bae-b6c155d48b6d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jf6qs" Jul 28 17:22:46.278250 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.278021 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j45jf\" (UniqueName: \"kubernetes.io/projected/de584b57-28d6-4931-b323-1e262b172270-kube-api-access-j45jf\") pod \"network-metrics-daemon-mh4wt\" (UID: \"de584b57-28d6-4931-b323-1e262b172270\") " pod="openshift-multus/network-metrics-daemon-mh4wt" Jul 28 17:22:46.278250 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.278047 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a44a458c-3e2b-4eff-aaa4-04496e296ff2-host-cni-bin\") pod \"ovnkube-node-kprz5\" (UID: \"a44a458c-3e2b-4eff-aaa4-04496e296ff2\") " pod="openshift-ovn-kubernetes/ovnkube-node-kprz5" Jul 28 17:22:46.278250 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.278079 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7b971e2f-14bd-4ff9-a4ee-c3a81e63a311-host-var-lib-kubelet\") pod \"multus-cgwb8\" (UID: \"7b971e2f-14bd-4ff9-a4ee-c3a81e63a311\") " pod="openshift-multus/multus-cgwb8" Jul 28 17:22:46.278250 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.278110 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7b971e2f-14bd-4ff9-a4ee-c3a81e63a311-host-run-k8s-cni-cncf-io\") pod \"multus-cgwb8\" (UID: \"7b971e2f-14bd-4ff9-a4ee-c3a81e63a311\") " pod="openshift-multus/multus-cgwb8" Jul 28 17:22:46.278250 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.278141 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7b971e2f-14bd-4ff9-a4ee-c3a81e63a311-host-var-lib-cni-bin\") pod \"multus-cgwb8\" (UID: \"7b971e2f-14bd-4ff9-a4ee-c3a81e63a311\") " pod="openshift-multus/multus-cgwb8" Jul 28 17:22:46.278250 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.278186 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a44a458c-3e2b-4eff-aaa4-04496e296ff2-host-kubelet\") pod \"ovnkube-node-kprz5\" (UID: \"a44a458c-3e2b-4eff-aaa4-04496e296ff2\") " pod="openshift-ovn-kubernetes/ovnkube-node-kprz5" Jul 28 17:22:46.278250 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.278215 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7b971e2f-14bd-4ff9-a4ee-c3a81e63a311-host-run-multus-certs\") pod \"multus-cgwb8\" (UID: \"7b971e2f-14bd-4ff9-a4ee-c3a81e63a311\") " pod="openshift-multus/multus-cgwb8" Jul 28 17:22:46.278250 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.278247 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9c048132-0256-43ad-8bae-b6c155d48b6d-socket-dir\") pod \"aws-ebs-csi-driver-node-jf6qs\" (UID: \"9c048132-0256-43ad-8bae-b6c155d48b6d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jf6qs" Jul 28 17:22:46.278966 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.278274 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9c048132-0256-43ad-8bae-b6c155d48b6d-sys-fs\") pod \"aws-ebs-csi-driver-node-jf6qs\" (UID: \"9c048132-0256-43ad-8bae-b6c155d48b6d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jf6qs" Jul 28 17:22:46.278966 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.278304 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a44a458c-3e2b-4eff-aaa4-04496e296ff2-run-systemd\") pod \"ovnkube-node-kprz5\" (UID: \"a44a458c-3e2b-4eff-aaa4-04496e296ff2\") " pod="openshift-ovn-kubernetes/ovnkube-node-kprz5" Jul 28 17:22:46.278966 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.278372 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a44a458c-3e2b-4eff-aaa4-04496e296ff2-run-openvswitch\") pod \"ovnkube-node-kprz5\" (UID: \"a44a458c-3e2b-4eff-aaa4-04496e296ff2\") " pod="openshift-ovn-kubernetes/ovnkube-node-kprz5" Jul 28 17:22:46.278966 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.278407 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7b971e2f-14bd-4ff9-a4ee-c3a81e63a311-multus-cni-dir\") pod \"multus-cgwb8\" (UID: \"7b971e2f-14bd-4ff9-a4ee-c3a81e63a311\") " pod="openshift-multus/multus-cgwb8" Jul 28 17:22:46.278966 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.278438 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9c048132-0256-43ad-8bae-b6c155d48b6d-etc-selinux\") pod \"aws-ebs-csi-driver-node-jf6qs\" (UID: \"9c048132-0256-43ad-8bae-b6c155d48b6d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jf6qs" Jul 28 17:22:46.278966 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.278466 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/31ac4453-76a9-4596-ac57-682b8417c6e7-agent-certs\") pod \"konnectivity-agent-tb4pl\" (UID: \"31ac4453-76a9-4596-ac57-682b8417c6e7\") " pod="kube-system/konnectivity-agent-tb4pl" Jul 28 17:22:46.278966 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.278539 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a44a458c-3e2b-4eff-aaa4-04496e296ff2-systemd-units\") pod \"ovnkube-node-kprz5\" (UID: \"a44a458c-3e2b-4eff-aaa4-04496e296ff2\") " pod="openshift-ovn-kubernetes/ovnkube-node-kprz5" Jul 28 17:22:46.278966 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.278590 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a44a458c-3e2b-4eff-aaa4-04496e296ff2-var-lib-openvswitch\") pod \"ovnkube-node-kprz5\" (UID: \"a44a458c-3e2b-4eff-aaa4-04496e296ff2\") " pod="openshift-ovn-kubernetes/ovnkube-node-kprz5" Jul 28 17:22:46.278966 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.278637 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9c048132-0256-43ad-8bae-b6c155d48b6d-device-dir\") pod \"aws-ebs-csi-driver-node-jf6qs\" (UID: \"9c048132-0256-43ad-8bae-b6c155d48b6d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jf6qs" Jul 28 17:22:46.278966 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.278666 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a44a458c-3e2b-4eff-aaa4-04496e296ff2-host-slash\") pod \"ovnkube-node-kprz5\" (UID: \"a44a458c-3e2b-4eff-aaa4-04496e296ff2\") " pod="openshift-ovn-kubernetes/ovnkube-node-kprz5" Jul 28 17:22:46.278966 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.278693 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7b971e2f-14bd-4ff9-a4ee-c3a81e63a311-system-cni-dir\") pod \"multus-cgwb8\" (UID: \"7b971e2f-14bd-4ff9-a4ee-c3a81e63a311\") " pod="openshift-multus/multus-cgwb8" Jul 28 17:22:46.278966 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.278739 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7b971e2f-14bd-4ff9-a4ee-c3a81e63a311-multus-conf-dir\") pod \"multus-cgwb8\" (UID: \"7b971e2f-14bd-4ff9-a4ee-c3a81e63a311\") " pod="openshift-multus/multus-cgwb8" Jul 28 17:22:46.278966 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.278771 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a44a458c-3e2b-4eff-aaa4-04496e296ff2-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kprz5\" (UID: \"a44a458c-3e2b-4eff-aaa4-04496e296ff2\") " pod="openshift-ovn-kubernetes/ovnkube-node-kprz5" Jul 28 17:22:46.278966 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.278812 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7b971e2f-14bd-4ff9-a4ee-c3a81e63a311-hostroot\") pod \"multus-cgwb8\" (UID: \"7b971e2f-14bd-4ff9-a4ee-c3a81e63a311\") " pod="openshift-multus/multus-cgwb8" Jul 28 17:22:46.278966 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.278843 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/de584b57-28d6-4931-b323-1e262b172270-metrics-certs\") pod \"network-metrics-daemon-mh4wt\" (UID: \"de584b57-28d6-4931-b323-1e262b172270\") " pod="openshift-multus/network-metrics-daemon-mh4wt" Jul 28 17:22:46.278966 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.278875 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a44a458c-3e2b-4eff-aaa4-04496e296ff2-ovnkube-script-lib\") pod \"ovnkube-node-kprz5\" (UID: \"a44a458c-3e2b-4eff-aaa4-04496e296ff2\") " pod="openshift-ovn-kubernetes/ovnkube-node-kprz5" Jul 28 17:22:46.278966 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.278921 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a44a458c-3e2b-4eff-aaa4-04496e296ff2-log-socket\") pod \"ovnkube-node-kprz5\" (UID: \"a44a458c-3e2b-4eff-aaa4-04496e296ff2\") " pod="openshift-ovn-kubernetes/ovnkube-node-kprz5" Jul 28 17:22:46.279900 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.278950 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a44a458c-3e2b-4eff-aaa4-04496e296ff2-host-run-ovn-kubernetes\") pod \"ovnkube-node-kprz5\" (UID: \"a44a458c-3e2b-4eff-aaa4-04496e296ff2\") " pod="openshift-ovn-kubernetes/ovnkube-node-kprz5" Jul 28 17:22:46.279900 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.278977 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a44a458c-3e2b-4eff-aaa4-04496e296ff2-env-overrides\") pod \"ovnkube-node-kprz5\" (UID: \"a44a458c-3e2b-4eff-aaa4-04496e296ff2\") " pod="openshift-ovn-kubernetes/ovnkube-node-kprz5" Jul 28 17:22:46.279900 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.279025 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7b971e2f-14bd-4ff9-a4ee-c3a81e63a311-os-release\") pod \"multus-cgwb8\" (UID: \"7b971e2f-14bd-4ff9-a4ee-c3a81e63a311\") " pod="openshift-multus/multus-cgwb8" Jul 28 17:22:46.279900 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.279072 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a44a458c-3e2b-4eff-aaa4-04496e296ff2-host-cni-netd\") pod \"ovnkube-node-kprz5\" (UID: \"a44a458c-3e2b-4eff-aaa4-04496e296ff2\") " pod="openshift-ovn-kubernetes/ovnkube-node-kprz5" Jul 28 17:22:46.279900 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.279103 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7b971e2f-14bd-4ff9-a4ee-c3a81e63a311-cni-binary-copy\") pod \"multus-cgwb8\" (UID: \"7b971e2f-14bd-4ff9-a4ee-c3a81e63a311\") " pod="openshift-multus/multus-cgwb8" Jul 28 17:22:46.279900 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.279130 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a44a458c-3e2b-4eff-aaa4-04496e296ff2-node-log\") pod \"ovnkube-node-kprz5\" (UID: \"a44a458c-3e2b-4eff-aaa4-04496e296ff2\") " pod="openshift-ovn-kubernetes/ovnkube-node-kprz5" Jul 28 17:22:46.279900 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.279164 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7b971e2f-14bd-4ff9-a4ee-c3a81e63a311-host-var-lib-cni-multus\") pod \"multus-cgwb8\" (UID: \"7b971e2f-14bd-4ff9-a4ee-c3a81e63a311\") " pod="openshift-multus/multus-cgwb8" Jul 28 17:22:46.279900 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.279214 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7b971e2f-14bd-4ff9-a4ee-c3a81e63a311-multus-daemon-config\") pod \"multus-cgwb8\" (UID: \"7b971e2f-14bd-4ff9-a4ee-c3a81e63a311\") " pod="openshift-multus/multus-cgwb8" Jul 28 17:22:46.279900 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.279245 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7b971e2f-14bd-4ff9-a4ee-c3a81e63a311-etc-kubernetes\") pod \"multus-cgwb8\" (UID: \"7b971e2f-14bd-4ff9-a4ee-c3a81e63a311\") " pod="openshift-multus/multus-cgwb8" Jul 28 17:22:46.279900 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.279274 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xl5z7\" (UniqueName: \"kubernetes.io/projected/7b971e2f-14bd-4ff9-a4ee-c3a81e63a311-kube-api-access-xl5z7\") pod \"multus-cgwb8\" (UID: \"7b971e2f-14bd-4ff9-a4ee-c3a81e63a311\") " pod="openshift-multus/multus-cgwb8" Jul 28 17:22:46.279900 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.279685 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7b971e2f-14bd-4ff9-a4ee-c3a81e63a311-cnibin\") pod \"multus-cgwb8\" (UID: \"7b971e2f-14bd-4ff9-a4ee-c3a81e63a311\") " pod="openshift-multus/multus-cgwb8" Jul 28 17:22:46.279900 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.279750 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7b971e2f-14bd-4ff9-a4ee-c3a81e63a311-host-run-netns\") pod \"multus-cgwb8\" (UID: \"7b971e2f-14bd-4ff9-a4ee-c3a81e63a311\") " pod="openshift-multus/multus-cgwb8" Jul 28 17:22:46.279900 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.279795 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a44a458c-3e2b-4eff-aaa4-04496e296ff2-etc-openvswitch\") pod \"ovnkube-node-kprz5\" (UID: \"a44a458c-3e2b-4eff-aaa4-04496e296ff2\") " pod="openshift-ovn-kubernetes/ovnkube-node-kprz5" Jul 28 17:22:46.279900 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.279839 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a44a458c-3e2b-4eff-aaa4-04496e296ff2-run-ovn\") pod \"ovnkube-node-kprz5\" (UID: \"a44a458c-3e2b-4eff-aaa4-04496e296ff2\") " pod="openshift-ovn-kubernetes/ovnkube-node-kprz5" Jul 28 17:22:46.279900 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.279892 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7b971e2f-14bd-4ff9-a4ee-c3a81e63a311-multus-socket-dir-parent\") pod \"multus-cgwb8\" (UID: \"7b971e2f-14bd-4ff9-a4ee-c3a81e63a311\") " pod="openshift-multus/multus-cgwb8" Jul 28 17:22:46.280652 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.280543 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/31ac4453-76a9-4596-ac57-682b8417c6e7-konnectivity-ca\") pod \"konnectivity-agent-tb4pl\" (UID: \"31ac4453-76a9-4596-ac57-682b8417c6e7\") " pod="kube-system/konnectivity-agent-tb4pl" Jul 28 17:22:46.280652 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.280632 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9c048132-0256-43ad-8bae-b6c155d48b6d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jf6qs\" (UID: \"9c048132-0256-43ad-8bae-b6c155d48b6d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jf6qs" Jul 28 17:22:46.282260 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.280954 2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 17:22:46.282260 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.281124 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a44a458c-3e2b-4eff-aaa4-04496e296ff2-systemd-units\") pod \"ovnkube-node-kprz5\" (UID: \"a44a458c-3e2b-4eff-aaa4-04496e296ff2\") " pod="openshift-ovn-kubernetes/ovnkube-node-kprz5" Jul 28 17:22:46.282260 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.281202 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a44a458c-3e2b-4eff-aaa4-04496e296ff2-host-run-netns\") pod \"ovnkube-node-kprz5\" (UID: \"a44a458c-3e2b-4eff-aaa4-04496e296ff2\") " pod="openshift-ovn-kubernetes/ovnkube-node-kprz5" Jul 28 17:22:46.282260 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.281238 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a44a458c-3e2b-4eff-aaa4-04496e296ff2-var-lib-openvswitch\") pod \"ovnkube-node-kprz5\" (UID: \"a44a458c-3e2b-4eff-aaa4-04496e296ff2\") " pod="openshift-ovn-kubernetes/ovnkube-node-kprz5" Jul 28 17:22:46.282260 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.281295 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a44a458c-3e2b-4eff-aaa4-04496e296ff2-host-slash\") pod \"ovnkube-node-kprz5\" (UID: \"a44a458c-3e2b-4eff-aaa4-04496e296ff2\") " pod="openshift-ovn-kubernetes/ovnkube-node-kprz5" Jul 28 17:22:46.282260 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.281306 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a44a458c-3e2b-4eff-aaa4-04496e296ff2-host-kubelet\") pod \"ovnkube-node-kprz5\" (UID: \"a44a458c-3e2b-4eff-aaa4-04496e296ff2\") " pod="openshift-ovn-kubernetes/ovnkube-node-kprz5" Jul 28 17:22:46.282260 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.281360 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7b971e2f-14bd-4ff9-a4ee-c3a81e63a311-system-cni-dir\") pod \"multus-cgwb8\" (UID: \"7b971e2f-14bd-4ff9-a4ee-c3a81e63a311\") " pod="openshift-multus/multus-cgwb8" Jul 28 17:22:46.282260 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.281392 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9c048132-0256-43ad-8bae-b6c155d48b6d-device-dir\") pod \"aws-ebs-csi-driver-node-jf6qs\" (UID: \"9c048132-0256-43ad-8bae-b6c155d48b6d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jf6qs" Jul 28 17:22:46.282260 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.281411 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7b971e2f-14bd-4ff9-a4ee-c3a81e63a311-multus-conf-dir\") pod \"multus-cgwb8\" (UID: \"7b971e2f-14bd-4ff9-a4ee-c3a81e63a311\") " pod="openshift-multus/multus-cgwb8" Jul 28 17:22:46.282260 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.281667 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9c048132-0256-43ad-8bae-b6c155d48b6d-registration-dir\") pod \"aws-ebs-csi-driver-node-jf6qs\" (UID: \"9c048132-0256-43ad-8bae-b6c155d48b6d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jf6qs" Jul 28 17:22:46.282260 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.281778 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a44a458c-3e2b-4eff-aaa4-04496e296ff2-ovnkube-config\") pod \"ovnkube-node-kprz5\" (UID: \"a44a458c-3e2b-4eff-aaa4-04496e296ff2\") " pod="openshift-ovn-kubernetes/ovnkube-node-kprz5" Jul 28 17:22:46.282260 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.281845 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7b971e2f-14bd-4ff9-a4ee-c3a81e63a311-host-run-multus-certs\") pod \"multus-cgwb8\" (UID: \"7b971e2f-14bd-4ff9-a4ee-c3a81e63a311\") " pod="openshift-multus/multus-cgwb8" Jul 28 17:22:46.282260 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.281889 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a44a458c-3e2b-4eff-aaa4-04496e296ff2-run-openvswitch\") pod \"ovnkube-node-kprz5\" (UID: \"a44a458c-3e2b-4eff-aaa4-04496e296ff2\") " pod="openshift-ovn-kubernetes/ovnkube-node-kprz5" Jul 28 17:22:46.282260 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.281937 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7b971e2f-14bd-4ff9-a4ee-c3a81e63a311-host-run-k8s-cni-cncf-io\") pod \"multus-cgwb8\" (UID: \"7b971e2f-14bd-4ff9-a4ee-c3a81e63a311\") " pod="openshift-multus/multus-cgwb8" Jul 28 17:22:46.282260 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.281990 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7b971e2f-14bd-4ff9-a4ee-c3a81e63a311-host-var-lib-cni-bin\") pod \"multus-cgwb8\" (UID: \"7b971e2f-14bd-4ff9-a4ee-c3a81e63a311\") " pod="openshift-multus/multus-cgwb8" Jul 28 17:22:46.282260 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.282028 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9c048132-0256-43ad-8bae-b6c155d48b6d-etc-selinux\") pod \"aws-ebs-csi-driver-node-jf6qs\" (UID: \"9c048132-0256-43ad-8bae-b6c155d48b6d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jf6qs" Jul 28 17:22:46.282260 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.282157 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9c048132-0256-43ad-8bae-b6c155d48b6d-socket-dir\") pod \"aws-ebs-csi-driver-node-jf6qs\" (UID: \"9c048132-0256-43ad-8bae-b6c155d48b6d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jf6qs" Jul 28 17:22:46.282260 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.282245 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7b971e2f-14bd-4ff9-a4ee-c3a81e63a311-host-var-lib-kubelet\") pod \"multus-cgwb8\" (UID: \"7b971e2f-14bd-4ff9-a4ee-c3a81e63a311\") " pod="openshift-multus/multus-cgwb8" Jul 28 17:22:46.283339 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.282313 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7b971e2f-14bd-4ff9-a4ee-c3a81e63a311-multus-cni-dir\") pod \"multus-cgwb8\" (UID: \"7b971e2f-14bd-4ff9-a4ee-c3a81e63a311\") " pod="openshift-multus/multus-cgwb8" Jul 28 17:22:46.283339 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.282415 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a44a458c-3e2b-4eff-aaa4-04496e296ff2-env-overrides\") pod \"ovnkube-node-kprz5\" (UID: \"a44a458c-3e2b-4eff-aaa4-04496e296ff2\") " pod="openshift-ovn-kubernetes/ovnkube-node-kprz5" Jul 28 17:22:46.283339 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:22:46.282418 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 17:22:46.283339 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.282463 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a44a458c-3e2b-4eff-aaa4-04496e296ff2-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kprz5\" (UID: \"a44a458c-3e2b-4eff-aaa4-04496e296ff2\") " pod="openshift-ovn-kubernetes/ovnkube-node-kprz5" Jul 28 17:22:46.283339 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:22:46.282491 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de584b57-28d6-4931-b323-1e262b172270-metrics-certs podName:de584b57-28d6-4931-b323-1e262b172270 nodeName:}" failed. No retries permitted until 2026-07-28 17:22:46.782471684 +0000 UTC m=+3.134825017 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/de584b57-28d6-4931-b323-1e262b172270-metrics-certs") pod "network-metrics-daemon-mh4wt" (UID: "de584b57-28d6-4931-b323-1e262b172270") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 17:22:46.283339 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.282535 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7b971e2f-14bd-4ff9-a4ee-c3a81e63a311-hostroot\") pod \"multus-cgwb8\" (UID: \"7b971e2f-14bd-4ff9-a4ee-c3a81e63a311\") " pod="openshift-multus/multus-cgwb8" Jul 28 17:22:46.283339 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.282585 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a44a458c-3e2b-4eff-aaa4-04496e296ff2-node-log\") pod \"ovnkube-node-kprz5\" (UID: \"a44a458c-3e2b-4eff-aaa4-04496e296ff2\") " pod="openshift-ovn-kubernetes/ovnkube-node-kprz5" Jul 28 17:22:46.283339 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.282651 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7b971e2f-14bd-4ff9-a4ee-c3a81e63a311-os-release\") pod \"multus-cgwb8\" (UID: \"7b971e2f-14bd-4ff9-a4ee-c3a81e63a311\") " pod="openshift-multus/multus-cgwb8" Jul 28 17:22:46.283339 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.282696 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a44a458c-3e2b-4eff-aaa4-04496e296ff2-host-cni-netd\") pod \"ovnkube-node-kprz5\" (UID: \"a44a458c-3e2b-4eff-aaa4-04496e296ff2\") " pod="openshift-ovn-kubernetes/ovnkube-node-kprz5" Jul 28 17:22:46.283339 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.283009 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a44a458c-3e2b-4eff-aaa4-04496e296ff2-ovnkube-script-lib\") pod \"ovnkube-node-kprz5\" (UID: \"a44a458c-3e2b-4eff-aaa4-04496e296ff2\") " pod="openshift-ovn-kubernetes/ovnkube-node-kprz5" Jul 28 17:22:46.283339 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.283077 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a44a458c-3e2b-4eff-aaa4-04496e296ff2-log-socket\") pod \"ovnkube-node-kprz5\" (UID: \"a44a458c-3e2b-4eff-aaa4-04496e296ff2\") " pod="openshift-ovn-kubernetes/ovnkube-node-kprz5" Jul 28 17:22:46.283339 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.283132 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a44a458c-3e2b-4eff-aaa4-04496e296ff2-host-run-ovn-kubernetes\") pod \"ovnkube-node-kprz5\" (UID: \"a44a458c-3e2b-4eff-aaa4-04496e296ff2\") " pod="openshift-ovn-kubernetes/ovnkube-node-kprz5" Jul 28 17:22:46.284287 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.283348 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9c048132-0256-43ad-8bae-b6c155d48b6d-sys-fs\") pod \"aws-ebs-csi-driver-node-jf6qs\" (UID: \"9c048132-0256-43ad-8bae-b6c155d48b6d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jf6qs" Jul 28 17:22:46.284287 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.283416 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a44a458c-3e2b-4eff-aaa4-04496e296ff2-run-systemd\") pod \"ovnkube-node-kprz5\" (UID: \"a44a458c-3e2b-4eff-aaa4-04496e296ff2\") " pod="openshift-ovn-kubernetes/ovnkube-node-kprz5" Jul 28 17:22:46.284287 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.283473 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7b971e2f-14bd-4ff9-a4ee-c3a81e63a311-etc-kubernetes\") pod \"multus-cgwb8\" (UID: \"7b971e2f-14bd-4ff9-a4ee-c3a81e63a311\") " pod="openshift-multus/multus-cgwb8" Jul 28 17:22:46.284287 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.283524 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7b971e2f-14bd-4ff9-a4ee-c3a81e63a311-host-var-lib-cni-multus\") pod \"multus-cgwb8\" (UID: \"7b971e2f-14bd-4ff9-a4ee-c3a81e63a311\") " pod="openshift-multus/multus-cgwb8" Jul 28 17:22:46.284287 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.283590 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a44a458c-3e2b-4eff-aaa4-04496e296ff2-host-cni-bin\") pod \"ovnkube-node-kprz5\" (UID: \"a44a458c-3e2b-4eff-aaa4-04496e296ff2\") " pod="openshift-ovn-kubernetes/ovnkube-node-kprz5" Jul 28 17:22:46.284287 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.283802 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7b971e2f-14bd-4ff9-a4ee-c3a81e63a311-multus-daemon-config\") pod \"multus-cgwb8\" (UID: \"7b971e2f-14bd-4ff9-a4ee-c3a81e63a311\") " pod="openshift-multus/multus-cgwb8" Jul 28 17:22:46.284287 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.283939 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7b971e2f-14bd-4ff9-a4ee-c3a81e63a311-cni-binary-copy\") pod \"multus-cgwb8\" (UID: \"7b971e2f-14bd-4ff9-a4ee-c3a81e63a311\") " pod="openshift-multus/multus-cgwb8" Jul 28 17:22:46.286549 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.286522 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/31ac4453-76a9-4596-ac57-682b8417c6e7-agent-certs\") pod \"konnectivity-agent-tb4pl\" (UID: \"31ac4453-76a9-4596-ac57-682b8417c6e7\") " pod="kube-system/konnectivity-agent-tb4pl" Jul 28 17:22:46.288075 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.288017 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a44a458c-3e2b-4eff-aaa4-04496e296ff2-ovn-node-metrics-cert\") pod \"ovnkube-node-kprz5\" (UID: \"a44a458c-3e2b-4eff-aaa4-04496e296ff2\") " pod="openshift-ovn-kubernetes/ovnkube-node-kprz5" Jul 28 17:22:46.290801 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.290047 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xl5z7\" (UniqueName: \"kubernetes.io/projected/7b971e2f-14bd-4ff9-a4ee-c3a81e63a311-kube-api-access-xl5z7\") pod \"multus-cgwb8\" (UID: \"7b971e2f-14bd-4ff9-a4ee-c3a81e63a311\") " pod="openshift-multus/multus-cgwb8" Jul 28 17:22:46.299415 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.299385 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xnbfk\" (UniqueName: \"kubernetes.io/projected/a44a458c-3e2b-4eff-aaa4-04496e296ff2-kube-api-access-xnbfk\") pod \"ovnkube-node-kprz5\" (UID: \"a44a458c-3e2b-4eff-aaa4-04496e296ff2\") " pod="openshift-ovn-kubernetes/ovnkube-node-kprz5" Jul 28 17:22:46.306324 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.304306 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c5d6p\" (UniqueName: \"kubernetes.io/projected/9c048132-0256-43ad-8bae-b6c155d48b6d-kube-api-access-c5d6p\") pod \"aws-ebs-csi-driver-node-jf6qs\" (UID: \"9c048132-0256-43ad-8bae-b6c155d48b6d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jf6qs" Jul 28 17:22:46.306324 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.304813 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j45jf\" (UniqueName: \"kubernetes.io/projected/de584b57-28d6-4931-b323-1e262b172270-kube-api-access-j45jf\") pod \"network-metrics-daemon-mh4wt\" (UID: \"de584b57-28d6-4931-b323-1e262b172270\") " pod="openshift-multus/network-metrics-daemon-mh4wt" Jul 28 17:22:46.361692 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.361646 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-nbcx6" Jul 28 17:22:46.374910 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.374877 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-f8w4n" Jul 28 17:22:46.386728 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.386702 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-66rwd" Jul 28 17:22:46.397240 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.397212 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-brrsh" Jul 28 17:22:46.406144 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.406102 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-5gbk6" Jul 28 17:22:46.414078 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.414052 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-kprz5" Jul 28 17:22:46.424002 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.423975 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-tb4pl" Jul 28 17:22:46.436783 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.436758 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-cgwb8" Jul 28 17:22:46.445618 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.445597 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jf6qs" Jul 28 17:22:46.683985 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.683884 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/98a4008a-5635-4697-abdf-0dc44f6e3b87-original-pull-secret\") pod \"global-pull-secret-syncer-7krxm\" (UID: \"98a4008a-5635-4697-abdf-0dc44f6e3b87\") " pod="kube-system/global-pull-secret-syncer-7krxm" Jul 28 17:22:46.683985 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.683957 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-94f42\" (UniqueName: \"kubernetes.io/projected/17d12e69-fb0c-4161-a579-875ca2f629a6-kube-api-access-94f42\") pod \"network-check-target-j2hsj\" (UID: \"17d12e69-fb0c-4161-a579-875ca2f629a6\") " pod="openshift-network-diagnostics/network-check-target-j2hsj" Jul 28 17:22:46.684225 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:22:46.684062 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 17:22:46.684225 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:22:46.684113 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 17:22:46.684225 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:22:46.684134 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 17:22:46.684225 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:22:46.684146 2576 projected.go:196] Error preparing data for projected volume kube-api-access-94f42 for pod openshift-network-diagnostics/network-check-target-j2hsj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 17:22:46.684225 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:22:46.684153 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/98a4008a-5635-4697-abdf-0dc44f6e3b87-original-pull-secret podName:98a4008a-5635-4697-abdf-0dc44f6e3b87 nodeName:}" failed. No retries permitted until 2026-07-28 17:22:47.684122417 +0000 UTC m=+4.036475746 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/98a4008a-5635-4697-abdf-0dc44f6e3b87-original-pull-secret") pod "global-pull-secret-syncer-7krxm" (UID: "98a4008a-5635-4697-abdf-0dc44f6e3b87") : object "kube-system"/"original-pull-secret" not registered Jul 28 17:22:46.684225 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:22:46.684214 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/17d12e69-fb0c-4161-a579-875ca2f629a6-kube-api-access-94f42 podName:17d12e69-fb0c-4161-a579-875ca2f629a6 nodeName:}" failed. No retries permitted until 2026-07-28 17:22:47.684195434 +0000 UTC m=+4.036548786 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-94f42" (UniqueName: "kubernetes.io/projected/17d12e69-fb0c-4161-a579-875ca2f629a6-kube-api-access-94f42") pod "network-check-target-j2hsj" (UID: "17d12e69-fb0c-4161-a579-875ca2f629a6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 17:22:46.784798 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:46.784760 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/de584b57-28d6-4931-b323-1e262b172270-metrics-certs\") pod \"network-metrics-daemon-mh4wt\" (UID: \"de584b57-28d6-4931-b323-1e262b172270\") " pod="openshift-multus/network-metrics-daemon-mh4wt" Jul 28 17:22:46.784980 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:22:46.784953 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 17:22:46.785066 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:22:46.785052 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de584b57-28d6-4931-b323-1e262b172270-metrics-certs podName:de584b57-28d6-4931-b323-1e262b172270 nodeName:}" failed. No retries permitted until 2026-07-28 17:22:47.785027463 +0000 UTC m=+4.137380796 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/de584b57-28d6-4931-b323-1e262b172270-metrics-certs") pod "network-metrics-daemon-mh4wt" (UID: "de584b57-28d6-4931-b323-1e262b172270") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 17:22:47.114845 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:47.114733 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-27 17:17:46 +0000 UTC" deadline="2028-03-15 01:47:56.677422771 +0000 UTC" Jul 28 17:22:47.114845 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:47.114792 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14288h25m9.562635507s" Jul 28 17:22:47.234215 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:47.234176 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7krxm" Jul 28 17:22:47.234403 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:47.234184 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mh4wt" Jul 28 17:22:47.234403 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:22:47.234317 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7krxm" podUID="98a4008a-5635-4697-abdf-0dc44f6e3b87" Jul 28 17:22:47.234532 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:22:47.234412 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mh4wt" podUID="de584b57-28d6-4931-b323-1e262b172270" Jul 28 17:22:47.456856 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:47.456698 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31ac4453_76a9_4596_ac57_682b8417c6e7.slice/crio-890927cd88ddd934746dcf7e3f468da092c385e07220df792e025b65f02534e6 WatchSource:0}: Error finding container 890927cd88ddd934746dcf7e3f468da092c385e07220df792e025b65f02534e6: Status 404 returned error can't find the container with id 890927cd88ddd934746dcf7e3f468da092c385e07220df792e025b65f02534e6 Jul 28 17:22:47.457674 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:47.457643 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b73fe8a_a195_4bbb_a5c8_481a196280af.slice/crio-823a8976f2af4b9c2e907363ed02efb7525392c0c7d37214e703af90c7ec82e5 WatchSource:0}: Error finding container 823a8976f2af4b9c2e907363ed02efb7525392c0c7d37214e703af90c7ec82e5: Status 404 returned error can't find the container with id 823a8976f2af4b9c2e907363ed02efb7525392c0c7d37214e703af90c7ec82e5 Jul 28 17:22:47.461486 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:47.461458 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ccb0274_cef0_4595_9bb1_6a478e4d7d21.slice/crio-9f971e726418386f494549f0d56a8197c9b911c3e207982d3c679ae654cdd4a0 WatchSource:0}: Error finding container 9f971e726418386f494549f0d56a8197c9b911c3e207982d3c679ae654cdd4a0: Status 404 returned error can't find the container with id 9f971e726418386f494549f0d56a8197c9b911c3e207982d3c679ae654cdd4a0 Jul 28 17:22:47.463636 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:47.463608 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b971e2f_14bd_4ff9_a4ee_c3a81e63a311.slice/crio-b223d44ad71b18082e008ee0b0024c7b891fb6518501825b053b74a193be4a67 WatchSource:0}: Error finding container b223d44ad71b18082e008ee0b0024c7b891fb6518501825b053b74a193be4a67: Status 404 returned error can't find the container with id b223d44ad71b18082e008ee0b0024c7b891fb6518501825b053b74a193be4a67 Jul 28 17:22:47.465778 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:47.465638 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c048132_0256_43ad_8bae_b6c155d48b6d.slice/crio-17df913e4be54d03afec6efeba71257b7aa95e78b26e816b88f72e6e30d52666 WatchSource:0}: Error finding container 17df913e4be54d03afec6efeba71257b7aa95e78b26e816b88f72e6e30d52666: Status 404 returned error can't find the container with id 17df913e4be54d03afec6efeba71257b7aa95e78b26e816b88f72e6e30d52666 Jul 28 17:22:47.466692 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:22:47.466667 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda44a458c_3e2b_4eff_aaa4_04496e296ff2.slice/crio-77ba461a3aa379e3a76ae6f8a4e13cdd1b9042fe17ec9f0c336ed8f6488601c9 WatchSource:0}: Error finding container 77ba461a3aa379e3a76ae6f8a4e13cdd1b9042fe17ec9f0c336ed8f6488601c9: Status 404 returned error can't find the container with id 77ba461a3aa379e3a76ae6f8a4e13cdd1b9042fe17ec9f0c336ed8f6488601c9 Jul 28 17:22:47.691841 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:47.691602 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/98a4008a-5635-4697-abdf-0dc44f6e3b87-original-pull-secret\") pod \"global-pull-secret-syncer-7krxm\" (UID: \"98a4008a-5635-4697-abdf-0dc44f6e3b87\") " pod="kube-system/global-pull-secret-syncer-7krxm" Jul 28 17:22:47.691841 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:47.691817 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-94f42\" (UniqueName: \"kubernetes.io/projected/17d12e69-fb0c-4161-a579-875ca2f629a6-kube-api-access-94f42\") pod \"network-check-target-j2hsj\" (UID: \"17d12e69-fb0c-4161-a579-875ca2f629a6\") " pod="openshift-network-diagnostics/network-check-target-j2hsj" Jul 28 17:22:47.691972 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:22:47.691757 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 17:22:47.691972 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:22:47.691928 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/98a4008a-5635-4697-abdf-0dc44f6e3b87-original-pull-secret podName:98a4008a-5635-4697-abdf-0dc44f6e3b87 nodeName:}" failed. No retries permitted until 2026-07-28 17:22:49.691904059 +0000 UTC m=+6.044257395 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/98a4008a-5635-4697-abdf-0dc44f6e3b87-original-pull-secret") pod "global-pull-secret-syncer-7krxm" (UID: "98a4008a-5635-4697-abdf-0dc44f6e3b87") : object "kube-system"/"original-pull-secret" not registered Jul 28 17:22:47.691972 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:22:47.691944 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 17:22:47.691972 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:22:47.691961 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 17:22:47.691972 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:22:47.691973 2576 projected.go:196] Error preparing data for projected volume kube-api-access-94f42 for pod openshift-network-diagnostics/network-check-target-j2hsj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 17:22:47.692157 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:22:47.692031 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/17d12e69-fb0c-4161-a579-875ca2f629a6-kube-api-access-94f42 podName:17d12e69-fb0c-4161-a579-875ca2f629a6 nodeName:}" failed. No retries permitted until 2026-07-28 17:22:49.692016168 +0000 UTC m=+6.044369519 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-94f42" (UniqueName: "kubernetes.io/projected/17d12e69-fb0c-4161-a579-875ca2f629a6-kube-api-access-94f42") pod "network-check-target-j2hsj" (UID: "17d12e69-fb0c-4161-a579-875ca2f629a6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 17:22:47.793036 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:47.793001 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/de584b57-28d6-4931-b323-1e262b172270-metrics-certs\") pod \"network-metrics-daemon-mh4wt\" (UID: \"de584b57-28d6-4931-b323-1e262b172270\") " pod="openshift-multus/network-metrics-daemon-mh4wt" Jul 28 17:22:47.793202 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:22:47.793121 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 17:22:47.793265 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:22:47.793202 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de584b57-28d6-4931-b323-1e262b172270-metrics-certs podName:de584b57-28d6-4931-b323-1e262b172270 nodeName:}" failed. No retries permitted until 2026-07-28 17:22:49.793184476 +0000 UTC m=+6.145537820 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/de584b57-28d6-4931-b323-1e262b172270-metrics-certs") pod "network-metrics-daemon-mh4wt" (UID: "de584b57-28d6-4931-b323-1e262b172270") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 17:22:47.985676 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:47.985405 2576 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 17:22:48.115546 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:48.115485 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-27 17:17:46 +0000 UTC" deadline="2027-12-25 02:59:14.861480365 +0000 UTC" Jul 28 17:22:48.116048 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:48.115566 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12345h36m26.745952062s" Jul 28 17:22:48.235950 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:48.235328 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j2hsj" Jul 28 17:22:48.235950 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:22:48.235472 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j2hsj" podUID="17d12e69-fb0c-4161-a579-875ca2f629a6" Jul 28 17:22:48.269510 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:48.268581 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-31.ec2.internal" event={"ID":"85547fd26d62ca170d8549b389f25e88","Type":"ContainerStarted","Data":"cfdcac8a30b01e9180ea3f3164891c684b7e8ea5dff627d48b0ae2bd6d965d0c"} Jul 28 17:22:48.291460 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:48.291418 2576 generic.go:356] "Generic (PLEG): container finished" podID="bf5d45a3473f9607ff7c933ffd8b119c" containerID="1b1773691078db4f1a9df4dedd4c690cc7456d6aeeeaad6438ad139b64b72524" exitCode=0 Jul 28 17:22:48.291642 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:48.291517 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-31.ec2.internal" event={"ID":"bf5d45a3473f9607ff7c933ffd8b119c","Type":"ContainerDied","Data":"1b1773691078db4f1a9df4dedd4c690cc7456d6aeeeaad6438ad139b64b72524"} Jul 28 17:22:48.308839 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:48.308771 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-31.ec2.internal" podStartSLOduration=2.308749885 podStartE2EDuration="2.308749885s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 17:22:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:22:48.285742927 +0000 UTC m=+4.638096281" watchObservedRunningTime="2026-07-28 17:22:48.308749885 +0000 UTC m=+4.661103239" Jul 28 17:22:48.313260 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:48.313228 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-66rwd" event={"ID":"269df47c-be5d-458f-8423-f032804bc81a","Type":"ContainerStarted","Data":"dde5dd630ea5aea7f42225e90849135f07548c93354b01006923d40d97b59ccb"} Jul 28 17:22:48.326791 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:48.326760 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jf6qs" event={"ID":"9c048132-0256-43ad-8bae-b6c155d48b6d","Type":"ContainerStarted","Data":"17df913e4be54d03afec6efeba71257b7aa95e78b26e816b88f72e6e30d52666"} Jul 28 17:22:48.344506 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:48.344458 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-5gbk6" event={"ID":"0b73fe8a-a195-4bbb-a5c8-481a196280af","Type":"ContainerStarted","Data":"823a8976f2af4b9c2e907363ed02efb7525392c0c7d37214e703af90c7ec82e5"} Jul 28 17:22:48.353885 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:48.353850 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-brrsh" event={"ID":"d8e62687-ca38-4624-ab1c-70a23dbe0140","Type":"ContainerStarted","Data":"5928a5aae1600acf62584e90389fce7e684e1c48ae6eba8f7d9e262f9dae2a2b"} Jul 28 17:22:48.363325 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:48.363280 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kprz5" event={"ID":"a44a458c-3e2b-4eff-aaa4-04496e296ff2","Type":"ContainerStarted","Data":"77ba461a3aa379e3a76ae6f8a4e13cdd1b9042fe17ec9f0c336ed8f6488601c9"} Jul 28 17:22:48.370599 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:48.370547 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-cgwb8" event={"ID":"7b971e2f-14bd-4ff9-a4ee-c3a81e63a311","Type":"ContainerStarted","Data":"b223d44ad71b18082e008ee0b0024c7b891fb6518501825b053b74a193be4a67"} Jul 28 17:22:48.380802 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:48.380764 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-f8w4n" event={"ID":"2ccb0274-cef0-4595-9bb1-6a478e4d7d21","Type":"ContainerStarted","Data":"9f971e726418386f494549f0d56a8197c9b911c3e207982d3c679ae654cdd4a0"} Jul 28 17:22:48.391186 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:48.388932 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-tb4pl" event={"ID":"31ac4453-76a9-4596-ac57-682b8417c6e7","Type":"ContainerStarted","Data":"890927cd88ddd934746dcf7e3f468da092c385e07220df792e025b65f02534e6"} Jul 28 17:22:48.403743 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:48.403705 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nbcx6" event={"ID":"d3519015-daca-4781-ac23-4156cb19876f","Type":"ContainerStarted","Data":"66d85e4370e29f0d488b8424d4b47e4df396b19942a017ca5933e1b759822b54"} Jul 28 17:22:49.233924 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:49.233888 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mh4wt" Jul 28 17:22:49.234444 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:22:49.234046 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mh4wt" podUID="de584b57-28d6-4931-b323-1e262b172270" Jul 28 17:22:49.234527 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:49.234500 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7krxm" Jul 28 17:22:49.234645 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:22:49.234621 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7krxm" podUID="98a4008a-5635-4697-abdf-0dc44f6e3b87" Jul 28 17:22:49.435593 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:49.435151 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-31.ec2.internal" event={"ID":"bf5d45a3473f9607ff7c933ffd8b119c","Type":"ContainerStarted","Data":"b42618f6f7883166b7bdbd6f616560d5a7fef5589468a672c42e6249b69fbb43"} Jul 28 17:22:49.455240 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:49.454207 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-31.ec2.internal" podStartSLOduration=3.454170128 podStartE2EDuration="3.454170128s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 17:22:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:22:49.454084391 +0000 UTC m=+5.806437747" watchObservedRunningTime="2026-07-28 17:22:49.454170128 +0000 UTC m=+5.806523483" Jul 28 17:22:49.714454 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:49.714361 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/98a4008a-5635-4697-abdf-0dc44f6e3b87-original-pull-secret\") pod \"global-pull-secret-syncer-7krxm\" (UID: \"98a4008a-5635-4697-abdf-0dc44f6e3b87\") " pod="kube-system/global-pull-secret-syncer-7krxm" Jul 28 17:22:49.714454 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:49.714443 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-94f42\" (UniqueName: \"kubernetes.io/projected/17d12e69-fb0c-4161-a579-875ca2f629a6-kube-api-access-94f42\") pod \"network-check-target-j2hsj\" (UID: \"17d12e69-fb0c-4161-a579-875ca2f629a6\") " pod="openshift-network-diagnostics/network-check-target-j2hsj" Jul 28 17:22:49.714687 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:22:49.714592 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 17:22:49.714687 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:22:49.714611 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 17:22:49.714687 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:22:49.714625 2576 projected.go:196] Error preparing data for projected volume kube-api-access-94f42 for pod openshift-network-diagnostics/network-check-target-j2hsj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 17:22:49.714687 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:22:49.714686 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/17d12e69-fb0c-4161-a579-875ca2f629a6-kube-api-access-94f42 podName:17d12e69-fb0c-4161-a579-875ca2f629a6 nodeName:}" failed. No retries permitted until 2026-07-28 17:22:53.714666593 +0000 UTC m=+10.067019942 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-94f42" (UniqueName: "kubernetes.io/projected/17d12e69-fb0c-4161-a579-875ca2f629a6-kube-api-access-94f42") pod "network-check-target-j2hsj" (UID: "17d12e69-fb0c-4161-a579-875ca2f629a6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 17:22:49.715140 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:22:49.715112 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 17:22:49.715250 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:22:49.715179 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/98a4008a-5635-4697-abdf-0dc44f6e3b87-original-pull-secret podName:98a4008a-5635-4697-abdf-0dc44f6e3b87 nodeName:}" failed. No retries permitted until 2026-07-28 17:22:53.715162692 +0000 UTC m=+10.067516041 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/98a4008a-5635-4697-abdf-0dc44f6e3b87-original-pull-secret") pod "global-pull-secret-syncer-7krxm" (UID: "98a4008a-5635-4697-abdf-0dc44f6e3b87") : object "kube-system"/"original-pull-secret" not registered Jul 28 17:22:49.815233 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:49.815190 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/de584b57-28d6-4931-b323-1e262b172270-metrics-certs\") pod \"network-metrics-daemon-mh4wt\" (UID: \"de584b57-28d6-4931-b323-1e262b172270\") " pod="openshift-multus/network-metrics-daemon-mh4wt" Jul 28 17:22:49.815444 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:22:49.815425 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 17:22:49.815509 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:22:49.815503 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de584b57-28d6-4931-b323-1e262b172270-metrics-certs podName:de584b57-28d6-4931-b323-1e262b172270 nodeName:}" failed. No retries permitted until 2026-07-28 17:22:53.81548321 +0000 UTC m=+10.167836547 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/de584b57-28d6-4931-b323-1e262b172270-metrics-certs") pod "network-metrics-daemon-mh4wt" (UID: "de584b57-28d6-4931-b323-1e262b172270") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 17:22:50.236381 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:50.236345 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j2hsj" Jul 28 17:22:50.236870 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:22:50.236499 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j2hsj" podUID="17d12e69-fb0c-4161-a579-875ca2f629a6" Jul 28 17:22:51.233641 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:51.233603 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mh4wt" Jul 28 17:22:51.233641 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:51.233633 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7krxm" Jul 28 17:22:51.233921 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:22:51.233775 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mh4wt" podUID="de584b57-28d6-4931-b323-1e262b172270" Jul 28 17:22:51.233921 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:22:51.233895 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7krxm" podUID="98a4008a-5635-4697-abdf-0dc44f6e3b87" Jul 28 17:22:52.234306 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:52.234224 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j2hsj" Jul 28 17:22:52.234747 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:22:52.234366 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j2hsj" podUID="17d12e69-fb0c-4161-a579-875ca2f629a6" Jul 28 17:22:53.234074 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:53.234040 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7krxm" Jul 28 17:22:53.234074 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:53.234066 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mh4wt" Jul 28 17:22:53.234332 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:22:53.234192 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7krxm" podUID="98a4008a-5635-4697-abdf-0dc44f6e3b87" Jul 28 17:22:53.234643 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:22:53.234611 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mh4wt" podUID="de584b57-28d6-4931-b323-1e262b172270" Jul 28 17:22:53.746763 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:53.746725 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-94f42\" (UniqueName: \"kubernetes.io/projected/17d12e69-fb0c-4161-a579-875ca2f629a6-kube-api-access-94f42\") pod \"network-check-target-j2hsj\" (UID: \"17d12e69-fb0c-4161-a579-875ca2f629a6\") " pod="openshift-network-diagnostics/network-check-target-j2hsj" Jul 28 17:22:53.746918 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:53.746823 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/98a4008a-5635-4697-abdf-0dc44f6e3b87-original-pull-secret\") pod \"global-pull-secret-syncer-7krxm\" (UID: \"98a4008a-5635-4697-abdf-0dc44f6e3b87\") " pod="kube-system/global-pull-secret-syncer-7krxm" Jul 28 17:22:53.746980 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:22:53.746959 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 17:22:53.747042 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:22:53.747026 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/98a4008a-5635-4697-abdf-0dc44f6e3b87-original-pull-secret podName:98a4008a-5635-4697-abdf-0dc44f6e3b87 nodeName:}" failed. No retries permitted until 2026-07-28 17:23:01.74700622 +0000 UTC m=+18.099359562 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/98a4008a-5635-4697-abdf-0dc44f6e3b87-original-pull-secret") pod "global-pull-secret-syncer-7krxm" (UID: "98a4008a-5635-4697-abdf-0dc44f6e3b87") : object "kube-system"/"original-pull-secret" not registered Jul 28 17:22:53.747390 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:22:53.747367 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 17:22:53.747495 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:22:53.747395 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 17:22:53.747495 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:22:53.747408 2576 projected.go:196] Error preparing data for projected volume kube-api-access-94f42 for pod openshift-network-diagnostics/network-check-target-j2hsj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 17:22:53.747495 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:22:53.747466 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/17d12e69-fb0c-4161-a579-875ca2f629a6-kube-api-access-94f42 podName:17d12e69-fb0c-4161-a579-875ca2f629a6 nodeName:}" failed. No retries permitted until 2026-07-28 17:23:01.747449663 +0000 UTC m=+18.099803011 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-94f42" (UniqueName: "kubernetes.io/projected/17d12e69-fb0c-4161-a579-875ca2f629a6-kube-api-access-94f42") pod "network-check-target-j2hsj" (UID: "17d12e69-fb0c-4161-a579-875ca2f629a6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 17:22:53.848660 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:53.847982 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/de584b57-28d6-4931-b323-1e262b172270-metrics-certs\") pod \"network-metrics-daemon-mh4wt\" (UID: \"de584b57-28d6-4931-b323-1e262b172270\") " pod="openshift-multus/network-metrics-daemon-mh4wt" Jul 28 17:22:53.848660 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:22:53.848236 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 17:22:53.848660 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:22:53.848307 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de584b57-28d6-4931-b323-1e262b172270-metrics-certs podName:de584b57-28d6-4931-b323-1e262b172270 nodeName:}" failed. No retries permitted until 2026-07-28 17:23:01.84828699 +0000 UTC m=+18.200640337 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/de584b57-28d6-4931-b323-1e262b172270-metrics-certs") pod "network-metrics-daemon-mh4wt" (UID: "de584b57-28d6-4931-b323-1e262b172270") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 17:22:54.235475 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:54.235390 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j2hsj" Jul 28 17:22:54.235875 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:22:54.235517 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j2hsj" podUID="17d12e69-fb0c-4161-a579-875ca2f629a6" Jul 28 17:22:55.234501 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:55.234466 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mh4wt" Jul 28 17:22:55.234669 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:55.234515 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7krxm" Jul 28 17:22:55.234669 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:22:55.234637 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mh4wt" podUID="de584b57-28d6-4931-b323-1e262b172270" Jul 28 17:22:55.235193 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:22:55.235157 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7krxm" podUID="98a4008a-5635-4697-abdf-0dc44f6e3b87" Jul 28 17:22:56.234210 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:56.234175 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j2hsj" Jul 28 17:22:56.234642 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:22:56.234299 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j2hsj" podUID="17d12e69-fb0c-4161-a579-875ca2f629a6" Jul 28 17:22:57.233982 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:57.233952 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7krxm" Jul 28 17:22:57.234167 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:22:57.234078 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7krxm" podUID="98a4008a-5635-4697-abdf-0dc44f6e3b87" Jul 28 17:22:57.234167 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:57.234137 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mh4wt" Jul 28 17:22:57.234269 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:22:57.234246 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mh4wt" podUID="de584b57-28d6-4931-b323-1e262b172270" Jul 28 17:22:58.234496 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:58.234462 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j2hsj" Jul 28 17:22:58.234861 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:22:58.234584 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j2hsj" podUID="17d12e69-fb0c-4161-a579-875ca2f629a6" Jul 28 17:22:59.234090 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:59.234052 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7krxm" Jul 28 17:22:59.234281 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:22:59.234213 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7krxm" podUID="98a4008a-5635-4697-abdf-0dc44f6e3b87" Jul 28 17:22:59.234281 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:22:59.234249 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mh4wt" Jul 28 17:22:59.234410 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:22:59.234388 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mh4wt" podUID="de584b57-28d6-4931-b323-1e262b172270" Jul 28 17:23:00.233898 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:00.233851 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j2hsj" Jul 28 17:23:00.234388 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:23:00.233987 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j2hsj" podUID="17d12e69-fb0c-4161-a579-875ca2f629a6" Jul 28 17:23:01.234158 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:01.234104 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mh4wt" Jul 28 17:23:01.234643 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:01.234104 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7krxm" Jul 28 17:23:01.234643 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:23:01.234277 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mh4wt" podUID="de584b57-28d6-4931-b323-1e262b172270" Jul 28 17:23:01.234643 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:23:01.234326 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7krxm" podUID="98a4008a-5635-4697-abdf-0dc44f6e3b87" Jul 28 17:23:01.809944 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:01.809903 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/98a4008a-5635-4697-abdf-0dc44f6e3b87-original-pull-secret\") pod \"global-pull-secret-syncer-7krxm\" (UID: \"98a4008a-5635-4697-abdf-0dc44f6e3b87\") " pod="kube-system/global-pull-secret-syncer-7krxm" Jul 28 17:23:01.810142 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:01.809964 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-94f42\" (UniqueName: \"kubernetes.io/projected/17d12e69-fb0c-4161-a579-875ca2f629a6-kube-api-access-94f42\") pod \"network-check-target-j2hsj\" (UID: \"17d12e69-fb0c-4161-a579-875ca2f629a6\") " pod="openshift-network-diagnostics/network-check-target-j2hsj" Jul 28 17:23:01.810142 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:23:01.810064 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 17:23:01.810142 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:23:01.810086 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 17:23:01.810307 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:23:01.810151 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/98a4008a-5635-4697-abdf-0dc44f6e3b87-original-pull-secret podName:98a4008a-5635-4697-abdf-0dc44f6e3b87 nodeName:}" failed. No retries permitted until 2026-07-28 17:23:17.810112366 +0000 UTC m=+34.162465712 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/98a4008a-5635-4697-abdf-0dc44f6e3b87-original-pull-secret") pod "global-pull-secret-syncer-7krxm" (UID: "98a4008a-5635-4697-abdf-0dc44f6e3b87") : object "kube-system"/"original-pull-secret" not registered Jul 28 17:23:01.810307 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:23:01.810152 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 17:23:01.810307 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:23:01.810170 2576 projected.go:196] Error preparing data for projected volume kube-api-access-94f42 for pod openshift-network-diagnostics/network-check-target-j2hsj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 17:23:01.810307 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:23:01.810208 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/17d12e69-fb0c-4161-a579-875ca2f629a6-kube-api-access-94f42 podName:17d12e69-fb0c-4161-a579-875ca2f629a6 nodeName:}" failed. No retries permitted until 2026-07-28 17:23:17.810198945 +0000 UTC m=+34.162552285 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-94f42" (UniqueName: "kubernetes.io/projected/17d12e69-fb0c-4161-a579-875ca2f629a6-kube-api-access-94f42") pod "network-check-target-j2hsj" (UID: "17d12e69-fb0c-4161-a579-875ca2f629a6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 17:23:01.910484 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:01.910450 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/de584b57-28d6-4931-b323-1e262b172270-metrics-certs\") pod \"network-metrics-daemon-mh4wt\" (UID: \"de584b57-28d6-4931-b323-1e262b172270\") " pod="openshift-multus/network-metrics-daemon-mh4wt" Jul 28 17:23:01.910646 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:23:01.910630 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 17:23:01.910716 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:23:01.910704 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de584b57-28d6-4931-b323-1e262b172270-metrics-certs podName:de584b57-28d6-4931-b323-1e262b172270 nodeName:}" failed. No retries permitted until 2026-07-28 17:23:17.910680978 +0000 UTC m=+34.263034324 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/de584b57-28d6-4931-b323-1e262b172270-metrics-certs") pod "network-metrics-daemon-mh4wt" (UID: "de584b57-28d6-4931-b323-1e262b172270") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 17:23:02.234054 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:02.234021 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j2hsj" Jul 28 17:23:02.234236 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:23:02.234178 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j2hsj" podUID="17d12e69-fb0c-4161-a579-875ca2f629a6" Jul 28 17:23:03.234323 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:03.234293 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mh4wt" Jul 28 17:23:03.234725 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:03.234338 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7krxm" Jul 28 17:23:03.234725 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:23:03.234451 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mh4wt" podUID="de584b57-28d6-4931-b323-1e262b172270" Jul 28 17:23:03.234725 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:23:03.234544 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7krxm" podUID="98a4008a-5635-4697-abdf-0dc44f6e3b87" Jul 28 17:23:04.235152 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:04.235065 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j2hsj" Jul 28 17:23:04.235630 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:23:04.235194 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j2hsj" podUID="17d12e69-fb0c-4161-a579-875ca2f629a6" Jul 28 17:23:05.233705 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:05.233653 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7krxm" Jul 28 17:23:05.233896 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:23:05.233813 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7krxm" podUID="98a4008a-5635-4697-abdf-0dc44f6e3b87" Jul 28 17:23:05.233896 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:05.233857 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mh4wt" Jul 28 17:23:05.234017 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:23:05.233991 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mh4wt" podUID="de584b57-28d6-4931-b323-1e262b172270" Jul 28 17:23:06.234104 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:06.234083 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j2hsj" Jul 28 17:23:06.234409 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:23:06.234202 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j2hsj" podUID="17d12e69-fb0c-4161-a579-875ca2f629a6" Jul 28 17:23:06.486622 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:06.485985 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-f8w4n" event={"ID":"2ccb0274-cef0-4595-9bb1-6a478e4d7d21","Type":"ContainerStarted","Data":"0acd2a9727c2d6b5c5daf715ad4dea6e65f6a1999a55d65cff4f4a514c1f3bc4"} Jul 28 17:23:06.490709 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:06.490343 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-tb4pl" event={"ID":"31ac4453-76a9-4596-ac57-682b8417c6e7","Type":"ContainerStarted","Data":"0d591adb648a03bd7d3626c8c62e9a82003b7fad41b11c21a2c43baa594eaacb"} Jul 28 17:23:06.504458 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:06.504202 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-f8w4n" podStartSLOduration=3.622561192 podStartE2EDuration="22.50418219s" totalImagesPullingTime="18.881620998s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 17:22:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:23:06.503552116 +0000 UTC m=+22.855905466" watchObservedRunningTime="2026-07-28 17:23:06.50418219 +0000 UTC m=+22.856535540" Jul 28 17:23:06.521327 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:06.521112 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-tb4pl" podStartSLOduration=3.895915659 podStartE2EDuration="22.521090661s" totalImagesPullingTime="18.625175002s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:22:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:23:06.520865268 +0000 UTC m=+22.873218619" watchObservedRunningTime="2026-07-28 17:23:06.521090661 +0000 UTC m=+22.873444013" Jul 28 17:23:07.234103 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:07.233894 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7krxm" Jul 28 17:23:07.234879 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:07.233956 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mh4wt" Jul 28 17:23:07.234879 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:23:07.234213 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7krxm" podUID="98a4008a-5635-4697-abdf-0dc44f6e3b87" Jul 28 17:23:07.234879 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:23:07.234298 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mh4wt" podUID="de584b57-28d6-4931-b323-1e262b172270" Jul 28 17:23:07.494910 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:07.494800 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-brrsh" event={"ID":"d8e62687-ca38-4624-ab1c-70a23dbe0140","Type":"ContainerStarted","Data":"ed1c0934dd5f31a4ed40ad373472cf8c0a4e66bfcd9ae815da677300866a0a71"} Jul 28 17:23:07.500136 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:07.500097 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kprz5_a44a458c-3e2b-4eff-aaa4-04496e296ff2/ovn-acl-logging/0.log" Jul 28 17:23:07.500692 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:07.500661 2576 generic.go:356] "Generic (PLEG): container finished" podID="a44a458c-3e2b-4eff-aaa4-04496e296ff2" containerID="7f9b912b5996c47dbe75170484bc7a37a77261d98f840d1b1a304a8ea1115606" exitCode=1 Jul 28 17:23:07.500813 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:07.500752 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kprz5" event={"ID":"a44a458c-3e2b-4eff-aaa4-04496e296ff2","Type":"ContainerStarted","Data":"12fd5eadeebfd98c0f58795675c999a4e7ac5b44d7d4e12be4365b6c5f141abb"} Jul 28 17:23:07.500875 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:07.500845 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kprz5" event={"ID":"a44a458c-3e2b-4eff-aaa4-04496e296ff2","Type":"ContainerStarted","Data":"40c3316bc89c9ffbc009b5b266059670022c3127f0aa4676b7f21acfa971fc1e"} Jul 28 17:23:07.500927 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:07.500897 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kprz5" event={"ID":"a44a458c-3e2b-4eff-aaa4-04496e296ff2","Type":"ContainerStarted","Data":"9320b106ddec7b7d54e99be1c7774080ced662785c9cdd1d413ed3c8734ad0db"} Jul 28 17:23:07.500976 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:07.500951 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kprz5" event={"ID":"a44a458c-3e2b-4eff-aaa4-04496e296ff2","Type":"ContainerStarted","Data":"112213c23cdaa28cb6258617d07d77d159538c0596b63a6d4affbd0345a7032d"} Jul 28 17:23:07.501029 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:07.501000 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kprz5" event={"ID":"a44a458c-3e2b-4eff-aaa4-04496e296ff2","Type":"ContainerDied","Data":"7f9b912b5996c47dbe75170484bc7a37a77261d98f840d1b1a304a8ea1115606"} Jul 28 17:23:07.501084 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:07.501052 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kprz5" event={"ID":"a44a458c-3e2b-4eff-aaa4-04496e296ff2","Type":"ContainerStarted","Data":"b48caab6383210632bef393948c28280bf590d37d4e74260436f6616750da2e6"} Jul 28 17:23:07.502490 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:07.502464 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-cgwb8" event={"ID":"7b971e2f-14bd-4ff9-a4ee-c3a81e63a311","Type":"ContainerStarted","Data":"4c55642855cfd7e117e26329b12cb253da65f23f5498c2a2d236f8a590375043"} Jul 28 17:23:07.504277 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:07.504252 2576 generic.go:356] "Generic (PLEG): container finished" podID="d3519015-daca-4781-ac23-4156cb19876f" containerID="42e728aadbca1662dd3b65db8895750327eb3dabb92ce2d5ad71de15b77c068a" exitCode=0 Jul 28 17:23:07.504396 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:07.504336 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nbcx6" event={"ID":"d3519015-daca-4781-ac23-4156cb19876f","Type":"ContainerDied","Data":"42e728aadbca1662dd3b65db8895750327eb3dabb92ce2d5ad71de15b77c068a"} Jul 28 17:23:07.505970 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:07.505951 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-66rwd" event={"ID":"269df47c-be5d-458f-8423-f032804bc81a","Type":"ContainerStarted","Data":"f6aee911095b39df71918458d6c7471620eba40a9cd83467b2d289a0b56ce85d"} Jul 28 17:23:07.507627 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:07.507606 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jf6qs" event={"ID":"9c048132-0256-43ad-8bae-b6c155d48b6d","Type":"ContainerStarted","Data":"3d5715af191be41a7d79ef24c655386f78432f54a882676604f1b845d2cd04f0"} Jul 28 17:23:07.510106 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:07.510058 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-brrsh" podStartSLOduration=4.650794232 podStartE2EDuration="23.510043037s" totalImagesPullingTime="18.859248805s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 17:22:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:23:07.509975678 +0000 UTC m=+23.862329030" watchObservedRunningTime="2026-07-28 17:23:07.510043037 +0000 UTC m=+23.862396389" Jul 28 17:23:07.524482 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:07.524438 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-66rwd" podStartSLOduration=4.6500194 podStartE2EDuration="23.524418522s" totalImagesPullingTime="18.874399122s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 17:22:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:23:07.524409212 +0000 UTC m=+23.876762561" watchObservedRunningTime="2026-07-28 17:23:07.524418522 +0000 UTC m=+23.876771874" Jul 28 17:23:07.565693 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:07.565639 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-cgwb8" podStartSLOduration=4.64025476 podStartE2EDuration="23.565624006s" totalImagesPullingTime="18.925369246s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 17:22:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:23:07.564959044 +0000 UTC m=+23.917312393" watchObservedRunningTime="2026-07-28 17:23:07.565624006 +0000 UTC m=+23.917977353" Jul 28 17:23:07.959460 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:07.959434 2576 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 28 17:23:08.139297 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:08.139154 2576 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-28T17:23:07.959455184Z","UUID":"50837673-4bc1-4241-9140-f9996cfb735b","Handler":null,"Name":"","Endpoint":""} Jul 28 17:23:08.140616 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:08.140594 2576 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 28 17:23:08.140727 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:08.140629 2576 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 28 17:23:08.233701 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:08.233667 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j2hsj" Jul 28 17:23:08.233878 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:23:08.233800 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j2hsj" podUID="17d12e69-fb0c-4161-a579-875ca2f629a6" Jul 28 17:23:08.351843 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:08.351814 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-66rwd_269df47c-be5d-458f-8423-f032804bc81a/dns-node-resolver/0.log" Jul 28 17:23:08.503827 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:08.503781 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-tb4pl" Jul 28 17:23:08.512040 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:08.511970 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jf6qs" event={"ID":"9c048132-0256-43ad-8bae-b6c155d48b6d","Type":"ContainerStarted","Data":"84296817ced6a0cd89f314a4c5366244a52950610342c0e8dcfe8bc19cefe829"} Jul 28 17:23:08.514098 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:08.514058 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-5gbk6" event={"ID":"0b73fe8a-a195-4bbb-a5c8-481a196280af","Type":"ContainerStarted","Data":"6563ec90d48a8a4310074e9baede5dfc680b537688397ab8127109bb0e0fb2c9"} Jul 28 17:23:08.531330 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:08.531275 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-5gbk6" podStartSLOduration=5.660617258 podStartE2EDuration="24.531255349s" totalImagesPullingTime="18.870638091s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 17:22:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:23:08.530602415 +0000 UTC m=+24.882955766" watchObservedRunningTime="2026-07-28 17:23:08.531255349 +0000 UTC m=+24.883608700" Jul 28 17:23:08.973454 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:08.973420 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-tb4pl" Jul 28 17:23:08.974039 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:08.974017 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-tb4pl" Jul 28 17:23:09.136443 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:09.136419 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-brrsh_d8e62687-ca38-4624-ab1c-70a23dbe0140/node-ca/0.log" Jul 28 17:23:09.234257 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:09.234186 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7krxm" Jul 28 17:23:09.234411 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:23:09.234305 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7krxm" podUID="98a4008a-5635-4697-abdf-0dc44f6e3b87" Jul 28 17:23:09.234411 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:09.234379 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mh4wt" Jul 28 17:23:09.234522 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:23:09.234477 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mh4wt" podUID="de584b57-28d6-4931-b323-1e262b172270" Jul 28 17:23:09.518819 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:09.518725 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jf6qs" event={"ID":"9c048132-0256-43ad-8bae-b6c155d48b6d","Type":"ContainerStarted","Data":"4bcb69fd49f5cb7318eafdb39c4a20aeda9fb0e47ea6a8d310ee02c06b7dd906"} Jul 28 17:23:09.522465 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:09.522437 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kprz5_a44a458c-3e2b-4eff-aaa4-04496e296ff2/ovn-acl-logging/0.log" Jul 28 17:23:09.522856 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:09.522831 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kprz5" event={"ID":"a44a458c-3e2b-4eff-aaa4-04496e296ff2","Type":"ContainerStarted","Data":"c4d4c24f2794ef026cab7ef110cd4a20f1196023d859e13f2aa3cf11d0c4f11f"} Jul 28 17:23:09.523623 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:09.523605 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-tb4pl" Jul 28 17:23:09.539527 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:09.539473 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jf6qs" podStartSLOduration=4.2827509599999996 podStartE2EDuration="25.539456028s" totalImagesPullingTime="21.256705068s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 17:22:44 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:23:09.538960614 +0000 UTC m=+25.891313964" watchObservedRunningTime="2026-07-28 17:23:09.539456028 +0000 UTC m=+25.891809378" Jul 28 17:23:10.234658 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:10.234420 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j2hsj" Jul 28 17:23:10.234906 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:23:10.234768 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j2hsj" podUID="17d12e69-fb0c-4161-a579-875ca2f629a6" Jul 28 17:23:11.234347 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:11.234320 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7krxm" Jul 28 17:23:11.234716 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:23:11.234456 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7krxm" podUID="98a4008a-5635-4697-abdf-0dc44f6e3b87" Jul 28 17:23:11.234716 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:11.234504 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mh4wt" Jul 28 17:23:11.234716 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:23:11.234616 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mh4wt" podUID="de584b57-28d6-4931-b323-1e262b172270" Jul 28 17:23:12.234087 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:12.233857 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j2hsj" Jul 28 17:23:12.234246 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:23:12.234135 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j2hsj" podUID="17d12e69-fb0c-4161-a579-875ca2f629a6" Jul 28 17:23:12.533068 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:12.532994 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kprz5_a44a458c-3e2b-4eff-aaa4-04496e296ff2/ovn-acl-logging/0.log" Jul 28 17:23:12.533834 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:12.533388 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kprz5" event={"ID":"a44a458c-3e2b-4eff-aaa4-04496e296ff2","Type":"ContainerStarted","Data":"6ff6bdae0e27400bdcfe2e1445d82b20f48983150ebac54ddcaa2f9e84f38e5a"} Jul 28 17:23:12.533834 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:12.533645 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kprz5" Jul 28 17:23:12.533934 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:12.533830 2576 scope.go:117] "RemoveContainer" containerID="7f9b912b5996c47dbe75170484bc7a37a77261d98f840d1b1a304a8ea1115606" Jul 28 17:23:12.535532 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:12.535499 2576 generic.go:356] "Generic (PLEG): container finished" podID="d3519015-daca-4781-ac23-4156cb19876f" containerID="af10f45e8036e391a97140d6863b93903700436c3500fa20a4e89f1033829f31" exitCode=0 Jul 28 17:23:12.535663 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:12.535545 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nbcx6" event={"ID":"d3519015-daca-4781-ac23-4156cb19876f","Type":"ContainerDied","Data":"af10f45e8036e391a97140d6863b93903700436c3500fa20a4e89f1033829f31"} Jul 28 17:23:12.549996 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:12.549978 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kprz5" Jul 28 17:23:13.234372 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:13.234341 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mh4wt" Jul 28 17:23:13.234539 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:13.234341 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7krxm" Jul 28 17:23:13.234539 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:23:13.234496 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mh4wt" podUID="de584b57-28d6-4931-b323-1e262b172270" Jul 28 17:23:13.234618 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:23:13.234589 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7krxm" podUID="98a4008a-5635-4697-abdf-0dc44f6e3b87" Jul 28 17:23:13.541230 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:13.541153 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kprz5_a44a458c-3e2b-4eff-aaa4-04496e296ff2/ovn-acl-logging/0.log" Jul 28 17:23:13.541750 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:13.541511 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kprz5" event={"ID":"a44a458c-3e2b-4eff-aaa4-04496e296ff2","Type":"ContainerStarted","Data":"d3ca67800ccb3d9c033001abdaea0e6279c0a84a334b2b29e625768b49eb8d7c"} Jul 28 17:23:13.541750 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:13.541623 2576 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 28 17:23:13.541925 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:13.541906 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kprz5" Jul 28 17:23:13.557174 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:13.557152 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kprz5" Jul 28 17:23:13.576924 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:13.576884 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-kprz5" podStartSLOduration=10.642303929 podStartE2EDuration="29.576870979s" totalImagesPullingTime="18.93456705s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 17:22:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:23:13.576590482 +0000 UTC m=+29.928943841" watchObservedRunningTime="2026-07-28 17:23:13.576870979 +0000 UTC m=+29.929224329" Jul 28 17:23:14.047969 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:14.047935 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kprz5" Jul 28 17:23:14.234873 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:14.234842 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j2hsj" Jul 28 17:23:14.235024 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:23:14.234920 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j2hsj" podUID="17d12e69-fb0c-4161-a579-875ca2f629a6" Jul 28 17:23:14.545942 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:14.545905 2576 generic.go:356] "Generic (PLEG): container finished" podID="d3519015-daca-4781-ac23-4156cb19876f" containerID="a5337c1d45d857973a39c09f0f74d462301520df0a93446bf479457d7c44659a" exitCode=0 Jul 28 17:23:14.546323 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:14.545984 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nbcx6" event={"ID":"d3519015-daca-4781-ac23-4156cb19876f","Type":"ContainerDied","Data":"a5337c1d45d857973a39c09f0f74d462301520df0a93446bf479457d7c44659a"} Jul 28 17:23:15.234646 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:15.234615 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7krxm" Jul 28 17:23:15.234868 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:15.234626 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mh4wt" Jul 28 17:23:15.234868 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:23:15.234749 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7krxm" podUID="98a4008a-5635-4697-abdf-0dc44f6e3b87" Jul 28 17:23:15.234868 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:23:15.234790 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mh4wt" podUID="de584b57-28d6-4931-b323-1e262b172270" Jul 28 17:23:15.550311 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:15.550282 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nbcx6" event={"ID":"d3519015-daca-4781-ac23-4156cb19876f","Type":"ContainerStarted","Data":"d52885766fcfba097058e6493bccbde740e7e7c4a9dcb0db68015e40c17a3514"} Jul 28 17:23:16.234324 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:16.234287 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j2hsj" Jul 28 17:23:16.234505 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:23:16.234393 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j2hsj" podUID="17d12e69-fb0c-4161-a579-875ca2f629a6" Jul 28 17:23:16.554678 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:16.554591 2576 generic.go:356] "Generic (PLEG): container finished" podID="d3519015-daca-4781-ac23-4156cb19876f" containerID="d52885766fcfba097058e6493bccbde740e7e7c4a9dcb0db68015e40c17a3514" exitCode=0 Jul 28 17:23:16.554678 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:16.554650 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nbcx6" event={"ID":"d3519015-daca-4781-ac23-4156cb19876f","Type":"ContainerDied","Data":"d52885766fcfba097058e6493bccbde740e7e7c4a9dcb0db68015e40c17a3514"} Jul 28 17:23:17.233752 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:17.233719 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7krxm" Jul 28 17:23:17.233752 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:17.233751 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mh4wt" Jul 28 17:23:17.233984 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:23:17.233849 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7krxm" podUID="98a4008a-5635-4697-abdf-0dc44f6e3b87" Jul 28 17:23:17.233984 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:23:17.233964 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mh4wt" podUID="de584b57-28d6-4931-b323-1e262b172270" Jul 28 17:23:17.837863 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:17.837814 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/98a4008a-5635-4697-abdf-0dc44f6e3b87-original-pull-secret\") pod \"global-pull-secret-syncer-7krxm\" (UID: \"98a4008a-5635-4697-abdf-0dc44f6e3b87\") " pod="kube-system/global-pull-secret-syncer-7krxm" Jul 28 17:23:17.838303 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:17.837895 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-94f42\" (UniqueName: \"kubernetes.io/projected/17d12e69-fb0c-4161-a579-875ca2f629a6-kube-api-access-94f42\") pod \"network-check-target-j2hsj\" (UID: \"17d12e69-fb0c-4161-a579-875ca2f629a6\") " pod="openshift-network-diagnostics/network-check-target-j2hsj" Jul 28 17:23:17.838303 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:23:17.838034 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 17:23:17.838303 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:23:17.838057 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 17:23:17.838303 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:23:17.838067 2576 projected.go:196] Error preparing data for projected volume kube-api-access-94f42 for pod openshift-network-diagnostics/network-check-target-j2hsj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 17:23:17.838303 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:23:17.838134 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/17d12e69-fb0c-4161-a579-875ca2f629a6-kube-api-access-94f42 podName:17d12e69-fb0c-4161-a579-875ca2f629a6 nodeName:}" failed. No retries permitted until 2026-07-28 17:23:49.838099503 +0000 UTC m=+66.190452845 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-94f42" (UniqueName: "kubernetes.io/projected/17d12e69-fb0c-4161-a579-875ca2f629a6-kube-api-access-94f42") pod "network-check-target-j2hsj" (UID: "17d12e69-fb0c-4161-a579-875ca2f629a6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 17:23:17.838303 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:23:17.838034 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 17:23:17.838303 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:23:17.838261 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/98a4008a-5635-4697-abdf-0dc44f6e3b87-original-pull-secret podName:98a4008a-5635-4697-abdf-0dc44f6e3b87 nodeName:}" failed. No retries permitted until 2026-07-28 17:23:49.838227434 +0000 UTC m=+66.190580768 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/98a4008a-5635-4697-abdf-0dc44f6e3b87-original-pull-secret") pod "global-pull-secret-syncer-7krxm" (UID: "98a4008a-5635-4697-abdf-0dc44f6e3b87") : object "kube-system"/"original-pull-secret" not registered Jul 28 17:23:17.938763 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:17.938720 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/de584b57-28d6-4931-b323-1e262b172270-metrics-certs\") pod \"network-metrics-daemon-mh4wt\" (UID: \"de584b57-28d6-4931-b323-1e262b172270\") " pod="openshift-multus/network-metrics-daemon-mh4wt" Jul 28 17:23:17.938938 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:23:17.938883 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 17:23:17.939004 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:23:17.938966 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de584b57-28d6-4931-b323-1e262b172270-metrics-certs podName:de584b57-28d6-4931-b323-1e262b172270 nodeName:}" failed. No retries permitted until 2026-07-28 17:23:49.938945085 +0000 UTC m=+66.291298429 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/de584b57-28d6-4931-b323-1e262b172270-metrics-certs") pod "network-metrics-daemon-mh4wt" (UID: "de584b57-28d6-4931-b323-1e262b172270") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 17:23:18.234555 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:18.234515 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j2hsj" Jul 28 17:23:18.234727 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:23:18.234651 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j2hsj" podUID="17d12e69-fb0c-4161-a579-875ca2f629a6" Jul 28 17:23:19.233916 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:19.233879 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7krxm" Jul 28 17:23:19.234429 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:23:19.234001 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7krxm" podUID="98a4008a-5635-4697-abdf-0dc44f6e3b87" Jul 28 17:23:19.234429 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:19.234052 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mh4wt" Jul 28 17:23:19.234429 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:23:19.234183 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mh4wt" podUID="de584b57-28d6-4931-b323-1e262b172270" Jul 28 17:23:20.234442 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:20.234408 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j2hsj" Jul 28 17:23:20.234889 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:23:20.234547 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j2hsj" podUID="17d12e69-fb0c-4161-a579-875ca2f629a6" Jul 28 17:23:20.567158 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:20.567110 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nbcx6" event={"ID":"d3519015-daca-4781-ac23-4156cb19876f","Type":"ContainerStarted","Data":"2b197199c02b3a5b72435a80bdfc2ef63eb34f6e2e56bc7e5f53e0a4784c8e9f"} Jul 28 17:23:21.233761 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:21.233730 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7krxm" Jul 28 17:23:21.233937 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:23:21.233827 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7krxm" podUID="98a4008a-5635-4697-abdf-0dc44f6e3b87" Jul 28 17:23:21.233937 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:21.233881 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mh4wt" Jul 28 17:23:21.234008 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:23:21.233966 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mh4wt" podUID="de584b57-28d6-4931-b323-1e262b172270" Jul 28 17:23:21.572321 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:21.572240 2576 generic.go:356] "Generic (PLEG): container finished" podID="d3519015-daca-4781-ac23-4156cb19876f" containerID="2b197199c02b3a5b72435a80bdfc2ef63eb34f6e2e56bc7e5f53e0a4784c8e9f" exitCode=0 Jul 28 17:23:21.572321 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:21.572302 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nbcx6" event={"ID":"d3519015-daca-4781-ac23-4156cb19876f","Type":"ContainerDied","Data":"2b197199c02b3a5b72435a80bdfc2ef63eb34f6e2e56bc7e5f53e0a4784c8e9f"} Jul 28 17:23:22.233863 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:22.233824 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j2hsj" Jul 28 17:23:22.234048 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:23:22.233966 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j2hsj" podUID="17d12e69-fb0c-4161-a579-875ca2f629a6" Jul 28 17:23:22.577673 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:22.577400 2576 generic.go:356] "Generic (PLEG): container finished" podID="d3519015-daca-4781-ac23-4156cb19876f" containerID="5ec9561879a40c79e851021782f08fb704dfc79bf3a5ba28d13216857969d266" exitCode=0 Jul 28 17:23:22.577673 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:22.577480 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nbcx6" event={"ID":"d3519015-daca-4781-ac23-4156cb19876f","Type":"ContainerDied","Data":"5ec9561879a40c79e851021782f08fb704dfc79bf3a5ba28d13216857969d266"} Jul 28 17:23:23.233832 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:23.233798 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7krxm" Jul 28 17:23:23.234026 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:23.233798 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mh4wt" Jul 28 17:23:23.234026 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:23:23.233921 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7krxm" podUID="98a4008a-5635-4697-abdf-0dc44f6e3b87" Jul 28 17:23:23.234026 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:23:23.233977 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mh4wt" podUID="de584b57-28d6-4931-b323-1e262b172270" Jul 28 17:23:23.582791 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:23.582707 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nbcx6" event={"ID":"d3519015-daca-4781-ac23-4156cb19876f","Type":"ContainerStarted","Data":"b156590c302648df6eeb6a1cb59428f698209bf0b44d3cf3f6745686f9add290"} Jul 28 17:23:24.235429 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:24.235397 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j2hsj" Jul 28 17:23:24.235618 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:23:24.235507 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j2hsj" podUID="17d12e69-fb0c-4161-a579-875ca2f629a6" Jul 28 17:23:25.233553 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:25.233522 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7krxm" Jul 28 17:23:25.233959 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:25.233523 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mh4wt" Jul 28 17:23:25.233959 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:23:25.233619 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7krxm" podUID="98a4008a-5635-4697-abdf-0dc44f6e3b87" Jul 28 17:23:25.233959 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:23:25.233702 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mh4wt" podUID="de584b57-28d6-4931-b323-1e262b172270" Jul 28 17:23:26.233590 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:26.233560 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j2hsj" Jul 28 17:23:26.234039 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:23:26.233682 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j2hsj" podUID="17d12e69-fb0c-4161-a579-875ca2f629a6" Jul 28 17:23:27.234307 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:27.234282 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7krxm" Jul 28 17:23:27.234686 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:27.234284 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mh4wt" Jul 28 17:23:27.234686 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:23:27.234372 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7krxm" podUID="98a4008a-5635-4697-abdf-0dc44f6e3b87" Jul 28 17:23:27.234686 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:23:27.234467 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mh4wt" podUID="de584b57-28d6-4931-b323-1e262b172270" Jul 28 17:23:28.234562 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:28.234519 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j2hsj" Jul 28 17:23:28.234936 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:23:28.234645 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j2hsj" podUID="17d12e69-fb0c-4161-a579-875ca2f629a6" Jul 28 17:23:29.233540 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:29.233505 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mh4wt" Jul 28 17:23:29.233757 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:29.233510 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7krxm" Jul 28 17:23:29.233757 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:23:29.233608 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mh4wt" podUID="de584b57-28d6-4931-b323-1e262b172270" Jul 28 17:23:29.233757 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:23:29.233724 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7krxm" podUID="98a4008a-5635-4697-abdf-0dc44f6e3b87" Jul 28 17:23:30.233603 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:30.233569 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j2hsj" Jul 28 17:23:30.234176 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:23:30.233675 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j2hsj" podUID="17d12e69-fb0c-4161-a579-875ca2f629a6" Jul 28 17:23:31.234564 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:31.234527 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7krxm" Jul 28 17:23:31.234963 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:31.234527 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mh4wt" Jul 28 17:23:31.234963 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:23:31.234642 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7krxm" podUID="98a4008a-5635-4697-abdf-0dc44f6e3b87" Jul 28 17:23:31.234963 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:23:31.234704 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mh4wt" podUID="de584b57-28d6-4931-b323-1e262b172270" Jul 28 17:23:32.233862 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:32.233829 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j2hsj" Jul 28 17:23:32.234030 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:23:32.233935 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j2hsj" podUID="17d12e69-fb0c-4161-a579-875ca2f629a6" Jul 28 17:23:33.233572 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:33.233542 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7krxm" Jul 28 17:23:33.233968 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:33.233549 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mh4wt" Jul 28 17:23:33.233968 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:23:33.233647 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7krxm" podUID="98a4008a-5635-4697-abdf-0dc44f6e3b87" Jul 28 17:23:33.233968 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:23:33.233727 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mh4wt" podUID="de584b57-28d6-4931-b323-1e262b172270" Jul 28 17:23:34.068833 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:34.068770 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-nbcx6" podStartSLOduration=21.147532498 podStartE2EDuration="50.068748855s" totalImagesPullingTime="28.921216357s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 17:22:44 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:23:23.607483929 +0000 UTC m=+39.959837278" watchObservedRunningTime="2026-07-28 17:23:34.068748855 +0000 UTC m=+50.421102207" Jul 28 17:23:34.069637 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:34.069606 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-7krxm"] Jul 28 17:23:34.069765 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:34.069735 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7krxm" Jul 28 17:23:34.069875 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:23:34.069851 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7krxm" podUID="98a4008a-5635-4697-abdf-0dc44f6e3b87" Jul 28 17:23:34.073468 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:34.073370 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-mh4wt"] Jul 28 17:23:34.073586 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:34.073513 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mh4wt" Jul 28 17:23:34.073651 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:23:34.073609 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mh4wt" podUID="de584b57-28d6-4931-b323-1e262b172270" Jul 28 17:23:34.074066 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:34.074044 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-j2hsj"] Jul 28 17:23:34.074189 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:34.074169 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j2hsj" Jul 28 17:23:34.074283 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:23:34.074264 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j2hsj" podUID="17d12e69-fb0c-4161-a579-875ca2f629a6" Jul 28 17:23:36.234581 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:36.234487 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7krxm" Jul 28 17:23:36.235386 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:36.234489 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j2hsj" Jul 28 17:23:36.235386 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:23:36.234595 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7krxm" podUID="98a4008a-5635-4697-abdf-0dc44f6e3b87" Jul 28 17:23:36.235386 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:36.234501 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mh4wt" Jul 28 17:23:36.235386 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:23:36.234666 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j2hsj" podUID="17d12e69-fb0c-4161-a579-875ca2f629a6" Jul 28 17:23:36.235386 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:23:36.234751 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mh4wt" podUID="de584b57-28d6-4931-b323-1e262b172270" Jul 28 17:23:37.978755 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:37.978571 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-31.ec2.internal" event="NodeReady" Jul 28 17:23:37.979113 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:37.978850 2576 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 28 17:23:38.066031 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:38.061611 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-786774f45-chdbb"] Jul 28 17:23:38.068086 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:38.068064 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-786774f45-chdbb" Jul 28 17:23:38.072627 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:38.072604 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 28 17:23:38.073074 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:38.073048 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 28 17:23:38.073287 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:38.073269 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 28 17:23:38.073569 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:38.073553 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-kh5wz\"" Jul 28 17:23:38.080092 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:38.080055 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0ac092e1-4b2d-4389-b663-816623ed37cd-registry-certificates\") pod \"image-registry-786774f45-chdbb\" (UID: \"0ac092e1-4b2d-4389-b663-816623ed37cd\") " pod="openshift-image-registry/image-registry-786774f45-chdbb" Jul 28 17:23:38.080224 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:38.080100 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0ac092e1-4b2d-4389-b663-816623ed37cd-image-registry-private-configuration\") pod \"image-registry-786774f45-chdbb\" (UID: \"0ac092e1-4b2d-4389-b663-816623ed37cd\") " pod="openshift-image-registry/image-registry-786774f45-chdbb" Jul 28 17:23:38.080224 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:38.080168 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0ac092e1-4b2d-4389-b663-816623ed37cd-installation-pull-secrets\") pod \"image-registry-786774f45-chdbb\" (UID: \"0ac092e1-4b2d-4389-b663-816623ed37cd\") " pod="openshift-image-registry/image-registry-786774f45-chdbb" Jul 28 17:23:38.080224 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:38.080201 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0ac092e1-4b2d-4389-b663-816623ed37cd-registry-tls\") pod \"image-registry-786774f45-chdbb\" (UID: \"0ac092e1-4b2d-4389-b663-816623ed37cd\") " pod="openshift-image-registry/image-registry-786774f45-chdbb" Jul 28 17:23:38.080431 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:38.080224 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0ac092e1-4b2d-4389-b663-816623ed37cd-trusted-ca\") pod \"image-registry-786774f45-chdbb\" (UID: \"0ac092e1-4b2d-4389-b663-816623ed37cd\") " pod="openshift-image-registry/image-registry-786774f45-chdbb" Jul 28 17:23:38.080431 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:38.080277 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0ac092e1-4b2d-4389-b663-816623ed37cd-bound-sa-token\") pod \"image-registry-786774f45-chdbb\" (UID: \"0ac092e1-4b2d-4389-b663-816623ed37cd\") " pod="openshift-image-registry/image-registry-786774f45-chdbb" Jul 28 17:23:38.080431 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:38.080341 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lsfpp\" (UniqueName: \"kubernetes.io/projected/0ac092e1-4b2d-4389-b663-816623ed37cd-kube-api-access-lsfpp\") pod \"image-registry-786774f45-chdbb\" (UID: \"0ac092e1-4b2d-4389-b663-816623ed37cd\") " pod="openshift-image-registry/image-registry-786774f45-chdbb" Jul 28 17:23:38.080431 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:38.080384 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0ac092e1-4b2d-4389-b663-816623ed37cd-ca-trust-extracted\") pod \"image-registry-786774f45-chdbb\" (UID: \"0ac092e1-4b2d-4389-b663-816623ed37cd\") " pod="openshift-image-registry/image-registry-786774f45-chdbb" Jul 28 17:23:38.081853 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:38.081836 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 28 17:23:38.093792 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:38.093763 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-xl7m9"] Jul 28 17:23:38.098320 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:38.098298 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-786774f45-chdbb"] Jul 28 17:23:38.098423 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:38.098404 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-xl7m9" Jul 28 17:23:38.099165 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:38.099145 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-jnlp5"] Jul 28 17:23:38.105962 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:38.105902 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-jnlp5" Jul 28 17:23:38.106069 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:38.106051 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 28 17:23:38.106244 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:38.106209 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 28 17:23:38.106452 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:38.106432 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-5f6s9\"" Jul 28 17:23:38.108055 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:38.108040 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 28 17:23:38.109299 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:38.109283 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 28 17:23:38.109375 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:38.109347 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-8g2tr\"" Jul 28 17:23:38.109650 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:38.109632 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 28 17:23:38.110767 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:38.110712 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 28 17:23:38.110767 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:38.110725 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-xl7m9"] Jul 28 17:23:38.111011 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:38.110995 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 28 17:23:38.118675 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:38.118650 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-jnlp5"] Jul 28 17:23:38.180701 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:38.180665 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0ac092e1-4b2d-4389-b663-816623ed37cd-trusted-ca\") pod \"image-registry-786774f45-chdbb\" (UID: \"0ac092e1-4b2d-4389-b663-816623ed37cd\") " pod="openshift-image-registry/image-registry-786774f45-chdbb" Jul 28 17:23:38.180701 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:38.180701 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0ac092e1-4b2d-4389-b663-816623ed37cd-bound-sa-token\") pod \"image-registry-786774f45-chdbb\" (UID: \"0ac092e1-4b2d-4389-b663-816623ed37cd\") " pod="openshift-image-registry/image-registry-786774f45-chdbb" Jul 28 17:23:38.180915 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:38.180721 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4c9faa95-82c3-4808-8c53-c16bf9dbdbf9-cert\") pod \"ingress-canary-xl7m9\" (UID: \"4c9faa95-82c3-4808-8c53-c16bf9dbdbf9\") " pod="openshift-ingress-canary/ingress-canary-xl7m9" Jul 28 17:23:38.180915 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:38.180832 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0cf93cde-5412-4319-92c1-95a1b7c97c5f-data-volume\") pod \"insights-runtime-extractor-jnlp5\" (UID: \"0cf93cde-5412-4319-92c1-95a1b7c97c5f\") " pod="openshift-insights/insights-runtime-extractor-jnlp5" Jul 28 17:23:38.180915 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:38.180858 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lsfpp\" (UniqueName: \"kubernetes.io/projected/0ac092e1-4b2d-4389-b663-816623ed37cd-kube-api-access-lsfpp\") pod \"image-registry-786774f45-chdbb\" (UID: \"0ac092e1-4b2d-4389-b663-816623ed37cd\") " pod="openshift-image-registry/image-registry-786774f45-chdbb" Jul 28 17:23:38.180915 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:38.180873 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0cf93cde-5412-4319-92c1-95a1b7c97c5f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jnlp5\" (UID: \"0cf93cde-5412-4319-92c1-95a1b7c97c5f\") " pod="openshift-insights/insights-runtime-extractor-jnlp5" Jul 28 17:23:38.180915 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:38.180899 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0ac092e1-4b2d-4389-b663-816623ed37cd-ca-trust-extracted\") pod \"image-registry-786774f45-chdbb\" (UID: \"0ac092e1-4b2d-4389-b663-816623ed37cd\") " pod="openshift-image-registry/image-registry-786774f45-chdbb" Jul 28 17:23:38.181110 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:38.181001 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0ac092e1-4b2d-4389-b663-816623ed37cd-registry-certificates\") pod \"image-registry-786774f45-chdbb\" (UID: \"0ac092e1-4b2d-4389-b663-816623ed37cd\") " pod="openshift-image-registry/image-registry-786774f45-chdbb" Jul 28 17:23:38.181110 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:38.181053 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0cf93cde-5412-4319-92c1-95a1b7c97c5f-crio-socket\") pod \"insights-runtime-extractor-jnlp5\" (UID: \"0cf93cde-5412-4319-92c1-95a1b7c97c5f\") " pod="openshift-insights/insights-runtime-extractor-jnlp5" Jul 28 17:23:38.181110 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:38.181089 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0ac092e1-4b2d-4389-b663-816623ed37cd-image-registry-private-configuration\") pod \"image-registry-786774f45-chdbb\" (UID: \"0ac092e1-4b2d-4389-b663-816623ed37cd\") " pod="openshift-image-registry/image-registry-786774f45-chdbb" Jul 28 17:23:38.181250 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:38.181167 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0ac092e1-4b2d-4389-b663-816623ed37cd-installation-pull-secrets\") pod \"image-registry-786774f45-chdbb\" (UID: \"0ac092e1-4b2d-4389-b663-816623ed37cd\") " pod="openshift-image-registry/image-registry-786774f45-chdbb" Jul 28 17:23:38.181250 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:38.181216 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0cf93cde-5412-4319-92c1-95a1b7c97c5f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jnlp5\" (UID: \"0cf93cde-5412-4319-92c1-95a1b7c97c5f\") " pod="openshift-insights/insights-runtime-extractor-jnlp5" Jul 28 17:23:38.181250 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:38.181238 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0ac092e1-4b2d-4389-b663-816623ed37cd-ca-trust-extracted\") pod \"image-registry-786774f45-chdbb\" (UID: \"0ac092e1-4b2d-4389-b663-816623ed37cd\") " pod="openshift-image-registry/image-registry-786774f45-chdbb" Jul 28 17:23:38.181250 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:38.181245 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-45hml\" (UniqueName: \"kubernetes.io/projected/0cf93cde-5412-4319-92c1-95a1b7c97c5f-kube-api-access-45hml\") pod \"insights-runtime-extractor-jnlp5\" (UID: \"0cf93cde-5412-4319-92c1-95a1b7c97c5f\") " pod="openshift-insights/insights-runtime-extractor-jnlp5" Jul 28 17:23:38.181408 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:38.181271 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ls678\" (UniqueName: \"kubernetes.io/projected/4c9faa95-82c3-4808-8c53-c16bf9dbdbf9-kube-api-access-ls678\") pod \"ingress-canary-xl7m9\" (UID: \"4c9faa95-82c3-4808-8c53-c16bf9dbdbf9\") " pod="openshift-ingress-canary/ingress-canary-xl7m9" Jul 28 17:23:38.181408 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:38.181322 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0ac092e1-4b2d-4389-b663-816623ed37cd-registry-tls\") pod \"image-registry-786774f45-chdbb\" (UID: \"0ac092e1-4b2d-4389-b663-816623ed37cd\") " pod="openshift-image-registry/image-registry-786774f45-chdbb" Jul 28 17:23:38.181742 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:38.181715 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0ac092e1-4b2d-4389-b663-816623ed37cd-registry-certificates\") pod \"image-registry-786774f45-chdbb\" (UID: \"0ac092e1-4b2d-4389-b663-816623ed37cd\") " pod="openshift-image-registry/image-registry-786774f45-chdbb" Jul 28 17:23:38.181828 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:38.181808 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0ac092e1-4b2d-4389-b663-816623ed37cd-trusted-ca\") pod \"image-registry-786774f45-chdbb\" (UID: \"0ac092e1-4b2d-4389-b663-816623ed37cd\") " pod="openshift-image-registry/image-registry-786774f45-chdbb" Jul 28 17:23:38.185005 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:38.184981 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0ac092e1-4b2d-4389-b663-816623ed37cd-installation-pull-secrets\") pod \"image-registry-786774f45-chdbb\" (UID: \"0ac092e1-4b2d-4389-b663-816623ed37cd\") " pod="openshift-image-registry/image-registry-786774f45-chdbb" Jul 28 17:23:38.185101 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:38.185079 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0ac092e1-4b2d-4389-b663-816623ed37cd-image-registry-private-configuration\") pod \"image-registry-786774f45-chdbb\" (UID: \"0ac092e1-4b2d-4389-b663-816623ed37cd\") " pod="openshift-image-registry/image-registry-786774f45-chdbb" Jul 28 17:23:38.185199 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:38.185184 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0ac092e1-4b2d-4389-b663-816623ed37cd-registry-tls\") pod \"image-registry-786774f45-chdbb\" (UID: \"0ac092e1-4b2d-4389-b663-816623ed37cd\") " pod="openshift-image-registry/image-registry-786774f45-chdbb" Jul 28 17:23:38.193629 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:38.193605 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-hp9s5"] Jul 28 17:23:38.200417 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:38.200395 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0ac092e1-4b2d-4389-b663-816623ed37cd-bound-sa-token\") pod \"image-registry-786774f45-chdbb\" (UID: \"0ac092e1-4b2d-4389-b663-816623ed37cd\") " pod="openshift-image-registry/image-registry-786774f45-chdbb" Jul 28 17:23:38.207209 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:38.207188 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lsfpp\" (UniqueName: \"kubernetes.io/projected/0ac092e1-4b2d-4389-b663-816623ed37cd-kube-api-access-lsfpp\") pod \"image-registry-786774f45-chdbb\" (UID: \"0ac092e1-4b2d-4389-b663-816623ed37cd\") " pod="openshift-image-registry/image-registry-786774f45-chdbb" Jul 28 17:23:38.214356 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:38.214334 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-hp9s5"] Jul 28 17:23:38.214448 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:38.214430 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hp9s5" Jul 28 17:23:38.217269 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:38.217251 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 28 17:23:38.217352 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:38.217269 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 28 17:23:38.217515 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:38.217503 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-pshjr\"" Jul 28 17:23:38.234484 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:38.234460 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j2hsj" Jul 28 17:23:38.234655 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:38.234635 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7krxm" Jul 28 17:23:38.234655 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:38.234648 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mh4wt" Jul 28 17:23:38.237452 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:38.237433 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-r6c5r\"" Jul 28 17:23:38.238228 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:38.238212 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-4ssq7\"" Jul 28 17:23:38.238228 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:38.238225 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 28 17:23:38.238364 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:38.238347 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 28 17:23:38.238445 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:38.238433 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 28 17:23:38.238511 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:38.238497 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 28 17:23:38.282080 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:38.282052 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4c9faa95-82c3-4808-8c53-c16bf9dbdbf9-cert\") pod \"ingress-canary-xl7m9\" (UID: \"4c9faa95-82c3-4808-8c53-c16bf9dbdbf9\") " pod="openshift-ingress-canary/ingress-canary-xl7m9" Jul 28 17:23:38.282080 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:38.282084 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5c83f00d-3c63-47ae-b2f7-e91d74db4565-config-volume\") pod \"dns-default-hp9s5\" (UID: \"5c83f00d-3c63-47ae-b2f7-e91d74db4565\") " pod="openshift-dns/dns-default-hp9s5" Jul 28 17:23:38.282288 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:38.282102 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5c83f00d-3c63-47ae-b2f7-e91d74db4565-tmp-dir\") pod \"dns-default-hp9s5\" (UID: \"5c83f00d-3c63-47ae-b2f7-e91d74db4565\") " pod="openshift-dns/dns-default-hp9s5" Jul 28 17:23:38.282288 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:38.282137 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tt8pg\" (UniqueName: \"kubernetes.io/projected/5c83f00d-3c63-47ae-b2f7-e91d74db4565-kube-api-access-tt8pg\") pod \"dns-default-hp9s5\" (UID: \"5c83f00d-3c63-47ae-b2f7-e91d74db4565\") " pod="openshift-dns/dns-default-hp9s5" Jul 28 17:23:38.282288 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:38.282168 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0cf93cde-5412-4319-92c1-95a1b7c97c5f-data-volume\") pod \"insights-runtime-extractor-jnlp5\" (UID: \"0cf93cde-5412-4319-92c1-95a1b7c97c5f\") " pod="openshift-insights/insights-runtime-extractor-jnlp5" Jul 28 17:23:38.282288 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:38.282242 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0cf93cde-5412-4319-92c1-95a1b7c97c5f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jnlp5\" (UID: \"0cf93cde-5412-4319-92c1-95a1b7c97c5f\") " pod="openshift-insights/insights-runtime-extractor-jnlp5" Jul 28 17:23:38.282473 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:38.282316 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0cf93cde-5412-4319-92c1-95a1b7c97c5f-crio-socket\") pod \"insights-runtime-extractor-jnlp5\" (UID: \"0cf93cde-5412-4319-92c1-95a1b7c97c5f\") " pod="openshift-insights/insights-runtime-extractor-jnlp5" Jul 28 17:23:38.282473 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:38.282351 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5c83f00d-3c63-47ae-b2f7-e91d74db4565-metrics-tls\") pod \"dns-default-hp9s5\" (UID: \"5c83f00d-3c63-47ae-b2f7-e91d74db4565\") " pod="openshift-dns/dns-default-hp9s5" Jul 28 17:23:38.282473 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:38.282394 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0cf93cde-5412-4319-92c1-95a1b7c97c5f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jnlp5\" (UID: \"0cf93cde-5412-4319-92c1-95a1b7c97c5f\") " pod="openshift-insights/insights-runtime-extractor-jnlp5" Jul 28 17:23:38.282473 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:38.282411 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-45hml\" (UniqueName: \"kubernetes.io/projected/0cf93cde-5412-4319-92c1-95a1b7c97c5f-kube-api-access-45hml\") pod \"insights-runtime-extractor-jnlp5\" (UID: \"0cf93cde-5412-4319-92c1-95a1b7c97c5f\") " pod="openshift-insights/insights-runtime-extractor-jnlp5" Jul 28 17:23:38.282473 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:38.282429 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ls678\" (UniqueName: \"kubernetes.io/projected/4c9faa95-82c3-4808-8c53-c16bf9dbdbf9-kube-api-access-ls678\") pod \"ingress-canary-xl7m9\" (UID: \"4c9faa95-82c3-4808-8c53-c16bf9dbdbf9\") " pod="openshift-ingress-canary/ingress-canary-xl7m9" Jul 28 17:23:38.282664 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:38.282515 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0cf93cde-5412-4319-92c1-95a1b7c97c5f-data-volume\") pod \"insights-runtime-extractor-jnlp5\" (UID: \"0cf93cde-5412-4319-92c1-95a1b7c97c5f\") " pod="openshift-insights/insights-runtime-extractor-jnlp5" Jul 28 17:23:38.282664 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:38.282543 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0cf93cde-5412-4319-92c1-95a1b7c97c5f-crio-socket\") pod \"insights-runtime-extractor-jnlp5\" (UID: \"0cf93cde-5412-4319-92c1-95a1b7c97c5f\") " pod="openshift-insights/insights-runtime-extractor-jnlp5" Jul 28 17:23:38.283348 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:38.283327 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0cf93cde-5412-4319-92c1-95a1b7c97c5f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jnlp5\" (UID: \"0cf93cde-5412-4319-92c1-95a1b7c97c5f\") " pod="openshift-insights/insights-runtime-extractor-jnlp5" Jul 28 17:23:38.284413 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:38.284393 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0cf93cde-5412-4319-92c1-95a1b7c97c5f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jnlp5\" (UID: \"0cf93cde-5412-4319-92c1-95a1b7c97c5f\") " pod="openshift-insights/insights-runtime-extractor-jnlp5" Jul 28 17:23:38.284603 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:38.284587 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4c9faa95-82c3-4808-8c53-c16bf9dbdbf9-cert\") pod \"ingress-canary-xl7m9\" (UID: \"4c9faa95-82c3-4808-8c53-c16bf9dbdbf9\") " pod="openshift-ingress-canary/ingress-canary-xl7m9" Jul 28 17:23:38.291057 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:38.291033 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-45hml\" (UniqueName: \"kubernetes.io/projected/0cf93cde-5412-4319-92c1-95a1b7c97c5f-kube-api-access-45hml\") pod \"insights-runtime-extractor-jnlp5\" (UID: \"0cf93cde-5412-4319-92c1-95a1b7c97c5f\") " pod="openshift-insights/insights-runtime-extractor-jnlp5" Jul 28 17:23:38.292255 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:38.292238 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ls678\" (UniqueName: \"kubernetes.io/projected/4c9faa95-82c3-4808-8c53-c16bf9dbdbf9-kube-api-access-ls678\") pod \"ingress-canary-xl7m9\" (UID: \"4c9faa95-82c3-4808-8c53-c16bf9dbdbf9\") " pod="openshift-ingress-canary/ingress-canary-xl7m9" Jul 28 17:23:38.377873 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:38.377793 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-786774f45-chdbb" Jul 28 17:23:38.383006 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:38.382981 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5c83f00d-3c63-47ae-b2f7-e91d74db4565-metrics-tls\") pod \"dns-default-hp9s5\" (UID: \"5c83f00d-3c63-47ae-b2f7-e91d74db4565\") " pod="openshift-dns/dns-default-hp9s5" Jul 28 17:23:38.383071 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:38.383027 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5c83f00d-3c63-47ae-b2f7-e91d74db4565-config-volume\") pod \"dns-default-hp9s5\" (UID: \"5c83f00d-3c63-47ae-b2f7-e91d74db4565\") " pod="openshift-dns/dns-default-hp9s5" Jul 28 17:23:38.383071 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:38.383045 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5c83f00d-3c63-47ae-b2f7-e91d74db4565-tmp-dir\") pod \"dns-default-hp9s5\" (UID: \"5c83f00d-3c63-47ae-b2f7-e91d74db4565\") " pod="openshift-dns/dns-default-hp9s5" Jul 28 17:23:38.383163 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:38.383069 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tt8pg\" (UniqueName: \"kubernetes.io/projected/5c83f00d-3c63-47ae-b2f7-e91d74db4565-kube-api-access-tt8pg\") pod \"dns-default-hp9s5\" (UID: \"5c83f00d-3c63-47ae-b2f7-e91d74db4565\") " pod="openshift-dns/dns-default-hp9s5" Jul 28 17:23:38.383402 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:38.383381 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5c83f00d-3c63-47ae-b2f7-e91d74db4565-tmp-dir\") pod \"dns-default-hp9s5\" (UID: \"5c83f00d-3c63-47ae-b2f7-e91d74db4565\") " pod="openshift-dns/dns-default-hp9s5" Jul 28 17:23:38.383588 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:38.383561 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5c83f00d-3c63-47ae-b2f7-e91d74db4565-config-volume\") pod \"dns-default-hp9s5\" (UID: \"5c83f00d-3c63-47ae-b2f7-e91d74db4565\") " pod="openshift-dns/dns-default-hp9s5" Jul 28 17:23:38.385271 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:38.385254 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5c83f00d-3c63-47ae-b2f7-e91d74db4565-metrics-tls\") pod \"dns-default-hp9s5\" (UID: \"5c83f00d-3c63-47ae-b2f7-e91d74db4565\") " pod="openshift-dns/dns-default-hp9s5" Jul 28 17:23:38.394181 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:38.394159 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tt8pg\" (UniqueName: \"kubernetes.io/projected/5c83f00d-3c63-47ae-b2f7-e91d74db4565-kube-api-access-tt8pg\") pod \"dns-default-hp9s5\" (UID: \"5c83f00d-3c63-47ae-b2f7-e91d74db4565\") " pod="openshift-dns/dns-default-hp9s5" Jul 28 17:23:38.406906 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:38.406889 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-xl7m9" Jul 28 17:23:38.415109 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:38.415087 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-jnlp5" Jul 28 17:23:38.523349 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:38.523271 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hp9s5" Jul 28 17:23:38.575267 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:38.574921 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-786774f45-chdbb"] Jul 28 17:23:38.575267 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:38.575228 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-xl7m9"] Jul 28 17:23:38.578687 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:38.578663 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-jnlp5"] Jul 28 17:23:38.584508 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:23:38.584462 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ac092e1_4b2d_4389_b663_816623ed37cd.slice/crio-fde7465bf8a3c45e5fc75066e5f06b756eef22721c3735f91a423d2c13ecd86c WatchSource:0}: Error finding container fde7465bf8a3c45e5fc75066e5f06b756eef22721c3735f91a423d2c13ecd86c: Status 404 returned error can't find the container with id fde7465bf8a3c45e5fc75066e5f06b756eef22721c3735f91a423d2c13ecd86c Jul 28 17:23:38.584964 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:23:38.584933 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c9faa95_82c3_4808_8c53_c16bf9dbdbf9.slice/crio-f202130a2326fad3e3b2598090439715802650b9f544b68ecb4d70bab4f14b91 WatchSource:0}: Error finding container f202130a2326fad3e3b2598090439715802650b9f544b68ecb4d70bab4f14b91: Status 404 returned error can't find the container with id f202130a2326fad3e3b2598090439715802650b9f544b68ecb4d70bab4f14b91 Jul 28 17:23:38.585910 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:23:38.585889 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0cf93cde_5412_4319_92c1_95a1b7c97c5f.slice/crio-c1363a095853dd7c79129f3032ae7b1e24a70629533cc5fe82defe5082e3a2a5 WatchSource:0}: Error finding container c1363a095853dd7c79129f3032ae7b1e24a70629533cc5fe82defe5082e3a2a5: Status 404 returned error can't find the container with id c1363a095853dd7c79129f3032ae7b1e24a70629533cc5fe82defe5082e3a2a5 Jul 28 17:23:38.619152 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:38.618881 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-786774f45-chdbb" event={"ID":"0ac092e1-4b2d-4389-b663-816623ed37cd","Type":"ContainerStarted","Data":"fde7465bf8a3c45e5fc75066e5f06b756eef22721c3735f91a423d2c13ecd86c"} Jul 28 17:23:38.628217 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:38.628013 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jnlp5" event={"ID":"0cf93cde-5412-4319-92c1-95a1b7c97c5f","Type":"ContainerStarted","Data":"c1363a095853dd7c79129f3032ae7b1e24a70629533cc5fe82defe5082e3a2a5"} Jul 28 17:23:38.630222 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:38.630159 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-xl7m9" event={"ID":"4c9faa95-82c3-4808-8c53-c16bf9dbdbf9","Type":"ContainerStarted","Data":"f202130a2326fad3e3b2598090439715802650b9f544b68ecb4d70bab4f14b91"} Jul 28 17:23:38.707787 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:38.707566 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-hp9s5"] Jul 28 17:23:38.711077 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:23:38.711053 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c83f00d_3c63_47ae_b2f7_e91d74db4565.slice/crio-9e9d9ce2a64d7bad2a70790be00156feb7e1dba1141e61d58f55618850f63a05 WatchSource:0}: Error finding container 9e9d9ce2a64d7bad2a70790be00156feb7e1dba1141e61d58f55618850f63a05: Status 404 returned error can't find the container with id 9e9d9ce2a64d7bad2a70790be00156feb7e1dba1141e61d58f55618850f63a05 Jul 28 17:23:39.637147 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:39.637071 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-786774f45-chdbb" event={"ID":"0ac092e1-4b2d-4389-b663-816623ed37cd","Type":"ContainerStarted","Data":"a68a61f366a58a7e1781c07247686299d815fe629dbb361c2b0bbe6925f7c91a"} Jul 28 17:23:39.637964 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:39.637928 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-786774f45-chdbb" Jul 28 17:23:39.641077 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:39.641016 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hp9s5" event={"ID":"5c83f00d-3c63-47ae-b2f7-e91d74db4565","Type":"ContainerStarted","Data":"9e9d9ce2a64d7bad2a70790be00156feb7e1dba1141e61d58f55618850f63a05"} Jul 28 17:23:44.657236 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:44.657201 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jnlp5" event={"ID":"0cf93cde-5412-4319-92c1-95a1b7c97c5f","Type":"ContainerStarted","Data":"c40347d3ab8dd231eb282f33dddbf9caf053dc8277720f0d09f067f41caae605"} Jul 28 17:23:44.658714 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:44.658688 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-xl7m9" event={"ID":"4c9faa95-82c3-4808-8c53-c16bf9dbdbf9","Type":"ContainerStarted","Data":"72cd664781796cc8fdba48a80e9962ce781fbd295608e4699ba457095316ce93"} Jul 28 17:23:44.660362 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:44.660339 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hp9s5" event={"ID":"5c83f00d-3c63-47ae-b2f7-e91d74db4565","Type":"ContainerStarted","Data":"0a57e1bb370935138343246270b93fbac82640da4eca583f16c873c07416c900"} Jul 28 17:23:44.660473 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:44.660383 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hp9s5" event={"ID":"5c83f00d-3c63-47ae-b2f7-e91d74db4565","Type":"ContainerStarted","Data":"4c368b5d48329a69e8668d9b0fecc91f437b00762f34f222e4929cd30dd2cd73"} Jul 28 17:23:44.660522 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:44.660466 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-hp9s5" Jul 28 17:23:44.674779 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:44.674736 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-786774f45-chdbb" podStartSLOduration=12.674723471 podStartE2EDuration="12.674723471s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:23:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:23:39.661190779 +0000 UTC m=+56.013544131" watchObservedRunningTime="2026-07-28 17:23:44.674723471 +0000 UTC m=+61.027076802" Jul 28 17:23:44.675180 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:44.675153 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-xl7m9" podStartSLOduration=1.021712094 podStartE2EDuration="6.675143731s" totalImagesPullingTime="5.653431637s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:23:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:23:44.673836694 +0000 UTC m=+61.026190044" watchObservedRunningTime="2026-07-28 17:23:44.675143731 +0000 UTC m=+61.027497080" Jul 28 17:23:44.691691 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:44.691654 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-hp9s5" podStartSLOduration=1.165311588 podStartE2EDuration="6.691641943s" totalImagesPullingTime="5.526330355s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:23:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:23:44.691633473 +0000 UTC m=+61.043986822" watchObservedRunningTime="2026-07-28 17:23:44.691641943 +0000 UTC m=+61.043995293" Jul 28 17:23:45.571921 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:45.571895 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kprz5" Jul 28 17:23:48.679370 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:48.679322 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jnlp5" event={"ID":"0cf93cde-5412-4319-92c1-95a1b7c97c5f","Type":"ContainerStarted","Data":"652031da0b7f125b46218df9cadff3705bbfcc98d4442927927f21e4fc1e0361"} Jul 28 17:23:49.881912 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:49.881871 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/98a4008a-5635-4697-abdf-0dc44f6e3b87-original-pull-secret\") pod \"global-pull-secret-syncer-7krxm\" (UID: \"98a4008a-5635-4697-abdf-0dc44f6e3b87\") " pod="kube-system/global-pull-secret-syncer-7krxm" Jul 28 17:23:49.882378 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:49.881937 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-94f42\" (UniqueName: \"kubernetes.io/projected/17d12e69-fb0c-4161-a579-875ca2f629a6-kube-api-access-94f42\") pod \"network-check-target-j2hsj\" (UID: \"17d12e69-fb0c-4161-a579-875ca2f629a6\") " pod="openshift-network-diagnostics/network-check-target-j2hsj" Jul 28 17:23:49.884679 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:49.884657 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 28 17:23:49.884814 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:49.884682 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 28 17:23:49.895199 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:49.895174 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 28 17:23:49.896715 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:49.896680 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/98a4008a-5635-4697-abdf-0dc44f6e3b87-original-pull-secret\") pod \"global-pull-secret-syncer-7krxm\" (UID: \"98a4008a-5635-4697-abdf-0dc44f6e3b87\") " pod="kube-system/global-pull-secret-syncer-7krxm" Jul 28 17:23:49.905719 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:49.905696 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-94f42\" (UniqueName: \"kubernetes.io/projected/17d12e69-fb0c-4161-a579-875ca2f629a6-kube-api-access-94f42\") pod \"network-check-target-j2hsj\" (UID: \"17d12e69-fb0c-4161-a579-875ca2f629a6\") " pod="openshift-network-diagnostics/network-check-target-j2hsj" Jul 28 17:23:49.947890 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:49.947866 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-r6c5r\"" Jul 28 17:23:49.950895 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:49.950872 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7krxm" Jul 28 17:23:49.955228 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:49.955205 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j2hsj" Jul 28 17:23:49.983208 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:49.983177 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/de584b57-28d6-4931-b323-1e262b172270-metrics-certs\") pod \"network-metrics-daemon-mh4wt\" (UID: \"de584b57-28d6-4931-b323-1e262b172270\") " pod="openshift-multus/network-metrics-daemon-mh4wt" Jul 28 17:23:49.985608 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:49.985579 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 28 17:23:49.996140 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:49.996100 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/de584b57-28d6-4931-b323-1e262b172270-metrics-certs\") pod \"network-metrics-daemon-mh4wt\" (UID: \"de584b57-28d6-4931-b323-1e262b172270\") " pod="openshift-multus/network-metrics-daemon-mh4wt" Jul 28 17:23:50.258077 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:50.258044 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-4ssq7\"" Jul 28 17:23:50.266103 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:50.266072 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mh4wt" Jul 28 17:23:51.343952 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:51.343881 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-j2hsj"] Jul 28 17:23:51.345165 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:23:51.345136 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17d12e69_fb0c_4161_a579_875ca2f629a6.slice/crio-2c3f389eacbbf823bc9eb7726fda9b3b1802166b085f3f11f6653bc3ad5bc5ed WatchSource:0}: Error finding container 2c3f389eacbbf823bc9eb7726fda9b3b1802166b085f3f11f6653bc3ad5bc5ed: Status 404 returned error can't find the container with id 2c3f389eacbbf823bc9eb7726fda9b3b1802166b085f3f11f6653bc3ad5bc5ed Jul 28 17:23:51.358190 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:51.358164 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-mh4wt"] Jul 28 17:23:51.361608 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:23:51.361578 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde584b57_28d6_4931_b323_1e262b172270.slice/crio-5c9863d45962dddb4a6c18fe5eb6ff3b8421b96695666191fde16ce50cb8152d WatchSource:0}: Error finding container 5c9863d45962dddb4a6c18fe5eb6ff3b8421b96695666191fde16ce50cb8152d: Status 404 returned error can't find the container with id 5c9863d45962dddb4a6c18fe5eb6ff3b8421b96695666191fde16ce50cb8152d Jul 28 17:23:51.372963 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:51.372933 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-7krxm"] Jul 28 17:23:51.379504 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:23:51.379472 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98a4008a_5635_4697_abdf_0dc44f6e3b87.slice/crio-daee3227b550d5cf011cf168d4bb4434899e016bd2222248e1ebe0165a52c1a7 WatchSource:0}: Error finding container daee3227b550d5cf011cf168d4bb4434899e016bd2222248e1ebe0165a52c1a7: Status 404 returned error can't find the container with id daee3227b550d5cf011cf168d4bb4434899e016bd2222248e1ebe0165a52c1a7 Jul 28 17:23:51.690205 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:51.690172 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mh4wt" event={"ID":"de584b57-28d6-4931-b323-1e262b172270","Type":"ContainerStarted","Data":"5c9863d45962dddb4a6c18fe5eb6ff3b8421b96695666191fde16ce50cb8152d"} Jul 28 17:23:51.691303 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:51.691278 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-j2hsj" event={"ID":"17d12e69-fb0c-4161-a579-875ca2f629a6","Type":"ContainerStarted","Data":"2c3f389eacbbf823bc9eb7726fda9b3b1802166b085f3f11f6653bc3ad5bc5ed"} Jul 28 17:23:51.692386 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:51.692366 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-7krxm" event={"ID":"98a4008a-5635-4697-abdf-0dc44f6e3b87","Type":"ContainerStarted","Data":"daee3227b550d5cf011cf168d4bb4434899e016bd2222248e1ebe0165a52c1a7"} Jul 28 17:23:51.694397 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:51.694375 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jnlp5" event={"ID":"0cf93cde-5412-4319-92c1-95a1b7c97c5f","Type":"ContainerStarted","Data":"0313ad2a88b1be7a29cd6bccfeba1063bc026c72daabdd786140386188cbe2fe"} Jul 28 17:23:51.716267 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:51.716172 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-jnlp5" podStartSLOduration=1.1715853 podStartE2EDuration="13.716154464s" totalImagesPullingTime="12.544569164s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 17:23:38 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:23:51.714370197 +0000 UTC m=+68.066723569" watchObservedRunningTime="2026-07-28 17:23:51.716154464 +0000 UTC m=+68.068507814" Jul 28 17:23:53.705151 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:53.705095 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mh4wt" event={"ID":"de584b57-28d6-4931-b323-1e262b172270","Type":"ContainerStarted","Data":"cdd53b3bf46aa569dd1033c281778aa3c9ff289066c4e7d460007a24843e6a0b"} Jul 28 17:23:53.705603 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:53.705211 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mh4wt" event={"ID":"de584b57-28d6-4931-b323-1e262b172270","Type":"ContainerStarted","Data":"abad26bf953d739f303497d4cd275bdc19101246c8f779c127005c5da80aa184"} Jul 28 17:23:53.725241 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:53.725180 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-mh4wt" podStartSLOduration=68.031867508 podStartE2EDuration="1m9.725157442s" totalImagesPullingTime="1.693289934s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:22:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:23:53.722559997 +0000 UTC m=+70.074913362" watchObservedRunningTime="2026-07-28 17:23:53.725157442 +0000 UTC m=+70.077510795" Jul 28 17:23:54.666737 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:54.666705 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-hp9s5" Jul 28 17:23:55.204316 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:55.204281 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-zj5sc"] Jul 28 17:23:55.206491 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:55.206462 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-zj5sc" Jul 28 17:23:55.212689 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:55.212657 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 28 17:23:55.213025 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:55.212994 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 28 17:23:55.213025 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:55.212993 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 28 17:23:55.214044 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:55.213921 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-b655k\"" Jul 28 17:23:55.214044 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:55.213924 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 28 17:23:55.214394 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:55.214368 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 28 17:23:55.221380 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:55.221334 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-zj5sc"] Jul 28 17:23:55.242714 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:55.242684 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-wlzdr"] Jul 28 17:23:55.244823 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:55.244802 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-wlzdr" Jul 28 17:23:55.247744 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:55.247722 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 28 17:23:55.247744 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:55.247710 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-68kcm\"" Jul 28 17:23:55.247908 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:55.247835 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 28 17:23:55.250685 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:55.250664 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 28 17:23:55.263457 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:55.263432 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-x29k4"] Jul 28 17:23:55.270346 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:55.270320 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-wlzdr"] Jul 28 17:23:55.270462 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:55.270442 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-x29k4" Jul 28 17:23:55.273161 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:55.273138 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 28 17:23:55.273455 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:55.273434 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 28 17:23:55.273551 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:55.273434 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 28 17:23:55.273551 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:55.273483 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-j8m7x\"" Jul 28 17:23:55.325998 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:55.325953 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3d43e446-eb2c-4dbf-8358-3d41c4120e6a-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-wlzdr\" (UID: \"3d43e446-eb2c-4dbf-8358-3d41c4120e6a\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-wlzdr" Jul 28 17:23:55.325998 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:55.326001 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3b0a9fac-7aa5-4758-9831-2135c1dcc534-metrics-client-ca\") pod \"node-exporter-x29k4\" (UID: \"3b0a9fac-7aa5-4758-9831-2135c1dcc534\") " pod="openshift-monitoring/node-exporter-x29k4" Jul 28 17:23:55.326268 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:55.326029 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3b0a9fac-7aa5-4758-9831-2135c1dcc534-node-exporter-accelerators-collector-config\") pod \"node-exporter-x29k4\" (UID: \"3b0a9fac-7aa5-4758-9831-2135c1dcc534\") " pod="openshift-monitoring/node-exporter-x29k4" Jul 28 17:23:55.326268 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:55.326067 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c4063b0e-9185-4cbd-9739-1cbff5b3e338-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-zj5sc\" (UID: \"c4063b0e-9185-4cbd-9739-1cbff5b3e338\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-zj5sc" Jul 28 17:23:55.326268 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:55.326212 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/3d43e446-eb2c-4dbf-8358-3d41c4120e6a-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-wlzdr\" (UID: \"3d43e446-eb2c-4dbf-8358-3d41c4120e6a\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-wlzdr" Jul 28 17:23:55.326268 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:55.326259 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bzht5\" (UniqueName: \"kubernetes.io/projected/3d43e446-eb2c-4dbf-8358-3d41c4120e6a-kube-api-access-bzht5\") pod \"kube-state-metrics-56d9f944b4-wlzdr\" (UID: \"3d43e446-eb2c-4dbf-8358-3d41c4120e6a\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-wlzdr" Jul 28 17:23:55.326475 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:55.326281 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l4wd4\" (UniqueName: \"kubernetes.io/projected/c4063b0e-9185-4cbd-9739-1cbff5b3e338-kube-api-access-l4wd4\") pod \"openshift-state-metrics-b8f49f5c6-zj5sc\" (UID: \"c4063b0e-9185-4cbd-9739-1cbff5b3e338\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-zj5sc" Jul 28 17:23:55.326475 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:55.326329 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3d43e446-eb2c-4dbf-8358-3d41c4120e6a-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-wlzdr\" (UID: \"3d43e446-eb2c-4dbf-8358-3d41c4120e6a\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-wlzdr" Jul 28 17:23:55.326475 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:55.326370 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3b0a9fac-7aa5-4758-9831-2135c1dcc534-node-exporter-textfile\") pod \"node-exporter-x29k4\" (UID: \"3b0a9fac-7aa5-4758-9831-2135c1dcc534\") " pod="openshift-monitoring/node-exporter-x29k4" Jul 28 17:23:55.326475 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:55.326416 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3b0a9fac-7aa5-4758-9831-2135c1dcc534-root\") pod \"node-exporter-x29k4\" (UID: \"3b0a9fac-7aa5-4758-9831-2135c1dcc534\") " pod="openshift-monitoring/node-exporter-x29k4" Jul 28 17:23:55.326475 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:55.326439 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3b0a9fac-7aa5-4758-9831-2135c1dcc534-node-exporter-wtmp\") pod \"node-exporter-x29k4\" (UID: \"3b0a9fac-7aa5-4758-9831-2135c1dcc534\") " pod="openshift-monitoring/node-exporter-x29k4" Jul 28 17:23:55.326475 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:55.326465 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3b0a9fac-7aa5-4758-9831-2135c1dcc534-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-x29k4\" (UID: \"3b0a9fac-7aa5-4758-9831-2135c1dcc534\") " pod="openshift-monitoring/node-exporter-x29k4" Jul 28 17:23:55.326756 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:55.326490 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3b0a9fac-7aa5-4758-9831-2135c1dcc534-node-exporter-tls\") pod \"node-exporter-x29k4\" (UID: \"3b0a9fac-7aa5-4758-9831-2135c1dcc534\") " pod="openshift-monitoring/node-exporter-x29k4" Jul 28 17:23:55.326756 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:55.326516 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3d43e446-eb2c-4dbf-8358-3d41c4120e6a-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-wlzdr\" (UID: \"3d43e446-eb2c-4dbf-8358-3d41c4120e6a\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-wlzdr" Jul 28 17:23:55.326756 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:55.326549 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3b0a9fac-7aa5-4758-9831-2135c1dcc534-sys\") pod \"node-exporter-x29k4\" (UID: \"3b0a9fac-7aa5-4758-9831-2135c1dcc534\") " pod="openshift-monitoring/node-exporter-x29k4" Jul 28 17:23:55.326756 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:55.326621 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c4063b0e-9185-4cbd-9739-1cbff5b3e338-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-zj5sc\" (UID: \"c4063b0e-9185-4cbd-9739-1cbff5b3e338\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-zj5sc" Jul 28 17:23:55.326756 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:55.326685 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/3d43e446-eb2c-4dbf-8358-3d41c4120e6a-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-wlzdr\" (UID: \"3d43e446-eb2c-4dbf-8358-3d41c4120e6a\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-wlzdr" Jul 28 17:23:55.326756 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:55.326724 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c4063b0e-9185-4cbd-9739-1cbff5b3e338-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-zj5sc\" (UID: \"c4063b0e-9185-4cbd-9739-1cbff5b3e338\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-zj5sc" Jul 28 17:23:55.326756 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:55.326750 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9mmq\" (UniqueName: \"kubernetes.io/projected/3b0a9fac-7aa5-4758-9831-2135c1dcc534-kube-api-access-t9mmq\") pod \"node-exporter-x29k4\" (UID: \"3b0a9fac-7aa5-4758-9831-2135c1dcc534\") " pod="openshift-monitoring/node-exporter-x29k4" Jul 28 17:23:55.428046 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:55.428009 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3b0a9fac-7aa5-4758-9831-2135c1dcc534-sys\") pod \"node-exporter-x29k4\" (UID: \"3b0a9fac-7aa5-4758-9831-2135c1dcc534\") " pod="openshift-monitoring/node-exporter-x29k4" Jul 28 17:23:55.428250 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:55.428055 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c4063b0e-9185-4cbd-9739-1cbff5b3e338-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-zj5sc\" (UID: \"c4063b0e-9185-4cbd-9739-1cbff5b3e338\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-zj5sc" Jul 28 17:23:55.428250 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:55.428085 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/3d43e446-eb2c-4dbf-8358-3d41c4120e6a-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-wlzdr\" (UID: \"3d43e446-eb2c-4dbf-8358-3d41c4120e6a\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-wlzdr" Jul 28 17:23:55.428250 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:55.428105 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c4063b0e-9185-4cbd-9739-1cbff5b3e338-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-zj5sc\" (UID: \"c4063b0e-9185-4cbd-9739-1cbff5b3e338\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-zj5sc" Jul 28 17:23:55.428250 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:55.428137 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3b0a9fac-7aa5-4758-9831-2135c1dcc534-sys\") pod \"node-exporter-x29k4\" (UID: \"3b0a9fac-7aa5-4758-9831-2135c1dcc534\") " pod="openshift-monitoring/node-exporter-x29k4" Jul 28 17:23:55.428250 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:55.428148 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t9mmq\" (UniqueName: \"kubernetes.io/projected/3b0a9fac-7aa5-4758-9831-2135c1dcc534-kube-api-access-t9mmq\") pod \"node-exporter-x29k4\" (UID: \"3b0a9fac-7aa5-4758-9831-2135c1dcc534\") " pod="openshift-monitoring/node-exporter-x29k4" Jul 28 17:23:55.428250 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:55.428223 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3d43e446-eb2c-4dbf-8358-3d41c4120e6a-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-wlzdr\" (UID: \"3d43e446-eb2c-4dbf-8358-3d41c4120e6a\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-wlzdr" Jul 28 17:23:55.428557 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:55.428256 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3b0a9fac-7aa5-4758-9831-2135c1dcc534-metrics-client-ca\") pod \"node-exporter-x29k4\" (UID: \"3b0a9fac-7aa5-4758-9831-2135c1dcc534\") " pod="openshift-monitoring/node-exporter-x29k4" Jul 28 17:23:55.428557 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:55.428276 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3b0a9fac-7aa5-4758-9831-2135c1dcc534-node-exporter-accelerators-collector-config\") pod \"node-exporter-x29k4\" (UID: \"3b0a9fac-7aa5-4758-9831-2135c1dcc534\") " pod="openshift-monitoring/node-exporter-x29k4" Jul 28 17:23:55.428557 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:55.428303 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c4063b0e-9185-4cbd-9739-1cbff5b3e338-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-zj5sc\" (UID: \"c4063b0e-9185-4cbd-9739-1cbff5b3e338\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-zj5sc" Jul 28 17:23:55.428557 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:55.428465 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/3d43e446-eb2c-4dbf-8358-3d41c4120e6a-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-wlzdr\" (UID: \"3d43e446-eb2c-4dbf-8358-3d41c4120e6a\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-wlzdr" Jul 28 17:23:55.428557 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:55.428516 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bzht5\" (UniqueName: \"kubernetes.io/projected/3d43e446-eb2c-4dbf-8358-3d41c4120e6a-kube-api-access-bzht5\") pod \"kube-state-metrics-56d9f944b4-wlzdr\" (UID: \"3d43e446-eb2c-4dbf-8358-3d41c4120e6a\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-wlzdr" Jul 28 17:23:55.428557 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:55.428543 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l4wd4\" (UniqueName: \"kubernetes.io/projected/c4063b0e-9185-4cbd-9739-1cbff5b3e338-kube-api-access-l4wd4\") pod \"openshift-state-metrics-b8f49f5c6-zj5sc\" (UID: \"c4063b0e-9185-4cbd-9739-1cbff5b3e338\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-zj5sc" Jul 28 17:23:55.428846 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:55.428568 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3d43e446-eb2c-4dbf-8358-3d41c4120e6a-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-wlzdr\" (UID: \"3d43e446-eb2c-4dbf-8358-3d41c4120e6a\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-wlzdr" Jul 28 17:23:55.428846 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:55.428590 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3b0a9fac-7aa5-4758-9831-2135c1dcc534-node-exporter-textfile\") pod \"node-exporter-x29k4\" (UID: \"3b0a9fac-7aa5-4758-9831-2135c1dcc534\") " pod="openshift-monitoring/node-exporter-x29k4" Jul 28 17:23:55.428846 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:55.428623 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3b0a9fac-7aa5-4758-9831-2135c1dcc534-root\") pod \"node-exporter-x29k4\" (UID: \"3b0a9fac-7aa5-4758-9831-2135c1dcc534\") " pod="openshift-monitoring/node-exporter-x29k4" Jul 28 17:23:55.428846 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:55.428646 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3b0a9fac-7aa5-4758-9831-2135c1dcc534-node-exporter-wtmp\") pod \"node-exporter-x29k4\" (UID: \"3b0a9fac-7aa5-4758-9831-2135c1dcc534\") " pod="openshift-monitoring/node-exporter-x29k4" Jul 28 17:23:55.428846 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:55.428670 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3b0a9fac-7aa5-4758-9831-2135c1dcc534-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-x29k4\" (UID: \"3b0a9fac-7aa5-4758-9831-2135c1dcc534\") " pod="openshift-monitoring/node-exporter-x29k4" Jul 28 17:23:55.428846 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:55.428694 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3b0a9fac-7aa5-4758-9831-2135c1dcc534-node-exporter-tls\") pod \"node-exporter-x29k4\" (UID: \"3b0a9fac-7aa5-4758-9831-2135c1dcc534\") " pod="openshift-monitoring/node-exporter-x29k4" Jul 28 17:23:55.428846 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:55.428722 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3d43e446-eb2c-4dbf-8358-3d41c4120e6a-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-wlzdr\" (UID: \"3d43e446-eb2c-4dbf-8358-3d41c4120e6a\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-wlzdr" Jul 28 17:23:55.429201 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:55.429023 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3b0a9fac-7aa5-4758-9831-2135c1dcc534-node-exporter-accelerators-collector-config\") pod \"node-exporter-x29k4\" (UID: \"3b0a9fac-7aa5-4758-9831-2135c1dcc534\") " pod="openshift-monitoring/node-exporter-x29k4" Jul 28 17:23:55.429201 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:55.429079 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/3d43e446-eb2c-4dbf-8358-3d41c4120e6a-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-wlzdr\" (UID: \"3d43e446-eb2c-4dbf-8358-3d41c4120e6a\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-wlzdr" Jul 28 17:23:55.429201 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:55.429102 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3b0a9fac-7aa5-4758-9831-2135c1dcc534-metrics-client-ca\") pod \"node-exporter-x29k4\" (UID: \"3b0a9fac-7aa5-4758-9831-2135c1dcc534\") " pod="openshift-monitoring/node-exporter-x29k4" Jul 28 17:23:55.429368 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:55.429215 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3b0a9fac-7aa5-4758-9831-2135c1dcc534-node-exporter-wtmp\") pod \"node-exporter-x29k4\" (UID: \"3b0a9fac-7aa5-4758-9831-2135c1dcc534\") " pod="openshift-monitoring/node-exporter-x29k4" Jul 28 17:23:55.429368 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:23:55.429230 2576 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 28 17:23:55.429368 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:55.429273 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3b0a9fac-7aa5-4758-9831-2135c1dcc534-root\") pod \"node-exporter-x29k4\" (UID: \"3b0a9fac-7aa5-4758-9831-2135c1dcc534\") " pod="openshift-monitoring/node-exporter-x29k4" Jul 28 17:23:55.429368 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:55.429296 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c4063b0e-9185-4cbd-9739-1cbff5b3e338-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-zj5sc\" (UID: \"c4063b0e-9185-4cbd-9739-1cbff5b3e338\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-zj5sc" Jul 28 17:23:55.429368 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:23:55.429304 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b0a9fac-7aa5-4758-9831-2135c1dcc534-node-exporter-tls podName:3b0a9fac-7aa5-4758-9831-2135c1dcc534 nodeName:}" failed. No retries permitted until 2026-07-28 17:23:55.929283881 +0000 UTC m=+72.281637225 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/3b0a9fac-7aa5-4758-9831-2135c1dcc534-node-exporter-tls") pod "node-exporter-x29k4" (UID: "3b0a9fac-7aa5-4758-9831-2135c1dcc534") : secret "node-exporter-tls" not found Jul 28 17:23:55.429607 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:55.429459 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/3d43e446-eb2c-4dbf-8358-3d41c4120e6a-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-wlzdr\" (UID: \"3d43e446-eb2c-4dbf-8358-3d41c4120e6a\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-wlzdr" Jul 28 17:23:55.429665 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:55.429652 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3b0a9fac-7aa5-4758-9831-2135c1dcc534-node-exporter-textfile\") pod \"node-exporter-x29k4\" (UID: \"3b0a9fac-7aa5-4758-9831-2135c1dcc534\") " pod="openshift-monitoring/node-exporter-x29k4" Jul 28 17:23:55.429949 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:55.429912 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3d43e446-eb2c-4dbf-8358-3d41c4120e6a-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-wlzdr\" (UID: \"3d43e446-eb2c-4dbf-8358-3d41c4120e6a\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-wlzdr" Jul 28 17:23:55.430970 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:55.430927 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c4063b0e-9185-4cbd-9739-1cbff5b3e338-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-zj5sc\" (UID: \"c4063b0e-9185-4cbd-9739-1cbff5b3e338\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-zj5sc" Jul 28 17:23:55.431487 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:55.431463 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3d43e446-eb2c-4dbf-8358-3d41c4120e6a-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-wlzdr\" (UID: \"3d43e446-eb2c-4dbf-8358-3d41c4120e6a\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-wlzdr" Jul 28 17:23:55.431628 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:55.431609 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3b0a9fac-7aa5-4758-9831-2135c1dcc534-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-x29k4\" (UID: \"3b0a9fac-7aa5-4758-9831-2135c1dcc534\") " pod="openshift-monitoring/node-exporter-x29k4" Jul 28 17:23:55.431938 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:55.431919 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3d43e446-eb2c-4dbf-8358-3d41c4120e6a-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-wlzdr\" (UID: \"3d43e446-eb2c-4dbf-8358-3d41c4120e6a\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-wlzdr" Jul 28 17:23:55.432009 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:55.431979 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c4063b0e-9185-4cbd-9739-1cbff5b3e338-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-zj5sc\" (UID: \"c4063b0e-9185-4cbd-9739-1cbff5b3e338\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-zj5sc" Jul 28 17:23:55.451329 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:55.451299 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9mmq\" (UniqueName: \"kubernetes.io/projected/3b0a9fac-7aa5-4758-9831-2135c1dcc534-kube-api-access-t9mmq\") pod \"node-exporter-x29k4\" (UID: \"3b0a9fac-7aa5-4758-9831-2135c1dcc534\") " pod="openshift-monitoring/node-exporter-x29k4" Jul 28 17:23:55.451469 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:55.451454 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bzht5\" (UniqueName: \"kubernetes.io/projected/3d43e446-eb2c-4dbf-8358-3d41c4120e6a-kube-api-access-bzht5\") pod \"kube-state-metrics-56d9f944b4-wlzdr\" (UID: \"3d43e446-eb2c-4dbf-8358-3d41c4120e6a\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-wlzdr" Jul 28 17:23:55.453193 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:55.453172 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l4wd4\" (UniqueName: \"kubernetes.io/projected/c4063b0e-9185-4cbd-9739-1cbff5b3e338-kube-api-access-l4wd4\") pod \"openshift-state-metrics-b8f49f5c6-zj5sc\" (UID: \"c4063b0e-9185-4cbd-9739-1cbff5b3e338\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-zj5sc" Jul 28 17:23:55.517310 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:55.517226 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-zj5sc" Jul 28 17:23:55.556372 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:55.556341 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-wlzdr" Jul 28 17:23:55.933071 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:55.933041 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3b0a9fac-7aa5-4758-9831-2135c1dcc534-node-exporter-tls\") pod \"node-exporter-x29k4\" (UID: \"3b0a9fac-7aa5-4758-9831-2135c1dcc534\") " pod="openshift-monitoring/node-exporter-x29k4" Jul 28 17:23:55.936167 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:55.936106 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3b0a9fac-7aa5-4758-9831-2135c1dcc534-node-exporter-tls\") pod \"node-exporter-x29k4\" (UID: \"3b0a9fac-7aa5-4758-9831-2135c1dcc534\") " pod="openshift-monitoring/node-exporter-x29k4" Jul 28 17:23:56.063163 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:56.063137 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-zj5sc"] Jul 28 17:23:56.067237 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:23:56.067203 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4063b0e_9185_4cbd_9739_1cbff5b3e338.slice/crio-ce7a7a9e059854a39bdd93821c3dd6fc5d0a3e943ddca5823487eed94a78e12d WatchSource:0}: Error finding container ce7a7a9e059854a39bdd93821c3dd6fc5d0a3e943ddca5823487eed94a78e12d: Status 404 returned error can't find the container with id ce7a7a9e059854a39bdd93821c3dd6fc5d0a3e943ddca5823487eed94a78e12d Jul 28 17:23:56.081284 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:56.081248 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-wlzdr"] Jul 28 17:23:56.086290 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:23:56.086260 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d43e446_eb2c_4dbf_8358_3d41c4120e6a.slice/crio-a7378a3b7ab74f32b2443959558eae5163eb41ea4e968083dd5018366d70b0d9 WatchSource:0}: Error finding container a7378a3b7ab74f32b2443959558eae5163eb41ea4e968083dd5018366d70b0d9: Status 404 returned error can't find the container with id a7378a3b7ab74f32b2443959558eae5163eb41ea4e968083dd5018366d70b0d9 Jul 28 17:23:56.181293 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:56.181225 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-x29k4" Jul 28 17:23:56.192003 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:23:56.191971 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b0a9fac_7aa5_4758_9831_2135c1dcc534.slice/crio-e9c7392e1bc0bd97285153415f0d10ed6de16629bba07147b94eebd4f36cfcfe WatchSource:0}: Error finding container e9c7392e1bc0bd97285153415f0d10ed6de16629bba07147b94eebd4f36cfcfe: Status 404 returned error can't find the container with id e9c7392e1bc0bd97285153415f0d10ed6de16629bba07147b94eebd4f36cfcfe Jul 28 17:23:56.333353 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:56.333322 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 28 17:23:56.336888 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:56.336868 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 28 17:23:56.339543 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:56.339504 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 28 17:23:56.339667 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:56.339552 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 28 17:23:56.339667 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:56.339598 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 28 17:23:56.339837 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:56.339818 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 28 17:23:56.339955 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:56.339833 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-7kvhh\"" Jul 28 17:23:56.339955 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:56.339822 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 28 17:23:56.339955 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:56.339909 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 28 17:23:56.339955 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:56.339897 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 28 17:23:56.340192 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:56.340134 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 28 17:23:56.340350 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:56.340335 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 28 17:23:56.360820 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:56.360795 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 28 17:23:56.435685 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:56.435595 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/93f66a6f-1eea-4d42-b60b-9c8a56e71170-config-volume\") pod \"alertmanager-main-0\" (UID: \"93f66a6f-1eea-4d42-b60b-9c8a56e71170\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 17:23:56.435685 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:56.435628 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/93f66a6f-1eea-4d42-b60b-9c8a56e71170-config-out\") pod \"alertmanager-main-0\" (UID: \"93f66a6f-1eea-4d42-b60b-9c8a56e71170\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 17:23:56.435685 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:56.435654 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/93f66a6f-1eea-4d42-b60b-9c8a56e71170-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"93f66a6f-1eea-4d42-b60b-9c8a56e71170\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 17:23:56.435685 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:56.435670 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/93f66a6f-1eea-4d42-b60b-9c8a56e71170-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"93f66a6f-1eea-4d42-b60b-9c8a56e71170\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 17:23:56.435960 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:56.435733 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/93f66a6f-1eea-4d42-b60b-9c8a56e71170-tls-assets\") pod \"alertmanager-main-0\" (UID: \"93f66a6f-1eea-4d42-b60b-9c8a56e71170\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 17:23:56.435960 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:56.435753 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/93f66a6f-1eea-4d42-b60b-9c8a56e71170-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"93f66a6f-1eea-4d42-b60b-9c8a56e71170\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 17:23:56.435960 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:56.435770 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/93f66a6f-1eea-4d42-b60b-9c8a56e71170-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"93f66a6f-1eea-4d42-b60b-9c8a56e71170\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 17:23:56.435960 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:56.435789 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/93f66a6f-1eea-4d42-b60b-9c8a56e71170-web-config\") pod \"alertmanager-main-0\" (UID: \"93f66a6f-1eea-4d42-b60b-9c8a56e71170\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 17:23:56.435960 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:56.435811 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/93f66a6f-1eea-4d42-b60b-9c8a56e71170-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"93f66a6f-1eea-4d42-b60b-9c8a56e71170\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 17:23:56.435960 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:56.435834 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/93f66a6f-1eea-4d42-b60b-9c8a56e71170-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"93f66a6f-1eea-4d42-b60b-9c8a56e71170\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 17:23:56.435960 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:56.435861 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/93f66a6f-1eea-4d42-b60b-9c8a56e71170-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"93f66a6f-1eea-4d42-b60b-9c8a56e71170\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 17:23:56.435960 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:56.435882 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/93f66a6f-1eea-4d42-b60b-9c8a56e71170-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"93f66a6f-1eea-4d42-b60b-9c8a56e71170\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 17:23:56.435960 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:56.435903 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sqs5f\" (UniqueName: \"kubernetes.io/projected/93f66a6f-1eea-4d42-b60b-9c8a56e71170-kube-api-access-sqs5f\") pod \"alertmanager-main-0\" (UID: \"93f66a6f-1eea-4d42-b60b-9c8a56e71170\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 17:23:56.537076 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:56.537043 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/93f66a6f-1eea-4d42-b60b-9c8a56e71170-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"93f66a6f-1eea-4d42-b60b-9c8a56e71170\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 17:23:56.537076 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:56.537076 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/93f66a6f-1eea-4d42-b60b-9c8a56e71170-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"93f66a6f-1eea-4d42-b60b-9c8a56e71170\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 17:23:56.537310 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:56.537092 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/93f66a6f-1eea-4d42-b60b-9c8a56e71170-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"93f66a6f-1eea-4d42-b60b-9c8a56e71170\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 17:23:56.537310 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:56.537243 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/93f66a6f-1eea-4d42-b60b-9c8a56e71170-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"93f66a6f-1eea-4d42-b60b-9c8a56e71170\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 17:23:56.537310 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:56.537286 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sqs5f\" (UniqueName: \"kubernetes.io/projected/93f66a6f-1eea-4d42-b60b-9c8a56e71170-kube-api-access-sqs5f\") pod \"alertmanager-main-0\" (UID: \"93f66a6f-1eea-4d42-b60b-9c8a56e71170\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 17:23:56.537458 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:56.537321 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/93f66a6f-1eea-4d42-b60b-9c8a56e71170-config-volume\") pod \"alertmanager-main-0\" (UID: \"93f66a6f-1eea-4d42-b60b-9c8a56e71170\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 17:23:56.537458 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:56.537344 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/93f66a6f-1eea-4d42-b60b-9c8a56e71170-config-out\") pod \"alertmanager-main-0\" (UID: \"93f66a6f-1eea-4d42-b60b-9c8a56e71170\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 17:23:56.537458 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:56.537413 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/93f66a6f-1eea-4d42-b60b-9c8a56e71170-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"93f66a6f-1eea-4d42-b60b-9c8a56e71170\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 17:23:56.537458 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:56.537438 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/93f66a6f-1eea-4d42-b60b-9c8a56e71170-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"93f66a6f-1eea-4d42-b60b-9c8a56e71170\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 17:23:56.537706 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:56.537480 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/93f66a6f-1eea-4d42-b60b-9c8a56e71170-tls-assets\") pod \"alertmanager-main-0\" (UID: \"93f66a6f-1eea-4d42-b60b-9c8a56e71170\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 17:23:56.537706 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:56.537522 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/93f66a6f-1eea-4d42-b60b-9c8a56e71170-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"93f66a6f-1eea-4d42-b60b-9c8a56e71170\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 17:23:56.537706 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:56.537545 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/93f66a6f-1eea-4d42-b60b-9c8a56e71170-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"93f66a6f-1eea-4d42-b60b-9c8a56e71170\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 17:23:56.537706 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:56.537579 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/93f66a6f-1eea-4d42-b60b-9c8a56e71170-web-config\") pod \"alertmanager-main-0\" (UID: \"93f66a6f-1eea-4d42-b60b-9c8a56e71170\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 17:23:56.539055 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:56.538336 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/93f66a6f-1eea-4d42-b60b-9c8a56e71170-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"93f66a6f-1eea-4d42-b60b-9c8a56e71170\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 17:23:56.539055 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:23:56.538833 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/93f66a6f-1eea-4d42-b60b-9c8a56e71170-alertmanager-trusted-ca-bundle podName:93f66a6f-1eea-4d42-b60b-9c8a56e71170 nodeName:}" failed. No retries permitted until 2026-07-28 17:23:57.03881203 +0000 UTC m=+73.391165361 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/93f66a6f-1eea-4d42-b60b-9c8a56e71170-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "93f66a6f-1eea-4d42-b60b-9c8a56e71170") : configmap references non-existent config key: ca-bundle.crt Jul 28 17:23:56.539055 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:56.539004 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/93f66a6f-1eea-4d42-b60b-9c8a56e71170-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"93f66a6f-1eea-4d42-b60b-9c8a56e71170\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 17:23:56.540490 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:56.540246 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/93f66a6f-1eea-4d42-b60b-9c8a56e71170-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"93f66a6f-1eea-4d42-b60b-9c8a56e71170\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 17:23:56.540490 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:56.540304 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/93f66a6f-1eea-4d42-b60b-9c8a56e71170-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"93f66a6f-1eea-4d42-b60b-9c8a56e71170\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 17:23:56.540490 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:56.540408 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/93f66a6f-1eea-4d42-b60b-9c8a56e71170-config-out\") pod \"alertmanager-main-0\" (UID: \"93f66a6f-1eea-4d42-b60b-9c8a56e71170\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 17:23:56.540490 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:56.540452 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/93f66a6f-1eea-4d42-b60b-9c8a56e71170-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"93f66a6f-1eea-4d42-b60b-9c8a56e71170\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 17:23:56.540774 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:56.540684 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/93f66a6f-1eea-4d42-b60b-9c8a56e71170-web-config\") pod \"alertmanager-main-0\" (UID: \"93f66a6f-1eea-4d42-b60b-9c8a56e71170\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 17:23:56.541159 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:56.541112 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/93f66a6f-1eea-4d42-b60b-9c8a56e71170-config-volume\") pod \"alertmanager-main-0\" (UID: \"93f66a6f-1eea-4d42-b60b-9c8a56e71170\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 17:23:56.541262 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:56.541198 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/93f66a6f-1eea-4d42-b60b-9c8a56e71170-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"93f66a6f-1eea-4d42-b60b-9c8a56e71170\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 17:23:56.541667 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:56.541649 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/93f66a6f-1eea-4d42-b60b-9c8a56e71170-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"93f66a6f-1eea-4d42-b60b-9c8a56e71170\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 17:23:56.541829 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:56.541810 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/93f66a6f-1eea-4d42-b60b-9c8a56e71170-tls-assets\") pod \"alertmanager-main-0\" (UID: \"93f66a6f-1eea-4d42-b60b-9c8a56e71170\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 17:23:56.545395 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:56.545374 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sqs5f\" (UniqueName: \"kubernetes.io/projected/93f66a6f-1eea-4d42-b60b-9c8a56e71170-kube-api-access-sqs5f\") pod \"alertmanager-main-0\" (UID: \"93f66a6f-1eea-4d42-b60b-9c8a56e71170\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 17:23:56.721435 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:56.721249 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-wlzdr" event={"ID":"3d43e446-eb2c-4dbf-8358-3d41c4120e6a","Type":"ContainerStarted","Data":"a7378a3b7ab74f32b2443959558eae5163eb41ea4e968083dd5018366d70b0d9"} Jul 28 17:23:56.724178 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:56.724011 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-zj5sc" event={"ID":"c4063b0e-9185-4cbd-9739-1cbff5b3e338","Type":"ContainerStarted","Data":"3fb7e5ff35e36c532718ff784d3584749fdc2a795af9f22412be696d5d741a0d"} Jul 28 17:23:56.724178 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:56.724072 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-zj5sc" event={"ID":"c4063b0e-9185-4cbd-9739-1cbff5b3e338","Type":"ContainerStarted","Data":"bb8f5af5d1cb431c53879eaab5d3bdb08367a34aad1cc105d85da8ed5d9c3b13"} Jul 28 17:23:56.724178 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:56.724100 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-zj5sc" event={"ID":"c4063b0e-9185-4cbd-9739-1cbff5b3e338","Type":"ContainerStarted","Data":"ce7a7a9e059854a39bdd93821c3dd6fc5d0a3e943ddca5823487eed94a78e12d"} Jul 28 17:23:56.726527 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:56.726502 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-j2hsj" event={"ID":"17d12e69-fb0c-4161-a579-875ca2f629a6","Type":"ContainerStarted","Data":"14ca1445534607ec57b1054171f064acc6ee7510ee45b74dfe1fe32195328757"} Jul 28 17:23:56.726650 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:56.726584 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-j2hsj" Jul 28 17:23:56.728305 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:56.728279 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-7krxm" event={"ID":"98a4008a-5635-4697-abdf-0dc44f6e3b87","Type":"ContainerStarted","Data":"416115cd7511d35446e678257391f9d5a83c40b1ffdcf8c594009da52ff49c83"} Jul 28 17:23:56.730030 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:56.730001 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-x29k4" event={"ID":"3b0a9fac-7aa5-4758-9831-2135c1dcc534","Type":"ContainerStarted","Data":"e9c7392e1bc0bd97285153415f0d10ed6de16629bba07147b94eebd4f36cfcfe"} Jul 28 17:23:56.743984 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:56.743916 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-j2hsj" podStartSLOduration=68.167294996 podStartE2EDuration="1m12.743902776s" totalImagesPullingTime="4.57660778s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:22:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:23:56.741604119 +0000 UTC m=+73.093957472" watchObservedRunningTime="2026-07-28 17:23:56.743902776 +0000 UTC m=+73.096256126" Jul 28 17:23:57.041035 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:57.040964 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/93f66a6f-1eea-4d42-b60b-9c8a56e71170-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"93f66a6f-1eea-4d42-b60b-9c8a56e71170\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 17:23:57.042014 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:57.041987 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/93f66a6f-1eea-4d42-b60b-9c8a56e71170-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"93f66a6f-1eea-4d42-b60b-9c8a56e71170\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 17:23:57.246296 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:57.246257 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 28 17:23:57.742497 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:57.742458 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-zj5sc" event={"ID":"c4063b0e-9185-4cbd-9739-1cbff5b3e338","Type":"ContainerStarted","Data":"69ca156ddcb8c1e8ccc47dcbf8566d5c25cb9a768cc2cd6afb9205b43971022a"} Jul 28 17:23:57.761927 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:57.761864 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-zj5sc" podStartSLOduration=1.321286379 podStartE2EDuration="2.76183914s" totalImagesPullingTime="1.440552761s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:23:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:23:57.761167056 +0000 UTC m=+74.113520407" watchObservedRunningTime="2026-07-28 17:23:57.76183914 +0000 UTC m=+74.114192492" Jul 28 17:23:57.762914 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:57.762855 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-7krxm" podStartSLOduration=69.206085236 podStartE2EDuration="1m13.762838936s" totalImagesPullingTime="4.5567537s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 17:22:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:23:56.755766668 +0000 UTC m=+73.108120019" watchObservedRunningTime="2026-07-28 17:23:57.762838936 +0000 UTC m=+74.115192287" Jul 28 17:23:57.805247 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:57.805225 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 28 17:23:57.808715 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:23:57.808680 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93f66a6f_1eea_4d42_b60b_9c8a56e71170.slice/crio-d0c9810f4246176e1fe5d03f5f09fa1c6614a13e9c4809925d6079153f13a240 WatchSource:0}: Error finding container d0c9810f4246176e1fe5d03f5f09fa1c6614a13e9c4809925d6079153f13a240: Status 404 returned error can't find the container with id d0c9810f4246176e1fe5d03f5f09fa1c6614a13e9c4809925d6079153f13a240 Jul 28 17:23:58.748451 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:58.748409 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"93f66a6f-1eea-4d42-b60b-9c8a56e71170","Type":"ContainerStarted","Data":"d0c9810f4246176e1fe5d03f5f09fa1c6614a13e9c4809925d6079153f13a240"} Jul 28 17:23:58.750203 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:58.750180 2576 generic.go:356] "Generic (PLEG): container finished" podID="3b0a9fac-7aa5-4758-9831-2135c1dcc534" containerID="80ac12d7e44da422b404f6e71800d08b04927d5d2e7ae0b5bfc748a3de699197" exitCode=0 Jul 28 17:23:58.750346 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:58.750274 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-x29k4" event={"ID":"3b0a9fac-7aa5-4758-9831-2135c1dcc534","Type":"ContainerDied","Data":"80ac12d7e44da422b404f6e71800d08b04927d5d2e7ae0b5bfc748a3de699197"} Jul 28 17:23:58.752657 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:58.752634 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-wlzdr" event={"ID":"3d43e446-eb2c-4dbf-8358-3d41c4120e6a","Type":"ContainerStarted","Data":"69c58a99c002fa1f3beca655f8aed068886220a22ed911657c1a1a2fef667b2c"} Jul 28 17:23:58.752760 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:58.752680 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-wlzdr" event={"ID":"3d43e446-eb2c-4dbf-8358-3d41c4120e6a","Type":"ContainerStarted","Data":"24b66c0bbd542c1521a4aeb2681ce6c28d7ce8fcadb06c3dd5fa9843a69058ef"} Jul 28 17:23:58.752760 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:58.752709 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-wlzdr" event={"ID":"3d43e446-eb2c-4dbf-8358-3d41c4120e6a","Type":"ContainerStarted","Data":"85956f7a4426993bc14dd6b027fdc50e5efe9937dcdd7bac2c4d4c14924f0fde"} Jul 28 17:23:58.798718 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:58.798657 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-wlzdr" podStartSLOduration=2.240044447 podStartE2EDuration="3.798637054s" totalImagesPullingTime="1.558592607s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:23:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:23:58.797374405 +0000 UTC m=+75.149727758" watchObservedRunningTime="2026-07-28 17:23:58.798637054 +0000 UTC m=+75.150990405" Jul 28 17:23:59.469654 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:59.469618 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-5f68856876-dgt2s"] Jul 28 17:23:59.472700 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:59.472680 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5f68856876-dgt2s" Jul 28 17:23:59.475515 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:59.475494 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-cijpfcm0j7mqu\"" Jul 28 17:23:59.475641 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:59.475569 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 28 17:23:59.476405 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:59.476379 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 28 17:23:59.476520 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:59.476424 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 28 17:23:59.476520 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:59.476470 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-sxbrc\"" Jul 28 17:23:59.476520 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:59.476480 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 28 17:23:59.488400 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:59.488380 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5f68856876-dgt2s"] Jul 28 17:23:59.562648 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:59.562618 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/38e47062-b657-40a4-9088-7bc23f0c7151-metrics-server-audit-profiles\") pod \"metrics-server-5f68856876-dgt2s\" (UID: \"38e47062-b657-40a4-9088-7bc23f0c7151\") " pod="openshift-monitoring/metrics-server-5f68856876-dgt2s" Jul 28 17:23:59.562648 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:59.562651 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/38e47062-b657-40a4-9088-7bc23f0c7151-audit-log\") pod \"metrics-server-5f68856876-dgt2s\" (UID: \"38e47062-b657-40a4-9088-7bc23f0c7151\") " pod="openshift-monitoring/metrics-server-5f68856876-dgt2s" Jul 28 17:23:59.562834 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:59.562669 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/38e47062-b657-40a4-9088-7bc23f0c7151-secret-metrics-server-client-certs\") pod \"metrics-server-5f68856876-dgt2s\" (UID: \"38e47062-b657-40a4-9088-7bc23f0c7151\") " pod="openshift-monitoring/metrics-server-5f68856876-dgt2s" Jul 28 17:23:59.562834 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:59.562745 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/38e47062-b657-40a4-9088-7bc23f0c7151-client-ca-bundle\") pod \"metrics-server-5f68856876-dgt2s\" (UID: \"38e47062-b657-40a4-9088-7bc23f0c7151\") " pod="openshift-monitoring/metrics-server-5f68856876-dgt2s" Jul 28 17:23:59.562834 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:59.562782 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/38e47062-b657-40a4-9088-7bc23f0c7151-secret-metrics-server-tls\") pod \"metrics-server-5f68856876-dgt2s\" (UID: \"38e47062-b657-40a4-9088-7bc23f0c7151\") " pod="openshift-monitoring/metrics-server-5f68856876-dgt2s" Jul 28 17:23:59.562834 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:59.562798 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4kqb\" (UniqueName: \"kubernetes.io/projected/38e47062-b657-40a4-9088-7bc23f0c7151-kube-api-access-h4kqb\") pod \"metrics-server-5f68856876-dgt2s\" (UID: \"38e47062-b657-40a4-9088-7bc23f0c7151\") " pod="openshift-monitoring/metrics-server-5f68856876-dgt2s" Jul 28 17:23:59.562957 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:59.562836 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38e47062-b657-40a4-9088-7bc23f0c7151-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5f68856876-dgt2s\" (UID: \"38e47062-b657-40a4-9088-7bc23f0c7151\") " pod="openshift-monitoring/metrics-server-5f68856876-dgt2s" Jul 28 17:23:59.663443 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:59.663407 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38e47062-b657-40a4-9088-7bc23f0c7151-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5f68856876-dgt2s\" (UID: \"38e47062-b657-40a4-9088-7bc23f0c7151\") " pod="openshift-monitoring/metrics-server-5f68856876-dgt2s" Jul 28 17:23:59.663575 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:59.663456 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/38e47062-b657-40a4-9088-7bc23f0c7151-metrics-server-audit-profiles\") pod \"metrics-server-5f68856876-dgt2s\" (UID: \"38e47062-b657-40a4-9088-7bc23f0c7151\") " pod="openshift-monitoring/metrics-server-5f68856876-dgt2s" Jul 28 17:23:59.663575 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:59.663474 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/38e47062-b657-40a4-9088-7bc23f0c7151-audit-log\") pod \"metrics-server-5f68856876-dgt2s\" (UID: \"38e47062-b657-40a4-9088-7bc23f0c7151\") " pod="openshift-monitoring/metrics-server-5f68856876-dgt2s" Jul 28 17:23:59.663575 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:59.663492 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/38e47062-b657-40a4-9088-7bc23f0c7151-secret-metrics-server-client-certs\") pod \"metrics-server-5f68856876-dgt2s\" (UID: \"38e47062-b657-40a4-9088-7bc23f0c7151\") " pod="openshift-monitoring/metrics-server-5f68856876-dgt2s" Jul 28 17:23:59.663575 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:59.663523 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/38e47062-b657-40a4-9088-7bc23f0c7151-client-ca-bundle\") pod \"metrics-server-5f68856876-dgt2s\" (UID: \"38e47062-b657-40a4-9088-7bc23f0c7151\") " pod="openshift-monitoring/metrics-server-5f68856876-dgt2s" Jul 28 17:23:59.663575 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:59.663543 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/38e47062-b657-40a4-9088-7bc23f0c7151-secret-metrics-server-tls\") pod \"metrics-server-5f68856876-dgt2s\" (UID: \"38e47062-b657-40a4-9088-7bc23f0c7151\") " pod="openshift-monitoring/metrics-server-5f68856876-dgt2s" Jul 28 17:23:59.663575 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:59.663557 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h4kqb\" (UniqueName: \"kubernetes.io/projected/38e47062-b657-40a4-9088-7bc23f0c7151-kube-api-access-h4kqb\") pod \"metrics-server-5f68856876-dgt2s\" (UID: \"38e47062-b657-40a4-9088-7bc23f0c7151\") " pod="openshift-monitoring/metrics-server-5f68856876-dgt2s" Jul 28 17:23:59.663883 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:59.663862 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/38e47062-b657-40a4-9088-7bc23f0c7151-audit-log\") pod \"metrics-server-5f68856876-dgt2s\" (UID: \"38e47062-b657-40a4-9088-7bc23f0c7151\") " pod="openshift-monitoring/metrics-server-5f68856876-dgt2s" Jul 28 17:23:59.664304 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:59.664280 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38e47062-b657-40a4-9088-7bc23f0c7151-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5f68856876-dgt2s\" (UID: \"38e47062-b657-40a4-9088-7bc23f0c7151\") " pod="openshift-monitoring/metrics-server-5f68856876-dgt2s" Jul 28 17:23:59.664773 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:59.664751 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/38e47062-b657-40a4-9088-7bc23f0c7151-metrics-server-audit-profiles\") pod \"metrics-server-5f68856876-dgt2s\" (UID: \"38e47062-b657-40a4-9088-7bc23f0c7151\") " pod="openshift-monitoring/metrics-server-5f68856876-dgt2s" Jul 28 17:23:59.666455 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:59.666431 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/38e47062-b657-40a4-9088-7bc23f0c7151-secret-metrics-server-tls\") pod \"metrics-server-5f68856876-dgt2s\" (UID: \"38e47062-b657-40a4-9088-7bc23f0c7151\") " pod="openshift-monitoring/metrics-server-5f68856876-dgt2s" Jul 28 17:23:59.666618 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:59.666599 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/38e47062-b657-40a4-9088-7bc23f0c7151-client-ca-bundle\") pod \"metrics-server-5f68856876-dgt2s\" (UID: \"38e47062-b657-40a4-9088-7bc23f0c7151\") " pod="openshift-monitoring/metrics-server-5f68856876-dgt2s" Jul 28 17:23:59.666656 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:59.666640 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/38e47062-b657-40a4-9088-7bc23f0c7151-secret-metrics-server-client-certs\") pod \"metrics-server-5f68856876-dgt2s\" (UID: \"38e47062-b657-40a4-9088-7bc23f0c7151\") " pod="openshift-monitoring/metrics-server-5f68856876-dgt2s" Jul 28 17:23:59.672494 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:59.672470 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4kqb\" (UniqueName: \"kubernetes.io/projected/38e47062-b657-40a4-9088-7bc23f0c7151-kube-api-access-h4kqb\") pod \"metrics-server-5f68856876-dgt2s\" (UID: \"38e47062-b657-40a4-9088-7bc23f0c7151\") " pod="openshift-monitoring/metrics-server-5f68856876-dgt2s" Jul 28 17:23:59.758400 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:59.758313 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-x29k4" event={"ID":"3b0a9fac-7aa5-4758-9831-2135c1dcc534","Type":"ContainerStarted","Data":"a23f8006f7138b27eeb2cda2a1c8a47837d21b5e64b74a3bfcf98888e9bc0e9a"} Jul 28 17:23:59.758400 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:59.758374 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-x29k4" event={"ID":"3b0a9fac-7aa5-4758-9831-2135c1dcc534","Type":"ContainerStarted","Data":"f9ef1c218d39c29702b30aa48726ad48dd4afbeae76f1f6aeed975f39dad60ea"} Jul 28 17:23:59.759943 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:59.759920 2576 generic.go:356] "Generic (PLEG): container finished" podID="93f66a6f-1eea-4d42-b60b-9c8a56e71170" containerID="e75d45501d72e4cedb49afb133798927e3c31f8f85d10a2737f395c524eef8d5" exitCode=0 Jul 28 17:23:59.760052 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:59.759977 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"93f66a6f-1eea-4d42-b60b-9c8a56e71170","Type":"ContainerDied","Data":"e75d45501d72e4cedb49afb133798927e3c31f8f85d10a2737f395c524eef8d5"} Jul 28 17:23:59.781334 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:59.781288 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-x29k4" podStartSLOduration=3.236409708 podStartE2EDuration="4.781272516s" totalImagesPullingTime="1.453056351s" totalInitContainerRuntime="91.806457ms" isStatefulPod=true podCreationTimestamp="2026-07-28 17:23:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:23:59.779673164 +0000 UTC m=+76.132026515" watchObservedRunningTime="2026-07-28 17:23:59.781272516 +0000 UTC m=+76.133625876" Jul 28 17:23:59.782443 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:59.782424 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5f68856876-dgt2s" Jul 28 17:23:59.914229 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:23:59.914207 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5f68856876-dgt2s"] Jul 28 17:23:59.916589 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:23:59.916558 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38e47062_b657_40a4_9088_7bc23f0c7151.slice/crio-c888181be9fb1d79d48c9c337e7e8d0969fe9f7e73df30bf837e40c5bb12481e WatchSource:0}: Error finding container c888181be9fb1d79d48c9c337e7e8d0969fe9f7e73df30bf837e40c5bb12481e: Status 404 returned error can't find the container with id c888181be9fb1d79d48c9c337e7e8d0969fe9f7e73df30bf837e40c5bb12481e Jul 28 17:24:00.005550 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:24:00.005519 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-sslwd"] Jul 28 17:24:00.010011 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:24:00.009948 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-sslwd" Jul 28 17:24:00.012285 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:24:00.012267 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 28 17:24:00.012433 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:24:00.012417 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-nz9v9\"" Jul 28 17:24:00.018572 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:24:00.018551 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-sslwd"] Jul 28 17:24:00.066231 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:24:00.066198 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lwpg8\" (UniqueName: \"kubernetes.io/projected/7f8c4c27-65a5-41b8-8516-50196ef8dc12-kube-api-access-lwpg8\") pod \"monitoring-plugin-68b7fc9574-sslwd\" (UID: \"7f8c4c27-65a5-41b8-8516-50196ef8dc12\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-sslwd" Jul 28 17:24:00.066231 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:24:00.066232 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7f8c4c27-65a5-41b8-8516-50196ef8dc12-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-sslwd\" (UID: \"7f8c4c27-65a5-41b8-8516-50196ef8dc12\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-sslwd" Jul 28 17:24:00.167484 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:24:00.167450 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lwpg8\" (UniqueName: \"kubernetes.io/projected/7f8c4c27-65a5-41b8-8516-50196ef8dc12-kube-api-access-lwpg8\") pod \"monitoring-plugin-68b7fc9574-sslwd\" (UID: \"7f8c4c27-65a5-41b8-8516-50196ef8dc12\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-sslwd" Jul 28 17:24:00.167673 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:24:00.167491 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7f8c4c27-65a5-41b8-8516-50196ef8dc12-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-sslwd\" (UID: \"7f8c4c27-65a5-41b8-8516-50196ef8dc12\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-sslwd" Jul 28 17:24:00.167673 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:24:00.167607 2576 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jul 28 17:24:00.167785 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:24:00.167675 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f8c4c27-65a5-41b8-8516-50196ef8dc12-monitoring-plugin-cert podName:7f8c4c27-65a5-41b8-8516-50196ef8dc12 nodeName:}" failed. No retries permitted until 2026-07-28 17:24:00.667652653 +0000 UTC m=+77.020005984 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/7f8c4c27-65a5-41b8-8516-50196ef8dc12-monitoring-plugin-cert") pod "monitoring-plugin-68b7fc9574-sslwd" (UID: "7f8c4c27-65a5-41b8-8516-50196ef8dc12") : secret "monitoring-plugin-cert" not found Jul 28 17:24:00.175950 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:24:00.175922 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lwpg8\" (UniqueName: \"kubernetes.io/projected/7f8c4c27-65a5-41b8-8516-50196ef8dc12-kube-api-access-lwpg8\") pod \"monitoring-plugin-68b7fc9574-sslwd\" (UID: \"7f8c4c27-65a5-41b8-8516-50196ef8dc12\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-sslwd" Jul 28 17:24:00.673048 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:24:00.673012 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7f8c4c27-65a5-41b8-8516-50196ef8dc12-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-sslwd\" (UID: \"7f8c4c27-65a5-41b8-8516-50196ef8dc12\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-sslwd" Jul 28 17:24:00.676015 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:24:00.675987 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7f8c4c27-65a5-41b8-8516-50196ef8dc12-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-sslwd\" (UID: \"7f8c4c27-65a5-41b8-8516-50196ef8dc12\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-sslwd" Jul 28 17:24:00.769009 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:24:00.768962 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5f68856876-dgt2s" event={"ID":"38e47062-b657-40a4-9088-7bc23f0c7151","Type":"ContainerStarted","Data":"c888181be9fb1d79d48c9c337e7e8d0969fe9f7e73df30bf837e40c5bb12481e"} Jul 28 17:24:00.920237 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:24:00.920199 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-sslwd" Jul 28 17:24:01.098705 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:24:01.098672 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-sslwd"] Jul 28 17:24:01.370475 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:24:01.370407 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f8c4c27_65a5_41b8_8516_50196ef8dc12.slice/crio-bb96b930bbb13f0d930bb51b1055bdb41ca9321be29e2600bc9e1575838209d0 WatchSource:0}: Error finding container bb96b930bbb13f0d930bb51b1055bdb41ca9321be29e2600bc9e1575838209d0: Status 404 returned error can't find the container with id bb96b930bbb13f0d930bb51b1055bdb41ca9321be29e2600bc9e1575838209d0 Jul 28 17:24:01.531021 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:24:01.530985 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 28 17:24:01.535155 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:24:01.535110 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:24:01.539778 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:24:01.539732 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 28 17:24:01.539938 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:24:01.539791 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 28 17:24:01.540081 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:24:01.540055 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 28 17:24:01.540210 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:24:01.540109 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 28 17:24:01.540210 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:24:01.540056 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 28 17:24:01.540210 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:24:01.540171 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 28 17:24:01.540210 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:24:01.540195 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 28 17:24:01.540422 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:24:01.540137 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 28 17:24:01.540422 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:24:01.540055 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 28 17:24:01.540422 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:24:01.540344 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-pseesa2ce685\"" Jul 28 17:24:01.540538 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:24:01.540510 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 28 17:24:01.540596 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:24:01.540577 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 28 17:24:01.540636 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:24:01.540596 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 28 17:24:01.540787 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:24:01.540765 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 28 17:24:01.540787 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:24:01.540766 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-snn2h\"" Jul 28 17:24:01.545492 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:24:01.545471 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 28 17:24:01.558445 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:24:01.558415 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 28 17:24:01.651872 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:24:01.651846 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-786774f45-chdbb" Jul 28 17:24:01.683024 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:24:01.682995 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5f08643e-7ba6-4635-aee3-e0fb447f5fde-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"5f08643e-7ba6-4635-aee3-e0fb447f5fde\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:24:01.683024 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:24:01.683029 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5f08643e-7ba6-4635-aee3-e0fb447f5fde-web-config\") pod \"prometheus-k8s-0\" (UID: \"5f08643e-7ba6-4635-aee3-e0fb447f5fde\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:24:01.683269 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:24:01.683054 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c7nb2\" (UniqueName: \"kubernetes.io/projected/5f08643e-7ba6-4635-aee3-e0fb447f5fde-kube-api-access-c7nb2\") pod \"prometheus-k8s-0\" (UID: \"5f08643e-7ba6-4635-aee3-e0fb447f5fde\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:24:01.683269 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:24:01.683106 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5f08643e-7ba6-4635-aee3-e0fb447f5fde-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"5f08643e-7ba6-4635-aee3-e0fb447f5fde\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:24:01.683269 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:24:01.683179 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5f08643e-7ba6-4635-aee3-e0fb447f5fde-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"5f08643e-7ba6-4635-aee3-e0fb447f5fde\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:24:01.683269 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:24:01.683237 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f08643e-7ba6-4635-aee3-e0fb447f5fde-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5f08643e-7ba6-4635-aee3-e0fb447f5fde\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:24:01.683469 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:24:01.683273 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5f08643e-7ba6-4635-aee3-e0fb447f5fde-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"5f08643e-7ba6-4635-aee3-e0fb447f5fde\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:24:01.683469 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:24:01.683304 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/5f08643e-7ba6-4635-aee3-e0fb447f5fde-config\") pod \"prometheus-k8s-0\" (UID: \"5f08643e-7ba6-4635-aee3-e0fb447f5fde\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:24:01.683469 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:24:01.683331 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5f08643e-7ba6-4635-aee3-e0fb447f5fde-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"5f08643e-7ba6-4635-aee3-e0fb447f5fde\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:24:01.683469 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:24:01.683360 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5f08643e-7ba6-4635-aee3-e0fb447f5fde-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"5f08643e-7ba6-4635-aee3-e0fb447f5fde\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:24:01.683469 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:24:01.683387 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5f08643e-7ba6-4635-aee3-e0fb447f5fde-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"5f08643e-7ba6-4635-aee3-e0fb447f5fde\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:24:01.683469 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:24:01.683432 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f08643e-7ba6-4635-aee3-e0fb447f5fde-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5f08643e-7ba6-4635-aee3-e0fb447f5fde\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:24:01.683743 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:24:01.683468 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5f08643e-7ba6-4635-aee3-e0fb447f5fde-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"5f08643e-7ba6-4635-aee3-e0fb447f5fde\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:24:01.683743 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:24:01.683497 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5f08643e-7ba6-4635-aee3-e0fb447f5fde-config-out\") pod \"prometheus-k8s-0\" (UID: \"5f08643e-7ba6-4635-aee3-e0fb447f5fde\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:24:01.683743 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:24:01.683524 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5f08643e-7ba6-4635-aee3-e0fb447f5fde-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"5f08643e-7ba6-4635-aee3-e0fb447f5fde\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:24:01.683743 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:24:01.683548 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f08643e-7ba6-4635-aee3-e0fb447f5fde-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5f08643e-7ba6-4635-aee3-e0fb447f5fde\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:24:01.683743 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:24:01.683576 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5f08643e-7ba6-4635-aee3-e0fb447f5fde-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"5f08643e-7ba6-4635-aee3-e0fb447f5fde\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:24:01.683743 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:24:01.683605 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5f08643e-7ba6-4635-aee3-e0fb447f5fde-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"5f08643e-7ba6-4635-aee3-e0fb447f5fde\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:24:01.683743 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:24:01.683634 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5f08643e-7ba6-4635-aee3-e0fb447f5fde-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"5f08643e-7ba6-4635-aee3-e0fb447f5fde\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:24:01.683743 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:24:01.683677 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5f08643e-7ba6-4635-aee3-e0fb447f5fde-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"5f08643e-7ba6-4635-aee3-e0fb447f5fde\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:24:01.773517 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:24:01.773492 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-sslwd" event={"ID":"7f8c4c27-65a5-41b8-8516-50196ef8dc12","Type":"ContainerStarted","Data":"bb96b930bbb13f0d930bb51b1055bdb41ca9321be29e2600bc9e1575838209d0"} Jul 28 17:24:01.784383 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:24:01.784352 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5f08643e-7ba6-4635-aee3-e0fb447f5fde-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"5f08643e-7ba6-4635-aee3-e0fb447f5fde\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:24:01.784481 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:24:01.784400 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5f08643e-7ba6-4635-aee3-e0fb447f5fde-web-config\") pod \"prometheus-k8s-0\" (UID: \"5f08643e-7ba6-4635-aee3-e0fb447f5fde\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:24:01.784481 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:24:01.784433 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c7nb2\" (UniqueName: \"kubernetes.io/projected/5f08643e-7ba6-4635-aee3-e0fb447f5fde-kube-api-access-c7nb2\") pod \"prometheus-k8s-0\" (UID: \"5f08643e-7ba6-4635-aee3-e0fb447f5fde\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:24:01.786376 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:24:01.784626 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5f08643e-7ba6-4635-aee3-e0fb447f5fde-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"5f08643e-7ba6-4635-aee3-e0fb447f5fde\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:24:01.786376 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:24:01.784687 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5f08643e-7ba6-4635-aee3-e0fb447f5fde-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"5f08643e-7ba6-4635-aee3-e0fb447f5fde\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:24:01.786376 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:24:01.784722 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f08643e-7ba6-4635-aee3-e0fb447f5fde-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5f08643e-7ba6-4635-aee3-e0fb447f5fde\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:24:01.786376 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:24:01.784748 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5f08643e-7ba6-4635-aee3-e0fb447f5fde-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"5f08643e-7ba6-4635-aee3-e0fb447f5fde\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:24:01.786376 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:24:01.784775 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/5f08643e-7ba6-4635-aee3-e0fb447f5fde-config\") pod \"prometheus-k8s-0\" (UID: \"5f08643e-7ba6-4635-aee3-e0fb447f5fde\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:24:01.786376 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:24:01.784828 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5f08643e-7ba6-4635-aee3-e0fb447f5fde-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"5f08643e-7ba6-4635-aee3-e0fb447f5fde\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:24:01.786376 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:24:01.784880 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5f08643e-7ba6-4635-aee3-e0fb447f5fde-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"5f08643e-7ba6-4635-aee3-e0fb447f5fde\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:24:01.786376 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:24:01.784907 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5f08643e-7ba6-4635-aee3-e0fb447f5fde-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"5f08643e-7ba6-4635-aee3-e0fb447f5fde\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:24:01.786376 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:24:01.784932 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f08643e-7ba6-4635-aee3-e0fb447f5fde-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5f08643e-7ba6-4635-aee3-e0fb447f5fde\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:24:01.786376 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:24:01.784957 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5f08643e-7ba6-4635-aee3-e0fb447f5fde-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"5f08643e-7ba6-4635-aee3-e0fb447f5fde\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:24:01.786376 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:24:01.784982 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5f08643e-7ba6-4635-aee3-e0fb447f5fde-config-out\") pod \"prometheus-k8s-0\" (UID: \"5f08643e-7ba6-4635-aee3-e0fb447f5fde\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:24:01.786376 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:24:01.785005 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5f08643e-7ba6-4635-aee3-e0fb447f5fde-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"5f08643e-7ba6-4635-aee3-e0fb447f5fde\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:24:01.786376 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:24:01.785032 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f08643e-7ba6-4635-aee3-e0fb447f5fde-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5f08643e-7ba6-4635-aee3-e0fb447f5fde\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:24:01.786376 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:24:01.785077 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5f08643e-7ba6-4635-aee3-e0fb447f5fde-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"5f08643e-7ba6-4635-aee3-e0fb447f5fde\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:24:01.786376 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:24:01.785155 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5f08643e-7ba6-4635-aee3-e0fb447f5fde-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"5f08643e-7ba6-4635-aee3-e0fb447f5fde\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:24:01.786376 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:24:01.785188 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5f08643e-7ba6-4635-aee3-e0fb447f5fde-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"5f08643e-7ba6-4635-aee3-e0fb447f5fde\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:24:01.786376 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:24:01.785226 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5f08643e-7ba6-4635-aee3-e0fb447f5fde-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"5f08643e-7ba6-4635-aee3-e0fb447f5fde\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:24:01.787432 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:24:01.785362 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5f08643e-7ba6-4635-aee3-e0fb447f5fde-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"5f08643e-7ba6-4635-aee3-e0fb447f5fde\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:24:01.787432 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:24:01.786243 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f08643e-7ba6-4635-aee3-e0fb447f5fde-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5f08643e-7ba6-4635-aee3-e0fb447f5fde\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:24:01.787432 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:24:01.786398 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f08643e-7ba6-4635-aee3-e0fb447f5fde-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5f08643e-7ba6-4635-aee3-e0fb447f5fde\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:24:01.787432 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:24:01.786434 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5f08643e-7ba6-4635-aee3-e0fb447f5fde-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"5f08643e-7ba6-4635-aee3-e0fb447f5fde\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:24:01.787432 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:24:01.787098 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5f08643e-7ba6-4635-aee3-e0fb447f5fde-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"5f08643e-7ba6-4635-aee3-e0fb447f5fde\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:24:01.787754 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:24:01.787515 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5f08643e-7ba6-4635-aee3-e0fb447f5fde-web-config\") pod \"prometheus-k8s-0\" (UID: \"5f08643e-7ba6-4635-aee3-e0fb447f5fde\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:24:01.788557 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:24:01.788530 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5f08643e-7ba6-4635-aee3-e0fb447f5fde-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"5f08643e-7ba6-4635-aee3-e0fb447f5fde\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:24:01.788943 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:24:01.788922 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/5f08643e-7ba6-4635-aee3-e0fb447f5fde-config\") pod \"prometheus-k8s-0\" (UID: \"5f08643e-7ba6-4635-aee3-e0fb447f5fde\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:24:01.789538 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:24:01.789497 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5f08643e-7ba6-4635-aee3-e0fb447f5fde-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"5f08643e-7ba6-4635-aee3-e0fb447f5fde\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:24:01.791243 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:24:01.790320 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5f08643e-7ba6-4635-aee3-e0fb447f5fde-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"5f08643e-7ba6-4635-aee3-e0fb447f5fde\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:24:01.791243 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:24:01.790417 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f08643e-7ba6-4635-aee3-e0fb447f5fde-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5f08643e-7ba6-4635-aee3-e0fb447f5fde\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:24:01.791243 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:24:01.790742 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5f08643e-7ba6-4635-aee3-e0fb447f5fde-config-out\") pod \"prometheus-k8s-0\" (UID: \"5f08643e-7ba6-4635-aee3-e0fb447f5fde\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:24:01.791243 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:24:01.790828 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5f08643e-7ba6-4635-aee3-e0fb447f5fde-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"5f08643e-7ba6-4635-aee3-e0fb447f5fde\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:24:01.791243 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:24:01.790833 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5f08643e-7ba6-4635-aee3-e0fb447f5fde-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"5f08643e-7ba6-4635-aee3-e0fb447f5fde\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:24:01.791243 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:24:01.790848 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5f08643e-7ba6-4635-aee3-e0fb447f5fde-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"5f08643e-7ba6-4635-aee3-e0fb447f5fde\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:24:01.791487 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:24:01.791276 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5f08643e-7ba6-4635-aee3-e0fb447f5fde-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"5f08643e-7ba6-4635-aee3-e0fb447f5fde\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:24:01.791487 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:24:01.791393 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5f08643e-7ba6-4635-aee3-e0fb447f5fde-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"5f08643e-7ba6-4635-aee3-e0fb447f5fde\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:24:01.791770 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:24:01.791750 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5f08643e-7ba6-4635-aee3-e0fb447f5fde-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"5f08643e-7ba6-4635-aee3-e0fb447f5fde\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:24:01.792173 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:24:01.792152 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5f08643e-7ba6-4635-aee3-e0fb447f5fde-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"5f08643e-7ba6-4635-aee3-e0fb447f5fde\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:24:01.795266 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:24:01.795248 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c7nb2\" (UniqueName: \"kubernetes.io/projected/5f08643e-7ba6-4635-aee3-e0fb447f5fde-kube-api-access-c7nb2\") pod \"prometheus-k8s-0\" (UID: \"5f08643e-7ba6-4635-aee3-e0fb447f5fde\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:24:01.847949 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:24:01.847924 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:24:02.020700 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:24:02.018225 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 28 17:24:02.027173 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:24:02.027135 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f08643e_7ba6_4635_aee3_e0fb447f5fde.slice/crio-39f285a15e4505bf5f9b470baf433e816977dcc22d1e58e011c17dc33ed50386 WatchSource:0}: Error finding container 39f285a15e4505bf5f9b470baf433e816977dcc22d1e58e011c17dc33ed50386: Status 404 returned error can't find the container with id 39f285a15e4505bf5f9b470baf433e816977dcc22d1e58e011c17dc33ed50386 Jul 28 17:24:02.780407 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:24:02.780370 2576 generic.go:356] "Generic (PLEG): container finished" podID="5f08643e-7ba6-4635-aee3-e0fb447f5fde" containerID="799ce0c5e5b0f86bfcf9b8ace8576576899a333dc75434dc0f1fe9a26303d3f0" exitCode=0 Jul 28 17:24:02.780855 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:24:02.780457 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5f08643e-7ba6-4635-aee3-e0fb447f5fde","Type":"ContainerDied","Data":"799ce0c5e5b0f86bfcf9b8ace8576576899a333dc75434dc0f1fe9a26303d3f0"} Jul 28 17:24:02.780855 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:24:02.780547 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5f08643e-7ba6-4635-aee3-e0fb447f5fde","Type":"ContainerStarted","Data":"39f285a15e4505bf5f9b470baf433e816977dcc22d1e58e011c17dc33ed50386"} Jul 28 17:24:02.784685 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:24:02.784654 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"93f66a6f-1eea-4d42-b60b-9c8a56e71170","Type":"ContainerStarted","Data":"39276bbb47bf0d00aceff033542ec1058536160b1cbb859dea17a26feea708bd"} Jul 28 17:24:02.784824 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:24:02.784801 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"93f66a6f-1eea-4d42-b60b-9c8a56e71170","Type":"ContainerStarted","Data":"b08580efdfa7cf8537f9039d3ab2c5341ee1e22b2c780ac9f6ff711a5370ebdf"} Jul 28 17:24:02.784903 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:24:02.784854 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"93f66a6f-1eea-4d42-b60b-9c8a56e71170","Type":"ContainerStarted","Data":"cee2a0fbe0109244483c42d0c1f9afa5592b7dffa54e7519764ff3ab37e0aa03"} Jul 28 17:24:02.784903 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:24:02.784894 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"93f66a6f-1eea-4d42-b60b-9c8a56e71170","Type":"ContainerStarted","Data":"f3e8a1650aa6f32e555c2d0112af0b46ccc268b684a8767d49553b285156db55"} Jul 28 17:24:02.784993 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:24:02.784930 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"93f66a6f-1eea-4d42-b60b-9c8a56e71170","Type":"ContainerStarted","Data":"ba7fc3e7ddc428d291da1481fac043bac8805a336fde8e37966f60515ae49f89"} Jul 28 17:24:02.787161 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:24:02.787112 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5f68856876-dgt2s" event={"ID":"38e47062-b657-40a4-9088-7bc23f0c7151","Type":"ContainerStarted","Data":"507f436fcccbd9d08655eee97e36d74453c4a1db0ecee2f8fe2a3a47349419e5"} Jul 28 17:24:02.837959 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:24:02.837901 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-5f68856876-dgt2s" podStartSLOduration=1.998270644 podStartE2EDuration="3.837883665s" totalImagesPullingTime="1.839613021s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:23:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:24:02.835930957 +0000 UTC m=+79.188284308" watchObservedRunningTime="2026-07-28 17:24:02.837883665 +0000 UTC m=+79.190237014" Jul 28 17:24:03.796390 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:24:03.796337 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"93f66a6f-1eea-4d42-b60b-9c8a56e71170","Type":"ContainerStarted","Data":"e118d1bf7db6f42469a526ca48b3e5f3804b90bc9c1f4e68cf55a9bd0eefbb54"} Jul 28 17:24:03.798552 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:24:03.798519 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-sslwd" event={"ID":"7f8c4c27-65a5-41b8-8516-50196ef8dc12","Type":"ContainerStarted","Data":"bb2f049dfc564ae394a24e0a61489859e71412154796d6ad099b73c1ca97cbd1"} Jul 28 17:24:03.830232 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:24:03.830162 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.331723356 podStartE2EDuration="7.830139655s" totalImagesPullingTime="4.480605351s" totalInitContainerRuntime="17.810948ms" isStatefulPod=false podCreationTimestamp="2026-07-28 17:23:56 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:24:03.829362593 +0000 UTC m=+80.181715942" watchObservedRunningTime="2026-07-28 17:24:03.830139655 +0000 UTC m=+80.182493000" Jul 28 17:24:03.847096 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:24:03.847033 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-sslwd" podStartSLOduration=3.263902349 podStartE2EDuration="4.847009444s" totalImagesPullingTime="1.583107095s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:23:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:24:03.846886324 +0000 UTC m=+80.199239675" watchObservedRunningTime="2026-07-28 17:24:03.847009444 +0000 UTC m=+80.199362797" Jul 28 17:24:04.803872 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:24:04.803837 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-sslwd" Jul 28 17:24:04.810468 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:24:04.810440 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-sslwd" Jul 28 17:24:06.814716 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:24:06.814678 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5f08643e-7ba6-4635-aee3-e0fb447f5fde","Type":"ContainerStarted","Data":"b3e09ddfab6daad7cbd929dd755d165580a02b1bcb501d59eae2a76c37fdf26d"} Jul 28 17:24:06.815257 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:24:06.815225 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5f08643e-7ba6-4635-aee3-e0fb447f5fde","Type":"ContainerStarted","Data":"04d81aca8c617e3c85727de631e40b21f954091b36eb10fbd18248d47b401447"} Jul 28 17:24:08.825469 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:24:08.825434 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5f08643e-7ba6-4635-aee3-e0fb447f5fde","Type":"ContainerStarted","Data":"a99125f273b78cb2d002abb826412db9aab9b527053343dfe2540a8b203a8f7e"} Jul 28 17:24:08.825849 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:24:08.825499 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5f08643e-7ba6-4635-aee3-e0fb447f5fde","Type":"ContainerStarted","Data":"ba5d71411f49f75533fea9c300377b40069f547474e3c3706a9aec767f0d4188"} Jul 28 17:24:08.825849 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:24:08.825529 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5f08643e-7ba6-4635-aee3-e0fb447f5fde","Type":"ContainerStarted","Data":"42d78edb91aca1e26c2b370b357f208c191194c545a746ab9032c04f452c17ab"} Jul 28 17:24:08.825849 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:24:08.825553 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5f08643e-7ba6-4635-aee3-e0fb447f5fde","Type":"ContainerStarted","Data":"497a74f3de62eded4164ce1c534fb15f9d9f2b4485b4c0c65733bc56275de714"} Jul 28 17:24:08.855004 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:24:08.854946 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.723400056 podStartE2EDuration="7.854922689s" totalImagesPullingTime="5.11003326s" totalInitContainerRuntime="21.489373ms" isStatefulPod=false podCreationTimestamp="2026-07-28 17:24:01 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:24:08.853242901 +0000 UTC m=+85.205596252" watchObservedRunningTime="2026-07-28 17:24:08.854922689 +0000 UTC m=+85.207276044" Jul 28 17:24:11.849060 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:24:11.849013 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:24:19.783235 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:24:19.783200 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-5f68856876-dgt2s" Jul 28 17:24:19.783697 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:24:19.783296 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-5f68856876-dgt2s" Jul 28 17:24:27.747194 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:24:27.747166 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-j2hsj" Jul 28 17:24:39.787705 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:24:39.787676 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-5f68856876-dgt2s" Jul 28 17:24:39.791579 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:24:39.791553 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-5f68856876-dgt2s" Jul 28 17:25:01.849013 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:01.848965 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:25:01.868616 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:01.868589 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:25:02.040447 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:02.040414 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:25:15.598034 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:15.597995 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 28 17:25:16.075208 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:16.075152 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="93f66a6f-1eea-4d42-b60b-9c8a56e71170" containerName="alertmanager" containerID="cri-o://ba7fc3e7ddc428d291da1481fac043bac8805a336fde8e37966f60515ae49f89" gracePeriod=120 Jul 28 17:25:16.075417 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:16.075211 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="93f66a6f-1eea-4d42-b60b-9c8a56e71170" containerName="kube-rbac-proxy-metric" containerID="cri-o://39276bbb47bf0d00aceff033542ec1058536160b1cbb859dea17a26feea708bd" gracePeriod=120 Jul 28 17:25:16.075417 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:16.075247 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="93f66a6f-1eea-4d42-b60b-9c8a56e71170" containerName="prom-label-proxy" containerID="cri-o://e118d1bf7db6f42469a526ca48b3e5f3804b90bc9c1f4e68cf55a9bd0eefbb54" gracePeriod=120 Jul 28 17:25:16.075417 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:16.075269 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="93f66a6f-1eea-4d42-b60b-9c8a56e71170" containerName="config-reloader" containerID="cri-o://f3e8a1650aa6f32e555c2d0112af0b46ccc268b684a8767d49553b285156db55" gracePeriod=120 Jul 28 17:25:16.075417 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:16.075292 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="93f66a6f-1eea-4d42-b60b-9c8a56e71170" containerName="kube-rbac-proxy" containerID="cri-o://b08580efdfa7cf8537f9039d3ab2c5341ee1e22b2c780ac9f6ff711a5370ebdf" gracePeriod=120 Jul 28 17:25:16.075417 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:16.075217 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="93f66a6f-1eea-4d42-b60b-9c8a56e71170" containerName="kube-rbac-proxy-web" containerID="cri-o://cee2a0fbe0109244483c42d0c1f9afa5592b7dffa54e7519764ff3ab37e0aa03" gracePeriod=120 Jul 28 17:25:17.085090 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:17.085058 2576 generic.go:356] "Generic (PLEG): container finished" podID="93f66a6f-1eea-4d42-b60b-9c8a56e71170" containerID="e118d1bf7db6f42469a526ca48b3e5f3804b90bc9c1f4e68cf55a9bd0eefbb54" exitCode=0 Jul 28 17:25:17.085090 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:17.085082 2576 generic.go:356] "Generic (PLEG): container finished" podID="93f66a6f-1eea-4d42-b60b-9c8a56e71170" containerID="b08580efdfa7cf8537f9039d3ab2c5341ee1e22b2c780ac9f6ff711a5370ebdf" exitCode=0 Jul 28 17:25:17.085090 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:17.085088 2576 generic.go:356] "Generic (PLEG): container finished" podID="93f66a6f-1eea-4d42-b60b-9c8a56e71170" containerID="f3e8a1650aa6f32e555c2d0112af0b46ccc268b684a8767d49553b285156db55" exitCode=0 Jul 28 17:25:17.085090 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:17.085093 2576 generic.go:356] "Generic (PLEG): container finished" podID="93f66a6f-1eea-4d42-b60b-9c8a56e71170" containerID="ba7fc3e7ddc428d291da1481fac043bac8805a336fde8e37966f60515ae49f89" exitCode=0 Jul 28 17:25:17.085561 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:17.085142 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"93f66a6f-1eea-4d42-b60b-9c8a56e71170","Type":"ContainerDied","Data":"e118d1bf7db6f42469a526ca48b3e5f3804b90bc9c1f4e68cf55a9bd0eefbb54"} Jul 28 17:25:17.085561 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:17.085211 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"93f66a6f-1eea-4d42-b60b-9c8a56e71170","Type":"ContainerDied","Data":"b08580efdfa7cf8537f9039d3ab2c5341ee1e22b2c780ac9f6ff711a5370ebdf"} Jul 28 17:25:17.085561 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:17.085239 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"93f66a6f-1eea-4d42-b60b-9c8a56e71170","Type":"ContainerDied","Data":"f3e8a1650aa6f32e555c2d0112af0b46ccc268b684a8767d49553b285156db55"} Jul 28 17:25:17.085561 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:17.085265 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"93f66a6f-1eea-4d42-b60b-9c8a56e71170","Type":"ContainerDied","Data":"ba7fc3e7ddc428d291da1481fac043bac8805a336fde8e37966f60515ae49f89"} Jul 28 17:25:17.316244 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:17.316217 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 28 17:25:17.434498 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:17.434468 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/93f66a6f-1eea-4d42-b60b-9c8a56e71170-tls-assets\") pod \"93f66a6f-1eea-4d42-b60b-9c8a56e71170\" (UID: \"93f66a6f-1eea-4d42-b60b-9c8a56e71170\") " Jul 28 17:25:17.434660 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:17.434522 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/93f66a6f-1eea-4d42-b60b-9c8a56e71170-secret-alertmanager-kube-rbac-proxy-web\") pod \"93f66a6f-1eea-4d42-b60b-9c8a56e71170\" (UID: \"93f66a6f-1eea-4d42-b60b-9c8a56e71170\") " Jul 28 17:25:17.434660 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:17.434549 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/93f66a6f-1eea-4d42-b60b-9c8a56e71170-secret-alertmanager-main-tls\") pod \"93f66a6f-1eea-4d42-b60b-9c8a56e71170\" (UID: \"93f66a6f-1eea-4d42-b60b-9c8a56e71170\") " Jul 28 17:25:17.434796 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:17.434588 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/93f66a6f-1eea-4d42-b60b-9c8a56e71170-config-volume\") pod \"93f66a6f-1eea-4d42-b60b-9c8a56e71170\" (UID: \"93f66a6f-1eea-4d42-b60b-9c8a56e71170\") " Jul 28 17:25:17.434796 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:17.434748 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/93f66a6f-1eea-4d42-b60b-9c8a56e71170-cluster-tls-config\") pod \"93f66a6f-1eea-4d42-b60b-9c8a56e71170\" (UID: \"93f66a6f-1eea-4d42-b60b-9c8a56e71170\") " Jul 28 17:25:17.434796 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:17.434773 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/93f66a6f-1eea-4d42-b60b-9c8a56e71170-metrics-client-ca\") pod \"93f66a6f-1eea-4d42-b60b-9c8a56e71170\" (UID: \"93f66a6f-1eea-4d42-b60b-9c8a56e71170\") " Jul 28 17:25:17.434951 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:17.434800 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/93f66a6f-1eea-4d42-b60b-9c8a56e71170-alertmanager-main-db\") pod \"93f66a6f-1eea-4d42-b60b-9c8a56e71170\" (UID: \"93f66a6f-1eea-4d42-b60b-9c8a56e71170\") " Jul 28 17:25:17.434951 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:17.434832 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/93f66a6f-1eea-4d42-b60b-9c8a56e71170-secret-alertmanager-kube-rbac-proxy-metric\") pod \"93f66a6f-1eea-4d42-b60b-9c8a56e71170\" (UID: \"93f66a6f-1eea-4d42-b60b-9c8a56e71170\") " Jul 28 17:25:17.434951 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:17.434872 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/93f66a6f-1eea-4d42-b60b-9c8a56e71170-config-out\") pod \"93f66a6f-1eea-4d42-b60b-9c8a56e71170\" (UID: \"93f66a6f-1eea-4d42-b60b-9c8a56e71170\") " Jul 28 17:25:17.434951 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:17.434907 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/93f66a6f-1eea-4d42-b60b-9c8a56e71170-secret-alertmanager-kube-rbac-proxy\") pod \"93f66a6f-1eea-4d42-b60b-9c8a56e71170\" (UID: \"93f66a6f-1eea-4d42-b60b-9c8a56e71170\") " Jul 28 17:25:17.434951 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:17.434934 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sqs5f\" (UniqueName: \"kubernetes.io/projected/93f66a6f-1eea-4d42-b60b-9c8a56e71170-kube-api-access-sqs5f\") pod \"93f66a6f-1eea-4d42-b60b-9c8a56e71170\" (UID: \"93f66a6f-1eea-4d42-b60b-9c8a56e71170\") " Jul 28 17:25:17.435298 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:17.434968 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/93f66a6f-1eea-4d42-b60b-9c8a56e71170-alertmanager-trusted-ca-bundle\") pod \"93f66a6f-1eea-4d42-b60b-9c8a56e71170\" (UID: \"93f66a6f-1eea-4d42-b60b-9c8a56e71170\") " Jul 28 17:25:17.435298 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:17.435000 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/93f66a6f-1eea-4d42-b60b-9c8a56e71170-web-config\") pod \"93f66a6f-1eea-4d42-b60b-9c8a56e71170\" (UID: \"93f66a6f-1eea-4d42-b60b-9c8a56e71170\") " Jul 28 17:25:17.435298 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:17.435096 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/93f66a6f-1eea-4d42-b60b-9c8a56e71170-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "93f66a6f-1eea-4d42-b60b-9c8a56e71170" (UID: "93f66a6f-1eea-4d42-b60b-9c8a56e71170"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 17:25:17.435455 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:17.435306 2576 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/93f66a6f-1eea-4d42-b60b-9c8a56e71170-metrics-client-ca\") on node \"ip-10-0-129-31.ec2.internal\" DevicePath \"\"" Jul 28 17:25:17.435645 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:17.435621 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93f66a6f-1eea-4d42-b60b-9c8a56e71170-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "93f66a6f-1eea-4d42-b60b-9c8a56e71170" (UID: "93f66a6f-1eea-4d42-b60b-9c8a56e71170"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 17:25:17.436284 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:17.436254 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/93f66a6f-1eea-4d42-b60b-9c8a56e71170-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "93f66a6f-1eea-4d42-b60b-9c8a56e71170" (UID: "93f66a6f-1eea-4d42-b60b-9c8a56e71170"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 17:25:17.438234 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:17.438048 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/93f66a6f-1eea-4d42-b60b-9c8a56e71170-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "93f66a6f-1eea-4d42-b60b-9c8a56e71170" (UID: "93f66a6f-1eea-4d42-b60b-9c8a56e71170"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 17:25:17.438234 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:17.438112 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93f66a6f-1eea-4d42-b60b-9c8a56e71170-config-out" (OuterVolumeSpecName: "config-out") pod "93f66a6f-1eea-4d42-b60b-9c8a56e71170" (UID: "93f66a6f-1eea-4d42-b60b-9c8a56e71170"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 17:25:17.438234 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:17.438141 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93f66a6f-1eea-4d42-b60b-9c8a56e71170-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "93f66a6f-1eea-4d42-b60b-9c8a56e71170" (UID: "93f66a6f-1eea-4d42-b60b-9c8a56e71170"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 17:25:17.438234 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:17.438166 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/93f66a6f-1eea-4d42-b60b-9c8a56e71170-config-volume" (OuterVolumeSpecName: "config-volume") pod "93f66a6f-1eea-4d42-b60b-9c8a56e71170" (UID: "93f66a6f-1eea-4d42-b60b-9c8a56e71170"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 17:25:17.438234 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:17.438201 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/93f66a6f-1eea-4d42-b60b-9c8a56e71170-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "93f66a6f-1eea-4d42-b60b-9c8a56e71170" (UID: "93f66a6f-1eea-4d42-b60b-9c8a56e71170"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 17:25:17.438234 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:17.438216 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/93f66a6f-1eea-4d42-b60b-9c8a56e71170-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "93f66a6f-1eea-4d42-b60b-9c8a56e71170" (UID: "93f66a6f-1eea-4d42-b60b-9c8a56e71170"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 17:25:17.438932 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:17.438901 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/93f66a6f-1eea-4d42-b60b-9c8a56e71170-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "93f66a6f-1eea-4d42-b60b-9c8a56e71170" (UID: "93f66a6f-1eea-4d42-b60b-9c8a56e71170"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 17:25:17.439451 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:17.439428 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93f66a6f-1eea-4d42-b60b-9c8a56e71170-kube-api-access-sqs5f" (OuterVolumeSpecName: "kube-api-access-sqs5f") pod "93f66a6f-1eea-4d42-b60b-9c8a56e71170" (UID: "93f66a6f-1eea-4d42-b60b-9c8a56e71170"). InnerVolumeSpecName "kube-api-access-sqs5f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 17:25:17.443168 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:17.443143 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/93f66a6f-1eea-4d42-b60b-9c8a56e71170-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "93f66a6f-1eea-4d42-b60b-9c8a56e71170" (UID: "93f66a6f-1eea-4d42-b60b-9c8a56e71170"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 17:25:17.449109 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:17.449089 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/93f66a6f-1eea-4d42-b60b-9c8a56e71170-web-config" (OuterVolumeSpecName: "web-config") pod "93f66a6f-1eea-4d42-b60b-9c8a56e71170" (UID: "93f66a6f-1eea-4d42-b60b-9c8a56e71170"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 17:25:17.535964 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:17.535918 2576 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/93f66a6f-1eea-4d42-b60b-9c8a56e71170-cluster-tls-config\") on node \"ip-10-0-129-31.ec2.internal\" DevicePath \"\"" Jul 28 17:25:17.535964 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:17.535959 2576 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/93f66a6f-1eea-4d42-b60b-9c8a56e71170-alertmanager-main-db\") on node \"ip-10-0-129-31.ec2.internal\" DevicePath \"\"" Jul 28 17:25:17.535964 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:17.535971 2576 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/93f66a6f-1eea-4d42-b60b-9c8a56e71170-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-129-31.ec2.internal\" DevicePath \"\"" Jul 28 17:25:17.535964 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:17.535981 2576 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/93f66a6f-1eea-4d42-b60b-9c8a56e71170-config-out\") on node \"ip-10-0-129-31.ec2.internal\" DevicePath \"\"" Jul 28 17:25:17.536232 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:17.535990 2576 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/93f66a6f-1eea-4d42-b60b-9c8a56e71170-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-129-31.ec2.internal\" DevicePath \"\"" Jul 28 17:25:17.536232 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:17.535998 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sqs5f\" (UniqueName: \"kubernetes.io/projected/93f66a6f-1eea-4d42-b60b-9c8a56e71170-kube-api-access-sqs5f\") on node \"ip-10-0-129-31.ec2.internal\" DevicePath \"\"" Jul 28 17:25:17.536232 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:17.536008 2576 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/93f66a6f-1eea-4d42-b60b-9c8a56e71170-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-129-31.ec2.internal\" DevicePath \"\"" Jul 28 17:25:17.536232 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:17.536018 2576 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/93f66a6f-1eea-4d42-b60b-9c8a56e71170-web-config\") on node \"ip-10-0-129-31.ec2.internal\" DevicePath \"\"" Jul 28 17:25:17.536232 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:17.536027 2576 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/93f66a6f-1eea-4d42-b60b-9c8a56e71170-tls-assets\") on node \"ip-10-0-129-31.ec2.internal\" DevicePath \"\"" Jul 28 17:25:17.536232 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:17.536034 2576 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/93f66a6f-1eea-4d42-b60b-9c8a56e71170-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-129-31.ec2.internal\" DevicePath \"\"" Jul 28 17:25:17.536232 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:17.536044 2576 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/93f66a6f-1eea-4d42-b60b-9c8a56e71170-secret-alertmanager-main-tls\") on node \"ip-10-0-129-31.ec2.internal\" DevicePath \"\"" Jul 28 17:25:17.536232 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:17.536053 2576 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/93f66a6f-1eea-4d42-b60b-9c8a56e71170-config-volume\") on node \"ip-10-0-129-31.ec2.internal\" DevicePath \"\"" Jul 28 17:25:18.092085 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:18.092050 2576 generic.go:356] "Generic (PLEG): container finished" podID="93f66a6f-1eea-4d42-b60b-9c8a56e71170" containerID="39276bbb47bf0d00aceff033542ec1058536160b1cbb859dea17a26feea708bd" exitCode=0 Jul 28 17:25:18.092085 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:18.092075 2576 generic.go:356] "Generic (PLEG): container finished" podID="93f66a6f-1eea-4d42-b60b-9c8a56e71170" containerID="cee2a0fbe0109244483c42d0c1f9afa5592b7dffa54e7519764ff3ab37e0aa03" exitCode=0 Jul 28 17:25:18.092642 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:18.092143 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 28 17:25:18.092642 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:18.092151 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"93f66a6f-1eea-4d42-b60b-9c8a56e71170","Type":"ContainerDied","Data":"39276bbb47bf0d00aceff033542ec1058536160b1cbb859dea17a26feea708bd"} Jul 28 17:25:18.092642 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:18.092241 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"93f66a6f-1eea-4d42-b60b-9c8a56e71170","Type":"ContainerDied","Data":"cee2a0fbe0109244483c42d0c1f9afa5592b7dffa54e7519764ff3ab37e0aa03"} Jul 28 17:25:18.092642 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:18.092298 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"93f66a6f-1eea-4d42-b60b-9c8a56e71170","Type":"ContainerDied","Data":"d0c9810f4246176e1fe5d03f5f09fa1c6614a13e9c4809925d6079153f13a240"} Jul 28 17:25:18.092642 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:18.092302 2576 scope.go:117] "RemoveContainer" containerID="e118d1bf7db6f42469a526ca48b3e5f3804b90bc9c1f4e68cf55a9bd0eefbb54" Jul 28 17:25:18.100411 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:18.100391 2576 scope.go:117] "RemoveContainer" containerID="39276bbb47bf0d00aceff033542ec1058536160b1cbb859dea17a26feea708bd" Jul 28 17:25:18.107278 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:18.107261 2576 scope.go:117] "RemoveContainer" containerID="b08580efdfa7cf8537f9039d3ab2c5341ee1e22b2c780ac9f6ff711a5370ebdf" Jul 28 17:25:18.113910 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:18.113885 2576 scope.go:117] "RemoveContainer" containerID="cee2a0fbe0109244483c42d0c1f9afa5592b7dffa54e7519764ff3ab37e0aa03" Jul 28 17:25:18.116690 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:18.116670 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 28 17:25:18.121134 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:18.121096 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 28 17:25:18.122852 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:18.122827 2576 scope.go:117] "RemoveContainer" containerID="f3e8a1650aa6f32e555c2d0112af0b46ccc268b684a8767d49553b285156db55" Jul 28 17:25:18.129679 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:18.129661 2576 scope.go:117] "RemoveContainer" containerID="ba7fc3e7ddc428d291da1481fac043bac8805a336fde8e37966f60515ae49f89" Jul 28 17:25:18.136533 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:18.136507 2576 scope.go:117] "RemoveContainer" containerID="e75d45501d72e4cedb49afb133798927e3c31f8f85d10a2737f395c524eef8d5" Jul 28 17:25:18.145277 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:18.145258 2576 scope.go:117] "RemoveContainer" containerID="e118d1bf7db6f42469a526ca48b3e5f3804b90bc9c1f4e68cf55a9bd0eefbb54" Jul 28 17:25:18.145567 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:25:18.145544 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e118d1bf7db6f42469a526ca48b3e5f3804b90bc9c1f4e68cf55a9bd0eefbb54\": container with ID starting with e118d1bf7db6f42469a526ca48b3e5f3804b90bc9c1f4e68cf55a9bd0eefbb54 not found: ID does not exist" containerID="e118d1bf7db6f42469a526ca48b3e5f3804b90bc9c1f4e68cf55a9bd0eefbb54" Jul 28 17:25:18.145650 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:18.145574 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e118d1bf7db6f42469a526ca48b3e5f3804b90bc9c1f4e68cf55a9bd0eefbb54"} err="failed to get container status \"e118d1bf7db6f42469a526ca48b3e5f3804b90bc9c1f4e68cf55a9bd0eefbb54\": rpc error: code = NotFound desc = could not find container \"e118d1bf7db6f42469a526ca48b3e5f3804b90bc9c1f4e68cf55a9bd0eefbb54\": container with ID starting with e118d1bf7db6f42469a526ca48b3e5f3804b90bc9c1f4e68cf55a9bd0eefbb54 not found: ID does not exist" Jul 28 17:25:18.145650 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:18.145613 2576 scope.go:117] "RemoveContainer" containerID="39276bbb47bf0d00aceff033542ec1058536160b1cbb859dea17a26feea708bd" Jul 28 17:25:18.145848 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:25:18.145830 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"39276bbb47bf0d00aceff033542ec1058536160b1cbb859dea17a26feea708bd\": container with ID starting with 39276bbb47bf0d00aceff033542ec1058536160b1cbb859dea17a26feea708bd not found: ID does not exist" containerID="39276bbb47bf0d00aceff033542ec1058536160b1cbb859dea17a26feea708bd" Jul 28 17:25:18.145892 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:18.145855 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"39276bbb47bf0d00aceff033542ec1058536160b1cbb859dea17a26feea708bd"} err="failed to get container status \"39276bbb47bf0d00aceff033542ec1058536160b1cbb859dea17a26feea708bd\": rpc error: code = NotFound desc = could not find container \"39276bbb47bf0d00aceff033542ec1058536160b1cbb859dea17a26feea708bd\": container with ID starting with 39276bbb47bf0d00aceff033542ec1058536160b1cbb859dea17a26feea708bd not found: ID does not exist" Jul 28 17:25:18.145892 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:18.145879 2576 scope.go:117] "RemoveContainer" containerID="b08580efdfa7cf8537f9039d3ab2c5341ee1e22b2c780ac9f6ff711a5370ebdf" Jul 28 17:25:18.146103 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:25:18.146085 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b08580efdfa7cf8537f9039d3ab2c5341ee1e22b2c780ac9f6ff711a5370ebdf\": container with ID starting with b08580efdfa7cf8537f9039d3ab2c5341ee1e22b2c780ac9f6ff711a5370ebdf not found: ID does not exist" containerID="b08580efdfa7cf8537f9039d3ab2c5341ee1e22b2c780ac9f6ff711a5370ebdf" Jul 28 17:25:18.146165 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:18.146107 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b08580efdfa7cf8537f9039d3ab2c5341ee1e22b2c780ac9f6ff711a5370ebdf"} err="failed to get container status \"b08580efdfa7cf8537f9039d3ab2c5341ee1e22b2c780ac9f6ff711a5370ebdf\": rpc error: code = NotFound desc = could not find container \"b08580efdfa7cf8537f9039d3ab2c5341ee1e22b2c780ac9f6ff711a5370ebdf\": container with ID starting with b08580efdfa7cf8537f9039d3ab2c5341ee1e22b2c780ac9f6ff711a5370ebdf not found: ID does not exist" Jul 28 17:25:18.146165 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:18.146145 2576 scope.go:117] "RemoveContainer" containerID="cee2a0fbe0109244483c42d0c1f9afa5592b7dffa54e7519764ff3ab37e0aa03" Jul 28 17:25:18.146396 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:25:18.146381 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cee2a0fbe0109244483c42d0c1f9afa5592b7dffa54e7519764ff3ab37e0aa03\": container with ID starting with cee2a0fbe0109244483c42d0c1f9afa5592b7dffa54e7519764ff3ab37e0aa03 not found: ID does not exist" containerID="cee2a0fbe0109244483c42d0c1f9afa5592b7dffa54e7519764ff3ab37e0aa03" Jul 28 17:25:18.146442 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:18.146401 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cee2a0fbe0109244483c42d0c1f9afa5592b7dffa54e7519764ff3ab37e0aa03"} err="failed to get container status \"cee2a0fbe0109244483c42d0c1f9afa5592b7dffa54e7519764ff3ab37e0aa03\": rpc error: code = NotFound desc = could not find container \"cee2a0fbe0109244483c42d0c1f9afa5592b7dffa54e7519764ff3ab37e0aa03\": container with ID starting with cee2a0fbe0109244483c42d0c1f9afa5592b7dffa54e7519764ff3ab37e0aa03 not found: ID does not exist" Jul 28 17:25:18.146442 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:18.146415 2576 scope.go:117] "RemoveContainer" containerID="f3e8a1650aa6f32e555c2d0112af0b46ccc268b684a8767d49553b285156db55" Jul 28 17:25:18.146627 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:25:18.146612 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f3e8a1650aa6f32e555c2d0112af0b46ccc268b684a8767d49553b285156db55\": container with ID starting with f3e8a1650aa6f32e555c2d0112af0b46ccc268b684a8767d49553b285156db55 not found: ID does not exist" containerID="f3e8a1650aa6f32e555c2d0112af0b46ccc268b684a8767d49553b285156db55" Jul 28 17:25:18.146663 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:18.146632 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f3e8a1650aa6f32e555c2d0112af0b46ccc268b684a8767d49553b285156db55"} err="failed to get container status \"f3e8a1650aa6f32e555c2d0112af0b46ccc268b684a8767d49553b285156db55\": rpc error: code = NotFound desc = could not find container \"f3e8a1650aa6f32e555c2d0112af0b46ccc268b684a8767d49553b285156db55\": container with ID starting with f3e8a1650aa6f32e555c2d0112af0b46ccc268b684a8767d49553b285156db55 not found: ID does not exist" Jul 28 17:25:18.146663 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:18.146650 2576 scope.go:117] "RemoveContainer" containerID="ba7fc3e7ddc428d291da1481fac043bac8805a336fde8e37966f60515ae49f89" Jul 28 17:25:18.146863 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:25:18.146848 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ba7fc3e7ddc428d291da1481fac043bac8805a336fde8e37966f60515ae49f89\": container with ID starting with ba7fc3e7ddc428d291da1481fac043bac8805a336fde8e37966f60515ae49f89 not found: ID does not exist" containerID="ba7fc3e7ddc428d291da1481fac043bac8805a336fde8e37966f60515ae49f89" Jul 28 17:25:18.146900 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:18.146867 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba7fc3e7ddc428d291da1481fac043bac8805a336fde8e37966f60515ae49f89"} err="failed to get container status \"ba7fc3e7ddc428d291da1481fac043bac8805a336fde8e37966f60515ae49f89\": rpc error: code = NotFound desc = could not find container \"ba7fc3e7ddc428d291da1481fac043bac8805a336fde8e37966f60515ae49f89\": container with ID starting with ba7fc3e7ddc428d291da1481fac043bac8805a336fde8e37966f60515ae49f89 not found: ID does not exist" Jul 28 17:25:18.146900 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:18.146890 2576 scope.go:117] "RemoveContainer" containerID="e75d45501d72e4cedb49afb133798927e3c31f8f85d10a2737f395c524eef8d5" Jul 28 17:25:18.147169 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:25:18.147153 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e75d45501d72e4cedb49afb133798927e3c31f8f85d10a2737f395c524eef8d5\": container with ID starting with e75d45501d72e4cedb49afb133798927e3c31f8f85d10a2737f395c524eef8d5 not found: ID does not exist" containerID="e75d45501d72e4cedb49afb133798927e3c31f8f85d10a2737f395c524eef8d5" Jul 28 17:25:18.147210 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:18.147175 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e75d45501d72e4cedb49afb133798927e3c31f8f85d10a2737f395c524eef8d5"} err="failed to get container status \"e75d45501d72e4cedb49afb133798927e3c31f8f85d10a2737f395c524eef8d5\": rpc error: code = NotFound desc = could not find container \"e75d45501d72e4cedb49afb133798927e3c31f8f85d10a2737f395c524eef8d5\": container with ID starting with e75d45501d72e4cedb49afb133798927e3c31f8f85d10a2737f395c524eef8d5 not found: ID does not exist" Jul 28 17:25:18.147210 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:18.147192 2576 scope.go:117] "RemoveContainer" containerID="e118d1bf7db6f42469a526ca48b3e5f3804b90bc9c1f4e68cf55a9bd0eefbb54" Jul 28 17:25:18.147405 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:18.147388 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e118d1bf7db6f42469a526ca48b3e5f3804b90bc9c1f4e68cf55a9bd0eefbb54"} err="failed to get container status \"e118d1bf7db6f42469a526ca48b3e5f3804b90bc9c1f4e68cf55a9bd0eefbb54\": rpc error: code = NotFound desc = could not find container \"e118d1bf7db6f42469a526ca48b3e5f3804b90bc9c1f4e68cf55a9bd0eefbb54\": container with ID starting with e118d1bf7db6f42469a526ca48b3e5f3804b90bc9c1f4e68cf55a9bd0eefbb54 not found: ID does not exist" Jul 28 17:25:18.147449 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:18.147406 2576 scope.go:117] "RemoveContainer" containerID="39276bbb47bf0d00aceff033542ec1058536160b1cbb859dea17a26feea708bd" Jul 28 17:25:18.147618 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:18.147603 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"39276bbb47bf0d00aceff033542ec1058536160b1cbb859dea17a26feea708bd"} err="failed to get container status \"39276bbb47bf0d00aceff033542ec1058536160b1cbb859dea17a26feea708bd\": rpc error: code = NotFound desc = could not find container \"39276bbb47bf0d00aceff033542ec1058536160b1cbb859dea17a26feea708bd\": container with ID starting with 39276bbb47bf0d00aceff033542ec1058536160b1cbb859dea17a26feea708bd not found: ID does not exist" Jul 28 17:25:18.147662 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:18.147619 2576 scope.go:117] "RemoveContainer" containerID="b08580efdfa7cf8537f9039d3ab2c5341ee1e22b2c780ac9f6ff711a5370ebdf" Jul 28 17:25:18.147821 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:18.147807 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b08580efdfa7cf8537f9039d3ab2c5341ee1e22b2c780ac9f6ff711a5370ebdf"} err="failed to get container status \"b08580efdfa7cf8537f9039d3ab2c5341ee1e22b2c780ac9f6ff711a5370ebdf\": rpc error: code = NotFound desc = could not find container \"b08580efdfa7cf8537f9039d3ab2c5341ee1e22b2c780ac9f6ff711a5370ebdf\": container with ID starting with b08580efdfa7cf8537f9039d3ab2c5341ee1e22b2c780ac9f6ff711a5370ebdf not found: ID does not exist" Jul 28 17:25:18.147867 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:18.147821 2576 scope.go:117] "RemoveContainer" containerID="cee2a0fbe0109244483c42d0c1f9afa5592b7dffa54e7519764ff3ab37e0aa03" Jul 28 17:25:18.148034 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:18.148017 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cee2a0fbe0109244483c42d0c1f9afa5592b7dffa54e7519764ff3ab37e0aa03"} err="failed to get container status \"cee2a0fbe0109244483c42d0c1f9afa5592b7dffa54e7519764ff3ab37e0aa03\": rpc error: code = NotFound desc = could not find container \"cee2a0fbe0109244483c42d0c1f9afa5592b7dffa54e7519764ff3ab37e0aa03\": container with ID starting with cee2a0fbe0109244483c42d0c1f9afa5592b7dffa54e7519764ff3ab37e0aa03 not found: ID does not exist" Jul 28 17:25:18.148034 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:18.148033 2576 scope.go:117] "RemoveContainer" containerID="f3e8a1650aa6f32e555c2d0112af0b46ccc268b684a8767d49553b285156db55" Jul 28 17:25:18.148290 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:18.148270 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f3e8a1650aa6f32e555c2d0112af0b46ccc268b684a8767d49553b285156db55"} err="failed to get container status \"f3e8a1650aa6f32e555c2d0112af0b46ccc268b684a8767d49553b285156db55\": rpc error: code = NotFound desc = could not find container \"f3e8a1650aa6f32e555c2d0112af0b46ccc268b684a8767d49553b285156db55\": container with ID starting with f3e8a1650aa6f32e555c2d0112af0b46ccc268b684a8767d49553b285156db55 not found: ID does not exist" Jul 28 17:25:18.148344 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:18.148290 2576 scope.go:117] "RemoveContainer" containerID="ba7fc3e7ddc428d291da1481fac043bac8805a336fde8e37966f60515ae49f89" Jul 28 17:25:18.148502 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:18.148487 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba7fc3e7ddc428d291da1481fac043bac8805a336fde8e37966f60515ae49f89"} err="failed to get container status \"ba7fc3e7ddc428d291da1481fac043bac8805a336fde8e37966f60515ae49f89\": rpc error: code = NotFound desc = could not find container \"ba7fc3e7ddc428d291da1481fac043bac8805a336fde8e37966f60515ae49f89\": container with ID starting with ba7fc3e7ddc428d291da1481fac043bac8805a336fde8e37966f60515ae49f89 not found: ID does not exist" Jul 28 17:25:18.148546 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:18.148502 2576 scope.go:117] "RemoveContainer" containerID="e75d45501d72e4cedb49afb133798927e3c31f8f85d10a2737f395c524eef8d5" Jul 28 17:25:18.148712 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:18.148692 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e75d45501d72e4cedb49afb133798927e3c31f8f85d10a2737f395c524eef8d5"} err="failed to get container status \"e75d45501d72e4cedb49afb133798927e3c31f8f85d10a2737f395c524eef8d5\": rpc error: code = NotFound desc = could not find container \"e75d45501d72e4cedb49afb133798927e3c31f8f85d10a2737f395c524eef8d5\": container with ID starting with e75d45501d72e4cedb49afb133798927e3c31f8f85d10a2737f395c524eef8d5 not found: ID does not exist" Jul 28 17:25:18.242640 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:18.242605 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="93f66a6f-1eea-4d42-b60b-9c8a56e71170" path="/var/lib/kubelet/pods/93f66a6f-1eea-4d42-b60b-9c8a56e71170/volumes" Jul 28 17:25:20.049299 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:20.049265 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 28 17:25:20.049679 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:20.049584 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5f08643e-7ba6-4635-aee3-e0fb447f5fde" containerName="prometheus" containerID="cri-o://04d81aca8c617e3c85727de631e40b21f954091b36eb10fbd18248d47b401447" gracePeriod=600 Jul 28 17:25:20.049679 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:20.049612 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5f08643e-7ba6-4635-aee3-e0fb447f5fde" containerName="kube-rbac-proxy-web" containerID="cri-o://42d78edb91aca1e26c2b370b357f208c191194c545a746ab9032c04f452c17ab" gracePeriod=600 Jul 28 17:25:20.049679 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:20.049620 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5f08643e-7ba6-4635-aee3-e0fb447f5fde" containerName="kube-rbac-proxy-thanos" containerID="cri-o://a99125f273b78cb2d002abb826412db9aab9b527053343dfe2540a8b203a8f7e" gracePeriod=600 Jul 28 17:25:20.049679 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:20.049638 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5f08643e-7ba6-4635-aee3-e0fb447f5fde" containerName="kube-rbac-proxy" containerID="cri-o://ba5d71411f49f75533fea9c300377b40069f547474e3c3706a9aec767f0d4188" gracePeriod=600 Jul 28 17:25:20.049679 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:20.049592 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5f08643e-7ba6-4635-aee3-e0fb447f5fde" containerName="thanos-sidecar" containerID="cri-o://497a74f3de62eded4164ce1c534fb15f9d9f2b4485b4c0c65733bc56275de714" gracePeriod=600 Jul 28 17:25:20.049974 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:20.049648 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5f08643e-7ba6-4635-aee3-e0fb447f5fde" containerName="config-reloader" containerID="cri-o://b3e09ddfab6daad7cbd929dd755d165580a02b1bcb501d59eae2a76c37fdf26d" gracePeriod=600 Jul 28 17:25:20.284894 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:20.284870 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:25:20.361130 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:20.361040 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f08643e-7ba6-4635-aee3-e0fb447f5fde-configmap-serving-certs-ca-bundle\") pod \"5f08643e-7ba6-4635-aee3-e0fb447f5fde\" (UID: \"5f08643e-7ba6-4635-aee3-e0fb447f5fde\") " Jul 28 17:25:20.361130 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:20.361080 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5f08643e-7ba6-4635-aee3-e0fb447f5fde-secret-grpc-tls\") pod \"5f08643e-7ba6-4635-aee3-e0fb447f5fde\" (UID: \"5f08643e-7ba6-4635-aee3-e0fb447f5fde\") " Jul 28 17:25:20.361130 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:20.361108 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c7nb2\" (UniqueName: \"kubernetes.io/projected/5f08643e-7ba6-4635-aee3-e0fb447f5fde-kube-api-access-c7nb2\") pod \"5f08643e-7ba6-4635-aee3-e0fb447f5fde\" (UID: \"5f08643e-7ba6-4635-aee3-e0fb447f5fde\") " Jul 28 17:25:20.361387 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:20.361150 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5f08643e-7ba6-4635-aee3-e0fb447f5fde-secret-metrics-client-certs\") pod \"5f08643e-7ba6-4635-aee3-e0fb447f5fde\" (UID: \"5f08643e-7ba6-4635-aee3-e0fb447f5fde\") " Jul 28 17:25:20.361387 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:20.361186 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5f08643e-7ba6-4635-aee3-e0fb447f5fde-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"5f08643e-7ba6-4635-aee3-e0fb447f5fde\" (UID: \"5f08643e-7ba6-4635-aee3-e0fb447f5fde\") " Jul 28 17:25:20.361387 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:20.361214 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5f08643e-7ba6-4635-aee3-e0fb447f5fde-config-out\") pod \"5f08643e-7ba6-4635-aee3-e0fb447f5fde\" (UID: \"5f08643e-7ba6-4635-aee3-e0fb447f5fde\") " Jul 28 17:25:20.361387 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:20.361241 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5f08643e-7ba6-4635-aee3-e0fb447f5fde-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"5f08643e-7ba6-4635-aee3-e0fb447f5fde\" (UID: \"5f08643e-7ba6-4635-aee3-e0fb447f5fde\") " Jul 28 17:25:20.361387 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:20.361268 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5f08643e-7ba6-4635-aee3-e0fb447f5fde-thanos-prometheus-http-client-file\") pod \"5f08643e-7ba6-4635-aee3-e0fb447f5fde\" (UID: \"5f08643e-7ba6-4635-aee3-e0fb447f5fde\") " Jul 28 17:25:20.361387 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:20.361311 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f08643e-7ba6-4635-aee3-e0fb447f5fde-configmap-kubelet-serving-ca-bundle\") pod \"5f08643e-7ba6-4635-aee3-e0fb447f5fde\" (UID: \"5f08643e-7ba6-4635-aee3-e0fb447f5fde\") " Jul 28 17:25:20.361680 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:20.361392 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5f08643e-7ba6-4635-aee3-e0fb447f5fde-prometheus-k8s-db\") pod \"5f08643e-7ba6-4635-aee3-e0fb447f5fde\" (UID: \"5f08643e-7ba6-4635-aee3-e0fb447f5fde\") " Jul 28 17:25:20.361680 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:20.361431 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5f08643e-7ba6-4635-aee3-e0fb447f5fde-prometheus-k8s-rulefiles-0\") pod \"5f08643e-7ba6-4635-aee3-e0fb447f5fde\" (UID: \"5f08643e-7ba6-4635-aee3-e0fb447f5fde\") " Jul 28 17:25:20.361680 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:20.361477 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f08643e-7ba6-4635-aee3-e0fb447f5fde-prometheus-trusted-ca-bundle\") pod \"5f08643e-7ba6-4635-aee3-e0fb447f5fde\" (UID: \"5f08643e-7ba6-4635-aee3-e0fb447f5fde\") " Jul 28 17:25:20.361680 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:20.361490 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5f08643e-7ba6-4635-aee3-e0fb447f5fde-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "5f08643e-7ba6-4635-aee3-e0fb447f5fde" (UID: "5f08643e-7ba6-4635-aee3-e0fb447f5fde"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 17:25:20.361680 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:20.361505 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/5f08643e-7ba6-4635-aee3-e0fb447f5fde-config\") pod \"5f08643e-7ba6-4635-aee3-e0fb447f5fde\" (UID: \"5f08643e-7ba6-4635-aee3-e0fb447f5fde\") " Jul 28 17:25:20.361680 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:20.361589 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5f08643e-7ba6-4635-aee3-e0fb447f5fde-configmap-metrics-client-ca\") pod \"5f08643e-7ba6-4635-aee3-e0fb447f5fde\" (UID: \"5f08643e-7ba6-4635-aee3-e0fb447f5fde\") " Jul 28 17:25:20.361680 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:20.361615 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5f08643e-7ba6-4635-aee3-e0fb447f5fde-web-config\") pod \"5f08643e-7ba6-4635-aee3-e0fb447f5fde\" (UID: \"5f08643e-7ba6-4635-aee3-e0fb447f5fde\") " Jul 28 17:25:20.361680 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:20.361640 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5f08643e-7ba6-4635-aee3-e0fb447f5fde-secret-prometheus-k8s-tls\") pod \"5f08643e-7ba6-4635-aee3-e0fb447f5fde\" (UID: \"5f08643e-7ba6-4635-aee3-e0fb447f5fde\") " Jul 28 17:25:20.361680 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:20.361665 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5f08643e-7ba6-4635-aee3-e0fb447f5fde-secret-kube-rbac-proxy\") pod \"5f08643e-7ba6-4635-aee3-e0fb447f5fde\" (UID: \"5f08643e-7ba6-4635-aee3-e0fb447f5fde\") " Jul 28 17:25:20.362090 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:20.361690 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5f08643e-7ba6-4635-aee3-e0fb447f5fde-prometheus-k8s-rulefiles-2\") pod \"5f08643e-7ba6-4635-aee3-e0fb447f5fde\" (UID: \"5f08643e-7ba6-4635-aee3-e0fb447f5fde\") " Jul 28 17:25:20.362090 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:20.361722 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5f08643e-7ba6-4635-aee3-e0fb447f5fde-prometheus-k8s-rulefiles-1\") pod \"5f08643e-7ba6-4635-aee3-e0fb447f5fde\" (UID: \"5f08643e-7ba6-4635-aee3-e0fb447f5fde\") " Jul 28 17:25:20.362090 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:20.361753 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5f08643e-7ba6-4635-aee3-e0fb447f5fde-tls-assets\") pod \"5f08643e-7ba6-4635-aee3-e0fb447f5fde\" (UID: \"5f08643e-7ba6-4635-aee3-e0fb447f5fde\") " Jul 28 17:25:20.362276 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:20.362237 2576 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f08643e-7ba6-4635-aee3-e0fb447f5fde-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-129-31.ec2.internal\" DevicePath \"\"" Jul 28 17:25:20.362823 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:20.362795 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5f08643e-7ba6-4635-aee3-e0fb447f5fde-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "5f08643e-7ba6-4635-aee3-e0fb447f5fde" (UID: "5f08643e-7ba6-4635-aee3-e0fb447f5fde"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 17:25:20.363148 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:20.363109 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5f08643e-7ba6-4635-aee3-e0fb447f5fde-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "5f08643e-7ba6-4635-aee3-e0fb447f5fde" (UID: "5f08643e-7ba6-4635-aee3-e0fb447f5fde"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 17:25:20.363428 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:20.363400 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5f08643e-7ba6-4635-aee3-e0fb447f5fde-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "5f08643e-7ba6-4635-aee3-e0fb447f5fde" (UID: "5f08643e-7ba6-4635-aee3-e0fb447f5fde"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 17:25:20.364217 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:20.364181 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f08643e-7ba6-4635-aee3-e0fb447f5fde-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "5f08643e-7ba6-4635-aee3-e0fb447f5fde" (UID: "5f08643e-7ba6-4635-aee3-e0fb447f5fde"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 17:25:20.364401 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:20.364380 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5f08643e-7ba6-4635-aee3-e0fb447f5fde-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "5f08643e-7ba6-4635-aee3-e0fb447f5fde" (UID: "5f08643e-7ba6-4635-aee3-e0fb447f5fde"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 17:25:20.364622 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:20.364594 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5f08643e-7ba6-4635-aee3-e0fb447f5fde-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "5f08643e-7ba6-4635-aee3-e0fb447f5fde" (UID: "5f08643e-7ba6-4635-aee3-e0fb447f5fde"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 17:25:20.364848 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:20.364826 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5f08643e-7ba6-4635-aee3-e0fb447f5fde-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "5f08643e-7ba6-4635-aee3-e0fb447f5fde" (UID: "5f08643e-7ba6-4635-aee3-e0fb447f5fde"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 17:25:20.365754 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:20.365716 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f08643e-7ba6-4635-aee3-e0fb447f5fde-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "5f08643e-7ba6-4635-aee3-e0fb447f5fde" (UID: "5f08643e-7ba6-4635-aee3-e0fb447f5fde"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 17:25:20.365847 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:20.365821 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5f08643e-7ba6-4635-aee3-e0fb447f5fde-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "5f08643e-7ba6-4635-aee3-e0fb447f5fde" (UID: "5f08643e-7ba6-4635-aee3-e0fb447f5fde"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 17:25:20.365993 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:20.365930 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5f08643e-7ba6-4635-aee3-e0fb447f5fde-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "5f08643e-7ba6-4635-aee3-e0fb447f5fde" (UID: "5f08643e-7ba6-4635-aee3-e0fb447f5fde"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 17:25:20.366106 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:20.366065 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f08643e-7ba6-4635-aee3-e0fb447f5fde-kube-api-access-c7nb2" (OuterVolumeSpecName: "kube-api-access-c7nb2") pod "5f08643e-7ba6-4635-aee3-e0fb447f5fde" (UID: "5f08643e-7ba6-4635-aee3-e0fb447f5fde"). InnerVolumeSpecName "kube-api-access-c7nb2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 17:25:20.366323 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:20.366113 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5f08643e-7ba6-4635-aee3-e0fb447f5fde-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "5f08643e-7ba6-4635-aee3-e0fb447f5fde" (UID: "5f08643e-7ba6-4635-aee3-e0fb447f5fde"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 17:25:20.366323 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:20.366147 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5f08643e-7ba6-4635-aee3-e0fb447f5fde-config" (OuterVolumeSpecName: "config") pod "5f08643e-7ba6-4635-aee3-e0fb447f5fde" (UID: "5f08643e-7ba6-4635-aee3-e0fb447f5fde"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 17:25:20.366323 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:20.366187 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5f08643e-7ba6-4635-aee3-e0fb447f5fde-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "5f08643e-7ba6-4635-aee3-e0fb447f5fde" (UID: "5f08643e-7ba6-4635-aee3-e0fb447f5fde"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 17:25:20.366657 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:20.366623 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5f08643e-7ba6-4635-aee3-e0fb447f5fde-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "5f08643e-7ba6-4635-aee3-e0fb447f5fde" (UID: "5f08643e-7ba6-4635-aee3-e0fb447f5fde"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 17:25:20.367107 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:20.367078 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5f08643e-7ba6-4635-aee3-e0fb447f5fde-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "5f08643e-7ba6-4635-aee3-e0fb447f5fde" (UID: "5f08643e-7ba6-4635-aee3-e0fb447f5fde"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 17:25:20.367217 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:20.367148 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f08643e-7ba6-4635-aee3-e0fb447f5fde-config-out" (OuterVolumeSpecName: "config-out") pod "5f08643e-7ba6-4635-aee3-e0fb447f5fde" (UID: "5f08643e-7ba6-4635-aee3-e0fb447f5fde"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 17:25:20.367516 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:20.367495 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5f08643e-7ba6-4635-aee3-e0fb447f5fde-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "5f08643e-7ba6-4635-aee3-e0fb447f5fde" (UID: "5f08643e-7ba6-4635-aee3-e0fb447f5fde"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 17:25:20.375948 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:20.375918 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5f08643e-7ba6-4635-aee3-e0fb447f5fde-web-config" (OuterVolumeSpecName: "web-config") pod "5f08643e-7ba6-4635-aee3-e0fb447f5fde" (UID: "5f08643e-7ba6-4635-aee3-e0fb447f5fde"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 17:25:20.463429 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:20.463394 2576 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5f08643e-7ba6-4635-aee3-e0fb447f5fde-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-129-31.ec2.internal\" DevicePath \"\"" Jul 28 17:25:20.463429 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:20.463422 2576 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5f08643e-7ba6-4635-aee3-e0fb447f5fde-config-out\") on node \"ip-10-0-129-31.ec2.internal\" DevicePath \"\"" Jul 28 17:25:20.463429 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:20.463432 2576 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5f08643e-7ba6-4635-aee3-e0fb447f5fde-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-129-31.ec2.internal\" DevicePath \"\"" Jul 28 17:25:20.463649 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:20.463442 2576 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5f08643e-7ba6-4635-aee3-e0fb447f5fde-thanos-prometheus-http-client-file\") on node \"ip-10-0-129-31.ec2.internal\" DevicePath \"\"" Jul 28 17:25:20.463649 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:20.463451 2576 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f08643e-7ba6-4635-aee3-e0fb447f5fde-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-129-31.ec2.internal\" DevicePath \"\"" Jul 28 17:25:20.463649 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:20.463460 2576 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5f08643e-7ba6-4635-aee3-e0fb447f5fde-prometheus-k8s-db\") on node \"ip-10-0-129-31.ec2.internal\" DevicePath \"\"" Jul 28 17:25:20.463649 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:20.463469 2576 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5f08643e-7ba6-4635-aee3-e0fb447f5fde-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-129-31.ec2.internal\" DevicePath \"\"" Jul 28 17:25:20.463649 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:20.463477 2576 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f08643e-7ba6-4635-aee3-e0fb447f5fde-prometheus-trusted-ca-bundle\") on node \"ip-10-0-129-31.ec2.internal\" DevicePath \"\"" Jul 28 17:25:20.463649 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:20.463485 2576 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/5f08643e-7ba6-4635-aee3-e0fb447f5fde-config\") on node \"ip-10-0-129-31.ec2.internal\" DevicePath \"\"" Jul 28 17:25:20.463649 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:20.463493 2576 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5f08643e-7ba6-4635-aee3-e0fb447f5fde-configmap-metrics-client-ca\") on node \"ip-10-0-129-31.ec2.internal\" DevicePath \"\"" Jul 28 17:25:20.463649 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:20.463502 2576 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5f08643e-7ba6-4635-aee3-e0fb447f5fde-web-config\") on node \"ip-10-0-129-31.ec2.internal\" DevicePath \"\"" Jul 28 17:25:20.463649 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:20.463510 2576 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5f08643e-7ba6-4635-aee3-e0fb447f5fde-secret-prometheus-k8s-tls\") on node \"ip-10-0-129-31.ec2.internal\" DevicePath \"\"" Jul 28 17:25:20.463649 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:20.463518 2576 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5f08643e-7ba6-4635-aee3-e0fb447f5fde-secret-kube-rbac-proxy\") on node \"ip-10-0-129-31.ec2.internal\" DevicePath \"\"" Jul 28 17:25:20.463649 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:20.463525 2576 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5f08643e-7ba6-4635-aee3-e0fb447f5fde-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-129-31.ec2.internal\" DevicePath \"\"" Jul 28 17:25:20.463649 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:20.463534 2576 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5f08643e-7ba6-4635-aee3-e0fb447f5fde-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-129-31.ec2.internal\" DevicePath \"\"" Jul 28 17:25:20.463649 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:20.463542 2576 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5f08643e-7ba6-4635-aee3-e0fb447f5fde-tls-assets\") on node \"ip-10-0-129-31.ec2.internal\" DevicePath \"\"" Jul 28 17:25:20.463649 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:20.463549 2576 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5f08643e-7ba6-4635-aee3-e0fb447f5fde-secret-grpc-tls\") on node \"ip-10-0-129-31.ec2.internal\" DevicePath \"\"" Jul 28 17:25:20.463649 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:20.463556 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c7nb2\" (UniqueName: \"kubernetes.io/projected/5f08643e-7ba6-4635-aee3-e0fb447f5fde-kube-api-access-c7nb2\") on node \"ip-10-0-129-31.ec2.internal\" DevicePath \"\"" Jul 28 17:25:20.463649 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:20.463564 2576 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5f08643e-7ba6-4635-aee3-e0fb447f5fde-secret-metrics-client-certs\") on node \"ip-10-0-129-31.ec2.internal\" DevicePath \"\"" Jul 28 17:25:21.107019 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.106983 2576 generic.go:356] "Generic (PLEG): container finished" podID="5f08643e-7ba6-4635-aee3-e0fb447f5fde" containerID="a99125f273b78cb2d002abb826412db9aab9b527053343dfe2540a8b203a8f7e" exitCode=0 Jul 28 17:25:21.107019 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.107009 2576 generic.go:356] "Generic (PLEG): container finished" podID="5f08643e-7ba6-4635-aee3-e0fb447f5fde" containerID="ba5d71411f49f75533fea9c300377b40069f547474e3c3706a9aec767f0d4188" exitCode=0 Jul 28 17:25:21.107019 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.107018 2576 generic.go:356] "Generic (PLEG): container finished" podID="5f08643e-7ba6-4635-aee3-e0fb447f5fde" containerID="42d78edb91aca1e26c2b370b357f208c191194c545a746ab9032c04f452c17ab" exitCode=0 Jul 28 17:25:21.107019 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.107027 2576 generic.go:356] "Generic (PLEG): container finished" podID="5f08643e-7ba6-4635-aee3-e0fb447f5fde" containerID="497a74f3de62eded4164ce1c534fb15f9d9f2b4485b4c0c65733bc56275de714" exitCode=0 Jul 28 17:25:21.107598 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.107034 2576 generic.go:356] "Generic (PLEG): container finished" podID="5f08643e-7ba6-4635-aee3-e0fb447f5fde" containerID="b3e09ddfab6daad7cbd929dd755d165580a02b1bcb501d59eae2a76c37fdf26d" exitCode=0 Jul 28 17:25:21.107598 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.107042 2576 generic.go:356] "Generic (PLEG): container finished" podID="5f08643e-7ba6-4635-aee3-e0fb447f5fde" containerID="04d81aca8c617e3c85727de631e40b21f954091b36eb10fbd18248d47b401447" exitCode=0 Jul 28 17:25:21.107598 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.107060 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:25:21.107598 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.107059 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5f08643e-7ba6-4635-aee3-e0fb447f5fde","Type":"ContainerDied","Data":"a99125f273b78cb2d002abb826412db9aab9b527053343dfe2540a8b203a8f7e"} Jul 28 17:25:21.107598 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.107142 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5f08643e-7ba6-4635-aee3-e0fb447f5fde","Type":"ContainerDied","Data":"ba5d71411f49f75533fea9c300377b40069f547474e3c3706a9aec767f0d4188"} Jul 28 17:25:21.107598 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.107172 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5f08643e-7ba6-4635-aee3-e0fb447f5fde","Type":"ContainerDied","Data":"42d78edb91aca1e26c2b370b357f208c191194c545a746ab9032c04f452c17ab"} Jul 28 17:25:21.107598 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.107199 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5f08643e-7ba6-4635-aee3-e0fb447f5fde","Type":"ContainerDied","Data":"497a74f3de62eded4164ce1c534fb15f9d9f2b4485b4c0c65733bc56275de714"} Jul 28 17:25:21.107598 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.107214 2576 scope.go:117] "RemoveContainer" containerID="a99125f273b78cb2d002abb826412db9aab9b527053343dfe2540a8b203a8f7e" Jul 28 17:25:21.107598 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.107224 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5f08643e-7ba6-4635-aee3-e0fb447f5fde","Type":"ContainerDied","Data":"b3e09ddfab6daad7cbd929dd755d165580a02b1bcb501d59eae2a76c37fdf26d"} Jul 28 17:25:21.107598 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.107318 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5f08643e-7ba6-4635-aee3-e0fb447f5fde","Type":"ContainerDied","Data":"04d81aca8c617e3c85727de631e40b21f954091b36eb10fbd18248d47b401447"} Jul 28 17:25:21.107598 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.107350 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5f08643e-7ba6-4635-aee3-e0fb447f5fde","Type":"ContainerDied","Data":"39f285a15e4505bf5f9b470baf433e816977dcc22d1e58e011c17dc33ed50386"} Jul 28 17:25:21.115468 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.115454 2576 scope.go:117] "RemoveContainer" containerID="ba5d71411f49f75533fea9c300377b40069f547474e3c3706a9aec767f0d4188" Jul 28 17:25:21.122434 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.122417 2576 scope.go:117] "RemoveContainer" containerID="42d78edb91aca1e26c2b370b357f208c191194c545a746ab9032c04f452c17ab" Jul 28 17:25:21.130963 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.130943 2576 scope.go:117] "RemoveContainer" containerID="497a74f3de62eded4164ce1c534fb15f9d9f2b4485b4c0c65733bc56275de714" Jul 28 17:25:21.131339 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.131318 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 28 17:25:21.136740 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.136715 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 28 17:25:21.139090 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.139070 2576 scope.go:117] "RemoveContainer" containerID="b3e09ddfab6daad7cbd929dd755d165580a02b1bcb501d59eae2a76c37fdf26d" Jul 28 17:25:21.145556 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.145539 2576 scope.go:117] "RemoveContainer" containerID="04d81aca8c617e3c85727de631e40b21f954091b36eb10fbd18248d47b401447" Jul 28 17:25:21.152515 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.152487 2576 scope.go:117] "RemoveContainer" containerID="799ce0c5e5b0f86bfcf9b8ace8576576899a333dc75434dc0f1fe9a26303d3f0" Jul 28 17:25:21.159079 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.159057 2576 scope.go:117] "RemoveContainer" containerID="a99125f273b78cb2d002abb826412db9aab9b527053343dfe2540a8b203a8f7e" Jul 28 17:25:21.159381 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:25:21.159363 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a99125f273b78cb2d002abb826412db9aab9b527053343dfe2540a8b203a8f7e\": container with ID starting with a99125f273b78cb2d002abb826412db9aab9b527053343dfe2540a8b203a8f7e not found: ID does not exist" containerID="a99125f273b78cb2d002abb826412db9aab9b527053343dfe2540a8b203a8f7e" Jul 28 17:25:21.159440 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.159391 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a99125f273b78cb2d002abb826412db9aab9b527053343dfe2540a8b203a8f7e"} err="failed to get container status \"a99125f273b78cb2d002abb826412db9aab9b527053343dfe2540a8b203a8f7e\": rpc error: code = NotFound desc = could not find container \"a99125f273b78cb2d002abb826412db9aab9b527053343dfe2540a8b203a8f7e\": container with ID starting with a99125f273b78cb2d002abb826412db9aab9b527053343dfe2540a8b203a8f7e not found: ID does not exist" Jul 28 17:25:21.159440 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.159411 2576 scope.go:117] "RemoveContainer" containerID="ba5d71411f49f75533fea9c300377b40069f547474e3c3706a9aec767f0d4188" Jul 28 17:25:21.159663 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:25:21.159646 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ba5d71411f49f75533fea9c300377b40069f547474e3c3706a9aec767f0d4188\": container with ID starting with ba5d71411f49f75533fea9c300377b40069f547474e3c3706a9aec767f0d4188 not found: ID does not exist" containerID="ba5d71411f49f75533fea9c300377b40069f547474e3c3706a9aec767f0d4188" Jul 28 17:25:21.159708 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.159669 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba5d71411f49f75533fea9c300377b40069f547474e3c3706a9aec767f0d4188"} err="failed to get container status \"ba5d71411f49f75533fea9c300377b40069f547474e3c3706a9aec767f0d4188\": rpc error: code = NotFound desc = could not find container \"ba5d71411f49f75533fea9c300377b40069f547474e3c3706a9aec767f0d4188\": container with ID starting with ba5d71411f49f75533fea9c300377b40069f547474e3c3706a9aec767f0d4188 not found: ID does not exist" Jul 28 17:25:21.159708 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.159686 2576 scope.go:117] "RemoveContainer" containerID="42d78edb91aca1e26c2b370b357f208c191194c545a746ab9032c04f452c17ab" Jul 28 17:25:21.159911 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:25:21.159895 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"42d78edb91aca1e26c2b370b357f208c191194c545a746ab9032c04f452c17ab\": container with ID starting with 42d78edb91aca1e26c2b370b357f208c191194c545a746ab9032c04f452c17ab not found: ID does not exist" containerID="42d78edb91aca1e26c2b370b357f208c191194c545a746ab9032c04f452c17ab" Jul 28 17:25:21.159972 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.159919 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"42d78edb91aca1e26c2b370b357f208c191194c545a746ab9032c04f452c17ab"} err="failed to get container status \"42d78edb91aca1e26c2b370b357f208c191194c545a746ab9032c04f452c17ab\": rpc error: code = NotFound desc = could not find container \"42d78edb91aca1e26c2b370b357f208c191194c545a746ab9032c04f452c17ab\": container with ID starting with 42d78edb91aca1e26c2b370b357f208c191194c545a746ab9032c04f452c17ab not found: ID does not exist" Jul 28 17:25:21.159972 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.159941 2576 scope.go:117] "RemoveContainer" containerID="497a74f3de62eded4164ce1c534fb15f9d9f2b4485b4c0c65733bc56275de714" Jul 28 17:25:21.160197 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:25:21.160179 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"497a74f3de62eded4164ce1c534fb15f9d9f2b4485b4c0c65733bc56275de714\": container with ID starting with 497a74f3de62eded4164ce1c534fb15f9d9f2b4485b4c0c65733bc56275de714 not found: ID does not exist" containerID="497a74f3de62eded4164ce1c534fb15f9d9f2b4485b4c0c65733bc56275de714" Jul 28 17:25:21.160247 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.160203 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"497a74f3de62eded4164ce1c534fb15f9d9f2b4485b4c0c65733bc56275de714"} err="failed to get container status \"497a74f3de62eded4164ce1c534fb15f9d9f2b4485b4c0c65733bc56275de714\": rpc error: code = NotFound desc = could not find container \"497a74f3de62eded4164ce1c534fb15f9d9f2b4485b4c0c65733bc56275de714\": container with ID starting with 497a74f3de62eded4164ce1c534fb15f9d9f2b4485b4c0c65733bc56275de714 not found: ID does not exist" Jul 28 17:25:21.160247 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.160218 2576 scope.go:117] "RemoveContainer" containerID="b3e09ddfab6daad7cbd929dd755d165580a02b1bcb501d59eae2a76c37fdf26d" Jul 28 17:25:21.160447 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:25:21.160429 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b3e09ddfab6daad7cbd929dd755d165580a02b1bcb501d59eae2a76c37fdf26d\": container with ID starting with b3e09ddfab6daad7cbd929dd755d165580a02b1bcb501d59eae2a76c37fdf26d not found: ID does not exist" containerID="b3e09ddfab6daad7cbd929dd755d165580a02b1bcb501d59eae2a76c37fdf26d" Jul 28 17:25:21.160507 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.160454 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3e09ddfab6daad7cbd929dd755d165580a02b1bcb501d59eae2a76c37fdf26d"} err="failed to get container status \"b3e09ddfab6daad7cbd929dd755d165580a02b1bcb501d59eae2a76c37fdf26d\": rpc error: code = NotFound desc = could not find container \"b3e09ddfab6daad7cbd929dd755d165580a02b1bcb501d59eae2a76c37fdf26d\": container with ID starting with b3e09ddfab6daad7cbd929dd755d165580a02b1bcb501d59eae2a76c37fdf26d not found: ID does not exist" Jul 28 17:25:21.160507 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.160473 2576 scope.go:117] "RemoveContainer" containerID="04d81aca8c617e3c85727de631e40b21f954091b36eb10fbd18248d47b401447" Jul 28 17:25:21.160679 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:25:21.160664 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"04d81aca8c617e3c85727de631e40b21f954091b36eb10fbd18248d47b401447\": container with ID starting with 04d81aca8c617e3c85727de631e40b21f954091b36eb10fbd18248d47b401447 not found: ID does not exist" containerID="04d81aca8c617e3c85727de631e40b21f954091b36eb10fbd18248d47b401447" Jul 28 17:25:21.160725 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.160683 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04d81aca8c617e3c85727de631e40b21f954091b36eb10fbd18248d47b401447"} err="failed to get container status \"04d81aca8c617e3c85727de631e40b21f954091b36eb10fbd18248d47b401447\": rpc error: code = NotFound desc = could not find container \"04d81aca8c617e3c85727de631e40b21f954091b36eb10fbd18248d47b401447\": container with ID starting with 04d81aca8c617e3c85727de631e40b21f954091b36eb10fbd18248d47b401447 not found: ID does not exist" Jul 28 17:25:21.160725 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.160695 2576 scope.go:117] "RemoveContainer" containerID="799ce0c5e5b0f86bfcf9b8ace8576576899a333dc75434dc0f1fe9a26303d3f0" Jul 28 17:25:21.160895 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:25:21.160879 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"799ce0c5e5b0f86bfcf9b8ace8576576899a333dc75434dc0f1fe9a26303d3f0\": container with ID starting with 799ce0c5e5b0f86bfcf9b8ace8576576899a333dc75434dc0f1fe9a26303d3f0 not found: ID does not exist" containerID="799ce0c5e5b0f86bfcf9b8ace8576576899a333dc75434dc0f1fe9a26303d3f0" Jul 28 17:25:21.160950 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.160901 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"799ce0c5e5b0f86bfcf9b8ace8576576899a333dc75434dc0f1fe9a26303d3f0"} err="failed to get container status \"799ce0c5e5b0f86bfcf9b8ace8576576899a333dc75434dc0f1fe9a26303d3f0\": rpc error: code = NotFound desc = could not find container \"799ce0c5e5b0f86bfcf9b8ace8576576899a333dc75434dc0f1fe9a26303d3f0\": container with ID starting with 799ce0c5e5b0f86bfcf9b8ace8576576899a333dc75434dc0f1fe9a26303d3f0 not found: ID does not exist" Jul 28 17:25:21.160950 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.160918 2576 scope.go:117] "RemoveContainer" containerID="a99125f273b78cb2d002abb826412db9aab9b527053343dfe2540a8b203a8f7e" Jul 28 17:25:21.161135 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.161101 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a99125f273b78cb2d002abb826412db9aab9b527053343dfe2540a8b203a8f7e"} err="failed to get container status \"a99125f273b78cb2d002abb826412db9aab9b527053343dfe2540a8b203a8f7e\": rpc error: code = NotFound desc = could not find container \"a99125f273b78cb2d002abb826412db9aab9b527053343dfe2540a8b203a8f7e\": container with ID starting with a99125f273b78cb2d002abb826412db9aab9b527053343dfe2540a8b203a8f7e not found: ID does not exist" Jul 28 17:25:21.161135 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.161130 2576 scope.go:117] "RemoveContainer" containerID="ba5d71411f49f75533fea9c300377b40069f547474e3c3706a9aec767f0d4188" Jul 28 17:25:21.161328 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.161309 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba5d71411f49f75533fea9c300377b40069f547474e3c3706a9aec767f0d4188"} err="failed to get container status \"ba5d71411f49f75533fea9c300377b40069f547474e3c3706a9aec767f0d4188\": rpc error: code = NotFound desc = could not find container \"ba5d71411f49f75533fea9c300377b40069f547474e3c3706a9aec767f0d4188\": container with ID starting with ba5d71411f49f75533fea9c300377b40069f547474e3c3706a9aec767f0d4188 not found: ID does not exist" Jul 28 17:25:21.161378 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.161330 2576 scope.go:117] "RemoveContainer" containerID="42d78edb91aca1e26c2b370b357f208c191194c545a746ab9032c04f452c17ab" Jul 28 17:25:21.161563 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.161543 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"42d78edb91aca1e26c2b370b357f208c191194c545a746ab9032c04f452c17ab"} err="failed to get container status \"42d78edb91aca1e26c2b370b357f208c191194c545a746ab9032c04f452c17ab\": rpc error: code = NotFound desc = could not find container \"42d78edb91aca1e26c2b370b357f208c191194c545a746ab9032c04f452c17ab\": container with ID starting with 42d78edb91aca1e26c2b370b357f208c191194c545a746ab9032c04f452c17ab not found: ID does not exist" Jul 28 17:25:21.161627 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.161563 2576 scope.go:117] "RemoveContainer" containerID="497a74f3de62eded4164ce1c534fb15f9d9f2b4485b4c0c65733bc56275de714" Jul 28 17:25:21.161763 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.161748 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"497a74f3de62eded4164ce1c534fb15f9d9f2b4485b4c0c65733bc56275de714"} err="failed to get container status \"497a74f3de62eded4164ce1c534fb15f9d9f2b4485b4c0c65733bc56275de714\": rpc error: code = NotFound desc = could not find container \"497a74f3de62eded4164ce1c534fb15f9d9f2b4485b4c0c65733bc56275de714\": container with ID starting with 497a74f3de62eded4164ce1c534fb15f9d9f2b4485b4c0c65733bc56275de714 not found: ID does not exist" Jul 28 17:25:21.161805 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.161763 2576 scope.go:117] "RemoveContainer" containerID="b3e09ddfab6daad7cbd929dd755d165580a02b1bcb501d59eae2a76c37fdf26d" Jul 28 17:25:21.162003 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.161985 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3e09ddfab6daad7cbd929dd755d165580a02b1bcb501d59eae2a76c37fdf26d"} err="failed to get container status \"b3e09ddfab6daad7cbd929dd755d165580a02b1bcb501d59eae2a76c37fdf26d\": rpc error: code = NotFound desc = could not find container \"b3e09ddfab6daad7cbd929dd755d165580a02b1bcb501d59eae2a76c37fdf26d\": container with ID starting with b3e09ddfab6daad7cbd929dd755d165580a02b1bcb501d59eae2a76c37fdf26d not found: ID does not exist" Jul 28 17:25:21.162046 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.162012 2576 scope.go:117] "RemoveContainer" containerID="04d81aca8c617e3c85727de631e40b21f954091b36eb10fbd18248d47b401447" Jul 28 17:25:21.162270 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.162252 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04d81aca8c617e3c85727de631e40b21f954091b36eb10fbd18248d47b401447"} err="failed to get container status \"04d81aca8c617e3c85727de631e40b21f954091b36eb10fbd18248d47b401447\": rpc error: code = NotFound desc = could not find container \"04d81aca8c617e3c85727de631e40b21f954091b36eb10fbd18248d47b401447\": container with ID starting with 04d81aca8c617e3c85727de631e40b21f954091b36eb10fbd18248d47b401447 not found: ID does not exist" Jul 28 17:25:21.162338 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.162270 2576 scope.go:117] "RemoveContainer" containerID="799ce0c5e5b0f86bfcf9b8ace8576576899a333dc75434dc0f1fe9a26303d3f0" Jul 28 17:25:21.162463 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.162442 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"799ce0c5e5b0f86bfcf9b8ace8576576899a333dc75434dc0f1fe9a26303d3f0"} err="failed to get container status \"799ce0c5e5b0f86bfcf9b8ace8576576899a333dc75434dc0f1fe9a26303d3f0\": rpc error: code = NotFound desc = could not find container \"799ce0c5e5b0f86bfcf9b8ace8576576899a333dc75434dc0f1fe9a26303d3f0\": container with ID starting with 799ce0c5e5b0f86bfcf9b8ace8576576899a333dc75434dc0f1fe9a26303d3f0 not found: ID does not exist" Jul 28 17:25:21.162508 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.162463 2576 scope.go:117] "RemoveContainer" containerID="a99125f273b78cb2d002abb826412db9aab9b527053343dfe2540a8b203a8f7e" Jul 28 17:25:21.162666 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.162650 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a99125f273b78cb2d002abb826412db9aab9b527053343dfe2540a8b203a8f7e"} err="failed to get container status \"a99125f273b78cb2d002abb826412db9aab9b527053343dfe2540a8b203a8f7e\": rpc error: code = NotFound desc = could not find container \"a99125f273b78cb2d002abb826412db9aab9b527053343dfe2540a8b203a8f7e\": container with ID starting with a99125f273b78cb2d002abb826412db9aab9b527053343dfe2540a8b203a8f7e not found: ID does not exist" Jul 28 17:25:21.162666 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.162665 2576 scope.go:117] "RemoveContainer" containerID="ba5d71411f49f75533fea9c300377b40069f547474e3c3706a9aec767f0d4188" Jul 28 17:25:21.162873 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.162855 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba5d71411f49f75533fea9c300377b40069f547474e3c3706a9aec767f0d4188"} err="failed to get container status \"ba5d71411f49f75533fea9c300377b40069f547474e3c3706a9aec767f0d4188\": rpc error: code = NotFound desc = could not find container \"ba5d71411f49f75533fea9c300377b40069f547474e3c3706a9aec767f0d4188\": container with ID starting with ba5d71411f49f75533fea9c300377b40069f547474e3c3706a9aec767f0d4188 not found: ID does not exist" Jul 28 17:25:21.162970 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.162873 2576 scope.go:117] "RemoveContainer" containerID="42d78edb91aca1e26c2b370b357f208c191194c545a746ab9032c04f452c17ab" Jul 28 17:25:21.163079 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.163064 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"42d78edb91aca1e26c2b370b357f208c191194c545a746ab9032c04f452c17ab"} err="failed to get container status \"42d78edb91aca1e26c2b370b357f208c191194c545a746ab9032c04f452c17ab\": rpc error: code = NotFound desc = could not find container \"42d78edb91aca1e26c2b370b357f208c191194c545a746ab9032c04f452c17ab\": container with ID starting with 42d78edb91aca1e26c2b370b357f208c191194c545a746ab9032c04f452c17ab not found: ID does not exist" Jul 28 17:25:21.163141 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.163079 2576 scope.go:117] "RemoveContainer" containerID="497a74f3de62eded4164ce1c534fb15f9d9f2b4485b4c0c65733bc56275de714" Jul 28 17:25:21.163293 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.163276 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"497a74f3de62eded4164ce1c534fb15f9d9f2b4485b4c0c65733bc56275de714"} err="failed to get container status \"497a74f3de62eded4164ce1c534fb15f9d9f2b4485b4c0c65733bc56275de714\": rpc error: code = NotFound desc = could not find container \"497a74f3de62eded4164ce1c534fb15f9d9f2b4485b4c0c65733bc56275de714\": container with ID starting with 497a74f3de62eded4164ce1c534fb15f9d9f2b4485b4c0c65733bc56275de714 not found: ID does not exist" Jul 28 17:25:21.163339 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.163294 2576 scope.go:117] "RemoveContainer" containerID="b3e09ddfab6daad7cbd929dd755d165580a02b1bcb501d59eae2a76c37fdf26d" Jul 28 17:25:21.163490 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.163473 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3e09ddfab6daad7cbd929dd755d165580a02b1bcb501d59eae2a76c37fdf26d"} err="failed to get container status \"b3e09ddfab6daad7cbd929dd755d165580a02b1bcb501d59eae2a76c37fdf26d\": rpc error: code = NotFound desc = could not find container \"b3e09ddfab6daad7cbd929dd755d165580a02b1bcb501d59eae2a76c37fdf26d\": container with ID starting with b3e09ddfab6daad7cbd929dd755d165580a02b1bcb501d59eae2a76c37fdf26d not found: ID does not exist" Jul 28 17:25:21.163531 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.163490 2576 scope.go:117] "RemoveContainer" containerID="04d81aca8c617e3c85727de631e40b21f954091b36eb10fbd18248d47b401447" Jul 28 17:25:21.163700 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.163683 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04d81aca8c617e3c85727de631e40b21f954091b36eb10fbd18248d47b401447"} err="failed to get container status \"04d81aca8c617e3c85727de631e40b21f954091b36eb10fbd18248d47b401447\": rpc error: code = NotFound desc = could not find container \"04d81aca8c617e3c85727de631e40b21f954091b36eb10fbd18248d47b401447\": container with ID starting with 04d81aca8c617e3c85727de631e40b21f954091b36eb10fbd18248d47b401447 not found: ID does not exist" Jul 28 17:25:21.163741 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.163700 2576 scope.go:117] "RemoveContainer" containerID="799ce0c5e5b0f86bfcf9b8ace8576576899a333dc75434dc0f1fe9a26303d3f0" Jul 28 17:25:21.163900 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.163884 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"799ce0c5e5b0f86bfcf9b8ace8576576899a333dc75434dc0f1fe9a26303d3f0"} err="failed to get container status \"799ce0c5e5b0f86bfcf9b8ace8576576899a333dc75434dc0f1fe9a26303d3f0\": rpc error: code = NotFound desc = could not find container \"799ce0c5e5b0f86bfcf9b8ace8576576899a333dc75434dc0f1fe9a26303d3f0\": container with ID starting with 799ce0c5e5b0f86bfcf9b8ace8576576899a333dc75434dc0f1fe9a26303d3f0 not found: ID does not exist" Jul 28 17:25:21.163945 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.163900 2576 scope.go:117] "RemoveContainer" containerID="a99125f273b78cb2d002abb826412db9aab9b527053343dfe2540a8b203a8f7e" Jul 28 17:25:21.164089 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.164073 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a99125f273b78cb2d002abb826412db9aab9b527053343dfe2540a8b203a8f7e"} err="failed to get container status \"a99125f273b78cb2d002abb826412db9aab9b527053343dfe2540a8b203a8f7e\": rpc error: code = NotFound desc = could not find container \"a99125f273b78cb2d002abb826412db9aab9b527053343dfe2540a8b203a8f7e\": container with ID starting with a99125f273b78cb2d002abb826412db9aab9b527053343dfe2540a8b203a8f7e not found: ID does not exist" Jul 28 17:25:21.164142 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.164090 2576 scope.go:117] "RemoveContainer" containerID="ba5d71411f49f75533fea9c300377b40069f547474e3c3706a9aec767f0d4188" Jul 28 17:25:21.164879 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.164373 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba5d71411f49f75533fea9c300377b40069f547474e3c3706a9aec767f0d4188"} err="failed to get container status \"ba5d71411f49f75533fea9c300377b40069f547474e3c3706a9aec767f0d4188\": rpc error: code = NotFound desc = could not find container \"ba5d71411f49f75533fea9c300377b40069f547474e3c3706a9aec767f0d4188\": container with ID starting with ba5d71411f49f75533fea9c300377b40069f547474e3c3706a9aec767f0d4188 not found: ID does not exist" Jul 28 17:25:21.164879 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.164397 2576 scope.go:117] "RemoveContainer" containerID="42d78edb91aca1e26c2b370b357f208c191194c545a746ab9032c04f452c17ab" Jul 28 17:25:21.165024 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.164951 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"42d78edb91aca1e26c2b370b357f208c191194c545a746ab9032c04f452c17ab"} err="failed to get container status \"42d78edb91aca1e26c2b370b357f208c191194c545a746ab9032c04f452c17ab\": rpc error: code = NotFound desc = could not find container \"42d78edb91aca1e26c2b370b357f208c191194c545a746ab9032c04f452c17ab\": container with ID starting with 42d78edb91aca1e26c2b370b357f208c191194c545a746ab9032c04f452c17ab not found: ID does not exist" Jul 28 17:25:21.165024 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.164976 2576 scope.go:117] "RemoveContainer" containerID="497a74f3de62eded4164ce1c534fb15f9d9f2b4485b4c0c65733bc56275de714" Jul 28 17:25:21.165311 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.165285 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"497a74f3de62eded4164ce1c534fb15f9d9f2b4485b4c0c65733bc56275de714"} err="failed to get container status \"497a74f3de62eded4164ce1c534fb15f9d9f2b4485b4c0c65733bc56275de714\": rpc error: code = NotFound desc = could not find container \"497a74f3de62eded4164ce1c534fb15f9d9f2b4485b4c0c65733bc56275de714\": container with ID starting with 497a74f3de62eded4164ce1c534fb15f9d9f2b4485b4c0c65733bc56275de714 not found: ID does not exist" Jul 28 17:25:21.165418 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.165312 2576 scope.go:117] "RemoveContainer" containerID="b3e09ddfab6daad7cbd929dd755d165580a02b1bcb501d59eae2a76c37fdf26d" Jul 28 17:25:21.165600 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.165565 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3e09ddfab6daad7cbd929dd755d165580a02b1bcb501d59eae2a76c37fdf26d"} err="failed to get container status \"b3e09ddfab6daad7cbd929dd755d165580a02b1bcb501d59eae2a76c37fdf26d\": rpc error: code = NotFound desc = could not find container \"b3e09ddfab6daad7cbd929dd755d165580a02b1bcb501d59eae2a76c37fdf26d\": container with ID starting with b3e09ddfab6daad7cbd929dd755d165580a02b1bcb501d59eae2a76c37fdf26d not found: ID does not exist" Jul 28 17:25:21.165600 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.165589 2576 scope.go:117] "RemoveContainer" containerID="04d81aca8c617e3c85727de631e40b21f954091b36eb10fbd18248d47b401447" Jul 28 17:25:21.165941 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.165838 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04d81aca8c617e3c85727de631e40b21f954091b36eb10fbd18248d47b401447"} err="failed to get container status \"04d81aca8c617e3c85727de631e40b21f954091b36eb10fbd18248d47b401447\": rpc error: code = NotFound desc = could not find container \"04d81aca8c617e3c85727de631e40b21f954091b36eb10fbd18248d47b401447\": container with ID starting with 04d81aca8c617e3c85727de631e40b21f954091b36eb10fbd18248d47b401447 not found: ID does not exist" Jul 28 17:25:21.165941 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.165870 2576 scope.go:117] "RemoveContainer" containerID="799ce0c5e5b0f86bfcf9b8ace8576576899a333dc75434dc0f1fe9a26303d3f0" Jul 28 17:25:21.166207 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.166178 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"799ce0c5e5b0f86bfcf9b8ace8576576899a333dc75434dc0f1fe9a26303d3f0"} err="failed to get container status \"799ce0c5e5b0f86bfcf9b8ace8576576899a333dc75434dc0f1fe9a26303d3f0\": rpc error: code = NotFound desc = could not find container \"799ce0c5e5b0f86bfcf9b8ace8576576899a333dc75434dc0f1fe9a26303d3f0\": container with ID starting with 799ce0c5e5b0f86bfcf9b8ace8576576899a333dc75434dc0f1fe9a26303d3f0 not found: ID does not exist" Jul 28 17:25:21.166207 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.166201 2576 scope.go:117] "RemoveContainer" containerID="a99125f273b78cb2d002abb826412db9aab9b527053343dfe2540a8b203a8f7e" Jul 28 17:25:21.166469 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.166448 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a99125f273b78cb2d002abb826412db9aab9b527053343dfe2540a8b203a8f7e"} err="failed to get container status \"a99125f273b78cb2d002abb826412db9aab9b527053343dfe2540a8b203a8f7e\": rpc error: code = NotFound desc = could not find container \"a99125f273b78cb2d002abb826412db9aab9b527053343dfe2540a8b203a8f7e\": container with ID starting with a99125f273b78cb2d002abb826412db9aab9b527053343dfe2540a8b203a8f7e not found: ID does not exist" Jul 28 17:25:21.166469 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.166468 2576 scope.go:117] "RemoveContainer" containerID="ba5d71411f49f75533fea9c300377b40069f547474e3c3706a9aec767f0d4188" Jul 28 17:25:21.166728 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.166705 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba5d71411f49f75533fea9c300377b40069f547474e3c3706a9aec767f0d4188"} err="failed to get container status \"ba5d71411f49f75533fea9c300377b40069f547474e3c3706a9aec767f0d4188\": rpc error: code = NotFound desc = could not find container \"ba5d71411f49f75533fea9c300377b40069f547474e3c3706a9aec767f0d4188\": container with ID starting with ba5d71411f49f75533fea9c300377b40069f547474e3c3706a9aec767f0d4188 not found: ID does not exist" Jul 28 17:25:21.166808 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.166730 2576 scope.go:117] "RemoveContainer" containerID="42d78edb91aca1e26c2b370b357f208c191194c545a746ab9032c04f452c17ab" Jul 28 17:25:21.166965 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.166948 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"42d78edb91aca1e26c2b370b357f208c191194c545a746ab9032c04f452c17ab"} err="failed to get container status \"42d78edb91aca1e26c2b370b357f208c191194c545a746ab9032c04f452c17ab\": rpc error: code = NotFound desc = could not find container \"42d78edb91aca1e26c2b370b357f208c191194c545a746ab9032c04f452c17ab\": container with ID starting with 42d78edb91aca1e26c2b370b357f208c191194c545a746ab9032c04f452c17ab not found: ID does not exist" Jul 28 17:25:21.167025 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.166966 2576 scope.go:117] "RemoveContainer" containerID="497a74f3de62eded4164ce1c534fb15f9d9f2b4485b4c0c65733bc56275de714" Jul 28 17:25:21.167025 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.167006 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 28 17:25:21.167190 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.167171 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"497a74f3de62eded4164ce1c534fb15f9d9f2b4485b4c0c65733bc56275de714"} err="failed to get container status \"497a74f3de62eded4164ce1c534fb15f9d9f2b4485b4c0c65733bc56275de714\": rpc error: code = NotFound desc = could not find container \"497a74f3de62eded4164ce1c534fb15f9d9f2b4485b4c0c65733bc56275de714\": container with ID starting with 497a74f3de62eded4164ce1c534fb15f9d9f2b4485b4c0c65733bc56275de714 not found: ID does not exist" Jul 28 17:25:21.167273 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.167191 2576 scope.go:117] "RemoveContainer" containerID="b3e09ddfab6daad7cbd929dd755d165580a02b1bcb501d59eae2a76c37fdf26d" Jul 28 17:25:21.167331 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.167316 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93f66a6f-1eea-4d42-b60b-9c8a56e71170" containerName="kube-rbac-proxy-web" Jul 28 17:25:21.167363 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.167336 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="93f66a6f-1eea-4d42-b60b-9c8a56e71170" containerName="kube-rbac-proxy-web" Jul 28 17:25:21.167363 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.167347 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f08643e-7ba6-4635-aee3-e0fb447f5fde" containerName="prometheus" Jul 28 17:25:21.167363 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.167356 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f08643e-7ba6-4635-aee3-e0fb447f5fde" containerName="prometheus" Jul 28 17:25:21.167455 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.167364 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93f66a6f-1eea-4d42-b60b-9c8a56e71170" containerName="kube-rbac-proxy" Jul 28 17:25:21.167455 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.167369 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="93f66a6f-1eea-4d42-b60b-9c8a56e71170" containerName="kube-rbac-proxy" Jul 28 17:25:21.167455 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.167383 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93f66a6f-1eea-4d42-b60b-9c8a56e71170" containerName="prom-label-proxy" Jul 28 17:25:21.167455 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.167388 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="93f66a6f-1eea-4d42-b60b-9c8a56e71170" containerName="prom-label-proxy" Jul 28 17:25:21.167455 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.167394 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f08643e-7ba6-4635-aee3-e0fb447f5fde" containerName="config-reloader" Jul 28 17:25:21.167455 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.167399 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f08643e-7ba6-4635-aee3-e0fb447f5fde" containerName="config-reloader" Jul 28 17:25:21.167455 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.167398 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3e09ddfab6daad7cbd929dd755d165580a02b1bcb501d59eae2a76c37fdf26d"} err="failed to get container status \"b3e09ddfab6daad7cbd929dd755d165580a02b1bcb501d59eae2a76c37fdf26d\": rpc error: code = NotFound desc = could not find container \"b3e09ddfab6daad7cbd929dd755d165580a02b1bcb501d59eae2a76c37fdf26d\": container with ID starting with b3e09ddfab6daad7cbd929dd755d165580a02b1bcb501d59eae2a76c37fdf26d not found: ID does not exist" Jul 28 17:25:21.167455 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.167420 2576 scope.go:117] "RemoveContainer" containerID="04d81aca8c617e3c85727de631e40b21f954091b36eb10fbd18248d47b401447" Jul 28 17:25:21.167455 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.167405 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f08643e-7ba6-4635-aee3-e0fb447f5fde" containerName="thanos-sidecar" Jul 28 17:25:21.167716 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.167465 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f08643e-7ba6-4635-aee3-e0fb447f5fde" containerName="thanos-sidecar" Jul 28 17:25:21.167716 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.167476 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f08643e-7ba6-4635-aee3-e0fb447f5fde" containerName="kube-rbac-proxy" Jul 28 17:25:21.167716 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.167482 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f08643e-7ba6-4635-aee3-e0fb447f5fde" containerName="kube-rbac-proxy" Jul 28 17:25:21.167716 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.167492 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f08643e-7ba6-4635-aee3-e0fb447f5fde" containerName="init-config-reloader" Jul 28 17:25:21.167716 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.167501 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f08643e-7ba6-4635-aee3-e0fb447f5fde" containerName="init-config-reloader" Jul 28 17:25:21.167716 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.167509 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93f66a6f-1eea-4d42-b60b-9c8a56e71170" containerName="init-config-reloader" Jul 28 17:25:21.167716 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.167514 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="93f66a6f-1eea-4d42-b60b-9c8a56e71170" containerName="init-config-reloader" Jul 28 17:25:21.167716 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.167521 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93f66a6f-1eea-4d42-b60b-9c8a56e71170" containerName="alertmanager" Jul 28 17:25:21.167716 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.167525 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="93f66a6f-1eea-4d42-b60b-9c8a56e71170" containerName="alertmanager" Jul 28 17:25:21.167716 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.167531 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93f66a6f-1eea-4d42-b60b-9c8a56e71170" containerName="config-reloader" Jul 28 17:25:21.167716 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.167537 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="93f66a6f-1eea-4d42-b60b-9c8a56e71170" containerName="config-reloader" Jul 28 17:25:21.167716 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.167544 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f08643e-7ba6-4635-aee3-e0fb447f5fde" containerName="kube-rbac-proxy-thanos" Jul 28 17:25:21.167716 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.167551 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f08643e-7ba6-4635-aee3-e0fb447f5fde" containerName="kube-rbac-proxy-thanos" Jul 28 17:25:21.167716 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.167562 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f08643e-7ba6-4635-aee3-e0fb447f5fde" containerName="kube-rbac-proxy-web" Jul 28 17:25:21.167716 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.167570 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f08643e-7ba6-4635-aee3-e0fb447f5fde" containerName="kube-rbac-proxy-web" Jul 28 17:25:21.167716 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.167583 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93f66a6f-1eea-4d42-b60b-9c8a56e71170" containerName="kube-rbac-proxy-metric" Jul 28 17:25:21.167716 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.167590 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="93f66a6f-1eea-4d42-b60b-9c8a56e71170" containerName="kube-rbac-proxy-metric" Jul 28 17:25:21.167716 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.167630 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04d81aca8c617e3c85727de631e40b21f954091b36eb10fbd18248d47b401447"} err="failed to get container status \"04d81aca8c617e3c85727de631e40b21f954091b36eb10fbd18248d47b401447\": rpc error: code = NotFound desc = could not find container \"04d81aca8c617e3c85727de631e40b21f954091b36eb10fbd18248d47b401447\": container with ID starting with 04d81aca8c617e3c85727de631e40b21f954091b36eb10fbd18248d47b401447 not found: ID does not exist" Jul 28 17:25:21.167716 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.167654 2576 scope.go:117] "RemoveContainer" containerID="799ce0c5e5b0f86bfcf9b8ace8576576899a333dc75434dc0f1fe9a26303d3f0" Jul 28 17:25:21.167716 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.167654 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f08643e-7ba6-4635-aee3-e0fb447f5fde" containerName="kube-rbac-proxy-thanos" Jul 28 17:25:21.167716 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.167702 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="93f66a6f-1eea-4d42-b60b-9c8a56e71170" containerName="alertmanager" Jul 28 17:25:21.167716 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.167709 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="93f66a6f-1eea-4d42-b60b-9c8a56e71170" containerName="config-reloader" Jul 28 17:25:21.167716 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.167715 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="93f66a6f-1eea-4d42-b60b-9c8a56e71170" containerName="kube-rbac-proxy-web" Jul 28 17:25:21.167716 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.167722 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="93f66a6f-1eea-4d42-b60b-9c8a56e71170" containerName="kube-rbac-proxy" Jul 28 17:25:21.167716 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.167728 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="93f66a6f-1eea-4d42-b60b-9c8a56e71170" containerName="kube-rbac-proxy-metric" Jul 28 17:25:21.168562 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.167733 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="93f66a6f-1eea-4d42-b60b-9c8a56e71170" containerName="prom-label-proxy" Jul 28 17:25:21.168562 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.167740 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f08643e-7ba6-4635-aee3-e0fb447f5fde" containerName="prometheus" Jul 28 17:25:21.168562 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.167750 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f08643e-7ba6-4635-aee3-e0fb447f5fde" containerName="config-reloader" Jul 28 17:25:21.168562 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.167757 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f08643e-7ba6-4635-aee3-e0fb447f5fde" containerName="thanos-sidecar" Jul 28 17:25:21.168562 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.167764 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f08643e-7ba6-4635-aee3-e0fb447f5fde" containerName="kube-rbac-proxy-web" Jul 28 17:25:21.168562 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.167769 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f08643e-7ba6-4635-aee3-e0fb447f5fde" containerName="kube-rbac-proxy" Jul 28 17:25:21.168562 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.167858 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"799ce0c5e5b0f86bfcf9b8ace8576576899a333dc75434dc0f1fe9a26303d3f0"} err="failed to get container status \"799ce0c5e5b0f86bfcf9b8ace8576576899a333dc75434dc0f1fe9a26303d3f0\": rpc error: code = NotFound desc = could not find container \"799ce0c5e5b0f86bfcf9b8ace8576576899a333dc75434dc0f1fe9a26303d3f0\": container with ID starting with 799ce0c5e5b0f86bfcf9b8ace8576576899a333dc75434dc0f1fe9a26303d3f0 not found: ID does not exist" Jul 28 17:25:21.168562 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.167871 2576 scope.go:117] "RemoveContainer" containerID="a99125f273b78cb2d002abb826412db9aab9b527053343dfe2540a8b203a8f7e" Jul 28 17:25:21.168562 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.168070 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a99125f273b78cb2d002abb826412db9aab9b527053343dfe2540a8b203a8f7e"} err="failed to get container status \"a99125f273b78cb2d002abb826412db9aab9b527053343dfe2540a8b203a8f7e\": rpc error: code = NotFound desc = could not find container \"a99125f273b78cb2d002abb826412db9aab9b527053343dfe2540a8b203a8f7e\": container with ID starting with a99125f273b78cb2d002abb826412db9aab9b527053343dfe2540a8b203a8f7e not found: ID does not exist" Jul 28 17:25:21.168562 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.168092 2576 scope.go:117] "RemoveContainer" containerID="ba5d71411f49f75533fea9c300377b40069f547474e3c3706a9aec767f0d4188" Jul 28 17:25:21.168562 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.168311 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba5d71411f49f75533fea9c300377b40069f547474e3c3706a9aec767f0d4188"} err="failed to get container status \"ba5d71411f49f75533fea9c300377b40069f547474e3c3706a9aec767f0d4188\": rpc error: code = NotFound desc = could not find container \"ba5d71411f49f75533fea9c300377b40069f547474e3c3706a9aec767f0d4188\": container with ID starting with ba5d71411f49f75533fea9c300377b40069f547474e3c3706a9aec767f0d4188 not found: ID does not exist" Jul 28 17:25:21.168562 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.168326 2576 scope.go:117] "RemoveContainer" containerID="42d78edb91aca1e26c2b370b357f208c191194c545a746ab9032c04f452c17ab" Jul 28 17:25:21.168562 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.168524 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"42d78edb91aca1e26c2b370b357f208c191194c545a746ab9032c04f452c17ab"} err="failed to get container status \"42d78edb91aca1e26c2b370b357f208c191194c545a746ab9032c04f452c17ab\": rpc error: code = NotFound desc = could not find container \"42d78edb91aca1e26c2b370b357f208c191194c545a746ab9032c04f452c17ab\": container with ID starting with 42d78edb91aca1e26c2b370b357f208c191194c545a746ab9032c04f452c17ab not found: ID does not exist" Jul 28 17:25:21.168562 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.168541 2576 scope.go:117] "RemoveContainer" containerID="497a74f3de62eded4164ce1c534fb15f9d9f2b4485b4c0c65733bc56275de714" Jul 28 17:25:21.169012 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.168728 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"497a74f3de62eded4164ce1c534fb15f9d9f2b4485b4c0c65733bc56275de714"} err="failed to get container status \"497a74f3de62eded4164ce1c534fb15f9d9f2b4485b4c0c65733bc56275de714\": rpc error: code = NotFound desc = could not find container \"497a74f3de62eded4164ce1c534fb15f9d9f2b4485b4c0c65733bc56275de714\": container with ID starting with 497a74f3de62eded4164ce1c534fb15f9d9f2b4485b4c0c65733bc56275de714 not found: ID does not exist" Jul 28 17:25:21.169012 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.168748 2576 scope.go:117] "RemoveContainer" containerID="b3e09ddfab6daad7cbd929dd755d165580a02b1bcb501d59eae2a76c37fdf26d" Jul 28 17:25:21.169012 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.168964 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3e09ddfab6daad7cbd929dd755d165580a02b1bcb501d59eae2a76c37fdf26d"} err="failed to get container status \"b3e09ddfab6daad7cbd929dd755d165580a02b1bcb501d59eae2a76c37fdf26d\": rpc error: code = NotFound desc = could not find container \"b3e09ddfab6daad7cbd929dd755d165580a02b1bcb501d59eae2a76c37fdf26d\": container with ID starting with b3e09ddfab6daad7cbd929dd755d165580a02b1bcb501d59eae2a76c37fdf26d not found: ID does not exist" Jul 28 17:25:21.169012 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.168978 2576 scope.go:117] "RemoveContainer" containerID="04d81aca8c617e3c85727de631e40b21f954091b36eb10fbd18248d47b401447" Jul 28 17:25:21.169199 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.169181 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04d81aca8c617e3c85727de631e40b21f954091b36eb10fbd18248d47b401447"} err="failed to get container status \"04d81aca8c617e3c85727de631e40b21f954091b36eb10fbd18248d47b401447\": rpc error: code = NotFound desc = could not find container \"04d81aca8c617e3c85727de631e40b21f954091b36eb10fbd18248d47b401447\": container with ID starting with 04d81aca8c617e3c85727de631e40b21f954091b36eb10fbd18248d47b401447 not found: ID does not exist" Jul 28 17:25:21.169237 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.169199 2576 scope.go:117] "RemoveContainer" containerID="799ce0c5e5b0f86bfcf9b8ace8576576899a333dc75434dc0f1fe9a26303d3f0" Jul 28 17:25:21.169396 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.169382 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"799ce0c5e5b0f86bfcf9b8ace8576576899a333dc75434dc0f1fe9a26303d3f0"} err="failed to get container status \"799ce0c5e5b0f86bfcf9b8ace8576576899a333dc75434dc0f1fe9a26303d3f0\": rpc error: code = NotFound desc = could not find container \"799ce0c5e5b0f86bfcf9b8ace8576576899a333dc75434dc0f1fe9a26303d3f0\": container with ID starting with 799ce0c5e5b0f86bfcf9b8ace8576576899a333dc75434dc0f1fe9a26303d3f0 not found: ID does not exist" Jul 28 17:25:21.172697 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.172682 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:25:21.175386 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.175366 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-pseesa2ce685\"" Jul 28 17:25:21.175517 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.175500 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-snn2h\"" Jul 28 17:25:21.175585 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.175566 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 28 17:25:21.175641 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.175604 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 28 17:25:21.175695 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.175641 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 28 17:25:21.175695 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.175641 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 28 17:25:21.175695 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.175661 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 28 17:25:21.175844 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.175746 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 28 17:25:21.176134 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.176102 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 28 17:25:21.176204 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.176104 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 28 17:25:21.176346 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.176331 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 28 17:25:21.176505 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.176487 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 28 17:25:21.177223 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.176910 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 28 17:25:21.177658 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.177639 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 28 17:25:21.181217 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.181194 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 28 17:25:21.183454 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.183431 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 28 17:25:21.188932 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.188911 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 28 17:25:21.267537 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.267503 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/32c79fa5-7cca-49d3-8836-c1836b56d798-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"32c79fa5-7cca-49d3-8836-c1836b56d798\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:25:21.267537 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.267539 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/32c79fa5-7cca-49d3-8836-c1836b56d798-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"32c79fa5-7cca-49d3-8836-c1836b56d798\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:25:21.267740 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.267557 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/32c79fa5-7cca-49d3-8836-c1836b56d798-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"32c79fa5-7cca-49d3-8836-c1836b56d798\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:25:21.267740 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.267576 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/32c79fa5-7cca-49d3-8836-c1836b56d798-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"32c79fa5-7cca-49d3-8836-c1836b56d798\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:25:21.267740 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.267593 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/32c79fa5-7cca-49d3-8836-c1836b56d798-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"32c79fa5-7cca-49d3-8836-c1836b56d798\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:25:21.267740 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.267613 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/32c79fa5-7cca-49d3-8836-c1836b56d798-config\") pod \"prometheus-k8s-0\" (UID: \"32c79fa5-7cca-49d3-8836-c1836b56d798\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:25:21.267740 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.267639 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/32c79fa5-7cca-49d3-8836-c1836b56d798-config-out\") pod \"prometheus-k8s-0\" (UID: \"32c79fa5-7cca-49d3-8836-c1836b56d798\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:25:21.267740 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.267676 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/32c79fa5-7cca-49d3-8836-c1836b56d798-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"32c79fa5-7cca-49d3-8836-c1836b56d798\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:25:21.267740 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.267694 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/32c79fa5-7cca-49d3-8836-c1836b56d798-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"32c79fa5-7cca-49d3-8836-c1836b56d798\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:25:21.267740 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.267718 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/32c79fa5-7cca-49d3-8836-c1836b56d798-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"32c79fa5-7cca-49d3-8836-c1836b56d798\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:25:21.267740 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.267732 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/32c79fa5-7cca-49d3-8836-c1836b56d798-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"32c79fa5-7cca-49d3-8836-c1836b56d798\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:25:21.267995 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.267747 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/32c79fa5-7cca-49d3-8836-c1836b56d798-web-config\") pod \"prometheus-k8s-0\" (UID: \"32c79fa5-7cca-49d3-8836-c1836b56d798\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:25:21.267995 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.267791 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/32c79fa5-7cca-49d3-8836-c1836b56d798-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"32c79fa5-7cca-49d3-8836-c1836b56d798\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:25:21.267995 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.267867 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/32c79fa5-7cca-49d3-8836-c1836b56d798-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"32c79fa5-7cca-49d3-8836-c1836b56d798\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:25:21.267995 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.267882 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bm47n\" (UniqueName: \"kubernetes.io/projected/32c79fa5-7cca-49d3-8836-c1836b56d798-kube-api-access-bm47n\") pod \"prometheus-k8s-0\" (UID: \"32c79fa5-7cca-49d3-8836-c1836b56d798\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:25:21.267995 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.267898 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/32c79fa5-7cca-49d3-8836-c1836b56d798-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"32c79fa5-7cca-49d3-8836-c1836b56d798\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:25:21.267995 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.267913 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/32c79fa5-7cca-49d3-8836-c1836b56d798-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"32c79fa5-7cca-49d3-8836-c1836b56d798\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:25:21.267995 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.267930 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/32c79fa5-7cca-49d3-8836-c1836b56d798-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"32c79fa5-7cca-49d3-8836-c1836b56d798\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:25:21.267995 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.267945 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/32c79fa5-7cca-49d3-8836-c1836b56d798-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"32c79fa5-7cca-49d3-8836-c1836b56d798\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:25:21.267995 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.267963 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/32c79fa5-7cca-49d3-8836-c1836b56d798-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"32c79fa5-7cca-49d3-8836-c1836b56d798\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:25:21.368950 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.368858 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/32c79fa5-7cca-49d3-8836-c1836b56d798-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"32c79fa5-7cca-49d3-8836-c1836b56d798\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:25:21.368950 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.368903 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/32c79fa5-7cca-49d3-8836-c1836b56d798-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"32c79fa5-7cca-49d3-8836-c1836b56d798\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:25:21.368950 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.368930 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/32c79fa5-7cca-49d3-8836-c1836b56d798-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"32c79fa5-7cca-49d3-8836-c1836b56d798\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:25:21.369231 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.368952 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/32c79fa5-7cca-49d3-8836-c1836b56d798-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"32c79fa5-7cca-49d3-8836-c1836b56d798\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:25:21.369231 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.368978 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/32c79fa5-7cca-49d3-8836-c1836b56d798-web-config\") pod \"prometheus-k8s-0\" (UID: \"32c79fa5-7cca-49d3-8836-c1836b56d798\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:25:21.369231 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.369005 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/32c79fa5-7cca-49d3-8836-c1836b56d798-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"32c79fa5-7cca-49d3-8836-c1836b56d798\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:25:21.369231 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.369045 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/32c79fa5-7cca-49d3-8836-c1836b56d798-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"32c79fa5-7cca-49d3-8836-c1836b56d798\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:25:21.369231 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.369069 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bm47n\" (UniqueName: \"kubernetes.io/projected/32c79fa5-7cca-49d3-8836-c1836b56d798-kube-api-access-bm47n\") pod \"prometheus-k8s-0\" (UID: \"32c79fa5-7cca-49d3-8836-c1836b56d798\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:25:21.369231 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.369093 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/32c79fa5-7cca-49d3-8836-c1836b56d798-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"32c79fa5-7cca-49d3-8836-c1836b56d798\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:25:21.369231 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.369113 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/32c79fa5-7cca-49d3-8836-c1836b56d798-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"32c79fa5-7cca-49d3-8836-c1836b56d798\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:25:21.369231 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.369163 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/32c79fa5-7cca-49d3-8836-c1836b56d798-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"32c79fa5-7cca-49d3-8836-c1836b56d798\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:25:21.369656 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.369260 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/32c79fa5-7cca-49d3-8836-c1836b56d798-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"32c79fa5-7cca-49d3-8836-c1836b56d798\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:25:21.369656 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.369294 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/32c79fa5-7cca-49d3-8836-c1836b56d798-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"32c79fa5-7cca-49d3-8836-c1836b56d798\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:25:21.369656 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.369324 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/32c79fa5-7cca-49d3-8836-c1836b56d798-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"32c79fa5-7cca-49d3-8836-c1836b56d798\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:25:21.369656 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.369406 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/32c79fa5-7cca-49d3-8836-c1836b56d798-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"32c79fa5-7cca-49d3-8836-c1836b56d798\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:25:21.369656 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.369439 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/32c79fa5-7cca-49d3-8836-c1836b56d798-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"32c79fa5-7cca-49d3-8836-c1836b56d798\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:25:21.369656 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.369466 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/32c79fa5-7cca-49d3-8836-c1836b56d798-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"32c79fa5-7cca-49d3-8836-c1836b56d798\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:25:21.369656 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.369493 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/32c79fa5-7cca-49d3-8836-c1836b56d798-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"32c79fa5-7cca-49d3-8836-c1836b56d798\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:25:21.369656 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.369520 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/32c79fa5-7cca-49d3-8836-c1836b56d798-config\") pod \"prometheus-k8s-0\" (UID: \"32c79fa5-7cca-49d3-8836-c1836b56d798\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:25:21.369656 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.369553 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/32c79fa5-7cca-49d3-8836-c1836b56d798-config-out\") pod \"prometheus-k8s-0\" (UID: \"32c79fa5-7cca-49d3-8836-c1836b56d798\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:25:21.370103 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.369755 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/32c79fa5-7cca-49d3-8836-c1836b56d798-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"32c79fa5-7cca-49d3-8836-c1836b56d798\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:25:21.370103 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.369896 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/32c79fa5-7cca-49d3-8836-c1836b56d798-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"32c79fa5-7cca-49d3-8836-c1836b56d798\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:25:21.370270 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.370245 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/32c79fa5-7cca-49d3-8836-c1836b56d798-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"32c79fa5-7cca-49d3-8836-c1836b56d798\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:25:21.370689 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.370615 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/32c79fa5-7cca-49d3-8836-c1836b56d798-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"32c79fa5-7cca-49d3-8836-c1836b56d798\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:25:21.370689 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.370677 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/32c79fa5-7cca-49d3-8836-c1836b56d798-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"32c79fa5-7cca-49d3-8836-c1836b56d798\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:25:21.370976 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.370940 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/32c79fa5-7cca-49d3-8836-c1836b56d798-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"32c79fa5-7cca-49d3-8836-c1836b56d798\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:25:21.371692 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.371667 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/32c79fa5-7cca-49d3-8836-c1836b56d798-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"32c79fa5-7cca-49d3-8836-c1836b56d798\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:25:21.371692 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.371983 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/32c79fa5-7cca-49d3-8836-c1836b56d798-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"32c79fa5-7cca-49d3-8836-c1836b56d798\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:25:21.374160 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.372498 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/32c79fa5-7cca-49d3-8836-c1836b56d798-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"32c79fa5-7cca-49d3-8836-c1836b56d798\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:25:21.374160 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.373373 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/32c79fa5-7cca-49d3-8836-c1836b56d798-web-config\") pod \"prometheus-k8s-0\" (UID: \"32c79fa5-7cca-49d3-8836-c1836b56d798\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:25:21.374160 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.373537 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/32c79fa5-7cca-49d3-8836-c1836b56d798-config\") pod \"prometheus-k8s-0\" (UID: \"32c79fa5-7cca-49d3-8836-c1836b56d798\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:25:21.374160 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.373810 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/32c79fa5-7cca-49d3-8836-c1836b56d798-config-out\") pod \"prometheus-k8s-0\" (UID: \"32c79fa5-7cca-49d3-8836-c1836b56d798\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:25:21.374404 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.374353 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/32c79fa5-7cca-49d3-8836-c1836b56d798-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"32c79fa5-7cca-49d3-8836-c1836b56d798\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:25:21.374404 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.374382 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/32c79fa5-7cca-49d3-8836-c1836b56d798-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"32c79fa5-7cca-49d3-8836-c1836b56d798\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:25:21.374508 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.374497 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/32c79fa5-7cca-49d3-8836-c1836b56d798-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"32c79fa5-7cca-49d3-8836-c1836b56d798\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:25:21.374566 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.374505 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/32c79fa5-7cca-49d3-8836-c1836b56d798-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"32c79fa5-7cca-49d3-8836-c1836b56d798\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:25:21.374778 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.374749 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/32c79fa5-7cca-49d3-8836-c1836b56d798-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"32c79fa5-7cca-49d3-8836-c1836b56d798\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:25:21.374778 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.374769 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/32c79fa5-7cca-49d3-8836-c1836b56d798-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"32c79fa5-7cca-49d3-8836-c1836b56d798\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:25:21.375396 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.375380 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/32c79fa5-7cca-49d3-8836-c1836b56d798-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"32c79fa5-7cca-49d3-8836-c1836b56d798\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:25:21.378304 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.378288 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bm47n\" (UniqueName: \"kubernetes.io/projected/32c79fa5-7cca-49d3-8836-c1836b56d798-kube-api-access-bm47n\") pod \"prometheus-k8s-0\" (UID: \"32c79fa5-7cca-49d3-8836-c1836b56d798\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:25:21.487501 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.487466 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:25:21.626598 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:21.626498 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 28 17:25:21.628673 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:25:21.628642 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32c79fa5_7cca_49d3_8836_c1836b56d798.slice/crio-d40170c93ccd3b4a2cd8c2a7261f55bcef19b7091b5e8886877fd596eda2cbd8 WatchSource:0}: Error finding container d40170c93ccd3b4a2cd8c2a7261f55bcef19b7091b5e8886877fd596eda2cbd8: Status 404 returned error can't find the container with id d40170c93ccd3b4a2cd8c2a7261f55bcef19b7091b5e8886877fd596eda2cbd8 Jul 28 17:25:22.113545 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:22.113512 2576 generic.go:356] "Generic (PLEG): container finished" podID="32c79fa5-7cca-49d3-8836-c1836b56d798" containerID="b7287370fbde6b71fcab9d4e9ecabfbb69de452da7385616bd642aca02088ab7" exitCode=0 Jul 28 17:25:22.113918 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:22.113583 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"32c79fa5-7cca-49d3-8836-c1836b56d798","Type":"ContainerDied","Data":"b7287370fbde6b71fcab9d4e9ecabfbb69de452da7385616bd642aca02088ab7"} Jul 28 17:25:22.113918 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:22.113651 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"32c79fa5-7cca-49d3-8836-c1836b56d798","Type":"ContainerStarted","Data":"d40170c93ccd3b4a2cd8c2a7261f55bcef19b7091b5e8886877fd596eda2cbd8"} Jul 28 17:25:22.240847 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:22.240814 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5f08643e-7ba6-4635-aee3-e0fb447f5fde" path="/var/lib/kubelet/pods/5f08643e-7ba6-4635-aee3-e0fb447f5fde/volumes" Jul 28 17:25:23.120816 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:23.120786 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"32c79fa5-7cca-49d3-8836-c1836b56d798","Type":"ContainerStarted","Data":"8685848004f94bb8bf168b912a072f56ac7db34cc877da66accb8ae2e44e0f87"} Jul 28 17:25:23.121197 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:23.120878 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"32c79fa5-7cca-49d3-8836-c1836b56d798","Type":"ContainerStarted","Data":"b1955d80570bf0a1c78fe9aa29d0f9f9c17ae23137f79bb9f5b4c1d5f3c4acb1"} Jul 28 17:25:23.121197 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:23.120904 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"32c79fa5-7cca-49d3-8836-c1836b56d798","Type":"ContainerStarted","Data":"573e2df4bedf1e12509759b1aaeb040578041e31229396592b12d573b910d7f0"} Jul 28 17:25:23.121197 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:23.120932 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"32c79fa5-7cca-49d3-8836-c1836b56d798","Type":"ContainerStarted","Data":"966a620008497348126819e3257d3a0c6bcd266056bad62edb0622156953fe09"} Jul 28 17:25:23.121197 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:23.120957 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"32c79fa5-7cca-49d3-8836-c1836b56d798","Type":"ContainerStarted","Data":"41948033bfa800159c4a081dc07bb5ec021b4d73a30ca47f3b3425a2673129ea"} Jul 28 17:25:23.121197 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:23.120980 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"32c79fa5-7cca-49d3-8836-c1836b56d798","Type":"ContainerStarted","Data":"4fe31dac055a0797e31a23abc486222aebfa1ec181fb640b087c6ad080303f9d"} Jul 28 17:25:23.173414 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:23.173362 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.155049909 podStartE2EDuration="2.173344109s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.2942ms" isStatefulPod=false podCreationTimestamp="2026-07-28 17:25:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:25:23.171111679 +0000 UTC m=+159.523465131" watchObservedRunningTime="2026-07-28 17:25:23.173344109 +0000 UTC m=+159.525697458" Jul 28 17:25:26.487673 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:25:26.487633 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:26:21.488652 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:26:21.488610 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:26:21.503668 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:26:21.503648 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:26:22.347970 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:26:22.347942 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:27:44.060515 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:27:44.060487 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kprz5_a44a458c-3e2b-4eff-aaa4-04496e296ff2/ovn-acl-logging/0.log" Jul 28 17:27:44.066625 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:27:44.066606 2576 kubelet.go:1648] "Image garbage collection succeeded" Jul 28 17:27:44.076708 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:27:44.076687 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kprz5_a44a458c-3e2b-4eff-aaa4-04496e296ff2/ovn-acl-logging/0.log" Jul 28 17:30:35.563591 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:30:35.563517 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/model-serving-api-7b954ffc95-4d4zt"] Jul 28 17:30:35.566554 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:30:35.566535 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/model-serving-api-7b954ffc95-4d4zt" Jul 28 17:30:35.569085 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:30:35.569057 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"model-serving-api-tls\"" Jul 28 17:30:35.569217 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:30:35.569088 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\"" Jul 28 17:30:35.569217 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:30:35.569136 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"model-serving-api-dockercfg-7wkt9\"" Jul 28 17:30:35.569886 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:30:35.569869 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\"" Jul 28 17:30:35.576225 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:30:35.576207 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/model-serving-api-7b954ffc95-4d4zt"] Jul 28 17:30:35.708273 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:30:35.708234 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ghp9f\" (UniqueName: \"kubernetes.io/projected/5cfbb0bd-5ab2-4371-8c32-73db33967202-kube-api-access-ghp9f\") pod \"model-serving-api-7b954ffc95-4d4zt\" (UID: \"5cfbb0bd-5ab2-4371-8c32-73db33967202\") " pod="kserve/model-serving-api-7b954ffc95-4d4zt" Jul 28 17:30:35.708472 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:30:35.708316 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5cfbb0bd-5ab2-4371-8c32-73db33967202-tls-certs\") pod \"model-serving-api-7b954ffc95-4d4zt\" (UID: \"5cfbb0bd-5ab2-4371-8c32-73db33967202\") " pod="kserve/model-serving-api-7b954ffc95-4d4zt" Jul 28 17:30:35.808997 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:30:35.808959 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ghp9f\" (UniqueName: \"kubernetes.io/projected/5cfbb0bd-5ab2-4371-8c32-73db33967202-kube-api-access-ghp9f\") pod \"model-serving-api-7b954ffc95-4d4zt\" (UID: \"5cfbb0bd-5ab2-4371-8c32-73db33967202\") " pod="kserve/model-serving-api-7b954ffc95-4d4zt" Jul 28 17:30:35.809210 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:30:35.809010 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5cfbb0bd-5ab2-4371-8c32-73db33967202-tls-certs\") pod \"model-serving-api-7b954ffc95-4d4zt\" (UID: \"5cfbb0bd-5ab2-4371-8c32-73db33967202\") " pod="kserve/model-serving-api-7b954ffc95-4d4zt" Jul 28 17:30:35.811378 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:30:35.811360 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5cfbb0bd-5ab2-4371-8c32-73db33967202-tls-certs\") pod \"model-serving-api-7b954ffc95-4d4zt\" (UID: \"5cfbb0bd-5ab2-4371-8c32-73db33967202\") " pod="kserve/model-serving-api-7b954ffc95-4d4zt" Jul 28 17:30:35.817840 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:30:35.817782 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ghp9f\" (UniqueName: \"kubernetes.io/projected/5cfbb0bd-5ab2-4371-8c32-73db33967202-kube-api-access-ghp9f\") pod \"model-serving-api-7b954ffc95-4d4zt\" (UID: \"5cfbb0bd-5ab2-4371-8c32-73db33967202\") " pod="kserve/model-serving-api-7b954ffc95-4d4zt" Jul 28 17:30:35.876739 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:30:35.876709 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/model-serving-api-7b954ffc95-4d4zt" Jul 28 17:30:36.003663 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:30:36.003580 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/model-serving-api-7b954ffc95-4d4zt"] Jul 28 17:30:36.007302 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:30:36.007273 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5cfbb0bd_5ab2_4371_8c32_73db33967202.slice/crio-d41ac2067002a70c7b1f8773a7f59c19f40b091f93641405a7c79dc15c8f80eb WatchSource:0}: Error finding container d41ac2067002a70c7b1f8773a7f59c19f40b091f93641405a7c79dc15c8f80eb: Status 404 returned error can't find the container with id d41ac2067002a70c7b1f8773a7f59c19f40b091f93641405a7c79dc15c8f80eb Jul 28 17:30:36.009037 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:30:36.009022 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 28 17:30:36.204664 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:30:36.204629 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/model-serving-api-7b954ffc95-4d4zt" event={"ID":"5cfbb0bd-5ab2-4371-8c32-73db33967202","Type":"ContainerStarted","Data":"d41ac2067002a70c7b1f8773a7f59c19f40b091f93641405a7c79dc15c8f80eb"} Jul 28 17:30:39.222489 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:30:39.222456 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/model-serving-api-7b954ffc95-4d4zt" event={"ID":"5cfbb0bd-5ab2-4371-8c32-73db33967202","Type":"ContainerStarted","Data":"9bf7990a34366789438998e8685a8adb4cd37ae8c68f160c362e6be536acdcbc"} Jul 28 17:30:39.222968 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:30:39.222587 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/model-serving-api-7b954ffc95-4d4zt" Jul 28 17:30:39.238618 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:30:39.238573 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/model-serving-api-7b954ffc95-4d4zt" podStartSLOduration=1.4284679759999999 podStartE2EDuration="4.238557978s" totalImagesPullingTime="2.810090002s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:30:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:30:39.237580177 +0000 UTC m=+475.589933520" watchObservedRunningTime="2026-07-28 17:30:39.238557978 +0000 UTC m=+475.590911328" Jul 28 17:30:50.230289 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:30:50.230259 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/model-serving-api-7b954ffc95-4d4zt" Jul 28 17:30:50.497997 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:30:50.497916 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/s3-init-szjl5"] Jul 28 17:30:50.501181 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:30:50.501165 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-szjl5" Jul 28 17:30:50.503805 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:30:50.503787 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-wfhr9\"" Jul 28 17:30:50.503890 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:30:50.503831 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"mlpipeline-s3-artifact\"" Jul 28 17:30:50.508832 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:30:50.508812 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/s3-init-szjl5"] Jul 28 17:30:50.629883 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:30:50.629854 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bbd5cd55-2a38-4e5e-8682-59d36b4d5773-model-cache\") pod \"s3-init-szjl5\" (UID: \"bbd5cd55-2a38-4e5e-8682-59d36b4d5773\") " pod="kserve/s3-init-szjl5" Jul 28 17:30:50.630042 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:30:50.629909 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2mh4r\" (UniqueName: \"kubernetes.io/projected/bbd5cd55-2a38-4e5e-8682-59d36b4d5773-kube-api-access-2mh4r\") pod \"s3-init-szjl5\" (UID: \"bbd5cd55-2a38-4e5e-8682-59d36b4d5773\") " pod="kserve/s3-init-szjl5" Jul 28 17:30:50.730687 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:30:50.730650 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bbd5cd55-2a38-4e5e-8682-59d36b4d5773-model-cache\") pod \"s3-init-szjl5\" (UID: \"bbd5cd55-2a38-4e5e-8682-59d36b4d5773\") " pod="kserve/s3-init-szjl5" Jul 28 17:30:50.730873 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:30:50.730706 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2mh4r\" (UniqueName: \"kubernetes.io/projected/bbd5cd55-2a38-4e5e-8682-59d36b4d5773-kube-api-access-2mh4r\") pod \"s3-init-szjl5\" (UID: \"bbd5cd55-2a38-4e5e-8682-59d36b4d5773\") " pod="kserve/s3-init-szjl5" Jul 28 17:30:50.731011 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:30:50.730990 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bbd5cd55-2a38-4e5e-8682-59d36b4d5773-model-cache\") pod \"s3-init-szjl5\" (UID: \"bbd5cd55-2a38-4e5e-8682-59d36b4d5773\") " pod="kserve/s3-init-szjl5" Jul 28 17:30:50.739248 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:30:50.739227 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2mh4r\" (UniqueName: \"kubernetes.io/projected/bbd5cd55-2a38-4e5e-8682-59d36b4d5773-kube-api-access-2mh4r\") pod \"s3-init-szjl5\" (UID: \"bbd5cd55-2a38-4e5e-8682-59d36b4d5773\") " pod="kserve/s3-init-szjl5" Jul 28 17:30:50.819794 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:30:50.819723 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-szjl5" Jul 28 17:30:50.944717 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:30:50.944686 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/s3-init-szjl5"] Jul 28 17:30:50.947469 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:30:50.947434 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbbd5cd55_2a38_4e5e_8682_59d36b4d5773.slice/crio-ee46bfdf43e363420917a69d5d846cb129c60b079a6e9fba5e3dda53c7044ed8 WatchSource:0}: Error finding container ee46bfdf43e363420917a69d5d846cb129c60b079a6e9fba5e3dda53c7044ed8: Status 404 returned error can't find the container with id ee46bfdf43e363420917a69d5d846cb129c60b079a6e9fba5e3dda53c7044ed8 Jul 28 17:30:51.265707 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:30:51.265675 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-szjl5" event={"ID":"bbd5cd55-2a38-4e5e-8682-59d36b4d5773","Type":"ContainerStarted","Data":"ee46bfdf43e363420917a69d5d846cb129c60b079a6e9fba5e3dda53c7044ed8"} Jul 28 17:30:54.277448 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:30:54.277399 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-szjl5" event={"ID":"bbd5cd55-2a38-4e5e-8682-59d36b4d5773","Type":"ContainerStarted","Data":"2104f05087b35e65c9d81edded94124034c7d4ad5977a3d4e0a07443a150610f"} Jul 28 17:32:44.083790 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:32:44.083763 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kprz5_a44a458c-3e2b-4eff-aaa4-04496e296ff2/ovn-acl-logging/0.log" Jul 28 17:32:44.098030 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:32:44.098009 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kprz5_a44a458c-3e2b-4eff-aaa4-04496e296ff2/ovn-acl-logging/0.log" Jul 28 17:35:56.014584 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:35:56.014550 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-5cv8s/must-gather-sw2h4"] Jul 28 17:35:56.017893 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:35:56.017873 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5cv8s/must-gather-sw2h4" Jul 28 17:35:56.020561 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:35:56.020535 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-5cv8s\"/\"default-dockercfg-2792s\"" Jul 28 17:35:56.020561 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:35:56.020549 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-5cv8s\"/\"kube-root-ca.crt\"" Jul 28 17:35:56.020732 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:35:56.020619 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-5cv8s\"/\"openshift-service-ca.crt\"" Jul 28 17:35:56.028241 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:35:56.028216 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-5cv8s/must-gather-sw2h4"] Jul 28 17:35:56.096176 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:35:56.096151 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/cf1db57c-a994-446c-9234-1b5b9a8be9ce-must-gather-output\") pod \"must-gather-sw2h4\" (UID: \"cf1db57c-a994-446c-9234-1b5b9a8be9ce\") " pod="openshift-must-gather-5cv8s/must-gather-sw2h4" Jul 28 17:35:56.096176 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:35:56.096178 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8cprg\" (UniqueName: \"kubernetes.io/projected/cf1db57c-a994-446c-9234-1b5b9a8be9ce-kube-api-access-8cprg\") pod \"must-gather-sw2h4\" (UID: \"cf1db57c-a994-446c-9234-1b5b9a8be9ce\") " pod="openshift-must-gather-5cv8s/must-gather-sw2h4" Jul 28 17:35:56.197011 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:35:56.196975 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/cf1db57c-a994-446c-9234-1b5b9a8be9ce-must-gather-output\") pod \"must-gather-sw2h4\" (UID: \"cf1db57c-a994-446c-9234-1b5b9a8be9ce\") " pod="openshift-must-gather-5cv8s/must-gather-sw2h4" Jul 28 17:35:56.197011 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:35:56.197013 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8cprg\" (UniqueName: \"kubernetes.io/projected/cf1db57c-a994-446c-9234-1b5b9a8be9ce-kube-api-access-8cprg\") pod \"must-gather-sw2h4\" (UID: \"cf1db57c-a994-446c-9234-1b5b9a8be9ce\") " pod="openshift-must-gather-5cv8s/must-gather-sw2h4" Jul 28 17:35:56.197378 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:35:56.197356 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/cf1db57c-a994-446c-9234-1b5b9a8be9ce-must-gather-output\") pod \"must-gather-sw2h4\" (UID: \"cf1db57c-a994-446c-9234-1b5b9a8be9ce\") " pod="openshift-must-gather-5cv8s/must-gather-sw2h4" Jul 28 17:35:56.204669 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:35:56.204638 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8cprg\" (UniqueName: \"kubernetes.io/projected/cf1db57c-a994-446c-9234-1b5b9a8be9ce-kube-api-access-8cprg\") pod \"must-gather-sw2h4\" (UID: \"cf1db57c-a994-446c-9234-1b5b9a8be9ce\") " pod="openshift-must-gather-5cv8s/must-gather-sw2h4" Jul 28 17:35:56.326973 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:35:56.326889 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5cv8s/must-gather-sw2h4" Jul 28 17:35:56.453142 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:35:56.453104 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-5cv8s/must-gather-sw2h4"] Jul 28 17:35:56.455720 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:35:56.455689 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcf1db57c_a994_446c_9234_1b5b9a8be9ce.slice/crio-ca1433bfaa8bced178c1b0195fc0a4ff52384f0e634f65df9f8977b5a27b9d62 WatchSource:0}: Error finding container ca1433bfaa8bced178c1b0195fc0a4ff52384f0e634f65df9f8977b5a27b9d62: Status 404 returned error can't find the container with id ca1433bfaa8bced178c1b0195fc0a4ff52384f0e634f65df9f8977b5a27b9d62 Jul 28 17:35:56.457506 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:35:56.457487 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 28 17:35:57.373868 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:35:57.373785 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5cv8s/must-gather-sw2h4" event={"ID":"cf1db57c-a994-446c-9234-1b5b9a8be9ce","Type":"ContainerStarted","Data":"ca1433bfaa8bced178c1b0195fc0a4ff52384f0e634f65df9f8977b5a27b9d62"} Jul 28 17:36:03.402535 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:36:03.402500 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5cv8s/must-gather-sw2h4" event={"ID":"cf1db57c-a994-446c-9234-1b5b9a8be9ce","Type":"ContainerStarted","Data":"c943711d6f7f7c5d355400b207d3b329745b1b84f96c1a8f2666227842b5285c"} Jul 28 17:36:03.402535 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:36:03.402543 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5cv8s/must-gather-sw2h4" event={"ID":"cf1db57c-a994-446c-9234-1b5b9a8be9ce","Type":"ContainerStarted","Data":"af19a55d6d86dafdffa1d390ec4ad0211038fd0aec95f8356e3ea34dd713f2e8"} Jul 28 17:36:03.418385 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:36:03.418329 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-5cv8s/must-gather-sw2h4" podStartSLOduration=1.906758032 podStartE2EDuration="8.41830795s" totalImagesPullingTime="6.511549918s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:35:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:36:03.417196763 +0000 UTC m=+799.769550113" watchObservedRunningTime="2026-07-28 17:36:03.41830795 +0000 UTC m=+799.770661303" Jul 28 17:36:16.455370 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:36:16.455337 2576 generic.go:356] "Generic (PLEG): container finished" podID="cf1db57c-a994-446c-9234-1b5b9a8be9ce" containerID="af19a55d6d86dafdffa1d390ec4ad0211038fd0aec95f8356e3ea34dd713f2e8" exitCode=0 Jul 28 17:36:16.455804 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:36:16.455403 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5cv8s/must-gather-sw2h4" event={"ID":"cf1db57c-a994-446c-9234-1b5b9a8be9ce","Type":"ContainerDied","Data":"af19a55d6d86dafdffa1d390ec4ad0211038fd0aec95f8356e3ea34dd713f2e8"} Jul 28 17:36:16.455804 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:36:16.455724 2576 scope.go:117] "RemoveContainer" containerID="af19a55d6d86dafdffa1d390ec4ad0211038fd0aec95f8356e3ea34dd713f2e8" Jul 28 17:36:16.727845 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:36:16.727754 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-5cv8s_must-gather-sw2h4_cf1db57c-a994-446c-9234-1b5b9a8be9ce/gather/0.log" Jul 28 17:36:20.063808 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:36:20.063782 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-7krxm_98a4008a-5635-4697-abdf-0dc44f6e3b87/global-pull-secret-syncer/0.log" Jul 28 17:36:20.284722 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:36:20.284693 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-tb4pl_31ac4453-76a9-4596-ac57-682b8417c6e7/konnectivity-agent/0.log" Jul 28 17:36:20.309372 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:36:20.309350 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-129-31.ec2.internal_85547fd26d62ca170d8549b389f25e88/haproxy/0.log" Jul 28 17:36:22.111362 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:36:22.111331 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-5cv8s/must-gather-sw2h4"] Jul 28 17:36:22.111794 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:36:22.111511 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-must-gather-5cv8s/must-gather-sw2h4" podUID="cf1db57c-a994-446c-9234-1b5b9a8be9ce" containerName="copy" containerID="cri-o://c943711d6f7f7c5d355400b207d3b329745b1b84f96c1a8f2666227842b5285c" gracePeriod=2 Jul 28 17:36:22.116145 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:36:22.115889 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-5cv8s/must-gather-sw2h4"] Jul 28 17:36:22.331100 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:36:22.331079 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-5cv8s_must-gather-sw2h4_cf1db57c-a994-446c-9234-1b5b9a8be9ce/copy/0.log" Jul 28 17:36:22.332866 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:36:22.332847 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5cv8s/must-gather-sw2h4" Jul 28 17:36:22.427338 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:36:22.427311 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/cf1db57c-a994-446c-9234-1b5b9a8be9ce-must-gather-output\") pod \"cf1db57c-a994-446c-9234-1b5b9a8be9ce\" (UID: \"cf1db57c-a994-446c-9234-1b5b9a8be9ce\") " Jul 28 17:36:22.427563 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:36:22.427384 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8cprg\" (UniqueName: \"kubernetes.io/projected/cf1db57c-a994-446c-9234-1b5b9a8be9ce-kube-api-access-8cprg\") pod \"cf1db57c-a994-446c-9234-1b5b9a8be9ce\" (UID: \"cf1db57c-a994-446c-9234-1b5b9a8be9ce\") " Jul 28 17:36:22.427816 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:36:22.427791 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf1db57c-a994-446c-9234-1b5b9a8be9ce-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "cf1db57c-a994-446c-9234-1b5b9a8be9ce" (UID: "cf1db57c-a994-446c-9234-1b5b9a8be9ce"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 17:36:22.429508 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:36:22.429484 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf1db57c-a994-446c-9234-1b5b9a8be9ce-kube-api-access-8cprg" (OuterVolumeSpecName: "kube-api-access-8cprg") pod "cf1db57c-a994-446c-9234-1b5b9a8be9ce" (UID: "cf1db57c-a994-446c-9234-1b5b9a8be9ce"). InnerVolumeSpecName "kube-api-access-8cprg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 17:36:22.479522 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:36:22.479495 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-5cv8s_must-gather-sw2h4_cf1db57c-a994-446c-9234-1b5b9a8be9ce/copy/0.log" Jul 28 17:36:22.479860 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:36:22.479838 2576 generic.go:356] "Generic (PLEG): container finished" podID="cf1db57c-a994-446c-9234-1b5b9a8be9ce" containerID="c943711d6f7f7c5d355400b207d3b329745b1b84f96c1a8f2666227842b5285c" exitCode=143 Jul 28 17:36:22.479947 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:36:22.479888 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5cv8s/must-gather-sw2h4" Jul 28 17:36:22.479947 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:36:22.479935 2576 scope.go:117] "RemoveContainer" containerID="c943711d6f7f7c5d355400b207d3b329745b1b84f96c1a8f2666227842b5285c" Jul 28 17:36:22.488082 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:36:22.488060 2576 scope.go:117] "RemoveContainer" containerID="af19a55d6d86dafdffa1d390ec4ad0211038fd0aec95f8356e3ea34dd713f2e8" Jul 28 17:36:22.499409 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:36:22.499390 2576 scope.go:117] "RemoveContainer" containerID="c943711d6f7f7c5d355400b207d3b329745b1b84f96c1a8f2666227842b5285c" Jul 28 17:36:22.499683 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:36:22.499664 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c943711d6f7f7c5d355400b207d3b329745b1b84f96c1a8f2666227842b5285c\": container with ID starting with c943711d6f7f7c5d355400b207d3b329745b1b84f96c1a8f2666227842b5285c not found: ID does not exist" containerID="c943711d6f7f7c5d355400b207d3b329745b1b84f96c1a8f2666227842b5285c" Jul 28 17:36:22.499736 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:36:22.499692 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c943711d6f7f7c5d355400b207d3b329745b1b84f96c1a8f2666227842b5285c"} err="failed to get container status \"c943711d6f7f7c5d355400b207d3b329745b1b84f96c1a8f2666227842b5285c\": rpc error: code = NotFound desc = could not find container \"c943711d6f7f7c5d355400b207d3b329745b1b84f96c1a8f2666227842b5285c\": container with ID starting with c943711d6f7f7c5d355400b207d3b329745b1b84f96c1a8f2666227842b5285c not found: ID does not exist" Jul 28 17:36:22.499736 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:36:22.499712 2576 scope.go:117] "RemoveContainer" containerID="af19a55d6d86dafdffa1d390ec4ad0211038fd0aec95f8356e3ea34dd713f2e8" Jul 28 17:36:22.499956 ip-10-0-129-31 kubenswrapper[2576]: E0728 17:36:22.499936 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"af19a55d6d86dafdffa1d390ec4ad0211038fd0aec95f8356e3ea34dd713f2e8\": container with ID starting with af19a55d6d86dafdffa1d390ec4ad0211038fd0aec95f8356e3ea34dd713f2e8 not found: ID does not exist" containerID="af19a55d6d86dafdffa1d390ec4ad0211038fd0aec95f8356e3ea34dd713f2e8" Jul 28 17:36:22.499998 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:36:22.499963 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af19a55d6d86dafdffa1d390ec4ad0211038fd0aec95f8356e3ea34dd713f2e8"} err="failed to get container status \"af19a55d6d86dafdffa1d390ec4ad0211038fd0aec95f8356e3ea34dd713f2e8\": rpc error: code = NotFound desc = could not find container \"af19a55d6d86dafdffa1d390ec4ad0211038fd0aec95f8356e3ea34dd713f2e8\": container with ID starting with af19a55d6d86dafdffa1d390ec4ad0211038fd0aec95f8356e3ea34dd713f2e8 not found: ID does not exist" Jul 28 17:36:22.528881 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:36:22.528850 2576 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/cf1db57c-a994-446c-9234-1b5b9a8be9ce-must-gather-output\") on node \"ip-10-0-129-31.ec2.internal\" DevicePath \"\"" Jul 28 17:36:22.528881 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:36:22.528876 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8cprg\" (UniqueName: \"kubernetes.io/projected/cf1db57c-a994-446c-9234-1b5b9a8be9ce-kube-api-access-8cprg\") on node \"ip-10-0-129-31.ec2.internal\" DevicePath \"\"" Jul 28 17:36:24.238751 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:36:24.238721 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cf1db57c-a994-446c-9234-1b5b9a8be9ce" path="/var/lib/kubelet/pods/cf1db57c-a994-446c-9234-1b5b9a8be9ce/volumes" Jul 28 17:36:25.019256 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:36:25.019169 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-wlzdr_3d43e446-eb2c-4dbf-8358-3d41c4120e6a/kube-state-metrics/0.log" Jul 28 17:36:25.043857 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:36:25.043827 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-wlzdr_3d43e446-eb2c-4dbf-8358-3d41c4120e6a/kube-rbac-proxy-main/0.log" Jul 28 17:36:25.072561 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:36:25.072537 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-wlzdr_3d43e446-eb2c-4dbf-8358-3d41c4120e6a/kube-rbac-proxy-self/0.log" Jul 28 17:36:25.105258 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:36:25.105235 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-5f68856876-dgt2s_38e47062-b657-40a4-9088-7bc23f0c7151/metrics-server/0.log" Jul 28 17:36:25.133824 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:36:25.133804 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-68b7fc9574-sslwd_7f8c4c27-65a5-41b8-8516-50196ef8dc12/monitoring-plugin/0.log" Jul 28 17:36:25.341188 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:36:25.341098 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-x29k4_3b0a9fac-7aa5-4758-9831-2135c1dcc534/node-exporter/0.log" Jul 28 17:36:25.366581 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:36:25.366556 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-x29k4_3b0a9fac-7aa5-4758-9831-2135c1dcc534/kube-rbac-proxy/0.log" Jul 28 17:36:25.394017 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:36:25.393996 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-x29k4_3b0a9fac-7aa5-4758-9831-2135c1dcc534/init-textfile/0.log" Jul 28 17:36:25.424276 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:36:25.424239 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-zj5sc_c4063b0e-9185-4cbd-9739-1cbff5b3e338/kube-rbac-proxy-main/0.log" Jul 28 17:36:25.453720 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:36:25.453694 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-zj5sc_c4063b0e-9185-4cbd-9739-1cbff5b3e338/kube-rbac-proxy-self/0.log" Jul 28 17:36:25.478601 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:36:25.478578 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-zj5sc_c4063b0e-9185-4cbd-9739-1cbff5b3e338/openshift-state-metrics/0.log" Jul 28 17:36:25.516898 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:36:25.516866 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_32c79fa5-7cca-49d3-8836-c1836b56d798/prometheus/0.log" Jul 28 17:36:25.541844 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:36:25.541819 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_32c79fa5-7cca-49d3-8836-c1836b56d798/config-reloader/0.log" Jul 28 17:36:25.565525 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:36:25.565500 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_32c79fa5-7cca-49d3-8836-c1836b56d798/thanos-sidecar/0.log" Jul 28 17:36:25.591392 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:36:25.591330 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_32c79fa5-7cca-49d3-8836-c1836b56d798/kube-rbac-proxy-web/0.log" Jul 28 17:36:25.613507 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:36:25.613487 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_32c79fa5-7cca-49d3-8836-c1836b56d798/kube-rbac-proxy/0.log" Jul 28 17:36:25.641389 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:36:25.641370 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_32c79fa5-7cca-49d3-8836-c1836b56d798/kube-rbac-proxy-thanos/0.log" Jul 28 17:36:25.665060 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:36:25.665040 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_32c79fa5-7cca-49d3-8836-c1836b56d798/init-config-reloader/0.log" Jul 28 17:36:28.800296 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:36:28.800264 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-np94q/perf-node-gather-daemonset-j55v5"] Jul 28 17:36:28.800685 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:36:28.800532 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf1db57c-a994-446c-9234-1b5b9a8be9ce" containerName="gather" Jul 28 17:36:28.800685 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:36:28.800542 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf1db57c-a994-446c-9234-1b5b9a8be9ce" containerName="gather" Jul 28 17:36:28.800685 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:36:28.800557 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf1db57c-a994-446c-9234-1b5b9a8be9ce" containerName="copy" Jul 28 17:36:28.800685 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:36:28.800562 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf1db57c-a994-446c-9234-1b5b9a8be9ce" containerName="copy" Jul 28 17:36:28.800685 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:36:28.800602 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="cf1db57c-a994-446c-9234-1b5b9a8be9ce" containerName="gather" Jul 28 17:36:28.800685 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:36:28.800611 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="cf1db57c-a994-446c-9234-1b5b9a8be9ce" containerName="copy" Jul 28 17:36:28.804280 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:36:28.804260 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-np94q/perf-node-gather-daemonset-j55v5" Jul 28 17:36:28.807036 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:36:28.807013 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-np94q\"/\"default-dockercfg-67784\"" Jul 28 17:36:28.807178 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:36:28.807037 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-np94q\"/\"openshift-service-ca.crt\"" Jul 28 17:36:28.807178 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:36:28.807075 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-np94q\"/\"kube-root-ca.crt\"" Jul 28 17:36:28.813699 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:36:28.813668 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-np94q/perf-node-gather-daemonset-j55v5"] Jul 28 17:36:28.980163 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:36:28.980110 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/242920a4-7a17-486d-ab37-6833c882fcfc-sys\") pod \"perf-node-gather-daemonset-j55v5\" (UID: \"242920a4-7a17-486d-ab37-6833c882fcfc\") " pod="openshift-must-gather-np94q/perf-node-gather-daemonset-j55v5" Jul 28 17:36:28.980329 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:36:28.980173 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-prvk2\" (UniqueName: \"kubernetes.io/projected/242920a4-7a17-486d-ab37-6833c882fcfc-kube-api-access-prvk2\") pod \"perf-node-gather-daemonset-j55v5\" (UID: \"242920a4-7a17-486d-ab37-6833c882fcfc\") " pod="openshift-must-gather-np94q/perf-node-gather-daemonset-j55v5" Jul 28 17:36:28.980329 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:36:28.980236 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/242920a4-7a17-486d-ab37-6833c882fcfc-proc\") pod \"perf-node-gather-daemonset-j55v5\" (UID: \"242920a4-7a17-486d-ab37-6833c882fcfc\") " pod="openshift-must-gather-np94q/perf-node-gather-daemonset-j55v5" Jul 28 17:36:28.980329 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:36:28.980262 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/242920a4-7a17-486d-ab37-6833c882fcfc-lib-modules\") pod \"perf-node-gather-daemonset-j55v5\" (UID: \"242920a4-7a17-486d-ab37-6833c882fcfc\") " pod="openshift-must-gather-np94q/perf-node-gather-daemonset-j55v5" Jul 28 17:36:28.980329 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:36:28.980281 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/242920a4-7a17-486d-ab37-6833c882fcfc-podres\") pod \"perf-node-gather-daemonset-j55v5\" (UID: \"242920a4-7a17-486d-ab37-6833c882fcfc\") " pod="openshift-must-gather-np94q/perf-node-gather-daemonset-j55v5" Jul 28 17:36:29.081226 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:36:29.081113 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/242920a4-7a17-486d-ab37-6833c882fcfc-proc\") pod \"perf-node-gather-daemonset-j55v5\" (UID: \"242920a4-7a17-486d-ab37-6833c882fcfc\") " pod="openshift-must-gather-np94q/perf-node-gather-daemonset-j55v5" Jul 28 17:36:29.081226 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:36:29.081181 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/242920a4-7a17-486d-ab37-6833c882fcfc-lib-modules\") pod \"perf-node-gather-daemonset-j55v5\" (UID: \"242920a4-7a17-486d-ab37-6833c882fcfc\") " pod="openshift-must-gather-np94q/perf-node-gather-daemonset-j55v5" Jul 28 17:36:29.081226 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:36:29.081211 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/242920a4-7a17-486d-ab37-6833c882fcfc-podres\") pod \"perf-node-gather-daemonset-j55v5\" (UID: \"242920a4-7a17-486d-ab37-6833c882fcfc\") " pod="openshift-must-gather-np94q/perf-node-gather-daemonset-j55v5" Jul 28 17:36:29.081535 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:36:29.081240 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/242920a4-7a17-486d-ab37-6833c882fcfc-sys\") pod \"perf-node-gather-daemonset-j55v5\" (UID: \"242920a4-7a17-486d-ab37-6833c882fcfc\") " pod="openshift-must-gather-np94q/perf-node-gather-daemonset-j55v5" Jul 28 17:36:29.081535 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:36:29.081246 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/242920a4-7a17-486d-ab37-6833c882fcfc-proc\") pod \"perf-node-gather-daemonset-j55v5\" (UID: \"242920a4-7a17-486d-ab37-6833c882fcfc\") " pod="openshift-must-gather-np94q/perf-node-gather-daemonset-j55v5" Jul 28 17:36:29.081535 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:36:29.081286 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-prvk2\" (UniqueName: \"kubernetes.io/projected/242920a4-7a17-486d-ab37-6833c882fcfc-kube-api-access-prvk2\") pod \"perf-node-gather-daemonset-j55v5\" (UID: \"242920a4-7a17-486d-ab37-6833c882fcfc\") " pod="openshift-must-gather-np94q/perf-node-gather-daemonset-j55v5" Jul 28 17:36:29.081535 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:36:29.081302 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/242920a4-7a17-486d-ab37-6833c882fcfc-sys\") pod \"perf-node-gather-daemonset-j55v5\" (UID: \"242920a4-7a17-486d-ab37-6833c882fcfc\") " pod="openshift-must-gather-np94q/perf-node-gather-daemonset-j55v5" Jul 28 17:36:29.081535 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:36:29.081373 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/242920a4-7a17-486d-ab37-6833c882fcfc-podres\") pod \"perf-node-gather-daemonset-j55v5\" (UID: \"242920a4-7a17-486d-ab37-6833c882fcfc\") " pod="openshift-must-gather-np94q/perf-node-gather-daemonset-j55v5" Jul 28 17:36:29.081535 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:36:29.081373 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/242920a4-7a17-486d-ab37-6833c882fcfc-lib-modules\") pod \"perf-node-gather-daemonset-j55v5\" (UID: \"242920a4-7a17-486d-ab37-6833c882fcfc\") " pod="openshift-must-gather-np94q/perf-node-gather-daemonset-j55v5" Jul 28 17:36:29.089333 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:36:29.089313 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-prvk2\" (UniqueName: \"kubernetes.io/projected/242920a4-7a17-486d-ab37-6833c882fcfc-kube-api-access-prvk2\") pod \"perf-node-gather-daemonset-j55v5\" (UID: \"242920a4-7a17-486d-ab37-6833c882fcfc\") " pod="openshift-must-gather-np94q/perf-node-gather-daemonset-j55v5" Jul 28 17:36:29.114387 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:36:29.114357 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-np94q/perf-node-gather-daemonset-j55v5" Jul 28 17:36:29.237070 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:36:29.237039 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-np94q/perf-node-gather-daemonset-j55v5"] Jul 28 17:36:29.240917 ip-10-0-129-31 kubenswrapper[2576]: W0728 17:36:29.240895 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod242920a4_7a17_486d_ab37_6833c882fcfc.slice/crio-c9d669f9f79f7d8da777baee8dc9dce81d284660996524ddd5aa1910fd482105 WatchSource:0}: Error finding container c9d669f9f79f7d8da777baee8dc9dce81d284660996524ddd5aa1910fd482105: Status 404 returned error can't find the container with id c9d669f9f79f7d8da777baee8dc9dce81d284660996524ddd5aa1910fd482105 Jul 28 17:36:29.506691 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:36:29.506656 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-np94q/perf-node-gather-daemonset-j55v5" event={"ID":"242920a4-7a17-486d-ab37-6833c882fcfc","Type":"ContainerStarted","Data":"ba5ff8625335915598bd9a79df3010ca5dfdb03fd054a3ba86af50d811d31f17"} Jul 28 17:36:29.506892 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:36:29.506717 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-np94q/perf-node-gather-daemonset-j55v5" event={"ID":"242920a4-7a17-486d-ab37-6833c882fcfc","Type":"ContainerStarted","Data":"c9d669f9f79f7d8da777baee8dc9dce81d284660996524ddd5aa1910fd482105"} Jul 28 17:36:29.506892 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:36:29.506786 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-np94q/perf-node-gather-daemonset-j55v5" Jul 28 17:36:29.522511 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:36:29.522472 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-np94q/perf-node-gather-daemonset-j55v5" podStartSLOduration=1.522457717 podStartE2EDuration="1.522457717s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 17:36:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:36:29.522163084 +0000 UTC m=+825.874516435" watchObservedRunningTime="2026-07-28 17:36:29.522457717 +0000 UTC m=+825.874811091" Jul 28 17:36:30.020245 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:36:30.020202 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-hp9s5_5c83f00d-3c63-47ae-b2f7-e91d74db4565/dns/0.log" Jul 28 17:36:30.046077 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:36:30.046053 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-hp9s5_5c83f00d-3c63-47ae-b2f7-e91d74db4565/kube-rbac-proxy/0.log" Jul 28 17:36:30.095492 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:36:30.095466 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-66rwd_269df47c-be5d-458f-8423-f032804bc81a/dns-node-resolver/0.log" Jul 28 17:36:30.553859 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:36:30.553833 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-786774f45-chdbb_0ac092e1-4b2d-4389-b663-816623ed37cd/registry/0.log" Jul 28 17:36:30.575596 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:36:30.575570 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-brrsh_d8e62687-ca38-4624-ab1c-70a23dbe0140/node-ca/0.log" Jul 28 17:36:31.774779 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:36:31.774740 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-xl7m9_4c9faa95-82c3-4808-8c53-c16bf9dbdbf9/serve-healthcheck-canary/0.log" Jul 28 17:36:32.214861 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:36:32.214833 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jnlp5_0cf93cde-5412-4319-92c1-95a1b7c97c5f/kube-rbac-proxy/0.log" Jul 28 17:36:32.240690 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:36:32.240665 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jnlp5_0cf93cde-5412-4319-92c1-95a1b7c97c5f/exporter/0.log" Jul 28 17:36:32.268478 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:36:32.268453 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jnlp5_0cf93cde-5412-4319-92c1-95a1b7c97c5f/extractor/0.log" Jul 28 17:36:34.714724 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:36:34.714697 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_model-serving-api-7b954ffc95-4d4zt_5cfbb0bd-5ab2-4371-8c32-73db33967202/server/0.log" Jul 28 17:36:34.823752 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:36:34.823722 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-init-szjl5_bbd5cd55-2a38-4e5e-8682-59d36b4d5773/download-hf-model/0.log" Jul 28 17:36:35.521040 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:36:35.521015 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-np94q/perf-node-gather-daemonset-j55v5" Jul 28 17:36:40.745126 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:36:40.745100 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nbcx6_d3519015-daca-4781-ac23-4156cb19876f/kube-multus-additional-cni-plugins/0.log" Jul 28 17:36:40.767668 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:36:40.767642 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nbcx6_d3519015-daca-4781-ac23-4156cb19876f/egress-router-binary-copy/0.log" Jul 28 17:36:40.790623 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:36:40.790601 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nbcx6_d3519015-daca-4781-ac23-4156cb19876f/cni-plugins/0.log" Jul 28 17:36:40.815622 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:36:40.815602 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nbcx6_d3519015-daca-4781-ac23-4156cb19876f/bond-cni-plugin/0.log" Jul 28 17:36:40.844551 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:36:40.844532 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nbcx6_d3519015-daca-4781-ac23-4156cb19876f/routeoverride-cni/0.log" Jul 28 17:36:40.868741 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:36:40.868721 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nbcx6_d3519015-daca-4781-ac23-4156cb19876f/whereabouts-cni-bincopy/0.log" Jul 28 17:36:40.891825 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:36:40.891808 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nbcx6_d3519015-daca-4781-ac23-4156cb19876f/whereabouts-cni/0.log" Jul 28 17:36:41.092954 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:36:41.092888 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-cgwb8_7b971e2f-14bd-4ff9-a4ee-c3a81e63a311/kube-multus/0.log" Jul 28 17:36:41.209316 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:36:41.209293 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-mh4wt_de584b57-28d6-4931-b323-1e262b172270/network-metrics-daemon/0.log" Jul 28 17:36:41.239344 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:36:41.239307 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-mh4wt_de584b57-28d6-4931-b323-1e262b172270/kube-rbac-proxy/0.log" Jul 28 17:36:42.233922 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:36:42.233888 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kprz5_a44a458c-3e2b-4eff-aaa4-04496e296ff2/ovn-controller/0.log" Jul 28 17:36:42.255978 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:36:42.255954 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kprz5_a44a458c-3e2b-4eff-aaa4-04496e296ff2/ovn-acl-logging/1.log" Jul 28 17:36:42.256109 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:36:42.255982 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kprz5_a44a458c-3e2b-4eff-aaa4-04496e296ff2/ovn-acl-logging/0.log" Jul 28 17:36:42.275633 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:36:42.275609 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kprz5_a44a458c-3e2b-4eff-aaa4-04496e296ff2/kube-rbac-proxy-node/0.log" Jul 28 17:36:42.301400 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:36:42.301381 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kprz5_a44a458c-3e2b-4eff-aaa4-04496e296ff2/kube-rbac-proxy-ovn-metrics/0.log" Jul 28 17:36:42.324603 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:36:42.324577 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kprz5_a44a458c-3e2b-4eff-aaa4-04496e296ff2/northd/0.log" Jul 28 17:36:42.347384 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:36:42.347363 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kprz5_a44a458c-3e2b-4eff-aaa4-04496e296ff2/nbdb/0.log" Jul 28 17:36:42.369592 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:36:42.369566 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kprz5_a44a458c-3e2b-4eff-aaa4-04496e296ff2/sbdb/0.log" Jul 28 17:36:42.409463 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:36:42.409438 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kprz5_a44a458c-3e2b-4eff-aaa4-04496e296ff2/ovnkube-controller/0.log" Jul 28 17:36:43.856034 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:36:43.856008 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-j2hsj_17d12e69-fb0c-4161-a579-875ca2f629a6/network-check-target-container/0.log" Jul 28 17:36:44.938900 ip-10-0-129-31 kubenswrapper[2576]: I0728 17:36:44.938878 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-5gbk6_0b73fe8a-a195-4bbb-a5c8-481a196280af/iptables-alerter/0.log"