Jul 21 20:35:07.124342 ip-10-0-131-27 systemd[1]: Starting Kubernetes Kubelet... Jul 21 20:35:07.558705 ip-10-0-131-27 kubenswrapper[2560]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 21 20:35:07.558705 ip-10-0-131-27 kubenswrapper[2560]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 21 20:35:07.558705 ip-10-0-131-27 kubenswrapper[2560]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 21 20:35:07.558705 ip-10-0-131-27 kubenswrapper[2560]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 21 20:35:07.558705 ip-10-0-131-27 kubenswrapper[2560]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 21 20:35:07.558705 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.520451 2560 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 21 20:35:07.558705 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.528378 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 21 20:35:07.558705 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.528394 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 21 20:35:07.558705 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.528398 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 21 20:35:07.558705 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.528402 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 21 20:35:07.558705 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.528405 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 21 20:35:07.558705 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.528408 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 21 20:35:07.558705 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.528411 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 21 20:35:07.558705 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.528415 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 21 20:35:07.560035 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.528418 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 21 20:35:07.560035 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.528421 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 21 20:35:07.560035 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.528425 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 21 20:35:07.560035 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.528428 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 21 20:35:07.560035 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.528431 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 21 20:35:07.560035 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.528434 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 21 20:35:07.560035 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.528437 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 21 20:35:07.560035 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.528440 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 21 20:35:07.560035 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.528443 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 21 20:35:07.560035 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.528447 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 21 20:35:07.560035 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.528450 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 21 20:35:07.560035 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.528456 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 21 20:35:07.560035 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.528461 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 21 20:35:07.560035 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.528464 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 21 20:35:07.560035 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.528469 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 21 20:35:07.560035 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.528472 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 21 20:35:07.560035 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.528475 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 21 20:35:07.560035 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.528478 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 21 20:35:07.560035 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.528482 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 21 20:35:07.562360 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.528484 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 21 20:35:07.562360 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.528488 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 21 20:35:07.562360 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.528491 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 21 20:35:07.562360 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.528494 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 21 20:35:07.562360 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.528497 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 21 20:35:07.562360 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.528499 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 21 20:35:07.562360 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.528502 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 21 20:35:07.562360 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.528505 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 21 20:35:07.562360 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.528508 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 21 20:35:07.562360 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.528511 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 21 20:35:07.562360 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.528515 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 21 20:35:07.562360 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.528518 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 21 20:35:07.562360 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.528521 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 21 20:35:07.562360 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.528524 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 21 20:35:07.562360 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.528527 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 21 20:35:07.562360 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.528530 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 21 20:35:07.562360 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.528532 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 21 20:35:07.562360 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.528535 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 21 20:35:07.562360 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.528538 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 21 20:35:07.562360 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.528541 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 21 20:35:07.563057 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.528543 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 21 20:35:07.563057 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.528546 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 21 20:35:07.563057 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.528549 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 21 20:35:07.563057 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.528552 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 21 20:35:07.563057 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.528555 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 21 20:35:07.563057 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.528558 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jul 21 20:35:07.563057 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.528560 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 21 20:35:07.563057 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.528563 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 21 20:35:07.563057 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.528566 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 21 20:35:07.563057 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.528569 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 21 20:35:07.563057 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.528571 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 21 20:35:07.563057 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.528574 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 21 20:35:07.563057 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.528578 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 21 20:35:07.563057 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.528581 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 21 20:35:07.563057 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.528584 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 21 20:35:07.563057 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.528587 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 21 20:35:07.563057 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.528590 2560 feature_gate.go:328] unrecognized feature gate: Example Jul 21 20:35:07.563057 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.528593 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 21 20:35:07.563057 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.528596 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 21 20:35:07.563057 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.528599 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 21 20:35:07.563057 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.528602 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 21 20:35:07.564624 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.528605 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 21 20:35:07.564624 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.528608 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 21 20:35:07.564624 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.528611 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 21 20:35:07.564624 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.528614 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 21 20:35:07.564624 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.528617 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 21 20:35:07.564624 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.528620 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 21 20:35:07.564624 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.528623 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 21 20:35:07.564624 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.528625 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 21 20:35:07.564624 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.528628 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 21 20:35:07.564624 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.528631 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 21 20:35:07.564624 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.528633 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 21 20:35:07.564624 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.528636 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 21 20:35:07.564624 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.528639 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 21 20:35:07.564624 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.528642 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 21 20:35:07.564624 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.528644 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 21 20:35:07.564624 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.528647 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 21 20:35:07.564624 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.528650 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 21 20:35:07.564624 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.528652 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 21 20:35:07.564624 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.528655 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 21 20:35:07.564624 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.528657 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 21 20:35:07.565297 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.528660 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 21 20:35:07.565297 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.528663 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 21 20:35:07.565297 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.528666 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 21 20:35:07.565297 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.528671 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 21 20:35:07.565297 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.528675 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 21 20:35:07.565297 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.528680 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 21 20:35:07.565297 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.528684 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 21 20:35:07.565297 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.528687 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 21 20:35:07.565297 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.528690 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 21 20:35:07.565297 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.528693 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 21 20:35:07.565297 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.528696 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 21 20:35:07.565297 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.529583 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 21 20:35:07.565297 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.529593 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 21 20:35:07.565297 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.529597 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 21 20:35:07.565297 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.529600 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 21 20:35:07.565297 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.529604 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 21 20:35:07.565297 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.529620 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 21 20:35:07.565297 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.529625 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 21 20:35:07.566295 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.529629 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 21 20:35:07.566295 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.529632 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 21 20:35:07.566295 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.529635 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 21 20:35:07.566295 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.529638 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 21 20:35:07.566295 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.529641 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 21 20:35:07.566295 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.529644 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 21 20:35:07.566295 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.529648 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 21 20:35:07.566295 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.529651 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 21 20:35:07.566295 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.529654 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 21 20:35:07.566295 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.529657 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 21 20:35:07.566295 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.529660 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 21 20:35:07.566295 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.529662 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 21 20:35:07.566295 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.529665 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 21 20:35:07.566295 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.529668 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 21 20:35:07.566295 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.529670 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 21 20:35:07.566295 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.529673 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 21 20:35:07.566295 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.529676 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 21 20:35:07.566295 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.529678 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 21 20:35:07.566295 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.529681 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 21 20:35:07.566295 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.529683 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 21 20:35:07.567067 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.529686 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 21 20:35:07.567067 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.529689 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 21 20:35:07.567067 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.529691 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 21 20:35:07.567067 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.529694 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 21 20:35:07.567067 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.529697 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 21 20:35:07.567067 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.529699 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 21 20:35:07.567067 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.529703 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 21 20:35:07.567067 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.529706 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 21 20:35:07.567067 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.529708 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 21 20:35:07.567067 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.529711 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 21 20:35:07.567067 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.529714 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 21 20:35:07.567067 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.529724 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 21 20:35:07.567067 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.529727 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 21 20:35:07.567067 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.529730 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jul 21 20:35:07.567067 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.529733 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 21 20:35:07.567067 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.529736 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 21 20:35:07.567067 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.529739 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 21 20:35:07.567067 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.529742 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 21 20:35:07.567067 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.529744 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 21 20:35:07.567673 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.529747 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 21 20:35:07.567673 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.529750 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 21 20:35:07.567673 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.529754 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 21 20:35:07.567673 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.529759 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 21 20:35:07.567673 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.529762 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 21 20:35:07.567673 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.529765 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 21 20:35:07.567673 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.529768 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 21 20:35:07.567673 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.529770 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 21 20:35:07.567673 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.529773 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 21 20:35:07.567673 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.529776 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 21 20:35:07.567673 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.529779 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 21 20:35:07.567673 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.529781 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 21 20:35:07.567673 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.529784 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 21 20:35:07.567673 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.529787 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 21 20:35:07.567673 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.529789 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 21 20:35:07.567673 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.529792 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 21 20:35:07.567673 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.529795 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 21 20:35:07.567673 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.529798 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 21 20:35:07.567673 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.529801 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 21 20:35:07.568379 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.529803 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 21 20:35:07.568379 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.529806 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 21 20:35:07.568379 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.529809 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 21 20:35:07.568379 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.529812 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 21 20:35:07.568379 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.529815 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 21 20:35:07.568379 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.529817 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 21 20:35:07.568379 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.529828 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 21 20:35:07.568379 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.529831 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 21 20:35:07.568379 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.529833 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 21 20:35:07.568379 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.529836 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 21 20:35:07.568379 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.529839 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 21 20:35:07.568379 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.529842 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 21 20:35:07.568379 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.529845 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 21 20:35:07.568379 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.529848 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 21 20:35:07.568379 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.529852 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 21 20:35:07.568379 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.529856 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 21 20:35:07.568379 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.529859 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 21 20:35:07.568379 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.529864 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 21 20:35:07.568379 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.529866 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 21 20:35:07.568379 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.529869 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 21 20:35:07.568996 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.529872 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 21 20:35:07.568996 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.529875 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 21 20:35:07.568996 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.529878 2560 feature_gate.go:328] unrecognized feature gate: Example Jul 21 20:35:07.568996 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.529883 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 21 20:35:07.568996 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.529887 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 21 20:35:07.568996 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.529890 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 21 20:35:07.568996 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.529893 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 21 20:35:07.568996 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.529896 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 21 20:35:07.568996 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.529899 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 21 20:35:07.568996 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.529902 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 21 20:35:07.568996 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.529905 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 21 20:35:07.568996 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.529909 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 21 20:35:07.568996 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.529912 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 21 20:35:07.568996 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.529915 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 21 20:35:07.568996 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.530402 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 21 20:35:07.568996 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.530407 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 21 20:35:07.568996 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.530410 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 21 20:35:07.568996 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.530413 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 21 20:35:07.568996 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.530417 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 21 20:35:07.568996 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.530420 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 21 20:35:07.569622 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.530424 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 21 20:35:07.569622 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.530427 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 21 20:35:07.569622 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.530430 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 21 20:35:07.569622 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.530432 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 21 20:35:07.569622 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.530435 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 21 20:35:07.569622 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.530438 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 21 20:35:07.569622 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.530441 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 21 20:35:07.569622 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.530444 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 21 20:35:07.569622 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.530450 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 21 20:35:07.569622 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.530452 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 21 20:35:07.569622 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.530456 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 21 20:35:07.569622 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.530459 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 21 20:35:07.569622 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.530462 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 21 20:35:07.569622 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.530464 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 21 20:35:07.569622 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.530467 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 21 20:35:07.569622 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.530470 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 21 20:35:07.569622 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.530472 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 21 20:35:07.569622 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.530477 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 21 20:35:07.569622 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.530481 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 21 20:35:07.570231 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.530485 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 21 20:35:07.570231 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.530489 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 21 20:35:07.570231 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.530494 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 21 20:35:07.570231 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.530497 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 21 20:35:07.570231 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.530501 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 21 20:35:07.570231 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.530504 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 21 20:35:07.570231 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.530508 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 21 20:35:07.570231 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.530511 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 21 20:35:07.570231 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.530514 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 21 20:35:07.570231 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.530518 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 21 20:35:07.570231 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.530521 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 21 20:35:07.570231 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.530524 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 21 20:35:07.570231 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.530528 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 21 20:35:07.570231 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.530531 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 21 20:35:07.570231 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.530534 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 21 20:35:07.570231 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.530536 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 21 20:35:07.570231 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.530539 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 21 20:35:07.570231 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.530542 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 21 20:35:07.570231 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.530544 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 21 20:35:07.570231 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.530547 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 21 20:35:07.570871 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.530550 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 21 20:35:07.570871 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.530554 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 21 20:35:07.570871 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.530557 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 21 20:35:07.570871 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.530560 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 21 20:35:07.570871 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.530562 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 21 20:35:07.570871 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.530565 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 21 20:35:07.570871 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.530568 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 21 20:35:07.570871 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.530571 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 21 20:35:07.570871 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.530573 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 21 20:35:07.570871 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.530576 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 21 20:35:07.570871 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.530579 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 21 20:35:07.570871 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.530582 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 21 20:35:07.570871 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.530584 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 21 20:35:07.570871 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.530587 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 21 20:35:07.570871 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.530591 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 21 20:35:07.570871 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.530594 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 21 20:35:07.570871 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.530596 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 21 20:35:07.570871 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.530599 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 21 20:35:07.570871 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.530605 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 21 20:35:07.571452 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.530608 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 21 20:35:07.571452 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.530611 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 21 20:35:07.571452 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.530614 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 21 20:35:07.571452 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.530618 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 21 20:35:07.571452 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.530622 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 21 20:35:07.571452 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.530625 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 21 20:35:07.571452 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.530629 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 21 20:35:07.571452 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.530633 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 21 20:35:07.571452 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.530635 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 21 20:35:07.571452 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.530638 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 21 20:35:07.571452 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.530642 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 21 20:35:07.571452 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.530653 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 21 20:35:07.571452 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.530656 2560 feature_gate.go:328] unrecognized feature gate: Example Jul 21 20:35:07.571452 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.530658 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 21 20:35:07.571452 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.530663 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 21 20:35:07.571452 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.530666 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 21 20:35:07.571452 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.530669 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 21 20:35:07.571452 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.530672 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 21 20:35:07.571452 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.530674 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 21 20:35:07.572447 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.530677 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 21 20:35:07.572447 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.530680 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 21 20:35:07.572447 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.530683 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 21 20:35:07.572447 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.530686 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 21 20:35:07.572447 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.530688 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 21 20:35:07.572447 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.530691 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 21 20:35:07.572447 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.530694 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 21 20:35:07.572447 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.530697 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 21 20:35:07.572447 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.530700 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 21 20:35:07.572447 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.530702 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 21 20:35:07.572447 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.530705 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jul 21 20:35:07.572447 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.530708 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 21 20:35:07.572447 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.530712 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 21 20:35:07.572447 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.530715 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 21 20:35:07.572447 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.530718 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 21 20:35:07.572447 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.530721 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 21 20:35:07.572447 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.530802 2560 flags.go:64] FLAG: --address="0.0.0.0" Jul 21 20:35:07.572447 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.530810 2560 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 21 20:35:07.572447 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.530820 2560 flags.go:64] FLAG: --anonymous-auth="true" Jul 21 20:35:07.572447 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.530828 2560 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 21 20:35:07.572447 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.530836 2560 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 21 20:35:07.573505 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.530841 2560 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 21 20:35:07.573505 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.530846 2560 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 21 20:35:07.573505 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.530851 2560 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 21 20:35:07.573505 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.530855 2560 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 21 20:35:07.573505 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.530858 2560 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 21 20:35:07.573505 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.530862 2560 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 21 20:35:07.573505 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.530867 2560 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 21 20:35:07.573505 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.530871 2560 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 21 20:35:07.573505 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.530874 2560 flags.go:64] FLAG: --cgroup-root="" Jul 21 20:35:07.573505 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.530877 2560 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 21 20:35:07.573505 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.530880 2560 flags.go:64] FLAG: --client-ca-file="" Jul 21 20:35:07.573505 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.530884 2560 flags.go:64] FLAG: --cloud-provider="external" Jul 21 20:35:07.573505 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.530887 2560 flags.go:64] FLAG: --cluster-dns="[]" Jul 21 20:35:07.573505 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.530891 2560 flags.go:64] FLAG: --cluster-domain="" Jul 21 20:35:07.573505 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.530894 2560 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 21 20:35:07.573505 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.530898 2560 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 21 20:35:07.573505 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.530901 2560 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 21 20:35:07.573505 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.530904 2560 flags.go:64] FLAG: --container-log-max-files="5" Jul 21 20:35:07.573505 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.530909 2560 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 21 20:35:07.573505 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.530912 2560 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 21 20:35:07.573505 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.530915 2560 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 21 20:35:07.573505 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.530919 2560 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 21 20:35:07.573505 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.530922 2560 flags.go:64] FLAG: --contention-profiling="false" Jul 21 20:35:07.573505 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.530927 2560 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 21 20:35:07.574429 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.530930 2560 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 21 20:35:07.574429 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.530934 2560 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 21 20:35:07.574429 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.530937 2560 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 21 20:35:07.574429 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.530941 2560 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 21 20:35:07.574429 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.530944 2560 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 21 20:35:07.574429 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.530947 2560 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 21 20:35:07.574429 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.530951 2560 flags.go:64] FLAG: --enable-load-reader="false" Jul 21 20:35:07.574429 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.530954 2560 flags.go:64] FLAG: --enable-server="true" Jul 21 20:35:07.574429 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.530962 2560 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 21 20:35:07.574429 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.530970 2560 flags.go:64] FLAG: --event-burst="100" Jul 21 20:35:07.574429 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.530973 2560 flags.go:64] FLAG: --event-qps="50" Jul 21 20:35:07.574429 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.530976 2560 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 21 20:35:07.574429 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.530980 2560 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 21 20:35:07.574429 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.530983 2560 flags.go:64] FLAG: --eviction-hard="" Jul 21 20:35:07.574429 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.530989 2560 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 21 20:35:07.574429 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.530992 2560 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 21 20:35:07.574429 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.530996 2560 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 21 20:35:07.574429 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.530999 2560 flags.go:64] FLAG: --eviction-soft="" Jul 21 20:35:07.574429 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.531002 2560 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 21 20:35:07.574429 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.531005 2560 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 21 20:35:07.574429 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.531008 2560 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 21 20:35:07.574429 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.531011 2560 flags.go:64] FLAG: --experimental-mounter-path="" Jul 21 20:35:07.574429 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.531014 2560 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 21 20:35:07.574429 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.531017 2560 flags.go:64] FLAG: --fail-swap-on="true" Jul 21 20:35:07.574429 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.531020 2560 flags.go:64] FLAG: --feature-gates="" Jul 21 20:35:07.576525 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.531024 2560 flags.go:64] FLAG: --file-check-frequency="20s" Jul 21 20:35:07.576525 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.531027 2560 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 21 20:35:07.576525 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.531031 2560 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 21 20:35:07.576525 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.531034 2560 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 21 20:35:07.576525 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.531037 2560 flags.go:64] FLAG: --healthz-port="10248" Jul 21 20:35:07.576525 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.531040 2560 flags.go:64] FLAG: --help="false" Jul 21 20:35:07.576525 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.531045 2560 flags.go:64] FLAG: --hostname-override="ip-10-0-131-27.ec2.internal" Jul 21 20:35:07.576525 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.531048 2560 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 21 20:35:07.576525 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.531051 2560 flags.go:64] FLAG: --http-check-frequency="20s" Jul 21 20:35:07.576525 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.531055 2560 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 21 20:35:07.576525 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.531058 2560 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 21 20:35:07.576525 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.531062 2560 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 21 20:35:07.576525 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.531065 2560 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 21 20:35:07.576525 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.531068 2560 flags.go:64] FLAG: --image-service-endpoint="" Jul 21 20:35:07.576525 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.531071 2560 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 21 20:35:07.576525 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.531074 2560 flags.go:64] FLAG: --kube-api-burst="100" Jul 21 20:35:07.576525 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.531078 2560 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 21 20:35:07.576525 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.531095 2560 flags.go:64] FLAG: --kube-api-qps="50" Jul 21 20:35:07.576525 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.531098 2560 flags.go:64] FLAG: --kube-reserved="" Jul 21 20:35:07.576525 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.531102 2560 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 21 20:35:07.576525 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.531105 2560 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 21 20:35:07.576525 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.531109 2560 flags.go:64] FLAG: --kubelet-cgroups="" Jul 21 20:35:07.576525 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.531112 2560 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 21 20:35:07.576525 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.531115 2560 flags.go:64] FLAG: --lock-file="" Jul 21 20:35:07.577394 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.531118 2560 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 21 20:35:07.577394 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.531122 2560 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 21 20:35:07.577394 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.531125 2560 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 21 20:35:07.577394 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.531131 2560 flags.go:64] FLAG: --log-json-split-stream="false" Jul 21 20:35:07.577394 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.531134 2560 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 21 20:35:07.577394 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.531137 2560 flags.go:64] FLAG: --log-text-split-stream="false" Jul 21 20:35:07.577394 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.531140 2560 flags.go:64] FLAG: --logging-format="text" Jul 21 20:35:07.577394 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.531143 2560 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 21 20:35:07.577394 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.531147 2560 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 21 20:35:07.577394 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.531150 2560 flags.go:64] FLAG: --manifest-url="" Jul 21 20:35:07.577394 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.531153 2560 flags.go:64] FLAG: --manifest-url-header="" Jul 21 20:35:07.577394 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.531158 2560 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 21 20:35:07.577394 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.531161 2560 flags.go:64] FLAG: --max-open-files="1000000" Jul 21 20:35:07.577394 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.531166 2560 flags.go:64] FLAG: --max-pods="110" Jul 21 20:35:07.577394 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.531170 2560 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 21 20:35:07.577394 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.531174 2560 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 21 20:35:07.577394 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.531177 2560 flags.go:64] FLAG: --memory-manager-policy="None" Jul 21 20:35:07.577394 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.531181 2560 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 21 20:35:07.577394 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.531184 2560 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 21 20:35:07.577394 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.531187 2560 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 21 20:35:07.577394 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.531190 2560 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 21 20:35:07.577394 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.531198 2560 flags.go:64] FLAG: --node-status-max-images="50" Jul 21 20:35:07.577394 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.531201 2560 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 21 20:35:07.577394 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.531205 2560 flags.go:64] FLAG: --oom-score-adj="-999" Jul 21 20:35:07.577394 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.531208 2560 flags.go:64] FLAG: --pod-cidr="" Jul 21 20:35:07.579610 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.531212 2560 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0" Jul 21 20:35:07.579610 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.531220 2560 flags.go:64] FLAG: --pod-manifest-path="" Jul 21 20:35:07.579610 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.531223 2560 flags.go:64] FLAG: --pod-max-pids="-1" Jul 21 20:35:07.579610 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.531226 2560 flags.go:64] FLAG: --pods-per-core="0" Jul 21 20:35:07.579610 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.531231 2560 flags.go:64] FLAG: --port="10250" Jul 21 20:35:07.579610 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.531234 2560 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 21 20:35:07.579610 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.531237 2560 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0842744c07663223c" Jul 21 20:35:07.579610 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.531241 2560 flags.go:64] FLAG: --qos-reserved="" Jul 21 20:35:07.579610 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.531244 2560 flags.go:64] FLAG: --read-only-port="10255" Jul 21 20:35:07.579610 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.531247 2560 flags.go:64] FLAG: --register-node="true" Jul 21 20:35:07.579610 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.531250 2560 flags.go:64] FLAG: --register-with-taints="" Jul 21 20:35:07.579610 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.531254 2560 flags.go:64] FLAG: --registry-burst="10" Jul 21 20:35:07.579610 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.531257 2560 flags.go:64] FLAG: --registry-qps="5" Jul 21 20:35:07.579610 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.531260 2560 flags.go:64] FLAG: --reserved-cpus="" Jul 21 20:35:07.579610 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.531263 2560 flags.go:64] FLAG: --reserved-memory="" Jul 21 20:35:07.579610 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.531268 2560 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 21 20:35:07.579610 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.531271 2560 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 21 20:35:07.579610 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.531274 2560 flags.go:64] FLAG: --rotate-certificates="false" Jul 21 20:35:07.579610 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.531277 2560 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 21 20:35:07.579610 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.531280 2560 flags.go:64] FLAG: --runonce="false" Jul 21 20:35:07.579610 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.531283 2560 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 21 20:35:07.579610 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.531286 2560 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 21 20:35:07.579610 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.531291 2560 flags.go:64] FLAG: --seccomp-default="false" Jul 21 20:35:07.579610 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.531294 2560 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 21 20:35:07.579610 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.531297 2560 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 21 20:35:07.580717 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.531300 2560 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 21 20:35:07.580717 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.531303 2560 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 21 20:35:07.580717 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.531307 2560 flags.go:64] FLAG: --storage-driver-password="root" Jul 21 20:35:07.580717 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.531310 2560 flags.go:64] FLAG: --storage-driver-secure="false" Jul 21 20:35:07.580717 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.531313 2560 flags.go:64] FLAG: --storage-driver-table="stats" Jul 21 20:35:07.580717 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.531316 2560 flags.go:64] FLAG: --storage-driver-user="root" Jul 21 20:35:07.580717 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.531318 2560 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 21 20:35:07.580717 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.531322 2560 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 21 20:35:07.580717 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.531326 2560 flags.go:64] FLAG: --system-cgroups="" Jul 21 20:35:07.580717 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.531329 2560 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 21 20:35:07.580717 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.531334 2560 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 21 20:35:07.580717 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.531339 2560 flags.go:64] FLAG: --tls-cert-file="" Jul 21 20:35:07.580717 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.531342 2560 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 21 20:35:07.580717 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.531349 2560 flags.go:64] FLAG: --tls-min-version="" Jul 21 20:35:07.580717 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.531352 2560 flags.go:64] FLAG: --tls-private-key-file="" Jul 21 20:35:07.580717 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.531355 2560 flags.go:64] FLAG: --topology-manager-policy="none" Jul 21 20:35:07.580717 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.531358 2560 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 21 20:35:07.580717 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.531361 2560 flags.go:64] FLAG: --topology-manager-scope="container" Jul 21 20:35:07.580717 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.531365 2560 flags.go:64] FLAG: --v="2" Jul 21 20:35:07.580717 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.531369 2560 flags.go:64] FLAG: --version="false" Jul 21 20:35:07.580717 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.531373 2560 flags.go:64] FLAG: --vmodule="" Jul 21 20:35:07.580717 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.531377 2560 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 21 20:35:07.580717 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.531380 2560 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 21 20:35:07.580717 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.531562 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 21 20:35:07.580717 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.531567 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 21 20:35:07.701487 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.531570 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 21 20:35:07.701487 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.531573 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 21 20:35:07.701487 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.531576 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 21 20:35:07.701487 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.531579 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 21 20:35:07.701487 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.531583 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 21 20:35:07.701487 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.531586 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 21 20:35:07.701487 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.531589 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 21 20:35:07.701487 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.531592 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 21 20:35:07.701487 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.531594 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 21 20:35:07.701487 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.531597 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 21 20:35:07.701487 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.531600 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 21 20:35:07.701487 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.531603 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 21 20:35:07.701487 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.531605 2560 feature_gate.go:328] unrecognized feature gate: Example Jul 21 20:35:07.701487 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.531608 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 21 20:35:07.701487 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.531611 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 21 20:35:07.701487 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.531614 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 21 20:35:07.701487 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.531625 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 21 20:35:07.701487 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.531629 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 21 20:35:07.701487 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.531634 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 21 20:35:07.701487 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.531637 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 21 20:35:07.618094 ip-10-0-131-27 systemd[1]: Started Kubernetes Kubelet. Jul 21 20:35:07.702350 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.531640 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 21 20:35:07.702350 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.531643 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 21 20:35:07.702350 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.531647 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 21 20:35:07.702350 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.531650 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 21 20:35:07.702350 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.531653 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 21 20:35:07.702350 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.531656 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 21 20:35:07.702350 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.531659 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 21 20:35:07.702350 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.531662 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 21 20:35:07.702350 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.531664 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 21 20:35:07.702350 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.531667 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 21 20:35:07.702350 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.531670 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 21 20:35:07.702350 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.531672 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 21 20:35:07.702350 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.531675 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 21 20:35:07.702350 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.531678 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 21 20:35:07.702350 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.531680 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 21 20:35:07.702350 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.531683 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 21 20:35:07.702350 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.531689 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 21 20:35:07.702350 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.531691 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 21 20:35:07.702350 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.531694 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 21 20:35:07.702350 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.531697 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 21 20:35:07.703547 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.531700 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 21 20:35:07.703547 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.531702 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 21 20:35:07.703547 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.531705 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 21 20:35:07.703547 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.531708 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 21 20:35:07.703547 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.531711 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 21 20:35:07.703547 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.531714 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 21 20:35:07.703547 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.531717 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 21 20:35:07.703547 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.531719 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 21 20:35:07.703547 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.531722 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 21 20:35:07.703547 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.531732 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 21 20:35:07.703547 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.531737 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 21 20:35:07.703547 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.531740 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 21 20:35:07.703547 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.531742 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 21 20:35:07.703547 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.531745 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 21 20:35:07.703547 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.531748 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 21 20:35:07.703547 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.531750 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 21 20:35:07.703547 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.531753 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 21 20:35:07.703547 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.531757 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 21 20:35:07.703547 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.531760 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 21 20:35:07.704223 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.531765 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 21 20:35:07.704223 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.531769 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 21 20:35:07.704223 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.531772 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 21 20:35:07.704223 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.531775 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 21 20:35:07.704223 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.531779 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 21 20:35:07.704223 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.531781 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jul 21 20:35:07.704223 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.531784 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 21 20:35:07.704223 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.531786 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 21 20:35:07.704223 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.531789 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 21 20:35:07.704223 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.531794 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 21 20:35:07.704223 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.531796 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 21 20:35:07.704223 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.531800 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 21 20:35:07.704223 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.531802 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 21 20:35:07.704223 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.531805 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 21 20:35:07.704223 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.531808 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 21 20:35:07.704223 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.531811 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 21 20:35:07.704223 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.531813 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 21 20:35:07.704223 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.531816 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 21 20:35:07.704223 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.531819 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 21 20:35:07.704916 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.531821 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 21 20:35:07.704916 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.531824 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 21 20:35:07.704916 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.531827 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 21 20:35:07.704916 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.531830 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 21 20:35:07.704916 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.531840 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 21 20:35:07.704916 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.531843 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 21 20:35:07.704916 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.531846 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 21 20:35:07.704916 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.531849 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 21 20:35:07.704916 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.531851 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 21 20:35:07.704916 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.531854 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 21 20:35:07.704916 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.531857 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 21 20:35:07.704916 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.531860 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 21 20:35:07.704916 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.531862 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 21 20:35:07.704916 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.531865 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 21 20:35:07.704916 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.531868 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 21 20:35:07.704916 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.531871 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 21 20:35:07.704916 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.531874 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 21 20:35:07.704916 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.531876 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 21 20:35:07.704916 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.531879 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 21 20:35:07.706507 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.531884 2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 21 20:35:07.706507 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.547643 2560 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 21 20:35:07.706507 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.547668 2560 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 21 20:35:07.706507 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.548345 2560 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 21 20:35:07.706507 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.548356 2560 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 21 20:35:07.706507 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.548429 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 21 20:35:07.706507 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.548437 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 21 20:35:07.706507 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.548441 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 21 20:35:07.706507 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.548445 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 21 20:35:07.706507 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.548448 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 21 20:35:07.706507 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.548451 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 21 20:35:07.706507 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.548455 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 21 20:35:07.706507 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.548458 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 21 20:35:07.706507 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.548461 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 21 20:35:07.707456 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.548464 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 21 20:35:07.707456 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.548468 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 21 20:35:07.707456 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.548471 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 21 20:35:07.707456 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.548476 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 21 20:35:07.707456 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.548481 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 21 20:35:07.707456 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.548485 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 21 20:35:07.707456 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.548488 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 21 20:35:07.707456 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.548491 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 21 20:35:07.707456 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.548495 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 21 20:35:07.707456 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.548498 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 21 20:35:07.707456 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.548501 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 21 20:35:07.707456 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.548504 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 21 20:35:07.707456 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.548507 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 21 20:35:07.707456 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.548510 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 21 20:35:07.707456 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.548513 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 21 20:35:07.707456 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.548516 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 21 20:35:07.707456 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.548519 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 21 20:35:07.707456 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.548522 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 21 20:35:07.707456 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.548525 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 21 20:35:07.708124 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.548528 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 21 20:35:07.708124 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.548531 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 21 20:35:07.708124 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.548534 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 21 20:35:07.708124 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.548539 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 21 20:35:07.708124 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.548542 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 21 20:35:07.708124 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.548545 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 21 20:35:07.708124 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.548547 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 21 20:35:07.708124 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.548550 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 21 20:35:07.708124 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.548553 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 21 20:35:07.708124 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.548555 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 21 20:35:07.708124 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.548558 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 21 20:35:07.708124 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.548562 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 21 20:35:07.708124 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.548565 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 21 20:35:07.708124 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.548567 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 21 20:35:07.708124 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.548570 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 21 20:35:07.708124 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.548573 2560 feature_gate.go:328] unrecognized feature gate: Example Jul 21 20:35:07.708124 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.548577 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 21 20:35:07.708124 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.548580 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 21 20:35:07.708124 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.548584 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 21 20:35:07.708124 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.548587 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 21 20:35:07.708983 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.548590 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 21 20:35:07.708983 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.548593 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 21 20:35:07.708983 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.548596 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 21 20:35:07.708983 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.548599 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 21 20:35:07.708983 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.548601 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 21 20:35:07.708983 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.548604 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 21 20:35:07.708983 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.548607 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jul 21 20:35:07.708983 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.548610 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 21 20:35:07.708983 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.548613 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 21 20:35:07.708983 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.548615 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 21 20:35:07.708983 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.548618 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 21 20:35:07.708983 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.548621 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 21 20:35:07.708983 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.548624 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 21 20:35:07.708983 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.548626 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 21 20:35:07.708983 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.548629 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 21 20:35:07.708983 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.548634 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 21 20:35:07.708983 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.548637 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 21 20:35:07.708983 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.548640 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 21 20:35:07.708983 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.548642 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 21 20:35:07.708983 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.548645 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 21 20:35:07.709928 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.548648 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 21 20:35:07.709928 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.548651 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 21 20:35:07.709928 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.548654 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 21 20:35:07.709928 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.548656 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 21 20:35:07.709928 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.548659 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 21 20:35:07.709928 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.548662 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 21 20:35:07.709928 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.548665 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 21 20:35:07.709928 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.548667 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 21 20:35:07.709928 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.548671 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 21 20:35:07.709928 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.548675 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 21 20:35:07.709928 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.548677 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 21 20:35:07.709928 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.548681 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 21 20:35:07.709928 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.548685 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 21 20:35:07.709928 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.548689 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 21 20:35:07.709928 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.548692 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 21 20:35:07.709928 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.548695 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 21 20:35:07.709928 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.548697 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 21 20:35:07.709928 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.548700 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 21 20:35:07.709928 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.548703 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 21 20:35:07.709928 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.548706 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 21 20:35:07.710696 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.548708 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 21 20:35:07.710696 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.548712 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 21 20:35:07.710696 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.548715 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 21 20:35:07.710696 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.548718 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 21 20:35:07.710696 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.548720 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 21 20:35:07.710696 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.548723 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 21 20:35:07.710696 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.548726 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 21 20:35:07.710696 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.548731 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 21 20:35:07.710696 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.548734 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 21 20:35:07.710696 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.548737 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 21 20:35:07.710696 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.548739 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 21 20:35:07.710696 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.548745 2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 21 20:35:07.710696 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.548902 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 21 20:35:07.710696 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.548909 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 21 20:35:07.710696 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.548912 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 21 20:35:07.711364 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.548915 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 21 20:35:07.711364 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.548919 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 21 20:35:07.711364 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.548922 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 21 20:35:07.711364 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.548925 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 21 20:35:07.711364 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.548928 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 21 20:35:07.711364 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.548932 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 21 20:35:07.711364 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.548934 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 21 20:35:07.711364 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.548937 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 21 20:35:07.711364 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.548940 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 21 20:35:07.711364 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.548944 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 21 20:35:07.711364 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.548946 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 21 20:35:07.711364 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.548956 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 21 20:35:07.711364 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.548959 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 21 20:35:07.711364 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.548962 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 21 20:35:07.711364 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.548965 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 21 20:35:07.711364 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.548969 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 21 20:35:07.711364 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.548974 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 21 20:35:07.711364 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.548977 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 21 20:35:07.711364 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.548980 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 21 20:35:07.712447 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.548983 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 21 20:35:07.712447 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.548985 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 21 20:35:07.712447 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.548988 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 21 20:35:07.712447 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.548991 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 21 20:35:07.712447 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.548994 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jul 21 20:35:07.712447 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.548997 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 21 20:35:07.712447 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.549001 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 21 20:35:07.712447 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.549004 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 21 20:35:07.712447 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.549007 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 21 20:35:07.712447 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.549009 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 21 20:35:07.712447 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.549012 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 21 20:35:07.712447 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.549015 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 21 20:35:07.712447 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.549018 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 21 20:35:07.712447 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.549021 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 21 20:35:07.712447 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.549024 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 21 20:35:07.712447 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.549027 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 21 20:35:07.712447 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.549029 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 21 20:35:07.712447 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.549032 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 21 20:35:07.712447 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.549036 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 21 20:35:07.712447 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.549039 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 21 20:35:07.713976 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.549042 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 21 20:35:07.713976 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.549045 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 21 20:35:07.713976 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.549048 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 21 20:35:07.713976 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.549051 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 21 20:35:07.713976 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.549055 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 21 20:35:07.713976 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.549057 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 21 20:35:07.713976 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.549060 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 21 20:35:07.713976 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.549063 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 21 20:35:07.713976 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.549065 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 21 20:35:07.713976 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.549070 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 21 20:35:07.713976 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.549073 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 21 20:35:07.713976 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.549077 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 21 20:35:07.713976 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.549080 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 21 20:35:07.713976 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.549099 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 21 20:35:07.713976 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.549102 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 21 20:35:07.713976 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.549105 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 21 20:35:07.713976 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.549108 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 21 20:35:07.713976 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.549110 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 21 20:35:07.713976 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.549115 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 21 20:35:07.713976 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.549117 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 21 20:35:07.714888 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.549120 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 21 20:35:07.714888 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.549123 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 21 20:35:07.714888 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.549126 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 21 20:35:07.714888 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.549129 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 21 20:35:07.714888 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.549132 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 21 20:35:07.714888 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.549134 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 21 20:35:07.714888 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.549137 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 21 20:35:07.714888 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.549140 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 21 20:35:07.714888 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.549143 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 21 20:35:07.714888 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.549145 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 21 20:35:07.714888 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.549150 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 21 20:35:07.714888 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.549152 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 21 20:35:07.714888 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.549156 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 21 20:35:07.714888 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.549158 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 21 20:35:07.714888 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.549162 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 21 20:35:07.714888 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.549164 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 21 20:35:07.714888 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.549168 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 21 20:35:07.714888 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.549171 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 21 20:35:07.714888 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.549174 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 21 20:35:07.714888 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.549176 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 21 20:35:07.716010 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.549179 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 21 20:35:07.716010 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.549182 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 21 20:35:07.716010 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.549184 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 21 20:35:07.716010 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.549187 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 21 20:35:07.716010 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.549190 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 21 20:35:07.716010 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.549192 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 21 20:35:07.716010 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.549195 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 21 20:35:07.716010 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.549198 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 21 20:35:07.716010 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.549202 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 21 20:35:07.716010 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.549206 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 21 20:35:07.716010 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.549211 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 21 20:35:07.716010 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.549215 2560 feature_gate.go:328] unrecognized feature gate: Example Jul 21 20:35:07.716010 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.549219 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 21 20:35:07.716010 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.549222 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 21 20:35:07.716010 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.549225 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 21 20:35:07.716010 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.549228 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 21 20:35:07.716010 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:07.549231 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 21 20:35:07.716683 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.549238 2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 21 20:35:07.716683 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.549383 2560 server.go:962] "Client rotation is on, will bootstrap in background" Jul 21 20:35:07.716683 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.553509 2560 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 21 20:35:07.716683 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.554866 2560 server.go:1019] "Starting client certificate rotation" Jul 21 20:35:07.716683 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.555024 2560 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 21 20:35:07.716683 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.555063 2560 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 21 20:35:07.716683 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.558260 2560 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 21 20:35:07.716683 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.561625 2560 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 21 20:35:07.716683 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.573686 2560 log.go:25] "Validated CRI v1 runtime API" Jul 21 20:35:07.716683 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.580306 2560 log.go:25] "Validated CRI v1 image API" Jul 21 20:35:07.716683 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.582868 2560 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 21 20:35:07.716683 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.583981 2560 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 21 20:35:07.717805 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.588546 2560 fs.go:135] Filesystem UUIDs: map[3a2589bd-5afd-4a00-a7e6-7a25e01d0da2:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 979c2fe6-a551-44c7-a45a-9a081f3cb51c:/dev/nvme0n1p4] Jul 21 20:35:07.717805 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.588563 2560 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 21 20:35:07.719416 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.594314 2560 manager.go:216] Machine: {Timestamp:2026-07-21 20:35:07.592649098 +0000 UTC m=+0.355886035 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3097229 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec258631d11c9454b0b07752ea99cfe4 SystemUUID:ec258631-d11c-9454-b0b0-7752ea99cfe4 BootID:d224229e-2b03-4838-8e42-a42f89de1b69 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:29:9a:86:79:bf Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:29:9a:86:79:bf Speed:0 Mtu:9001} {Name:ovs-system MacAddress:fa:ae:d9:56:79:1b Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 21 20:35:07.719416 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.594440 2560 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 21 20:35:07.719416 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.594541 2560 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 21 20:35:07.719416 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.597908 2560 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 21 20:35:07.719416 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.597936 2560 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-131-27.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 21 20:35:07.719416 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.598722 2560 topology_manager.go:138] "Creating topology manager with none policy" Jul 21 20:35:07.719416 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.598733 2560 container_manager_linux.go:309] "Creating device plugin manager" Jul 21 20:35:07.719416 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.598747 2560 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 21 20:35:07.719416 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.599462 2560 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 21 20:35:07.719416 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.601074 2560 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 21 20:35:07.719416 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.604181 2560 state_mem.go:36] "Initialized new in-memory state store" Jul 21 20:35:07.719416 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.604349 2560 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 21 20:35:07.719416 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.604383 2560 kubelet.go:486] "Attempting to sync node with API server" Jul 21 20:35:07.719416 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.604397 2560 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 21 20:35:07.719416 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.604419 2560 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 21 20:35:07.719416 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.604433 2560 kubelet.go:398] "Adding apiserver pod source" Jul 21 20:35:07.719416 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.604446 2560 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 21 20:35:07.719416 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.604938 2560 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 21 20:35:07.720130 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.604962 2560 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 21 20:35:07.720130 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.608343 2560 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 21 20:35:07.720130 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.610554 2560 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 21 20:35:07.720130 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.610587 2560 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 21 20:35:07.720130 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.611814 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 21 20:35:07.720130 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.611828 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 21 20:35:07.720130 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.611835 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 21 20:35:07.720130 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.611841 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 21 20:35:07.720130 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.611850 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 21 20:35:07.720130 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.611856 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 21 20:35:07.720130 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.611864 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 21 20:35:07.720130 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.611870 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 21 20:35:07.720130 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.611877 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 21 20:35:07.720130 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.611883 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 21 20:35:07.720130 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.611898 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 21 20:35:07.720130 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.611903 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 21 20:35:07.720130 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.613371 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 21 20:35:07.720130 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.613380 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 21 20:35:07.720130 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.617024 2560 server.go:1268] "Started kubelet" Jul 21 20:35:07.720130 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.617137 2560 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 21 20:35:07.720130 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.617182 2560 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 21 20:35:07.720130 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.617260 2560 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 21 20:35:07.720130 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.618132 2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-131-27.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 21 20:35:07.720130 ip-10-0-131-27 kubenswrapper[2560]: E0721 20:35:07.618218 2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-131-27.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 21 20:35:07.720130 ip-10-0-131-27 kubenswrapper[2560]: E0721 20:35:07.618218 2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 21 20:35:07.720130 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.619220 2560 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 21 20:35:07.720130 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.620036 2560 server.go:310] "Adding debug handlers to kubelet server" Jul 21 20:35:07.720130 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.625948 2560 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 21 20:35:07.720130 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.625983 2560 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 21 20:35:07.720130 ip-10-0-131-27 kubenswrapper[2560]: E0721 20:35:07.626068 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-27.ec2.internal\" not found" Jul 21 20:35:07.720130 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.626518 2560 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 21 20:35:07.720130 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.626533 2560 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 21 20:35:07.720130 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.626518 2560 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 21 20:35:07.720130 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.627283 2560 reconstruct.go:97] "Volume reconstruction finished" Jul 21 20:35:07.720130 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.627295 2560 reconciler.go:29] "Reconciler: start to sync state" Jul 21 20:35:07.720130 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.631302 2560 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 21 20:35:07.720130 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.631319 2560 factory.go:55] Registering systemd factory Jul 21 20:35:07.720130 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.631331 2560 factory.go:223] Registration of the systemd container factory successfully Jul 21 20:35:07.720130 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.631926 2560 factory.go:153] Registering CRI-O factory Jul 21 20:35:07.720130 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.631983 2560 factory.go:223] Registration of the crio container factory successfully Jul 21 20:35:07.720130 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.632010 2560 factory.go:103] Registering Raw factory Jul 21 20:35:07.720130 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.632035 2560 manager.go:1196] Started watching for new ooms in manager Jul 21 20:35:07.720130 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.632044 2560 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-7fr4v" Jul 21 20:35:07.720130 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.632069 2560 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-7fr4v" Jul 21 20:35:07.721594 ip-10-0-131-27 kubenswrapper[2560]: E0721 20:35:07.631545 2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-27.ec2.internal.18c4685e8b2dafd2 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-27.ec2.internal,UID:ip-10-0-131-27.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-131-27.ec2.internal,},FirstTimestamp:2026-07-21 20:35:07.616800722 +0000 UTC m=+0.380037657,LastTimestamp:2026-07-21 20:35:07.616800722 +0000 UTC m=+0.380037657,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-27.ec2.internal,}" Jul 21 20:35:07.721594 ip-10-0-131-27 kubenswrapper[2560]: E0721 20:35:07.632553 2560 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 21 20:35:07.721594 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.632774 2560 manager.go:349] Starting recovery of all containers Jul 21 20:35:07.721594 ip-10-0-131-27 kubenswrapper[2560]: E0721 20:35:07.637545 2560 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-131-27.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 21 20:35:07.721594 ip-10-0-131-27 kubenswrapper[2560]: E0721 20:35:07.637680 2560 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 21 20:35:07.721594 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.646345 2560 manager.go:354] Recovery completed Jul 21 20:35:07.721594 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.651420 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 21 20:35:07.721594 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.653897 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-27.ec2.internal" event="NodeHasSufficientMemory" Jul 21 20:35:07.721594 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.653933 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-27.ec2.internal" event="NodeHasNoDiskPressure" Jul 21 20:35:07.721594 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.653951 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-27.ec2.internal" event="NodeHasSufficientPID" Jul 21 20:35:07.721594 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.654635 2560 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 21 20:35:07.721594 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.654645 2560 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 21 20:35:07.721594 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.654662 2560 state_mem.go:36] "Initialized new in-memory state store" Jul 21 20:35:07.721594 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.654708 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 21 20:35:07.721594 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.655531 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-27.ec2.internal" event="NodeHasSufficientMemory" Jul 21 20:35:07.721594 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.655564 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-27.ec2.internal" event="NodeHasNoDiskPressure" Jul 21 20:35:07.721594 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.655581 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-27.ec2.internal" event="NodeHasSufficientPID" Jul 21 20:35:07.721594 ip-10-0-131-27 kubenswrapper[2560]: E0721 20:35:07.655701 2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-27.ec2.internal.18c4685e8d63fb73 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-27.ec2.internal,UID:ip-10-0-131-27.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-131-27.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-131-27.ec2.internal,},FirstTimestamp:2026-07-21 20:35:07.653913459 +0000 UTC m=+0.417150406,LastTimestamp:2026-07-21 20:35:07.653913459 +0000 UTC m=+0.417150406,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-27.ec2.internal,}" Jul 21 20:35:07.721594 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.661616 2560 policy_none.go:49] "None policy: Start" Jul 21 20:35:07.721594 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.661632 2560 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 21 20:35:07.721594 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.661644 2560 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 21 20:35:07.721594 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.662737 2560 policy_none.go:47] "Start" Jul 21 20:35:07.722467 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.721873 2560 manager.go:337] "Starting Device Plugin manager" Jul 21 20:35:07.722467 ip-10-0-131-27 kubenswrapper[2560]: E0721 20:35:07.722076 2560 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 21 20:35:07.722467 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.722091 2560 server.go:87] "Starting device plugin registration server" Jul 21 20:35:07.722467 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.722384 2560 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 21 20:35:07.722467 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.722396 2560 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 21 20:35:07.722852 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.722511 2560 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 21 20:35:07.722852 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.722638 2560 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 21 20:35:07.722852 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.722649 2560 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 21 20:35:07.872976 ip-10-0-131-27 kubenswrapper[2560]: E0721 20:35:07.723367 2560 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 21 20:35:07.872976 ip-10-0-131-27 kubenswrapper[2560]: E0721 20:35:07.723425 2560 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-131-27.ec2.internal\" not found" Jul 21 20:35:07.872976 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.823384 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 21 20:35:07.872976 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.824663 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-27.ec2.internal" event="NodeHasSufficientMemory" Jul 21 20:35:07.872976 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.824694 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-27.ec2.internal" event="NodeHasNoDiskPressure" Jul 21 20:35:07.872976 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.824709 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-27.ec2.internal" event="NodeHasSufficientPID" Jul 21 20:35:07.872976 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.824753 2560 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-131-27.ec2.internal" Jul 21 20:35:07.872976 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.831287 2560 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-131-27.ec2.internal" Jul 21 20:35:07.872976 ip-10-0-131-27 kubenswrapper[2560]: E0721 20:35:07.831309 2560 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-131-27.ec2.internal\": node \"ip-10-0-131-27.ec2.internal\" not found" Jul 21 20:35:07.872976 ip-10-0-131-27 kubenswrapper[2560]: E0721 20:35:07.852284 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-27.ec2.internal\" not found" Jul 21 20:35:07.872976 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.862665 2560 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 21 20:35:07.872976 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.863980 2560 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 21 20:35:07.872976 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.864031 2560 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 21 20:35:07.872976 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.864052 2560 kubelet.go:2448] "Starting kubelet main sync loop" Jul 21 20:35:07.872976 ip-10-0-131-27 kubenswrapper[2560]: E0721 20:35:07.864090 2560 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 21 20:35:07.872976 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.866571 2560 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 21 20:35:08.011979 ip-10-0-131-27 kubenswrapper[2560]: E0721 20:35:07.953964 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-27.ec2.internal\" not found" Jul 21 20:35:08.011979 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.964901 2560 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-27.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-131-27.ec2.internal"] Jul 21 20:35:08.011979 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.964987 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 21 20:35:08.011979 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.966134 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-27.ec2.internal" event="NodeHasSufficientMemory" Jul 21 20:35:08.011979 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.966171 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-27.ec2.internal" event="NodeHasNoDiskPressure" Jul 21 20:35:08.011979 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.966186 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-27.ec2.internal" event="NodeHasSufficientPID" Jul 21 20:35:08.011979 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.967671 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 21 20:35:08.011979 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.967782 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-27.ec2.internal" Jul 21 20:35:08.011979 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.967828 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 21 20:35:08.011979 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.968580 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-27.ec2.internal" event="NodeHasSufficientMemory" Jul 21 20:35:08.011979 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.968613 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-27.ec2.internal" event="NodeHasNoDiskPressure" Jul 21 20:35:08.011979 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.968627 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-27.ec2.internal" event="NodeHasSufficientPID" Jul 21 20:35:08.011979 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.968584 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-27.ec2.internal" event="NodeHasSufficientMemory" Jul 21 20:35:08.011979 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.968703 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-27.ec2.internal" event="NodeHasNoDiskPressure" Jul 21 20:35:08.011979 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.968720 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-27.ec2.internal" event="NodeHasSufficientPID" Jul 21 20:35:08.011979 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.970164 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-27.ec2.internal" Jul 21 20:35:08.011979 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.970191 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 21 20:35:08.011979 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.970945 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-27.ec2.internal" event="NodeHasSufficientMemory" Jul 21 20:35:08.011979 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.970971 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-27.ec2.internal" event="NodeHasNoDiskPressure" Jul 21 20:35:08.011979 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:07.970983 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-27.ec2.internal" event="NodeHasSufficientPID" Jul 21 20:35:08.011979 ip-10-0-131-27 kubenswrapper[2560]: E0721 20:35:07.996797 2560 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-27.ec2.internal\" not found" node="ip-10-0-131-27.ec2.internal" Jul 21 20:35:08.011979 ip-10-0-131-27 kubenswrapper[2560]: E0721 20:35:08.000713 2560 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-27.ec2.internal\" not found" node="ip-10-0-131-27.ec2.internal" Jul 21 20:35:08.176789 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:08.029087 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e748e1b0ad8f133f242876b765fcf5fc-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-27.ec2.internal\" (UID: \"e748e1b0ad8f133f242876b765fcf5fc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-27.ec2.internal" Jul 21 20:35:08.176789 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:08.029133 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d5698e5baf2a73bf68056435e9975908-config\") pod \"kube-apiserver-proxy-ip-10-0-131-27.ec2.internal\" (UID: \"d5698e5baf2a73bf68056435e9975908\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-27.ec2.internal" Jul 21 20:35:08.176789 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:08.029161 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e748e1b0ad8f133f242876b765fcf5fc-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-27.ec2.internal\" (UID: \"e748e1b0ad8f133f242876b765fcf5fc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-27.ec2.internal" Jul 21 20:35:08.176789 ip-10-0-131-27 kubenswrapper[2560]: E0721 20:35:08.055144 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-27.ec2.internal\" not found" Jul 21 20:35:08.176789 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:08.130223 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e748e1b0ad8f133f242876b765fcf5fc-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-27.ec2.internal\" (UID: \"e748e1b0ad8f133f242876b765fcf5fc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-27.ec2.internal" Jul 21 20:35:08.176789 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:08.130257 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e748e1b0ad8f133f242876b765fcf5fc-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-27.ec2.internal\" (UID: \"e748e1b0ad8f133f242876b765fcf5fc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-27.ec2.internal" Jul 21 20:35:08.176789 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:08.130285 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d5698e5baf2a73bf68056435e9975908-config\") pod \"kube-apiserver-proxy-ip-10-0-131-27.ec2.internal\" (UID: \"d5698e5baf2a73bf68056435e9975908\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-27.ec2.internal" Jul 21 20:35:08.176789 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:08.130339 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e748e1b0ad8f133f242876b765fcf5fc-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-27.ec2.internal\" (UID: \"e748e1b0ad8f133f242876b765fcf5fc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-27.ec2.internal" Jul 21 20:35:08.176789 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:08.130375 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e748e1b0ad8f133f242876b765fcf5fc-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-27.ec2.internal\" (UID: \"e748e1b0ad8f133f242876b765fcf5fc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-27.ec2.internal" Jul 21 20:35:08.176789 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:08.130423 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d5698e5baf2a73bf68056435e9975908-config\") pod \"kube-apiserver-proxy-ip-10-0-131-27.ec2.internal\" (UID: \"d5698e5baf2a73bf68056435e9975908\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-27.ec2.internal" Jul 21 20:35:08.176789 ip-10-0-131-27 kubenswrapper[2560]: E0721 20:35:08.156292 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-27.ec2.internal\" not found" Jul 21 20:35:08.337945 ip-10-0-131-27 kubenswrapper[2560]: E0721 20:35:08.258411 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-27.ec2.internal\" not found" Jul 21 20:35:08.337945 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:08.302951 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-27.ec2.internal" Jul 21 20:35:08.337945 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:08.304123 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-27.ec2.internal" Jul 21 20:35:08.475223 ip-10-0-131-27 kubenswrapper[2560]: E0721 20:35:08.359212 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-27.ec2.internal\" not found" Jul 21 20:35:08.475223 ip-10-0-131-27 kubenswrapper[2560]: E0721 20:35:08.461385 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-27.ec2.internal\" not found" Jul 21 20:35:08.601672 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:08.550001 2560 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 21 20:35:08.601672 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:08.553841 2560 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 21 20:35:08.601672 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:08.553970 2560 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 21 20:35:08.601672 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:08.554030 2560 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 21 20:35:08.601672 ip-10-0-131-27 kubenswrapper[2560]: E0721 20:35:08.562583 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-27.ec2.internal\" not found" Jul 21 20:35:08.770104 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:08.645709 2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-20 20:30:08 +0000 UTC" deadline="2028-02-02 03:54:42.544834601 +0000 UTC" Jul 21 20:35:08.770104 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:08.645738 2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13447h19m33.899099574s" Jul 21 20:35:08.770104 ip-10-0-131-27 kubenswrapper[2560]: E0721 20:35:08.663140 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-27.ec2.internal\" not found" Jul 21 20:35:08.770104 ip-10-0-131-27 kubenswrapper[2560]: E0721 20:35:08.764334 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-27.ec2.internal\" not found" Jul 21 20:35:08.865289 ip-10-0-131-27 kubenswrapper[2560]: E0721 20:35:08.865173 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-27.ec2.internal\" not found" Jul 21 20:35:08.895637 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:08.895604 2560 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 21 20:35:08.966264 ip-10-0-131-27 kubenswrapper[2560]: E0721 20:35:08.966218 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-27.ec2.internal\" not found" Jul 21 20:35:08.994304 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:08.994267 2560 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 21 20:35:09.007797 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:09.007764 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5698e5baf2a73bf68056435e9975908.slice/crio-b67e709d9a493cfddeb03a66862ed36e336434a5ce07cafb1542959bf2c61a11 WatchSource:0}: Error finding container b67e709d9a493cfddeb03a66862ed36e336434a5ce07cafb1542959bf2c61a11: Status 404 returned error can't find the container with id b67e709d9a493cfddeb03a66862ed36e336434a5ce07cafb1542959bf2c61a11 Jul 21 20:35:09.008186 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:09.008166 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode748e1b0ad8f133f242876b765fcf5fc.slice/crio-abfe71cf4f518693d95ce093f98194492459f89cabefc0c96c8076791c813db4 WatchSource:0}: Error finding container abfe71cf4f518693d95ce093f98194492459f89cabefc0c96c8076791c813db4: Status 404 returned error can't find the container with id abfe71cf4f518693d95ce093f98194492459f89cabefc0c96c8076791c813db4 Jul 21 20:35:09.013383 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.013361 2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 21 20:35:09.027254 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.027229 2560 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-27.ec2.internal" Jul 21 20:35:09.041601 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.041576 2560 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 21 20:35:09.042619 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.042604 2560 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-27.ec2.internal" Jul 21 20:35:09.052953 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.052934 2560 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 21 20:35:09.608621 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.608310 2560 apiserver.go:52] "Watching apiserver" Jul 21 20:35:09.619804 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.619775 2560 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 21 20:35:09.620319 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.620294 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-131-27.ec2.internal","openshift-image-registry/node-ca-gf4h6","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-27.ec2.internal","openshift-multus/multus-additional-cni-plugins-tdg72","openshift-multus/multus-rl9pf","openshift-multus/network-metrics-daemon-qs78f","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nr9h","openshift-cluster-node-tuning-operator/tuned-swn8q","openshift-dns/node-resolver-4shwn","openshift-network-diagnostics/network-check-target-5v767","openshift-network-operator/iptables-alerter-6k7l8","openshift-ovn-kubernetes/ovnkube-node-bpvvl","kube-system/global-pull-secret-syncer-2mfdm","kube-system/konnectivity-agent-qgk2d"] Jul 21 20:35:09.623006 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.622985 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5v767" Jul 21 20:35:09.623534 ip-10-0-131-27 kubenswrapper[2560]: E0721 20:35:09.623148 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5v767" podUID="3abb9e4b-7d06-4635-90a7-a31abc3c38ff" Jul 21 20:35:09.625758 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.625650 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2mfdm" Jul 21 20:35:09.625758 ip-10-0-131-27 kubenswrapper[2560]: E0721 20:35:09.625721 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2mfdm" podUID="0da0f4c0-d4be-484a-8efb-8f525f2ab0d9" Jul 21 20:35:09.630408 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.630385 2560 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 21 20:35:09.631017 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.630539 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-qgk2d" Jul 21 20:35:09.631145 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.631087 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-tdg72" Jul 21 20:35:09.633229 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.632983 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-rl9pf" Jul 21 20:35:09.633976 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.633732 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 21 20:35:09.633976 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.633801 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 21 20:35:09.633976 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.633970 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-9ctc6\"" Jul 21 20:35:09.634594 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.634243 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 21 20:35:09.634594 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.634438 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 21 20:35:09.636166 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.635861 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qs78f" Jul 21 20:35:09.636166 ip-10-0-131-27 kubenswrapper[2560]: E0721 20:35:09.635933 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qs78f" podUID="51fd4d84-10d1-464a-bcdb-dd32614a44a9" Jul 21 20:35:09.636166 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.636036 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 21 20:35:09.638829 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.638806 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-dftjp\"" Jul 21 20:35:09.639109 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.639074 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 21 20:35:09.640057 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.639345 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 21 20:35:09.640057 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.639665 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-5qww5\"" Jul 21 20:35:09.640057 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.639884 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 21 20:35:09.640269 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.640251 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/baf82b79-7fff-42da-8256-bd0d0b6a3414-system-cni-dir\") pod \"multus-additional-cni-plugins-tdg72\" (UID: \"baf82b79-7fff-42da-8256-bd0d0b6a3414\") " pod="openshift-multus/multus-additional-cni-plugins-tdg72" Jul 21 20:35:09.640321 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.640289 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/baf82b79-7fff-42da-8256-bd0d0b6a3414-cni-binary-copy\") pod \"multus-additional-cni-plugins-tdg72\" (UID: \"baf82b79-7fff-42da-8256-bd0d0b6a3414\") " pod="openshift-multus/multus-additional-cni-plugins-tdg72" Jul 21 20:35:09.640982 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.640371 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/baf82b79-7fff-42da-8256-bd0d0b6a3414-cnibin\") pod \"multus-additional-cni-plugins-tdg72\" (UID: \"baf82b79-7fff-42da-8256-bd0d0b6a3414\") " pod="openshift-multus/multus-additional-cni-plugins-tdg72" Jul 21 20:35:09.640982 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.640431 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/baf82b79-7fff-42da-8256-bd0d0b6a3414-os-release\") pod \"multus-additional-cni-plugins-tdg72\" (UID: \"baf82b79-7fff-42da-8256-bd0d0b6a3414\") " pod="openshift-multus/multus-additional-cni-plugins-tdg72" Jul 21 20:35:09.640982 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.640489 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/baf82b79-7fff-42da-8256-bd0d0b6a3414-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tdg72\" (UID: \"baf82b79-7fff-42da-8256-bd0d0b6a3414\") " pod="openshift-multus/multus-additional-cni-plugins-tdg72" Jul 21 20:35:09.640982 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.640519 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0da0f4c0-d4be-484a-8efb-8f525f2ab0d9-dbus\") pod \"global-pull-secret-syncer-2mfdm\" (UID: \"0da0f4c0-d4be-484a-8efb-8f525f2ab0d9\") " pod="kube-system/global-pull-secret-syncer-2mfdm" Jul 21 20:35:09.640982 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.640550 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e5ef3217-99e0-43ce-a415-937df67f3cd2-agent-certs\") pod \"konnectivity-agent-qgk2d\" (UID: \"e5ef3217-99e0-43ce-a415-937df67f3cd2\") " pod="kube-system/konnectivity-agent-qgk2d" Jul 21 20:35:09.640982 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.640575 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/baf82b79-7fff-42da-8256-bd0d0b6a3414-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tdg72\" (UID: \"baf82b79-7fff-42da-8256-bd0d0b6a3414\") " pod="openshift-multus/multus-additional-cni-plugins-tdg72" Jul 21 20:35:09.640982 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.640611 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vltxc\" (UniqueName: \"kubernetes.io/projected/baf82b79-7fff-42da-8256-bd0d0b6a3414-kube-api-access-vltxc\") pod \"multus-additional-cni-plugins-tdg72\" (UID: \"baf82b79-7fff-42da-8256-bd0d0b6a3414\") " pod="openshift-multus/multus-additional-cni-plugins-tdg72" Jul 21 20:35:09.640982 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.640644 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0da0f4c0-d4be-484a-8efb-8f525f2ab0d9-kubelet-config\") pod \"global-pull-secret-syncer-2mfdm\" (UID: \"0da0f4c0-d4be-484a-8efb-8f525f2ab0d9\") " pod="kube-system/global-pull-secret-syncer-2mfdm" Jul 21 20:35:09.640982 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.640691 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0da0f4c0-d4be-484a-8efb-8f525f2ab0d9-original-pull-secret\") pod \"global-pull-secret-syncer-2mfdm\" (UID: \"0da0f4c0-d4be-484a-8efb-8f525f2ab0d9\") " pod="kube-system/global-pull-secret-syncer-2mfdm" Jul 21 20:35:09.640982 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.640722 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dtrsl\" (UniqueName: \"kubernetes.io/projected/3abb9e4b-7d06-4635-90a7-a31abc3c38ff-kube-api-access-dtrsl\") pod \"network-check-target-5v767\" (UID: \"3abb9e4b-7d06-4635-90a7-a31abc3c38ff\") " pod="openshift-network-diagnostics/network-check-target-5v767" Jul 21 20:35:09.640982 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.640750 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e5ef3217-99e0-43ce-a415-937df67f3cd2-konnectivity-ca\") pod \"konnectivity-agent-qgk2d\" (UID: \"e5ef3217-99e0-43ce-a415-937df67f3cd2\") " pod="kube-system/konnectivity-agent-qgk2d" Jul 21 20:35:09.640982 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.640782 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/baf82b79-7fff-42da-8256-bd0d0b6a3414-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tdg72\" (UID: \"baf82b79-7fff-42da-8256-bd0d0b6a3414\") " pod="openshift-multus/multus-additional-cni-plugins-tdg72" Jul 21 20:35:09.643012 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.641735 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-4shwn" Jul 21 20:35:09.643437 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.643419 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-swn8q" Jul 21 20:35:09.647922 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.647870 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 21 20:35:09.647999 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.647959 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-d9qsb\"" Jul 21 20:35:09.648793 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.648186 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 21 20:35:09.648793 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.648597 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-gf4h6" Jul 21 20:35:09.650108 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.649726 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-gw794\"" Jul 21 20:35:09.650108 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.649979 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 21 20:35:09.650108 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.649987 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 21 20:35:09.652548 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.651538 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 21 20:35:09.652548 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.651536 2560 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 21 20:35:09.652548 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.651971 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-b2bfv\"" Jul 21 20:35:09.652548 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.652243 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 21 20:35:09.652548 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.652321 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 21 20:35:09.652924 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.652579 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-bpvvl" Jul 21 20:35:09.654534 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.654478 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-6k7l8" Jul 21 20:35:09.656795 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.656769 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nr9h" Jul 21 20:35:09.657616 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.657596 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 21 20:35:09.657715 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.657664 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 21 20:35:09.657896 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.657877 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 21 20:35:09.657996 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.657888 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 21 20:35:09.658131 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.658114 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-gctbc\"" Jul 21 20:35:09.658411 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.658290 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 21 20:35:09.658490 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.658433 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 21 20:35:09.660051 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.659189 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-c8lwt\"" Jul 21 20:35:09.660051 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.659433 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 21 20:35:09.660051 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.659621 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 21 20:35:09.660051 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.659806 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 21 20:35:09.660436 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.660313 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 21 20:35:09.660436 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.660325 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 21 20:35:09.660436 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.660330 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-f9pwk\"" Jul 21 20:35:09.660767 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.660750 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 21 20:35:09.675147 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.674777 2560 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-m7tnk" Jul 21 20:35:09.728555 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.728425 2560 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 21 20:35:09.741036 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.740995 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/77b4be87-3e69-4f8a-a708-1dd40a4f05cc-etc-modprobe-d\") pod \"tuned-swn8q\" (UID: \"77b4be87-3e69-4f8a-a708-1dd40a4f05cc\") " pod="openshift-cluster-node-tuning-operator/tuned-swn8q" Jul 21 20:35:09.741191 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.741058 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cd3c0f2a-c76d-4d83-9eeb-1e5dafd81177-host-run-ovn-kubernetes\") pod \"ovnkube-node-bpvvl\" (UID: \"cd3c0f2a-c76d-4d83-9eeb-1e5dafd81177\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpvvl" Jul 21 20:35:09.741191 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.741087 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rj6lq\" (UniqueName: \"kubernetes.io/projected/e49d91ac-7093-4224-b087-0115ce9cec60-kube-api-access-rj6lq\") pod \"multus-rl9pf\" (UID: \"e49d91ac-7093-4224-b087-0115ce9cec60\") " pod="openshift-multus/multus-rl9pf" Jul 21 20:35:09.741191 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.741113 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cd3c0f2a-c76d-4d83-9eeb-1e5dafd81177-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bpvvl\" (UID: \"cd3c0f2a-c76d-4d83-9eeb-1e5dafd81177\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpvvl" Jul 21 20:35:09.741191 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.741150 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dtrsl\" (UniqueName: \"kubernetes.io/projected/3abb9e4b-7d06-4635-90a7-a31abc3c38ff-kube-api-access-dtrsl\") pod \"network-check-target-5v767\" (UID: \"3abb9e4b-7d06-4635-90a7-a31abc3c38ff\") " pod="openshift-network-diagnostics/network-check-target-5v767" Jul 21 20:35:09.741191 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.741179 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/77b4be87-3e69-4f8a-a708-1dd40a4f05cc-etc-sysconfig\") pod \"tuned-swn8q\" (UID: \"77b4be87-3e69-4f8a-a708-1dd40a4f05cc\") " pod="openshift-cluster-node-tuning-operator/tuned-swn8q" Jul 21 20:35:09.741478 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.741203 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cd3c0f2a-c76d-4d83-9eeb-1e5dafd81177-host-slash\") pod \"ovnkube-node-bpvvl\" (UID: \"cd3c0f2a-c76d-4d83-9eeb-1e5dafd81177\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpvvl" Jul 21 20:35:09.741478 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.741229 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cd3c0f2a-c76d-4d83-9eeb-1e5dafd81177-etc-openvswitch\") pod \"ovnkube-node-bpvvl\" (UID: \"cd3c0f2a-c76d-4d83-9eeb-1e5dafd81177\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpvvl" Jul 21 20:35:09.741478 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.741256 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e49d91ac-7093-4224-b087-0115ce9cec60-multus-conf-dir\") pod \"multus-rl9pf\" (UID: \"e49d91ac-7093-4224-b087-0115ce9cec60\") " pod="openshift-multus/multus-rl9pf" Jul 21 20:35:09.741478 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.741319 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e49d91ac-7093-4224-b087-0115ce9cec60-etc-kubernetes\") pod \"multus-rl9pf\" (UID: \"e49d91ac-7093-4224-b087-0115ce9cec60\") " pod="openshift-multus/multus-rl9pf" Jul 21 20:35:09.741478 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.741344 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/77b4be87-3e69-4f8a-a708-1dd40a4f05cc-lib-modules\") pod \"tuned-swn8q\" (UID: \"77b4be87-3e69-4f8a-a708-1dd40a4f05cc\") " pod="openshift-cluster-node-tuning-operator/tuned-swn8q" Jul 21 20:35:09.741478 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.741367 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/77b4be87-3e69-4f8a-a708-1dd40a4f05cc-host\") pod \"tuned-swn8q\" (UID: \"77b4be87-3e69-4f8a-a708-1dd40a4f05cc\") " pod="openshift-cluster-node-tuning-operator/tuned-swn8q" Jul 21 20:35:09.741478 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.741389 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/cd3c0f2a-c76d-4d83-9eeb-1e5dafd81177-systemd-units\") pod \"ovnkube-node-bpvvl\" (UID: \"cd3c0f2a-c76d-4d83-9eeb-1e5dafd81177\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpvvl" Jul 21 20:35:09.741478 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.741411 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e49d91ac-7093-4224-b087-0115ce9cec60-multus-cni-dir\") pod \"multus-rl9pf\" (UID: \"e49d91ac-7093-4224-b087-0115ce9cec60\") " pod="openshift-multus/multus-rl9pf" Jul 21 20:35:09.741478 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.741439 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/baf82b79-7fff-42da-8256-bd0d0b6a3414-cnibin\") pod \"multus-additional-cni-plugins-tdg72\" (UID: \"baf82b79-7fff-42da-8256-bd0d0b6a3414\") " pod="openshift-multus/multus-additional-cni-plugins-tdg72" Jul 21 20:35:09.741478 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.741465 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8cafaac7-d4fe-43e8-a75a-08f26aa58cd5-tmp-dir\") pod \"node-resolver-4shwn\" (UID: \"8cafaac7-d4fe-43e8-a75a-08f26aa58cd5\") " pod="openshift-dns/node-resolver-4shwn" Jul 21 20:35:09.741986 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.741492 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/77b4be87-3e69-4f8a-a708-1dd40a4f05cc-etc-kubernetes\") pod \"tuned-swn8q\" (UID: \"77b4be87-3e69-4f8a-a708-1dd40a4f05cc\") " pod="openshift-cluster-node-tuning-operator/tuned-swn8q" Jul 21 20:35:09.741986 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.741555 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/baf82b79-7fff-42da-8256-bd0d0b6a3414-cnibin\") pod \"multus-additional-cni-plugins-tdg72\" (UID: \"baf82b79-7fff-42da-8256-bd0d0b6a3414\") " pod="openshift-multus/multus-additional-cni-plugins-tdg72" Jul 21 20:35:09.741986 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.741558 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jl6xv\" (UniqueName: \"kubernetes.io/projected/74c3fef4-6119-460a-850e-27a565b7d068-kube-api-access-jl6xv\") pod \"node-ca-gf4h6\" (UID: \"74c3fef4-6119-460a-850e-27a565b7d068\") " pod="openshift-image-registry/node-ca-gf4h6" Jul 21 20:35:09.741986 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.741607 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vltxc\" (UniqueName: \"kubernetes.io/projected/baf82b79-7fff-42da-8256-bd0d0b6a3414-kube-api-access-vltxc\") pod \"multus-additional-cni-plugins-tdg72\" (UID: \"baf82b79-7fff-42da-8256-bd0d0b6a3414\") " pod="openshift-multus/multus-additional-cni-plugins-tdg72" Jul 21 20:35:09.741986 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.741640 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0da0f4c0-d4be-484a-8efb-8f525f2ab0d9-kubelet-config\") pod \"global-pull-secret-syncer-2mfdm\" (UID: \"0da0f4c0-d4be-484a-8efb-8f525f2ab0d9\") " pod="kube-system/global-pull-secret-syncer-2mfdm" Jul 21 20:35:09.741986 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.741887 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0da0f4c0-d4be-484a-8efb-8f525f2ab0d9-kubelet-config\") pod \"global-pull-secret-syncer-2mfdm\" (UID: \"0da0f4c0-d4be-484a-8efb-8f525f2ab0d9\") " pod="kube-system/global-pull-secret-syncer-2mfdm" Jul 21 20:35:09.742303 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.742169 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8cafaac7-d4fe-43e8-a75a-08f26aa58cd5-hosts-file\") pod \"node-resolver-4shwn\" (UID: \"8cafaac7-d4fe-43e8-a75a-08f26aa58cd5\") " pod="openshift-dns/node-resolver-4shwn" Jul 21 20:35:09.742303 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.742202 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/77b4be87-3e69-4f8a-a708-1dd40a4f05cc-sys\") pod \"tuned-swn8q\" (UID: \"77b4be87-3e69-4f8a-a708-1dd40a4f05cc\") " pod="openshift-cluster-node-tuning-operator/tuned-swn8q" Jul 21 20:35:09.742303 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.742238 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/cd3c0f2a-c76d-4d83-9eeb-1e5dafd81177-log-socket\") pod \"ovnkube-node-bpvvl\" (UID: \"cd3c0f2a-c76d-4d83-9eeb-1e5dafd81177\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpvvl" Jul 21 20:35:09.742303 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.742264 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e49d91ac-7093-4224-b087-0115ce9cec60-cni-binary-copy\") pod \"multus-rl9pf\" (UID: \"e49d91ac-7093-4224-b087-0115ce9cec60\") " pod="openshift-multus/multus-rl9pf" Jul 21 20:35:09.742303 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.742291 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e5ef3217-99e0-43ce-a415-937df67f3cd2-konnectivity-ca\") pod \"konnectivity-agent-qgk2d\" (UID: \"e5ef3217-99e0-43ce-a415-937df67f3cd2\") " pod="kube-system/konnectivity-agent-qgk2d" Jul 21 20:35:09.742557 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.742318 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/cd3c0f2a-c76d-4d83-9eeb-1e5dafd81177-host-kubelet\") pod \"ovnkube-node-bpvvl\" (UID: \"cd3c0f2a-c76d-4d83-9eeb-1e5dafd81177\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpvvl" Jul 21 20:35:09.742557 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.742346 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bd370f2e-33cc-425d-812a-c063fd02f4c9-host-slash\") pod \"iptables-alerter-6k7l8\" (UID: \"bd370f2e-33cc-425d-812a-c063fd02f4c9\") " pod="openshift-network-operator/iptables-alerter-6k7l8" Jul 21 20:35:09.742557 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.742370 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/92ab865e-73dc-4b1a-a999-5ad3e40f04f0-etc-selinux\") pod \"aws-ebs-csi-driver-node-9nr9h\" (UID: \"92ab865e-73dc-4b1a-a999-5ad3e40f04f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nr9h" Jul 21 20:35:09.742557 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.742399 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e49d91ac-7093-4224-b087-0115ce9cec60-os-release\") pod \"multus-rl9pf\" (UID: \"e49d91ac-7093-4224-b087-0115ce9cec60\") " pod="openshift-multus/multus-rl9pf" Jul 21 20:35:09.742557 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.742422 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e49d91ac-7093-4224-b087-0115ce9cec60-multus-daemon-config\") pod \"multus-rl9pf\" (UID: \"e49d91ac-7093-4224-b087-0115ce9cec60\") " pod="openshift-multus/multus-rl9pf" Jul 21 20:35:09.742557 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.742448 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/baf82b79-7fff-42da-8256-bd0d0b6a3414-cni-binary-copy\") pod \"multus-additional-cni-plugins-tdg72\" (UID: \"baf82b79-7fff-42da-8256-bd0d0b6a3414\") " pod="openshift-multus/multus-additional-cni-plugins-tdg72" Jul 21 20:35:09.742557 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.742472 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/77b4be87-3e69-4f8a-a708-1dd40a4f05cc-etc-sysctl-conf\") pod \"tuned-swn8q\" (UID: \"77b4be87-3e69-4f8a-a708-1dd40a4f05cc\") " pod="openshift-cluster-node-tuning-operator/tuned-swn8q" Jul 21 20:35:09.742557 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.742496 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/77b4be87-3e69-4f8a-a708-1dd40a4f05cc-run\") pod \"tuned-swn8q\" (UID: \"77b4be87-3e69-4f8a-a708-1dd40a4f05cc\") " pod="openshift-cluster-node-tuning-operator/tuned-swn8q" Jul 21 20:35:09.742557 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.742523 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cd3c0f2a-c76d-4d83-9eeb-1e5dafd81177-var-lib-openvswitch\") pod \"ovnkube-node-bpvvl\" (UID: \"cd3c0f2a-c76d-4d83-9eeb-1e5dafd81177\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpvvl" Jul 21 20:35:09.742986 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.742569 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e49d91ac-7093-4224-b087-0115ce9cec60-host-var-lib-kubelet\") pod \"multus-rl9pf\" (UID: \"e49d91ac-7093-4224-b087-0115ce9cec60\") " pod="openshift-multus/multus-rl9pf" Jul 21 20:35:09.742986 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.742597 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/baf82b79-7fff-42da-8256-bd0d0b6a3414-os-release\") pod \"multus-additional-cni-plugins-tdg72\" (UID: \"baf82b79-7fff-42da-8256-bd0d0b6a3414\") " pod="openshift-multus/multus-additional-cni-plugins-tdg72" Jul 21 20:35:09.742986 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.742622 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/baf82b79-7fff-42da-8256-bd0d0b6a3414-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tdg72\" (UID: \"baf82b79-7fff-42da-8256-bd0d0b6a3414\") " pod="openshift-multus/multus-additional-cni-plugins-tdg72" Jul 21 20:35:09.742986 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.742648 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dc48z\" (UniqueName: \"kubernetes.io/projected/bd370f2e-33cc-425d-812a-c063fd02f4c9-kube-api-access-dc48z\") pod \"iptables-alerter-6k7l8\" (UID: \"bd370f2e-33cc-425d-812a-c063fd02f4c9\") " pod="openshift-network-operator/iptables-alerter-6k7l8" Jul 21 20:35:09.742986 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.742675 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/baf82b79-7fff-42da-8256-bd0d0b6a3414-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tdg72\" (UID: \"baf82b79-7fff-42da-8256-bd0d0b6a3414\") " pod="openshift-multus/multus-additional-cni-plugins-tdg72" Jul 21 20:35:09.742986 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.742698 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/74c3fef4-6119-460a-850e-27a565b7d068-serviceca\") pod \"node-ca-gf4h6\" (UID: \"74c3fef4-6119-460a-850e-27a565b7d068\") " pod="openshift-image-registry/node-ca-gf4h6" Jul 21 20:35:09.742986 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.742723 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cd3c0f2a-c76d-4d83-9eeb-1e5dafd81177-run-openvswitch\") pod \"ovnkube-node-bpvvl\" (UID: \"cd3c0f2a-c76d-4d83-9eeb-1e5dafd81177\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpvvl" Jul 21 20:35:09.742986 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.742749 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cd3c0f2a-c76d-4d83-9eeb-1e5dafd81177-host-cni-bin\") pod \"ovnkube-node-bpvvl\" (UID: \"cd3c0f2a-c76d-4d83-9eeb-1e5dafd81177\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpvvl" Jul 21 20:35:09.742986 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.742774 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/92ab865e-73dc-4b1a-a999-5ad3e40f04f0-sys-fs\") pod \"aws-ebs-csi-driver-node-9nr9h\" (UID: \"92ab865e-73dc-4b1a-a999-5ad3e40f04f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nr9h" Jul 21 20:35:09.742986 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.742805 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e49d91ac-7093-4224-b087-0115ce9cec60-multus-socket-dir-parent\") pod \"multus-rl9pf\" (UID: \"e49d91ac-7093-4224-b087-0115ce9cec60\") " pod="openshift-multus/multus-rl9pf" Jul 21 20:35:09.742986 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.742828 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/51fd4d84-10d1-464a-bcdb-dd32614a44a9-metrics-certs\") pod \"network-metrics-daemon-qs78f\" (UID: \"51fd4d84-10d1-464a-bcdb-dd32614a44a9\") " pod="openshift-multus/network-metrics-daemon-qs78f" Jul 21 20:35:09.742986 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.742856 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/cd3c0f2a-c76d-4d83-9eeb-1e5dafd81177-ovn-node-metrics-cert\") pod \"ovnkube-node-bpvvl\" (UID: \"cd3c0f2a-c76d-4d83-9eeb-1e5dafd81177\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpvvl" Jul 21 20:35:09.742986 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.742884 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/baf82b79-7fff-42da-8256-bd0d0b6a3414-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tdg72\" (UID: \"baf82b79-7fff-42da-8256-bd0d0b6a3414\") " pod="openshift-multus/multus-additional-cni-plugins-tdg72" Jul 21 20:35:09.742986 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.742920 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/77b4be87-3e69-4f8a-a708-1dd40a4f05cc-etc-sysctl-d\") pod \"tuned-swn8q\" (UID: \"77b4be87-3e69-4f8a-a708-1dd40a4f05cc\") " pod="openshift-cluster-node-tuning-operator/tuned-swn8q" Jul 21 20:35:09.742986 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.742943 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/77b4be87-3e69-4f8a-a708-1dd40a4f05cc-etc-tuned\") pod \"tuned-swn8q\" (UID: \"77b4be87-3e69-4f8a-a708-1dd40a4f05cc\") " pod="openshift-cluster-node-tuning-operator/tuned-swn8q" Jul 21 20:35:09.742986 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.742967 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/92ab865e-73dc-4b1a-a999-5ad3e40f04f0-socket-dir\") pod \"aws-ebs-csi-driver-node-9nr9h\" (UID: \"92ab865e-73dc-4b1a-a999-5ad3e40f04f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nr9h" Jul 21 20:35:09.743851 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.742991 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e49d91ac-7093-4224-b087-0115ce9cec60-system-cni-dir\") pod \"multus-rl9pf\" (UID: \"e49d91ac-7093-4224-b087-0115ce9cec60\") " pod="openshift-multus/multus-rl9pf" Jul 21 20:35:09.743851 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.743014 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e49d91ac-7093-4224-b087-0115ce9cec60-host-run-netns\") pod \"multus-rl9pf\" (UID: \"e49d91ac-7093-4224-b087-0115ce9cec60\") " pod="openshift-multus/multus-rl9pf" Jul 21 20:35:09.743851 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.743039 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/77b4be87-3e69-4f8a-a708-1dd40a4f05cc-etc-systemd\") pod \"tuned-swn8q\" (UID: \"77b4be87-3e69-4f8a-a708-1dd40a4f05cc\") " pod="openshift-cluster-node-tuning-operator/tuned-swn8q" Jul 21 20:35:09.743851 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.743063 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cv6np\" (UniqueName: \"kubernetes.io/projected/77b4be87-3e69-4f8a-a708-1dd40a4f05cc-kube-api-access-cv6np\") pod \"tuned-swn8q\" (UID: \"77b4be87-3e69-4f8a-a708-1dd40a4f05cc\") " pod="openshift-cluster-node-tuning-operator/tuned-swn8q" Jul 21 20:35:09.743851 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.743106 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cd3c0f2a-c76d-4d83-9eeb-1e5dafd81177-host-run-netns\") pod \"ovnkube-node-bpvvl\" (UID: \"cd3c0f2a-c76d-4d83-9eeb-1e5dafd81177\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpvvl" Jul 21 20:35:09.743851 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.743131 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/cd3c0f2a-c76d-4d83-9eeb-1e5dafd81177-run-ovn\") pod \"ovnkube-node-bpvvl\" (UID: \"cd3c0f2a-c76d-4d83-9eeb-1e5dafd81177\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpvvl" Jul 21 20:35:09.743851 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.743156 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/cd3c0f2a-c76d-4d83-9eeb-1e5dafd81177-ovnkube-script-lib\") pod \"ovnkube-node-bpvvl\" (UID: \"cd3c0f2a-c76d-4d83-9eeb-1e5dafd81177\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpvvl" Jul 21 20:35:09.743851 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.743180 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/92ab865e-73dc-4b1a-a999-5ad3e40f04f0-registration-dir\") pod \"aws-ebs-csi-driver-node-9nr9h\" (UID: \"92ab865e-73dc-4b1a-a999-5ad3e40f04f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nr9h" Jul 21 20:35:09.743851 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.743207 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e49d91ac-7093-4224-b087-0115ce9cec60-host-run-k8s-cni-cncf-io\") pod \"multus-rl9pf\" (UID: \"e49d91ac-7093-4224-b087-0115ce9cec60\") " pod="openshift-multus/multus-rl9pf" Jul 21 20:35:09.743851 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.743231 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e49d91ac-7093-4224-b087-0115ce9cec60-host-var-lib-cni-bin\") pod \"multus-rl9pf\" (UID: \"e49d91ac-7093-4224-b087-0115ce9cec60\") " pod="openshift-multus/multus-rl9pf" Jul 21 20:35:09.743851 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.743507 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0da0f4c0-d4be-484a-8efb-8f525f2ab0d9-dbus\") pod \"global-pull-secret-syncer-2mfdm\" (UID: \"0da0f4c0-d4be-484a-8efb-8f525f2ab0d9\") " pod="kube-system/global-pull-secret-syncer-2mfdm" Jul 21 20:35:09.743851 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.743574 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pl7d8\" (UniqueName: \"kubernetes.io/projected/8cafaac7-d4fe-43e8-a75a-08f26aa58cd5-kube-api-access-pl7d8\") pod \"node-resolver-4shwn\" (UID: \"8cafaac7-d4fe-43e8-a75a-08f26aa58cd5\") " pod="openshift-dns/node-resolver-4shwn" Jul 21 20:35:09.743851 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.743612 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/cd3c0f2a-c76d-4d83-9eeb-1e5dafd81177-host-cni-netd\") pod \"ovnkube-node-bpvvl\" (UID: \"cd3c0f2a-c76d-4d83-9eeb-1e5dafd81177\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpvvl" Jul 21 20:35:09.743851 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.743650 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/92ab865e-73dc-4b1a-a999-5ad3e40f04f0-device-dir\") pod \"aws-ebs-csi-driver-node-9nr9h\" (UID: \"92ab865e-73dc-4b1a-a999-5ad3e40f04f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nr9h" Jul 21 20:35:09.743851 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.743829 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e49d91ac-7093-4224-b087-0115ce9cec60-host-run-multus-certs\") pod \"multus-rl9pf\" (UID: \"e49d91ac-7093-4224-b087-0115ce9cec60\") " pod="openshift-multus/multus-rl9pf" Jul 21 20:35:09.744513 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.743865 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7hdhs\" (UniqueName: \"kubernetes.io/projected/51fd4d84-10d1-464a-bcdb-dd32614a44a9-kube-api-access-7hdhs\") pod \"network-metrics-daemon-qs78f\" (UID: \"51fd4d84-10d1-464a-bcdb-dd32614a44a9\") " pod="openshift-multus/network-metrics-daemon-qs78f" Jul 21 20:35:09.744513 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.743902 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e5ef3217-99e0-43ce-a415-937df67f3cd2-agent-certs\") pod \"konnectivity-agent-qgk2d\" (UID: \"e5ef3217-99e0-43ce-a415-937df67f3cd2\") " pod="kube-system/konnectivity-agent-qgk2d" Jul 21 20:35:09.744513 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.743939 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0da0f4c0-d4be-484a-8efb-8f525f2ab0d9-original-pull-secret\") pod \"global-pull-secret-syncer-2mfdm\" (UID: \"0da0f4c0-d4be-484a-8efb-8f525f2ab0d9\") " pod="kube-system/global-pull-secret-syncer-2mfdm" Jul 21 20:35:09.744513 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.744176 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/77b4be87-3e69-4f8a-a708-1dd40a4f05cc-tmp\") pod \"tuned-swn8q\" (UID: \"77b4be87-3e69-4f8a-a708-1dd40a4f05cc\") " pod="openshift-cluster-node-tuning-operator/tuned-swn8q" Jul 21 20:35:09.744513 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.744214 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/cd3c0f2a-c76d-4d83-9eeb-1e5dafd81177-run-systemd\") pod \"ovnkube-node-bpvvl\" (UID: \"cd3c0f2a-c76d-4d83-9eeb-1e5dafd81177\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpvvl" Jul 21 20:35:09.745969 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.745939 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/cd3c0f2a-c76d-4d83-9eeb-1e5dafd81177-ovnkube-config\") pod \"ovnkube-node-bpvvl\" (UID: \"cd3c0f2a-c76d-4d83-9eeb-1e5dafd81177\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpvvl" Jul 21 20:35:09.746108 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.745986 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e49d91ac-7093-4224-b087-0115ce9cec60-cnibin\") pod \"multus-rl9pf\" (UID: \"e49d91ac-7093-4224-b087-0115ce9cec60\") " pod="openshift-multus/multus-rl9pf" Jul 21 20:35:09.746108 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.746017 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/74c3fef4-6119-460a-850e-27a565b7d068-host\") pod \"node-ca-gf4h6\" (UID: \"74c3fef4-6119-460a-850e-27a565b7d068\") " pod="openshift-image-registry/node-ca-gf4h6" Jul 21 20:35:09.746108 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.746046 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/cd3c0f2a-c76d-4d83-9eeb-1e5dafd81177-env-overrides\") pod \"ovnkube-node-bpvvl\" (UID: \"cd3c0f2a-c76d-4d83-9eeb-1e5dafd81177\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpvvl" Jul 21 20:35:09.746108 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.746076 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/bd370f2e-33cc-425d-812a-c063fd02f4c9-iptables-alerter-script\") pod \"iptables-alerter-6k7l8\" (UID: \"bd370f2e-33cc-425d-812a-c063fd02f4c9\") " pod="openshift-network-operator/iptables-alerter-6k7l8" Jul 21 20:35:09.746295 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.746126 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m424h\" (UniqueName: \"kubernetes.io/projected/92ab865e-73dc-4b1a-a999-5ad3e40f04f0-kube-api-access-m424h\") pod \"aws-ebs-csi-driver-node-9nr9h\" (UID: \"92ab865e-73dc-4b1a-a999-5ad3e40f04f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nr9h" Jul 21 20:35:09.746295 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.746157 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/baf82b79-7fff-42da-8256-bd0d0b6a3414-system-cni-dir\") pod \"multus-additional-cni-plugins-tdg72\" (UID: \"baf82b79-7fff-42da-8256-bd0d0b6a3414\") " pod="openshift-multus/multus-additional-cni-plugins-tdg72" Jul 21 20:35:09.746295 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.746186 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0da0f4c0-d4be-484a-8efb-8f525f2ab0d9-dbus\") pod \"global-pull-secret-syncer-2mfdm\" (UID: \"0da0f4c0-d4be-484a-8efb-8f525f2ab0d9\") " pod="kube-system/global-pull-secret-syncer-2mfdm" Jul 21 20:35:09.746295 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.746194 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/77b4be87-3e69-4f8a-a708-1dd40a4f05cc-var-lib-kubelet\") pod \"tuned-swn8q\" (UID: \"77b4be87-3e69-4f8a-a708-1dd40a4f05cc\") " pod="openshift-cluster-node-tuning-operator/tuned-swn8q" Jul 21 20:35:09.746295 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.746228 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/cd3c0f2a-c76d-4d83-9eeb-1e5dafd81177-node-log\") pod \"ovnkube-node-bpvvl\" (UID: \"cd3c0f2a-c76d-4d83-9eeb-1e5dafd81177\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpvvl" Jul 21 20:35:09.746499 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.746350 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e49d91ac-7093-4224-b087-0115ce9cec60-host-var-lib-cni-multus\") pod \"multus-rl9pf\" (UID: \"e49d91ac-7093-4224-b087-0115ce9cec60\") " pod="openshift-multus/multus-rl9pf" Jul 21 20:35:09.746499 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.746385 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e49d91ac-7093-4224-b087-0115ce9cec60-hostroot\") pod \"multus-rl9pf\" (UID: \"e49d91ac-7093-4224-b087-0115ce9cec60\") " pod="openshift-multus/multus-rl9pf" Jul 21 20:35:09.746499 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.746426 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hpmgz\" (UniqueName: \"kubernetes.io/projected/cd3c0f2a-c76d-4d83-9eeb-1e5dafd81177-kube-api-access-hpmgz\") pod \"ovnkube-node-bpvvl\" (UID: \"cd3c0f2a-c76d-4d83-9eeb-1e5dafd81177\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpvvl" Jul 21 20:35:09.746499 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.746460 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/92ab865e-73dc-4b1a-a999-5ad3e40f04f0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9nr9h\" (UID: \"92ab865e-73dc-4b1a-a999-5ad3e40f04f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nr9h" Jul 21 20:35:09.746753 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.746724 2560 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 21 20:35:09.747489 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.746886 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e5ef3217-99e0-43ce-a415-937df67f3cd2-konnectivity-ca\") pod \"konnectivity-agent-qgk2d\" (UID: \"e5ef3217-99e0-43ce-a415-937df67f3cd2\") " pod="kube-system/konnectivity-agent-qgk2d" Jul 21 20:35:09.747489 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.747049 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/baf82b79-7fff-42da-8256-bd0d0b6a3414-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tdg72\" (UID: \"baf82b79-7fff-42da-8256-bd0d0b6a3414\") " pod="openshift-multus/multus-additional-cni-plugins-tdg72" Jul 21 20:35:09.747489 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.747195 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/baf82b79-7fff-42da-8256-bd0d0b6a3414-os-release\") pod \"multus-additional-cni-plugins-tdg72\" (UID: \"baf82b79-7fff-42da-8256-bd0d0b6a3414\") " pod="openshift-multus/multus-additional-cni-plugins-tdg72" Jul 21 20:35:09.747489 ip-10-0-131-27 kubenswrapper[2560]: E0721 20:35:09.747312 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 21 20:35:09.747489 ip-10-0-131-27 kubenswrapper[2560]: E0721 20:35:09.747338 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 21 20:35:09.747489 ip-10-0-131-27 kubenswrapper[2560]: E0721 20:35:09.747360 2560 projected.go:196] Error preparing data for projected volume kube-api-access-dtrsl for pod openshift-network-diagnostics/network-check-target-5v767: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 20:35:09.747489 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.747391 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/baf82b79-7fff-42da-8256-bd0d0b6a3414-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tdg72\" (UID: \"baf82b79-7fff-42da-8256-bd0d0b6a3414\") " pod="openshift-multus/multus-additional-cni-plugins-tdg72" Jul 21 20:35:09.747967 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.747508 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/baf82b79-7fff-42da-8256-bd0d0b6a3414-system-cni-dir\") pod \"multus-additional-cni-plugins-tdg72\" (UID: \"baf82b79-7fff-42da-8256-bd0d0b6a3414\") " pod="openshift-multus/multus-additional-cni-plugins-tdg72" Jul 21 20:35:09.747967 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.747869 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/baf82b79-7fff-42da-8256-bd0d0b6a3414-cni-binary-copy\") pod \"multus-additional-cni-plugins-tdg72\" (UID: \"baf82b79-7fff-42da-8256-bd0d0b6a3414\") " pod="openshift-multus/multus-additional-cni-plugins-tdg72" Jul 21 20:35:09.748560 ip-10-0-131-27 kubenswrapper[2560]: E0721 20:35:09.747999 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 21 20:35:09.748649 ip-10-0-131-27 kubenswrapper[2560]: E0721 20:35:09.748634 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0da0f4c0-d4be-484a-8efb-8f525f2ab0d9-original-pull-secret podName:0da0f4c0-d4be-484a-8efb-8f525f2ab0d9 nodeName:}" failed. No retries permitted until 2026-07-21 20:35:10.248598495 +0000 UTC m=+3.011835432 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0da0f4c0-d4be-484a-8efb-8f525f2ab0d9-original-pull-secret") pod "global-pull-secret-syncer-2mfdm" (UID: "0da0f4c0-d4be-484a-8efb-8f525f2ab0d9") : object "kube-system"/"original-pull-secret" not registered Jul 21 20:35:09.748755 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.747353 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/baf82b79-7fff-42da-8256-bd0d0b6a3414-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tdg72\" (UID: \"baf82b79-7fff-42da-8256-bd0d0b6a3414\") " pod="openshift-multus/multus-additional-cni-plugins-tdg72" Jul 21 20:35:09.749426 ip-10-0-131-27 kubenswrapper[2560]: E0721 20:35:09.748812 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3abb9e4b-7d06-4635-90a7-a31abc3c38ff-kube-api-access-dtrsl podName:3abb9e4b-7d06-4635-90a7-a31abc3c38ff nodeName:}" failed. No retries permitted until 2026-07-21 20:35:10.248799481 +0000 UTC m=+3.012036417 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-dtrsl" (UniqueName: "kubernetes.io/projected/3abb9e4b-7d06-4635-90a7-a31abc3c38ff-kube-api-access-dtrsl") pod "network-check-target-5v767" (UID: "3abb9e4b-7d06-4635-90a7-a31abc3c38ff") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 20:35:09.752178 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.752156 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vltxc\" (UniqueName: \"kubernetes.io/projected/baf82b79-7fff-42da-8256-bd0d0b6a3414-kube-api-access-vltxc\") pod \"multus-additional-cni-plugins-tdg72\" (UID: \"baf82b79-7fff-42da-8256-bd0d0b6a3414\") " pod="openshift-multus/multus-additional-cni-plugins-tdg72" Jul 21 20:35:09.753490 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.753462 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e5ef3217-99e0-43ce-a415-937df67f3cd2-agent-certs\") pod \"konnectivity-agent-qgk2d\" (UID: \"e5ef3217-99e0-43ce-a415-937df67f3cd2\") " pod="kube-system/konnectivity-agent-qgk2d" Jul 21 20:35:09.847272 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.847232 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cd3c0f2a-c76d-4d83-9eeb-1e5dafd81177-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bpvvl\" (UID: \"cd3c0f2a-c76d-4d83-9eeb-1e5dafd81177\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpvvl" Jul 21 20:35:09.847484 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.847297 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/77b4be87-3e69-4f8a-a708-1dd40a4f05cc-etc-sysconfig\") pod \"tuned-swn8q\" (UID: \"77b4be87-3e69-4f8a-a708-1dd40a4f05cc\") " pod="openshift-cluster-node-tuning-operator/tuned-swn8q" Jul 21 20:35:09.847484 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.847322 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cd3c0f2a-c76d-4d83-9eeb-1e5dafd81177-host-slash\") pod \"ovnkube-node-bpvvl\" (UID: \"cd3c0f2a-c76d-4d83-9eeb-1e5dafd81177\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpvvl" Jul 21 20:35:09.847484 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.847343 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cd3c0f2a-c76d-4d83-9eeb-1e5dafd81177-etc-openvswitch\") pod \"ovnkube-node-bpvvl\" (UID: \"cd3c0f2a-c76d-4d83-9eeb-1e5dafd81177\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpvvl" Jul 21 20:35:09.847484 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.847365 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e49d91ac-7093-4224-b087-0115ce9cec60-multus-conf-dir\") pod \"multus-rl9pf\" (UID: \"e49d91ac-7093-4224-b087-0115ce9cec60\") " pod="openshift-multus/multus-rl9pf" Jul 21 20:35:09.847484 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.847389 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e49d91ac-7093-4224-b087-0115ce9cec60-etc-kubernetes\") pod \"multus-rl9pf\" (UID: \"e49d91ac-7093-4224-b087-0115ce9cec60\") " pod="openshift-multus/multus-rl9pf" Jul 21 20:35:09.847484 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.847405 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cd3c0f2a-c76d-4d83-9eeb-1e5dafd81177-host-slash\") pod \"ovnkube-node-bpvvl\" (UID: \"cd3c0f2a-c76d-4d83-9eeb-1e5dafd81177\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpvvl" Jul 21 20:35:09.847484 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.847411 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/77b4be87-3e69-4f8a-a708-1dd40a4f05cc-lib-modules\") pod \"tuned-swn8q\" (UID: \"77b4be87-3e69-4f8a-a708-1dd40a4f05cc\") " pod="openshift-cluster-node-tuning-operator/tuned-swn8q" Jul 21 20:35:09.847484 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.847455 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/77b4be87-3e69-4f8a-a708-1dd40a4f05cc-host\") pod \"tuned-swn8q\" (UID: \"77b4be87-3e69-4f8a-a708-1dd40a4f05cc\") " pod="openshift-cluster-node-tuning-operator/tuned-swn8q" Jul 21 20:35:09.847484 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.847483 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/cd3c0f2a-c76d-4d83-9eeb-1e5dafd81177-systemd-units\") pod \"ovnkube-node-bpvvl\" (UID: \"cd3c0f2a-c76d-4d83-9eeb-1e5dafd81177\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpvvl" Jul 21 20:35:09.847957 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.847510 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e49d91ac-7093-4224-b087-0115ce9cec60-multus-cni-dir\") pod \"multus-rl9pf\" (UID: \"e49d91ac-7093-4224-b087-0115ce9cec60\") " pod="openshift-multus/multus-rl9pf" Jul 21 20:35:09.847957 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.847538 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8cafaac7-d4fe-43e8-a75a-08f26aa58cd5-tmp-dir\") pod \"node-resolver-4shwn\" (UID: \"8cafaac7-d4fe-43e8-a75a-08f26aa58cd5\") " pod="openshift-dns/node-resolver-4shwn" Jul 21 20:35:09.847957 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.847562 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/77b4be87-3e69-4f8a-a708-1dd40a4f05cc-lib-modules\") pod \"tuned-swn8q\" (UID: \"77b4be87-3e69-4f8a-a708-1dd40a4f05cc\") " pod="openshift-cluster-node-tuning-operator/tuned-swn8q" Jul 21 20:35:09.847957 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.847584 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/77b4be87-3e69-4f8a-a708-1dd40a4f05cc-etc-kubernetes\") pod \"tuned-swn8q\" (UID: \"77b4be87-3e69-4f8a-a708-1dd40a4f05cc\") " pod="openshift-cluster-node-tuning-operator/tuned-swn8q" Jul 21 20:35:09.847957 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.847651 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/77b4be87-3e69-4f8a-a708-1dd40a4f05cc-etc-kubernetes\") pod \"tuned-swn8q\" (UID: \"77b4be87-3e69-4f8a-a708-1dd40a4f05cc\") " pod="openshift-cluster-node-tuning-operator/tuned-swn8q" Jul 21 20:35:09.847957 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.847358 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cd3c0f2a-c76d-4d83-9eeb-1e5dafd81177-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bpvvl\" (UID: \"cd3c0f2a-c76d-4d83-9eeb-1e5dafd81177\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpvvl" Jul 21 20:35:09.847957 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.847697 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e49d91ac-7093-4224-b087-0115ce9cec60-multus-conf-dir\") pod \"multus-rl9pf\" (UID: \"e49d91ac-7093-4224-b087-0115ce9cec60\") " pod="openshift-multus/multus-rl9pf" Jul 21 20:35:09.847957 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.847703 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e49d91ac-7093-4224-b087-0115ce9cec60-etc-kubernetes\") pod \"multus-rl9pf\" (UID: \"e49d91ac-7093-4224-b087-0115ce9cec60\") " pod="openshift-multus/multus-rl9pf" Jul 21 20:35:09.847957 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.847761 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/77b4be87-3e69-4f8a-a708-1dd40a4f05cc-etc-sysconfig\") pod \"tuned-swn8q\" (UID: \"77b4be87-3e69-4f8a-a708-1dd40a4f05cc\") " pod="openshift-cluster-node-tuning-operator/tuned-swn8q" Jul 21 20:35:09.847957 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.847650 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cd3c0f2a-c76d-4d83-9eeb-1e5dafd81177-etc-openvswitch\") pod \"ovnkube-node-bpvvl\" (UID: \"cd3c0f2a-c76d-4d83-9eeb-1e5dafd81177\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpvvl" Jul 21 20:35:09.847957 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.847775 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e49d91ac-7093-4224-b087-0115ce9cec60-multus-cni-dir\") pod \"multus-rl9pf\" (UID: \"e49d91ac-7093-4224-b087-0115ce9cec60\") " pod="openshift-multus/multus-rl9pf" Jul 21 20:35:09.847957 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.847807 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jl6xv\" (UniqueName: \"kubernetes.io/projected/74c3fef4-6119-460a-850e-27a565b7d068-kube-api-access-jl6xv\") pod \"node-ca-gf4h6\" (UID: \"74c3fef4-6119-460a-850e-27a565b7d068\") " pod="openshift-image-registry/node-ca-gf4h6" Jul 21 20:35:09.847957 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.847815 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/77b4be87-3e69-4f8a-a708-1dd40a4f05cc-host\") pod \"tuned-swn8q\" (UID: \"77b4be87-3e69-4f8a-a708-1dd40a4f05cc\") " pod="openshift-cluster-node-tuning-operator/tuned-swn8q" Jul 21 20:35:09.847957 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.847892 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8cafaac7-d4fe-43e8-a75a-08f26aa58cd5-hosts-file\") pod \"node-resolver-4shwn\" (UID: \"8cafaac7-d4fe-43e8-a75a-08f26aa58cd5\") " pod="openshift-dns/node-resolver-4shwn" Jul 21 20:35:09.847957 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.847897 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/cd3c0f2a-c76d-4d83-9eeb-1e5dafd81177-systemd-units\") pod \"ovnkube-node-bpvvl\" (UID: \"cd3c0f2a-c76d-4d83-9eeb-1e5dafd81177\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpvvl" Jul 21 20:35:09.847957 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.847925 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/77b4be87-3e69-4f8a-a708-1dd40a4f05cc-sys\") pod \"tuned-swn8q\" (UID: \"77b4be87-3e69-4f8a-a708-1dd40a4f05cc\") " pod="openshift-cluster-node-tuning-operator/tuned-swn8q" Jul 21 20:35:09.848766 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.847974 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/cd3c0f2a-c76d-4d83-9eeb-1e5dafd81177-log-socket\") pod \"ovnkube-node-bpvvl\" (UID: \"cd3c0f2a-c76d-4d83-9eeb-1e5dafd81177\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpvvl" Jul 21 20:35:09.848766 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.848025 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/cd3c0f2a-c76d-4d83-9eeb-1e5dafd81177-log-socket\") pod \"ovnkube-node-bpvvl\" (UID: \"cd3c0f2a-c76d-4d83-9eeb-1e5dafd81177\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpvvl" Jul 21 20:35:09.848766 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.848082 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e49d91ac-7093-4224-b087-0115ce9cec60-cni-binary-copy\") pod \"multus-rl9pf\" (UID: \"e49d91ac-7093-4224-b087-0115ce9cec60\") " pod="openshift-multus/multus-rl9pf" Jul 21 20:35:09.848766 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.848115 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8cafaac7-d4fe-43e8-a75a-08f26aa58cd5-hosts-file\") pod \"node-resolver-4shwn\" (UID: \"8cafaac7-d4fe-43e8-a75a-08f26aa58cd5\") " pod="openshift-dns/node-resolver-4shwn" Jul 21 20:35:09.848766 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.848155 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/77b4be87-3e69-4f8a-a708-1dd40a4f05cc-sys\") pod \"tuned-swn8q\" (UID: \"77b4be87-3e69-4f8a-a708-1dd40a4f05cc\") " pod="openshift-cluster-node-tuning-operator/tuned-swn8q" Jul 21 20:35:09.848766 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.848192 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/cd3c0f2a-c76d-4d83-9eeb-1e5dafd81177-host-kubelet\") pod \"ovnkube-node-bpvvl\" (UID: \"cd3c0f2a-c76d-4d83-9eeb-1e5dafd81177\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpvvl" Jul 21 20:35:09.848766 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.848199 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8cafaac7-d4fe-43e8-a75a-08f26aa58cd5-tmp-dir\") pod \"node-resolver-4shwn\" (UID: \"8cafaac7-d4fe-43e8-a75a-08f26aa58cd5\") " pod="openshift-dns/node-resolver-4shwn" Jul 21 20:35:09.848766 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.848312 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/cd3c0f2a-c76d-4d83-9eeb-1e5dafd81177-host-kubelet\") pod \"ovnkube-node-bpvvl\" (UID: \"cd3c0f2a-c76d-4d83-9eeb-1e5dafd81177\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpvvl" Jul 21 20:35:09.848766 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.848330 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bd370f2e-33cc-425d-812a-c063fd02f4c9-host-slash\") pod \"iptables-alerter-6k7l8\" (UID: \"bd370f2e-33cc-425d-812a-c063fd02f4c9\") " pod="openshift-network-operator/iptables-alerter-6k7l8" Jul 21 20:35:09.848766 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.848371 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bd370f2e-33cc-425d-812a-c063fd02f4c9-host-slash\") pod \"iptables-alerter-6k7l8\" (UID: \"bd370f2e-33cc-425d-812a-c063fd02f4c9\") " pod="openshift-network-operator/iptables-alerter-6k7l8" Jul 21 20:35:09.848766 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.848370 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/92ab865e-73dc-4b1a-a999-5ad3e40f04f0-etc-selinux\") pod \"aws-ebs-csi-driver-node-9nr9h\" (UID: \"92ab865e-73dc-4b1a-a999-5ad3e40f04f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nr9h" Jul 21 20:35:09.848766 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.848409 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e49d91ac-7093-4224-b087-0115ce9cec60-os-release\") pod \"multus-rl9pf\" (UID: \"e49d91ac-7093-4224-b087-0115ce9cec60\") " pod="openshift-multus/multus-rl9pf" Jul 21 20:35:09.848766 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.848435 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e49d91ac-7093-4224-b087-0115ce9cec60-multus-daemon-config\") pod \"multus-rl9pf\" (UID: \"e49d91ac-7093-4224-b087-0115ce9cec60\") " pod="openshift-multus/multus-rl9pf" Jul 21 20:35:09.848766 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.848463 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/77b4be87-3e69-4f8a-a708-1dd40a4f05cc-etc-sysctl-conf\") pod \"tuned-swn8q\" (UID: \"77b4be87-3e69-4f8a-a708-1dd40a4f05cc\") " pod="openshift-cluster-node-tuning-operator/tuned-swn8q" Jul 21 20:35:09.848766 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.848485 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/92ab865e-73dc-4b1a-a999-5ad3e40f04f0-etc-selinux\") pod \"aws-ebs-csi-driver-node-9nr9h\" (UID: \"92ab865e-73dc-4b1a-a999-5ad3e40f04f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nr9h" Jul 21 20:35:09.848766 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.848488 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/77b4be87-3e69-4f8a-a708-1dd40a4f05cc-run\") pod \"tuned-swn8q\" (UID: \"77b4be87-3e69-4f8a-a708-1dd40a4f05cc\") " pod="openshift-cluster-node-tuning-operator/tuned-swn8q" Jul 21 20:35:09.848766 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.848522 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cd3c0f2a-c76d-4d83-9eeb-1e5dafd81177-var-lib-openvswitch\") pod \"ovnkube-node-bpvvl\" (UID: \"cd3c0f2a-c76d-4d83-9eeb-1e5dafd81177\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpvvl" Jul 21 20:35:09.848766 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.848530 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/77b4be87-3e69-4f8a-a708-1dd40a4f05cc-run\") pod \"tuned-swn8q\" (UID: \"77b4be87-3e69-4f8a-a708-1dd40a4f05cc\") " pod="openshift-cluster-node-tuning-operator/tuned-swn8q" Jul 21 20:35:09.849759 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.848552 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e49d91ac-7093-4224-b087-0115ce9cec60-host-var-lib-kubelet\") pod \"multus-rl9pf\" (UID: \"e49d91ac-7093-4224-b087-0115ce9cec60\") " pod="openshift-multus/multus-rl9pf" Jul 21 20:35:09.849759 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.848581 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dc48z\" (UniqueName: \"kubernetes.io/projected/bd370f2e-33cc-425d-812a-c063fd02f4c9-kube-api-access-dc48z\") pod \"iptables-alerter-6k7l8\" (UID: \"bd370f2e-33cc-425d-812a-c063fd02f4c9\") " pod="openshift-network-operator/iptables-alerter-6k7l8" Jul 21 20:35:09.849759 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.848608 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e49d91ac-7093-4224-b087-0115ce9cec60-os-release\") pod \"multus-rl9pf\" (UID: \"e49d91ac-7093-4224-b087-0115ce9cec60\") " pod="openshift-multus/multus-rl9pf" Jul 21 20:35:09.849759 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.848610 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/74c3fef4-6119-460a-850e-27a565b7d068-serviceca\") pod \"node-ca-gf4h6\" (UID: \"74c3fef4-6119-460a-850e-27a565b7d068\") " pod="openshift-image-registry/node-ca-gf4h6" Jul 21 20:35:09.849759 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.848639 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cd3c0f2a-c76d-4d83-9eeb-1e5dafd81177-run-openvswitch\") pod \"ovnkube-node-bpvvl\" (UID: \"cd3c0f2a-c76d-4d83-9eeb-1e5dafd81177\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpvvl" Jul 21 20:35:09.849759 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.848664 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cd3c0f2a-c76d-4d83-9eeb-1e5dafd81177-host-cni-bin\") pod \"ovnkube-node-bpvvl\" (UID: \"cd3c0f2a-c76d-4d83-9eeb-1e5dafd81177\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpvvl" Jul 21 20:35:09.849759 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.848690 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/92ab865e-73dc-4b1a-a999-5ad3e40f04f0-sys-fs\") pod \"aws-ebs-csi-driver-node-9nr9h\" (UID: \"92ab865e-73dc-4b1a-a999-5ad3e40f04f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nr9h" Jul 21 20:35:09.849759 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.848706 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e49d91ac-7093-4224-b087-0115ce9cec60-cni-binary-copy\") pod \"multus-rl9pf\" (UID: \"e49d91ac-7093-4224-b087-0115ce9cec60\") " pod="openshift-multus/multus-rl9pf" Jul 21 20:35:09.849759 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.848715 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e49d91ac-7093-4224-b087-0115ce9cec60-multus-socket-dir-parent\") pod \"multus-rl9pf\" (UID: \"e49d91ac-7093-4224-b087-0115ce9cec60\") " pod="openshift-multus/multus-rl9pf" Jul 21 20:35:09.849759 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.848743 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/77b4be87-3e69-4f8a-a708-1dd40a4f05cc-etc-sysctl-conf\") pod \"tuned-swn8q\" (UID: \"77b4be87-3e69-4f8a-a708-1dd40a4f05cc\") " pod="openshift-cluster-node-tuning-operator/tuned-swn8q" Jul 21 20:35:09.849759 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.848759 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/51fd4d84-10d1-464a-bcdb-dd32614a44a9-metrics-certs\") pod \"network-metrics-daemon-qs78f\" (UID: \"51fd4d84-10d1-464a-bcdb-dd32614a44a9\") " pod="openshift-multus/network-metrics-daemon-qs78f" Jul 21 20:35:09.849759 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.848781 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/cd3c0f2a-c76d-4d83-9eeb-1e5dafd81177-ovn-node-metrics-cert\") pod \"ovnkube-node-bpvvl\" (UID: \"cd3c0f2a-c76d-4d83-9eeb-1e5dafd81177\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpvvl" Jul 21 20:35:09.849759 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.848800 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/77b4be87-3e69-4f8a-a708-1dd40a4f05cc-etc-sysctl-d\") pod \"tuned-swn8q\" (UID: \"77b4be87-3e69-4f8a-a708-1dd40a4f05cc\") " pod="openshift-cluster-node-tuning-operator/tuned-swn8q" Jul 21 20:35:09.849759 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.848803 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/92ab865e-73dc-4b1a-a999-5ad3e40f04f0-sys-fs\") pod \"aws-ebs-csi-driver-node-9nr9h\" (UID: \"92ab865e-73dc-4b1a-a999-5ad3e40f04f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nr9h" Jul 21 20:35:09.849759 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.848832 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/77b4be87-3e69-4f8a-a708-1dd40a4f05cc-etc-tuned\") pod \"tuned-swn8q\" (UID: \"77b4be87-3e69-4f8a-a708-1dd40a4f05cc\") " pod="openshift-cluster-node-tuning-operator/tuned-swn8q" Jul 21 20:35:09.849759 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.848850 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/92ab865e-73dc-4b1a-a999-5ad3e40f04f0-socket-dir\") pod \"aws-ebs-csi-driver-node-9nr9h\" (UID: \"92ab865e-73dc-4b1a-a999-5ad3e40f04f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nr9h" Jul 21 20:35:09.849759 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.848852 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cd3c0f2a-c76d-4d83-9eeb-1e5dafd81177-host-cni-bin\") pod \"ovnkube-node-bpvvl\" (UID: \"cd3c0f2a-c76d-4d83-9eeb-1e5dafd81177\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpvvl" Jul 21 20:35:09.849759 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.848866 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e49d91ac-7093-4224-b087-0115ce9cec60-system-cni-dir\") pod \"multus-rl9pf\" (UID: \"e49d91ac-7093-4224-b087-0115ce9cec60\") " pod="openshift-multus/multus-rl9pf" Jul 21 20:35:09.850793 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.848883 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e49d91ac-7093-4224-b087-0115ce9cec60-host-run-netns\") pod \"multus-rl9pf\" (UID: \"e49d91ac-7093-4224-b087-0115ce9cec60\") " pod="openshift-multus/multus-rl9pf" Jul 21 20:35:09.850793 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.848898 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/77b4be87-3e69-4f8a-a708-1dd40a4f05cc-etc-systemd\") pod \"tuned-swn8q\" (UID: \"77b4be87-3e69-4f8a-a708-1dd40a4f05cc\") " pod="openshift-cluster-node-tuning-operator/tuned-swn8q" Jul 21 20:35:09.850793 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.848913 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cv6np\" (UniqueName: \"kubernetes.io/projected/77b4be87-3e69-4f8a-a708-1dd40a4f05cc-kube-api-access-cv6np\") pod \"tuned-swn8q\" (UID: \"77b4be87-3e69-4f8a-a708-1dd40a4f05cc\") " pod="openshift-cluster-node-tuning-operator/tuned-swn8q" Jul 21 20:35:09.850793 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.848930 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cd3c0f2a-c76d-4d83-9eeb-1e5dafd81177-host-run-netns\") pod \"ovnkube-node-bpvvl\" (UID: \"cd3c0f2a-c76d-4d83-9eeb-1e5dafd81177\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpvvl" Jul 21 20:35:09.850793 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.848954 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/cd3c0f2a-c76d-4d83-9eeb-1e5dafd81177-run-ovn\") pod \"ovnkube-node-bpvvl\" (UID: \"cd3c0f2a-c76d-4d83-9eeb-1e5dafd81177\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpvvl" Jul 21 20:35:09.850793 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.848969 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/cd3c0f2a-c76d-4d83-9eeb-1e5dafd81177-ovnkube-script-lib\") pod \"ovnkube-node-bpvvl\" (UID: \"cd3c0f2a-c76d-4d83-9eeb-1e5dafd81177\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpvvl" Jul 21 20:35:09.850793 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.848986 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/92ab865e-73dc-4b1a-a999-5ad3e40f04f0-registration-dir\") pod \"aws-ebs-csi-driver-node-9nr9h\" (UID: \"92ab865e-73dc-4b1a-a999-5ad3e40f04f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nr9h" Jul 21 20:35:09.850793 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.849003 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e49d91ac-7093-4224-b087-0115ce9cec60-host-run-k8s-cni-cncf-io\") pod \"multus-rl9pf\" (UID: \"e49d91ac-7093-4224-b087-0115ce9cec60\") " pod="openshift-multus/multus-rl9pf" Jul 21 20:35:09.850793 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.849020 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e49d91ac-7093-4224-b087-0115ce9cec60-host-var-lib-cni-bin\") pod \"multus-rl9pf\" (UID: \"e49d91ac-7093-4224-b087-0115ce9cec60\") " pod="openshift-multus/multus-rl9pf" Jul 21 20:35:09.850793 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.849038 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pl7d8\" (UniqueName: \"kubernetes.io/projected/8cafaac7-d4fe-43e8-a75a-08f26aa58cd5-kube-api-access-pl7d8\") pod \"node-resolver-4shwn\" (UID: \"8cafaac7-d4fe-43e8-a75a-08f26aa58cd5\") " pod="openshift-dns/node-resolver-4shwn" Jul 21 20:35:09.850793 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.849057 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/cd3c0f2a-c76d-4d83-9eeb-1e5dafd81177-host-cni-netd\") pod \"ovnkube-node-bpvvl\" (UID: \"cd3c0f2a-c76d-4d83-9eeb-1e5dafd81177\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpvvl" Jul 21 20:35:09.850793 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.849072 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/92ab865e-73dc-4b1a-a999-5ad3e40f04f0-device-dir\") pod \"aws-ebs-csi-driver-node-9nr9h\" (UID: \"92ab865e-73dc-4b1a-a999-5ad3e40f04f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nr9h" Jul 21 20:35:09.850793 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.849106 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e49d91ac-7093-4224-b087-0115ce9cec60-host-run-multus-certs\") pod \"multus-rl9pf\" (UID: \"e49d91ac-7093-4224-b087-0115ce9cec60\") " pod="openshift-multus/multus-rl9pf" Jul 21 20:35:09.850793 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.849108 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e49d91ac-7093-4224-b087-0115ce9cec60-multus-daemon-config\") pod \"multus-rl9pf\" (UID: \"e49d91ac-7093-4224-b087-0115ce9cec60\") " pod="openshift-multus/multus-rl9pf" Jul 21 20:35:09.850793 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.849134 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7hdhs\" (UniqueName: \"kubernetes.io/projected/51fd4d84-10d1-464a-bcdb-dd32614a44a9-kube-api-access-7hdhs\") pod \"network-metrics-daemon-qs78f\" (UID: \"51fd4d84-10d1-464a-bcdb-dd32614a44a9\") " pod="openshift-multus/network-metrics-daemon-qs78f" Jul 21 20:35:09.850793 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.849165 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cd3c0f2a-c76d-4d83-9eeb-1e5dafd81177-run-openvswitch\") pod \"ovnkube-node-bpvvl\" (UID: \"cd3c0f2a-c76d-4d83-9eeb-1e5dafd81177\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpvvl" Jul 21 20:35:09.850793 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.849192 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cd3c0f2a-c76d-4d83-9eeb-1e5dafd81177-var-lib-openvswitch\") pod \"ovnkube-node-bpvvl\" (UID: \"cd3c0f2a-c76d-4d83-9eeb-1e5dafd81177\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpvvl" Jul 21 20:35:09.851678 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.849203 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/74c3fef4-6119-460a-850e-27a565b7d068-serviceca\") pod \"node-ca-gf4h6\" (UID: \"74c3fef4-6119-460a-850e-27a565b7d068\") " pod="openshift-image-registry/node-ca-gf4h6" Jul 21 20:35:09.851678 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.849214 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e49d91ac-7093-4224-b087-0115ce9cec60-host-var-lib-kubelet\") pod \"multus-rl9pf\" (UID: \"e49d91ac-7093-4224-b087-0115ce9cec60\") " pod="openshift-multus/multus-rl9pf" Jul 21 20:35:09.851678 ip-10-0-131-27 kubenswrapper[2560]: E0721 20:35:09.849245 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 20:35:09.851678 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.849264 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cd3c0f2a-c76d-4d83-9eeb-1e5dafd81177-host-run-netns\") pod \"ovnkube-node-bpvvl\" (UID: \"cd3c0f2a-c76d-4d83-9eeb-1e5dafd81177\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpvvl" Jul 21 20:35:09.851678 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.849276 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e49d91ac-7093-4224-b087-0115ce9cec60-host-run-netns\") pod \"multus-rl9pf\" (UID: \"e49d91ac-7093-4224-b087-0115ce9cec60\") " pod="openshift-multus/multus-rl9pf" Jul 21 20:35:09.851678 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.849291 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e49d91ac-7093-4224-b087-0115ce9cec60-system-cni-dir\") pod \"multus-rl9pf\" (UID: \"e49d91ac-7093-4224-b087-0115ce9cec60\") " pod="openshift-multus/multus-rl9pf" Jul 21 20:35:09.851678 ip-10-0-131-27 kubenswrapper[2560]: E0721 20:35:09.849346 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51fd4d84-10d1-464a-bcdb-dd32614a44a9-metrics-certs podName:51fd4d84-10d1-464a-bcdb-dd32614a44a9 nodeName:}" failed. No retries permitted until 2026-07-21 20:35:10.349319174 +0000 UTC m=+3.112556115 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/51fd4d84-10d1-464a-bcdb-dd32614a44a9-metrics-certs") pod "network-metrics-daemon-qs78f" (UID: "51fd4d84-10d1-464a-bcdb-dd32614a44a9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 20:35:09.851678 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.848912 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e49d91ac-7093-4224-b087-0115ce9cec60-multus-socket-dir-parent\") pod \"multus-rl9pf\" (UID: \"e49d91ac-7093-4224-b087-0115ce9cec60\") " pod="openshift-multus/multus-rl9pf" Jul 21 20:35:09.851678 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.849401 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/92ab865e-73dc-4b1a-a999-5ad3e40f04f0-device-dir\") pod \"aws-ebs-csi-driver-node-9nr9h\" (UID: \"92ab865e-73dc-4b1a-a999-5ad3e40f04f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nr9h" Jul 21 20:35:09.851678 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.849462 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e49d91ac-7093-4224-b087-0115ce9cec60-host-run-multus-certs\") pod \"multus-rl9pf\" (UID: \"e49d91ac-7093-4224-b087-0115ce9cec60\") " pod="openshift-multus/multus-rl9pf" Jul 21 20:35:09.851678 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.849488 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/cd3c0f2a-c76d-4d83-9eeb-1e5dafd81177-host-cni-netd\") pod \"ovnkube-node-bpvvl\" (UID: \"cd3c0f2a-c76d-4d83-9eeb-1e5dafd81177\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpvvl" Jul 21 20:35:09.851678 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.849536 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e49d91ac-7093-4224-b087-0115ce9cec60-host-run-k8s-cni-cncf-io\") pod \"multus-rl9pf\" (UID: \"e49d91ac-7093-4224-b087-0115ce9cec60\") " pod="openshift-multus/multus-rl9pf" Jul 21 20:35:09.851678 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.849543 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/cd3c0f2a-c76d-4d83-9eeb-1e5dafd81177-run-ovn\") pod \"ovnkube-node-bpvvl\" (UID: \"cd3c0f2a-c76d-4d83-9eeb-1e5dafd81177\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpvvl" Jul 21 20:35:09.851678 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.849562 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/77b4be87-3e69-4f8a-a708-1dd40a4f05cc-etc-systemd\") pod \"tuned-swn8q\" (UID: \"77b4be87-3e69-4f8a-a708-1dd40a4f05cc\") " pod="openshift-cluster-node-tuning-operator/tuned-swn8q" Jul 21 20:35:09.851678 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.849593 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/92ab865e-73dc-4b1a-a999-5ad3e40f04f0-registration-dir\") pod \"aws-ebs-csi-driver-node-9nr9h\" (UID: \"92ab865e-73dc-4b1a-a999-5ad3e40f04f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nr9h" Jul 21 20:35:09.851678 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.849603 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/77b4be87-3e69-4f8a-a708-1dd40a4f05cc-tmp\") pod \"tuned-swn8q\" (UID: \"77b4be87-3e69-4f8a-a708-1dd40a4f05cc\") " pod="openshift-cluster-node-tuning-operator/tuned-swn8q" Jul 21 20:35:09.851678 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.849619 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e49d91ac-7093-4224-b087-0115ce9cec60-host-var-lib-cni-bin\") pod \"multus-rl9pf\" (UID: \"e49d91ac-7093-4224-b087-0115ce9cec60\") " pod="openshift-multus/multus-rl9pf" Jul 21 20:35:09.851678 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.849636 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/cd3c0f2a-c76d-4d83-9eeb-1e5dafd81177-run-systemd\") pod \"ovnkube-node-bpvvl\" (UID: \"cd3c0f2a-c76d-4d83-9eeb-1e5dafd81177\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpvvl" Jul 21 20:35:09.852618 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.849669 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/cd3c0f2a-c76d-4d83-9eeb-1e5dafd81177-ovnkube-config\") pod \"ovnkube-node-bpvvl\" (UID: \"cd3c0f2a-c76d-4d83-9eeb-1e5dafd81177\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpvvl" Jul 21 20:35:09.852618 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.849695 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e49d91ac-7093-4224-b087-0115ce9cec60-cnibin\") pod \"multus-rl9pf\" (UID: \"e49d91ac-7093-4224-b087-0115ce9cec60\") " pod="openshift-multus/multus-rl9pf" Jul 21 20:35:09.852618 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.849700 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/92ab865e-73dc-4b1a-a999-5ad3e40f04f0-socket-dir\") pod \"aws-ebs-csi-driver-node-9nr9h\" (UID: \"92ab865e-73dc-4b1a-a999-5ad3e40f04f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nr9h" Jul 21 20:35:09.852618 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.849722 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/74c3fef4-6119-460a-850e-27a565b7d068-host\") pod \"node-ca-gf4h6\" (UID: \"74c3fef4-6119-460a-850e-27a565b7d068\") " pod="openshift-image-registry/node-ca-gf4h6" Jul 21 20:35:09.852618 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.849749 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/cd3c0f2a-c76d-4d83-9eeb-1e5dafd81177-env-overrides\") pod \"ovnkube-node-bpvvl\" (UID: \"cd3c0f2a-c76d-4d83-9eeb-1e5dafd81177\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpvvl" Jul 21 20:35:09.852618 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.849778 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/bd370f2e-33cc-425d-812a-c063fd02f4c9-iptables-alerter-script\") pod \"iptables-alerter-6k7l8\" (UID: \"bd370f2e-33cc-425d-812a-c063fd02f4c9\") " pod="openshift-network-operator/iptables-alerter-6k7l8" Jul 21 20:35:09.852618 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.849808 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m424h\" (UniqueName: \"kubernetes.io/projected/92ab865e-73dc-4b1a-a999-5ad3e40f04f0-kube-api-access-m424h\") pod \"aws-ebs-csi-driver-node-9nr9h\" (UID: \"92ab865e-73dc-4b1a-a999-5ad3e40f04f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nr9h" Jul 21 20:35:09.852618 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.849828 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/cd3c0f2a-c76d-4d83-9eeb-1e5dafd81177-run-systemd\") pod \"ovnkube-node-bpvvl\" (UID: \"cd3c0f2a-c76d-4d83-9eeb-1e5dafd81177\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpvvl" Jul 21 20:35:09.852618 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.849837 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/77b4be87-3e69-4f8a-a708-1dd40a4f05cc-var-lib-kubelet\") pod \"tuned-swn8q\" (UID: \"77b4be87-3e69-4f8a-a708-1dd40a4f05cc\") " pod="openshift-cluster-node-tuning-operator/tuned-swn8q" Jul 21 20:35:09.852618 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.849862 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/cd3c0f2a-c76d-4d83-9eeb-1e5dafd81177-node-log\") pod \"ovnkube-node-bpvvl\" (UID: \"cd3c0f2a-c76d-4d83-9eeb-1e5dafd81177\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpvvl" Jul 21 20:35:09.852618 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.849887 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e49d91ac-7093-4224-b087-0115ce9cec60-host-var-lib-cni-multus\") pod \"multus-rl9pf\" (UID: \"e49d91ac-7093-4224-b087-0115ce9cec60\") " pod="openshift-multus/multus-rl9pf" Jul 21 20:35:09.852618 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.849900 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/cd3c0f2a-c76d-4d83-9eeb-1e5dafd81177-ovnkube-script-lib\") pod \"ovnkube-node-bpvvl\" (UID: \"cd3c0f2a-c76d-4d83-9eeb-1e5dafd81177\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpvvl" Jul 21 20:35:09.852618 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.849911 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e49d91ac-7093-4224-b087-0115ce9cec60-hostroot\") pod \"multus-rl9pf\" (UID: \"e49d91ac-7093-4224-b087-0115ce9cec60\") " pod="openshift-multus/multus-rl9pf" Jul 21 20:35:09.852618 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.849943 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hpmgz\" (UniqueName: \"kubernetes.io/projected/cd3c0f2a-c76d-4d83-9eeb-1e5dafd81177-kube-api-access-hpmgz\") pod \"ovnkube-node-bpvvl\" (UID: \"cd3c0f2a-c76d-4d83-9eeb-1e5dafd81177\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpvvl" Jul 21 20:35:09.852618 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.850110 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e49d91ac-7093-4224-b087-0115ce9cec60-hostroot\") pod \"multus-rl9pf\" (UID: \"e49d91ac-7093-4224-b087-0115ce9cec60\") " pod="openshift-multus/multus-rl9pf" Jul 21 20:35:09.852618 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.850181 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/77b4be87-3e69-4f8a-a708-1dd40a4f05cc-var-lib-kubelet\") pod \"tuned-swn8q\" (UID: \"77b4be87-3e69-4f8a-a708-1dd40a4f05cc\") " pod="openshift-cluster-node-tuning-operator/tuned-swn8q" Jul 21 20:35:09.852618 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.850189 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/cd3c0f2a-c76d-4d83-9eeb-1e5dafd81177-node-log\") pod \"ovnkube-node-bpvvl\" (UID: \"cd3c0f2a-c76d-4d83-9eeb-1e5dafd81177\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpvvl" Jul 21 20:35:09.852618 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.850246 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e49d91ac-7093-4224-b087-0115ce9cec60-cnibin\") pod \"multus-rl9pf\" (UID: \"e49d91ac-7093-4224-b087-0115ce9cec60\") " pod="openshift-multus/multus-rl9pf" Jul 21 20:35:09.853508 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.850279 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/74c3fef4-6119-460a-850e-27a565b7d068-host\") pod \"node-ca-gf4h6\" (UID: \"74c3fef4-6119-460a-850e-27a565b7d068\") " pod="openshift-image-registry/node-ca-gf4h6" Jul 21 20:35:09.853508 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.850288 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/cd3c0f2a-c76d-4d83-9eeb-1e5dafd81177-ovnkube-config\") pod \"ovnkube-node-bpvvl\" (UID: \"cd3c0f2a-c76d-4d83-9eeb-1e5dafd81177\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpvvl" Jul 21 20:35:09.853508 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.850313 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e49d91ac-7093-4224-b087-0115ce9cec60-host-var-lib-cni-multus\") pod \"multus-rl9pf\" (UID: \"e49d91ac-7093-4224-b087-0115ce9cec60\") " pod="openshift-multus/multus-rl9pf" Jul 21 20:35:09.853508 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.850293 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/cd3c0f2a-c76d-4d83-9eeb-1e5dafd81177-env-overrides\") pod \"ovnkube-node-bpvvl\" (UID: \"cd3c0f2a-c76d-4d83-9eeb-1e5dafd81177\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpvvl" Jul 21 20:35:09.853508 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.850390 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/92ab865e-73dc-4b1a-a999-5ad3e40f04f0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9nr9h\" (UID: \"92ab865e-73dc-4b1a-a999-5ad3e40f04f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nr9h" Jul 21 20:35:09.853508 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.850431 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/77b4be87-3e69-4f8a-a708-1dd40a4f05cc-etc-modprobe-d\") pod \"tuned-swn8q\" (UID: \"77b4be87-3e69-4f8a-a708-1dd40a4f05cc\") " pod="openshift-cluster-node-tuning-operator/tuned-swn8q" Jul 21 20:35:09.853508 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.850458 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cd3c0f2a-c76d-4d83-9eeb-1e5dafd81177-host-run-ovn-kubernetes\") pod \"ovnkube-node-bpvvl\" (UID: \"cd3c0f2a-c76d-4d83-9eeb-1e5dafd81177\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpvvl" Jul 21 20:35:09.853508 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.850482 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rj6lq\" (UniqueName: \"kubernetes.io/projected/e49d91ac-7093-4224-b087-0115ce9cec60-kube-api-access-rj6lq\") pod \"multus-rl9pf\" (UID: \"e49d91ac-7093-4224-b087-0115ce9cec60\") " pod="openshift-multus/multus-rl9pf" Jul 21 20:35:09.853508 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.850508 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/92ab865e-73dc-4b1a-a999-5ad3e40f04f0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9nr9h\" (UID: \"92ab865e-73dc-4b1a-a999-5ad3e40f04f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nr9h" Jul 21 20:35:09.853508 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.850516 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/bd370f2e-33cc-425d-812a-c063fd02f4c9-iptables-alerter-script\") pod \"iptables-alerter-6k7l8\" (UID: \"bd370f2e-33cc-425d-812a-c063fd02f4c9\") " pod="openshift-network-operator/iptables-alerter-6k7l8" Jul 21 20:35:09.853508 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.850523 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/77b4be87-3e69-4f8a-a708-1dd40a4f05cc-etc-sysctl-d\") pod \"tuned-swn8q\" (UID: \"77b4be87-3e69-4f8a-a708-1dd40a4f05cc\") " pod="openshift-cluster-node-tuning-operator/tuned-swn8q" Jul 21 20:35:09.853508 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.850567 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cd3c0f2a-c76d-4d83-9eeb-1e5dafd81177-host-run-ovn-kubernetes\") pod \"ovnkube-node-bpvvl\" (UID: \"cd3c0f2a-c76d-4d83-9eeb-1e5dafd81177\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpvvl" Jul 21 20:35:09.853508 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.850669 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/77b4be87-3e69-4f8a-a708-1dd40a4f05cc-etc-modprobe-d\") pod \"tuned-swn8q\" (UID: \"77b4be87-3e69-4f8a-a708-1dd40a4f05cc\") " pod="openshift-cluster-node-tuning-operator/tuned-swn8q" Jul 21 20:35:09.853508 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.852832 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/77b4be87-3e69-4f8a-a708-1dd40a4f05cc-etc-tuned\") pod \"tuned-swn8q\" (UID: \"77b4be87-3e69-4f8a-a708-1dd40a4f05cc\") " pod="openshift-cluster-node-tuning-operator/tuned-swn8q" Jul 21 20:35:09.853508 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.853413 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/cd3c0f2a-c76d-4d83-9eeb-1e5dafd81177-ovn-node-metrics-cert\") pod \"ovnkube-node-bpvvl\" (UID: \"cd3c0f2a-c76d-4d83-9eeb-1e5dafd81177\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpvvl" Jul 21 20:35:09.854263 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.854132 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/77b4be87-3e69-4f8a-a708-1dd40a4f05cc-tmp\") pod \"tuned-swn8q\" (UID: \"77b4be87-3e69-4f8a-a708-1dd40a4f05cc\") " pod="openshift-cluster-node-tuning-operator/tuned-swn8q" Jul 21 20:35:09.863268 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.863204 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rj6lq\" (UniqueName: \"kubernetes.io/projected/e49d91ac-7093-4224-b087-0115ce9cec60-kube-api-access-rj6lq\") pod \"multus-rl9pf\" (UID: \"e49d91ac-7093-4224-b087-0115ce9cec60\") " pod="openshift-multus/multus-rl9pf" Jul 21 20:35:09.863494 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.863407 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pl7d8\" (UniqueName: \"kubernetes.io/projected/8cafaac7-d4fe-43e8-a75a-08f26aa58cd5-kube-api-access-pl7d8\") pod \"node-resolver-4shwn\" (UID: \"8cafaac7-d4fe-43e8-a75a-08f26aa58cd5\") " pod="openshift-dns/node-resolver-4shwn" Jul 21 20:35:09.863968 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.863944 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7hdhs\" (UniqueName: \"kubernetes.io/projected/51fd4d84-10d1-464a-bcdb-dd32614a44a9-kube-api-access-7hdhs\") pod \"network-metrics-daemon-qs78f\" (UID: \"51fd4d84-10d1-464a-bcdb-dd32614a44a9\") " pod="openshift-multus/network-metrics-daemon-qs78f" Jul 21 20:35:09.869457 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.864120 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dc48z\" (UniqueName: \"kubernetes.io/projected/bd370f2e-33cc-425d-812a-c063fd02f4c9-kube-api-access-dc48z\") pod \"iptables-alerter-6k7l8\" (UID: \"bd370f2e-33cc-425d-812a-c063fd02f4c9\") " pod="openshift-network-operator/iptables-alerter-6k7l8" Jul 21 20:35:09.869457 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.867508 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hpmgz\" (UniqueName: \"kubernetes.io/projected/cd3c0f2a-c76d-4d83-9eeb-1e5dafd81177-kube-api-access-hpmgz\") pod \"ovnkube-node-bpvvl\" (UID: \"cd3c0f2a-c76d-4d83-9eeb-1e5dafd81177\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpvvl" Jul 21 20:35:09.869457 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.868247 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cv6np\" (UniqueName: \"kubernetes.io/projected/77b4be87-3e69-4f8a-a708-1dd40a4f05cc-kube-api-access-cv6np\") pod \"tuned-swn8q\" (UID: \"77b4be87-3e69-4f8a-a708-1dd40a4f05cc\") " pod="openshift-cluster-node-tuning-operator/tuned-swn8q" Jul 21 20:35:09.869457 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.868982 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m424h\" (UniqueName: \"kubernetes.io/projected/92ab865e-73dc-4b1a-a999-5ad3e40f04f0-kube-api-access-m424h\") pod \"aws-ebs-csi-driver-node-9nr9h\" (UID: \"92ab865e-73dc-4b1a-a999-5ad3e40f04f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nr9h" Jul 21 20:35:09.869457 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.869222 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jl6xv\" (UniqueName: \"kubernetes.io/projected/74c3fef4-6119-460a-850e-27a565b7d068-kube-api-access-jl6xv\") pod \"node-ca-gf4h6\" (UID: \"74c3fef4-6119-460a-850e-27a565b7d068\") " pod="openshift-image-registry/node-ca-gf4h6" Jul 21 20:35:09.871330 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.871219 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-27.ec2.internal" event={"ID":"e748e1b0ad8f133f242876b765fcf5fc","Type":"ContainerStarted","Data":"abfe71cf4f518693d95ce093f98194492459f89cabefc0c96c8076791c813db4"} Jul 21 20:35:09.873101 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.872942 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-27.ec2.internal" event={"ID":"d5698e5baf2a73bf68056435e9975908","Type":"ContainerStarted","Data":"b67e709d9a493cfddeb03a66862ed36e336434a5ce07cafb1542959bf2c61a11"} Jul 21 20:35:09.952396 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.952356 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-qgk2d" Jul 21 20:35:09.963150 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:09.963109 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5ef3217_99e0_43ce_a415_937df67f3cd2.slice/crio-3466565da8d0f1803c06d9a97cd0dcc1ede0a620039abbbb0b135e8db7d6f9dc WatchSource:0}: Error finding container 3466565da8d0f1803c06d9a97cd0dcc1ede0a620039abbbb0b135e8db7d6f9dc: Status 404 returned error can't find the container with id 3466565da8d0f1803c06d9a97cd0dcc1ede0a620039abbbb0b135e8db7d6f9dc Jul 21 20:35:09.964384 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.964356 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-tdg72" Jul 21 20:35:09.975401 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:09.975367 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbaf82b79_7fff_42da_8256_bd0d0b6a3414.slice/crio-605705cf3b33059df1be0f1ad978816beb4aa9dc0a67439be1c24b06df4b5e71 WatchSource:0}: Error finding container 605705cf3b33059df1be0f1ad978816beb4aa9dc0a67439be1c24b06df4b5e71: Status 404 returned error can't find the container with id 605705cf3b33059df1be0f1ad978816beb4aa9dc0a67439be1c24b06df4b5e71 Jul 21 20:35:09.976391 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.976365 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-rl9pf" Jul 21 20:35:09.983588 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.983550 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-4shwn" Jul 21 20:35:09.988604 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:09.988572 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode49d91ac_7093_4224_b087_0115ce9cec60.slice/crio-af6daaa65a172e2e17542f6af041d93e88b2188797c145d7aef2a0ec848e6cc4 WatchSource:0}: Error finding container af6daaa65a172e2e17542f6af041d93e88b2188797c145d7aef2a0ec848e6cc4: Status 404 returned error can't find the container with id af6daaa65a172e2e17542f6af041d93e88b2188797c145d7aef2a0ec848e6cc4 Jul 21 20:35:09.992407 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:09.992275 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-swn8q" Jul 21 20:35:09.996954 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:09.996908 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8cafaac7_d4fe_43e8_a75a_08f26aa58cd5.slice/crio-1b91fa8145d3afb28f887800ff74e455df2115e27bc06caa157d3b577c3d6cb2 WatchSource:0}: Error finding container 1b91fa8145d3afb28f887800ff74e455df2115e27bc06caa157d3b577c3d6cb2: Status 404 returned error can't find the container with id 1b91fa8145d3afb28f887800ff74e455df2115e27bc06caa157d3b577c3d6cb2 Jul 21 20:35:10.002537 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:10.002510 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-gf4h6" Jul 21 20:35:10.004981 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:10.004952 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77b4be87_3e69_4f8a_a708_1dd40a4f05cc.slice/crio-47ab8dd9c8038364dfe2189125f6bdb453abd0793e8a433e7150a886eed4e731 WatchSource:0}: Error finding container 47ab8dd9c8038364dfe2189125f6bdb453abd0793e8a433e7150a886eed4e731: Status 404 returned error can't find the container with id 47ab8dd9c8038364dfe2189125f6bdb453abd0793e8a433e7150a886eed4e731 Jul 21 20:35:10.010829 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:10.010802 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-bpvvl" Jul 21 20:35:10.015141 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:10.015108 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74c3fef4_6119_460a_850e_27a565b7d068.slice/crio-3151188ff32377f6cfe93c1db3842e6e43307af26198091d0b22f421186822ec WatchSource:0}: Error finding container 3151188ff32377f6cfe93c1db3842e6e43307af26198091d0b22f421186822ec: Status 404 returned error can't find the container with id 3151188ff32377f6cfe93c1db3842e6e43307af26198091d0b22f421186822ec Jul 21 20:35:10.021548 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:10.021461 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-6k7l8" Jul 21 20:35:10.028665 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:10.028642 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nr9h" Jul 21 20:35:10.071793 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:10.071761 2560 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 21 20:35:10.253267 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:10.253167 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0da0f4c0-d4be-484a-8efb-8f525f2ab0d9-original-pull-secret\") pod \"global-pull-secret-syncer-2mfdm\" (UID: \"0da0f4c0-d4be-484a-8efb-8f525f2ab0d9\") " pod="kube-system/global-pull-secret-syncer-2mfdm" Jul 21 20:35:10.253267 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:10.253221 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dtrsl\" (UniqueName: \"kubernetes.io/projected/3abb9e4b-7d06-4635-90a7-a31abc3c38ff-kube-api-access-dtrsl\") pod \"network-check-target-5v767\" (UID: \"3abb9e4b-7d06-4635-90a7-a31abc3c38ff\") " pod="openshift-network-diagnostics/network-check-target-5v767" Jul 21 20:35:10.253566 ip-10-0-131-27 kubenswrapper[2560]: E0721 20:35:10.253334 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 21 20:35:10.253566 ip-10-0-131-27 kubenswrapper[2560]: E0721 20:35:10.253407 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0da0f4c0-d4be-484a-8efb-8f525f2ab0d9-original-pull-secret podName:0da0f4c0-d4be-484a-8efb-8f525f2ab0d9 nodeName:}" failed. No retries permitted until 2026-07-21 20:35:11.253390921 +0000 UTC m=+4.016627843 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0da0f4c0-d4be-484a-8efb-8f525f2ab0d9-original-pull-secret") pod "global-pull-secret-syncer-2mfdm" (UID: "0da0f4c0-d4be-484a-8efb-8f525f2ab0d9") : object "kube-system"/"original-pull-secret" not registered Jul 21 20:35:10.253566 ip-10-0-131-27 kubenswrapper[2560]: E0721 20:35:10.253346 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 21 20:35:10.253566 ip-10-0-131-27 kubenswrapper[2560]: E0721 20:35:10.253458 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 21 20:35:10.253566 ip-10-0-131-27 kubenswrapper[2560]: E0721 20:35:10.253473 2560 projected.go:196] Error preparing data for projected volume kube-api-access-dtrsl for pod openshift-network-diagnostics/network-check-target-5v767: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 20:35:10.253566 ip-10-0-131-27 kubenswrapper[2560]: E0721 20:35:10.253527 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3abb9e4b-7d06-4635-90a7-a31abc3c38ff-kube-api-access-dtrsl podName:3abb9e4b-7d06-4635-90a7-a31abc3c38ff nodeName:}" failed. No retries permitted until 2026-07-21 20:35:11.253513477 +0000 UTC m=+4.016750417 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-dtrsl" (UniqueName: "kubernetes.io/projected/3abb9e4b-7d06-4635-90a7-a31abc3c38ff-kube-api-access-dtrsl") pod "network-check-target-5v767" (UID: "3abb9e4b-7d06-4635-90a7-a31abc3c38ff") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 20:35:10.354308 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:10.354261 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/51fd4d84-10d1-464a-bcdb-dd32614a44a9-metrics-certs\") pod \"network-metrics-daemon-qs78f\" (UID: \"51fd4d84-10d1-464a-bcdb-dd32614a44a9\") " pod="openshift-multus/network-metrics-daemon-qs78f" Jul 21 20:35:10.354519 ip-10-0-131-27 kubenswrapper[2560]: E0721 20:35:10.354468 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 20:35:10.354578 ip-10-0-131-27 kubenswrapper[2560]: E0721 20:35:10.354544 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51fd4d84-10d1-464a-bcdb-dd32614a44a9-metrics-certs podName:51fd4d84-10d1-464a-bcdb-dd32614a44a9 nodeName:}" failed. No retries permitted until 2026-07-21 20:35:11.354526932 +0000 UTC m=+4.117763854 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/51fd4d84-10d1-464a-bcdb-dd32614a44a9-metrics-certs") pod "network-metrics-daemon-qs78f" (UID: "51fd4d84-10d1-464a-bcdb-dd32614a44a9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 20:35:10.864841 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:10.864634 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2mfdm" Jul 21 20:35:10.864841 ip-10-0-131-27 kubenswrapper[2560]: E0721 20:35:10.864803 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2mfdm" podUID="0da0f4c0-d4be-484a-8efb-8f525f2ab0d9" Jul 21 20:35:10.878070 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:10.878031 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-4shwn" event={"ID":"8cafaac7-d4fe-43e8-a75a-08f26aa58cd5","Type":"ContainerStarted","Data":"1b91fa8145d3afb28f887800ff74e455df2115e27bc06caa157d3b577c3d6cb2"} Jul 21 20:35:10.879781 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:10.879730 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-rl9pf" event={"ID":"e49d91ac-7093-4224-b087-0115ce9cec60","Type":"ContainerStarted","Data":"af6daaa65a172e2e17542f6af041d93e88b2188797c145d7aef2a0ec848e6cc4"} Jul 21 20:35:10.881047 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:10.880998 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tdg72" event={"ID":"baf82b79-7fff-42da-8256-bd0d0b6a3414","Type":"ContainerStarted","Data":"605705cf3b33059df1be0f1ad978816beb4aa9dc0a67439be1c24b06df4b5e71"} Jul 21 20:35:10.882537 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:10.882509 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-qgk2d" event={"ID":"e5ef3217-99e0-43ce-a415-937df67f3cd2","Type":"ContainerStarted","Data":"3466565da8d0f1803c06d9a97cd0dcc1ede0a620039abbbb0b135e8db7d6f9dc"} Jul 21 20:35:10.884283 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:10.884211 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-gf4h6" event={"ID":"74c3fef4-6119-460a-850e-27a565b7d068","Type":"ContainerStarted","Data":"3151188ff32377f6cfe93c1db3842e6e43307af26198091d0b22f421186822ec"} Jul 21 20:35:10.885611 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:10.885561 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-swn8q" event={"ID":"77b4be87-3e69-4f8a-a708-1dd40a4f05cc","Type":"ContainerStarted","Data":"47ab8dd9c8038364dfe2189125f6bdb453abd0793e8a433e7150a886eed4e731"} Jul 21 20:35:11.263056 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:11.262082 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0da0f4c0-d4be-484a-8efb-8f525f2ab0d9-original-pull-secret\") pod \"global-pull-secret-syncer-2mfdm\" (UID: \"0da0f4c0-d4be-484a-8efb-8f525f2ab0d9\") " pod="kube-system/global-pull-secret-syncer-2mfdm" Jul 21 20:35:11.263056 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:11.262163 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dtrsl\" (UniqueName: \"kubernetes.io/projected/3abb9e4b-7d06-4635-90a7-a31abc3c38ff-kube-api-access-dtrsl\") pod \"network-check-target-5v767\" (UID: \"3abb9e4b-7d06-4635-90a7-a31abc3c38ff\") " pod="openshift-network-diagnostics/network-check-target-5v767" Jul 21 20:35:11.263056 ip-10-0-131-27 kubenswrapper[2560]: E0721 20:35:11.262369 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 21 20:35:11.263056 ip-10-0-131-27 kubenswrapper[2560]: E0721 20:35:11.262393 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 21 20:35:11.263056 ip-10-0-131-27 kubenswrapper[2560]: E0721 20:35:11.262407 2560 projected.go:196] Error preparing data for projected volume kube-api-access-dtrsl for pod openshift-network-diagnostics/network-check-target-5v767: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 20:35:11.263056 ip-10-0-131-27 kubenswrapper[2560]: E0721 20:35:11.262474 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3abb9e4b-7d06-4635-90a7-a31abc3c38ff-kube-api-access-dtrsl podName:3abb9e4b-7d06-4635-90a7-a31abc3c38ff nodeName:}" failed. No retries permitted until 2026-07-21 20:35:13.262453532 +0000 UTC m=+6.025690457 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-dtrsl" (UniqueName: "kubernetes.io/projected/3abb9e4b-7d06-4635-90a7-a31abc3c38ff-kube-api-access-dtrsl") pod "network-check-target-5v767" (UID: "3abb9e4b-7d06-4635-90a7-a31abc3c38ff") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 20:35:11.263056 ip-10-0-131-27 kubenswrapper[2560]: E0721 20:35:11.262904 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 21 20:35:11.263056 ip-10-0-131-27 kubenswrapper[2560]: E0721 20:35:11.262957 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0da0f4c0-d4be-484a-8efb-8f525f2ab0d9-original-pull-secret podName:0da0f4c0-d4be-484a-8efb-8f525f2ab0d9 nodeName:}" failed. No retries permitted until 2026-07-21 20:35:13.26294111 +0000 UTC m=+6.026178036 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0da0f4c0-d4be-484a-8efb-8f525f2ab0d9-original-pull-secret") pod "global-pull-secret-syncer-2mfdm" (UID: "0da0f4c0-d4be-484a-8efb-8f525f2ab0d9") : object "kube-system"/"original-pull-secret" not registered Jul 21 20:35:11.363369 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:11.362717 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/51fd4d84-10d1-464a-bcdb-dd32614a44a9-metrics-certs\") pod \"network-metrics-daemon-qs78f\" (UID: \"51fd4d84-10d1-464a-bcdb-dd32614a44a9\") " pod="openshift-multus/network-metrics-daemon-qs78f" Jul 21 20:35:11.363369 ip-10-0-131-27 kubenswrapper[2560]: E0721 20:35:11.362897 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 20:35:11.363369 ip-10-0-131-27 kubenswrapper[2560]: E0721 20:35:11.362967 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51fd4d84-10d1-464a-bcdb-dd32614a44a9-metrics-certs podName:51fd4d84-10d1-464a-bcdb-dd32614a44a9 nodeName:}" failed. No retries permitted until 2026-07-21 20:35:13.36294518 +0000 UTC m=+6.126182130 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/51fd4d84-10d1-464a-bcdb-dd32614a44a9-metrics-certs") pod "network-metrics-daemon-qs78f" (UID: "51fd4d84-10d1-464a-bcdb-dd32614a44a9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 20:35:11.433015 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:11.432774 2560 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 21 20:35:11.865001 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:11.864855 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5v767" Jul 21 20:35:11.865001 ip-10-0-131-27 kubenswrapper[2560]: E0721 20:35:11.864993 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5v767" podUID="3abb9e4b-7d06-4635-90a7-a31abc3c38ff" Jul 21 20:35:11.865703 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:11.865376 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qs78f" Jul 21 20:35:11.865703 ip-10-0-131-27 kubenswrapper[2560]: E0721 20:35:11.865497 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qs78f" podUID="51fd4d84-10d1-464a-bcdb-dd32614a44a9" Jul 21 20:35:12.865087 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:12.864917 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2mfdm" Jul 21 20:35:12.865651 ip-10-0-131-27 kubenswrapper[2560]: E0721 20:35:12.865090 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2mfdm" podUID="0da0f4c0-d4be-484a-8efb-8f525f2ab0d9" Jul 21 20:35:13.280770 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:13.280674 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dtrsl\" (UniqueName: \"kubernetes.io/projected/3abb9e4b-7d06-4635-90a7-a31abc3c38ff-kube-api-access-dtrsl\") pod \"network-check-target-5v767\" (UID: \"3abb9e4b-7d06-4635-90a7-a31abc3c38ff\") " pod="openshift-network-diagnostics/network-check-target-5v767" Jul 21 20:35:13.280770 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:13.280751 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0da0f4c0-d4be-484a-8efb-8f525f2ab0d9-original-pull-secret\") pod \"global-pull-secret-syncer-2mfdm\" (UID: \"0da0f4c0-d4be-484a-8efb-8f525f2ab0d9\") " pod="kube-system/global-pull-secret-syncer-2mfdm" Jul 21 20:35:13.281016 ip-10-0-131-27 kubenswrapper[2560]: E0721 20:35:13.280890 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 21 20:35:13.281016 ip-10-0-131-27 kubenswrapper[2560]: E0721 20:35:13.280940 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 21 20:35:13.281016 ip-10-0-131-27 kubenswrapper[2560]: E0721 20:35:13.280956 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0da0f4c0-d4be-484a-8efb-8f525f2ab0d9-original-pull-secret podName:0da0f4c0-d4be-484a-8efb-8f525f2ab0d9 nodeName:}" failed. No retries permitted until 2026-07-21 20:35:17.280941722 +0000 UTC m=+10.044178645 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0da0f4c0-d4be-484a-8efb-8f525f2ab0d9-original-pull-secret") pod "global-pull-secret-syncer-2mfdm" (UID: "0da0f4c0-d4be-484a-8efb-8f525f2ab0d9") : object "kube-system"/"original-pull-secret" not registered Jul 21 20:35:13.281016 ip-10-0-131-27 kubenswrapper[2560]: E0721 20:35:13.280967 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 21 20:35:13.281016 ip-10-0-131-27 kubenswrapper[2560]: E0721 20:35:13.280983 2560 projected.go:196] Error preparing data for projected volume kube-api-access-dtrsl for pod openshift-network-diagnostics/network-check-target-5v767: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 20:35:13.281330 ip-10-0-131-27 kubenswrapper[2560]: E0721 20:35:13.281059 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3abb9e4b-7d06-4635-90a7-a31abc3c38ff-kube-api-access-dtrsl podName:3abb9e4b-7d06-4635-90a7-a31abc3c38ff nodeName:}" failed. No retries permitted until 2026-07-21 20:35:17.281041596 +0000 UTC m=+10.044278534 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-dtrsl" (UniqueName: "kubernetes.io/projected/3abb9e4b-7d06-4635-90a7-a31abc3c38ff-kube-api-access-dtrsl") pod "network-check-target-5v767" (UID: "3abb9e4b-7d06-4635-90a7-a31abc3c38ff") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 20:35:13.331742 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:13.331664 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd3c0f2a_c76d_4d83_9eeb_1e5dafd81177.slice/crio-20781e02eb3b22919b7b767498f999e5342cb0a36f71a39f040ed63ae6a05524 WatchSource:0}: Error finding container 20781e02eb3b22919b7b767498f999e5342cb0a36f71a39f040ed63ae6a05524: Status 404 returned error can't find the container with id 20781e02eb3b22919b7b767498f999e5342cb0a36f71a39f040ed63ae6a05524 Jul 21 20:35:13.381899 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:13.381773 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/51fd4d84-10d1-464a-bcdb-dd32614a44a9-metrics-certs\") pod \"network-metrics-daemon-qs78f\" (UID: \"51fd4d84-10d1-464a-bcdb-dd32614a44a9\") " pod="openshift-multus/network-metrics-daemon-qs78f" Jul 21 20:35:13.382118 ip-10-0-131-27 kubenswrapper[2560]: E0721 20:35:13.381961 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 20:35:13.382118 ip-10-0-131-27 kubenswrapper[2560]: E0721 20:35:13.382066 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51fd4d84-10d1-464a-bcdb-dd32614a44a9-metrics-certs podName:51fd4d84-10d1-464a-bcdb-dd32614a44a9 nodeName:}" failed. No retries permitted until 2026-07-21 20:35:17.382044181 +0000 UTC m=+10.145281119 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/51fd4d84-10d1-464a-bcdb-dd32614a44a9-metrics-certs") pod "network-metrics-daemon-qs78f" (UID: "51fd4d84-10d1-464a-bcdb-dd32614a44a9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 20:35:13.865272 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:13.865233 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qs78f" Jul 21 20:35:13.865925 ip-10-0-131-27 kubenswrapper[2560]: E0721 20:35:13.865378 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qs78f" podUID="51fd4d84-10d1-464a-bcdb-dd32614a44a9" Jul 21 20:35:13.865925 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:13.865858 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5v767" Jul 21 20:35:13.866045 ip-10-0-131-27 kubenswrapper[2560]: E0721 20:35:13.865956 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5v767" podUID="3abb9e4b-7d06-4635-90a7-a31abc3c38ff" Jul 21 20:35:13.894044 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:13.893912 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bpvvl" event={"ID":"cd3c0f2a-c76d-4d83-9eeb-1e5dafd81177","Type":"ContainerStarted","Data":"20781e02eb3b22919b7b767498f999e5342cb0a36f71a39f040ed63ae6a05524"} Jul 21 20:35:14.789519 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:14.789482 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92ab865e_73dc_4b1a_a999_5ad3e40f04f0.slice/crio-cecc754cbef1c00cd059b837d7f5ffcb73fb6992549aecc33b3b5ddae7f43d40 WatchSource:0}: Error finding container cecc754cbef1c00cd059b837d7f5ffcb73fb6992549aecc33b3b5ddae7f43d40: Status 404 returned error can't find the container with id cecc754cbef1c00cd059b837d7f5ffcb73fb6992549aecc33b3b5ddae7f43d40 Jul 21 20:35:14.865316 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:14.865282 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2mfdm" Jul 21 20:35:14.865783 ip-10-0-131-27 kubenswrapper[2560]: E0721 20:35:14.865408 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2mfdm" podUID="0da0f4c0-d4be-484a-8efb-8f525f2ab0d9" Jul 21 20:35:14.896876 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:14.896818 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nr9h" event={"ID":"92ab865e-73dc-4b1a-a999-5ad3e40f04f0","Type":"ContainerStarted","Data":"cecc754cbef1c00cd059b837d7f5ffcb73fb6992549aecc33b3b5ddae7f43d40"} Jul 21 20:35:15.865305 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:15.865184 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5v767" Jul 21 20:35:15.865477 ip-10-0-131-27 kubenswrapper[2560]: E0721 20:35:15.865345 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5v767" podUID="3abb9e4b-7d06-4635-90a7-a31abc3c38ff" Jul 21 20:35:15.865477 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:15.865396 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qs78f" Jul 21 20:35:15.865937 ip-10-0-131-27 kubenswrapper[2560]: E0721 20:35:15.865538 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qs78f" podUID="51fd4d84-10d1-464a-bcdb-dd32614a44a9" Jul 21 20:35:16.864656 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:16.864608 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2mfdm" Jul 21 20:35:16.864842 ip-10-0-131-27 kubenswrapper[2560]: E0721 20:35:16.864733 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2mfdm" podUID="0da0f4c0-d4be-484a-8efb-8f525f2ab0d9" Jul 21 20:35:17.300310 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:17.300273 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd370f2e_33cc_425d_812a_c063fd02f4c9.slice/crio-319b75caca65a9ad0778b9bc479411197241a1f272dc8389e84c841d2b502518 WatchSource:0}: Error finding container 319b75caca65a9ad0778b9bc479411197241a1f272dc8389e84c841d2b502518: Status 404 returned error can't find the container with id 319b75caca65a9ad0778b9bc479411197241a1f272dc8389e84c841d2b502518 Jul 21 20:35:17.314365 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:17.314329 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dtrsl\" (UniqueName: \"kubernetes.io/projected/3abb9e4b-7d06-4635-90a7-a31abc3c38ff-kube-api-access-dtrsl\") pod \"network-check-target-5v767\" (UID: \"3abb9e4b-7d06-4635-90a7-a31abc3c38ff\") " pod="openshift-network-diagnostics/network-check-target-5v767" Jul 21 20:35:17.314504 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:17.314429 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0da0f4c0-d4be-484a-8efb-8f525f2ab0d9-original-pull-secret\") pod \"global-pull-secret-syncer-2mfdm\" (UID: \"0da0f4c0-d4be-484a-8efb-8f525f2ab0d9\") " pod="kube-system/global-pull-secret-syncer-2mfdm" Jul 21 20:35:17.314577 ip-10-0-131-27 kubenswrapper[2560]: E0721 20:35:17.314544 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 21 20:35:17.314630 ip-10-0-131-27 kubenswrapper[2560]: E0721 20:35:17.314608 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0da0f4c0-d4be-484a-8efb-8f525f2ab0d9-original-pull-secret podName:0da0f4c0-d4be-484a-8efb-8f525f2ab0d9 nodeName:}" failed. No retries permitted until 2026-07-21 20:35:25.314588319 +0000 UTC m=+18.077825246 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0da0f4c0-d4be-484a-8efb-8f525f2ab0d9-original-pull-secret") pod "global-pull-secret-syncer-2mfdm" (UID: "0da0f4c0-d4be-484a-8efb-8f525f2ab0d9") : object "kube-system"/"original-pull-secret" not registered Jul 21 20:35:17.314706 ip-10-0-131-27 kubenswrapper[2560]: E0721 20:35:17.314647 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 21 20:35:17.314706 ip-10-0-131-27 kubenswrapper[2560]: E0721 20:35:17.314672 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 21 20:35:17.314706 ip-10-0-131-27 kubenswrapper[2560]: E0721 20:35:17.314687 2560 projected.go:196] Error preparing data for projected volume kube-api-access-dtrsl for pod openshift-network-diagnostics/network-check-target-5v767: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 20:35:17.314868 ip-10-0-131-27 kubenswrapper[2560]: E0721 20:35:17.314742 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3abb9e4b-7d06-4635-90a7-a31abc3c38ff-kube-api-access-dtrsl podName:3abb9e4b-7d06-4635-90a7-a31abc3c38ff nodeName:}" failed. No retries permitted until 2026-07-21 20:35:25.314725678 +0000 UTC m=+18.077962600 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-dtrsl" (UniqueName: "kubernetes.io/projected/3abb9e4b-7d06-4635-90a7-a31abc3c38ff-kube-api-access-dtrsl") pod "network-check-target-5v767" (UID: "3abb9e4b-7d06-4635-90a7-a31abc3c38ff") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 20:35:17.416035 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:17.415779 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/51fd4d84-10d1-464a-bcdb-dd32614a44a9-metrics-certs\") pod \"network-metrics-daemon-qs78f\" (UID: \"51fd4d84-10d1-464a-bcdb-dd32614a44a9\") " pod="openshift-multus/network-metrics-daemon-qs78f" Jul 21 20:35:17.416386 ip-10-0-131-27 kubenswrapper[2560]: E0721 20:35:17.416359 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 20:35:17.416473 ip-10-0-131-27 kubenswrapper[2560]: E0721 20:35:17.416445 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51fd4d84-10d1-464a-bcdb-dd32614a44a9-metrics-certs podName:51fd4d84-10d1-464a-bcdb-dd32614a44a9 nodeName:}" failed. No retries permitted until 2026-07-21 20:35:25.416424074 +0000 UTC m=+18.179661017 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/51fd4d84-10d1-464a-bcdb-dd32614a44a9-metrics-certs") pod "network-metrics-daemon-qs78f" (UID: "51fd4d84-10d1-464a-bcdb-dd32614a44a9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 20:35:17.864822 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:17.864714 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qs78f" Jul 21 20:35:17.865908 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:17.865858 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5v767" Jul 21 20:35:17.866226 ip-10-0-131-27 kubenswrapper[2560]: E0721 20:35:17.866035 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qs78f" podUID="51fd4d84-10d1-464a-bcdb-dd32614a44a9" Jul 21 20:35:17.866226 ip-10-0-131-27 kubenswrapper[2560]: E0721 20:35:17.866178 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5v767" podUID="3abb9e4b-7d06-4635-90a7-a31abc3c38ff" Jul 21 20:35:17.904847 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:17.904708 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-6k7l8" event={"ID":"bd370f2e-33cc-425d-812a-c063fd02f4c9","Type":"ContainerStarted","Data":"319b75caca65a9ad0778b9bc479411197241a1f272dc8389e84c841d2b502518"} Jul 21 20:35:17.907706 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:17.907165 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-27.ec2.internal" event={"ID":"e748e1b0ad8f133f242876b765fcf5fc","Type":"ContainerStarted","Data":"e289d66edb064e7a2c9c601069801b38ce11fba1b9e233c790ce023ec8c1ba69"} Jul 21 20:35:17.910070 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:17.909747 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-27.ec2.internal" event={"ID":"d5698e5baf2a73bf68056435e9975908","Type":"ContainerStarted","Data":"0297c3c841020716678bdbd789452de1c949fc3ea2e45992d5eef9cf0b948984"} Jul 21 20:35:17.914195 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:17.912900 2560 generic.go:356] "Generic (PLEG): container finished" podID="baf82b79-7fff-42da-8256-bd0d0b6a3414" containerID="d4b89cd667ac66346d8890bacfd95d29b7874f8f3881519ee6eb0889b6aded24" exitCode=0 Jul 21 20:35:17.914195 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:17.913000 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tdg72" event={"ID":"baf82b79-7fff-42da-8256-bd0d0b6a3414","Type":"ContainerDied","Data":"d4b89cd667ac66346d8890bacfd95d29b7874f8f3881519ee6eb0889b6aded24"} Jul 21 20:35:17.917648 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:17.917624 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-qgk2d" event={"ID":"e5ef3217-99e0-43ce-a415-937df67f3cd2","Type":"ContainerStarted","Data":"84f7813b784c835121a4e52cbfb9a005c5307363a64ec6106eb4e2f9083c2cda"} Jul 21 20:35:17.920498 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:17.920471 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-gf4h6" event={"ID":"74c3fef4-6119-460a-850e-27a565b7d068","Type":"ContainerStarted","Data":"3d476460f700f0e64d310afd2ff5a1a93bd51ef3d95653dd08edfeaa7c7e5334"} Jul 21 20:35:17.922718 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:17.922692 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-swn8q" event={"ID":"77b4be87-3e69-4f8a-a708-1dd40a4f05cc","Type":"ContainerStarted","Data":"127bf9291628d3a27c846d4b442881290bb1d54ef1489a654b7652cd72c397c7"} Jul 21 20:35:17.926831 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:17.926806 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-4shwn" event={"ID":"8cafaac7-d4fe-43e8-a75a-08f26aa58cd5","Type":"ContainerStarted","Data":"2bbda9d06feea4112bdd2331bc9ee2c3aa07a3512fd53334f9ec30cad1be8d72"} Jul 21 20:35:17.943627 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:17.943578 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-qgk2d" podStartSLOduration=2.604843859 podStartE2EDuration="9.943564419s" totalImagesPullingTime="7.33872056s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 20:35:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:35:17.942729603 +0000 UTC m=+10.705966549" watchObservedRunningTime="2026-07-21 20:35:17.943564419 +0000 UTC m=+10.706801366" Jul 21 20:35:17.981194 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:17.981116 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-27.ec2.internal" podStartSLOduration=8.981075729 podStartE2EDuration="8.981075729s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 20:35:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:35:17.980261519 +0000 UTC m=+10.743498466" watchObservedRunningTime="2026-07-21 20:35:17.981075729 +0000 UTC m=+10.744312676" Jul 21 20:35:17.999355 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:17.999267 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-swn8q" podStartSLOduration=2.625387768 podStartE2EDuration="9.999244267s" totalImagesPullingTime="7.373856499s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 20:35:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:35:17.998072934 +0000 UTC m=+10.761309883" watchObservedRunningTime="2026-07-21 20:35:17.999244267 +0000 UTC m=+10.762481214" Jul 21 20:35:18.015025 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:18.014300 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-gf4h6" podStartSLOduration=2.718597633 podStartE2EDuration="10.014276811s" totalImagesPullingTime="7.295679178s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 20:35:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:35:18.01351027 +0000 UTC m=+10.776747241" watchObservedRunningTime="2026-07-21 20:35:18.014276811 +0000 UTC m=+10.777513757" Jul 21 20:35:18.865661 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:18.865628 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2mfdm" Jul 21 20:35:18.866188 ip-10-0-131-27 kubenswrapper[2560]: E0721 20:35:18.865767 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2mfdm" podUID="0da0f4c0-d4be-484a-8efb-8f525f2ab0d9" Jul 21 20:35:19.524288 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:19.524199 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-qgk2d" Jul 21 20:35:19.524886 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:19.524864 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-qgk2d" Jul 21 20:35:19.542967 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:19.542906 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-4shwn" podStartSLOduration=4.231530192 podStartE2EDuration="11.542882742s" totalImagesPullingTime="7.31135255s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 20:35:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:35:18.030844088 +0000 UTC m=+10.794081035" watchObservedRunningTime="2026-07-21 20:35:19.542882742 +0000 UTC m=+12.306119685" Jul 21 20:35:19.865430 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:19.865264 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5v767" Jul 21 20:35:19.865430 ip-10-0-131-27 kubenswrapper[2560]: E0721 20:35:19.865399 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5v767" podUID="3abb9e4b-7d06-4635-90a7-a31abc3c38ff" Jul 21 20:35:19.865742 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:19.865272 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qs78f" Jul 21 20:35:19.866174 ip-10-0-131-27 kubenswrapper[2560]: E0721 20:35:19.865880 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qs78f" podUID="51fd4d84-10d1-464a-bcdb-dd32614a44a9" Jul 21 20:35:19.932698 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:19.932642 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-6k7l8" event={"ID":"bd370f2e-33cc-425d-812a-c063fd02f4c9","Type":"ContainerStarted","Data":"30963a519120fb9d95fcfd5332f784870d078466f888bb3a4962e6e7c41de033"} Jul 21 20:35:19.947611 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:19.947546 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-6k7l8" podStartSLOduration=11.947530333 podStartE2EDuration="11.947530333s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 20:35:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:35:19.946934411 +0000 UTC m=+12.710171353" watchObservedRunningTime="2026-07-21 20:35:19.947530333 +0000 UTC m=+12.710767275" Jul 21 20:35:20.864378 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:20.864340 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2mfdm" Jul 21 20:35:20.864547 ip-10-0-131-27 kubenswrapper[2560]: E0721 20:35:20.864453 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2mfdm" podUID="0da0f4c0-d4be-484a-8efb-8f525f2ab0d9" Jul 21 20:35:20.934342 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:20.934299 2560 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 21 20:35:21.865690 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:21.865090 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5v767" Jul 21 20:35:21.865690 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:21.865097 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qs78f" Jul 21 20:35:21.865690 ip-10-0-131-27 kubenswrapper[2560]: E0721 20:35:21.865249 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5v767" podUID="3abb9e4b-7d06-4635-90a7-a31abc3c38ff" Jul 21 20:35:21.865690 ip-10-0-131-27 kubenswrapper[2560]: E0721 20:35:21.865333 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qs78f" podUID="51fd4d84-10d1-464a-bcdb-dd32614a44a9" Jul 21 20:35:22.865402 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:22.865146 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2mfdm" Jul 21 20:35:22.865818 ip-10-0-131-27 kubenswrapper[2560]: E0721 20:35:22.865560 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2mfdm" podUID="0da0f4c0-d4be-484a-8efb-8f525f2ab0d9" Jul 21 20:35:23.864719 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:23.864679 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qs78f" Jul 21 20:35:23.864917 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:23.864679 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5v767" Jul 21 20:35:23.864917 ip-10-0-131-27 kubenswrapper[2560]: E0721 20:35:23.864835 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qs78f" podUID="51fd4d84-10d1-464a-bcdb-dd32614a44a9" Jul 21 20:35:23.865096 ip-10-0-131-27 kubenswrapper[2560]: E0721 20:35:23.865071 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5v767" podUID="3abb9e4b-7d06-4635-90a7-a31abc3c38ff" Jul 21 20:35:24.864709 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:24.864673 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2mfdm" Jul 21 20:35:24.865285 ip-10-0-131-27 kubenswrapper[2560]: E0721 20:35:24.864803 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2mfdm" podUID="0da0f4c0-d4be-484a-8efb-8f525f2ab0d9" Jul 21 20:35:25.188190 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:25.188110 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-qgk2d" Jul 21 20:35:25.188355 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:25.188242 2560 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 21 20:35:25.188742 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:25.188722 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-qgk2d" Jul 21 20:35:25.384636 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:25.384602 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dtrsl\" (UniqueName: \"kubernetes.io/projected/3abb9e4b-7d06-4635-90a7-a31abc3c38ff-kube-api-access-dtrsl\") pod \"network-check-target-5v767\" (UID: \"3abb9e4b-7d06-4635-90a7-a31abc3c38ff\") " pod="openshift-network-diagnostics/network-check-target-5v767" Jul 21 20:35:25.384785 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:25.384666 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0da0f4c0-d4be-484a-8efb-8f525f2ab0d9-original-pull-secret\") pod \"global-pull-secret-syncer-2mfdm\" (UID: \"0da0f4c0-d4be-484a-8efb-8f525f2ab0d9\") " pod="kube-system/global-pull-secret-syncer-2mfdm" Jul 21 20:35:25.384785 ip-10-0-131-27 kubenswrapper[2560]: E0721 20:35:25.384764 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 21 20:35:25.384785 ip-10-0-131-27 kubenswrapper[2560]: E0721 20:35:25.384771 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 21 20:35:25.384891 ip-10-0-131-27 kubenswrapper[2560]: E0721 20:35:25.384795 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 21 20:35:25.384891 ip-10-0-131-27 kubenswrapper[2560]: E0721 20:35:25.384805 2560 projected.go:196] Error preparing data for projected volume kube-api-access-dtrsl for pod openshift-network-diagnostics/network-check-target-5v767: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 20:35:25.384891 ip-10-0-131-27 kubenswrapper[2560]: E0721 20:35:25.384822 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0da0f4c0-d4be-484a-8efb-8f525f2ab0d9-original-pull-secret podName:0da0f4c0-d4be-484a-8efb-8f525f2ab0d9 nodeName:}" failed. No retries permitted until 2026-07-21 20:35:41.384806791 +0000 UTC m=+34.148043730 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0da0f4c0-d4be-484a-8efb-8f525f2ab0d9-original-pull-secret") pod "global-pull-secret-syncer-2mfdm" (UID: "0da0f4c0-d4be-484a-8efb-8f525f2ab0d9") : object "kube-system"/"original-pull-secret" not registered Jul 21 20:35:25.384891 ip-10-0-131-27 kubenswrapper[2560]: E0721 20:35:25.384846 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3abb9e4b-7d06-4635-90a7-a31abc3c38ff-kube-api-access-dtrsl podName:3abb9e4b-7d06-4635-90a7-a31abc3c38ff nodeName:}" failed. No retries permitted until 2026-07-21 20:35:41.384833881 +0000 UTC m=+34.148070801 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-dtrsl" (UniqueName: "kubernetes.io/projected/3abb9e4b-7d06-4635-90a7-a31abc3c38ff-kube-api-access-dtrsl") pod "network-check-target-5v767" (UID: "3abb9e4b-7d06-4635-90a7-a31abc3c38ff") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 20:35:25.485457 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:25.485376 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/51fd4d84-10d1-464a-bcdb-dd32614a44a9-metrics-certs\") pod \"network-metrics-daemon-qs78f\" (UID: \"51fd4d84-10d1-464a-bcdb-dd32614a44a9\") " pod="openshift-multus/network-metrics-daemon-qs78f" Jul 21 20:35:25.485614 ip-10-0-131-27 kubenswrapper[2560]: E0721 20:35:25.485503 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 20:35:25.485614 ip-10-0-131-27 kubenswrapper[2560]: E0721 20:35:25.485575 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51fd4d84-10d1-464a-bcdb-dd32614a44a9-metrics-certs podName:51fd4d84-10d1-464a-bcdb-dd32614a44a9 nodeName:}" failed. No retries permitted until 2026-07-21 20:35:41.4855562 +0000 UTC m=+34.248793129 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/51fd4d84-10d1-464a-bcdb-dd32614a44a9-metrics-certs") pod "network-metrics-daemon-qs78f" (UID: "51fd4d84-10d1-464a-bcdb-dd32614a44a9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 20:35:25.864493 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:25.864288 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5v767" Jul 21 20:35:25.864493 ip-10-0-131-27 kubenswrapper[2560]: E0721 20:35:25.864433 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5v767" podUID="3abb9e4b-7d06-4635-90a7-a31abc3c38ff" Jul 21 20:35:25.864712 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:25.864520 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qs78f" Jul 21 20:35:25.864712 ip-10-0-131-27 kubenswrapper[2560]: E0721 20:35:25.864628 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qs78f" podUID="51fd4d84-10d1-464a-bcdb-dd32614a44a9" Jul 21 20:35:26.864446 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:26.864413 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2mfdm" Jul 21 20:35:26.864636 ip-10-0-131-27 kubenswrapper[2560]: E0721 20:35:26.864547 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2mfdm" podUID="0da0f4c0-d4be-484a-8efb-8f525f2ab0d9" Jul 21 20:35:27.865353 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:27.865315 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5v767" Jul 21 20:35:27.865795 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:27.865395 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qs78f" Jul 21 20:35:27.865795 ip-10-0-131-27 kubenswrapper[2560]: E0721 20:35:27.865427 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5v767" podUID="3abb9e4b-7d06-4635-90a7-a31abc3c38ff" Jul 21 20:35:27.865795 ip-10-0-131-27 kubenswrapper[2560]: E0721 20:35:27.865568 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qs78f" podUID="51fd4d84-10d1-464a-bcdb-dd32614a44a9" Jul 21 20:35:28.865191 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:28.865154 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2mfdm" Jul 21 20:35:28.865356 ip-10-0-131-27 kubenswrapper[2560]: E0721 20:35:28.865285 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2mfdm" podUID="0da0f4c0-d4be-484a-8efb-8f525f2ab0d9" Jul 21 20:35:29.865086 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:29.865050 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qs78f" Jul 21 20:35:29.865851 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:29.865096 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5v767" Jul 21 20:35:29.865851 ip-10-0-131-27 kubenswrapper[2560]: E0721 20:35:29.865209 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qs78f" podUID="51fd4d84-10d1-464a-bcdb-dd32614a44a9" Jul 21 20:35:29.865851 ip-10-0-131-27 kubenswrapper[2560]: E0721 20:35:29.865322 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5v767" podUID="3abb9e4b-7d06-4635-90a7-a31abc3c38ff" Jul 21 20:35:30.406955 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:30.406921 2560 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-m7tnk" Jul 21 20:35:30.864804 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:30.864718 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2mfdm" Jul 21 20:35:30.864954 ip-10-0-131-27 kubenswrapper[2560]: E0721 20:35:30.864857 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2mfdm" podUID="0da0f4c0-d4be-484a-8efb-8f525f2ab0d9" Jul 21 20:35:31.495113 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:31.495064 2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-20 20:30:30 +0000 UTC" deadline="2028-02-12 13:53:13.812513365 +0000 UTC" Jul 21 20:35:31.495113 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:31.495106 2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13697h17m42.317412596s" Jul 21 20:35:31.864882 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:31.864627 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5v767" Jul 21 20:35:31.864980 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:31.864681 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qs78f" Jul 21 20:35:31.865042 ip-10-0-131-27 kubenswrapper[2560]: E0721 20:35:31.865021 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5v767" podUID="3abb9e4b-7d06-4635-90a7-a31abc3c38ff" Jul 21 20:35:31.865145 ip-10-0-131-27 kubenswrapper[2560]: E0721 20:35:31.865110 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qs78f" podUID="51fd4d84-10d1-464a-bcdb-dd32614a44a9" Jul 21 20:35:31.957962 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:31.957937 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-131-27.ec2.internal_e748e1b0ad8f133f242876b765fcf5fc/setup/0.log" Jul 21 20:35:31.958109 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:31.957972 2560 generic.go:356] "Generic (PLEG): container finished" podID="e748e1b0ad8f133f242876b765fcf5fc" containerID="e289d66edb064e7a2c9c601069801b38ce11fba1b9e233c790ce023ec8c1ba69" exitCode=1 Jul 21 20:35:31.958109 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:31.958047 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-27.ec2.internal" event={"ID":"e748e1b0ad8f133f242876b765fcf5fc","Type":"ContainerDied","Data":"e289d66edb064e7a2c9c601069801b38ce11fba1b9e233c790ce023ec8c1ba69"} Jul 21 20:35:31.959617 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:31.959596 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nr9h" event={"ID":"92ab865e-73dc-4b1a-a999-5ad3e40f04f0","Type":"ContainerStarted","Data":"10095fa776e8c8dce8c0200c9d1b6f40dacf82a87d137750b46ab75f309b0beb"} Jul 21 20:35:31.961018 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:31.960987 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-rl9pf" event={"ID":"e49d91ac-7093-4224-b087-0115ce9cec60","Type":"ContainerStarted","Data":"2601ff99b40f872905768dd02bb9c102cc056fff38f2973950f07ffe72b7f3c1"} Jul 21 20:35:31.962870 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:31.962853 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bpvvl_cd3c0f2a-c76d-4d83-9eeb-1e5dafd81177/ovn-acl-logging/0.log" Jul 21 20:35:31.963164 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:31.963146 2560 generic.go:356] "Generic (PLEG): container finished" podID="cd3c0f2a-c76d-4d83-9eeb-1e5dafd81177" containerID="6cade4c35b8ed40ad15faae8447f859cf5f3be74cae2e4d8d514fbae6a0367eb" exitCode=1 Jul 21 20:35:31.963224 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:31.963174 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bpvvl" event={"ID":"cd3c0f2a-c76d-4d83-9eeb-1e5dafd81177","Type":"ContainerStarted","Data":"38112342105bfa307893850d558fd7d233587e13f29820c20d9e0275a56056ee"} Jul 21 20:35:31.963224 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:31.963218 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bpvvl" event={"ID":"cd3c0f2a-c76d-4d83-9eeb-1e5dafd81177","Type":"ContainerDied","Data":"6cade4c35b8ed40ad15faae8447f859cf5f3be74cae2e4d8d514fbae6a0367eb"} Jul 21 20:35:31.963289 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:31.963250 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bpvvl" event={"ID":"cd3c0f2a-c76d-4d83-9eeb-1e5dafd81177","Type":"ContainerStarted","Data":"3b79907d77681a67548a112d3b20ab5ee794b3c466bd161067b9e5e0da2617be"} Jul 21 20:35:31.990985 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:31.990925 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-rl9pf" podStartSLOduration=2.4558526929999998 podStartE2EDuration="23.990900265s" totalImagesPullingTime="21.535047572s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 20:35:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:35:31.99036913 +0000 UTC m=+24.753606085" watchObservedRunningTime="2026-07-21 20:35:31.990900265 +0000 UTC m=+24.754137208" Jul 21 20:35:32.496283 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:32.496233 2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-20 20:30:30 +0000 UTC" deadline="2028-01-18 12:00:46.09246755 +0000 UTC" Jul 21 20:35:32.496283 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:32.496281 2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13095h25m13.596192393s" Jul 21 20:35:32.760846 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:32.760656 2560 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 21 20:35:32.864730 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:32.864697 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2mfdm" Jul 21 20:35:32.864909 ip-10-0-131-27 kubenswrapper[2560]: E0721 20:35:32.864804 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2mfdm" podUID="0da0f4c0-d4be-484a-8efb-8f525f2ab0d9" Jul 21 20:35:32.968100 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:32.968005 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bpvvl_cd3c0f2a-c76d-4d83-9eeb-1e5dafd81177/ovn-acl-logging/0.log" Jul 21 20:35:32.970890 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:32.968735 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bpvvl" event={"ID":"cd3c0f2a-c76d-4d83-9eeb-1e5dafd81177","Type":"ContainerStarted","Data":"345da1be980daa731e90af15f5aabff78877d708bdb6433f2036c0f612dfb55e"} Jul 21 20:35:32.970890 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:32.968886 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bpvvl" event={"ID":"cd3c0f2a-c76d-4d83-9eeb-1e5dafd81177","Type":"ContainerStarted","Data":"0f755437187e2ef688c6f072f448a23c70d10646ccdd74838d06bae3ed4db348"} Jul 21 20:35:32.970890 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:32.968953 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bpvvl" event={"ID":"cd3c0f2a-c76d-4d83-9eeb-1e5dafd81177","Type":"ContainerStarted","Data":"91d6f138a030dea07fa19451915c2f7802bdb490be85a3fd8e8173410be1e3df"} Jul 21 20:35:32.972875 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:32.972853 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-131-27.ec2.internal_e748e1b0ad8f133f242876b765fcf5fc/setup/0.log" Jul 21 20:35:32.972985 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:32.972892 2560 generic.go:356] "Generic (PLEG): container finished" podID="e748e1b0ad8f133f242876b765fcf5fc" containerID="d394be43c87d73ede102660e69efdb95dedc11ac848a2ddd2d5a10e55a014313" exitCode=0 Jul 21 20:35:32.972985 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:32.972963 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-27.ec2.internal" event={"ID":"e748e1b0ad8f133f242876b765fcf5fc","Type":"ContainerDied","Data":"d394be43c87d73ede102660e69efdb95dedc11ac848a2ddd2d5a10e55a014313"} Jul 21 20:35:32.973115 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:32.973032 2560 scope.go:117] "RemoveContainer" containerID="e289d66edb064e7a2c9c601069801b38ce11fba1b9e233c790ce023ec8c1ba69" Jul 21 20:35:32.973340 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:32.973322 2560 scope.go:117] "RemoveContainer" containerID="e289d66edb064e7a2c9c601069801b38ce11fba1b9e233c790ce023ec8c1ba69" Jul 21 20:35:32.975245 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:32.975225 2560 generic.go:356] "Generic (PLEG): container finished" podID="baf82b79-7fff-42da-8256-bd0d0b6a3414" containerID="fe1cd90617035874358bdca1895a41b9df43caa49d6d22accae7111e3a09323e" exitCode=0 Jul 21 20:35:32.975314 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:32.975251 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tdg72" event={"ID":"baf82b79-7fff-42da-8256-bd0d0b6a3414","Type":"ContainerDied","Data":"fe1cd90617035874358bdca1895a41b9df43caa49d6d22accae7111e3a09323e"} Jul 21 20:35:32.977260 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:32.977230 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nr9h" event={"ID":"92ab865e-73dc-4b1a-a999-5ad3e40f04f0","Type":"ContainerStarted","Data":"6b6a1b54b9c492af293b65496b76c196a5c1e8b777c3864841c49216a0dbcbb5"} Jul 21 20:35:32.983049 ip-10-0-131-27 kubenswrapper[2560]: E0721 20:35:32.983021 2560 log.go:32] "RemoveContainer from runtime service failed" err="rpc error: code = Unknown desc = failed to delete container k8s_setup_kube-rbac-proxy-crio-ip-10-0-131-27.ec2.internal_openshift-machine-config-operator_e748e1b0ad8f133f242876b765fcf5fc_0 in pod sandbox abfe71cf4f518693d95ce093f98194492459f89cabefc0c96c8076791c813db4 from index: no such id: 'e289d66edb064e7a2c9c601069801b38ce11fba1b9e233c790ce023ec8c1ba69'" containerID="e289d66edb064e7a2c9c601069801b38ce11fba1b9e233c790ce023ec8c1ba69" Jul 21 20:35:32.983133 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:32.983058 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e289d66edb064e7a2c9c601069801b38ce11fba1b9e233c790ce023ec8c1ba69"} err="rpc error: code = Unknown desc = failed to delete container k8s_setup_kube-rbac-proxy-crio-ip-10-0-131-27.ec2.internal_openshift-machine-config-operator_e748e1b0ad8f133f242876b765fcf5fc_0 in pod sandbox abfe71cf4f518693d95ce093f98194492459f89cabefc0c96c8076791c813db4 from index: no such id: 'e289d66edb064e7a2c9c601069801b38ce11fba1b9e233c790ce023ec8c1ba69'" Jul 21 20:35:33.735764 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:33.735647 2560 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-21T20:35:32.760839538Z","UUID":"552af964-29c3-4fb8-95d6-47171ade12b4","Handler":null,"Name":"","Endpoint":""} Jul 21 20:35:33.737426 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:33.737401 2560 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 21 20:35:33.737567 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:33.737448 2560 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 21 20:35:33.864905 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:33.864878 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5v767" Jul 21 20:35:33.865118 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:33.864878 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qs78f" Jul 21 20:35:33.865118 ip-10-0-131-27 kubenswrapper[2560]: E0721 20:35:33.864993 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5v767" podUID="3abb9e4b-7d06-4635-90a7-a31abc3c38ff" Jul 21 20:35:33.865202 ip-10-0-131-27 kubenswrapper[2560]: E0721 20:35:33.865140 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qs78f" podUID="51fd4d84-10d1-464a-bcdb-dd32614a44a9" Jul 21 20:35:33.982284 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:33.982252 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nr9h" event={"ID":"92ab865e-73dc-4b1a-a999-5ad3e40f04f0","Type":"ContainerStarted","Data":"1fa34d0dcd321fe2f0be32c14a37826656611649168aebed3f694bdfbefb78ef"} Jul 21 20:35:33.984215 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:33.984188 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-27.ec2.internal" event={"ID":"e748e1b0ad8f133f242876b765fcf5fc","Type":"ContainerStarted","Data":"fc46d4c13d4b44b6c275d19e69c32cc63481b51769e406a594a95a58b38cce23"} Jul 21 20:35:33.986337 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:33.986266 2560 generic.go:356] "Generic (PLEG): container finished" podID="baf82b79-7fff-42da-8256-bd0d0b6a3414" containerID="8b36d4e02cc78ac4b75af51a383f3257817265053a263dbfe19cd18762867543" exitCode=0 Jul 21 20:35:33.986337 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:33.986309 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tdg72" event={"ID":"baf82b79-7fff-42da-8256-bd0d0b6a3414","Type":"ContainerDied","Data":"8b36d4e02cc78ac4b75af51a383f3257817265053a263dbfe19cd18762867543"} Jul 21 20:35:33.999038 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:33.998985 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nr9h" podStartSLOduration=6.239099037 podStartE2EDuration="24.998971014s" totalImagesPullingTime="18.759871977s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 20:35:09 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:35:33.998684295 +0000 UTC m=+26.761921236" watchObservedRunningTime="2026-07-21 20:35:33.998971014 +0000 UTC m=+26.762208000" Jul 21 20:35:34.034764 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:34.034717 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-27.ec2.internal" podStartSLOduration=25.034700987 podStartE2EDuration="25.034700987s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 20:35:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:35:34.013692621 +0000 UTC m=+26.776929563" watchObservedRunningTime="2026-07-21 20:35:34.034700987 +0000 UTC m=+26.797937930" Jul 21 20:35:34.864865 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:34.864833 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2mfdm" Jul 21 20:35:34.865279 ip-10-0-131-27 kubenswrapper[2560]: E0721 20:35:34.864941 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2mfdm" podUID="0da0f4c0-d4be-484a-8efb-8f525f2ab0d9" Jul 21 20:35:34.991928 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:34.991906 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bpvvl_cd3c0f2a-c76d-4d83-9eeb-1e5dafd81177/ovn-acl-logging/0.log" Jul 21 20:35:34.992336 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:34.992310 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bpvvl" event={"ID":"cd3c0f2a-c76d-4d83-9eeb-1e5dafd81177","Type":"ContainerStarted","Data":"c79883401789b1045dd843592d34a29eab837393d20454e8864186892bce6af1"} Jul 21 20:35:35.864580 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:35.864485 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5v767" Jul 21 20:35:35.864580 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:35.864529 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qs78f" Jul 21 20:35:35.864767 ip-10-0-131-27 kubenswrapper[2560]: E0721 20:35:35.864616 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5v767" podUID="3abb9e4b-7d06-4635-90a7-a31abc3c38ff" Jul 21 20:35:35.864767 ip-10-0-131-27 kubenswrapper[2560]: E0721 20:35:35.864739 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qs78f" podUID="51fd4d84-10d1-464a-bcdb-dd32614a44a9" Jul 21 20:35:35.996664 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:35.996632 2560 generic.go:356] "Generic (PLEG): container finished" podID="baf82b79-7fff-42da-8256-bd0d0b6a3414" containerID="a126b9735ecafd38ff39ad399440dd841c10ef3b9be02364e1a3488f98485c1f" exitCode=0 Jul 21 20:35:35.997146 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:35.996683 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tdg72" event={"ID":"baf82b79-7fff-42da-8256-bd0d0b6a3414","Type":"ContainerDied","Data":"a126b9735ecafd38ff39ad399440dd841c10ef3b9be02364e1a3488f98485c1f"} Jul 21 20:35:36.865431 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:36.865158 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2mfdm" Jul 21 20:35:36.865593 ip-10-0-131-27 kubenswrapper[2560]: E0721 20:35:36.865453 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2mfdm" podUID="0da0f4c0-d4be-484a-8efb-8f525f2ab0d9" Jul 21 20:35:37.003360 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:37.003331 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bpvvl_cd3c0f2a-c76d-4d83-9eeb-1e5dafd81177/ovn-acl-logging/0.log" Jul 21 20:35:37.003980 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:37.003805 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bpvvl" event={"ID":"cd3c0f2a-c76d-4d83-9eeb-1e5dafd81177","Type":"ContainerStarted","Data":"6bbc464c88c4a62cd56c3c12368739f91e08403c789a39cbd7eeb8113d7c72fb"} Jul 21 20:35:37.004163 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:37.004134 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bpvvl" Jul 21 20:35:37.004277 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:37.004210 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bpvvl" Jul 21 20:35:37.004277 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:37.004262 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bpvvl" Jul 21 20:35:37.004368 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:37.004350 2560 scope.go:117] "RemoveContainer" containerID="6cade4c35b8ed40ad15faae8447f859cf5f3be74cae2e4d8d514fbae6a0367eb" Jul 21 20:35:37.023765 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:37.023742 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bpvvl" Jul 21 20:35:37.024430 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:37.024397 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bpvvl" Jul 21 20:35:37.865533 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:37.865497 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5v767" Jul 21 20:35:37.865705 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:37.865588 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qs78f" Jul 21 20:35:37.865705 ip-10-0-131-27 kubenswrapper[2560]: E0721 20:35:37.865592 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5v767" podUID="3abb9e4b-7d06-4635-90a7-a31abc3c38ff" Jul 21 20:35:37.865821 ip-10-0-131-27 kubenswrapper[2560]: E0721 20:35:37.865712 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qs78f" podUID="51fd4d84-10d1-464a-bcdb-dd32614a44a9" Jul 21 20:35:38.013157 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:38.013133 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bpvvl_cd3c0f2a-c76d-4d83-9eeb-1e5dafd81177/ovn-acl-logging/0.log" Jul 21 20:35:38.013593 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:38.013526 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bpvvl" event={"ID":"cd3c0f2a-c76d-4d83-9eeb-1e5dafd81177","Type":"ContainerStarted","Data":"7d245eb478c65f86796fa9fdea92d9863fcd1edc42f2a4cd763886a4fcf25d47"} Jul 21 20:35:38.044375 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:38.044321 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-bpvvl" podStartSLOduration=11.822191997000001 podStartE2EDuration="30.044302454s" totalImagesPullingTime="18.222110457s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 20:35:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:35:38.042285235 +0000 UTC m=+30.805522176" watchObservedRunningTime="2026-07-21 20:35:38.044302454 +0000 UTC m=+30.807539441" Jul 21 20:35:38.514604 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:38.514567 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-2mfdm"] Jul 21 20:35:38.514785 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:38.514717 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2mfdm" Jul 21 20:35:38.514843 ip-10-0-131-27 kubenswrapper[2560]: E0721 20:35:38.514815 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2mfdm" podUID="0da0f4c0-d4be-484a-8efb-8f525f2ab0d9" Jul 21 20:35:38.521107 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:38.521059 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-qs78f"] Jul 21 20:35:38.521262 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:38.521230 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qs78f" Jul 21 20:35:38.521364 ip-10-0-131-27 kubenswrapper[2560]: E0721 20:35:38.521339 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qs78f" podUID="51fd4d84-10d1-464a-bcdb-dd32614a44a9" Jul 21 20:35:38.521962 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:38.521936 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-5v767"] Jul 21 20:35:38.522085 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:38.522065 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5v767" Jul 21 20:35:38.522179 ip-10-0-131-27 kubenswrapper[2560]: E0721 20:35:38.522156 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5v767" podUID="3abb9e4b-7d06-4635-90a7-a31abc3c38ff" Jul 21 20:35:39.865215 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:39.865177 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5v767" Jul 21 20:35:39.865215 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:39.865203 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qs78f" Jul 21 20:35:39.865716 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:39.865192 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2mfdm" Jul 21 20:35:39.865716 ip-10-0-131-27 kubenswrapper[2560]: E0721 20:35:39.865316 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5v767" podUID="3abb9e4b-7d06-4635-90a7-a31abc3c38ff" Jul 21 20:35:39.865716 ip-10-0-131-27 kubenswrapper[2560]: E0721 20:35:39.865396 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2mfdm" podUID="0da0f4c0-d4be-484a-8efb-8f525f2ab0d9" Jul 21 20:35:39.865716 ip-10-0-131-27 kubenswrapper[2560]: E0721 20:35:39.865476 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qs78f" podUID="51fd4d84-10d1-464a-bcdb-dd32614a44a9" Jul 21 20:35:41.023463 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:41.023117 2560 generic.go:356] "Generic (PLEG): container finished" podID="baf82b79-7fff-42da-8256-bd0d0b6a3414" containerID="dd70ef22f9b40711c54922651a70edccee86eef2c05395946d2b5ff7deb00aad" exitCode=0 Jul 21 20:35:41.023463 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:41.023188 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tdg72" event={"ID":"baf82b79-7fff-42da-8256-bd0d0b6a3414","Type":"ContainerDied","Data":"dd70ef22f9b40711c54922651a70edccee86eef2c05395946d2b5ff7deb00aad"} Jul 21 20:35:41.399945 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:41.399869 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dtrsl\" (UniqueName: \"kubernetes.io/projected/3abb9e4b-7d06-4635-90a7-a31abc3c38ff-kube-api-access-dtrsl\") pod \"network-check-target-5v767\" (UID: \"3abb9e4b-7d06-4635-90a7-a31abc3c38ff\") " pod="openshift-network-diagnostics/network-check-target-5v767" Jul 21 20:35:41.399945 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:41.399932 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0da0f4c0-d4be-484a-8efb-8f525f2ab0d9-original-pull-secret\") pod \"global-pull-secret-syncer-2mfdm\" (UID: \"0da0f4c0-d4be-484a-8efb-8f525f2ab0d9\") " pod="kube-system/global-pull-secret-syncer-2mfdm" Jul 21 20:35:41.400176 ip-10-0-131-27 kubenswrapper[2560]: E0721 20:35:41.400029 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 21 20:35:41.400176 ip-10-0-131-27 kubenswrapper[2560]: E0721 20:35:41.400050 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 21 20:35:41.400176 ip-10-0-131-27 kubenswrapper[2560]: E0721 20:35:41.400072 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 21 20:35:41.400176 ip-10-0-131-27 kubenswrapper[2560]: E0721 20:35:41.400084 2560 projected.go:196] Error preparing data for projected volume kube-api-access-dtrsl for pod openshift-network-diagnostics/network-check-target-5v767: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 20:35:41.400176 ip-10-0-131-27 kubenswrapper[2560]: E0721 20:35:41.400085 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0da0f4c0-d4be-484a-8efb-8f525f2ab0d9-original-pull-secret podName:0da0f4c0-d4be-484a-8efb-8f525f2ab0d9 nodeName:}" failed. No retries permitted until 2026-07-21 20:36:13.400072077 +0000 UTC m=+66.163308998 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0da0f4c0-d4be-484a-8efb-8f525f2ab0d9-original-pull-secret") pod "global-pull-secret-syncer-2mfdm" (UID: "0da0f4c0-d4be-484a-8efb-8f525f2ab0d9") : object "kube-system"/"original-pull-secret" not registered Jul 21 20:35:41.400176 ip-10-0-131-27 kubenswrapper[2560]: E0721 20:35:41.400135 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3abb9e4b-7d06-4635-90a7-a31abc3c38ff-kube-api-access-dtrsl podName:3abb9e4b-7d06-4635-90a7-a31abc3c38ff nodeName:}" failed. No retries permitted until 2026-07-21 20:36:13.400120623 +0000 UTC m=+66.163357544 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-dtrsl" (UniqueName: "kubernetes.io/projected/3abb9e4b-7d06-4635-90a7-a31abc3c38ff-kube-api-access-dtrsl") pod "network-check-target-5v767" (UID: "3abb9e4b-7d06-4635-90a7-a31abc3c38ff") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 20:35:41.500910 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:41.500871 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/51fd4d84-10d1-464a-bcdb-dd32614a44a9-metrics-certs\") pod \"network-metrics-daemon-qs78f\" (UID: \"51fd4d84-10d1-464a-bcdb-dd32614a44a9\") " pod="openshift-multus/network-metrics-daemon-qs78f" Jul 21 20:35:41.501092 ip-10-0-131-27 kubenswrapper[2560]: E0721 20:35:41.500985 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 20:35:41.501092 ip-10-0-131-27 kubenswrapper[2560]: E0721 20:35:41.501059 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51fd4d84-10d1-464a-bcdb-dd32614a44a9-metrics-certs podName:51fd4d84-10d1-464a-bcdb-dd32614a44a9 nodeName:}" failed. No retries permitted until 2026-07-21 20:36:13.501044354 +0000 UTC m=+66.264281294 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/51fd4d84-10d1-464a-bcdb-dd32614a44a9-metrics-certs") pod "network-metrics-daemon-qs78f" (UID: "51fd4d84-10d1-464a-bcdb-dd32614a44a9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 20:35:41.864510 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:41.864432 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5v767" Jul 21 20:35:41.864510 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:41.864469 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qs78f" Jul 21 20:35:41.864681 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:41.864438 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2mfdm" Jul 21 20:35:41.864681 ip-10-0-131-27 kubenswrapper[2560]: E0721 20:35:41.864542 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5v767" podUID="3abb9e4b-7d06-4635-90a7-a31abc3c38ff" Jul 21 20:35:41.864681 ip-10-0-131-27 kubenswrapper[2560]: E0721 20:35:41.864604 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2mfdm" podUID="0da0f4c0-d4be-484a-8efb-8f525f2ab0d9" Jul 21 20:35:41.864773 ip-10-0-131-27 kubenswrapper[2560]: E0721 20:35:41.864678 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qs78f" podUID="51fd4d84-10d1-464a-bcdb-dd32614a44a9" Jul 21 20:35:42.028269 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:42.028234 2560 generic.go:356] "Generic (PLEG): container finished" podID="baf82b79-7fff-42da-8256-bd0d0b6a3414" containerID="eaf84d7f3a61f0a451cea113a39d1b1125e7b55f19ddf29a681f3130d4289fe7" exitCode=0 Jul 21 20:35:42.028848 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:42.028303 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tdg72" event={"ID":"baf82b79-7fff-42da-8256-bd0d0b6a3414","Type":"ContainerDied","Data":"eaf84d7f3a61f0a451cea113a39d1b1125e7b55f19ddf29a681f3130d4289fe7"} Jul 21 20:35:43.034093 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:43.034056 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tdg72" event={"ID":"baf82b79-7fff-42da-8256-bd0d0b6a3414","Type":"ContainerStarted","Data":"f881a00868893ed59d9c8e69007c1092d4649e89d073d252258d8933bef103cd"} Jul 21 20:35:43.056848 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:43.056802 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-tdg72" podStartSLOduration=7.273261107 podStartE2EDuration="35.056787947s" totalImagesPullingTime="27.78352684s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 20:35:08 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:35:43.055055515 +0000 UTC m=+35.818292457" watchObservedRunningTime="2026-07-21 20:35:43.056787947 +0000 UTC m=+35.820024913" Jul 21 20:35:43.864728 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:43.864701 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5v767" Jul 21 20:35:43.864902 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:43.864701 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2mfdm" Jul 21 20:35:43.864902 ip-10-0-131-27 kubenswrapper[2560]: E0721 20:35:43.864807 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5v767" podUID="3abb9e4b-7d06-4635-90a7-a31abc3c38ff" Jul 21 20:35:43.864902 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:43.864701 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qs78f" Jul 21 20:35:43.865099 ip-10-0-131-27 kubenswrapper[2560]: E0721 20:35:43.864869 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2mfdm" podUID="0da0f4c0-d4be-484a-8efb-8f525f2ab0d9" Jul 21 20:35:43.865099 ip-10-0-131-27 kubenswrapper[2560]: E0721 20:35:43.864982 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qs78f" podUID="51fd4d84-10d1-464a-bcdb-dd32614a44a9" Jul 21 20:35:44.007078 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:44.007052 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-27.ec2.internal" event="NodeReady" Jul 21 20:35:44.007199 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:44.007190 2560 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 21 20:35:44.058065 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:44.058034 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-f6lvh"] Jul 21 20:35:44.070474 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:44.070444 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-km5t4"] Jul 21 20:35:44.070658 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:44.070574 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-f6lvh" Jul 21 20:35:44.073480 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:44.073455 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 21 20:35:44.073480 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:44.073474 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-cz5nx\"" Jul 21 20:35:44.073647 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:44.073534 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 21 20:35:44.073647 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:44.073457 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 21 20:35:44.080210 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:44.078998 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-f6lvh"] Jul 21 20:35:44.080210 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:44.079150 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-km5t4" Jul 21 20:35:44.080606 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:44.080585 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-km5t4"] Jul 21 20:35:44.081846 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:44.081822 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-7ffbl\"" Jul 21 20:35:44.081927 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:44.081859 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 21 20:35:44.082846 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:44.082826 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 21 20:35:44.082946 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:44.082828 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 21 20:35:44.082946 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:44.082872 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 21 20:35:44.086148 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:44.086130 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-9rz9d"] Jul 21 20:35:44.098701 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:44.098678 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-9rz9d" Jul 21 20:35:44.101208 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:44.101188 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-9rz9d"] Jul 21 20:35:44.101634 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:44.101613 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 21 20:35:44.101732 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:44.101658 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-ltcpm\"" Jul 21 20:35:44.101849 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:44.101836 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 21 20:35:44.220292 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:44.220261 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e1f1c9b1-9cf8-4962-804e-d5b905c2d4f4-config-volume\") pod \"dns-default-9rz9d\" (UID: \"e1f1c9b1-9cf8-4962-804e-d5b905c2d4f4\") " pod="openshift-dns/dns-default-9rz9d" Jul 21 20:35:44.220476 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:44.220305 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/eb3b766c-4d7d-40f5-ad7d-38b19e505a36-data-volume\") pod \"insights-runtime-extractor-km5t4\" (UID: \"eb3b766c-4d7d-40f5-ad7d-38b19e505a36\") " pod="openshift-insights/insights-runtime-extractor-km5t4" Jul 21 20:35:44.220476 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:44.220339 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/eb3b766c-4d7d-40f5-ad7d-38b19e505a36-crio-socket\") pod \"insights-runtime-extractor-km5t4\" (UID: \"eb3b766c-4d7d-40f5-ad7d-38b19e505a36\") " pod="openshift-insights/insights-runtime-extractor-km5t4" Jul 21 20:35:44.220476 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:44.220427 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/833f477b-d8ec-4245-82e2-5e2c5dce8dc1-cert\") pod \"ingress-canary-f6lvh\" (UID: \"833f477b-d8ec-4245-82e2-5e2c5dce8dc1\") " pod="openshift-ingress-canary/ingress-canary-f6lvh" Jul 21 20:35:44.220476 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:44.220464 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jj77r\" (UniqueName: \"kubernetes.io/projected/833f477b-d8ec-4245-82e2-5e2c5dce8dc1-kube-api-access-jj77r\") pod \"ingress-canary-f6lvh\" (UID: \"833f477b-d8ec-4245-82e2-5e2c5dce8dc1\") " pod="openshift-ingress-canary/ingress-canary-f6lvh" Jul 21 20:35:44.220649 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:44.220498 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/eb3b766c-4d7d-40f5-ad7d-38b19e505a36-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-km5t4\" (UID: \"eb3b766c-4d7d-40f5-ad7d-38b19e505a36\") " pod="openshift-insights/insights-runtime-extractor-km5t4" Jul 21 20:35:44.220649 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:44.220535 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/eb3b766c-4d7d-40f5-ad7d-38b19e505a36-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-km5t4\" (UID: \"eb3b766c-4d7d-40f5-ad7d-38b19e505a36\") " pod="openshift-insights/insights-runtime-extractor-km5t4" Jul 21 20:35:44.220649 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:44.220595 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e1f1c9b1-9cf8-4962-804e-d5b905c2d4f4-tmp-dir\") pod \"dns-default-9rz9d\" (UID: \"e1f1c9b1-9cf8-4962-804e-d5b905c2d4f4\") " pod="openshift-dns/dns-default-9rz9d" Jul 21 20:35:44.220649 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:44.220614 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qdm6l\" (UniqueName: \"kubernetes.io/projected/eb3b766c-4d7d-40f5-ad7d-38b19e505a36-kube-api-access-qdm6l\") pod \"insights-runtime-extractor-km5t4\" (UID: \"eb3b766c-4d7d-40f5-ad7d-38b19e505a36\") " pod="openshift-insights/insights-runtime-extractor-km5t4" Jul 21 20:35:44.220649 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:44.220633 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e1f1c9b1-9cf8-4962-804e-d5b905c2d4f4-metrics-tls\") pod \"dns-default-9rz9d\" (UID: \"e1f1c9b1-9cf8-4962-804e-d5b905c2d4f4\") " pod="openshift-dns/dns-default-9rz9d" Jul 21 20:35:44.220813 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:44.220652 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vp4x7\" (UniqueName: \"kubernetes.io/projected/e1f1c9b1-9cf8-4962-804e-d5b905c2d4f4-kube-api-access-vp4x7\") pod \"dns-default-9rz9d\" (UID: \"e1f1c9b1-9cf8-4962-804e-d5b905c2d4f4\") " pod="openshift-dns/dns-default-9rz9d" Jul 21 20:35:44.321722 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:44.321681 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/eb3b766c-4d7d-40f5-ad7d-38b19e505a36-data-volume\") pod \"insights-runtime-extractor-km5t4\" (UID: \"eb3b766c-4d7d-40f5-ad7d-38b19e505a36\") " pod="openshift-insights/insights-runtime-extractor-km5t4" Jul 21 20:35:44.321722 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:44.321724 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/eb3b766c-4d7d-40f5-ad7d-38b19e505a36-crio-socket\") pod \"insights-runtime-extractor-km5t4\" (UID: \"eb3b766c-4d7d-40f5-ad7d-38b19e505a36\") " pod="openshift-insights/insights-runtime-extractor-km5t4" Jul 21 20:35:44.321959 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:44.321888 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/833f477b-d8ec-4245-82e2-5e2c5dce8dc1-cert\") pod \"ingress-canary-f6lvh\" (UID: \"833f477b-d8ec-4245-82e2-5e2c5dce8dc1\") " pod="openshift-ingress-canary/ingress-canary-f6lvh" Jul 21 20:35:44.321959 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:44.321929 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jj77r\" (UniqueName: \"kubernetes.io/projected/833f477b-d8ec-4245-82e2-5e2c5dce8dc1-kube-api-access-jj77r\") pod \"ingress-canary-f6lvh\" (UID: \"833f477b-d8ec-4245-82e2-5e2c5dce8dc1\") " pod="openshift-ingress-canary/ingress-canary-f6lvh" Jul 21 20:35:44.322091 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:44.321959 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/eb3b766c-4d7d-40f5-ad7d-38b19e505a36-crio-socket\") pod \"insights-runtime-extractor-km5t4\" (UID: \"eb3b766c-4d7d-40f5-ad7d-38b19e505a36\") " pod="openshift-insights/insights-runtime-extractor-km5t4" Jul 21 20:35:44.322091 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:44.321976 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/eb3b766c-4d7d-40f5-ad7d-38b19e505a36-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-km5t4\" (UID: \"eb3b766c-4d7d-40f5-ad7d-38b19e505a36\") " pod="openshift-insights/insights-runtime-extractor-km5t4" Jul 21 20:35:44.322091 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:44.322004 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/eb3b766c-4d7d-40f5-ad7d-38b19e505a36-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-km5t4\" (UID: \"eb3b766c-4d7d-40f5-ad7d-38b19e505a36\") " pod="openshift-insights/insights-runtime-extractor-km5t4" Jul 21 20:35:44.322091 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:44.322061 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e1f1c9b1-9cf8-4962-804e-d5b905c2d4f4-tmp-dir\") pod \"dns-default-9rz9d\" (UID: \"e1f1c9b1-9cf8-4962-804e-d5b905c2d4f4\") " pod="openshift-dns/dns-default-9rz9d" Jul 21 20:35:44.322091 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:44.322087 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qdm6l\" (UniqueName: \"kubernetes.io/projected/eb3b766c-4d7d-40f5-ad7d-38b19e505a36-kube-api-access-qdm6l\") pod \"insights-runtime-extractor-km5t4\" (UID: \"eb3b766c-4d7d-40f5-ad7d-38b19e505a36\") " pod="openshift-insights/insights-runtime-extractor-km5t4" Jul 21 20:35:44.322091 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:44.322091 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/eb3b766c-4d7d-40f5-ad7d-38b19e505a36-data-volume\") pod \"insights-runtime-extractor-km5t4\" (UID: \"eb3b766c-4d7d-40f5-ad7d-38b19e505a36\") " pod="openshift-insights/insights-runtime-extractor-km5t4" Jul 21 20:35:44.322337 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:44.322109 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e1f1c9b1-9cf8-4962-804e-d5b905c2d4f4-metrics-tls\") pod \"dns-default-9rz9d\" (UID: \"e1f1c9b1-9cf8-4962-804e-d5b905c2d4f4\") " pod="openshift-dns/dns-default-9rz9d" Jul 21 20:35:44.322337 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:44.322131 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vp4x7\" (UniqueName: \"kubernetes.io/projected/e1f1c9b1-9cf8-4962-804e-d5b905c2d4f4-kube-api-access-vp4x7\") pod \"dns-default-9rz9d\" (UID: \"e1f1c9b1-9cf8-4962-804e-d5b905c2d4f4\") " pod="openshift-dns/dns-default-9rz9d" Jul 21 20:35:44.322337 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:44.322181 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e1f1c9b1-9cf8-4962-804e-d5b905c2d4f4-config-volume\") pod \"dns-default-9rz9d\" (UID: \"e1f1c9b1-9cf8-4962-804e-d5b905c2d4f4\") " pod="openshift-dns/dns-default-9rz9d" Jul 21 20:35:44.322453 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:44.322375 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e1f1c9b1-9cf8-4962-804e-d5b905c2d4f4-tmp-dir\") pod \"dns-default-9rz9d\" (UID: \"e1f1c9b1-9cf8-4962-804e-d5b905c2d4f4\") " pod="openshift-dns/dns-default-9rz9d" Jul 21 20:35:44.322708 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:44.322685 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/eb3b766c-4d7d-40f5-ad7d-38b19e505a36-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-km5t4\" (UID: \"eb3b766c-4d7d-40f5-ad7d-38b19e505a36\") " pod="openshift-insights/insights-runtime-extractor-km5t4" Jul 21 20:35:44.322841 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:44.322728 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e1f1c9b1-9cf8-4962-804e-d5b905c2d4f4-config-volume\") pod \"dns-default-9rz9d\" (UID: \"e1f1c9b1-9cf8-4962-804e-d5b905c2d4f4\") " pod="openshift-dns/dns-default-9rz9d" Jul 21 20:35:44.326002 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:44.325980 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e1f1c9b1-9cf8-4962-804e-d5b905c2d4f4-metrics-tls\") pod \"dns-default-9rz9d\" (UID: \"e1f1c9b1-9cf8-4962-804e-d5b905c2d4f4\") " pod="openshift-dns/dns-default-9rz9d" Jul 21 20:35:44.326137 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:44.325985 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/eb3b766c-4d7d-40f5-ad7d-38b19e505a36-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-km5t4\" (UID: \"eb3b766c-4d7d-40f5-ad7d-38b19e505a36\") " pod="openshift-insights/insights-runtime-extractor-km5t4" Jul 21 20:35:44.326252 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:44.326234 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/833f477b-d8ec-4245-82e2-5e2c5dce8dc1-cert\") pod \"ingress-canary-f6lvh\" (UID: \"833f477b-d8ec-4245-82e2-5e2c5dce8dc1\") " pod="openshift-ingress-canary/ingress-canary-f6lvh" Jul 21 20:35:44.340375 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:44.340345 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vp4x7\" (UniqueName: \"kubernetes.io/projected/e1f1c9b1-9cf8-4962-804e-d5b905c2d4f4-kube-api-access-vp4x7\") pod \"dns-default-9rz9d\" (UID: \"e1f1c9b1-9cf8-4962-804e-d5b905c2d4f4\") " pod="openshift-dns/dns-default-9rz9d" Jul 21 20:35:44.340492 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:44.340455 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qdm6l\" (UniqueName: \"kubernetes.io/projected/eb3b766c-4d7d-40f5-ad7d-38b19e505a36-kube-api-access-qdm6l\") pod \"insights-runtime-extractor-km5t4\" (UID: \"eb3b766c-4d7d-40f5-ad7d-38b19e505a36\") " pod="openshift-insights/insights-runtime-extractor-km5t4" Jul 21 20:35:44.340691 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:44.340672 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jj77r\" (UniqueName: \"kubernetes.io/projected/833f477b-d8ec-4245-82e2-5e2c5dce8dc1-kube-api-access-jj77r\") pod \"ingress-canary-f6lvh\" (UID: \"833f477b-d8ec-4245-82e2-5e2c5dce8dc1\") " pod="openshift-ingress-canary/ingress-canary-f6lvh" Jul 21 20:35:44.382429 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:44.382398 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-f6lvh" Jul 21 20:35:44.389561 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:44.389540 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-km5t4" Jul 21 20:35:44.407771 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:44.407738 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-9rz9d" Jul 21 20:35:44.597413 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:44.597173 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-f6lvh"] Jul 21 20:35:44.600106 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:44.600081 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-km5t4"] Jul 21 20:35:44.600642 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:44.600611 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod833f477b_d8ec_4245_82e2_5e2c5dce8dc1.slice/crio-4ee2cb9163efd0dc2ec3249fe909ef4eedeb2a9831a080d20c05a4862b5f9e51 WatchSource:0}: Error finding container 4ee2cb9163efd0dc2ec3249fe909ef4eedeb2a9831a080d20c05a4862b5f9e51: Status 404 returned error can't find the container with id 4ee2cb9163efd0dc2ec3249fe909ef4eedeb2a9831a080d20c05a4862b5f9e51 Jul 21 20:35:44.602986 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:44.602964 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb3b766c_4d7d_40f5_ad7d_38b19e505a36.slice/crio-8ae331af1b3b6fb83a1ab9c78fd09790e32a38b3f12921bb9ac67eb38c5db16b WatchSource:0}: Error finding container 8ae331af1b3b6fb83a1ab9c78fd09790e32a38b3f12921bb9ac67eb38c5db16b: Status 404 returned error can't find the container with id 8ae331af1b3b6fb83a1ab9c78fd09790e32a38b3f12921bb9ac67eb38c5db16b Jul 21 20:35:44.607202 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:44.607166 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-9rz9d"] Jul 21 20:35:44.609695 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:44.609675 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1f1c9b1_9cf8_4962_804e_d5b905c2d4f4.slice/crio-529870e8306d65e3dddf295c4f6e7de7a050d628fd57281be20e6d54a12bea7c WatchSource:0}: Error finding container 529870e8306d65e3dddf295c4f6e7de7a050d628fd57281be20e6d54a12bea7c: Status 404 returned error can't find the container with id 529870e8306d65e3dddf295c4f6e7de7a050d628fd57281be20e6d54a12bea7c Jul 21 20:35:45.039823 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:45.039788 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9rz9d" event={"ID":"e1f1c9b1-9cf8-4962-804e-d5b905c2d4f4","Type":"ContainerStarted","Data":"529870e8306d65e3dddf295c4f6e7de7a050d628fd57281be20e6d54a12bea7c"} Jul 21 20:35:45.040769 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:45.040742 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-km5t4" event={"ID":"eb3b766c-4d7d-40f5-ad7d-38b19e505a36","Type":"ContainerStarted","Data":"8ae331af1b3b6fb83a1ab9c78fd09790e32a38b3f12921bb9ac67eb38c5db16b"} Jul 21 20:35:45.041690 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:45.041670 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-f6lvh" event={"ID":"833f477b-d8ec-4245-82e2-5e2c5dce8dc1","Type":"ContainerStarted","Data":"4ee2cb9163efd0dc2ec3249fe909ef4eedeb2a9831a080d20c05a4862b5f9e51"} Jul 21 20:35:45.866502 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:45.865135 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5v767" Jul 21 20:35:45.866502 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:45.866065 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qs78f" Jul 21 20:35:45.867129 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:45.866616 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2mfdm" Jul 21 20:35:45.869925 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:45.869709 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 21 20:35:45.871619 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:45.870275 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 21 20:35:45.871619 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:45.870544 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-jv74c\"" Jul 21 20:35:45.871619 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:45.870778 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 21 20:35:45.871619 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:45.870940 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-xtr62\"" Jul 21 20:35:45.871619 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:45.871133 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 21 20:35:47.044840 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:47.044789 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-k9lrs"] Jul 21 20:35:47.061396 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:47.061366 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-g558f"] Jul 21 20:35:47.061788 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:47.061678 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56c5594674-k9lrs" Jul 21 20:35:47.065271 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:47.065238 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d0c64150-3a79-4dc2-99fa-a7f04c3e40dc-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-k9lrs\" (UID: \"d0c64150-3a79-4dc2-99fa-a7f04c3e40dc\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-k9lrs" Jul 21 20:35:47.065390 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:47.065289 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/d0c64150-3a79-4dc2-99fa-a7f04c3e40dc-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-k9lrs\" (UID: \"d0c64150-3a79-4dc2-99fa-a7f04c3e40dc\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-k9lrs" Jul 21 20:35:47.065390 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:47.065335 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d0c64150-3a79-4dc2-99fa-a7f04c3e40dc-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-k9lrs\" (UID: \"d0c64150-3a79-4dc2-99fa-a7f04c3e40dc\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-k9lrs" Jul 21 20:35:47.065501 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:47.065414 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d0c64150-3a79-4dc2-99fa-a7f04c3e40dc-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-k9lrs\" (UID: \"d0c64150-3a79-4dc2-99fa-a7f04c3e40dc\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-k9lrs" Jul 21 20:35:47.065501 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:47.065439 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/d0c64150-3a79-4dc2-99fa-a7f04c3e40dc-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-k9lrs\" (UID: \"d0c64150-3a79-4dc2-99fa-a7f04c3e40dc\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-k9lrs" Jul 21 20:35:47.065501 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:47.065463 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5rlfp\" (UniqueName: \"kubernetes.io/projected/d0c64150-3a79-4dc2-99fa-a7f04c3e40dc-kube-api-access-5rlfp\") pod \"kube-state-metrics-56c5594674-k9lrs\" (UID: \"d0c64150-3a79-4dc2-99fa-a7f04c3e40dc\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-k9lrs" Jul 21 20:35:47.066350 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:47.066324 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 21 20:35:47.066487 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:47.066399 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 21 20:35:47.066565 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:47.066335 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-ds92q\"" Jul 21 20:35:47.066740 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:47.066723 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 21 20:35:47.066829 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:47.066791 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 21 20:35:47.066882 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:47.066724 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 21 20:35:47.067241 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:47.067221 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 21 20:35:47.075472 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:47.075446 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-k9lrs"] Jul 21 20:35:47.075549 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:47.075506 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-g558f"] Jul 21 20:35:47.075549 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:47.075450 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-g558f" Jul 21 20:35:47.078386 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:47.078370 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-kcqxn\"" Jul 21 20:35:47.078658 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:47.078625 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-4x8tg"] Jul 21 20:35:47.078829 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:47.078810 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 21 20:35:47.079055 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:47.079040 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 21 20:35:47.093833 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:47.093812 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-4x8tg" Jul 21 20:35:47.096708 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:47.096688 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 21 20:35:47.096809 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:47.096745 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 21 20:35:47.096809 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:47.096747 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 21 20:35:47.096978 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:47.096768 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-l9lqd\"" Jul 21 20:35:47.166252 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:47.166220 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5rlfp\" (UniqueName: \"kubernetes.io/projected/d0c64150-3a79-4dc2-99fa-a7f04c3e40dc-kube-api-access-5rlfp\") pod \"kube-state-metrics-56c5594674-k9lrs\" (UID: \"d0c64150-3a79-4dc2-99fa-a7f04c3e40dc\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-k9lrs" Jul 21 20:35:47.166252 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:47.166256 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6e7f65a8-9ebc-4df4-9907-c9632cd5f7ac-root\") pod \"node-exporter-4x8tg\" (UID: \"6e7f65a8-9ebc-4df4-9907-c9632cd5f7ac\") " pod="openshift-monitoring/node-exporter-4x8tg" Jul 21 20:35:47.166490 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:47.166283 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d0c64150-3a79-4dc2-99fa-a7f04c3e40dc-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-k9lrs\" (UID: \"d0c64150-3a79-4dc2-99fa-a7f04c3e40dc\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-k9lrs" Jul 21 20:35:47.166490 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:47.166307 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6f695010-55df-4bb3-a59e-a6ba4ae714e7-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-g558f\" (UID: \"6f695010-55df-4bb3-a59e-a6ba4ae714e7\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-g558f" Jul 21 20:35:47.166490 ip-10-0-131-27 kubenswrapper[2560]: E0721 20:35:47.166402 2560 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jul 21 20:35:47.166490 ip-10-0-131-27 kubenswrapper[2560]: E0721 20:35:47.166459 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0c64150-3a79-4dc2-99fa-a7f04c3e40dc-kube-state-metrics-tls podName:d0c64150-3a79-4dc2-99fa-a7f04c3e40dc nodeName:}" failed. No retries permitted until 2026-07-21 20:35:47.666440838 +0000 UTC m=+40.429677761 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/d0c64150-3a79-4dc2-99fa-a7f04c3e40dc-kube-state-metrics-tls") pod "kube-state-metrics-56c5594674-k9lrs" (UID: "d0c64150-3a79-4dc2-99fa-a7f04c3e40dc") : secret "kube-state-metrics-tls" not found Jul 21 20:35:47.166699 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:47.166510 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/d0c64150-3a79-4dc2-99fa-a7f04c3e40dc-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-k9lrs\" (UID: \"d0c64150-3a79-4dc2-99fa-a7f04c3e40dc\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-k9lrs" Jul 21 20:35:47.166699 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:47.166569 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6f695010-55df-4bb3-a59e-a6ba4ae714e7-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-g558f\" (UID: \"6f695010-55df-4bb3-a59e-a6ba4ae714e7\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-g558f" Jul 21 20:35:47.166699 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:47.166620 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6e7f65a8-9ebc-4df4-9907-c9632cd5f7ac-node-exporter-wtmp\") pod \"node-exporter-4x8tg\" (UID: \"6e7f65a8-9ebc-4df4-9907-c9632cd5f7ac\") " pod="openshift-monitoring/node-exporter-4x8tg" Jul 21 20:35:47.166699 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:47.166643 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6e7f65a8-9ebc-4df4-9907-c9632cd5f7ac-metrics-client-ca\") pod \"node-exporter-4x8tg\" (UID: \"6e7f65a8-9ebc-4df4-9907-c9632cd5f7ac\") " pod="openshift-monitoring/node-exporter-4x8tg" Jul 21 20:35:47.166699 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:47.166670 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6e7f65a8-9ebc-4df4-9907-c9632cd5f7ac-node-exporter-tls\") pod \"node-exporter-4x8tg\" (UID: \"6e7f65a8-9ebc-4df4-9907-c9632cd5f7ac\") " pod="openshift-monitoring/node-exporter-4x8tg" Jul 21 20:35:47.166933 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:47.166703 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d0c64150-3a79-4dc2-99fa-a7f04c3e40dc-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-k9lrs\" (UID: \"d0c64150-3a79-4dc2-99fa-a7f04c3e40dc\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-k9lrs" Jul 21 20:35:47.166933 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:47.166743 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6e7f65a8-9ebc-4df4-9907-c9632cd5f7ac-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4x8tg\" (UID: \"6e7f65a8-9ebc-4df4-9907-c9632cd5f7ac\") " pod="openshift-monitoring/node-exporter-4x8tg" Jul 21 20:35:47.166933 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:47.166782 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6e7f65a8-9ebc-4df4-9907-c9632cd5f7ac-node-exporter-accelerators-collector-config\") pod \"node-exporter-4x8tg\" (UID: \"6e7f65a8-9ebc-4df4-9907-c9632cd5f7ac\") " pod="openshift-monitoring/node-exporter-4x8tg" Jul 21 20:35:47.166933 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:47.166813 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d0c64150-3a79-4dc2-99fa-a7f04c3e40dc-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-k9lrs\" (UID: \"d0c64150-3a79-4dc2-99fa-a7f04c3e40dc\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-k9lrs" Jul 21 20:35:47.166933 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:47.166857 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6e7f65a8-9ebc-4df4-9907-c9632cd5f7ac-sys\") pod \"node-exporter-4x8tg\" (UID: \"6e7f65a8-9ebc-4df4-9907-c9632cd5f7ac\") " pod="openshift-monitoring/node-exporter-4x8tg" Jul 21 20:35:47.166933 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:47.166879 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dhht8\" (UniqueName: \"kubernetes.io/projected/6e7f65a8-9ebc-4df4-9907-c9632cd5f7ac-kube-api-access-dhht8\") pod \"node-exporter-4x8tg\" (UID: \"6e7f65a8-9ebc-4df4-9907-c9632cd5f7ac\") " pod="openshift-monitoring/node-exporter-4x8tg" Jul 21 20:35:47.166933 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:47.166909 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/d0c64150-3a79-4dc2-99fa-a7f04c3e40dc-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-k9lrs\" (UID: \"d0c64150-3a79-4dc2-99fa-a7f04c3e40dc\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-k9lrs" Jul 21 20:35:47.167285 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:47.166944 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6f695010-55df-4bb3-a59e-a6ba4ae714e7-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-g558f\" (UID: \"6f695010-55df-4bb3-a59e-a6ba4ae714e7\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-g558f" Jul 21 20:35:47.167285 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:47.166972 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qbvmp\" (UniqueName: \"kubernetes.io/projected/6f695010-55df-4bb3-a59e-a6ba4ae714e7-kube-api-access-qbvmp\") pod \"openshift-state-metrics-79f6958cdf-g558f\" (UID: \"6f695010-55df-4bb3-a59e-a6ba4ae714e7\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-g558f" Jul 21 20:35:47.167285 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:47.166994 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6e7f65a8-9ebc-4df4-9907-c9632cd5f7ac-node-exporter-textfile\") pod \"node-exporter-4x8tg\" (UID: \"6e7f65a8-9ebc-4df4-9907-c9632cd5f7ac\") " pod="openshift-monitoring/node-exporter-4x8tg" Jul 21 20:35:47.167429 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:47.167351 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/d0c64150-3a79-4dc2-99fa-a7f04c3e40dc-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-k9lrs\" (UID: \"d0c64150-3a79-4dc2-99fa-a7f04c3e40dc\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-k9lrs" Jul 21 20:35:47.167469 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:47.167449 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d0c64150-3a79-4dc2-99fa-a7f04c3e40dc-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-k9lrs\" (UID: \"d0c64150-3a79-4dc2-99fa-a7f04c3e40dc\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-k9lrs" Jul 21 20:35:47.167571 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:47.167512 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/d0c64150-3a79-4dc2-99fa-a7f04c3e40dc-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-k9lrs\" (UID: \"d0c64150-3a79-4dc2-99fa-a7f04c3e40dc\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-k9lrs" Jul 21 20:35:47.170772 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:47.170739 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d0c64150-3a79-4dc2-99fa-a7f04c3e40dc-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-k9lrs\" (UID: \"d0c64150-3a79-4dc2-99fa-a7f04c3e40dc\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-k9lrs" Jul 21 20:35:47.175753 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:47.175633 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5rlfp\" (UniqueName: \"kubernetes.io/projected/d0c64150-3a79-4dc2-99fa-a7f04c3e40dc-kube-api-access-5rlfp\") pod \"kube-state-metrics-56c5594674-k9lrs\" (UID: \"d0c64150-3a79-4dc2-99fa-a7f04c3e40dc\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-k9lrs" Jul 21 20:35:47.267456 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:47.267413 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6e7f65a8-9ebc-4df4-9907-c9632cd5f7ac-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4x8tg\" (UID: \"6e7f65a8-9ebc-4df4-9907-c9632cd5f7ac\") " pod="openshift-monitoring/node-exporter-4x8tg" Jul 21 20:35:47.267621 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:47.267471 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6e7f65a8-9ebc-4df4-9907-c9632cd5f7ac-node-exporter-accelerators-collector-config\") pod \"node-exporter-4x8tg\" (UID: \"6e7f65a8-9ebc-4df4-9907-c9632cd5f7ac\") " pod="openshift-monitoring/node-exporter-4x8tg" Jul 21 20:35:47.267621 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:47.267503 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6e7f65a8-9ebc-4df4-9907-c9632cd5f7ac-sys\") pod \"node-exporter-4x8tg\" (UID: \"6e7f65a8-9ebc-4df4-9907-c9632cd5f7ac\") " pod="openshift-monitoring/node-exporter-4x8tg" Jul 21 20:35:47.267621 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:47.267527 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dhht8\" (UniqueName: \"kubernetes.io/projected/6e7f65a8-9ebc-4df4-9907-c9632cd5f7ac-kube-api-access-dhht8\") pod \"node-exporter-4x8tg\" (UID: \"6e7f65a8-9ebc-4df4-9907-c9632cd5f7ac\") " pod="openshift-monitoring/node-exporter-4x8tg" Jul 21 20:35:47.267621 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:47.267561 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6f695010-55df-4bb3-a59e-a6ba4ae714e7-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-g558f\" (UID: \"6f695010-55df-4bb3-a59e-a6ba4ae714e7\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-g558f" Jul 21 20:35:47.267621 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:47.267590 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qbvmp\" (UniqueName: \"kubernetes.io/projected/6f695010-55df-4bb3-a59e-a6ba4ae714e7-kube-api-access-qbvmp\") pod \"openshift-state-metrics-79f6958cdf-g558f\" (UID: \"6f695010-55df-4bb3-a59e-a6ba4ae714e7\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-g558f" Jul 21 20:35:47.267621 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:47.267613 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6e7f65a8-9ebc-4df4-9907-c9632cd5f7ac-node-exporter-textfile\") pod \"node-exporter-4x8tg\" (UID: \"6e7f65a8-9ebc-4df4-9907-c9632cd5f7ac\") " pod="openshift-monitoring/node-exporter-4x8tg" Jul 21 20:35:47.267873 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:47.267655 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6e7f65a8-9ebc-4df4-9907-c9632cd5f7ac-root\") pod \"node-exporter-4x8tg\" (UID: \"6e7f65a8-9ebc-4df4-9907-c9632cd5f7ac\") " pod="openshift-monitoring/node-exporter-4x8tg" Jul 21 20:35:47.267873 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:47.267704 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6f695010-55df-4bb3-a59e-a6ba4ae714e7-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-g558f\" (UID: \"6f695010-55df-4bb3-a59e-a6ba4ae714e7\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-g558f" Jul 21 20:35:47.267873 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:47.267736 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6f695010-55df-4bb3-a59e-a6ba4ae714e7-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-g558f\" (UID: \"6f695010-55df-4bb3-a59e-a6ba4ae714e7\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-g558f" Jul 21 20:35:47.267873 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:47.267777 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6e7f65a8-9ebc-4df4-9907-c9632cd5f7ac-node-exporter-wtmp\") pod \"node-exporter-4x8tg\" (UID: \"6e7f65a8-9ebc-4df4-9907-c9632cd5f7ac\") " pod="openshift-monitoring/node-exporter-4x8tg" Jul 21 20:35:47.267873 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:47.267795 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6e7f65a8-9ebc-4df4-9907-c9632cd5f7ac-sys\") pod \"node-exporter-4x8tg\" (UID: \"6e7f65a8-9ebc-4df4-9907-c9632cd5f7ac\") " pod="openshift-monitoring/node-exporter-4x8tg" Jul 21 20:35:47.267873 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:47.267805 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6e7f65a8-9ebc-4df4-9907-c9632cd5f7ac-metrics-client-ca\") pod \"node-exporter-4x8tg\" (UID: \"6e7f65a8-9ebc-4df4-9907-c9632cd5f7ac\") " pod="openshift-monitoring/node-exporter-4x8tg" Jul 21 20:35:47.267873 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:47.267869 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6e7f65a8-9ebc-4df4-9907-c9632cd5f7ac-node-exporter-tls\") pod \"node-exporter-4x8tg\" (UID: \"6e7f65a8-9ebc-4df4-9907-c9632cd5f7ac\") " pod="openshift-monitoring/node-exporter-4x8tg" Jul 21 20:35:47.268221 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:47.267884 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6e7f65a8-9ebc-4df4-9907-c9632cd5f7ac-root\") pod \"node-exporter-4x8tg\" (UID: \"6e7f65a8-9ebc-4df4-9907-c9632cd5f7ac\") " pod="openshift-monitoring/node-exporter-4x8tg" Jul 21 20:35:47.268276 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:47.268220 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6e7f65a8-9ebc-4df4-9907-c9632cd5f7ac-node-exporter-textfile\") pod \"node-exporter-4x8tg\" (UID: \"6e7f65a8-9ebc-4df4-9907-c9632cd5f7ac\") " pod="openshift-monitoring/node-exporter-4x8tg" Jul 21 20:35:47.268757 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:47.268566 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6e7f65a8-9ebc-4df4-9907-c9632cd5f7ac-metrics-client-ca\") pod \"node-exporter-4x8tg\" (UID: \"6e7f65a8-9ebc-4df4-9907-c9632cd5f7ac\") " pod="openshift-monitoring/node-exporter-4x8tg" Jul 21 20:35:47.268757 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:47.268725 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6e7f65a8-9ebc-4df4-9907-c9632cd5f7ac-node-exporter-wtmp\") pod \"node-exporter-4x8tg\" (UID: \"6e7f65a8-9ebc-4df4-9907-c9632cd5f7ac\") " pod="openshift-monitoring/node-exporter-4x8tg" Jul 21 20:35:47.268757 ip-10-0-131-27 kubenswrapper[2560]: E0721 20:35:47.268737 2560 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jul 21 20:35:47.268997 ip-10-0-131-27 kubenswrapper[2560]: E0721 20:35:47.268791 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f695010-55df-4bb3-a59e-a6ba4ae714e7-openshift-state-metrics-tls podName:6f695010-55df-4bb3-a59e-a6ba4ae714e7 nodeName:}" failed. No retries permitted until 2026-07-21 20:35:47.768775649 +0000 UTC m=+40.532012580 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/6f695010-55df-4bb3-a59e-a6ba4ae714e7-openshift-state-metrics-tls") pod "openshift-state-metrics-79f6958cdf-g558f" (UID: "6f695010-55df-4bb3-a59e-a6ba4ae714e7") : secret "openshift-state-metrics-tls" not found Jul 21 20:35:47.268997 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:47.268785 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6e7f65a8-9ebc-4df4-9907-c9632cd5f7ac-node-exporter-accelerators-collector-config\") pod \"node-exporter-4x8tg\" (UID: \"6e7f65a8-9ebc-4df4-9907-c9632cd5f7ac\") " pod="openshift-monitoring/node-exporter-4x8tg" Jul 21 20:35:47.269164 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:47.269105 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6f695010-55df-4bb3-a59e-a6ba4ae714e7-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-g558f\" (UID: \"6f695010-55df-4bb3-a59e-a6ba4ae714e7\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-g558f" Jul 21 20:35:47.270665 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:47.270638 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6e7f65a8-9ebc-4df4-9907-c9632cd5f7ac-node-exporter-tls\") pod \"node-exporter-4x8tg\" (UID: \"6e7f65a8-9ebc-4df4-9907-c9632cd5f7ac\") " pod="openshift-monitoring/node-exporter-4x8tg" Jul 21 20:35:47.270988 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:47.270963 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6e7f65a8-9ebc-4df4-9907-c9632cd5f7ac-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4x8tg\" (UID: \"6e7f65a8-9ebc-4df4-9907-c9632cd5f7ac\") " pod="openshift-monitoring/node-exporter-4x8tg" Jul 21 20:35:47.271628 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:47.271595 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6f695010-55df-4bb3-a59e-a6ba4ae714e7-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-g558f\" (UID: \"6f695010-55df-4bb3-a59e-a6ba4ae714e7\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-g558f" Jul 21 20:35:47.279830 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:47.279765 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dhht8\" (UniqueName: \"kubernetes.io/projected/6e7f65a8-9ebc-4df4-9907-c9632cd5f7ac-kube-api-access-dhht8\") pod \"node-exporter-4x8tg\" (UID: \"6e7f65a8-9ebc-4df4-9907-c9632cd5f7ac\") " pod="openshift-monitoring/node-exporter-4x8tg" Jul 21 20:35:47.280516 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:47.280494 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qbvmp\" (UniqueName: \"kubernetes.io/projected/6f695010-55df-4bb3-a59e-a6ba4ae714e7-kube-api-access-qbvmp\") pod \"openshift-state-metrics-79f6958cdf-g558f\" (UID: \"6f695010-55df-4bb3-a59e-a6ba4ae714e7\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-g558f" Jul 21 20:35:47.403805 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:47.403775 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-4x8tg" Jul 21 20:35:47.671145 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:47.671058 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d0c64150-3a79-4dc2-99fa-a7f04c3e40dc-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-k9lrs\" (UID: \"d0c64150-3a79-4dc2-99fa-a7f04c3e40dc\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-k9lrs" Jul 21 20:35:47.673890 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:47.673848 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d0c64150-3a79-4dc2-99fa-a7f04c3e40dc-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-k9lrs\" (UID: \"d0c64150-3a79-4dc2-99fa-a7f04c3e40dc\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-k9lrs" Jul 21 20:35:47.772448 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:47.772414 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6f695010-55df-4bb3-a59e-a6ba4ae714e7-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-g558f\" (UID: \"6f695010-55df-4bb3-a59e-a6ba4ae714e7\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-g558f" Jul 21 20:35:47.774904 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:47.774879 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6f695010-55df-4bb3-a59e-a6ba4ae714e7-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-g558f\" (UID: \"6f695010-55df-4bb3-a59e-a6ba4ae714e7\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-g558f" Jul 21 20:35:47.973837 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:47.973755 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56c5594674-k9lrs" Jul 21 20:35:47.985927 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:47.985904 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-g558f" Jul 21 20:35:48.117192 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:48.117167 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 21 20:35:48.151786 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:48.151752 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 21 20:35:48.151932 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:48.151920 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 21 20:35:48.155422 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:48.155124 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 21 20:35:48.155422 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:48.155181 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 21 20:35:48.155422 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:48.155205 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-kn8q7\"" Jul 21 20:35:48.155422 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:48.155222 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 21 20:35:48.155422 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:48.155124 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 21 20:35:48.155422 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:48.155223 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 21 20:35:48.155422 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:48.155140 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 21 20:35:48.155422 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:48.155140 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 21 20:35:48.155422 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:48.155353 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 21 20:35:48.155902 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:48.155628 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 21 20:35:48.176539 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:48.175853 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e92af0c2-fee3-4f53-8f7f-660c96621af2-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e92af0c2-fee3-4f53-8f7f-660c96621af2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 20:35:48.176539 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:48.175942 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e92af0c2-fee3-4f53-8f7f-660c96621af2-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e92af0c2-fee3-4f53-8f7f-660c96621af2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 20:35:48.176539 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:48.175975 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e92af0c2-fee3-4f53-8f7f-660c96621af2-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e92af0c2-fee3-4f53-8f7f-660c96621af2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 20:35:48.176539 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:48.176037 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e92af0c2-fee3-4f53-8f7f-660c96621af2-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e92af0c2-fee3-4f53-8f7f-660c96621af2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 20:35:48.176539 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:48.176061 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e92af0c2-fee3-4f53-8f7f-660c96621af2-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e92af0c2-fee3-4f53-8f7f-660c96621af2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 20:35:48.176539 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:48.176083 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e92af0c2-fee3-4f53-8f7f-660c96621af2-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e92af0c2-fee3-4f53-8f7f-660c96621af2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 20:35:48.176539 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:48.176115 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mgknw\" (UniqueName: \"kubernetes.io/projected/e92af0c2-fee3-4f53-8f7f-660c96621af2-kube-api-access-mgknw\") pod \"alertmanager-main-0\" (UID: \"e92af0c2-fee3-4f53-8f7f-660c96621af2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 20:35:48.176539 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:48.176145 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e92af0c2-fee3-4f53-8f7f-660c96621af2-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e92af0c2-fee3-4f53-8f7f-660c96621af2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 20:35:48.176539 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:48.176171 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e92af0c2-fee3-4f53-8f7f-660c96621af2-config-out\") pod \"alertmanager-main-0\" (UID: \"e92af0c2-fee3-4f53-8f7f-660c96621af2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 20:35:48.176539 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:48.176340 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e92af0c2-fee3-4f53-8f7f-660c96621af2-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e92af0c2-fee3-4f53-8f7f-660c96621af2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 20:35:48.176539 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:48.176389 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e92af0c2-fee3-4f53-8f7f-660c96621af2-config-volume\") pod \"alertmanager-main-0\" (UID: \"e92af0c2-fee3-4f53-8f7f-660c96621af2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 20:35:48.176539 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:48.176426 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e92af0c2-fee3-4f53-8f7f-660c96621af2-web-config\") pod \"alertmanager-main-0\" (UID: \"e92af0c2-fee3-4f53-8f7f-660c96621af2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 20:35:48.176539 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:48.176448 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e92af0c2-fee3-4f53-8f7f-660c96621af2-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e92af0c2-fee3-4f53-8f7f-660c96621af2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 20:35:48.277627 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:48.277544 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e92af0c2-fee3-4f53-8f7f-660c96621af2-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e92af0c2-fee3-4f53-8f7f-660c96621af2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 20:35:48.277627 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:48.277598 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e92af0c2-fee3-4f53-8f7f-660c96621af2-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e92af0c2-fee3-4f53-8f7f-660c96621af2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 20:35:48.277852 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:48.277627 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e92af0c2-fee3-4f53-8f7f-660c96621af2-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e92af0c2-fee3-4f53-8f7f-660c96621af2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 20:35:48.277852 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:48.277653 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e92af0c2-fee3-4f53-8f7f-660c96621af2-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e92af0c2-fee3-4f53-8f7f-660c96621af2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 20:35:48.277852 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:48.277708 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mgknw\" (UniqueName: \"kubernetes.io/projected/e92af0c2-fee3-4f53-8f7f-660c96621af2-kube-api-access-mgknw\") pod \"alertmanager-main-0\" (UID: \"e92af0c2-fee3-4f53-8f7f-660c96621af2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 20:35:48.277852 ip-10-0-131-27 kubenswrapper[2560]: E0721 20:35:48.277778 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e92af0c2-fee3-4f53-8f7f-660c96621af2-alertmanager-trusted-ca-bundle podName:e92af0c2-fee3-4f53-8f7f-660c96621af2 nodeName:}" failed. No retries permitted until 2026-07-21 20:35:48.777753868 +0000 UTC m=+41.540990815 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/e92af0c2-fee3-4f53-8f7f-660c96621af2-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "e92af0c2-fee3-4f53-8f7f-660c96621af2") : configmap references non-existent config key: ca-bundle.crt Jul 21 20:35:48.277852 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:48.277803 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e92af0c2-fee3-4f53-8f7f-660c96621af2-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e92af0c2-fee3-4f53-8f7f-660c96621af2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 20:35:48.277852 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:48.277826 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e92af0c2-fee3-4f53-8f7f-660c96621af2-config-out\") pod \"alertmanager-main-0\" (UID: \"e92af0c2-fee3-4f53-8f7f-660c96621af2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 20:35:48.278183 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:48.277872 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e92af0c2-fee3-4f53-8f7f-660c96621af2-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e92af0c2-fee3-4f53-8f7f-660c96621af2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 20:35:48.278183 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:48.277897 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e92af0c2-fee3-4f53-8f7f-660c96621af2-config-volume\") pod \"alertmanager-main-0\" (UID: \"e92af0c2-fee3-4f53-8f7f-660c96621af2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 20:35:48.278183 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:48.277915 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e92af0c2-fee3-4f53-8f7f-660c96621af2-web-config\") pod \"alertmanager-main-0\" (UID: \"e92af0c2-fee3-4f53-8f7f-660c96621af2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 20:35:48.278183 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:48.277935 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e92af0c2-fee3-4f53-8f7f-660c96621af2-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e92af0c2-fee3-4f53-8f7f-660c96621af2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 20:35:48.278183 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:48.277962 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e92af0c2-fee3-4f53-8f7f-660c96621af2-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e92af0c2-fee3-4f53-8f7f-660c96621af2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 20:35:48.278183 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:48.277997 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e92af0c2-fee3-4f53-8f7f-660c96621af2-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e92af0c2-fee3-4f53-8f7f-660c96621af2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 20:35:48.278183 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:48.278026 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e92af0c2-fee3-4f53-8f7f-660c96621af2-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e92af0c2-fee3-4f53-8f7f-660c96621af2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 20:35:48.279302 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:48.278951 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e92af0c2-fee3-4f53-8f7f-660c96621af2-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e92af0c2-fee3-4f53-8f7f-660c96621af2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 20:35:48.282084 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:48.282058 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e92af0c2-fee3-4f53-8f7f-660c96621af2-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e92af0c2-fee3-4f53-8f7f-660c96621af2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 20:35:48.282649 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:48.282231 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e92af0c2-fee3-4f53-8f7f-660c96621af2-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e92af0c2-fee3-4f53-8f7f-660c96621af2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 20:35:48.282649 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:48.282518 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e92af0c2-fee3-4f53-8f7f-660c96621af2-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e92af0c2-fee3-4f53-8f7f-660c96621af2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 20:35:48.282649 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:48.282605 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e92af0c2-fee3-4f53-8f7f-660c96621af2-config-volume\") pod \"alertmanager-main-0\" (UID: \"e92af0c2-fee3-4f53-8f7f-660c96621af2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 20:35:48.283255 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:48.282914 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e92af0c2-fee3-4f53-8f7f-660c96621af2-config-out\") pod \"alertmanager-main-0\" (UID: \"e92af0c2-fee3-4f53-8f7f-660c96621af2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 20:35:48.283255 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:48.283038 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e92af0c2-fee3-4f53-8f7f-660c96621af2-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e92af0c2-fee3-4f53-8f7f-660c96621af2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 20:35:48.283255 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:48.283218 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e92af0c2-fee3-4f53-8f7f-660c96621af2-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e92af0c2-fee3-4f53-8f7f-660c96621af2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 20:35:48.283572 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:48.283537 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e92af0c2-fee3-4f53-8f7f-660c96621af2-web-config\") pod \"alertmanager-main-0\" (UID: \"e92af0c2-fee3-4f53-8f7f-660c96621af2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 20:35:48.283953 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:48.283931 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e92af0c2-fee3-4f53-8f7f-660c96621af2-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e92af0c2-fee3-4f53-8f7f-660c96621af2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 20:35:48.293442 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:48.292803 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mgknw\" (UniqueName: \"kubernetes.io/projected/e92af0c2-fee3-4f53-8f7f-660c96621af2-kube-api-access-mgknw\") pod \"alertmanager-main-0\" (UID: \"e92af0c2-fee3-4f53-8f7f-660c96621af2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 20:35:48.782656 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:48.782616 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e92af0c2-fee3-4f53-8f7f-660c96621af2-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e92af0c2-fee3-4f53-8f7f-660c96621af2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 20:35:48.783400 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:48.783378 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e92af0c2-fee3-4f53-8f7f-660c96621af2-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e92af0c2-fee3-4f53-8f7f-660c96621af2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 20:35:49.034397 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:49.034322 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-6664b8bc76-4h8r2"] Jul 21 20:35:49.062653 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:49.062626 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 21 20:35:49.063600 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:49.063578 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6664b8bc76-4h8r2"] Jul 21 20:35:49.063721 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:49.063690 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6664b8bc76-4h8r2" Jul 21 20:35:49.067218 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:49.067049 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 21 20:35:49.067218 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:49.067085 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-f3e7gidpc6p1b\"" Jul 21 20:35:49.067218 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:49.067104 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 21 20:35:49.067218 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:49.067114 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 21 20:35:49.067481 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:49.067395 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 21 20:35:49.067481 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:49.067399 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-sv6px\"" Jul 21 20:35:49.067481 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:49.067452 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 21 20:35:49.084796 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:49.084769 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7a6dd5c2-848b-45ba-99d7-e9975ea40a7d-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6664b8bc76-4h8r2\" (UID: \"7a6dd5c2-848b-45ba-99d7-e9975ea40a7d\") " pod="openshift-monitoring/thanos-querier-6664b8bc76-4h8r2" Jul 21 20:35:49.084927 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:49.084808 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/7a6dd5c2-848b-45ba-99d7-e9975ea40a7d-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6664b8bc76-4h8r2\" (UID: \"7a6dd5c2-848b-45ba-99d7-e9975ea40a7d\") " pod="openshift-monitoring/thanos-querier-6664b8bc76-4h8r2" Jul 21 20:35:49.084927 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:49.084870 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-76zn8\" (UniqueName: \"kubernetes.io/projected/7a6dd5c2-848b-45ba-99d7-e9975ea40a7d-kube-api-access-76zn8\") pod \"thanos-querier-6664b8bc76-4h8r2\" (UID: \"7a6dd5c2-848b-45ba-99d7-e9975ea40a7d\") " pod="openshift-monitoring/thanos-querier-6664b8bc76-4h8r2" Jul 21 20:35:49.084927 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:49.084900 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7a6dd5c2-848b-45ba-99d7-e9975ea40a7d-metrics-client-ca\") pod \"thanos-querier-6664b8bc76-4h8r2\" (UID: \"7a6dd5c2-848b-45ba-99d7-e9975ea40a7d\") " pod="openshift-monitoring/thanos-querier-6664b8bc76-4h8r2" Jul 21 20:35:49.084927 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:49.084923 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7a6dd5c2-848b-45ba-99d7-e9975ea40a7d-secret-grpc-tls\") pod \"thanos-querier-6664b8bc76-4h8r2\" (UID: \"7a6dd5c2-848b-45ba-99d7-e9975ea40a7d\") " pod="openshift-monitoring/thanos-querier-6664b8bc76-4h8r2" Jul 21 20:35:49.085160 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:49.084960 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/7a6dd5c2-848b-45ba-99d7-e9975ea40a7d-secret-thanos-querier-tls\") pod \"thanos-querier-6664b8bc76-4h8r2\" (UID: \"7a6dd5c2-848b-45ba-99d7-e9975ea40a7d\") " pod="openshift-monitoring/thanos-querier-6664b8bc76-4h8r2" Jul 21 20:35:49.085160 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:49.084975 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/7a6dd5c2-848b-45ba-99d7-e9975ea40a7d-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6664b8bc76-4h8r2\" (UID: \"7a6dd5c2-848b-45ba-99d7-e9975ea40a7d\") " pod="openshift-monitoring/thanos-querier-6664b8bc76-4h8r2" Jul 21 20:35:49.085160 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:49.084994 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7a6dd5c2-848b-45ba-99d7-e9975ea40a7d-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6664b8bc76-4h8r2\" (UID: \"7a6dd5c2-848b-45ba-99d7-e9975ea40a7d\") " pod="openshift-monitoring/thanos-querier-6664b8bc76-4h8r2" Jul 21 20:35:49.185678 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:49.185639 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-76zn8\" (UniqueName: \"kubernetes.io/projected/7a6dd5c2-848b-45ba-99d7-e9975ea40a7d-kube-api-access-76zn8\") pod \"thanos-querier-6664b8bc76-4h8r2\" (UID: \"7a6dd5c2-848b-45ba-99d7-e9975ea40a7d\") " pod="openshift-monitoring/thanos-querier-6664b8bc76-4h8r2" Jul 21 20:35:49.186153 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:49.185725 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7a6dd5c2-848b-45ba-99d7-e9975ea40a7d-metrics-client-ca\") pod \"thanos-querier-6664b8bc76-4h8r2\" (UID: \"7a6dd5c2-848b-45ba-99d7-e9975ea40a7d\") " pod="openshift-monitoring/thanos-querier-6664b8bc76-4h8r2" Jul 21 20:35:49.186153 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:49.185770 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7a6dd5c2-848b-45ba-99d7-e9975ea40a7d-secret-grpc-tls\") pod \"thanos-querier-6664b8bc76-4h8r2\" (UID: \"7a6dd5c2-848b-45ba-99d7-e9975ea40a7d\") " pod="openshift-monitoring/thanos-querier-6664b8bc76-4h8r2" Jul 21 20:35:49.186153 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:49.185817 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/7a6dd5c2-848b-45ba-99d7-e9975ea40a7d-secret-thanos-querier-tls\") pod \"thanos-querier-6664b8bc76-4h8r2\" (UID: \"7a6dd5c2-848b-45ba-99d7-e9975ea40a7d\") " pod="openshift-monitoring/thanos-querier-6664b8bc76-4h8r2" Jul 21 20:35:49.186153 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:49.185852 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/7a6dd5c2-848b-45ba-99d7-e9975ea40a7d-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6664b8bc76-4h8r2\" (UID: \"7a6dd5c2-848b-45ba-99d7-e9975ea40a7d\") " pod="openshift-monitoring/thanos-querier-6664b8bc76-4h8r2" Jul 21 20:35:49.186153 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:49.185901 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7a6dd5c2-848b-45ba-99d7-e9975ea40a7d-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6664b8bc76-4h8r2\" (UID: \"7a6dd5c2-848b-45ba-99d7-e9975ea40a7d\") " pod="openshift-monitoring/thanos-querier-6664b8bc76-4h8r2" Jul 21 20:35:49.186153 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:49.185948 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7a6dd5c2-848b-45ba-99d7-e9975ea40a7d-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6664b8bc76-4h8r2\" (UID: \"7a6dd5c2-848b-45ba-99d7-e9975ea40a7d\") " pod="openshift-monitoring/thanos-querier-6664b8bc76-4h8r2" Jul 21 20:35:49.186153 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:49.185994 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/7a6dd5c2-848b-45ba-99d7-e9975ea40a7d-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6664b8bc76-4h8r2\" (UID: \"7a6dd5c2-848b-45ba-99d7-e9975ea40a7d\") " pod="openshift-monitoring/thanos-querier-6664b8bc76-4h8r2" Jul 21 20:35:49.186613 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:49.186585 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7a6dd5c2-848b-45ba-99d7-e9975ea40a7d-metrics-client-ca\") pod \"thanos-querier-6664b8bc76-4h8r2\" (UID: \"7a6dd5c2-848b-45ba-99d7-e9975ea40a7d\") " pod="openshift-monitoring/thanos-querier-6664b8bc76-4h8r2" Jul 21 20:35:49.188905 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:49.188879 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7a6dd5c2-848b-45ba-99d7-e9975ea40a7d-secret-grpc-tls\") pod \"thanos-querier-6664b8bc76-4h8r2\" (UID: \"7a6dd5c2-848b-45ba-99d7-e9975ea40a7d\") " pod="openshift-monitoring/thanos-querier-6664b8bc76-4h8r2" Jul 21 20:35:49.189092 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:49.188933 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7a6dd5c2-848b-45ba-99d7-e9975ea40a7d-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6664b8bc76-4h8r2\" (UID: \"7a6dd5c2-848b-45ba-99d7-e9975ea40a7d\") " pod="openshift-monitoring/thanos-querier-6664b8bc76-4h8r2" Jul 21 20:35:49.189570 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:49.189362 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/7a6dd5c2-848b-45ba-99d7-e9975ea40a7d-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6664b8bc76-4h8r2\" (UID: \"7a6dd5c2-848b-45ba-99d7-e9975ea40a7d\") " pod="openshift-monitoring/thanos-querier-6664b8bc76-4h8r2" Jul 21 20:35:49.189570 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:49.189405 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/7a6dd5c2-848b-45ba-99d7-e9975ea40a7d-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6664b8bc76-4h8r2\" (UID: \"7a6dd5c2-848b-45ba-99d7-e9975ea40a7d\") " pod="openshift-monitoring/thanos-querier-6664b8bc76-4h8r2" Jul 21 20:35:49.189570 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:49.189493 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7a6dd5c2-848b-45ba-99d7-e9975ea40a7d-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6664b8bc76-4h8r2\" (UID: \"7a6dd5c2-848b-45ba-99d7-e9975ea40a7d\") " pod="openshift-monitoring/thanos-querier-6664b8bc76-4h8r2" Jul 21 20:35:49.189758 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:49.189683 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/7a6dd5c2-848b-45ba-99d7-e9975ea40a7d-secret-thanos-querier-tls\") pod \"thanos-querier-6664b8bc76-4h8r2\" (UID: \"7a6dd5c2-848b-45ba-99d7-e9975ea40a7d\") " pod="openshift-monitoring/thanos-querier-6664b8bc76-4h8r2" Jul 21 20:35:49.197435 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:49.197415 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-76zn8\" (UniqueName: \"kubernetes.io/projected/7a6dd5c2-848b-45ba-99d7-e9975ea40a7d-kube-api-access-76zn8\") pod \"thanos-querier-6664b8bc76-4h8r2\" (UID: \"7a6dd5c2-848b-45ba-99d7-e9975ea40a7d\") " pod="openshift-monitoring/thanos-querier-6664b8bc76-4h8r2" Jul 21 20:35:49.375840 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:49.375767 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6664b8bc76-4h8r2" Jul 21 20:35:51.372311 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:51.372230 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e7f65a8_9ebc_4df4_9907_c9632cd5f7ac.slice/crio-e309712d240f332ef0fc70328a88f56d52de45ec413d58656439bdba2d2d6ad9 WatchSource:0}: Error finding container e309712d240f332ef0fc70328a88f56d52de45ec413d58656439bdba2d2d6ad9: Status 404 returned error can't find the container with id e309712d240f332ef0fc70328a88f56d52de45ec413d58656439bdba2d2d6ad9 Jul 21 20:35:51.548483 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:51.548201 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 21 20:35:51.548756 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:51.548705 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode92af0c2_fee3_4f53_8f7f_660c96621af2.slice/crio-43a8c984884304ba7f23d88c0b0e66e2af13129303d9f2582c46d5784336dcd5 WatchSource:0}: Error finding container 43a8c984884304ba7f23d88c0b0e66e2af13129303d9f2582c46d5784336dcd5: Status 404 returned error can't find the container with id 43a8c984884304ba7f23d88c0b0e66e2af13129303d9f2582c46d5784336dcd5 Jul 21 20:35:51.554471 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:51.554118 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-g558f"] Jul 21 20:35:51.556491 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:51.556446 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f695010_55df_4bb3_a59e_a6ba4ae714e7.slice/crio-761e71b7109b9d19e3c5a12fd7c28ca2b1a7a115a8c16170416db8fea4957791 WatchSource:0}: Error finding container 761e71b7109b9d19e3c5a12fd7c28ca2b1a7a115a8c16170416db8fea4957791: Status 404 returned error can't find the container with id 761e71b7109b9d19e3c5a12fd7c28ca2b1a7a115a8c16170416db8fea4957791 Jul 21 20:35:51.783069 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:51.782789 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-k9lrs"] Jul 21 20:35:51.788234 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:51.788205 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0c64150_3a79_4dc2_99fa_a7f04c3e40dc.slice/crio-2b33266ce2b94c9aba719cc836474c68e0255e09b1419897c7cfbf69d0ba6653 WatchSource:0}: Error finding container 2b33266ce2b94c9aba719cc836474c68e0255e09b1419897c7cfbf69d0ba6653: Status 404 returned error can't find the container with id 2b33266ce2b94c9aba719cc836474c68e0255e09b1419897c7cfbf69d0ba6653 Jul 21 20:35:51.794405 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:51.794381 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6664b8bc76-4h8r2"] Jul 21 20:35:51.797070 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:51.797046 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a6dd5c2_848b_45ba_99d7_e9975ea40a7d.slice/crio-d8cf4fd0e4fd67b35abe2e52ea1a0f34f982cd187cc530677b03068d96ec69a2 WatchSource:0}: Error finding container d8cf4fd0e4fd67b35abe2e52ea1a0f34f982cd187cc530677b03068d96ec69a2: Status 404 returned error can't find the container with id d8cf4fd0e4fd67b35abe2e52ea1a0f34f982cd187cc530677b03068d96ec69a2 Jul 21 20:35:51.838396 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:51.838369 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-65vlc"] Jul 21 20:35:51.854816 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:51.854795 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-65vlc"] Jul 21 20:35:51.854938 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:51.854885 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-65vlc" Jul 21 20:35:51.857946 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:51.857925 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-v6gv5\"" Jul 21 20:35:51.857946 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:51.857945 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 21 20:35:51.913297 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:51.913240 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gxzxw\" (UniqueName: \"kubernetes.io/projected/3ef3673d-2e1b-4d29-883c-a28a55c8e939-kube-api-access-gxzxw\") pod \"monitoring-plugin-7b7b7bc8bf-65vlc\" (UID: \"3ef3673d-2e1b-4d29-883c-a28a55c8e939\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-65vlc" Jul 21 20:35:51.913415 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:51.913303 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3ef3673d-2e1b-4d29-883c-a28a55c8e939-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-65vlc\" (UID: \"3ef3673d-2e1b-4d29-883c-a28a55c8e939\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-65vlc" Jul 21 20:35:52.014840 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:52.014805 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gxzxw\" (UniqueName: \"kubernetes.io/projected/3ef3673d-2e1b-4d29-883c-a28a55c8e939-kube-api-access-gxzxw\") pod \"monitoring-plugin-7b7b7bc8bf-65vlc\" (UID: \"3ef3673d-2e1b-4d29-883c-a28a55c8e939\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-65vlc" Jul 21 20:35:52.014999 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:52.014864 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3ef3673d-2e1b-4d29-883c-a28a55c8e939-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-65vlc\" (UID: \"3ef3673d-2e1b-4d29-883c-a28a55c8e939\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-65vlc" Jul 21 20:35:52.015081 ip-10-0-131-27 kubenswrapper[2560]: E0721 20:35:52.015062 2560 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jul 21 20:35:52.015137 ip-10-0-131-27 kubenswrapper[2560]: E0721 20:35:52.015126 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ef3673d-2e1b-4d29-883c-a28a55c8e939-monitoring-plugin-cert podName:3ef3673d-2e1b-4d29-883c-a28a55c8e939 nodeName:}" failed. No retries permitted until 2026-07-21 20:35:52.515110484 +0000 UTC m=+45.278347427 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/3ef3673d-2e1b-4d29-883c-a28a55c8e939-monitoring-plugin-cert") pod "monitoring-plugin-7b7b7bc8bf-65vlc" (UID: "3ef3673d-2e1b-4d29-883c-a28a55c8e939") : secret "monitoring-plugin-cert" not found Jul 21 20:35:52.026283 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:52.026244 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gxzxw\" (UniqueName: \"kubernetes.io/projected/3ef3673d-2e1b-4d29-883c-a28a55c8e939-kube-api-access-gxzxw\") pod \"monitoring-plugin-7b7b7bc8bf-65vlc\" (UID: \"3ef3673d-2e1b-4d29-883c-a28a55c8e939\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-65vlc" Jul 21 20:35:52.064514 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:52.064462 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-f6lvh" event={"ID":"833f477b-d8ec-4245-82e2-5e2c5dce8dc1","Type":"ContainerStarted","Data":"900de4b1e912a9881a32e734a2744f3e2f44799d611012b6868a4db2691ecf30"} Jul 21 20:35:52.065842 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:52.065812 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4x8tg" event={"ID":"6e7f65a8-9ebc-4df4-9907-c9632cd5f7ac","Type":"ContainerStarted","Data":"e309712d240f332ef0fc70328a88f56d52de45ec413d58656439bdba2d2d6ad9"} Jul 21 20:35:52.067137 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:52.067110 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6664b8bc76-4h8r2" event={"ID":"7a6dd5c2-848b-45ba-99d7-e9975ea40a7d","Type":"ContainerStarted","Data":"d8cf4fd0e4fd67b35abe2e52ea1a0f34f982cd187cc530677b03068d96ec69a2"} Jul 21 20:35:52.068524 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:52.068502 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-k9lrs" event={"ID":"d0c64150-3a79-4dc2-99fa-a7f04c3e40dc","Type":"ContainerStarted","Data":"2b33266ce2b94c9aba719cc836474c68e0255e09b1419897c7cfbf69d0ba6653"} Jul 21 20:35:52.070105 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:52.070076 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-km5t4" event={"ID":"eb3b766c-4d7d-40f5-ad7d-38b19e505a36","Type":"ContainerStarted","Data":"39aa683165084a5e9ad118448ed8a347d84ca34ede2b92b8c51441467b02eb0b"} Jul 21 20:35:52.071330 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:52.071309 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e92af0c2-fee3-4f53-8f7f-660c96621af2","Type":"ContainerStarted","Data":"43a8c984884304ba7f23d88c0b0e66e2af13129303d9f2582c46d5784336dcd5"} Jul 21 20:35:52.073321 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:52.073294 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9rz9d" event={"ID":"e1f1c9b1-9cf8-4962-804e-d5b905c2d4f4","Type":"ContainerStarted","Data":"c32605c11dac6fcfcbb2f52627def91ef8320e9e4d8d128e04253ebb3b3ad035"} Jul 21 20:35:52.073418 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:52.073348 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9rz9d" event={"ID":"e1f1c9b1-9cf8-4962-804e-d5b905c2d4f4","Type":"ContainerStarted","Data":"39d83da8f460611bf853f135bd8294972eb037cea85ffaf9cedf37c3a1540a33"} Jul 21 20:35:52.073418 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:52.073383 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-9rz9d" Jul 21 20:35:52.075457 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:52.075436 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-g558f" event={"ID":"6f695010-55df-4bb3-a59e-a6ba4ae714e7","Type":"ContainerStarted","Data":"e74542d764f39f7c95b3f4adbd03be8abdbd2b2f057316fff7fcdbfbb11ccd3c"} Jul 21 20:35:52.075562 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:52.075488 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-g558f" event={"ID":"6f695010-55df-4bb3-a59e-a6ba4ae714e7","Type":"ContainerStarted","Data":"aa586ed54758b62abe4c7e33e3f4e53749265c8698624b5bb3014ea15dbc6a87"} Jul 21 20:35:52.075562 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:52.075517 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-g558f" event={"ID":"6f695010-55df-4bb3-a59e-a6ba4ae714e7","Type":"ContainerStarted","Data":"761e71b7109b9d19e3c5a12fd7c28ca2b1a7a115a8c16170416db8fea4957791"} Jul 21 20:35:52.081722 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:52.081680 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-f6lvh" podStartSLOduration=1.3191886290000001 podStartE2EDuration="8.081664565s" totalImagesPullingTime="6.762475936s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 20:35:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:35:52.080757283 +0000 UTC m=+44.843994228" watchObservedRunningTime="2026-07-21 20:35:52.081664565 +0000 UTC m=+44.844901485" Jul 21 20:35:52.098522 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:52.098468 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-9rz9d" podStartSLOduration=1.740754371 podStartE2EDuration="8.098450721s" totalImagesPullingTime="6.35769635s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 20:35:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:35:52.0978133 +0000 UTC m=+44.861050242" watchObservedRunningTime="2026-07-21 20:35:52.098450721 +0000 UTC m=+44.861687664" Jul 21 20:35:52.520361 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:52.520327 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3ef3673d-2e1b-4d29-883c-a28a55c8e939-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-65vlc\" (UID: \"3ef3673d-2e1b-4d29-883c-a28a55c8e939\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-65vlc" Jul 21 20:35:52.522756 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:52.522733 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3ef3673d-2e1b-4d29-883c-a28a55c8e939-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-65vlc\" (UID: \"3ef3673d-2e1b-4d29-883c-a28a55c8e939\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-65vlc" Jul 21 20:35:52.764532 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:52.764452 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-65vlc" Jul 21 20:35:53.085559 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:53.085514 2560 generic.go:356] "Generic (PLEG): container finished" podID="6e7f65a8-9ebc-4df4-9907-c9632cd5f7ac" containerID="27029b5a994fa0f6619a878e939e7c0678cf1bdbc16fd51718adf018ad30288b" exitCode=0 Jul 21 20:35:53.085720 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:53.085699 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4x8tg" event={"ID":"6e7f65a8-9ebc-4df4-9907-c9632cd5f7ac","Type":"ContainerDied","Data":"27029b5a994fa0f6619a878e939e7c0678cf1bdbc16fd51718adf018ad30288b"} Jul 21 20:35:53.103814 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:53.103244 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-78684995d9-99lmx"] Jul 21 20:35:53.114364 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:53.114316 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78684995d9-99lmx" Jul 21 20:35:53.122441 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:53.120721 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 21 20:35:53.122441 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:53.120977 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 21 20:35:53.122441 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:53.121047 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-xwb5k\"" Jul 21 20:35:53.122441 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:53.121291 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 21 20:35:53.122441 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:53.121322 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 21 20:35:53.122441 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:53.121542 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 21 20:35:53.122441 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:53.121623 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 21 20:35:53.122441 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:53.121545 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 21 20:35:53.126587 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:53.125613 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-78684995d9-99lmx"] Jul 21 20:35:53.126785 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:53.126762 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zcxvf\" (UniqueName: \"kubernetes.io/projected/95b6ae55-056b-4516-af84-c4ee98742e1a-kube-api-access-zcxvf\") pod \"console-78684995d9-99lmx\" (UID: \"95b6ae55-056b-4516-af84-c4ee98742e1a\") " pod="openshift-console/console-78684995d9-99lmx" Jul 21 20:35:53.126872 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:53.126855 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/95b6ae55-056b-4516-af84-c4ee98742e1a-service-ca\") pod \"console-78684995d9-99lmx\" (UID: \"95b6ae55-056b-4516-af84-c4ee98742e1a\") " pod="openshift-console/console-78684995d9-99lmx" Jul 21 20:35:53.126939 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:53.126919 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/95b6ae55-056b-4516-af84-c4ee98742e1a-console-oauth-config\") pod \"console-78684995d9-99lmx\" (UID: \"95b6ae55-056b-4516-af84-c4ee98742e1a\") " pod="openshift-console/console-78684995d9-99lmx" Jul 21 20:35:53.127035 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:53.126999 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/95b6ae55-056b-4516-af84-c4ee98742e1a-console-config\") pod \"console-78684995d9-99lmx\" (UID: \"95b6ae55-056b-4516-af84-c4ee98742e1a\") " pod="openshift-console/console-78684995d9-99lmx" Jul 21 20:35:53.127150 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:53.127130 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/95b6ae55-056b-4516-af84-c4ee98742e1a-console-serving-cert\") pod \"console-78684995d9-99lmx\" (UID: \"95b6ae55-056b-4516-af84-c4ee98742e1a\") " pod="openshift-console/console-78684995d9-99lmx" Jul 21 20:35:53.127217 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:53.127180 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/95b6ae55-056b-4516-af84-c4ee98742e1a-oauth-serving-cert\") pod \"console-78684995d9-99lmx\" (UID: \"95b6ae55-056b-4516-af84-c4ee98742e1a\") " pod="openshift-console/console-78684995d9-99lmx" Jul 21 20:35:53.216319 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:53.216283 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-65vlc"] Jul 21 20:35:53.227638 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:53.227599 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/95b6ae55-056b-4516-af84-c4ee98742e1a-console-serving-cert\") pod \"console-78684995d9-99lmx\" (UID: \"95b6ae55-056b-4516-af84-c4ee98742e1a\") " pod="openshift-console/console-78684995d9-99lmx" Jul 21 20:35:53.227755 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:53.227661 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/95b6ae55-056b-4516-af84-c4ee98742e1a-oauth-serving-cert\") pod \"console-78684995d9-99lmx\" (UID: \"95b6ae55-056b-4516-af84-c4ee98742e1a\") " pod="openshift-console/console-78684995d9-99lmx" Jul 21 20:35:53.227755 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:53.227719 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zcxvf\" (UniqueName: \"kubernetes.io/projected/95b6ae55-056b-4516-af84-c4ee98742e1a-kube-api-access-zcxvf\") pod \"console-78684995d9-99lmx\" (UID: \"95b6ae55-056b-4516-af84-c4ee98742e1a\") " pod="openshift-console/console-78684995d9-99lmx" Jul 21 20:35:53.227906 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:53.227865 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/95b6ae55-056b-4516-af84-c4ee98742e1a-service-ca\") pod \"console-78684995d9-99lmx\" (UID: \"95b6ae55-056b-4516-af84-c4ee98742e1a\") " pod="openshift-console/console-78684995d9-99lmx" Jul 21 20:35:53.227976 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:53.227927 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/95b6ae55-056b-4516-af84-c4ee98742e1a-console-oauth-config\") pod \"console-78684995d9-99lmx\" (UID: \"95b6ae55-056b-4516-af84-c4ee98742e1a\") " pod="openshift-console/console-78684995d9-99lmx" Jul 21 20:35:53.227976 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:53.227970 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/95b6ae55-056b-4516-af84-c4ee98742e1a-console-config\") pod \"console-78684995d9-99lmx\" (UID: \"95b6ae55-056b-4516-af84-c4ee98742e1a\") " pod="openshift-console/console-78684995d9-99lmx" Jul 21 20:35:53.228520 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:53.228492 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/95b6ae55-056b-4516-af84-c4ee98742e1a-oauth-serving-cert\") pod \"console-78684995d9-99lmx\" (UID: \"95b6ae55-056b-4516-af84-c4ee98742e1a\") " pod="openshift-console/console-78684995d9-99lmx" Jul 21 20:35:53.228747 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:53.228646 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/95b6ae55-056b-4516-af84-c4ee98742e1a-console-config\") pod \"console-78684995d9-99lmx\" (UID: \"95b6ae55-056b-4516-af84-c4ee98742e1a\") " pod="openshift-console/console-78684995d9-99lmx" Jul 21 20:35:53.228847 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:53.228764 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/95b6ae55-056b-4516-af84-c4ee98742e1a-service-ca\") pod \"console-78684995d9-99lmx\" (UID: \"95b6ae55-056b-4516-af84-c4ee98742e1a\") " pod="openshift-console/console-78684995d9-99lmx" Jul 21 20:35:53.233053 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:53.230698 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 21 20:35:53.233053 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:53.232985 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/95b6ae55-056b-4516-af84-c4ee98742e1a-console-oauth-config\") pod \"console-78684995d9-99lmx\" (UID: \"95b6ae55-056b-4516-af84-c4ee98742e1a\") " pod="openshift-console/console-78684995d9-99lmx" Jul 21 20:35:53.233435 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:53.233412 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/95b6ae55-056b-4516-af84-c4ee98742e1a-console-serving-cert\") pod \"console-78684995d9-99lmx\" (UID: \"95b6ae55-056b-4516-af84-c4ee98742e1a\") " pod="openshift-console/console-78684995d9-99lmx" Jul 21 20:35:53.234642 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:53.234622 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 21 20:35:53.238242 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:53.237450 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 21 20:35:53.238242 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:53.237709 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 21 20:35:53.238242 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:53.238099 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 21 20:35:53.238612 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:53.238586 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-xl7sh\"" Jul 21 20:35:53.240035 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:53.238806 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 21 20:35:53.240035 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:53.238871 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 21 20:35:53.240035 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:53.238985 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 21 20:35:53.240035 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:53.239066 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 21 20:35:53.240035 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:53.239097 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zcxvf\" (UniqueName: \"kubernetes.io/projected/95b6ae55-056b-4516-af84-c4ee98742e1a-kube-api-access-zcxvf\") pod \"console-78684995d9-99lmx\" (UID: \"95b6ae55-056b-4516-af84-c4ee98742e1a\") " pod="openshift-console/console-78684995d9-99lmx" Jul 21 20:35:53.240035 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:53.239346 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-95ppdfu4sqtp1\"" Jul 21 20:35:53.240035 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:53.239399 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 21 20:35:53.240035 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:53.239349 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 21 20:35:53.240035 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:53.239572 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 21 20:35:53.240035 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:53.239594 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 21 20:35:53.240035 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:53.239724 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 21 20:35:53.240035 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:53.239960 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 21 20:35:53.240699 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:53.240353 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 21 20:35:53.241585 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:53.241379 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 21 20:35:53.254165 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:53.254134 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 21 20:35:53.329420 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:53.329332 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/40cc806e-9f77-4bc3-9dd6-2cd360a1bac6-config-out\") pod \"prometheus-k8s-0\" (UID: \"40cc806e-9f77-4bc3-9dd6-2cd360a1bac6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 20:35:53.329420 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:53.329380 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/40cc806e-9f77-4bc3-9dd6-2cd360a1bac6-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"40cc806e-9f77-4bc3-9dd6-2cd360a1bac6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 20:35:53.329420 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:53.329410 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/40cc806e-9f77-4bc3-9dd6-2cd360a1bac6-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"40cc806e-9f77-4bc3-9dd6-2cd360a1bac6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 20:35:53.329672 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:53.329446 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/40cc806e-9f77-4bc3-9dd6-2cd360a1bac6-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"40cc806e-9f77-4bc3-9dd6-2cd360a1bac6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 20:35:53.329672 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:53.329470 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/40cc806e-9f77-4bc3-9dd6-2cd360a1bac6-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"40cc806e-9f77-4bc3-9dd6-2cd360a1bac6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 20:35:53.329672 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:53.329493 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x4p6n\" (UniqueName: \"kubernetes.io/projected/40cc806e-9f77-4bc3-9dd6-2cd360a1bac6-kube-api-access-x4p6n\") pod \"prometheus-k8s-0\" (UID: \"40cc806e-9f77-4bc3-9dd6-2cd360a1bac6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 20:35:53.329672 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:53.329545 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/40cc806e-9f77-4bc3-9dd6-2cd360a1bac6-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"40cc806e-9f77-4bc3-9dd6-2cd360a1bac6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 20:35:53.329672 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:53.329568 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/40cc806e-9f77-4bc3-9dd6-2cd360a1bac6-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"40cc806e-9f77-4bc3-9dd6-2cd360a1bac6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 20:35:53.329672 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:53.329595 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/40cc806e-9f77-4bc3-9dd6-2cd360a1bac6-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"40cc806e-9f77-4bc3-9dd6-2cd360a1bac6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 20:35:53.329672 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:53.329627 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/40cc806e-9f77-4bc3-9dd6-2cd360a1bac6-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"40cc806e-9f77-4bc3-9dd6-2cd360a1bac6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 20:35:53.329672 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:53.329654 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/40cc806e-9f77-4bc3-9dd6-2cd360a1bac6-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"40cc806e-9f77-4bc3-9dd6-2cd360a1bac6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 20:35:53.330083 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:53.329740 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/40cc806e-9f77-4bc3-9dd6-2cd360a1bac6-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"40cc806e-9f77-4bc3-9dd6-2cd360a1bac6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 20:35:53.330083 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:53.329780 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/40cc806e-9f77-4bc3-9dd6-2cd360a1bac6-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"40cc806e-9f77-4bc3-9dd6-2cd360a1bac6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 20:35:53.330083 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:53.329803 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/40cc806e-9f77-4bc3-9dd6-2cd360a1bac6-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"40cc806e-9f77-4bc3-9dd6-2cd360a1bac6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 20:35:53.330083 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:53.329830 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/40cc806e-9f77-4bc3-9dd6-2cd360a1bac6-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"40cc806e-9f77-4bc3-9dd6-2cd360a1bac6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 20:35:53.330083 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:53.329852 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/40cc806e-9f77-4bc3-9dd6-2cd360a1bac6-web-config\") pod \"prometheus-k8s-0\" (UID: \"40cc806e-9f77-4bc3-9dd6-2cd360a1bac6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 20:35:53.330083 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:53.329889 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/40cc806e-9f77-4bc3-9dd6-2cd360a1bac6-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"40cc806e-9f77-4bc3-9dd6-2cd360a1bac6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 20:35:53.330083 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:53.329912 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/40cc806e-9f77-4bc3-9dd6-2cd360a1bac6-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"40cc806e-9f77-4bc3-9dd6-2cd360a1bac6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 20:35:53.330083 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:53.329961 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/40cc806e-9f77-4bc3-9dd6-2cd360a1bac6-config\") pod \"prometheus-k8s-0\" (UID: \"40cc806e-9f77-4bc3-9dd6-2cd360a1bac6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 20:35:53.330083 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:53.329986 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/40cc806e-9f77-4bc3-9dd6-2cd360a1bac6-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"40cc806e-9f77-4bc3-9dd6-2cd360a1bac6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 20:35:53.431217 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:53.431180 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/40cc806e-9f77-4bc3-9dd6-2cd360a1bac6-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"40cc806e-9f77-4bc3-9dd6-2cd360a1bac6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 20:35:53.431392 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:53.431227 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/40cc806e-9f77-4bc3-9dd6-2cd360a1bac6-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"40cc806e-9f77-4bc3-9dd6-2cd360a1bac6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 20:35:53.431392 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:53.431257 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x4p6n\" (UniqueName: \"kubernetes.io/projected/40cc806e-9f77-4bc3-9dd6-2cd360a1bac6-kube-api-access-x4p6n\") pod \"prometheus-k8s-0\" (UID: \"40cc806e-9f77-4bc3-9dd6-2cd360a1bac6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 20:35:53.431392 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:53.431308 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/40cc806e-9f77-4bc3-9dd6-2cd360a1bac6-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"40cc806e-9f77-4bc3-9dd6-2cd360a1bac6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 20:35:53.431392 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:53.431330 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/40cc806e-9f77-4bc3-9dd6-2cd360a1bac6-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"40cc806e-9f77-4bc3-9dd6-2cd360a1bac6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 20:35:53.431392 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:53.431357 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/40cc806e-9f77-4bc3-9dd6-2cd360a1bac6-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"40cc806e-9f77-4bc3-9dd6-2cd360a1bac6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 20:35:53.431392 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:53.431385 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/40cc806e-9f77-4bc3-9dd6-2cd360a1bac6-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"40cc806e-9f77-4bc3-9dd6-2cd360a1bac6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 20:35:53.431694 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:53.431415 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/40cc806e-9f77-4bc3-9dd6-2cd360a1bac6-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"40cc806e-9f77-4bc3-9dd6-2cd360a1bac6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 20:35:53.431694 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:53.431490 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/40cc806e-9f77-4bc3-9dd6-2cd360a1bac6-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"40cc806e-9f77-4bc3-9dd6-2cd360a1bac6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 20:35:53.431694 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:53.431527 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/40cc806e-9f77-4bc3-9dd6-2cd360a1bac6-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"40cc806e-9f77-4bc3-9dd6-2cd360a1bac6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 20:35:53.431694 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:53.431549 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/40cc806e-9f77-4bc3-9dd6-2cd360a1bac6-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"40cc806e-9f77-4bc3-9dd6-2cd360a1bac6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 20:35:53.431694 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:53.431577 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/40cc806e-9f77-4bc3-9dd6-2cd360a1bac6-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"40cc806e-9f77-4bc3-9dd6-2cd360a1bac6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 20:35:53.431694 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:53.431598 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/40cc806e-9f77-4bc3-9dd6-2cd360a1bac6-web-config\") pod \"prometheus-k8s-0\" (UID: \"40cc806e-9f77-4bc3-9dd6-2cd360a1bac6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 20:35:53.431694 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:53.431630 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/40cc806e-9f77-4bc3-9dd6-2cd360a1bac6-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"40cc806e-9f77-4bc3-9dd6-2cd360a1bac6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 20:35:53.431694 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:53.431654 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/40cc806e-9f77-4bc3-9dd6-2cd360a1bac6-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"40cc806e-9f77-4bc3-9dd6-2cd360a1bac6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 20:35:53.432087 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:53.431707 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/40cc806e-9f77-4bc3-9dd6-2cd360a1bac6-config\") pod \"prometheus-k8s-0\" (UID: \"40cc806e-9f77-4bc3-9dd6-2cd360a1bac6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 20:35:53.432087 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:53.431730 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/40cc806e-9f77-4bc3-9dd6-2cd360a1bac6-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"40cc806e-9f77-4bc3-9dd6-2cd360a1bac6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 20:35:53.432087 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:53.431754 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/40cc806e-9f77-4bc3-9dd6-2cd360a1bac6-config-out\") pod \"prometheus-k8s-0\" (UID: \"40cc806e-9f77-4bc3-9dd6-2cd360a1bac6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 20:35:53.432087 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:53.431779 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/40cc806e-9f77-4bc3-9dd6-2cd360a1bac6-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"40cc806e-9f77-4bc3-9dd6-2cd360a1bac6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 20:35:53.432087 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:53.431803 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/40cc806e-9f77-4bc3-9dd6-2cd360a1bac6-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"40cc806e-9f77-4bc3-9dd6-2cd360a1bac6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 20:35:53.432333 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:53.432310 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/40cc806e-9f77-4bc3-9dd6-2cd360a1bac6-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"40cc806e-9f77-4bc3-9dd6-2cd360a1bac6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 20:35:53.432333 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:53.432320 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/40cc806e-9f77-4bc3-9dd6-2cd360a1bac6-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"40cc806e-9f77-4bc3-9dd6-2cd360a1bac6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 20:35:53.432692 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:53.432665 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/40cc806e-9f77-4bc3-9dd6-2cd360a1bac6-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"40cc806e-9f77-4bc3-9dd6-2cd360a1bac6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 20:35:53.433511 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:53.433486 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/40cc806e-9f77-4bc3-9dd6-2cd360a1bac6-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"40cc806e-9f77-4bc3-9dd6-2cd360a1bac6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 20:35:53.434519 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:53.434359 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/40cc806e-9f77-4bc3-9dd6-2cd360a1bac6-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"40cc806e-9f77-4bc3-9dd6-2cd360a1bac6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 20:35:53.445933 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:53.434951 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/40cc806e-9f77-4bc3-9dd6-2cd360a1bac6-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"40cc806e-9f77-4bc3-9dd6-2cd360a1bac6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 20:35:53.445933 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:53.437104 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/40cc806e-9f77-4bc3-9dd6-2cd360a1bac6-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"40cc806e-9f77-4bc3-9dd6-2cd360a1bac6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 20:35:53.445933 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:53.438241 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/40cc806e-9f77-4bc3-9dd6-2cd360a1bac6-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"40cc806e-9f77-4bc3-9dd6-2cd360a1bac6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 20:35:53.445933 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:53.438386 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78684995d9-99lmx" Jul 21 20:35:53.445933 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:53.441133 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/40cc806e-9f77-4bc3-9dd6-2cd360a1bac6-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"40cc806e-9f77-4bc3-9dd6-2cd360a1bac6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 20:35:53.445933 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:53.441552 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/40cc806e-9f77-4bc3-9dd6-2cd360a1bac6-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"40cc806e-9f77-4bc3-9dd6-2cd360a1bac6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 20:35:53.445933 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:53.441906 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/40cc806e-9f77-4bc3-9dd6-2cd360a1bac6-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"40cc806e-9f77-4bc3-9dd6-2cd360a1bac6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 20:35:53.445933 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:53.442288 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/40cc806e-9f77-4bc3-9dd6-2cd360a1bac6-config\") pod \"prometheus-k8s-0\" (UID: \"40cc806e-9f77-4bc3-9dd6-2cd360a1bac6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 20:35:53.445933 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:53.444520 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/40cc806e-9f77-4bc3-9dd6-2cd360a1bac6-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"40cc806e-9f77-4bc3-9dd6-2cd360a1bac6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 20:35:53.445933 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:53.445355 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/40cc806e-9f77-4bc3-9dd6-2cd360a1bac6-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"40cc806e-9f77-4bc3-9dd6-2cd360a1bac6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 20:35:53.445933 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:53.445739 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/40cc806e-9f77-4bc3-9dd6-2cd360a1bac6-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"40cc806e-9f77-4bc3-9dd6-2cd360a1bac6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 20:35:53.446589 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:53.445955 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/40cc806e-9f77-4bc3-9dd6-2cd360a1bac6-config-out\") pod \"prometheus-k8s-0\" (UID: \"40cc806e-9f77-4bc3-9dd6-2cd360a1bac6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 20:35:53.447063 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:53.446984 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/40cc806e-9f77-4bc3-9dd6-2cd360a1bac6-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"40cc806e-9f77-4bc3-9dd6-2cd360a1bac6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 20:35:53.447292 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:53.447188 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/40cc806e-9f77-4bc3-9dd6-2cd360a1bac6-web-config\") pod \"prometheus-k8s-0\" (UID: \"40cc806e-9f77-4bc3-9dd6-2cd360a1bac6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 20:35:53.452524 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:53.452480 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x4p6n\" (UniqueName: \"kubernetes.io/projected/40cc806e-9f77-4bc3-9dd6-2cd360a1bac6-kube-api-access-x4p6n\") pod \"prometheus-k8s-0\" (UID: \"40cc806e-9f77-4bc3-9dd6-2cd360a1bac6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 20:35:53.455055 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:53.454965 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/40cc806e-9f77-4bc3-9dd6-2cd360a1bac6-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"40cc806e-9f77-4bc3-9dd6-2cd360a1bac6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 20:35:53.497700 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:53.497654 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ef3673d_2e1b_4d29_883c_a28a55c8e939.slice/crio-1f7129e8d1010fdb33022315e80c6f5384548ba4f897b373b4fe806db6a0d16f WatchSource:0}: Error finding container 1f7129e8d1010fdb33022315e80c6f5384548ba4f897b373b4fe806db6a0d16f: Status 404 returned error can't find the container with id 1f7129e8d1010fdb33022315e80c6f5384548ba4f897b373b4fe806db6a0d16f Jul 21 20:35:53.547322 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:53.547140 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 21 20:35:53.712791 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:53.712701 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-78684995d9-99lmx"] Jul 21 20:35:53.717064 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:53.717030 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95b6ae55_056b_4516_af84_c4ee98742e1a.slice/crio-ef4881812533c0d9ae8c103e41a05653a35a25373f5cf9185de606de76ca0ce6 WatchSource:0}: Error finding container ef4881812533c0d9ae8c103e41a05653a35a25373f5cf9185de606de76ca0ce6: Status 404 returned error can't find the container with id ef4881812533c0d9ae8c103e41a05653a35a25373f5cf9185de606de76ca0ce6 Jul 21 20:35:53.765689 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:53.765379 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 21 20:35:53.770065 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:35:53.770035 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40cc806e_9f77_4bc3_9dd6_2cd360a1bac6.slice/crio-a03684d797c5fca1b8abf3ba40bdd337ccce6259b1580ec46c8dd1d6ba30a213 WatchSource:0}: Error finding container a03684d797c5fca1b8abf3ba40bdd337ccce6259b1580ec46c8dd1d6ba30a213: Status 404 returned error can't find the container with id a03684d797c5fca1b8abf3ba40bdd337ccce6259b1580ec46c8dd1d6ba30a213 Jul 21 20:35:54.091753 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:54.091654 2560 generic.go:356] "Generic (PLEG): container finished" podID="e92af0c2-fee3-4f53-8f7f-660c96621af2" containerID="80787e5697a2e50b9a54d8cdb2a55272e8785f5fbfb929cd3788df2aebd76db1" exitCode=0 Jul 21 20:35:54.091911 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:54.091741 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e92af0c2-fee3-4f53-8f7f-660c96621af2","Type":"ContainerDied","Data":"80787e5697a2e50b9a54d8cdb2a55272e8785f5fbfb929cd3788df2aebd76db1"} Jul 21 20:35:54.093832 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:54.093803 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"40cc806e-9f77-4bc3-9dd6-2cd360a1bac6","Type":"ContainerStarted","Data":"500c56db1fb2d9231b85c025d7dd63502965916f8b80f489f722c72be4362758"} Jul 21 20:35:54.093906 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:54.093875 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"40cc806e-9f77-4bc3-9dd6-2cd360a1bac6","Type":"ContainerStarted","Data":"a03684d797c5fca1b8abf3ba40bdd337ccce6259b1580ec46c8dd1d6ba30a213"} Jul 21 20:35:54.095535 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:54.095506 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78684995d9-99lmx" event={"ID":"95b6ae55-056b-4516-af84-c4ee98742e1a","Type":"ContainerStarted","Data":"ef4881812533c0d9ae8c103e41a05653a35a25373f5cf9185de606de76ca0ce6"} Jul 21 20:35:54.098565 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:54.098536 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-g558f" event={"ID":"6f695010-55df-4bb3-a59e-a6ba4ae714e7","Type":"ContainerStarted","Data":"6c052136d5582e41ce50f59396767012659a57ca6133af163e8c5e108a814c91"} Jul 21 20:35:54.101347 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:54.101270 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4x8tg" event={"ID":"6e7f65a8-9ebc-4df4-9907-c9632cd5f7ac","Type":"ContainerStarted","Data":"67866cf9847c833055db8abdb21bad609e9380c3a04388812212cf82fbe6cb72"} Jul 21 20:35:54.101347 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:54.101317 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4x8tg" event={"ID":"6e7f65a8-9ebc-4df4-9907-c9632cd5f7ac","Type":"ContainerStarted","Data":"770ce7a00de26545eeab787f89a4b0df098773ff2a3cba3e3e4bc038fa8fd738"} Jul 21 20:35:54.102905 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:54.102883 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-65vlc" event={"ID":"3ef3673d-2e1b-4d29-883c-a28a55c8e939","Type":"ContainerStarted","Data":"1f7129e8d1010fdb33022315e80c6f5384548ba4f897b373b4fe806db6a0d16f"} Jul 21 20:35:54.134440 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:54.134381 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-g558f" podStartSLOduration=5.563742679 podStartE2EDuration="7.134364881s" totalImagesPullingTime="1.570622202s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 20:35:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:35:54.133667186 +0000 UTC m=+46.896904150" watchObservedRunningTime="2026-07-21 20:35:54.134364881 +0000 UTC m=+46.897601823" Jul 21 20:35:54.153520 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:54.153459 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-4x8tg" podStartSLOduration=6.111021626 podStartE2EDuration="7.153444377s" totalImagesPullingTime="973.30919ms" totalInitContainerRuntime="69.113561ms" isStatefulPod=true podCreationTimestamp="2026-07-21 20:35:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:35:54.152299107 +0000 UTC m=+46.915536050" watchObservedRunningTime="2026-07-21 20:35:54.153444377 +0000 UTC m=+46.916681318" Jul 21 20:35:55.115708 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:55.115108 2560 generic.go:356] "Generic (PLEG): container finished" podID="40cc806e-9f77-4bc3-9dd6-2cd360a1bac6" containerID="500c56db1fb2d9231b85c025d7dd63502965916f8b80f489f722c72be4362758" exitCode=0 Jul 21 20:35:55.115708 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:35:55.115218 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"40cc806e-9f77-4bc3-9dd6-2cd360a1bac6","Type":"ContainerDied","Data":"500c56db1fb2d9231b85c025d7dd63502965916f8b80f489f722c72be4362758"} Jul 21 20:36:01.142321 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:36:01.142266 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-65vlc" event={"ID":"3ef3673d-2e1b-4d29-883c-a28a55c8e939","Type":"ContainerStarted","Data":"da36b8291d84b05fa37c41f716cdcd4f0dee5253548d06532cd13606a8dd63bc"} Jul 21 20:36:01.142796 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:36:01.142382 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-65vlc" Jul 21 20:36:01.145089 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:36:01.145045 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6664b8bc76-4h8r2" event={"ID":"7a6dd5c2-848b-45ba-99d7-e9975ea40a7d","Type":"ContainerStarted","Data":"d06f433ec3f17b465dfc2d25114a05d19d2b5008f045f17786b22860f8b1bc40"} Jul 21 20:36:01.145260 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:36:01.145142 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6664b8bc76-4h8r2" event={"ID":"7a6dd5c2-848b-45ba-99d7-e9975ea40a7d","Type":"ContainerStarted","Data":"1508f7140f77c0e24d3ebb643db2eb8f9b210b161922f8b4b88448c60e2cc559"} Jul 21 20:36:01.145260 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:36:01.145188 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6664b8bc76-4h8r2" event={"ID":"7a6dd5c2-848b-45ba-99d7-e9975ea40a7d","Type":"ContainerStarted","Data":"2b5d85db49bc86d601244a13c05bcc0ec95a9bbae6bbd59c568104fa8c100474"} Jul 21 20:36:01.147869 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:36:01.147799 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-k9lrs" event={"ID":"d0c64150-3a79-4dc2-99fa-a7f04c3e40dc","Type":"ContainerStarted","Data":"8e0a99725e565f60e737279c129b7e9c6c3d8d277a20d6c9d1a5558da03a0aca"} Jul 21 20:36:01.147869 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:36:01.147860 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-k9lrs" event={"ID":"d0c64150-3a79-4dc2-99fa-a7f04c3e40dc","Type":"ContainerStarted","Data":"83c3defd055733b0a776be41723f257e1747f5beffd7aeed6da804eeb6345fd2"} Jul 21 20:36:01.148095 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:36:01.147889 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-k9lrs" event={"ID":"d0c64150-3a79-4dc2-99fa-a7f04c3e40dc","Type":"ContainerStarted","Data":"9ded47228f0732e346e71277ce157c4939f66de5877de9a3f09ab828e9941880"} Jul 21 20:36:01.148910 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:36:01.148885 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-65vlc" Jul 21 20:36:01.149953 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:36:01.149929 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-km5t4" event={"ID":"eb3b766c-4d7d-40f5-ad7d-38b19e505a36","Type":"ContainerStarted","Data":"7c766d40e346673d26757325d5a905ac4f12dd615128cdaba2865a20ea3c8516"} Jul 21 20:36:01.153369 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:36:01.153348 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e92af0c2-fee3-4f53-8f7f-660c96621af2","Type":"ContainerStarted","Data":"d2ac5a2bb7902f4ae663e78eb61b0d64322d2fd1e620603c17b21e5d0eb46426"} Jul 21 20:36:01.153458 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:36:01.153399 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e92af0c2-fee3-4f53-8f7f-660c96621af2","Type":"ContainerStarted","Data":"443ee738b1bcf43718da2657a8b16c767a75a5817aaecee5eb010f56b4b5e29d"} Jul 21 20:36:01.153458 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:36:01.153437 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e92af0c2-fee3-4f53-8f7f-660c96621af2","Type":"ContainerStarted","Data":"63e2f4ef1a359cbf432ffeb1341b1a20e17107cb3fb155b201f36beb79b64b0c"} Jul 21 20:36:01.153575 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:36:01.153476 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e92af0c2-fee3-4f53-8f7f-660c96621af2","Type":"ContainerStarted","Data":"1d18248f7158c09d2244150f792f81c61b71eefc5abf7809b470d9e08add8b7a"} Jul 21 20:36:01.153575 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:36:01.153514 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e92af0c2-fee3-4f53-8f7f-660c96621af2","Type":"ContainerStarted","Data":"2c5ea544b708d8d90b0b606a2dc8ddee698d221184eacdb1a23fec71cba5e8ff"} Jul 21 20:36:01.157068 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:36:01.157040 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"40cc806e-9f77-4bc3-9dd6-2cd360a1bac6","Type":"ContainerStarted","Data":"3005987eb65475568d207ee32909f010c033cbd4d879d76ab2ef4b461ebb12a9"} Jul 21 20:36:01.157177 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:36:01.157104 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"40cc806e-9f77-4bc3-9dd6-2cd360a1bac6","Type":"ContainerStarted","Data":"c392d42992f48fec37c232d9a9f176c730eff31cef9fabd87921070aecc22291"} Jul 21 20:36:01.157177 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:36:01.157137 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"40cc806e-9f77-4bc3-9dd6-2cd360a1bac6","Type":"ContainerStarted","Data":"8e353668a12482108662cec296fb3be7955183a0dde443c9906920d82287df87"} Jul 21 20:36:01.157177 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:36:01.157166 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"40cc806e-9f77-4bc3-9dd6-2cd360a1bac6","Type":"ContainerStarted","Data":"6206baea6b1778a9657490a3763fbdbc89af8c84c42d8b2ccbc0d7a4eb9ece0a"} Jul 21 20:36:01.157343 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:36:01.157206 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"40cc806e-9f77-4bc3-9dd6-2cd360a1bac6","Type":"ContainerStarted","Data":"b6179621cbd2da7d55fb9e3bd2dd8e45903a982a4f0d26062365ba17f3af84dc"} Jul 21 20:36:01.157343 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:36:01.157246 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"40cc806e-9f77-4bc3-9dd6-2cd360a1bac6","Type":"ContainerStarted","Data":"32eae96e1bace0d923788f6d34eb2d93b4cd7cba943a7fa1235cffd984b55aff"} Jul 21 20:36:01.159579 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:36:01.159534 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-65vlc" podStartSLOduration=3.301385096 podStartE2EDuration="10.15949477s" totalImagesPullingTime="6.858109674s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 20:35:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:36:01.158353699 +0000 UTC m=+53.921590769" watchObservedRunningTime="2026-07-21 20:36:01.15949477 +0000 UTC m=+53.922731712" Jul 21 20:36:01.159926 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:36:01.159902 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78684995d9-99lmx" event={"ID":"95b6ae55-056b-4516-af84-c4ee98742e1a","Type":"ContainerStarted","Data":"2e50fb12508a44e3ebbf0455c7f3acde7f2b8b948a76b3e4627b6c8de3356dd8"} Jul 21 20:36:01.191211 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:36:01.191158 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.903678052 podStartE2EDuration="8.191143332s" totalImagesPullingTime="5.261631338s" totalInitContainerRuntime="25.833942ms" isStatefulPod=false podCreationTimestamp="2026-07-21 20:35:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:36:01.185412663 +0000 UTC m=+53.948649606" watchObservedRunningTime="2026-07-21 20:36:01.191143332 +0000 UTC m=+53.954380252" Jul 21 20:36:01.206626 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:36:01.206572 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56c5594674-k9lrs" podStartSLOduration=8.528428887 podStartE2EDuration="14.206558385s" totalImagesPullingTime="5.678129498s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 20:35:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:36:01.205731533 +0000 UTC m=+53.968968476" watchObservedRunningTime="2026-07-21 20:36:01.206558385 +0000 UTC m=+53.969795317" Jul 21 20:36:01.240110 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:36:01.240046 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-78684995d9-99lmx" podStartSLOduration=1.5839607180000002 podStartE2EDuration="8.239993541s" totalImagesPullingTime="6.656032823s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 20:35:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:36:01.23850625 +0000 UTC m=+54.001743193" watchObservedRunningTime="2026-07-21 20:36:01.239993541 +0000 UTC m=+54.003230484" Jul 21 20:36:02.090052 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:36:02.089864 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-9rz9d" Jul 21 20:36:02.176713 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:36:02.176621 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e92af0c2-fee3-4f53-8f7f-660c96621af2","Type":"ContainerStarted","Data":"218203a7d997d738f2fe06e3692f50b3a3c3c7eae54c545e5f35e17de4a357ab"} Jul 21 20:36:02.180359 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:36:02.180300 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6664b8bc76-4h8r2" event={"ID":"7a6dd5c2-848b-45ba-99d7-e9975ea40a7d","Type":"ContainerStarted","Data":"a38db8238c1fca93f3740f007b4697c6994ecba806da2b7ab1f4baea72f617b6"} Jul 21 20:36:02.210057 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:36:02.209988 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=5.325941478 podStartE2EDuration="14.209970015s" totalImagesPullingTime="8.845097264s" totalInitContainerRuntime="38.931273ms" isStatefulPod=false podCreationTimestamp="2026-07-21 20:35:48 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:36:02.207782547 +0000 UTC m=+54.971019490" watchObservedRunningTime="2026-07-21 20:36:02.209970015 +0000 UTC m=+54.973206958" Jul 21 20:36:03.187941 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:36:03.187901 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6664b8bc76-4h8r2" event={"ID":"7a6dd5c2-848b-45ba-99d7-e9975ea40a7d","Type":"ContainerStarted","Data":"ef5ca5aeae56206d14cac5a1ae2811a8a622afc54fcc747be61bc1fb55805312"} Jul 21 20:36:03.188402 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:36:03.187991 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6664b8bc76-4h8r2" event={"ID":"7a6dd5c2-848b-45ba-99d7-e9975ea40a7d","Type":"ContainerStarted","Data":"ed5b73039c94330b8ca0d230e8e68f5dd07336b7605fd8b9181e4eb7a8fcf208"} Jul 21 20:36:03.188505 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:36:03.188481 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-6664b8bc76-4h8r2" Jul 21 20:36:03.214668 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:36:03.214613 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-6664b8bc76-4h8r2" podStartSLOduration=7.267147587 podStartE2EDuration="14.214596136s" totalImagesPullingTime="6.947448549s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 20:35:49 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:36:03.212278231 +0000 UTC m=+55.975515175" watchObservedRunningTime="2026-07-21 20:36:03.214596136 +0000 UTC m=+55.977833078" Jul 21 20:36:03.439715 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:36:03.439625 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-78684995d9-99lmx" Jul 21 20:36:03.439878 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:36:03.439735 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-78684995d9-99lmx" Jul 21 20:36:03.446273 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:36:03.446248 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-78684995d9-99lmx" Jul 21 20:36:03.548710 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:36:03.548684 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 21 20:36:04.195200 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:36:04.195174 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-78684995d9-99lmx" Jul 21 20:36:05.197600 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:36:05.197563 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-km5t4" event={"ID":"eb3b766c-4d7d-40f5-ad7d-38b19e505a36","Type":"ContainerStarted","Data":"78eb1c181f60e7bca6dc67d5783a8476c8bdbe1a85eaba614e46a93cfd0be028"} Jul 21 20:36:05.218988 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:36:05.218942 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-km5t4" podStartSLOduration=1.3144738280000001 podStartE2EDuration="21.218926304s" totalImagesPullingTime="19.904452476s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 20:35:44 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:36:05.21722548 +0000 UTC m=+57.980462423" watchObservedRunningTime="2026-07-21 20:36:05.218926304 +0000 UTC m=+57.982163245" Jul 21 20:36:09.030874 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:36:09.030841 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bpvvl" Jul 21 20:36:09.197593 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:36:09.197567 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-6664b8bc76-4h8r2" Jul 21 20:36:13.433214 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:36:13.433180 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0da0f4c0-d4be-484a-8efb-8f525f2ab0d9-original-pull-secret\") pod \"global-pull-secret-syncer-2mfdm\" (UID: \"0da0f4c0-d4be-484a-8efb-8f525f2ab0d9\") " pod="kube-system/global-pull-secret-syncer-2mfdm" Jul 21 20:36:13.433214 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:36:13.433219 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dtrsl\" (UniqueName: \"kubernetes.io/projected/3abb9e4b-7d06-4635-90a7-a31abc3c38ff-kube-api-access-dtrsl\") pod \"network-check-target-5v767\" (UID: \"3abb9e4b-7d06-4635-90a7-a31abc3c38ff\") " pod="openshift-network-diagnostics/network-check-target-5v767" Jul 21 20:36:13.436279 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:36:13.436251 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 21 20:36:13.436279 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:36:13.436251 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 21 20:36:13.446500 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:36:13.446480 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0da0f4c0-d4be-484a-8efb-8f525f2ab0d9-original-pull-secret\") pod \"global-pull-secret-syncer-2mfdm\" (UID: \"0da0f4c0-d4be-484a-8efb-8f525f2ab0d9\") " pod="kube-system/global-pull-secret-syncer-2mfdm" Jul 21 20:36:13.447080 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:36:13.447061 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 21 20:36:13.456826 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:36:13.456807 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dtrsl\" (UniqueName: \"kubernetes.io/projected/3abb9e4b-7d06-4635-90a7-a31abc3c38ff-kube-api-access-dtrsl\") pod \"network-check-target-5v767\" (UID: \"3abb9e4b-7d06-4635-90a7-a31abc3c38ff\") " pod="openshift-network-diagnostics/network-check-target-5v767" Jul 21 20:36:13.484844 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:36:13.484826 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-jv74c\"" Jul 21 20:36:13.492278 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:36:13.492262 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5v767" Jul 21 20:36:13.502504 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:36:13.502486 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2mfdm" Jul 21 20:36:13.533912 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:36:13.533891 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/51fd4d84-10d1-464a-bcdb-dd32614a44a9-metrics-certs\") pod \"network-metrics-daemon-qs78f\" (UID: \"51fd4d84-10d1-464a-bcdb-dd32614a44a9\") " pod="openshift-multus/network-metrics-daemon-qs78f" Jul 21 20:36:13.536640 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:36:13.536626 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 21 20:36:13.546825 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:36:13.546803 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/51fd4d84-10d1-464a-bcdb-dd32614a44a9-metrics-certs\") pod \"network-metrics-daemon-qs78f\" (UID: \"51fd4d84-10d1-464a-bcdb-dd32614a44a9\") " pod="openshift-multus/network-metrics-daemon-qs78f" Jul 21 20:36:13.795904 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:36:13.795880 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-xtr62\"" Jul 21 20:36:13.803174 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:36:13.803155 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qs78f" Jul 21 20:36:13.904180 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:36:13.904138 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-78684995d9-99lmx"] Jul 21 20:36:13.914628 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:36:13.914522 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-5v767"] Jul 21 20:36:13.917221 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:36:13.917197 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3abb9e4b_7d06_4635_90a7_a31abc3c38ff.slice/crio-5f4cfaa7c73c4ff958d55cf158413b747981c91d6c8cd860cf41e588ae4d2377 WatchSource:0}: Error finding container 5f4cfaa7c73c4ff958d55cf158413b747981c91d6c8cd860cf41e588ae4d2377: Status 404 returned error can't find the container with id 5f4cfaa7c73c4ff958d55cf158413b747981c91d6c8cd860cf41e588ae4d2377 Jul 21 20:36:13.943771 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:36:13.943669 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-2mfdm"] Jul 21 20:36:13.946965 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:36:13.946937 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0da0f4c0_d4be_484a_8efb_8f525f2ab0d9.slice/crio-8a60882439234c8beb25ca7423a84a336ceb60c99b052f5bfe36dd90c71987d3 WatchSource:0}: Error finding container 8a60882439234c8beb25ca7423a84a336ceb60c99b052f5bfe36dd90c71987d3: Status 404 returned error can't find the container with id 8a60882439234c8beb25ca7423a84a336ceb60c99b052f5bfe36dd90c71987d3 Jul 21 20:36:13.972031 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:36:13.971975 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-qs78f"] Jul 21 20:36:13.974316 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:36:13.974297 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51fd4d84_10d1_464a_bcdb_dd32614a44a9.slice/crio-af5c4c9c941fc45614247d5dc7310a93827afdf356665b7ea0d25e9b771deccd WatchSource:0}: Error finding container af5c4c9c941fc45614247d5dc7310a93827afdf356665b7ea0d25e9b771deccd: Status 404 returned error can't find the container with id af5c4c9c941fc45614247d5dc7310a93827afdf356665b7ea0d25e9b771deccd Jul 21 20:36:14.232153 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:36:14.232124 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qs78f" event={"ID":"51fd4d84-10d1-464a-bcdb-dd32614a44a9","Type":"ContainerStarted","Data":"af5c4c9c941fc45614247d5dc7310a93827afdf356665b7ea0d25e9b771deccd"} Jul 21 20:36:14.233334 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:36:14.233310 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-2mfdm" event={"ID":"0da0f4c0-d4be-484a-8efb-8f525f2ab0d9","Type":"ContainerStarted","Data":"8a60882439234c8beb25ca7423a84a336ceb60c99b052f5bfe36dd90c71987d3"} Jul 21 20:36:14.234389 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:36:14.234370 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-5v767" event={"ID":"3abb9e4b-7d06-4635-90a7-a31abc3c38ff","Type":"ContainerStarted","Data":"5f4cfaa7c73c4ff958d55cf158413b747981c91d6c8cd860cf41e588ae4d2377"} Jul 21 20:36:16.262410 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:36:16.261791 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qs78f" event={"ID":"51fd4d84-10d1-464a-bcdb-dd32614a44a9","Type":"ContainerStarted","Data":"cc4dc0dc2576ae165dd9931d5dca988c88f878d46dd0fb22eed2ab03028053e2"} Jul 21 20:36:16.262410 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:36:16.261888 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qs78f" event={"ID":"51fd4d84-10d1-464a-bcdb-dd32614a44a9","Type":"ContainerStarted","Data":"fe63b8a6d12b898b7cfbc09012e08290fd3e489f08da58fe2481bb62dfadd6a9"} Jul 21 20:36:16.278327 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:36:16.278271 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-qs78f" podStartSLOduration=66.668934284 podStartE2EDuration="1m8.278253139s" totalImagesPullingTime="1.609318855s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 20:35:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:36:16.277711898 +0000 UTC m=+69.040948840" watchObservedRunningTime="2026-07-21 20:36:16.278253139 +0000 UTC m=+69.041490082" Jul 21 20:36:19.276872 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:36:19.276836 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-2mfdm" event={"ID":"0da0f4c0-d4be-484a-8efb-8f525f2ab0d9","Type":"ContainerStarted","Data":"4c5d59b9f94897624fa7c3d92377a91a198de5052c6b2256a7e88ad62ba9d04e"} Jul 21 20:36:19.278380 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:36:19.278357 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-5v767" event={"ID":"3abb9e4b-7d06-4635-90a7-a31abc3c38ff","Type":"ContainerStarted","Data":"3929674e71158ef9e1d0046d45d63c848e4f8b0b0eb53c73ad32f4de57f7f854"} Jul 21 20:36:19.278478 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:36:19.278408 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-5v767" Jul 21 20:36:19.291813 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:36:19.291766 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-2mfdm" podStartSLOduration=66.188286732 podStartE2EDuration="1m11.291753852s" totalImagesPullingTime="5.10346712s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 20:35:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:36:19.29120413 +0000 UTC m=+72.054441084" watchObservedRunningTime="2026-07-21 20:36:19.291753852 +0000 UTC m=+72.054990825" Jul 21 20:36:19.305079 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:36:19.304995 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-5v767" podStartSLOduration=66.176218737 podStartE2EDuration="1m11.304983123s" totalImagesPullingTime="5.128764386s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 20:35:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:36:19.304656065 +0000 UTC m=+72.067893020" watchObservedRunningTime="2026-07-21 20:36:19.304983123 +0000 UTC m=+72.068220066" Jul 21 20:36:38.935197 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:36:38.935056 2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-78684995d9-99lmx" podUID="95b6ae55-056b-4516-af84-c4ee98742e1a" containerName="console" containerID="cri-o://2e50fb12508a44e3ebbf0455c7f3acde7f2b8b948a76b3e4627b6c8de3356dd8" gracePeriod=15 Jul 21 20:36:39.165137 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:36:39.165117 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78684995d9-99lmx" Jul 21 20:36:39.238590 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:36:39.238538 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/95b6ae55-056b-4516-af84-c4ee98742e1a-console-serving-cert\") pod \"95b6ae55-056b-4516-af84-c4ee98742e1a\" (UID: \"95b6ae55-056b-4516-af84-c4ee98742e1a\") " Jul 21 20:36:39.238590 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:36:39.238579 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/95b6ae55-056b-4516-af84-c4ee98742e1a-console-config\") pod \"95b6ae55-056b-4516-af84-c4ee98742e1a\" (UID: \"95b6ae55-056b-4516-af84-c4ee98742e1a\") " Jul 21 20:36:39.238717 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:36:39.238610 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zcxvf\" (UniqueName: \"kubernetes.io/projected/95b6ae55-056b-4516-af84-c4ee98742e1a-kube-api-access-zcxvf\") pod \"95b6ae55-056b-4516-af84-c4ee98742e1a\" (UID: \"95b6ae55-056b-4516-af84-c4ee98742e1a\") " Jul 21 20:36:39.238717 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:36:39.238669 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/95b6ae55-056b-4516-af84-c4ee98742e1a-console-oauth-config\") pod \"95b6ae55-056b-4516-af84-c4ee98742e1a\" (UID: \"95b6ae55-056b-4516-af84-c4ee98742e1a\") " Jul 21 20:36:39.238717 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:36:39.238691 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/95b6ae55-056b-4516-af84-c4ee98742e1a-oauth-serving-cert\") pod \"95b6ae55-056b-4516-af84-c4ee98742e1a\" (UID: \"95b6ae55-056b-4516-af84-c4ee98742e1a\") " Jul 21 20:36:39.238824 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:36:39.238718 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/95b6ae55-056b-4516-af84-c4ee98742e1a-service-ca\") pod \"95b6ae55-056b-4516-af84-c4ee98742e1a\" (UID: \"95b6ae55-056b-4516-af84-c4ee98742e1a\") " Jul 21 20:36:39.239126 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:36:39.239094 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/95b6ae55-056b-4516-af84-c4ee98742e1a-service-ca" (OuterVolumeSpecName: "service-ca") pod "95b6ae55-056b-4516-af84-c4ee98742e1a" (UID: "95b6ae55-056b-4516-af84-c4ee98742e1a"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 20:36:39.239126 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:36:39.239103 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/95b6ae55-056b-4516-af84-c4ee98742e1a-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "95b6ae55-056b-4516-af84-c4ee98742e1a" (UID: "95b6ae55-056b-4516-af84-c4ee98742e1a"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 20:36:39.239280 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:36:39.239201 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/95b6ae55-056b-4516-af84-c4ee98742e1a-console-config" (OuterVolumeSpecName: "console-config") pod "95b6ae55-056b-4516-af84-c4ee98742e1a" (UID: "95b6ae55-056b-4516-af84-c4ee98742e1a"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 20:36:39.240836 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:36:39.240814 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/95b6ae55-056b-4516-af84-c4ee98742e1a-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "95b6ae55-056b-4516-af84-c4ee98742e1a" (UID: "95b6ae55-056b-4516-af84-c4ee98742e1a"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 20:36:39.241172 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:36:39.241153 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/95b6ae55-056b-4516-af84-c4ee98742e1a-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "95b6ae55-056b-4516-af84-c4ee98742e1a" (UID: "95b6ae55-056b-4516-af84-c4ee98742e1a"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 20:36:39.241248 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:36:39.241173 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/95b6ae55-056b-4516-af84-c4ee98742e1a-kube-api-access-zcxvf" (OuterVolumeSpecName: "kube-api-access-zcxvf") pod "95b6ae55-056b-4516-af84-c4ee98742e1a" (UID: "95b6ae55-056b-4516-af84-c4ee98742e1a"). InnerVolumeSpecName "kube-api-access-zcxvf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 20:36:39.339845 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:36:39.339822 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zcxvf\" (UniqueName: \"kubernetes.io/projected/95b6ae55-056b-4516-af84-c4ee98742e1a-kube-api-access-zcxvf\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\"" Jul 21 20:36:39.339845 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:36:39.339843 2560 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/95b6ae55-056b-4516-af84-c4ee98742e1a-console-oauth-config\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\"" Jul 21 20:36:39.339960 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:36:39.339853 2560 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/95b6ae55-056b-4516-af84-c4ee98742e1a-oauth-serving-cert\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\"" Jul 21 20:36:39.339960 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:36:39.339862 2560 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/95b6ae55-056b-4516-af84-c4ee98742e1a-service-ca\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\"" Jul 21 20:36:39.339960 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:36:39.339871 2560 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/95b6ae55-056b-4516-af84-c4ee98742e1a-console-serving-cert\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\"" Jul 21 20:36:39.339960 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:36:39.339879 2560 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/95b6ae55-056b-4516-af84-c4ee98742e1a-console-config\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\"" Jul 21 20:36:39.354119 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:36:39.354095 2560 generic.go:356] "Generic (PLEG): container finished" podID="95b6ae55-056b-4516-af84-c4ee98742e1a" containerID="2e50fb12508a44e3ebbf0455c7f3acde7f2b8b948a76b3e4627b6c8de3356dd8" exitCode=0 Jul 21 20:36:39.354199 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:36:39.354148 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78684995d9-99lmx" Jul 21 20:36:39.354199 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:36:39.354157 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78684995d9-99lmx" event={"ID":"95b6ae55-056b-4516-af84-c4ee98742e1a","Type":"ContainerDied","Data":"2e50fb12508a44e3ebbf0455c7f3acde7f2b8b948a76b3e4627b6c8de3356dd8"} Jul 21 20:36:39.354280 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:36:39.354222 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78684995d9-99lmx" event={"ID":"95b6ae55-056b-4516-af84-c4ee98742e1a","Type":"ContainerDied","Data":"ef4881812533c0d9ae8c103e41a05653a35a25373f5cf9185de606de76ca0ce6"} Jul 21 20:36:39.354280 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:36:39.354243 2560 scope.go:117] "RemoveContainer" containerID="2e50fb12508a44e3ebbf0455c7f3acde7f2b8b948a76b3e4627b6c8de3356dd8" Jul 21 20:36:39.363550 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:36:39.363534 2560 scope.go:117] "RemoveContainer" containerID="2e50fb12508a44e3ebbf0455c7f3acde7f2b8b948a76b3e4627b6c8de3356dd8" Jul 21 20:36:39.363836 ip-10-0-131-27 kubenswrapper[2560]: E0721 20:36:39.363814 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2e50fb12508a44e3ebbf0455c7f3acde7f2b8b948a76b3e4627b6c8de3356dd8\": container with ID starting with 2e50fb12508a44e3ebbf0455c7f3acde7f2b8b948a76b3e4627b6c8de3356dd8 not found: ID does not exist" containerID="2e50fb12508a44e3ebbf0455c7f3acde7f2b8b948a76b3e4627b6c8de3356dd8" Jul 21 20:36:39.363924 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:36:39.363845 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2e50fb12508a44e3ebbf0455c7f3acde7f2b8b948a76b3e4627b6c8de3356dd8"} err="failed to get container status \"2e50fb12508a44e3ebbf0455c7f3acde7f2b8b948a76b3e4627b6c8de3356dd8\": rpc error: code = NotFound desc = could not find container \"2e50fb12508a44e3ebbf0455c7f3acde7f2b8b948a76b3e4627b6c8de3356dd8\": container with ID starting with 2e50fb12508a44e3ebbf0455c7f3acde7f2b8b948a76b3e4627b6c8de3356dd8 not found: ID does not exist" Jul 21 20:36:39.375442 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:36:39.375421 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-78684995d9-99lmx"] Jul 21 20:36:39.379097 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:36:39.379075 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-78684995d9-99lmx"] Jul 21 20:36:39.868977 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:36:39.868951 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="95b6ae55-056b-4516-af84-c4ee98742e1a" path="/var/lib/kubelet/pods/95b6ae55-056b-4516-af84-c4ee98742e1a/volumes" Jul 21 20:36:50.285045 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:36:50.285002 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-5v767" Jul 21 20:36:57.888192 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:36:57.888160 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 21 20:36:57.906715 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:36:57.906695 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 21 20:36:58.445272 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:36:58.445242 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 21 20:37:07.310034 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:07.309989 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 21 20:37:07.310434 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:07.310357 2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e92af0c2-fee3-4f53-8f7f-660c96621af2" containerName="alertmanager" containerID="cri-o://2c5ea544b708d8d90b0b606a2dc8ddee698d221184eacdb1a23fec71cba5e8ff" gracePeriod=120 Jul 21 20:37:07.310501 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:07.310425 2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e92af0c2-fee3-4f53-8f7f-660c96621af2" containerName="kube-rbac-proxy-web" containerID="cri-o://63e2f4ef1a359cbf432ffeb1341b1a20e17107cb3fb155b201f36beb79b64b0c" gracePeriod=120 Jul 21 20:37:07.310501 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:07.310450 2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e92af0c2-fee3-4f53-8f7f-660c96621af2" containerName="kube-rbac-proxy" containerID="cri-o://443ee738b1bcf43718da2657a8b16c767a75a5817aaecee5eb010f56b4b5e29d" gracePeriod=120 Jul 21 20:37:07.310599 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:07.310484 2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e92af0c2-fee3-4f53-8f7f-660c96621af2" containerName="prom-label-proxy" containerID="cri-o://218203a7d997d738f2fe06e3692f50b3a3c3c7eae54c545e5f35e17de4a357ab" gracePeriod=120 Jul 21 20:37:07.310599 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:07.310504 2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e92af0c2-fee3-4f53-8f7f-660c96621af2" containerName="config-reloader" containerID="cri-o://1d18248f7158c09d2244150f792f81c61b71eefc5abf7809b470d9e08add8b7a" gracePeriod=120 Jul 21 20:37:07.310599 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:07.310419 2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e92af0c2-fee3-4f53-8f7f-660c96621af2" containerName="kube-rbac-proxy-metric" containerID="cri-o://d2ac5a2bb7902f4ae663e78eb61b0d64322d2fd1e620603c17b21e5d0eb46426" gracePeriod=120 Jul 21 20:37:07.468853 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:07.468823 2560 generic.go:356] "Generic (PLEG): container finished" podID="e92af0c2-fee3-4f53-8f7f-660c96621af2" containerID="218203a7d997d738f2fe06e3692f50b3a3c3c7eae54c545e5f35e17de4a357ab" exitCode=0 Jul 21 20:37:07.468853 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:07.468847 2560 generic.go:356] "Generic (PLEG): container finished" podID="e92af0c2-fee3-4f53-8f7f-660c96621af2" containerID="d2ac5a2bb7902f4ae663e78eb61b0d64322d2fd1e620603c17b21e5d0eb46426" exitCode=0 Jul 21 20:37:07.468853 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:07.468854 2560 generic.go:356] "Generic (PLEG): container finished" podID="e92af0c2-fee3-4f53-8f7f-660c96621af2" containerID="443ee738b1bcf43718da2657a8b16c767a75a5817aaecee5eb010f56b4b5e29d" exitCode=0 Jul 21 20:37:07.468853 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:07.468859 2560 generic.go:356] "Generic (PLEG): container finished" podID="e92af0c2-fee3-4f53-8f7f-660c96621af2" containerID="63e2f4ef1a359cbf432ffeb1341b1a20e17107cb3fb155b201f36beb79b64b0c" exitCode=0 Jul 21 20:37:07.469188 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:07.468864 2560 generic.go:356] "Generic (PLEG): container finished" podID="e92af0c2-fee3-4f53-8f7f-660c96621af2" containerID="1d18248f7158c09d2244150f792f81c61b71eefc5abf7809b470d9e08add8b7a" exitCode=0 Jul 21 20:37:07.469188 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:07.468870 2560 generic.go:356] "Generic (PLEG): container finished" podID="e92af0c2-fee3-4f53-8f7f-660c96621af2" containerID="2c5ea544b708d8d90b0b606a2dc8ddee698d221184eacdb1a23fec71cba5e8ff" exitCode=0 Jul 21 20:37:07.469188 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:07.468894 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e92af0c2-fee3-4f53-8f7f-660c96621af2","Type":"ContainerDied","Data":"218203a7d997d738f2fe06e3692f50b3a3c3c7eae54c545e5f35e17de4a357ab"} Jul 21 20:37:07.469188 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:07.468976 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e92af0c2-fee3-4f53-8f7f-660c96621af2","Type":"ContainerDied","Data":"d2ac5a2bb7902f4ae663e78eb61b0d64322d2fd1e620603c17b21e5d0eb46426"} Jul 21 20:37:07.469188 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:07.469040 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e92af0c2-fee3-4f53-8f7f-660c96621af2","Type":"ContainerDied","Data":"443ee738b1bcf43718da2657a8b16c767a75a5817aaecee5eb010f56b4b5e29d"} Jul 21 20:37:07.469188 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:07.469084 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e92af0c2-fee3-4f53-8f7f-660c96621af2","Type":"ContainerDied","Data":"63e2f4ef1a359cbf432ffeb1341b1a20e17107cb3fb155b201f36beb79b64b0c"} Jul 21 20:37:07.469188 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:07.469126 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e92af0c2-fee3-4f53-8f7f-660c96621af2","Type":"ContainerDied","Data":"1d18248f7158c09d2244150f792f81c61b71eefc5abf7809b470d9e08add8b7a"} Jul 21 20:37:07.469188 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:07.469165 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e92af0c2-fee3-4f53-8f7f-660c96621af2","Type":"ContainerDied","Data":"2c5ea544b708d8d90b0b606a2dc8ddee698d221184eacdb1a23fec71cba5e8ff"} Jul 21 20:37:07.546727 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:07.546701 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 21 20:37:07.645739 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:07.645719 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e92af0c2-fee3-4f53-8f7f-660c96621af2-alertmanager-main-db\") pod \"e92af0c2-fee3-4f53-8f7f-660c96621af2\" (UID: \"e92af0c2-fee3-4f53-8f7f-660c96621af2\") " Jul 21 20:37:07.645844 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:07.645755 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e92af0c2-fee3-4f53-8f7f-660c96621af2-alertmanager-trusted-ca-bundle\") pod \"e92af0c2-fee3-4f53-8f7f-660c96621af2\" (UID: \"e92af0c2-fee3-4f53-8f7f-660c96621af2\") " Jul 21 20:37:07.645844 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:07.645774 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e92af0c2-fee3-4f53-8f7f-660c96621af2-secret-alertmanager-kube-rbac-proxy\") pod \"e92af0c2-fee3-4f53-8f7f-660c96621af2\" (UID: \"e92af0c2-fee3-4f53-8f7f-660c96621af2\") " Jul 21 20:37:07.645844 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:07.645798 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e92af0c2-fee3-4f53-8f7f-660c96621af2-config-volume\") pod \"e92af0c2-fee3-4f53-8f7f-660c96621af2\" (UID: \"e92af0c2-fee3-4f53-8f7f-660c96621af2\") " Jul 21 20:37:07.645844 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:07.645829 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e92af0c2-fee3-4f53-8f7f-660c96621af2-secret-alertmanager-kube-rbac-proxy-metric\") pod \"e92af0c2-fee3-4f53-8f7f-660c96621af2\" (UID: \"e92af0c2-fee3-4f53-8f7f-660c96621af2\") " Jul 21 20:37:07.646075 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:07.645853 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e92af0c2-fee3-4f53-8f7f-660c96621af2-metrics-client-ca\") pod \"e92af0c2-fee3-4f53-8f7f-660c96621af2\" (UID: \"e92af0c2-fee3-4f53-8f7f-660c96621af2\") " Jul 21 20:37:07.646075 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:07.645867 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e92af0c2-fee3-4f53-8f7f-660c96621af2-web-config\") pod \"e92af0c2-fee3-4f53-8f7f-660c96621af2\" (UID: \"e92af0c2-fee3-4f53-8f7f-660c96621af2\") " Jul 21 20:37:07.646075 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:07.645892 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e92af0c2-fee3-4f53-8f7f-660c96621af2-cluster-tls-config\") pod \"e92af0c2-fee3-4f53-8f7f-660c96621af2\" (UID: \"e92af0c2-fee3-4f53-8f7f-660c96621af2\") " Jul 21 20:37:07.646075 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:07.645920 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e92af0c2-fee3-4f53-8f7f-660c96621af2-config-out\") pod \"e92af0c2-fee3-4f53-8f7f-660c96621af2\" (UID: \"e92af0c2-fee3-4f53-8f7f-660c96621af2\") " Jul 21 20:37:07.646075 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:07.645994 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e92af0c2-fee3-4f53-8f7f-660c96621af2-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "e92af0c2-fee3-4f53-8f7f-660c96621af2" (UID: "e92af0c2-fee3-4f53-8f7f-660c96621af2"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 20:37:07.646682 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:07.646329 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e92af0c2-fee3-4f53-8f7f-660c96621af2-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "e92af0c2-fee3-4f53-8f7f-660c96621af2" (UID: "e92af0c2-fee3-4f53-8f7f-660c96621af2"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 20:37:07.646682 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:07.646380 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e92af0c2-fee3-4f53-8f7f-660c96621af2-secret-alertmanager-kube-rbac-proxy-web\") pod \"e92af0c2-fee3-4f53-8f7f-660c96621af2\" (UID: \"e92af0c2-fee3-4f53-8f7f-660c96621af2\") " Jul 21 20:37:07.646682 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:07.646394 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e92af0c2-fee3-4f53-8f7f-660c96621af2-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "e92af0c2-fee3-4f53-8f7f-660c96621af2" (UID: "e92af0c2-fee3-4f53-8f7f-660c96621af2"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 20:37:07.646682 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:07.646420 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e92af0c2-fee3-4f53-8f7f-660c96621af2-tls-assets\") pod \"e92af0c2-fee3-4f53-8f7f-660c96621af2\" (UID: \"e92af0c2-fee3-4f53-8f7f-660c96621af2\") " Jul 21 20:37:07.646682 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:07.646453 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e92af0c2-fee3-4f53-8f7f-660c96621af2-secret-alertmanager-main-tls\") pod \"e92af0c2-fee3-4f53-8f7f-660c96621af2\" (UID: \"e92af0c2-fee3-4f53-8f7f-660c96621af2\") " Jul 21 20:37:07.646682 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:07.646492 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mgknw\" (UniqueName: \"kubernetes.io/projected/e92af0c2-fee3-4f53-8f7f-660c96621af2-kube-api-access-mgknw\") pod \"e92af0c2-fee3-4f53-8f7f-660c96621af2\" (UID: \"e92af0c2-fee3-4f53-8f7f-660c96621af2\") " Jul 21 20:37:07.647085 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:07.646743 2560 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e92af0c2-fee3-4f53-8f7f-660c96621af2-alertmanager-main-db\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\"" Jul 21 20:37:07.647085 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:07.646762 2560 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e92af0c2-fee3-4f53-8f7f-660c96621af2-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\"" Jul 21 20:37:07.647085 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:07.646777 2560 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e92af0c2-fee3-4f53-8f7f-660c96621af2-metrics-client-ca\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\"" Jul 21 20:37:07.648875 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:07.648846 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e92af0c2-fee3-4f53-8f7f-660c96621af2-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "e92af0c2-fee3-4f53-8f7f-660c96621af2" (UID: "e92af0c2-fee3-4f53-8f7f-660c96621af2"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 20:37:07.649235 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:07.649045 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e92af0c2-fee3-4f53-8f7f-660c96621af2-config-out" (OuterVolumeSpecName: "config-out") pod "e92af0c2-fee3-4f53-8f7f-660c96621af2" (UID: "e92af0c2-fee3-4f53-8f7f-660c96621af2"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 20:37:07.649235 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:07.649101 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e92af0c2-fee3-4f53-8f7f-660c96621af2-config-volume" (OuterVolumeSpecName: "config-volume") pod "e92af0c2-fee3-4f53-8f7f-660c96621af2" (UID: "e92af0c2-fee3-4f53-8f7f-660c96621af2"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 20:37:07.649632 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:07.649326 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e92af0c2-fee3-4f53-8f7f-660c96621af2-kube-api-access-mgknw" (OuterVolumeSpecName: "kube-api-access-mgknw") pod "e92af0c2-fee3-4f53-8f7f-660c96621af2" (UID: "e92af0c2-fee3-4f53-8f7f-660c96621af2"). InnerVolumeSpecName "kube-api-access-mgknw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 20:37:07.649632 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:07.649431 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e92af0c2-fee3-4f53-8f7f-660c96621af2-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "e92af0c2-fee3-4f53-8f7f-660c96621af2" (UID: "e92af0c2-fee3-4f53-8f7f-660c96621af2"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 20:37:07.649745 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:07.649626 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e92af0c2-fee3-4f53-8f7f-660c96621af2-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "e92af0c2-fee3-4f53-8f7f-660c96621af2" (UID: "e92af0c2-fee3-4f53-8f7f-660c96621af2"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 20:37:07.651107 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:07.651083 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e92af0c2-fee3-4f53-8f7f-660c96621af2-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "e92af0c2-fee3-4f53-8f7f-660c96621af2" (UID: "e92af0c2-fee3-4f53-8f7f-660c96621af2"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 20:37:07.651234 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:07.651216 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e92af0c2-fee3-4f53-8f7f-660c96621af2-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "e92af0c2-fee3-4f53-8f7f-660c96621af2" (UID: "e92af0c2-fee3-4f53-8f7f-660c96621af2"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 20:37:07.652816 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:07.652790 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e92af0c2-fee3-4f53-8f7f-660c96621af2-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "e92af0c2-fee3-4f53-8f7f-660c96621af2" (UID: "e92af0c2-fee3-4f53-8f7f-660c96621af2"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 20:37:07.661796 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:07.661772 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e92af0c2-fee3-4f53-8f7f-660c96621af2-web-config" (OuterVolumeSpecName: "web-config") pod "e92af0c2-fee3-4f53-8f7f-660c96621af2" (UID: "e92af0c2-fee3-4f53-8f7f-660c96621af2"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 20:37:07.748056 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:07.748039 2560 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e92af0c2-fee3-4f53-8f7f-660c96621af2-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\"" Jul 21 20:37:07.748056 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:07.748057 2560 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e92af0c2-fee3-4f53-8f7f-660c96621af2-config-volume\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\"" Jul 21 20:37:07.748166 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:07.748067 2560 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e92af0c2-fee3-4f53-8f7f-660c96621af2-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\"" Jul 21 20:37:07.748166 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:07.748090 2560 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e92af0c2-fee3-4f53-8f7f-660c96621af2-web-config\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\"" Jul 21 20:37:07.748166 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:07.748098 2560 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e92af0c2-fee3-4f53-8f7f-660c96621af2-cluster-tls-config\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\"" Jul 21 20:37:07.748166 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:07.748106 2560 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e92af0c2-fee3-4f53-8f7f-660c96621af2-config-out\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\"" Jul 21 20:37:07.748166 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:07.748115 2560 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e92af0c2-fee3-4f53-8f7f-660c96621af2-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\"" Jul 21 20:37:07.748166 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:07.748123 2560 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e92af0c2-fee3-4f53-8f7f-660c96621af2-tls-assets\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\"" Jul 21 20:37:07.748166 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:07.748131 2560 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e92af0c2-fee3-4f53-8f7f-660c96621af2-secret-alertmanager-main-tls\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\"" Jul 21 20:37:07.748166 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:07.748139 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mgknw\" (UniqueName: \"kubernetes.io/projected/e92af0c2-fee3-4f53-8f7f-660c96621af2-kube-api-access-mgknw\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\"" Jul 21 20:37:08.475354 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:08.475325 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e92af0c2-fee3-4f53-8f7f-660c96621af2","Type":"ContainerDied","Data":"43a8c984884304ba7f23d88c0b0e66e2af13129303d9f2582c46d5784336dcd5"} Jul 21 20:37:08.475667 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:08.475394 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 21 20:37:08.475667 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:08.475400 2560 scope.go:117] "RemoveContainer" containerID="218203a7d997d738f2fe06e3692f50b3a3c3c7eae54c545e5f35e17de4a357ab" Jul 21 20:37:08.482706 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:08.482637 2560 scope.go:117] "RemoveContainer" containerID="d2ac5a2bb7902f4ae663e78eb61b0d64322d2fd1e620603c17b21e5d0eb46426" Jul 21 20:37:08.493632 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:08.493612 2560 scope.go:117] "RemoveContainer" containerID="443ee738b1bcf43718da2657a8b16c767a75a5817aaecee5eb010f56b4b5e29d" Jul 21 20:37:08.499523 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:08.499502 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 21 20:37:08.500871 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:08.500855 2560 scope.go:117] "RemoveContainer" containerID="63e2f4ef1a359cbf432ffeb1341b1a20e17107cb3fb155b201f36beb79b64b0c" Jul 21 20:37:08.504907 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:08.504889 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 21 20:37:08.507442 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:08.507423 2560 scope.go:117] "RemoveContainer" containerID="1d18248f7158c09d2244150f792f81c61b71eefc5abf7809b470d9e08add8b7a" Jul 21 20:37:08.513932 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:08.513917 2560 scope.go:117] "RemoveContainer" containerID="2c5ea544b708d8d90b0b606a2dc8ddee698d221184eacdb1a23fec71cba5e8ff" Jul 21 20:37:08.520312 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:08.520296 2560 scope.go:117] "RemoveContainer" containerID="80787e5697a2e50b9a54d8cdb2a55272e8785f5fbfb929cd3788df2aebd76db1" Jul 21 20:37:08.529632 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:08.529614 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 21 20:37:08.529884 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:08.529873 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e92af0c2-fee3-4f53-8f7f-660c96621af2" containerName="kube-rbac-proxy" Jul 21 20:37:08.529926 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:08.529885 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="e92af0c2-fee3-4f53-8f7f-660c96621af2" containerName="kube-rbac-proxy" Jul 21 20:37:08.529926 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:08.529899 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e92af0c2-fee3-4f53-8f7f-660c96621af2" containerName="kube-rbac-proxy-web" Jul 21 20:37:08.529926 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:08.529904 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="e92af0c2-fee3-4f53-8f7f-660c96621af2" containerName="kube-rbac-proxy-web" Jul 21 20:37:08.529926 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:08.529913 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e92af0c2-fee3-4f53-8f7f-660c96621af2" containerName="init-config-reloader" Jul 21 20:37:08.529926 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:08.529919 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="e92af0c2-fee3-4f53-8f7f-660c96621af2" containerName="init-config-reloader" Jul 21 20:37:08.530087 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:08.529930 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95b6ae55-056b-4516-af84-c4ee98742e1a" containerName="console" Jul 21 20:37:08.530087 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:08.529935 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="95b6ae55-056b-4516-af84-c4ee98742e1a" containerName="console" Jul 21 20:37:08.530087 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:08.529941 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e92af0c2-fee3-4f53-8f7f-660c96621af2" containerName="prom-label-proxy" Jul 21 20:37:08.530087 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:08.529947 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="e92af0c2-fee3-4f53-8f7f-660c96621af2" containerName="prom-label-proxy" Jul 21 20:37:08.530087 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:08.529953 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e92af0c2-fee3-4f53-8f7f-660c96621af2" containerName="kube-rbac-proxy-metric" Jul 21 20:37:08.530087 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:08.529958 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="e92af0c2-fee3-4f53-8f7f-660c96621af2" containerName="kube-rbac-proxy-metric" Jul 21 20:37:08.530087 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:08.529964 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e92af0c2-fee3-4f53-8f7f-660c96621af2" containerName="alertmanager" Jul 21 20:37:08.530087 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:08.529969 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="e92af0c2-fee3-4f53-8f7f-660c96621af2" containerName="alertmanager" Jul 21 20:37:08.530087 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:08.529975 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e92af0c2-fee3-4f53-8f7f-660c96621af2" containerName="config-reloader" Jul 21 20:37:08.530087 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:08.529979 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="e92af0c2-fee3-4f53-8f7f-660c96621af2" containerName="config-reloader" Jul 21 20:37:08.530087 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:08.530037 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="e92af0c2-fee3-4f53-8f7f-660c96621af2" containerName="config-reloader" Jul 21 20:37:08.530087 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:08.530045 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="e92af0c2-fee3-4f53-8f7f-660c96621af2" containerName="kube-rbac-proxy-metric" Jul 21 20:37:08.530087 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:08.530051 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="95b6ae55-056b-4516-af84-c4ee98742e1a" containerName="console" Jul 21 20:37:08.530087 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:08.530059 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="e92af0c2-fee3-4f53-8f7f-660c96621af2" containerName="alertmanager" Jul 21 20:37:08.530087 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:08.530065 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="e92af0c2-fee3-4f53-8f7f-660c96621af2" containerName="prom-label-proxy" Jul 21 20:37:08.530087 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:08.530070 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="e92af0c2-fee3-4f53-8f7f-660c96621af2" containerName="kube-rbac-proxy-web" Jul 21 20:37:08.530087 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:08.530075 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="e92af0c2-fee3-4f53-8f7f-660c96621af2" containerName="kube-rbac-proxy" Jul 21 20:37:08.533965 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:08.533950 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 21 20:37:08.536808 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:08.536787 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 21 20:37:08.536926 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:08.536787 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 21 20:37:08.536926 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:08.536820 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 21 20:37:08.536926 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:08.536828 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 21 20:37:08.537130 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:08.536949 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-kn8q7\"" Jul 21 20:37:08.537199 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:08.537183 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 21 20:37:08.537257 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:08.537229 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 21 20:37:08.537327 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:08.537233 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 21 20:37:08.537327 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:08.537183 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 21 20:37:08.541542 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:08.541524 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 21 20:37:08.546560 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:08.546540 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 21 20:37:08.654785 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:08.654762 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e3e6915a-468f-4dc9-a78d-056006143297-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e3e6915a-468f-4dc9-a78d-056006143297\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 20:37:08.654883 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:08.654789 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e3e6915a-468f-4dc9-a78d-056006143297-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e3e6915a-468f-4dc9-a78d-056006143297\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 20:37:08.654883 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:08.654810 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e3e6915a-468f-4dc9-a78d-056006143297-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e3e6915a-468f-4dc9-a78d-056006143297\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 20:37:08.654883 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:08.654828 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e3e6915a-468f-4dc9-a78d-056006143297-config-out\") pod \"alertmanager-main-0\" (UID: \"e3e6915a-468f-4dc9-a78d-056006143297\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 20:37:08.654883 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:08.654842 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e3e6915a-468f-4dc9-a78d-056006143297-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e3e6915a-468f-4dc9-a78d-056006143297\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 20:37:08.655043 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:08.654892 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e3e6915a-468f-4dc9-a78d-056006143297-web-config\") pod \"alertmanager-main-0\" (UID: \"e3e6915a-468f-4dc9-a78d-056006143297\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 20:37:08.655043 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:08.654909 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e3e6915a-468f-4dc9-a78d-056006143297-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e3e6915a-468f-4dc9-a78d-056006143297\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 20:37:08.655043 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:08.654957 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e3e6915a-468f-4dc9-a78d-056006143297-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e3e6915a-468f-4dc9-a78d-056006143297\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 20:37:08.655043 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:08.654971 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9xr72\" (UniqueName: \"kubernetes.io/projected/e3e6915a-468f-4dc9-a78d-056006143297-kube-api-access-9xr72\") pod \"alertmanager-main-0\" (UID: \"e3e6915a-468f-4dc9-a78d-056006143297\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 20:37:08.655043 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:08.654988 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e3e6915a-468f-4dc9-a78d-056006143297-config-volume\") pod \"alertmanager-main-0\" (UID: \"e3e6915a-468f-4dc9-a78d-056006143297\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 20:37:08.655207 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:08.655044 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e3e6915a-468f-4dc9-a78d-056006143297-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e3e6915a-468f-4dc9-a78d-056006143297\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 20:37:08.655207 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:08.655077 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e3e6915a-468f-4dc9-a78d-056006143297-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e3e6915a-468f-4dc9-a78d-056006143297\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 20:37:08.655207 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:08.655095 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3e6915a-468f-4dc9-a78d-056006143297-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e3e6915a-468f-4dc9-a78d-056006143297\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 20:37:08.756050 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:08.756024 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e3e6915a-468f-4dc9-a78d-056006143297-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e3e6915a-468f-4dc9-a78d-056006143297\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 20:37:08.756050 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:08.756051 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9xr72\" (UniqueName: \"kubernetes.io/projected/e3e6915a-468f-4dc9-a78d-056006143297-kube-api-access-9xr72\") pod \"alertmanager-main-0\" (UID: \"e3e6915a-468f-4dc9-a78d-056006143297\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 20:37:08.756210 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:08.756067 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e3e6915a-468f-4dc9-a78d-056006143297-config-volume\") pod \"alertmanager-main-0\" (UID: \"e3e6915a-468f-4dc9-a78d-056006143297\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 20:37:08.756210 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:08.756082 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e3e6915a-468f-4dc9-a78d-056006143297-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e3e6915a-468f-4dc9-a78d-056006143297\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 20:37:08.756210 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:08.756103 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e3e6915a-468f-4dc9-a78d-056006143297-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e3e6915a-468f-4dc9-a78d-056006143297\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 20:37:08.756210 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:08.756127 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3e6915a-468f-4dc9-a78d-056006143297-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e3e6915a-468f-4dc9-a78d-056006143297\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 20:37:08.756210 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:08.756166 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e3e6915a-468f-4dc9-a78d-056006143297-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e3e6915a-468f-4dc9-a78d-056006143297\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 20:37:08.756210 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:08.756189 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e3e6915a-468f-4dc9-a78d-056006143297-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e3e6915a-468f-4dc9-a78d-056006143297\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 20:37:08.756490 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:08.756222 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e3e6915a-468f-4dc9-a78d-056006143297-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e3e6915a-468f-4dc9-a78d-056006143297\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 20:37:08.756490 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:08.756247 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e3e6915a-468f-4dc9-a78d-056006143297-config-out\") pod \"alertmanager-main-0\" (UID: \"e3e6915a-468f-4dc9-a78d-056006143297\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 20:37:08.756490 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:08.756268 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e3e6915a-468f-4dc9-a78d-056006143297-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e3e6915a-468f-4dc9-a78d-056006143297\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 20:37:08.756490 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:08.756321 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e3e6915a-468f-4dc9-a78d-056006143297-web-config\") pod \"alertmanager-main-0\" (UID: \"e3e6915a-468f-4dc9-a78d-056006143297\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 20:37:08.756490 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:08.756351 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e3e6915a-468f-4dc9-a78d-056006143297-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e3e6915a-468f-4dc9-a78d-056006143297\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 20:37:08.757327 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:08.757258 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3e6915a-468f-4dc9-a78d-056006143297-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e3e6915a-468f-4dc9-a78d-056006143297\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 20:37:08.757440 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:08.757363 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e3e6915a-468f-4dc9-a78d-056006143297-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e3e6915a-468f-4dc9-a78d-056006143297\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 20:37:08.757619 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:08.757598 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e3e6915a-468f-4dc9-a78d-056006143297-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e3e6915a-468f-4dc9-a78d-056006143297\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 20:37:08.758954 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:08.758931 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e3e6915a-468f-4dc9-a78d-056006143297-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e3e6915a-468f-4dc9-a78d-056006143297\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 20:37:08.759182 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:08.759147 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e3e6915a-468f-4dc9-a78d-056006143297-config-volume\") pod \"alertmanager-main-0\" (UID: \"e3e6915a-468f-4dc9-a78d-056006143297\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 20:37:08.759609 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:08.759590 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e3e6915a-468f-4dc9-a78d-056006143297-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e3e6915a-468f-4dc9-a78d-056006143297\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 20:37:08.759809 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:08.759787 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e3e6915a-468f-4dc9-a78d-056006143297-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e3e6915a-468f-4dc9-a78d-056006143297\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 20:37:08.759999 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:08.759975 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e3e6915a-468f-4dc9-a78d-056006143297-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e3e6915a-468f-4dc9-a78d-056006143297\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 20:37:08.760099 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:08.760080 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e3e6915a-468f-4dc9-a78d-056006143297-config-out\") pod \"alertmanager-main-0\" (UID: \"e3e6915a-468f-4dc9-a78d-056006143297\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 20:37:08.760305 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:08.760287 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e3e6915a-468f-4dc9-a78d-056006143297-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e3e6915a-468f-4dc9-a78d-056006143297\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 20:37:08.760703 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:08.760683 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e3e6915a-468f-4dc9-a78d-056006143297-web-config\") pod \"alertmanager-main-0\" (UID: \"e3e6915a-468f-4dc9-a78d-056006143297\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 20:37:08.760766 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:08.760732 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e3e6915a-468f-4dc9-a78d-056006143297-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e3e6915a-468f-4dc9-a78d-056006143297\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 20:37:08.764333 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:08.764310 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9xr72\" (UniqueName: \"kubernetes.io/projected/e3e6915a-468f-4dc9-a78d-056006143297-kube-api-access-9xr72\") pod \"alertmanager-main-0\" (UID: \"e3e6915a-468f-4dc9-a78d-056006143297\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 20:37:08.842656 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:08.842624 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 21 20:37:08.971451 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:08.971392 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 21 20:37:08.973543 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:37:08.973518 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3e6915a_468f_4dc9_a78d_056006143297.slice/crio-52fa7a8e41e48e602dfd601775ac400e3f661f5ad76502b41a8731f02dea0f0e WatchSource:0}: Error finding container 52fa7a8e41e48e602dfd601775ac400e3f661f5ad76502b41a8731f02dea0f0e: Status 404 returned error can't find the container with id 52fa7a8e41e48e602dfd601775ac400e3f661f5ad76502b41a8731f02dea0f0e Jul 21 20:37:09.481307 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:09.481261 2560 generic.go:356] "Generic (PLEG): container finished" podID="e3e6915a-468f-4dc9-a78d-056006143297" containerID="f014cbf70c873676c4c986a16be8ba1d2c0b90906f2638347961d1749f9677fe" exitCode=0 Jul 21 20:37:09.481631 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:09.481355 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e3e6915a-468f-4dc9-a78d-056006143297","Type":"ContainerDied","Data":"f014cbf70c873676c4c986a16be8ba1d2c0b90906f2638347961d1749f9677fe"} Jul 21 20:37:09.481631 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:09.481429 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e3e6915a-468f-4dc9-a78d-056006143297","Type":"ContainerStarted","Data":"52fa7a8e41e48e602dfd601775ac400e3f661f5ad76502b41a8731f02dea0f0e"} Jul 21 20:37:09.869914 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:09.869880 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e92af0c2-fee3-4f53-8f7f-660c96621af2" path="/var/lib/kubelet/pods/e92af0c2-fee3-4f53-8f7f-660c96621af2/volumes" Jul 21 20:37:10.490187 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:10.490150 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e3e6915a-468f-4dc9-a78d-056006143297","Type":"ContainerStarted","Data":"13af66850f1cd9b928379a0b3782443c22f7b14a58139e6fde868291c25d2c0e"} Jul 21 20:37:10.490544 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:10.490226 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e3e6915a-468f-4dc9-a78d-056006143297","Type":"ContainerStarted","Data":"f1775e66e421955347cbd7ce5798a6bc8ea81519ec5e0af91afad30a72aaff0d"} Jul 21 20:37:10.490544 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:10.490258 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e3e6915a-468f-4dc9-a78d-056006143297","Type":"ContainerStarted","Data":"64595bdd6cbfc54a809f774211e4f9087e57a5726a1b7d2adda58d33297fe644"} Jul 21 20:37:10.490544 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:10.490290 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e3e6915a-468f-4dc9-a78d-056006143297","Type":"ContainerStarted","Data":"7fd0e1b6a5a02a004db5a8d79581a435aa7a954f74454dfc80f0883d25e94dd4"} Jul 21 20:37:10.490544 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:10.490318 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e3e6915a-468f-4dc9-a78d-056006143297","Type":"ContainerStarted","Data":"7c812c926169188ceca3e33a20a4014efa0e36359fec1d7e93ee5d6d34c841a0"} Jul 21 20:37:10.490544 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:10.490349 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e3e6915a-468f-4dc9-a78d-056006143297","Type":"ContainerStarted","Data":"eaa4d50110f4c52633c2d921d10177d6e2408ac582d4be0fdc6d6dbd521f9cae"} Jul 21 20:37:10.517548 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:10.517500 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.503985644 podStartE2EDuration="2.517485276s" totalImagesPullingTime="0s" totalInitContainerRuntime="13.499632ms" isStatefulPod=false podCreationTimestamp="2026-07-21 20:37:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:37:10.515774303 +0000 UTC m=+123.279011246" watchObservedRunningTime="2026-07-21 20:37:10.517485276 +0000 UTC m=+123.280722218" Jul 21 20:37:11.331343 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:11.331306 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-7d59944ccd-9gmsq"] Jul 21 20:37:11.333833 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:11.333817 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7d59944ccd-9gmsq" Jul 21 20:37:11.336727 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:11.336667 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 21 20:37:11.336727 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:11.336710 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 21 20:37:11.337094 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:11.337076 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 21 20:37:11.337188 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:11.337083 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-hvddd\"" Jul 21 20:37:11.337188 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:11.337111 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 21 20:37:11.337188 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:11.337124 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 21 20:37:11.341742 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:11.341721 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 21 20:37:11.351877 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:11.351851 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7d59944ccd-9gmsq"] Jul 21 20:37:11.479097 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:11.479075 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/80c425f8-3c06-46c8-a60d-9a8f607a2df3-secret-telemeter-client\") pod \"telemeter-client-7d59944ccd-9gmsq\" (UID: \"80c425f8-3c06-46c8-a60d-9a8f607a2df3\") " pod="openshift-monitoring/telemeter-client-7d59944ccd-9gmsq" Jul 21 20:37:11.479177 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:11.479107 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dkxjm\" (UniqueName: \"kubernetes.io/projected/80c425f8-3c06-46c8-a60d-9a8f607a2df3-kube-api-access-dkxjm\") pod \"telemeter-client-7d59944ccd-9gmsq\" (UID: \"80c425f8-3c06-46c8-a60d-9a8f607a2df3\") " pod="openshift-monitoring/telemeter-client-7d59944ccd-9gmsq" Jul 21 20:37:11.479177 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:11.479129 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/80c425f8-3c06-46c8-a60d-9a8f607a2df3-federate-client-tls\") pod \"telemeter-client-7d59944ccd-9gmsq\" (UID: \"80c425f8-3c06-46c8-a60d-9a8f607a2df3\") " pod="openshift-monitoring/telemeter-client-7d59944ccd-9gmsq" Jul 21 20:37:11.479254 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:11.479209 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/80c425f8-3c06-46c8-a60d-9a8f607a2df3-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7d59944ccd-9gmsq\" (UID: \"80c425f8-3c06-46c8-a60d-9a8f607a2df3\") " pod="openshift-monitoring/telemeter-client-7d59944ccd-9gmsq" Jul 21 20:37:11.479285 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:11.479273 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80c425f8-3c06-46c8-a60d-9a8f607a2df3-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7d59944ccd-9gmsq\" (UID: \"80c425f8-3c06-46c8-a60d-9a8f607a2df3\") " pod="openshift-monitoring/telemeter-client-7d59944ccd-9gmsq" Jul 21 20:37:11.479321 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:11.479299 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80c425f8-3c06-46c8-a60d-9a8f607a2df3-serving-certs-ca-bundle\") pod \"telemeter-client-7d59944ccd-9gmsq\" (UID: \"80c425f8-3c06-46c8-a60d-9a8f607a2df3\") " pod="openshift-monitoring/telemeter-client-7d59944ccd-9gmsq" Jul 21 20:37:11.479354 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:11.479317 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/80c425f8-3c06-46c8-a60d-9a8f607a2df3-telemeter-client-tls\") pod \"telemeter-client-7d59944ccd-9gmsq\" (UID: \"80c425f8-3c06-46c8-a60d-9a8f607a2df3\") " pod="openshift-monitoring/telemeter-client-7d59944ccd-9gmsq" Jul 21 20:37:11.479387 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:11.479354 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/80c425f8-3c06-46c8-a60d-9a8f607a2df3-metrics-client-ca\") pod \"telemeter-client-7d59944ccd-9gmsq\" (UID: \"80c425f8-3c06-46c8-a60d-9a8f607a2df3\") " pod="openshift-monitoring/telemeter-client-7d59944ccd-9gmsq" Jul 21 20:37:11.580521 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:11.580496 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/80c425f8-3c06-46c8-a60d-9a8f607a2df3-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7d59944ccd-9gmsq\" (UID: \"80c425f8-3c06-46c8-a60d-9a8f607a2df3\") " pod="openshift-monitoring/telemeter-client-7d59944ccd-9gmsq" Jul 21 20:37:11.580863 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:11.580572 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80c425f8-3c06-46c8-a60d-9a8f607a2df3-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7d59944ccd-9gmsq\" (UID: \"80c425f8-3c06-46c8-a60d-9a8f607a2df3\") " pod="openshift-monitoring/telemeter-client-7d59944ccd-9gmsq" Jul 21 20:37:11.580863 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:11.580776 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80c425f8-3c06-46c8-a60d-9a8f607a2df3-serving-certs-ca-bundle\") pod \"telemeter-client-7d59944ccd-9gmsq\" (UID: \"80c425f8-3c06-46c8-a60d-9a8f607a2df3\") " pod="openshift-monitoring/telemeter-client-7d59944ccd-9gmsq" Jul 21 20:37:11.580863 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:11.580806 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/80c425f8-3c06-46c8-a60d-9a8f607a2df3-telemeter-client-tls\") pod \"telemeter-client-7d59944ccd-9gmsq\" (UID: \"80c425f8-3c06-46c8-a60d-9a8f607a2df3\") " pod="openshift-monitoring/telemeter-client-7d59944ccd-9gmsq" Jul 21 20:37:11.580863 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:11.580836 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/80c425f8-3c06-46c8-a60d-9a8f607a2df3-metrics-client-ca\") pod \"telemeter-client-7d59944ccd-9gmsq\" (UID: \"80c425f8-3c06-46c8-a60d-9a8f607a2df3\") " pod="openshift-monitoring/telemeter-client-7d59944ccd-9gmsq" Jul 21 20:37:11.580863 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:11.580862 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/80c425f8-3c06-46c8-a60d-9a8f607a2df3-secret-telemeter-client\") pod \"telemeter-client-7d59944ccd-9gmsq\" (UID: \"80c425f8-3c06-46c8-a60d-9a8f607a2df3\") " pod="openshift-monitoring/telemeter-client-7d59944ccd-9gmsq" Jul 21 20:37:11.581155 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:11.580972 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dkxjm\" (UniqueName: \"kubernetes.io/projected/80c425f8-3c06-46c8-a60d-9a8f607a2df3-kube-api-access-dkxjm\") pod \"telemeter-client-7d59944ccd-9gmsq\" (UID: \"80c425f8-3c06-46c8-a60d-9a8f607a2df3\") " pod="openshift-monitoring/telemeter-client-7d59944ccd-9gmsq" Jul 21 20:37:11.581155 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:11.581073 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/80c425f8-3c06-46c8-a60d-9a8f607a2df3-federate-client-tls\") pod \"telemeter-client-7d59944ccd-9gmsq\" (UID: \"80c425f8-3c06-46c8-a60d-9a8f607a2df3\") " pod="openshift-monitoring/telemeter-client-7d59944ccd-9gmsq" Jul 21 20:37:11.581501 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:11.581446 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80c425f8-3c06-46c8-a60d-9a8f607a2df3-serving-certs-ca-bundle\") pod \"telemeter-client-7d59944ccd-9gmsq\" (UID: \"80c425f8-3c06-46c8-a60d-9a8f607a2df3\") " pod="openshift-monitoring/telemeter-client-7d59944ccd-9gmsq" Jul 21 20:37:11.581585 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:11.581540 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80c425f8-3c06-46c8-a60d-9a8f607a2df3-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7d59944ccd-9gmsq\" (UID: \"80c425f8-3c06-46c8-a60d-9a8f607a2df3\") " pod="openshift-monitoring/telemeter-client-7d59944ccd-9gmsq" Jul 21 20:37:11.581726 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:11.581700 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/80c425f8-3c06-46c8-a60d-9a8f607a2df3-metrics-client-ca\") pod \"telemeter-client-7d59944ccd-9gmsq\" (UID: \"80c425f8-3c06-46c8-a60d-9a8f607a2df3\") " pod="openshift-monitoring/telemeter-client-7d59944ccd-9gmsq" Jul 21 20:37:11.583337 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:11.583293 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/80c425f8-3c06-46c8-a60d-9a8f607a2df3-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7d59944ccd-9gmsq\" (UID: \"80c425f8-3c06-46c8-a60d-9a8f607a2df3\") " pod="openshift-monitoring/telemeter-client-7d59944ccd-9gmsq" Jul 21 20:37:11.583417 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:11.583402 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/80c425f8-3c06-46c8-a60d-9a8f607a2df3-secret-telemeter-client\") pod \"telemeter-client-7d59944ccd-9gmsq\" (UID: \"80c425f8-3c06-46c8-a60d-9a8f607a2df3\") " pod="openshift-monitoring/telemeter-client-7d59944ccd-9gmsq" Jul 21 20:37:11.583621 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:11.583605 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/80c425f8-3c06-46c8-a60d-9a8f607a2df3-federate-client-tls\") pod \"telemeter-client-7d59944ccd-9gmsq\" (UID: \"80c425f8-3c06-46c8-a60d-9a8f607a2df3\") " pod="openshift-monitoring/telemeter-client-7d59944ccd-9gmsq" Jul 21 20:37:11.583880 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:11.583858 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/80c425f8-3c06-46c8-a60d-9a8f607a2df3-telemeter-client-tls\") pod \"telemeter-client-7d59944ccd-9gmsq\" (UID: \"80c425f8-3c06-46c8-a60d-9a8f607a2df3\") " pod="openshift-monitoring/telemeter-client-7d59944ccd-9gmsq" Jul 21 20:37:11.590964 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:11.590946 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dkxjm\" (UniqueName: \"kubernetes.io/projected/80c425f8-3c06-46c8-a60d-9a8f607a2df3-kube-api-access-dkxjm\") pod \"telemeter-client-7d59944ccd-9gmsq\" (UID: \"80c425f8-3c06-46c8-a60d-9a8f607a2df3\") " pod="openshift-monitoring/telemeter-client-7d59944ccd-9gmsq" Jul 21 20:37:11.598588 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:11.598567 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 21 20:37:11.598820 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:11.598801 2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="40cc806e-9f77-4bc3-9dd6-2cd360a1bac6" containerName="prometheus" containerID="cri-o://32eae96e1bace0d923788f6d34eb2d93b4cd7cba943a7fa1235cffd984b55aff" gracePeriod=600 Jul 21 20:37:11.598903 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:11.598874 2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="40cc806e-9f77-4bc3-9dd6-2cd360a1bac6" containerName="kube-rbac-proxy-thanos" containerID="cri-o://3005987eb65475568d207ee32909f010c033cbd4d879d76ab2ef4b461ebb12a9" gracePeriod=600 Jul 21 20:37:11.598903 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:11.598890 2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="40cc806e-9f77-4bc3-9dd6-2cd360a1bac6" containerName="kube-rbac-proxy" containerID="cri-o://c392d42992f48fec37c232d9a9f176c730eff31cef9fabd87921070aecc22291" gracePeriod=600 Jul 21 20:37:11.599039 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:11.598897 2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="40cc806e-9f77-4bc3-9dd6-2cd360a1bac6" containerName="kube-rbac-proxy-web" containerID="cri-o://8e353668a12482108662cec296fb3be7955183a0dde443c9906920d82287df87" gracePeriod=600 Jul 21 20:37:11.599039 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:11.598934 2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="40cc806e-9f77-4bc3-9dd6-2cd360a1bac6" containerName="thanos-sidecar" containerID="cri-o://6206baea6b1778a9657490a3763fbdbc89af8c84c42d8b2ccbc0d7a4eb9ece0a" gracePeriod=600 Jul 21 20:37:11.599039 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:11.598938 2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="40cc806e-9f77-4bc3-9dd6-2cd360a1bac6" containerName="config-reloader" containerID="cri-o://b6179621cbd2da7d55fb9e3bd2dd8e45903a982a4f0d26062365ba17f3af84dc" gracePeriod=600 Jul 21 20:37:11.643402 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:11.643383 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7d59944ccd-9gmsq" Jul 21 20:37:11.777183 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:11.777155 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7d59944ccd-9gmsq"] Jul 21 20:37:11.784845 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:37:11.784824 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80c425f8_3c06_46c8_a60d_9a8f607a2df3.slice/crio-c348b9feb928f88582c20c1550a3457a1fa8ea23bd8e3af51b046a56edf54c7f WatchSource:0}: Error finding container c348b9feb928f88582c20c1550a3457a1fa8ea23bd8e3af51b046a56edf54c7f: Status 404 returned error can't find the container with id c348b9feb928f88582c20c1550a3457a1fa8ea23bd8e3af51b046a56edf54c7f Jul 21 20:37:11.853920 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:11.853899 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 21 20:37:11.984343 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:11.984318 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/40cc806e-9f77-4bc3-9dd6-2cd360a1bac6-thanos-prometheus-http-client-file\") pod \"40cc806e-9f77-4bc3-9dd6-2cd360a1bac6\" (UID: \"40cc806e-9f77-4bc3-9dd6-2cd360a1bac6\") " Jul 21 20:37:11.984343 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:11.984347 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/40cc806e-9f77-4bc3-9dd6-2cd360a1bac6-prometheus-k8s-rulefiles-0\") pod \"40cc806e-9f77-4bc3-9dd6-2cd360a1bac6\" (UID: \"40cc806e-9f77-4bc3-9dd6-2cd360a1bac6\") " Jul 21 20:37:11.984569 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:11.984363 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/40cc806e-9f77-4bc3-9dd6-2cd360a1bac6-configmap-serving-certs-ca-bundle\") pod \"40cc806e-9f77-4bc3-9dd6-2cd360a1bac6\" (UID: \"40cc806e-9f77-4bc3-9dd6-2cd360a1bac6\") " Jul 21 20:37:11.984569 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:11.984382 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/40cc806e-9f77-4bc3-9dd6-2cd360a1bac6-secret-kube-rbac-proxy\") pod \"40cc806e-9f77-4bc3-9dd6-2cd360a1bac6\" (UID: \"40cc806e-9f77-4bc3-9dd6-2cd360a1bac6\") " Jul 21 20:37:11.984569 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:11.984409 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/40cc806e-9f77-4bc3-9dd6-2cd360a1bac6-tls-assets\") pod \"40cc806e-9f77-4bc3-9dd6-2cd360a1bac6\" (UID: \"40cc806e-9f77-4bc3-9dd6-2cd360a1bac6\") " Jul 21 20:37:11.984569 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:11.984561 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/40cc806e-9f77-4bc3-9dd6-2cd360a1bac6-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"40cc806e-9f77-4bc3-9dd6-2cd360a1bac6\" (UID: \"40cc806e-9f77-4bc3-9dd6-2cd360a1bac6\") " Jul 21 20:37:11.984763 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:11.984597 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x4p6n\" (UniqueName: \"kubernetes.io/projected/40cc806e-9f77-4bc3-9dd6-2cd360a1bac6-kube-api-access-x4p6n\") pod \"40cc806e-9f77-4bc3-9dd6-2cd360a1bac6\" (UID: \"40cc806e-9f77-4bc3-9dd6-2cd360a1bac6\") " Jul 21 20:37:11.984763 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:11.984634 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/40cc806e-9f77-4bc3-9dd6-2cd360a1bac6-prometheus-k8s-db\") pod \"40cc806e-9f77-4bc3-9dd6-2cd360a1bac6\" (UID: \"40cc806e-9f77-4bc3-9dd6-2cd360a1bac6\") " Jul 21 20:37:11.984763 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:11.984661 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/40cc806e-9f77-4bc3-9dd6-2cd360a1bac6-secret-grpc-tls\") pod \"40cc806e-9f77-4bc3-9dd6-2cd360a1bac6\" (UID: \"40cc806e-9f77-4bc3-9dd6-2cd360a1bac6\") " Jul 21 20:37:11.984763 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:11.984689 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/40cc806e-9f77-4bc3-9dd6-2cd360a1bac6-prometheus-k8s-rulefiles-2\") pod \"40cc806e-9f77-4bc3-9dd6-2cd360a1bac6\" (UID: \"40cc806e-9f77-4bc3-9dd6-2cd360a1bac6\") " Jul 21 20:37:11.984763 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:11.984713 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/40cc806e-9f77-4bc3-9dd6-2cd360a1bac6-web-config\") pod \"40cc806e-9f77-4bc3-9dd6-2cd360a1bac6\" (UID: \"40cc806e-9f77-4bc3-9dd6-2cd360a1bac6\") " Jul 21 20:37:11.984943 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:11.984765 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/40cc806e-9f77-4bc3-9dd6-2cd360a1bac6-secret-metrics-client-certs\") pod \"40cc806e-9f77-4bc3-9dd6-2cd360a1bac6\" (UID: \"40cc806e-9f77-4bc3-9dd6-2cd360a1bac6\") " Jul 21 20:37:11.984943 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:11.984787 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/40cc806e-9f77-4bc3-9dd6-2cd360a1bac6-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "40cc806e-9f77-4bc3-9dd6-2cd360a1bac6" (UID: "40cc806e-9f77-4bc3-9dd6-2cd360a1bac6"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 20:37:11.984943 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:11.984796 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/40cc806e-9f77-4bc3-9dd6-2cd360a1bac6-configmap-metrics-client-ca\") pod \"40cc806e-9f77-4bc3-9dd6-2cd360a1bac6\" (UID: \"40cc806e-9f77-4bc3-9dd6-2cd360a1bac6\") " Jul 21 20:37:11.984943 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:11.984867 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/40cc806e-9f77-4bc3-9dd6-2cd360a1bac6-configmap-kubelet-serving-ca-bundle\") pod \"40cc806e-9f77-4bc3-9dd6-2cd360a1bac6\" (UID: \"40cc806e-9f77-4bc3-9dd6-2cd360a1bac6\") " Jul 21 20:37:11.984943 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:11.984897 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/40cc806e-9f77-4bc3-9dd6-2cd360a1bac6-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"40cc806e-9f77-4bc3-9dd6-2cd360a1bac6\" (UID: \"40cc806e-9f77-4bc3-9dd6-2cd360a1bac6\") " Jul 21 20:37:11.985208 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:11.985106 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/40cc806e-9f77-4bc3-9dd6-2cd360a1bac6-config-out\") pod \"40cc806e-9f77-4bc3-9dd6-2cd360a1bac6\" (UID: \"40cc806e-9f77-4bc3-9dd6-2cd360a1bac6\") " Jul 21 20:37:11.985208 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:11.985137 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/40cc806e-9f77-4bc3-9dd6-2cd360a1bac6-prometheus-k8s-rulefiles-1\") pod \"40cc806e-9f77-4bc3-9dd6-2cd360a1bac6\" (UID: \"40cc806e-9f77-4bc3-9dd6-2cd360a1bac6\") " Jul 21 20:37:11.985208 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:11.985174 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/40cc806e-9f77-4bc3-9dd6-2cd360a1bac6-secret-prometheus-k8s-tls\") pod \"40cc806e-9f77-4bc3-9dd6-2cd360a1bac6\" (UID: \"40cc806e-9f77-4bc3-9dd6-2cd360a1bac6\") " Jul 21 20:37:11.985208 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:11.985190 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/40cc806e-9f77-4bc3-9dd6-2cd360a1bac6-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "40cc806e-9f77-4bc3-9dd6-2cd360a1bac6" (UID: "40cc806e-9f77-4bc3-9dd6-2cd360a1bac6"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 20:37:11.985405 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:11.985222 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/40cc806e-9f77-4bc3-9dd6-2cd360a1bac6-prometheus-trusted-ca-bundle\") pod \"40cc806e-9f77-4bc3-9dd6-2cd360a1bac6\" (UID: \"40cc806e-9f77-4bc3-9dd6-2cd360a1bac6\") " Jul 21 20:37:11.985405 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:11.985247 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/40cc806e-9f77-4bc3-9dd6-2cd360a1bac6-config\") pod \"40cc806e-9f77-4bc3-9dd6-2cd360a1bac6\" (UID: \"40cc806e-9f77-4bc3-9dd6-2cd360a1bac6\") " Jul 21 20:37:11.985405 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:11.985279 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/40cc806e-9f77-4bc3-9dd6-2cd360a1bac6-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "40cc806e-9f77-4bc3-9dd6-2cd360a1bac6" (UID: "40cc806e-9f77-4bc3-9dd6-2cd360a1bac6"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 20:37:11.985563 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:11.985520 2560 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/40cc806e-9f77-4bc3-9dd6-2cd360a1bac6-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\"" Jul 21 20:37:11.985563 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:11.985540 2560 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/40cc806e-9f77-4bc3-9dd6-2cd360a1bac6-configmap-metrics-client-ca\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\"" Jul 21 20:37:11.985563 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:11.985556 2560 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/40cc806e-9f77-4bc3-9dd6-2cd360a1bac6-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\"" Jul 21 20:37:11.987706 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:11.985863 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/40cc806e-9f77-4bc3-9dd6-2cd360a1bac6-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "40cc806e-9f77-4bc3-9dd6-2cd360a1bac6" (UID: "40cc806e-9f77-4bc3-9dd6-2cd360a1bac6"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 20:37:11.987706 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:11.986280 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/40cc806e-9f77-4bc3-9dd6-2cd360a1bac6-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "40cc806e-9f77-4bc3-9dd6-2cd360a1bac6" (UID: "40cc806e-9f77-4bc3-9dd6-2cd360a1bac6"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 20:37:11.987706 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:11.986785 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/40cc806e-9f77-4bc3-9dd6-2cd360a1bac6-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "40cc806e-9f77-4bc3-9dd6-2cd360a1bac6" (UID: "40cc806e-9f77-4bc3-9dd6-2cd360a1bac6"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 20:37:11.987706 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:11.987367 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/40cc806e-9f77-4bc3-9dd6-2cd360a1bac6-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "40cc806e-9f77-4bc3-9dd6-2cd360a1bac6" (UID: "40cc806e-9f77-4bc3-9dd6-2cd360a1bac6"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 20:37:11.988080 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:11.987845 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/40cc806e-9f77-4bc3-9dd6-2cd360a1bac6-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "40cc806e-9f77-4bc3-9dd6-2cd360a1bac6" (UID: "40cc806e-9f77-4bc3-9dd6-2cd360a1bac6"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 20:37:11.988143 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:11.988082 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/40cc806e-9f77-4bc3-9dd6-2cd360a1bac6-kube-api-access-x4p6n" (OuterVolumeSpecName: "kube-api-access-x4p6n") pod "40cc806e-9f77-4bc3-9dd6-2cd360a1bac6" (UID: "40cc806e-9f77-4bc3-9dd6-2cd360a1bac6"). InnerVolumeSpecName "kube-api-access-x4p6n". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 20:37:11.988198 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:11.988143 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/40cc806e-9f77-4bc3-9dd6-2cd360a1bac6-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "40cc806e-9f77-4bc3-9dd6-2cd360a1bac6" (UID: "40cc806e-9f77-4bc3-9dd6-2cd360a1bac6"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 20:37:11.988581 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:11.988553 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/40cc806e-9f77-4bc3-9dd6-2cd360a1bac6-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "40cc806e-9f77-4bc3-9dd6-2cd360a1bac6" (UID: "40cc806e-9f77-4bc3-9dd6-2cd360a1bac6"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 20:37:11.988675 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:11.988643 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/40cc806e-9f77-4bc3-9dd6-2cd360a1bac6-config-out" (OuterVolumeSpecName: "config-out") pod "40cc806e-9f77-4bc3-9dd6-2cd360a1bac6" (UID: "40cc806e-9f77-4bc3-9dd6-2cd360a1bac6"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 20:37:11.988951 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:11.988912 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/40cc806e-9f77-4bc3-9dd6-2cd360a1bac6-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "40cc806e-9f77-4bc3-9dd6-2cd360a1bac6" (UID: "40cc806e-9f77-4bc3-9dd6-2cd360a1bac6"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 20:37:11.989077 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:11.989004 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/40cc806e-9f77-4bc3-9dd6-2cd360a1bac6-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "40cc806e-9f77-4bc3-9dd6-2cd360a1bac6" (UID: "40cc806e-9f77-4bc3-9dd6-2cd360a1bac6"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 20:37:11.989219 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:11.989195 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/40cc806e-9f77-4bc3-9dd6-2cd360a1bac6-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "40cc806e-9f77-4bc3-9dd6-2cd360a1bac6" (UID: "40cc806e-9f77-4bc3-9dd6-2cd360a1bac6"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 20:37:11.989539 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:11.989513 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/40cc806e-9f77-4bc3-9dd6-2cd360a1bac6-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "40cc806e-9f77-4bc3-9dd6-2cd360a1bac6" (UID: "40cc806e-9f77-4bc3-9dd6-2cd360a1bac6"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 20:37:11.989964 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:11.989944 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/40cc806e-9f77-4bc3-9dd6-2cd360a1bac6-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "40cc806e-9f77-4bc3-9dd6-2cd360a1bac6" (UID: "40cc806e-9f77-4bc3-9dd6-2cd360a1bac6"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 20:37:11.990088 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:11.989988 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/40cc806e-9f77-4bc3-9dd6-2cd360a1bac6-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "40cc806e-9f77-4bc3-9dd6-2cd360a1bac6" (UID: "40cc806e-9f77-4bc3-9dd6-2cd360a1bac6"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 20:37:11.990160 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:11.990137 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/40cc806e-9f77-4bc3-9dd6-2cd360a1bac6-config" (OuterVolumeSpecName: "config") pod "40cc806e-9f77-4bc3-9dd6-2cd360a1bac6" (UID: "40cc806e-9f77-4bc3-9dd6-2cd360a1bac6"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 20:37:11.998254 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:11.998234 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/40cc806e-9f77-4bc3-9dd6-2cd360a1bac6-web-config" (OuterVolumeSpecName: "web-config") pod "40cc806e-9f77-4bc3-9dd6-2cd360a1bac6" (UID: "40cc806e-9f77-4bc3-9dd6-2cd360a1bac6"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 20:37:12.086698 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.086676 2560 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/40cc806e-9f77-4bc3-9dd6-2cd360a1bac6-secret-prometheus-k8s-tls\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\"" Jul 21 20:37:12.086698 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.086696 2560 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/40cc806e-9f77-4bc3-9dd6-2cd360a1bac6-prometheus-trusted-ca-bundle\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\"" Jul 21 20:37:12.086817 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.086706 2560 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/40cc806e-9f77-4bc3-9dd6-2cd360a1bac6-config\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\"" Jul 21 20:37:12.086817 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.086714 2560 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/40cc806e-9f77-4bc3-9dd6-2cd360a1bac6-thanos-prometheus-http-client-file\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\"" Jul 21 20:37:12.086817 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.086724 2560 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/40cc806e-9f77-4bc3-9dd6-2cd360a1bac6-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\"" Jul 21 20:37:12.086817 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.086732 2560 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/40cc806e-9f77-4bc3-9dd6-2cd360a1bac6-secret-kube-rbac-proxy\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\"" Jul 21 20:37:12.086817 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.086739 2560 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/40cc806e-9f77-4bc3-9dd6-2cd360a1bac6-tls-assets\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\"" Jul 21 20:37:12.086817 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.086747 2560 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/40cc806e-9f77-4bc3-9dd6-2cd360a1bac6-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\"" Jul 21 20:37:12.086817 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.086755 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x4p6n\" (UniqueName: \"kubernetes.io/projected/40cc806e-9f77-4bc3-9dd6-2cd360a1bac6-kube-api-access-x4p6n\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\"" Jul 21 20:37:12.086817 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.086764 2560 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/40cc806e-9f77-4bc3-9dd6-2cd360a1bac6-prometheus-k8s-db\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\"" Jul 21 20:37:12.086817 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.086772 2560 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/40cc806e-9f77-4bc3-9dd6-2cd360a1bac6-secret-grpc-tls\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\"" Jul 21 20:37:12.086817 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.086780 2560 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/40cc806e-9f77-4bc3-9dd6-2cd360a1bac6-web-config\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\"" Jul 21 20:37:12.086817 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.086787 2560 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/40cc806e-9f77-4bc3-9dd6-2cd360a1bac6-secret-metrics-client-certs\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\"" Jul 21 20:37:12.086817 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.086794 2560 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/40cc806e-9f77-4bc3-9dd6-2cd360a1bac6-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\"" Jul 21 20:37:12.086817 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.086804 2560 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/40cc806e-9f77-4bc3-9dd6-2cd360a1bac6-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\"" Jul 21 20:37:12.086817 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.086812 2560 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/40cc806e-9f77-4bc3-9dd6-2cd360a1bac6-config-out\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\"" Jul 21 20:37:12.086817 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.086821 2560 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/40cc806e-9f77-4bc3-9dd6-2cd360a1bac6-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\"" Jul 21 20:37:12.505368 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.505334 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7d59944ccd-9gmsq" event={"ID":"80c425f8-3c06-46c8-a60d-9a8f607a2df3","Type":"ContainerStarted","Data":"c348b9feb928f88582c20c1550a3457a1fa8ea23bd8e3af51b046a56edf54c7f"} Jul 21 20:37:12.508440 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.508416 2560 generic.go:356] "Generic (PLEG): container finished" podID="40cc806e-9f77-4bc3-9dd6-2cd360a1bac6" containerID="3005987eb65475568d207ee32909f010c033cbd4d879d76ab2ef4b461ebb12a9" exitCode=0 Jul 21 20:37:12.508440 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.508435 2560 generic.go:356] "Generic (PLEG): container finished" podID="40cc806e-9f77-4bc3-9dd6-2cd360a1bac6" containerID="c392d42992f48fec37c232d9a9f176c730eff31cef9fabd87921070aecc22291" exitCode=0 Jul 21 20:37:12.508440 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.508442 2560 generic.go:356] "Generic (PLEG): container finished" podID="40cc806e-9f77-4bc3-9dd6-2cd360a1bac6" containerID="8e353668a12482108662cec296fb3be7955183a0dde443c9906920d82287df87" exitCode=0 Jul 21 20:37:12.508440 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.508447 2560 generic.go:356] "Generic (PLEG): container finished" podID="40cc806e-9f77-4bc3-9dd6-2cd360a1bac6" containerID="6206baea6b1778a9657490a3763fbdbc89af8c84c42d8b2ccbc0d7a4eb9ece0a" exitCode=0 Jul 21 20:37:12.508705 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.508453 2560 generic.go:356] "Generic (PLEG): container finished" podID="40cc806e-9f77-4bc3-9dd6-2cd360a1bac6" containerID="b6179621cbd2da7d55fb9e3bd2dd8e45903a982a4f0d26062365ba17f3af84dc" exitCode=0 Jul 21 20:37:12.508705 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.508458 2560 generic.go:356] "Generic (PLEG): container finished" podID="40cc806e-9f77-4bc3-9dd6-2cd360a1bac6" containerID="32eae96e1bace0d923788f6d34eb2d93b4cd7cba943a7fa1235cffd984b55aff" exitCode=0 Jul 21 20:37:12.508705 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.508481 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"40cc806e-9f77-4bc3-9dd6-2cd360a1bac6","Type":"ContainerDied","Data":"3005987eb65475568d207ee32909f010c033cbd4d879d76ab2ef4b461ebb12a9"} Jul 21 20:37:12.508705 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.508519 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 21 20:37:12.508705 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.508545 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"40cc806e-9f77-4bc3-9dd6-2cd360a1bac6","Type":"ContainerDied","Data":"c392d42992f48fec37c232d9a9f176c730eff31cef9fabd87921070aecc22291"} Jul 21 20:37:12.508705 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.508574 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"40cc806e-9f77-4bc3-9dd6-2cd360a1bac6","Type":"ContainerDied","Data":"8e353668a12482108662cec296fb3be7955183a0dde443c9906920d82287df87"} Jul 21 20:37:12.508705 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.508602 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"40cc806e-9f77-4bc3-9dd6-2cd360a1bac6","Type":"ContainerDied","Data":"6206baea6b1778a9657490a3763fbdbc89af8c84c42d8b2ccbc0d7a4eb9ece0a"} Jul 21 20:37:12.508705 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.508632 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"40cc806e-9f77-4bc3-9dd6-2cd360a1bac6","Type":"ContainerDied","Data":"b6179621cbd2da7d55fb9e3bd2dd8e45903a982a4f0d26062365ba17f3af84dc"} Jul 21 20:37:12.508705 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.508612 2560 scope.go:117] "RemoveContainer" containerID="3005987eb65475568d207ee32909f010c033cbd4d879d76ab2ef4b461ebb12a9" Jul 21 20:37:12.508705 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.508657 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"40cc806e-9f77-4bc3-9dd6-2cd360a1bac6","Type":"ContainerDied","Data":"32eae96e1bace0d923788f6d34eb2d93b4cd7cba943a7fa1235cffd984b55aff"} Jul 21 20:37:12.508705 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.508689 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"40cc806e-9f77-4bc3-9dd6-2cd360a1bac6","Type":"ContainerDied","Data":"a03684d797c5fca1b8abf3ba40bdd337ccce6259b1580ec46c8dd1d6ba30a213"} Jul 21 20:37:12.516830 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.516809 2560 scope.go:117] "RemoveContainer" containerID="c392d42992f48fec37c232d9a9f176c730eff31cef9fabd87921070aecc22291" Jul 21 20:37:12.525237 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.525217 2560 scope.go:117] "RemoveContainer" containerID="8e353668a12482108662cec296fb3be7955183a0dde443c9906920d82287df87" Jul 21 20:37:12.533281 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.533245 2560 scope.go:117] "RemoveContainer" containerID="6206baea6b1778a9657490a3763fbdbc89af8c84c42d8b2ccbc0d7a4eb9ece0a" Jul 21 20:37:12.534743 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.534722 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 21 20:37:12.537972 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.537953 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 21 20:37:12.541432 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.541418 2560 scope.go:117] "RemoveContainer" containerID="b6179621cbd2da7d55fb9e3bd2dd8e45903a982a4f0d26062365ba17f3af84dc" Jul 21 20:37:12.547755 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.547738 2560 scope.go:117] "RemoveContainer" containerID="32eae96e1bace0d923788f6d34eb2d93b4cd7cba943a7fa1235cffd984b55aff" Jul 21 20:37:12.554487 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.554471 2560 scope.go:117] "RemoveContainer" containerID="500c56db1fb2d9231b85c025d7dd63502965916f8b80f489f722c72be4362758" Jul 21 20:37:12.560749 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.560737 2560 scope.go:117] "RemoveContainer" containerID="3005987eb65475568d207ee32909f010c033cbd4d879d76ab2ef4b461ebb12a9" Jul 21 20:37:12.561001 ip-10-0-131-27 kubenswrapper[2560]: E0721 20:37:12.560978 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3005987eb65475568d207ee32909f010c033cbd4d879d76ab2ef4b461ebb12a9\": container with ID starting with 3005987eb65475568d207ee32909f010c033cbd4d879d76ab2ef4b461ebb12a9 not found: ID does not exist" containerID="3005987eb65475568d207ee32909f010c033cbd4d879d76ab2ef4b461ebb12a9" Jul 21 20:37:12.561114 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.561031 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3005987eb65475568d207ee32909f010c033cbd4d879d76ab2ef4b461ebb12a9"} err="failed to get container status \"3005987eb65475568d207ee32909f010c033cbd4d879d76ab2ef4b461ebb12a9\": rpc error: code = NotFound desc = could not find container \"3005987eb65475568d207ee32909f010c033cbd4d879d76ab2ef4b461ebb12a9\": container with ID starting with 3005987eb65475568d207ee32909f010c033cbd4d879d76ab2ef4b461ebb12a9 not found: ID does not exist" Jul 21 20:37:12.561114 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.561053 2560 scope.go:117] "RemoveContainer" containerID="c392d42992f48fec37c232d9a9f176c730eff31cef9fabd87921070aecc22291" Jul 21 20:37:12.561480 ip-10-0-131-27 kubenswrapper[2560]: E0721 20:37:12.561458 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c392d42992f48fec37c232d9a9f176c730eff31cef9fabd87921070aecc22291\": container with ID starting with c392d42992f48fec37c232d9a9f176c730eff31cef9fabd87921070aecc22291 not found: ID does not exist" containerID="c392d42992f48fec37c232d9a9f176c730eff31cef9fabd87921070aecc22291" Jul 21 20:37:12.561545 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.561487 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c392d42992f48fec37c232d9a9f176c730eff31cef9fabd87921070aecc22291"} err="failed to get container status \"c392d42992f48fec37c232d9a9f176c730eff31cef9fabd87921070aecc22291\": rpc error: code = NotFound desc = could not find container \"c392d42992f48fec37c232d9a9f176c730eff31cef9fabd87921070aecc22291\": container with ID starting with c392d42992f48fec37c232d9a9f176c730eff31cef9fabd87921070aecc22291 not found: ID does not exist" Jul 21 20:37:12.561545 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.561509 2560 scope.go:117] "RemoveContainer" containerID="8e353668a12482108662cec296fb3be7955183a0dde443c9906920d82287df87" Jul 21 20:37:12.561754 ip-10-0-131-27 kubenswrapper[2560]: E0721 20:37:12.561732 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8e353668a12482108662cec296fb3be7955183a0dde443c9906920d82287df87\": container with ID starting with 8e353668a12482108662cec296fb3be7955183a0dde443c9906920d82287df87 not found: ID does not exist" containerID="8e353668a12482108662cec296fb3be7955183a0dde443c9906920d82287df87" Jul 21 20:37:12.561832 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.561757 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e353668a12482108662cec296fb3be7955183a0dde443c9906920d82287df87"} err="failed to get container status \"8e353668a12482108662cec296fb3be7955183a0dde443c9906920d82287df87\": rpc error: code = NotFound desc = could not find container \"8e353668a12482108662cec296fb3be7955183a0dde443c9906920d82287df87\": container with ID starting with 8e353668a12482108662cec296fb3be7955183a0dde443c9906920d82287df87 not found: ID does not exist" Jul 21 20:37:12.561832 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.561772 2560 scope.go:117] "RemoveContainer" containerID="6206baea6b1778a9657490a3763fbdbc89af8c84c42d8b2ccbc0d7a4eb9ece0a" Jul 21 20:37:12.561948 ip-10-0-131-27 kubenswrapper[2560]: E0721 20:37:12.561932 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6206baea6b1778a9657490a3763fbdbc89af8c84c42d8b2ccbc0d7a4eb9ece0a\": container with ID starting with 6206baea6b1778a9657490a3763fbdbc89af8c84c42d8b2ccbc0d7a4eb9ece0a not found: ID does not exist" containerID="6206baea6b1778a9657490a3763fbdbc89af8c84c42d8b2ccbc0d7a4eb9ece0a" Jul 21 20:37:12.562034 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.561952 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6206baea6b1778a9657490a3763fbdbc89af8c84c42d8b2ccbc0d7a4eb9ece0a"} err="failed to get container status \"6206baea6b1778a9657490a3763fbdbc89af8c84c42d8b2ccbc0d7a4eb9ece0a\": rpc error: code = NotFound desc = could not find container \"6206baea6b1778a9657490a3763fbdbc89af8c84c42d8b2ccbc0d7a4eb9ece0a\": container with ID starting with 6206baea6b1778a9657490a3763fbdbc89af8c84c42d8b2ccbc0d7a4eb9ece0a not found: ID does not exist" Jul 21 20:37:12.562034 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.561969 2560 scope.go:117] "RemoveContainer" containerID="b6179621cbd2da7d55fb9e3bd2dd8e45903a982a4f0d26062365ba17f3af84dc" Jul 21 20:37:12.562258 ip-10-0-131-27 kubenswrapper[2560]: E0721 20:37:12.562243 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b6179621cbd2da7d55fb9e3bd2dd8e45903a982a4f0d26062365ba17f3af84dc\": container with ID starting with b6179621cbd2da7d55fb9e3bd2dd8e45903a982a4f0d26062365ba17f3af84dc not found: ID does not exist" containerID="b6179621cbd2da7d55fb9e3bd2dd8e45903a982a4f0d26062365ba17f3af84dc" Jul 21 20:37:12.562306 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.562261 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6179621cbd2da7d55fb9e3bd2dd8e45903a982a4f0d26062365ba17f3af84dc"} err="failed to get container status \"b6179621cbd2da7d55fb9e3bd2dd8e45903a982a4f0d26062365ba17f3af84dc\": rpc error: code = NotFound desc = could not find container \"b6179621cbd2da7d55fb9e3bd2dd8e45903a982a4f0d26062365ba17f3af84dc\": container with ID starting with b6179621cbd2da7d55fb9e3bd2dd8e45903a982a4f0d26062365ba17f3af84dc not found: ID does not exist" Jul 21 20:37:12.562306 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.562273 2560 scope.go:117] "RemoveContainer" containerID="32eae96e1bace0d923788f6d34eb2d93b4cd7cba943a7fa1235cffd984b55aff" Jul 21 20:37:12.562397 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.562359 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 21 20:37:12.562490 ip-10-0-131-27 kubenswrapper[2560]: E0721 20:37:12.562475 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"32eae96e1bace0d923788f6d34eb2d93b4cd7cba943a7fa1235cffd984b55aff\": container with ID starting with 32eae96e1bace0d923788f6d34eb2d93b4cd7cba943a7fa1235cffd984b55aff not found: ID does not exist" containerID="32eae96e1bace0d923788f6d34eb2d93b4cd7cba943a7fa1235cffd984b55aff" Jul 21 20:37:12.562530 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.562491 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"32eae96e1bace0d923788f6d34eb2d93b4cd7cba943a7fa1235cffd984b55aff"} err="failed to get container status \"32eae96e1bace0d923788f6d34eb2d93b4cd7cba943a7fa1235cffd984b55aff\": rpc error: code = NotFound desc = could not find container \"32eae96e1bace0d923788f6d34eb2d93b4cd7cba943a7fa1235cffd984b55aff\": container with ID starting with 32eae96e1bace0d923788f6d34eb2d93b4cd7cba943a7fa1235cffd984b55aff not found: ID does not exist" Jul 21 20:37:12.562530 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.562503 2560 scope.go:117] "RemoveContainer" containerID="500c56db1fb2d9231b85c025d7dd63502965916f8b80f489f722c72be4362758" Jul 21 20:37:12.562681 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.562669 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40cc806e-9f77-4bc3-9dd6-2cd360a1bac6" containerName="kube-rbac-proxy-web" Jul 21 20:37:12.562727 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.562683 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="40cc806e-9f77-4bc3-9dd6-2cd360a1bac6" containerName="kube-rbac-proxy-web" Jul 21 20:37:12.562727 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.562695 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40cc806e-9f77-4bc3-9dd6-2cd360a1bac6" containerName="thanos-sidecar" Jul 21 20:37:12.562727 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.562700 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="40cc806e-9f77-4bc3-9dd6-2cd360a1bac6" containerName="thanos-sidecar" Jul 21 20:37:12.562727 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.562709 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40cc806e-9f77-4bc3-9dd6-2cd360a1bac6" containerName="config-reloader" Jul 21 20:37:12.562727 ip-10-0-131-27 kubenswrapper[2560]: E0721 20:37:12.562719 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"500c56db1fb2d9231b85c025d7dd63502965916f8b80f489f722c72be4362758\": container with ID starting with 500c56db1fb2d9231b85c025d7dd63502965916f8b80f489f722c72be4362758 not found: ID does not exist" containerID="500c56db1fb2d9231b85c025d7dd63502965916f8b80f489f722c72be4362758" Jul 21 20:37:12.562907 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.562742 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"500c56db1fb2d9231b85c025d7dd63502965916f8b80f489f722c72be4362758"} err="failed to get container status \"500c56db1fb2d9231b85c025d7dd63502965916f8b80f489f722c72be4362758\": rpc error: code = NotFound desc = could not find container \"500c56db1fb2d9231b85c025d7dd63502965916f8b80f489f722c72be4362758\": container with ID starting with 500c56db1fb2d9231b85c025d7dd63502965916f8b80f489f722c72be4362758 not found: ID does not exist" Jul 21 20:37:12.562907 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.562757 2560 scope.go:117] "RemoveContainer" containerID="3005987eb65475568d207ee32909f010c033cbd4d879d76ab2ef4b461ebb12a9" Jul 21 20:37:12.562907 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.562730 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="40cc806e-9f77-4bc3-9dd6-2cd360a1bac6" containerName="config-reloader" Jul 21 20:37:12.562907 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.562804 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40cc806e-9f77-4bc3-9dd6-2cd360a1bac6" containerName="kube-rbac-proxy-thanos" Jul 21 20:37:12.562907 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.562812 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="40cc806e-9f77-4bc3-9dd6-2cd360a1bac6" containerName="kube-rbac-proxy-thanos" Jul 21 20:37:12.562907 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.562830 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40cc806e-9f77-4bc3-9dd6-2cd360a1bac6" containerName="init-config-reloader" Jul 21 20:37:12.562907 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.562837 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="40cc806e-9f77-4bc3-9dd6-2cd360a1bac6" containerName="init-config-reloader" Jul 21 20:37:12.562907 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.562844 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40cc806e-9f77-4bc3-9dd6-2cd360a1bac6" containerName="kube-rbac-proxy" Jul 21 20:37:12.562907 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.562849 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="40cc806e-9f77-4bc3-9dd6-2cd360a1bac6" containerName="kube-rbac-proxy" Jul 21 20:37:12.562907 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.562861 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40cc806e-9f77-4bc3-9dd6-2cd360a1bac6" containerName="prometheus" Jul 21 20:37:12.562907 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.562866 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="40cc806e-9f77-4bc3-9dd6-2cd360a1bac6" containerName="prometheus" Jul 21 20:37:12.563523 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.562937 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="40cc806e-9f77-4bc3-9dd6-2cd360a1bac6" containerName="kube-rbac-proxy-thanos" Jul 21 20:37:12.563523 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.562946 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="40cc806e-9f77-4bc3-9dd6-2cd360a1bac6" containerName="config-reloader" Jul 21 20:37:12.563523 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.562952 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="40cc806e-9f77-4bc3-9dd6-2cd360a1bac6" containerName="prometheus" Jul 21 20:37:12.563523 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.562959 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="40cc806e-9f77-4bc3-9dd6-2cd360a1bac6" containerName="kube-rbac-proxy" Jul 21 20:37:12.563523 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.562967 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="40cc806e-9f77-4bc3-9dd6-2cd360a1bac6" containerName="kube-rbac-proxy-web" Jul 21 20:37:12.563523 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.562977 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="40cc806e-9f77-4bc3-9dd6-2cd360a1bac6" containerName="thanos-sidecar" Jul 21 20:37:12.563523 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.563001 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3005987eb65475568d207ee32909f010c033cbd4d879d76ab2ef4b461ebb12a9"} err="failed to get container status \"3005987eb65475568d207ee32909f010c033cbd4d879d76ab2ef4b461ebb12a9\": rpc error: code = NotFound desc = could not find container \"3005987eb65475568d207ee32909f010c033cbd4d879d76ab2ef4b461ebb12a9\": container with ID starting with 3005987eb65475568d207ee32909f010c033cbd4d879d76ab2ef4b461ebb12a9 not found: ID does not exist" Jul 21 20:37:12.563523 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.563040 2560 scope.go:117] "RemoveContainer" containerID="c392d42992f48fec37c232d9a9f176c730eff31cef9fabd87921070aecc22291" Jul 21 20:37:12.563523 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.563268 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c392d42992f48fec37c232d9a9f176c730eff31cef9fabd87921070aecc22291"} err="failed to get container status \"c392d42992f48fec37c232d9a9f176c730eff31cef9fabd87921070aecc22291\": rpc error: code = NotFound desc = could not find container \"c392d42992f48fec37c232d9a9f176c730eff31cef9fabd87921070aecc22291\": container with ID starting with c392d42992f48fec37c232d9a9f176c730eff31cef9fabd87921070aecc22291 not found: ID does not exist" Jul 21 20:37:12.563523 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.563291 2560 scope.go:117] "RemoveContainer" containerID="8e353668a12482108662cec296fb3be7955183a0dde443c9906920d82287df87" Jul 21 20:37:12.563862 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.563771 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e353668a12482108662cec296fb3be7955183a0dde443c9906920d82287df87"} err="failed to get container status \"8e353668a12482108662cec296fb3be7955183a0dde443c9906920d82287df87\": rpc error: code = NotFound desc = could not find container \"8e353668a12482108662cec296fb3be7955183a0dde443c9906920d82287df87\": container with ID starting with 8e353668a12482108662cec296fb3be7955183a0dde443c9906920d82287df87 not found: ID does not exist" Jul 21 20:37:12.563862 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.563792 2560 scope.go:117] "RemoveContainer" containerID="6206baea6b1778a9657490a3763fbdbc89af8c84c42d8b2ccbc0d7a4eb9ece0a" Jul 21 20:37:12.564025 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.563986 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6206baea6b1778a9657490a3763fbdbc89af8c84c42d8b2ccbc0d7a4eb9ece0a"} err="failed to get container status \"6206baea6b1778a9657490a3763fbdbc89af8c84c42d8b2ccbc0d7a4eb9ece0a\": rpc error: code = NotFound desc = could not find container \"6206baea6b1778a9657490a3763fbdbc89af8c84c42d8b2ccbc0d7a4eb9ece0a\": container with ID starting with 6206baea6b1778a9657490a3763fbdbc89af8c84c42d8b2ccbc0d7a4eb9ece0a not found: ID does not exist" Jul 21 20:37:12.564078 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.564028 2560 scope.go:117] "RemoveContainer" containerID="b6179621cbd2da7d55fb9e3bd2dd8e45903a982a4f0d26062365ba17f3af84dc" Jul 21 20:37:12.564238 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.564214 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6179621cbd2da7d55fb9e3bd2dd8e45903a982a4f0d26062365ba17f3af84dc"} err="failed to get container status \"b6179621cbd2da7d55fb9e3bd2dd8e45903a982a4f0d26062365ba17f3af84dc\": rpc error: code = NotFound desc = could not find container \"b6179621cbd2da7d55fb9e3bd2dd8e45903a982a4f0d26062365ba17f3af84dc\": container with ID starting with b6179621cbd2da7d55fb9e3bd2dd8e45903a982a4f0d26062365ba17f3af84dc not found: ID does not exist" Jul 21 20:37:12.564238 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.564238 2560 scope.go:117] "RemoveContainer" containerID="32eae96e1bace0d923788f6d34eb2d93b4cd7cba943a7fa1235cffd984b55aff" Jul 21 20:37:12.564468 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.564452 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"32eae96e1bace0d923788f6d34eb2d93b4cd7cba943a7fa1235cffd984b55aff"} err="failed to get container status \"32eae96e1bace0d923788f6d34eb2d93b4cd7cba943a7fa1235cffd984b55aff\": rpc error: code = NotFound desc = could not find container \"32eae96e1bace0d923788f6d34eb2d93b4cd7cba943a7fa1235cffd984b55aff\": container with ID starting with 32eae96e1bace0d923788f6d34eb2d93b4cd7cba943a7fa1235cffd984b55aff not found: ID does not exist" Jul 21 20:37:12.564527 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.564469 2560 scope.go:117] "RemoveContainer" containerID="500c56db1fb2d9231b85c025d7dd63502965916f8b80f489f722c72be4362758" Jul 21 20:37:12.564708 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.564694 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"500c56db1fb2d9231b85c025d7dd63502965916f8b80f489f722c72be4362758"} err="failed to get container status \"500c56db1fb2d9231b85c025d7dd63502965916f8b80f489f722c72be4362758\": rpc error: code = NotFound desc = could not find container \"500c56db1fb2d9231b85c025d7dd63502965916f8b80f489f722c72be4362758\": container with ID starting with 500c56db1fb2d9231b85c025d7dd63502965916f8b80f489f722c72be4362758 not found: ID does not exist" Jul 21 20:37:12.564763 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.564708 2560 scope.go:117] "RemoveContainer" containerID="3005987eb65475568d207ee32909f010c033cbd4d879d76ab2ef4b461ebb12a9" Jul 21 20:37:12.564924 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.564907 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3005987eb65475568d207ee32909f010c033cbd4d879d76ab2ef4b461ebb12a9"} err="failed to get container status \"3005987eb65475568d207ee32909f010c033cbd4d879d76ab2ef4b461ebb12a9\": rpc error: code = NotFound desc = could not find container \"3005987eb65475568d207ee32909f010c033cbd4d879d76ab2ef4b461ebb12a9\": container with ID starting with 3005987eb65475568d207ee32909f010c033cbd4d879d76ab2ef4b461ebb12a9 not found: ID does not exist" Jul 21 20:37:12.564976 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.564925 2560 scope.go:117] "RemoveContainer" containerID="c392d42992f48fec37c232d9a9f176c730eff31cef9fabd87921070aecc22291" Jul 21 20:37:12.565191 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.565174 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c392d42992f48fec37c232d9a9f176c730eff31cef9fabd87921070aecc22291"} err="failed to get container status \"c392d42992f48fec37c232d9a9f176c730eff31cef9fabd87921070aecc22291\": rpc error: code = NotFound desc = could not find container \"c392d42992f48fec37c232d9a9f176c730eff31cef9fabd87921070aecc22291\": container with ID starting with c392d42992f48fec37c232d9a9f176c730eff31cef9fabd87921070aecc22291 not found: ID does not exist" Jul 21 20:37:12.565238 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.565192 2560 scope.go:117] "RemoveContainer" containerID="8e353668a12482108662cec296fb3be7955183a0dde443c9906920d82287df87" Jul 21 20:37:12.565426 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.565409 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e353668a12482108662cec296fb3be7955183a0dde443c9906920d82287df87"} err="failed to get container status \"8e353668a12482108662cec296fb3be7955183a0dde443c9906920d82287df87\": rpc error: code = NotFound desc = could not find container \"8e353668a12482108662cec296fb3be7955183a0dde443c9906920d82287df87\": container with ID starting with 8e353668a12482108662cec296fb3be7955183a0dde443c9906920d82287df87 not found: ID does not exist" Jul 21 20:37:12.565477 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.565427 2560 scope.go:117] "RemoveContainer" containerID="6206baea6b1778a9657490a3763fbdbc89af8c84c42d8b2ccbc0d7a4eb9ece0a" Jul 21 20:37:12.565623 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.565608 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6206baea6b1778a9657490a3763fbdbc89af8c84c42d8b2ccbc0d7a4eb9ece0a"} err="failed to get container status \"6206baea6b1778a9657490a3763fbdbc89af8c84c42d8b2ccbc0d7a4eb9ece0a\": rpc error: code = NotFound desc = could not find container \"6206baea6b1778a9657490a3763fbdbc89af8c84c42d8b2ccbc0d7a4eb9ece0a\": container with ID starting with 6206baea6b1778a9657490a3763fbdbc89af8c84c42d8b2ccbc0d7a4eb9ece0a not found: ID does not exist" Jul 21 20:37:12.565660 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.565623 2560 scope.go:117] "RemoveContainer" containerID="b6179621cbd2da7d55fb9e3bd2dd8e45903a982a4f0d26062365ba17f3af84dc" Jul 21 20:37:12.565841 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.565824 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6179621cbd2da7d55fb9e3bd2dd8e45903a982a4f0d26062365ba17f3af84dc"} err="failed to get container status \"b6179621cbd2da7d55fb9e3bd2dd8e45903a982a4f0d26062365ba17f3af84dc\": rpc error: code = NotFound desc = could not find container \"b6179621cbd2da7d55fb9e3bd2dd8e45903a982a4f0d26062365ba17f3af84dc\": container with ID starting with b6179621cbd2da7d55fb9e3bd2dd8e45903a982a4f0d26062365ba17f3af84dc not found: ID does not exist" Jul 21 20:37:12.565900 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.565841 2560 scope.go:117] "RemoveContainer" containerID="32eae96e1bace0d923788f6d34eb2d93b4cd7cba943a7fa1235cffd984b55aff" Jul 21 20:37:12.566078 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.566062 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"32eae96e1bace0d923788f6d34eb2d93b4cd7cba943a7fa1235cffd984b55aff"} err="failed to get container status \"32eae96e1bace0d923788f6d34eb2d93b4cd7cba943a7fa1235cffd984b55aff\": rpc error: code = NotFound desc = could not find container \"32eae96e1bace0d923788f6d34eb2d93b4cd7cba943a7fa1235cffd984b55aff\": container with ID starting with 32eae96e1bace0d923788f6d34eb2d93b4cd7cba943a7fa1235cffd984b55aff not found: ID does not exist" Jul 21 20:37:12.566135 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.566079 2560 scope.go:117] "RemoveContainer" containerID="500c56db1fb2d9231b85c025d7dd63502965916f8b80f489f722c72be4362758" Jul 21 20:37:12.566311 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.566292 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"500c56db1fb2d9231b85c025d7dd63502965916f8b80f489f722c72be4362758"} err="failed to get container status \"500c56db1fb2d9231b85c025d7dd63502965916f8b80f489f722c72be4362758\": rpc error: code = NotFound desc = could not find container \"500c56db1fb2d9231b85c025d7dd63502965916f8b80f489f722c72be4362758\": container with ID starting with 500c56db1fb2d9231b85c025d7dd63502965916f8b80f489f722c72be4362758 not found: ID does not exist" Jul 21 20:37:12.566348 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.566313 2560 scope.go:117] "RemoveContainer" containerID="3005987eb65475568d207ee32909f010c033cbd4d879d76ab2ef4b461ebb12a9" Jul 21 20:37:12.566535 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.566520 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3005987eb65475568d207ee32909f010c033cbd4d879d76ab2ef4b461ebb12a9"} err="failed to get container status \"3005987eb65475568d207ee32909f010c033cbd4d879d76ab2ef4b461ebb12a9\": rpc error: code = NotFound desc = could not find container \"3005987eb65475568d207ee32909f010c033cbd4d879d76ab2ef4b461ebb12a9\": container with ID starting with 3005987eb65475568d207ee32909f010c033cbd4d879d76ab2ef4b461ebb12a9 not found: ID does not exist" Jul 21 20:37:12.566572 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.566535 2560 scope.go:117] "RemoveContainer" containerID="c392d42992f48fec37c232d9a9f176c730eff31cef9fabd87921070aecc22291" Jul 21 20:37:12.566757 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.566730 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c392d42992f48fec37c232d9a9f176c730eff31cef9fabd87921070aecc22291"} err="failed to get container status \"c392d42992f48fec37c232d9a9f176c730eff31cef9fabd87921070aecc22291\": rpc error: code = NotFound desc = could not find container \"c392d42992f48fec37c232d9a9f176c730eff31cef9fabd87921070aecc22291\": container with ID starting with c392d42992f48fec37c232d9a9f176c730eff31cef9fabd87921070aecc22291 not found: ID does not exist" Jul 21 20:37:12.566757 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.566749 2560 scope.go:117] "RemoveContainer" containerID="8e353668a12482108662cec296fb3be7955183a0dde443c9906920d82287df87" Jul 21 20:37:12.566836 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.566787 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 21 20:37:12.567199 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.566951 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e353668a12482108662cec296fb3be7955183a0dde443c9906920d82287df87"} err="failed to get container status \"8e353668a12482108662cec296fb3be7955183a0dde443c9906920d82287df87\": rpc error: code = NotFound desc = could not find container \"8e353668a12482108662cec296fb3be7955183a0dde443c9906920d82287df87\": container with ID starting with 8e353668a12482108662cec296fb3be7955183a0dde443c9906920d82287df87 not found: ID does not exist" Jul 21 20:37:12.567199 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.566974 2560 scope.go:117] "RemoveContainer" containerID="6206baea6b1778a9657490a3763fbdbc89af8c84c42d8b2ccbc0d7a4eb9ece0a" Jul 21 20:37:12.567329 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.567240 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6206baea6b1778a9657490a3763fbdbc89af8c84c42d8b2ccbc0d7a4eb9ece0a"} err="failed to get container status \"6206baea6b1778a9657490a3763fbdbc89af8c84c42d8b2ccbc0d7a4eb9ece0a\": rpc error: code = NotFound desc = could not find container \"6206baea6b1778a9657490a3763fbdbc89af8c84c42d8b2ccbc0d7a4eb9ece0a\": container with ID starting with 6206baea6b1778a9657490a3763fbdbc89af8c84c42d8b2ccbc0d7a4eb9ece0a not found: ID does not exist" Jul 21 20:37:12.567329 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.567257 2560 scope.go:117] "RemoveContainer" containerID="b6179621cbd2da7d55fb9e3bd2dd8e45903a982a4f0d26062365ba17f3af84dc" Jul 21 20:37:12.567513 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.567488 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6179621cbd2da7d55fb9e3bd2dd8e45903a982a4f0d26062365ba17f3af84dc"} err="failed to get container status \"b6179621cbd2da7d55fb9e3bd2dd8e45903a982a4f0d26062365ba17f3af84dc\": rpc error: code = NotFound desc = could not find container \"b6179621cbd2da7d55fb9e3bd2dd8e45903a982a4f0d26062365ba17f3af84dc\": container with ID starting with b6179621cbd2da7d55fb9e3bd2dd8e45903a982a4f0d26062365ba17f3af84dc not found: ID does not exist" Jul 21 20:37:12.567513 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.567513 2560 scope.go:117] "RemoveContainer" containerID="32eae96e1bace0d923788f6d34eb2d93b4cd7cba943a7fa1235cffd984b55aff" Jul 21 20:37:12.567753 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.567733 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"32eae96e1bace0d923788f6d34eb2d93b4cd7cba943a7fa1235cffd984b55aff"} err="failed to get container status \"32eae96e1bace0d923788f6d34eb2d93b4cd7cba943a7fa1235cffd984b55aff\": rpc error: code = NotFound desc = could not find container \"32eae96e1bace0d923788f6d34eb2d93b4cd7cba943a7fa1235cffd984b55aff\": container with ID starting with 32eae96e1bace0d923788f6d34eb2d93b4cd7cba943a7fa1235cffd984b55aff not found: ID does not exist" Jul 21 20:37:12.567753 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.567753 2560 scope.go:117] "RemoveContainer" containerID="500c56db1fb2d9231b85c025d7dd63502965916f8b80f489f722c72be4362758" Jul 21 20:37:12.567966 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.567946 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"500c56db1fb2d9231b85c025d7dd63502965916f8b80f489f722c72be4362758"} err="failed to get container status \"500c56db1fb2d9231b85c025d7dd63502965916f8b80f489f722c72be4362758\": rpc error: code = NotFound desc = could not find container \"500c56db1fb2d9231b85c025d7dd63502965916f8b80f489f722c72be4362758\": container with ID starting with 500c56db1fb2d9231b85c025d7dd63502965916f8b80f489f722c72be4362758 not found: ID does not exist" Jul 21 20:37:12.568035 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.567968 2560 scope.go:117] "RemoveContainer" containerID="3005987eb65475568d207ee32909f010c033cbd4d879d76ab2ef4b461ebb12a9" Jul 21 20:37:12.568255 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.568233 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3005987eb65475568d207ee32909f010c033cbd4d879d76ab2ef4b461ebb12a9"} err="failed to get container status \"3005987eb65475568d207ee32909f010c033cbd4d879d76ab2ef4b461ebb12a9\": rpc error: code = NotFound desc = could not find container \"3005987eb65475568d207ee32909f010c033cbd4d879d76ab2ef4b461ebb12a9\": container with ID starting with 3005987eb65475568d207ee32909f010c033cbd4d879d76ab2ef4b461ebb12a9 not found: ID does not exist" Jul 21 20:37:12.568317 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.568256 2560 scope.go:117] "RemoveContainer" containerID="c392d42992f48fec37c232d9a9f176c730eff31cef9fabd87921070aecc22291" Jul 21 20:37:12.568513 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.568493 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c392d42992f48fec37c232d9a9f176c730eff31cef9fabd87921070aecc22291"} err="failed to get container status \"c392d42992f48fec37c232d9a9f176c730eff31cef9fabd87921070aecc22291\": rpc error: code = NotFound desc = could not find container \"c392d42992f48fec37c232d9a9f176c730eff31cef9fabd87921070aecc22291\": container with ID starting with c392d42992f48fec37c232d9a9f176c730eff31cef9fabd87921070aecc22291 not found: ID does not exist" Jul 21 20:37:12.568513 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.568513 2560 scope.go:117] "RemoveContainer" containerID="8e353668a12482108662cec296fb3be7955183a0dde443c9906920d82287df87" Jul 21 20:37:12.568746 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.568725 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e353668a12482108662cec296fb3be7955183a0dde443c9906920d82287df87"} err="failed to get container status \"8e353668a12482108662cec296fb3be7955183a0dde443c9906920d82287df87\": rpc error: code = NotFound desc = could not find container \"8e353668a12482108662cec296fb3be7955183a0dde443c9906920d82287df87\": container with ID starting with 8e353668a12482108662cec296fb3be7955183a0dde443c9906920d82287df87 not found: ID does not exist" Jul 21 20:37:12.568802 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.568748 2560 scope.go:117] "RemoveContainer" containerID="6206baea6b1778a9657490a3763fbdbc89af8c84c42d8b2ccbc0d7a4eb9ece0a" Jul 21 20:37:12.568973 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.568955 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6206baea6b1778a9657490a3763fbdbc89af8c84c42d8b2ccbc0d7a4eb9ece0a"} err="failed to get container status \"6206baea6b1778a9657490a3763fbdbc89af8c84c42d8b2ccbc0d7a4eb9ece0a\": rpc error: code = NotFound desc = could not find container \"6206baea6b1778a9657490a3763fbdbc89af8c84c42d8b2ccbc0d7a4eb9ece0a\": container with ID starting with 6206baea6b1778a9657490a3763fbdbc89af8c84c42d8b2ccbc0d7a4eb9ece0a not found: ID does not exist" Jul 21 20:37:12.569064 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.568974 2560 scope.go:117] "RemoveContainer" containerID="b6179621cbd2da7d55fb9e3bd2dd8e45903a982a4f0d26062365ba17f3af84dc" Jul 21 20:37:12.569315 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.569297 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6179621cbd2da7d55fb9e3bd2dd8e45903a982a4f0d26062365ba17f3af84dc"} err="failed to get container status \"b6179621cbd2da7d55fb9e3bd2dd8e45903a982a4f0d26062365ba17f3af84dc\": rpc error: code = NotFound desc = could not find container \"b6179621cbd2da7d55fb9e3bd2dd8e45903a982a4f0d26062365ba17f3af84dc\": container with ID starting with b6179621cbd2da7d55fb9e3bd2dd8e45903a982a4f0d26062365ba17f3af84dc not found: ID does not exist" Jul 21 20:37:12.569374 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.569314 2560 scope.go:117] "RemoveContainer" containerID="32eae96e1bace0d923788f6d34eb2d93b4cd7cba943a7fa1235cffd984b55aff" Jul 21 20:37:12.569600 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.569584 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"32eae96e1bace0d923788f6d34eb2d93b4cd7cba943a7fa1235cffd984b55aff"} err="failed to get container status \"32eae96e1bace0d923788f6d34eb2d93b4cd7cba943a7fa1235cffd984b55aff\": rpc error: code = NotFound desc = could not find container \"32eae96e1bace0d923788f6d34eb2d93b4cd7cba943a7fa1235cffd984b55aff\": container with ID starting with 32eae96e1bace0d923788f6d34eb2d93b4cd7cba943a7fa1235cffd984b55aff not found: ID does not exist" Jul 21 20:37:12.569642 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.569601 2560 scope.go:117] "RemoveContainer" containerID="500c56db1fb2d9231b85c025d7dd63502965916f8b80f489f722c72be4362758" Jul 21 20:37:12.569830 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.569815 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"500c56db1fb2d9231b85c025d7dd63502965916f8b80f489f722c72be4362758"} err="failed to get container status \"500c56db1fb2d9231b85c025d7dd63502965916f8b80f489f722c72be4362758\": rpc error: code = NotFound desc = could not find container \"500c56db1fb2d9231b85c025d7dd63502965916f8b80f489f722c72be4362758\": container with ID starting with 500c56db1fb2d9231b85c025d7dd63502965916f8b80f489f722c72be4362758 not found: ID does not exist" Jul 21 20:37:12.569830 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.569829 2560 scope.go:117] "RemoveContainer" containerID="3005987eb65475568d207ee32909f010c033cbd4d879d76ab2ef4b461ebb12a9" Jul 21 20:37:12.570111 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.570090 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3005987eb65475568d207ee32909f010c033cbd4d879d76ab2ef4b461ebb12a9"} err="failed to get container status \"3005987eb65475568d207ee32909f010c033cbd4d879d76ab2ef4b461ebb12a9\": rpc error: code = NotFound desc = could not find container \"3005987eb65475568d207ee32909f010c033cbd4d879d76ab2ef4b461ebb12a9\": container with ID starting with 3005987eb65475568d207ee32909f010c033cbd4d879d76ab2ef4b461ebb12a9 not found: ID does not exist" Jul 21 20:37:12.570111 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.570110 2560 scope.go:117] "RemoveContainer" containerID="c392d42992f48fec37c232d9a9f176c730eff31cef9fabd87921070aecc22291" Jul 21 20:37:12.570299 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.570281 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 21 20:37:12.570398 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.570281 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 21 20:37:12.570398 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.570322 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 21 20:37:12.570500 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.570394 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c392d42992f48fec37c232d9a9f176c730eff31cef9fabd87921070aecc22291"} err="failed to get container status \"c392d42992f48fec37c232d9a9f176c730eff31cef9fabd87921070aecc22291\": rpc error: code = NotFound desc = could not find container \"c392d42992f48fec37c232d9a9f176c730eff31cef9fabd87921070aecc22291\": container with ID starting with c392d42992f48fec37c232d9a9f176c730eff31cef9fabd87921070aecc22291 not found: ID does not exist" Jul 21 20:37:12.570500 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.570420 2560 scope.go:117] "RemoveContainer" containerID="8e353668a12482108662cec296fb3be7955183a0dde443c9906920d82287df87" Jul 21 20:37:12.571145 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.570690 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e353668a12482108662cec296fb3be7955183a0dde443c9906920d82287df87"} err="failed to get container status \"8e353668a12482108662cec296fb3be7955183a0dde443c9906920d82287df87\": rpc error: code = NotFound desc = could not find container \"8e353668a12482108662cec296fb3be7955183a0dde443c9906920d82287df87\": container with ID starting with 8e353668a12482108662cec296fb3be7955183a0dde443c9906920d82287df87 not found: ID does not exist" Jul 21 20:37:12.571145 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.570715 2560 scope.go:117] "RemoveContainer" containerID="6206baea6b1778a9657490a3763fbdbc89af8c84c42d8b2ccbc0d7a4eb9ece0a" Jul 21 20:37:12.571145 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.570716 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 21 20:37:12.571145 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.570699 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 21 20:37:12.571145 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.570782 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-xl7sh\"" Jul 21 20:37:12.571145 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.570977 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 21 20:37:12.571145 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.570991 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 21 20:37:12.571145 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.570997 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-95ppdfu4sqtp1\"" Jul 21 20:37:12.571145 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.570865 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 21 20:37:12.571145 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.571047 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6206baea6b1778a9657490a3763fbdbc89af8c84c42d8b2ccbc0d7a4eb9ece0a"} err="failed to get container status \"6206baea6b1778a9657490a3763fbdbc89af8c84c42d8b2ccbc0d7a4eb9ece0a\": rpc error: code = NotFound desc = could not find container \"6206baea6b1778a9657490a3763fbdbc89af8c84c42d8b2ccbc0d7a4eb9ece0a\": container with ID starting with 6206baea6b1778a9657490a3763fbdbc89af8c84c42d8b2ccbc0d7a4eb9ece0a not found: ID does not exist" Jul 21 20:37:12.571145 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.571068 2560 scope.go:117] "RemoveContainer" containerID="b6179621cbd2da7d55fb9e3bd2dd8e45903a982a4f0d26062365ba17f3af84dc" Jul 21 20:37:12.571763 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.571169 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 21 20:37:12.571763 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.571341 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6179621cbd2da7d55fb9e3bd2dd8e45903a982a4f0d26062365ba17f3af84dc"} err="failed to get container status \"b6179621cbd2da7d55fb9e3bd2dd8e45903a982a4f0d26062365ba17f3af84dc\": rpc error: code = NotFound desc = could not find container \"b6179621cbd2da7d55fb9e3bd2dd8e45903a982a4f0d26062365ba17f3af84dc\": container with ID starting with b6179621cbd2da7d55fb9e3bd2dd8e45903a982a4f0d26062365ba17f3af84dc not found: ID does not exist" Jul 21 20:37:12.571763 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.571365 2560 scope.go:117] "RemoveContainer" containerID="32eae96e1bace0d923788f6d34eb2d93b4cd7cba943a7fa1235cffd984b55aff" Jul 21 20:37:12.571763 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.571484 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 21 20:37:12.571763 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.571545 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 21 20:37:12.571763 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.571691 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"32eae96e1bace0d923788f6d34eb2d93b4cd7cba943a7fa1235cffd984b55aff"} err="failed to get container status \"32eae96e1bace0d923788f6d34eb2d93b4cd7cba943a7fa1235cffd984b55aff\": rpc error: code = NotFound desc = could not find container \"32eae96e1bace0d923788f6d34eb2d93b4cd7cba943a7fa1235cffd984b55aff\": container with ID starting with 32eae96e1bace0d923788f6d34eb2d93b4cd7cba943a7fa1235cffd984b55aff not found: ID does not exist" Jul 21 20:37:12.571763 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.571710 2560 scope.go:117] "RemoveContainer" containerID="500c56db1fb2d9231b85c025d7dd63502965916f8b80f489f722c72be4362758" Jul 21 20:37:12.572118 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.571917 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"500c56db1fb2d9231b85c025d7dd63502965916f8b80f489f722c72be4362758"} err="failed to get container status \"500c56db1fb2d9231b85c025d7dd63502965916f8b80f489f722c72be4362758\": rpc error: code = NotFound desc = could not find container \"500c56db1fb2d9231b85c025d7dd63502965916f8b80f489f722c72be4362758\": container with ID starting with 500c56db1fb2d9231b85c025d7dd63502965916f8b80f489f722c72be4362758 not found: ID does not exist" Jul 21 20:37:12.572230 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.572208 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 21 20:37:12.572724 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.572707 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 21 20:37:12.575732 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.575716 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 21 20:37:12.576818 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.576804 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 21 20:37:12.585854 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.585830 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 21 20:37:12.690003 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.689981 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/47ff18c4-4ce4-43b6-9932-ad3ec8e51546-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"47ff18c4-4ce4-43b6-9932-ad3ec8e51546\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 20:37:12.690102 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.690020 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/47ff18c4-4ce4-43b6-9932-ad3ec8e51546-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"47ff18c4-4ce4-43b6-9932-ad3ec8e51546\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 20:37:12.690102 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.690048 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/47ff18c4-4ce4-43b6-9932-ad3ec8e51546-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"47ff18c4-4ce4-43b6-9932-ad3ec8e51546\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 20:37:12.690102 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.690073 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/47ff18c4-4ce4-43b6-9932-ad3ec8e51546-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"47ff18c4-4ce4-43b6-9932-ad3ec8e51546\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 20:37:12.690256 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.690113 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/47ff18c4-4ce4-43b6-9932-ad3ec8e51546-config\") pod \"prometheus-k8s-0\" (UID: \"47ff18c4-4ce4-43b6-9932-ad3ec8e51546\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 20:37:12.690256 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.690132 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/47ff18c4-4ce4-43b6-9932-ad3ec8e51546-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"47ff18c4-4ce4-43b6-9932-ad3ec8e51546\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 20:37:12.690256 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.690204 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/47ff18c4-4ce4-43b6-9932-ad3ec8e51546-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"47ff18c4-4ce4-43b6-9932-ad3ec8e51546\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 20:37:12.690256 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.690246 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/47ff18c4-4ce4-43b6-9932-ad3ec8e51546-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"47ff18c4-4ce4-43b6-9932-ad3ec8e51546\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 20:37:12.690454 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.690273 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/47ff18c4-4ce4-43b6-9932-ad3ec8e51546-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"47ff18c4-4ce4-43b6-9932-ad3ec8e51546\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 20:37:12.690454 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.690298 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n2p9r\" (UniqueName: \"kubernetes.io/projected/47ff18c4-4ce4-43b6-9932-ad3ec8e51546-kube-api-access-n2p9r\") pod \"prometheus-k8s-0\" (UID: \"47ff18c4-4ce4-43b6-9932-ad3ec8e51546\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 20:37:12.690454 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.690325 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/47ff18c4-4ce4-43b6-9932-ad3ec8e51546-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"47ff18c4-4ce4-43b6-9932-ad3ec8e51546\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 20:37:12.690454 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.690359 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/47ff18c4-4ce4-43b6-9932-ad3ec8e51546-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"47ff18c4-4ce4-43b6-9932-ad3ec8e51546\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 20:37:12.690454 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.690386 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/47ff18c4-4ce4-43b6-9932-ad3ec8e51546-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"47ff18c4-4ce4-43b6-9932-ad3ec8e51546\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 20:37:12.690454 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.690439 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/47ff18c4-4ce4-43b6-9932-ad3ec8e51546-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"47ff18c4-4ce4-43b6-9932-ad3ec8e51546\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 20:37:12.690679 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.690480 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/47ff18c4-4ce4-43b6-9932-ad3ec8e51546-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"47ff18c4-4ce4-43b6-9932-ad3ec8e51546\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 20:37:12.690679 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.690511 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/47ff18c4-4ce4-43b6-9932-ad3ec8e51546-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"47ff18c4-4ce4-43b6-9932-ad3ec8e51546\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 20:37:12.690679 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.690583 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/47ff18c4-4ce4-43b6-9932-ad3ec8e51546-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"47ff18c4-4ce4-43b6-9932-ad3ec8e51546\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 20:37:12.690679 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.690600 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/47ff18c4-4ce4-43b6-9932-ad3ec8e51546-web-config\") pod \"prometheus-k8s-0\" (UID: \"47ff18c4-4ce4-43b6-9932-ad3ec8e51546\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 20:37:12.690679 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.690617 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/47ff18c4-4ce4-43b6-9932-ad3ec8e51546-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"47ff18c4-4ce4-43b6-9932-ad3ec8e51546\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 20:37:12.690679 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.690632 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/47ff18c4-4ce4-43b6-9932-ad3ec8e51546-config-out\") pod \"prometheus-k8s-0\" (UID: \"47ff18c4-4ce4-43b6-9932-ad3ec8e51546\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 20:37:12.792018 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.791945 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/47ff18c4-4ce4-43b6-9932-ad3ec8e51546-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"47ff18c4-4ce4-43b6-9932-ad3ec8e51546\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 20:37:12.792018 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.791976 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/47ff18c4-4ce4-43b6-9932-ad3ec8e51546-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"47ff18c4-4ce4-43b6-9932-ad3ec8e51546\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 20:37:12.792182 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.792033 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/47ff18c4-4ce4-43b6-9932-ad3ec8e51546-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"47ff18c4-4ce4-43b6-9932-ad3ec8e51546\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 20:37:12.792182 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.792076 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/47ff18c4-4ce4-43b6-9932-ad3ec8e51546-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"47ff18c4-4ce4-43b6-9932-ad3ec8e51546\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 20:37:12.792182 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.792107 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/47ff18c4-4ce4-43b6-9932-ad3ec8e51546-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"47ff18c4-4ce4-43b6-9932-ad3ec8e51546\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 20:37:12.792182 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.792148 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/47ff18c4-4ce4-43b6-9932-ad3ec8e51546-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"47ff18c4-4ce4-43b6-9932-ad3ec8e51546\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 20:37:12.792182 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.792170 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/47ff18c4-4ce4-43b6-9932-ad3ec8e51546-web-config\") pod \"prometheus-k8s-0\" (UID: \"47ff18c4-4ce4-43b6-9932-ad3ec8e51546\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 20:37:12.792413 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.792197 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/47ff18c4-4ce4-43b6-9932-ad3ec8e51546-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"47ff18c4-4ce4-43b6-9932-ad3ec8e51546\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 20:37:12.792413 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.792224 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/47ff18c4-4ce4-43b6-9932-ad3ec8e51546-config-out\") pod \"prometheus-k8s-0\" (UID: \"47ff18c4-4ce4-43b6-9932-ad3ec8e51546\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 20:37:12.792413 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.792257 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/47ff18c4-4ce4-43b6-9932-ad3ec8e51546-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"47ff18c4-4ce4-43b6-9932-ad3ec8e51546\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 20:37:12.792413 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.792285 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/47ff18c4-4ce4-43b6-9932-ad3ec8e51546-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"47ff18c4-4ce4-43b6-9932-ad3ec8e51546\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 20:37:12.792413 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.792309 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/47ff18c4-4ce4-43b6-9932-ad3ec8e51546-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"47ff18c4-4ce4-43b6-9932-ad3ec8e51546\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 20:37:12.792413 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.792335 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/47ff18c4-4ce4-43b6-9932-ad3ec8e51546-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"47ff18c4-4ce4-43b6-9932-ad3ec8e51546\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 20:37:12.792413 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.792360 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/47ff18c4-4ce4-43b6-9932-ad3ec8e51546-config\") pod \"prometheus-k8s-0\" (UID: \"47ff18c4-4ce4-43b6-9932-ad3ec8e51546\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 20:37:12.792413 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.792384 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/47ff18c4-4ce4-43b6-9932-ad3ec8e51546-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"47ff18c4-4ce4-43b6-9932-ad3ec8e51546\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 20:37:12.792413 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.792411 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/47ff18c4-4ce4-43b6-9932-ad3ec8e51546-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"47ff18c4-4ce4-43b6-9932-ad3ec8e51546\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 20:37:12.792845 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.792444 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/47ff18c4-4ce4-43b6-9932-ad3ec8e51546-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"47ff18c4-4ce4-43b6-9932-ad3ec8e51546\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 20:37:12.792845 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.792466 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/47ff18c4-4ce4-43b6-9932-ad3ec8e51546-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"47ff18c4-4ce4-43b6-9932-ad3ec8e51546\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 20:37:12.792845 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.792490 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n2p9r\" (UniqueName: \"kubernetes.io/projected/47ff18c4-4ce4-43b6-9932-ad3ec8e51546-kube-api-access-n2p9r\") pod \"prometheus-k8s-0\" (UID: \"47ff18c4-4ce4-43b6-9932-ad3ec8e51546\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 20:37:12.792845 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.792518 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/47ff18c4-4ce4-43b6-9932-ad3ec8e51546-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"47ff18c4-4ce4-43b6-9932-ad3ec8e51546\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 20:37:12.792845 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.792599 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/47ff18c4-4ce4-43b6-9932-ad3ec8e51546-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"47ff18c4-4ce4-43b6-9932-ad3ec8e51546\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 20:37:12.792845 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.792635 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/47ff18c4-4ce4-43b6-9932-ad3ec8e51546-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"47ff18c4-4ce4-43b6-9932-ad3ec8e51546\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 20:37:12.792845 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.792731 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/47ff18c4-4ce4-43b6-9932-ad3ec8e51546-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"47ff18c4-4ce4-43b6-9932-ad3ec8e51546\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 20:37:12.793189 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.792932 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/47ff18c4-4ce4-43b6-9932-ad3ec8e51546-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"47ff18c4-4ce4-43b6-9932-ad3ec8e51546\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 20:37:12.793588 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.793277 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/47ff18c4-4ce4-43b6-9932-ad3ec8e51546-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"47ff18c4-4ce4-43b6-9932-ad3ec8e51546\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 20:37:12.793588 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.793304 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/47ff18c4-4ce4-43b6-9932-ad3ec8e51546-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"47ff18c4-4ce4-43b6-9932-ad3ec8e51546\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 20:37:12.793736 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.793652 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/47ff18c4-4ce4-43b6-9932-ad3ec8e51546-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"47ff18c4-4ce4-43b6-9932-ad3ec8e51546\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 20:37:12.795672 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.795648 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/47ff18c4-4ce4-43b6-9932-ad3ec8e51546-config-out\") pod \"prometheus-k8s-0\" (UID: \"47ff18c4-4ce4-43b6-9932-ad3ec8e51546\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 20:37:12.795980 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.795955 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/47ff18c4-4ce4-43b6-9932-ad3ec8e51546-config\") pod \"prometheus-k8s-0\" (UID: \"47ff18c4-4ce4-43b6-9932-ad3ec8e51546\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 20:37:12.797038 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.796268 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/47ff18c4-4ce4-43b6-9932-ad3ec8e51546-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"47ff18c4-4ce4-43b6-9932-ad3ec8e51546\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 20:37:12.797038 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.796396 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/47ff18c4-4ce4-43b6-9932-ad3ec8e51546-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"47ff18c4-4ce4-43b6-9932-ad3ec8e51546\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 20:37:12.797179 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.797110 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/47ff18c4-4ce4-43b6-9932-ad3ec8e51546-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"47ff18c4-4ce4-43b6-9932-ad3ec8e51546\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 20:37:12.797499 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.797477 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/47ff18c4-4ce4-43b6-9932-ad3ec8e51546-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"47ff18c4-4ce4-43b6-9932-ad3ec8e51546\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 20:37:12.797780 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.797757 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/47ff18c4-4ce4-43b6-9932-ad3ec8e51546-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"47ff18c4-4ce4-43b6-9932-ad3ec8e51546\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 20:37:12.797915 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.797896 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/47ff18c4-4ce4-43b6-9932-ad3ec8e51546-web-config\") pod \"prometheus-k8s-0\" (UID: \"47ff18c4-4ce4-43b6-9932-ad3ec8e51546\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 20:37:12.798068 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.798037 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/47ff18c4-4ce4-43b6-9932-ad3ec8e51546-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"47ff18c4-4ce4-43b6-9932-ad3ec8e51546\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 20:37:12.798587 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.798549 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/47ff18c4-4ce4-43b6-9932-ad3ec8e51546-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"47ff18c4-4ce4-43b6-9932-ad3ec8e51546\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 20:37:12.798920 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.798896 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/47ff18c4-4ce4-43b6-9932-ad3ec8e51546-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"47ff18c4-4ce4-43b6-9932-ad3ec8e51546\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 20:37:12.799888 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.799871 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/47ff18c4-4ce4-43b6-9932-ad3ec8e51546-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"47ff18c4-4ce4-43b6-9932-ad3ec8e51546\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 20:37:12.806622 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.806601 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n2p9r\" (UniqueName: \"kubernetes.io/projected/47ff18c4-4ce4-43b6-9932-ad3ec8e51546-kube-api-access-n2p9r\") pod \"prometheus-k8s-0\" (UID: \"47ff18c4-4ce4-43b6-9932-ad3ec8e51546\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 20:37:12.876664 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:12.876640 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 21 20:37:13.018591 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:13.018415 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 21 20:37:13.021380 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:37:13.021340 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47ff18c4_4ce4_43b6_9932_ad3ec8e51546.slice/crio-6d075cb7002fe8495af4874b4a3b2f79f5c6125bc905d11f04d95dc9dd988d98 WatchSource:0}: Error finding container 6d075cb7002fe8495af4874b4a3b2f79f5c6125bc905d11f04d95dc9dd988d98: Status 404 returned error can't find the container with id 6d075cb7002fe8495af4874b4a3b2f79f5c6125bc905d11f04d95dc9dd988d98 Jul 21 20:37:13.514980 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:13.514946 2560 generic.go:356] "Generic (PLEG): container finished" podID="47ff18c4-4ce4-43b6-9932-ad3ec8e51546" containerID="2d61eb733276880c194034ba0c8106d9765d9923aa440c5d2509516e68e1eb45" exitCode=0 Jul 21 20:37:13.515117 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:13.515031 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"47ff18c4-4ce4-43b6-9932-ad3ec8e51546","Type":"ContainerDied","Data":"2d61eb733276880c194034ba0c8106d9765d9923aa440c5d2509516e68e1eb45"} Jul 21 20:37:13.515117 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:13.515097 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"47ff18c4-4ce4-43b6-9932-ad3ec8e51546","Type":"ContainerStarted","Data":"6d075cb7002fe8495af4874b4a3b2f79f5c6125bc905d11f04d95dc9dd988d98"} Jul 21 20:37:13.873355 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:13.871181 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="40cc806e-9f77-4bc3-9dd6-2cd360a1bac6" path="/var/lib/kubelet/pods/40cc806e-9f77-4bc3-9dd6-2cd360a1bac6/volumes" Jul 21 20:37:14.522431 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:14.522396 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7d59944ccd-9gmsq" event={"ID":"80c425f8-3c06-46c8-a60d-9a8f607a2df3","Type":"ContainerStarted","Data":"09050d5c42de8923b75dd34c3f3fa9f6749711cf193bf1a86a888a7efec80305"} Jul 21 20:37:14.522592 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:14.522454 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7d59944ccd-9gmsq" event={"ID":"80c425f8-3c06-46c8-a60d-9a8f607a2df3","Type":"ContainerStarted","Data":"90ee2debd4998226008071b8dd488cb876e656a8df438dfea23345426b57b9e6"} Jul 21 20:37:14.522592 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:14.522473 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7d59944ccd-9gmsq" event={"ID":"80c425f8-3c06-46c8-a60d-9a8f607a2df3","Type":"ContainerStarted","Data":"bcafc05c2cd78f33031e8788f25ed988a36722ded231ec70e98e19c6b722d162"} Jul 21 20:37:14.525580 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:14.525556 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"47ff18c4-4ce4-43b6-9932-ad3ec8e51546","Type":"ContainerStarted","Data":"d90a0f6f27c479a50deb0bcadfa585b2647fc95b1d27a26e5a1e2c908066bbe3"} Jul 21 20:37:14.525683 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:14.525640 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"47ff18c4-4ce4-43b6-9932-ad3ec8e51546","Type":"ContainerStarted","Data":"f1c98cc2bf2beb69e44aaa689634347b23c1ec36de4cfdca76b675bc9b0efc6b"} Jul 21 20:37:14.525683 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:14.525667 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"47ff18c4-4ce4-43b6-9932-ad3ec8e51546","Type":"ContainerStarted","Data":"e5aa5069aee45e4522a8c7bf390ccb40e0ccc314ebf69b22cedead9c71203f9f"} Jul 21 20:37:14.525751 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:14.525693 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"47ff18c4-4ce4-43b6-9932-ad3ec8e51546","Type":"ContainerStarted","Data":"5f952f93086187aebd10e7fb7464a9c0bcffe361427c287ca320339439d49af1"} Jul 21 20:37:14.525751 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:14.525720 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"47ff18c4-4ce4-43b6-9932-ad3ec8e51546","Type":"ContainerStarted","Data":"c26ba0f1db3c24969656140cb1d1b6fc476dc853d3c2a70a5ae3777b7f45a925"} Jul 21 20:37:14.525751 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:14.525743 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"47ff18c4-4ce4-43b6-9932-ad3ec8e51546","Type":"ContainerStarted","Data":"81bd12cacce6e73dedc5e6f283ac9c24a6f787224244ad69bb9db2fcefbed76d"} Jul 21 20:37:14.546720 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:14.546661 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-7d59944ccd-9gmsq" podStartSLOduration=1.198336638 podStartE2EDuration="3.546641035s" totalImagesPullingTime="2.348304397s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 20:37:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:37:14.542851219 +0000 UTC m=+127.306088175" watchObservedRunningTime="2026-07-21 20:37:14.546641035 +0000 UTC m=+127.309877980" Jul 21 20:37:14.570500 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:14.570456 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.5518068830000002 podStartE2EDuration="2.570443326s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.636443ms" isStatefulPod=false podCreationTimestamp="2026-07-21 20:37:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:37:14.568592686 +0000 UTC m=+127.331829658" watchObservedRunningTime="2026-07-21 20:37:14.570443326 +0000 UTC m=+127.333680268" Jul 21 20:37:17.877662 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:37:17.877632 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 21 20:38:12.877340 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:38:12.877308 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 21 20:38:12.893991 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:38:12.893962 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 21 20:38:13.784985 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:38:13.784955 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 21 20:39:29.927823 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:39:29.927727 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-2mfdm_0da0f4c0-d4be-484a-8efb-8f525f2ab0d9/global-pull-secret-syncer/0.log" Jul 21 20:39:30.083161 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:39:30.083121 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-qgk2d_e5ef3217-99e0-43ce-a415-937df67f3cd2/konnectivity-agent/0.log" Jul 21 20:39:30.101642 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:39:30.101611 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-131-27.ec2.internal_d5698e5baf2a73bf68056435e9975908/haproxy/0.log" Jul 21 20:39:33.756430 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:39:33.756398 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e3e6915a-468f-4dc9-a78d-056006143297/alertmanager/0.log" Jul 21 20:39:33.775635 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:39:33.775606 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e3e6915a-468f-4dc9-a78d-056006143297/config-reloader/0.log" Jul 21 20:39:33.795785 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:39:33.795751 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e3e6915a-468f-4dc9-a78d-056006143297/kube-rbac-proxy-web/0.log" Jul 21 20:39:33.816439 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:39:33.816421 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e3e6915a-468f-4dc9-a78d-056006143297/kube-rbac-proxy/0.log" Jul 21 20:39:33.841639 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:39:33.841616 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e3e6915a-468f-4dc9-a78d-056006143297/kube-rbac-proxy-metric/0.log" Jul 21 20:39:33.866240 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:39:33.866220 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e3e6915a-468f-4dc9-a78d-056006143297/prom-label-proxy/0.log" Jul 21 20:39:33.885216 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:39:33.885202 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e3e6915a-468f-4dc9-a78d-056006143297/init-config-reloader/0.log" Jul 21 20:39:33.938612 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:39:33.938595 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-k9lrs_d0c64150-3a79-4dc2-99fa-a7f04c3e40dc/kube-state-metrics/0.log" Jul 21 20:39:33.955501 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:39:33.955464 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-k9lrs_d0c64150-3a79-4dc2-99fa-a7f04c3e40dc/kube-rbac-proxy-main/0.log" Jul 21 20:39:33.973300 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:39:33.973235 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-k9lrs_d0c64150-3a79-4dc2-99fa-a7f04c3e40dc/kube-rbac-proxy-self/0.log" Jul 21 20:39:34.033870 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:39:34.033851 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-7b7b7bc8bf-65vlc_3ef3673d-2e1b-4d29-883c-a28a55c8e939/monitoring-plugin/0.log" Jul 21 20:39:34.132453 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:39:34.132435 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4x8tg_6e7f65a8-9ebc-4df4-9907-c9632cd5f7ac/node-exporter/0.log" Jul 21 20:39:34.151632 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:39:34.151615 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4x8tg_6e7f65a8-9ebc-4df4-9907-c9632cd5f7ac/kube-rbac-proxy/0.log" Jul 21 20:39:34.173548 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:39:34.173534 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4x8tg_6e7f65a8-9ebc-4df4-9907-c9632cd5f7ac/init-textfile/0.log" Jul 21 20:39:34.267938 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:39:34.267868 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-g558f_6f695010-55df-4bb3-a59e-a6ba4ae714e7/kube-rbac-proxy-main/0.log" Jul 21 20:39:34.288358 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:39:34.288333 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-g558f_6f695010-55df-4bb3-a59e-a6ba4ae714e7/kube-rbac-proxy-self/0.log" Jul 21 20:39:34.306840 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:39:34.306823 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-g558f_6f695010-55df-4bb3-a59e-a6ba4ae714e7/openshift-state-metrics/0.log" Jul 21 20:39:34.339705 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:39:34.339688 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_47ff18c4-4ce4-43b6-9932-ad3ec8e51546/prometheus/0.log" Jul 21 20:39:34.358992 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:39:34.358975 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_47ff18c4-4ce4-43b6-9932-ad3ec8e51546/config-reloader/0.log" Jul 21 20:39:34.376121 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:39:34.376102 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_47ff18c4-4ce4-43b6-9932-ad3ec8e51546/thanos-sidecar/0.log" Jul 21 20:39:34.394794 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:39:34.394763 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_47ff18c4-4ce4-43b6-9932-ad3ec8e51546/kube-rbac-proxy-web/0.log" Jul 21 20:39:34.412831 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:39:34.412807 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_47ff18c4-4ce4-43b6-9932-ad3ec8e51546/kube-rbac-proxy/0.log" Jul 21 20:39:34.430788 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:39:34.430768 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_47ff18c4-4ce4-43b6-9932-ad3ec8e51546/kube-rbac-proxy-thanos/0.log" Jul 21 20:39:34.448123 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:39:34.448101 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_47ff18c4-4ce4-43b6-9932-ad3ec8e51546/init-config-reloader/0.log" Jul 21 20:39:34.534161 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:39:34.534110 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7d59944ccd-9gmsq_80c425f8-3c06-46c8-a60d-9a8f607a2df3/telemeter-client/0.log" Jul 21 20:39:34.551485 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:39:34.551470 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7d59944ccd-9gmsq_80c425f8-3c06-46c8-a60d-9a8f607a2df3/reload/0.log" Jul 21 20:39:34.571193 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:39:34.571168 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7d59944ccd-9gmsq_80c425f8-3c06-46c8-a60d-9a8f607a2df3/kube-rbac-proxy/0.log" Jul 21 20:39:34.598328 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:39:34.598310 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6664b8bc76-4h8r2_7a6dd5c2-848b-45ba-99d7-e9975ea40a7d/thanos-query/0.log" Jul 21 20:39:34.620789 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:39:34.620770 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6664b8bc76-4h8r2_7a6dd5c2-848b-45ba-99d7-e9975ea40a7d/kube-rbac-proxy-web/0.log" Jul 21 20:39:34.642989 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:39:34.642974 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6664b8bc76-4h8r2_7a6dd5c2-848b-45ba-99d7-e9975ea40a7d/kube-rbac-proxy/0.log" Jul 21 20:39:34.666973 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:39:34.666952 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6664b8bc76-4h8r2_7a6dd5c2-848b-45ba-99d7-e9975ea40a7d/prom-label-proxy/0.log" Jul 21 20:39:34.693604 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:39:34.693585 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6664b8bc76-4h8r2_7a6dd5c2-848b-45ba-99d7-e9975ea40a7d/kube-rbac-proxy-rules/0.log" Jul 21 20:39:34.714811 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:39:34.714793 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6664b8bc76-4h8r2_7a6dd5c2-848b-45ba-99d7-e9975ea40a7d/kube-rbac-proxy-metrics/0.log" Jul 21 20:39:37.082322 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:39:37.082290 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-t8lbg/perf-node-gather-daemonset-5zlw6"] Jul 21 20:39:37.085604 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:39:37.085580 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-t8lbg/perf-node-gather-daemonset-5zlw6" Jul 21 20:39:37.088369 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:39:37.088344 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-t8lbg\"/\"default-dockercfg-4rtmx\"" Jul 21 20:39:37.088478 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:39:37.088349 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-t8lbg\"/\"kube-root-ca.crt\"" Jul 21 20:39:37.089744 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:39:37.089724 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-t8lbg\"/\"openshift-service-ca.crt\"" Jul 21 20:39:37.095716 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:39:37.095696 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-t8lbg/perf-node-gather-daemonset-5zlw6"] Jul 21 20:39:37.226499 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:39:37.226473 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/42b1e5ea-b0dc-423a-86c5-429c653718dc-lib-modules\") pod \"perf-node-gather-daemonset-5zlw6\" (UID: \"42b1e5ea-b0dc-423a-86c5-429c653718dc\") " pod="openshift-must-gather-t8lbg/perf-node-gather-daemonset-5zlw6" Jul 21 20:39:37.226651 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:39:37.226523 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/42b1e5ea-b0dc-423a-86c5-429c653718dc-podres\") pod \"perf-node-gather-daemonset-5zlw6\" (UID: \"42b1e5ea-b0dc-423a-86c5-429c653718dc\") " pod="openshift-must-gather-t8lbg/perf-node-gather-daemonset-5zlw6" Jul 21 20:39:37.226651 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:39:37.226552 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jc8lx\" (UniqueName: \"kubernetes.io/projected/42b1e5ea-b0dc-423a-86c5-429c653718dc-kube-api-access-jc8lx\") pod \"perf-node-gather-daemonset-5zlw6\" (UID: \"42b1e5ea-b0dc-423a-86c5-429c653718dc\") " pod="openshift-must-gather-t8lbg/perf-node-gather-daemonset-5zlw6" Jul 21 20:39:37.226651 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:39:37.226581 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/42b1e5ea-b0dc-423a-86c5-429c653718dc-sys\") pod \"perf-node-gather-daemonset-5zlw6\" (UID: \"42b1e5ea-b0dc-423a-86c5-429c653718dc\") " pod="openshift-must-gather-t8lbg/perf-node-gather-daemonset-5zlw6" Jul 21 20:39:37.226651 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:39:37.226613 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/42b1e5ea-b0dc-423a-86c5-429c653718dc-proc\") pod \"perf-node-gather-daemonset-5zlw6\" (UID: \"42b1e5ea-b0dc-423a-86c5-429c653718dc\") " pod="openshift-must-gather-t8lbg/perf-node-gather-daemonset-5zlw6" Jul 21 20:39:37.327611 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:39:37.327588 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/42b1e5ea-b0dc-423a-86c5-429c653718dc-lib-modules\") pod \"perf-node-gather-daemonset-5zlw6\" (UID: \"42b1e5ea-b0dc-423a-86c5-429c653718dc\") " pod="openshift-must-gather-t8lbg/perf-node-gather-daemonset-5zlw6" Jul 21 20:39:37.327734 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:39:37.327629 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/42b1e5ea-b0dc-423a-86c5-429c653718dc-podres\") pod \"perf-node-gather-daemonset-5zlw6\" (UID: \"42b1e5ea-b0dc-423a-86c5-429c653718dc\") " pod="openshift-must-gather-t8lbg/perf-node-gather-daemonset-5zlw6" Jul 21 20:39:37.327734 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:39:37.327655 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jc8lx\" (UniqueName: \"kubernetes.io/projected/42b1e5ea-b0dc-423a-86c5-429c653718dc-kube-api-access-jc8lx\") pod \"perf-node-gather-daemonset-5zlw6\" (UID: \"42b1e5ea-b0dc-423a-86c5-429c653718dc\") " pod="openshift-must-gather-t8lbg/perf-node-gather-daemonset-5zlw6" Jul 21 20:39:37.327734 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:39:37.327689 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/42b1e5ea-b0dc-423a-86c5-429c653718dc-sys\") pod \"perf-node-gather-daemonset-5zlw6\" (UID: \"42b1e5ea-b0dc-423a-86c5-429c653718dc\") " pod="openshift-must-gather-t8lbg/perf-node-gather-daemonset-5zlw6" Jul 21 20:39:37.327873 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:39:37.327736 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/42b1e5ea-b0dc-423a-86c5-429c653718dc-proc\") pod \"perf-node-gather-daemonset-5zlw6\" (UID: \"42b1e5ea-b0dc-423a-86c5-429c653718dc\") " pod="openshift-must-gather-t8lbg/perf-node-gather-daemonset-5zlw6" Jul 21 20:39:37.327873 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:39:37.327771 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/42b1e5ea-b0dc-423a-86c5-429c653718dc-podres\") pod \"perf-node-gather-daemonset-5zlw6\" (UID: \"42b1e5ea-b0dc-423a-86c5-429c653718dc\") " pod="openshift-must-gather-t8lbg/perf-node-gather-daemonset-5zlw6" Jul 21 20:39:37.327873 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:39:37.327779 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/42b1e5ea-b0dc-423a-86c5-429c653718dc-lib-modules\") pod \"perf-node-gather-daemonset-5zlw6\" (UID: \"42b1e5ea-b0dc-423a-86c5-429c653718dc\") " pod="openshift-must-gather-t8lbg/perf-node-gather-daemonset-5zlw6" Jul 21 20:39:37.327873 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:39:37.327803 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/42b1e5ea-b0dc-423a-86c5-429c653718dc-proc\") pod \"perf-node-gather-daemonset-5zlw6\" (UID: \"42b1e5ea-b0dc-423a-86c5-429c653718dc\") " pod="openshift-must-gather-t8lbg/perf-node-gather-daemonset-5zlw6" Jul 21 20:39:37.327873 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:39:37.327830 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/42b1e5ea-b0dc-423a-86c5-429c653718dc-sys\") pod \"perf-node-gather-daemonset-5zlw6\" (UID: \"42b1e5ea-b0dc-423a-86c5-429c653718dc\") " pod="openshift-must-gather-t8lbg/perf-node-gather-daemonset-5zlw6" Jul 21 20:39:37.336426 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:39:37.336369 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jc8lx\" (UniqueName: \"kubernetes.io/projected/42b1e5ea-b0dc-423a-86c5-429c653718dc-kube-api-access-jc8lx\") pod \"perf-node-gather-daemonset-5zlw6\" (UID: \"42b1e5ea-b0dc-423a-86c5-429c653718dc\") " pod="openshift-must-gather-t8lbg/perf-node-gather-daemonset-5zlw6" Jul 21 20:39:37.395385 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:39:37.395367 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-t8lbg/perf-node-gather-daemonset-5zlw6" Jul 21 20:39:37.518062 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:39:37.517873 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-t8lbg/perf-node-gather-daemonset-5zlw6"] Jul 21 20:39:37.520726 ip-10-0-131-27 kubenswrapper[2560]: W0721 20:39:37.520703 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod42b1e5ea_b0dc_423a_86c5_429c653718dc.slice/crio-8e1a452b1cacd582e95fe5b52504428fbce4ff363e48b0bcbe0db338139957be WatchSource:0}: Error finding container 8e1a452b1cacd582e95fe5b52504428fbce4ff363e48b0bcbe0db338139957be: Status 404 returned error can't find the container with id 8e1a452b1cacd582e95fe5b52504428fbce4ff363e48b0bcbe0db338139957be Jul 21 20:39:37.919967 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:39:37.919936 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-9rz9d_e1f1c9b1-9cf8-4962-804e-d5b905c2d4f4/dns/0.log" Jul 21 20:39:37.936886 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:39:37.936853 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-9rz9d_e1f1c9b1-9cf8-4962-804e-d5b905c2d4f4/kube-rbac-proxy/0.log" Jul 21 20:39:38.030551 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:39:38.030531 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4shwn_8cafaac7-d4fe-43e8-a75a-08f26aa58cd5/dns-node-resolver/0.log" Jul 21 20:39:38.097453 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:39:38.097421 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-t8lbg/perf-node-gather-daemonset-5zlw6" event={"ID":"42b1e5ea-b0dc-423a-86c5-429c653718dc","Type":"ContainerStarted","Data":"8829f6d8ecf104870eef65b735142799bf754a3597f248851f55e8a6c3f3e90f"} Jul 21 20:39:38.097826 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:39:38.097487 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-t8lbg/perf-node-gather-daemonset-5zlw6" event={"ID":"42b1e5ea-b0dc-423a-86c5-429c653718dc","Type":"ContainerStarted","Data":"8e1a452b1cacd582e95fe5b52504428fbce4ff363e48b0bcbe0db338139957be"} Jul 21 20:39:38.097826 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:39:38.097559 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-t8lbg/perf-node-gather-daemonset-5zlw6" Jul 21 20:39:38.113621 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:39:38.113581 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-t8lbg/perf-node-gather-daemonset-5zlw6" podStartSLOduration=1.113567373 podStartE2EDuration="1.113567373s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 20:39:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:39:38.112189192 +0000 UTC m=+270.875426133" watchObservedRunningTime="2026-07-21 20:39:38.113567373 +0000 UTC m=+270.876804316" Jul 21 20:39:38.452419 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:39:38.452391 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-gf4h6_74c3fef4-6119-460a-850e-27a565b7d068/node-ca/0.log" Jul 21 20:39:39.347576 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:39:39.347550 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-f6lvh_833f477b-d8ec-4245-82e2-5e2c5dce8dc1/serve-healthcheck-canary/0.log" Jul 21 20:39:39.822189 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:39:39.822162 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-km5t4_eb3b766c-4d7d-40f5-ad7d-38b19e505a36/kube-rbac-proxy/0.log" Jul 21 20:39:39.840062 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:39:39.840035 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-km5t4_eb3b766c-4d7d-40f5-ad7d-38b19e505a36/exporter/0.log" Jul 21 20:39:39.856511 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:39:39.856492 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-km5t4_eb3b766c-4d7d-40f5-ad7d-38b19e505a36/extractor/0.log" Jul 21 20:39:44.110043 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:39:44.110000 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-t8lbg/perf-node-gather-daemonset-5zlw6" Jul 21 20:39:44.496485 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:39:44.496461 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tdg72_baf82b79-7fff-42da-8256-bd0d0b6a3414/kube-multus-additional-cni-plugins/0.log" Jul 21 20:39:44.514202 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:39:44.514176 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tdg72_baf82b79-7fff-42da-8256-bd0d0b6a3414/egress-router-binary-copy/0.log" Jul 21 20:39:44.531795 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:39:44.531769 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tdg72_baf82b79-7fff-42da-8256-bd0d0b6a3414/cni-plugins/0.log" Jul 21 20:39:44.549269 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:39:44.549253 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tdg72_baf82b79-7fff-42da-8256-bd0d0b6a3414/bond-cni-plugin/0.log" Jul 21 20:39:44.570220 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:39:44.570199 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tdg72_baf82b79-7fff-42da-8256-bd0d0b6a3414/routeoverride-cni/0.log" Jul 21 20:39:44.586961 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:39:44.586946 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tdg72_baf82b79-7fff-42da-8256-bd0d0b6a3414/whereabouts-cni-bincopy/0.log" Jul 21 20:39:44.603563 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:39:44.603534 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tdg72_baf82b79-7fff-42da-8256-bd0d0b6a3414/whereabouts-cni/0.log" Jul 21 20:39:44.656108 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:39:44.656083 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-rl9pf_e49d91ac-7093-4224-b087-0115ce9cec60/kube-multus/0.log" Jul 21 20:39:44.748685 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:39:44.748628 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-qs78f_51fd4d84-10d1-464a-bcdb-dd32614a44a9/network-metrics-daemon/0.log" Jul 21 20:39:44.765791 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:39:44.765775 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-qs78f_51fd4d84-10d1-464a-bcdb-dd32614a44a9/kube-rbac-proxy/0.log" Jul 21 20:39:45.440157 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:39:45.440132 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bpvvl_cd3c0f2a-c76d-4d83-9eeb-1e5dafd81177/ovn-controller/0.log" Jul 21 20:39:45.458503 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:39:45.458481 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bpvvl_cd3c0f2a-c76d-4d83-9eeb-1e5dafd81177/ovn-acl-logging/1.log" Jul 21 20:39:45.458609 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:39:45.458564 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bpvvl_cd3c0f2a-c76d-4d83-9eeb-1e5dafd81177/ovn-acl-logging/0.log" Jul 21 20:39:45.476547 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:39:45.476526 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bpvvl_cd3c0f2a-c76d-4d83-9eeb-1e5dafd81177/kube-rbac-proxy-node/0.log" Jul 21 20:39:45.493710 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:39:45.493697 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bpvvl_cd3c0f2a-c76d-4d83-9eeb-1e5dafd81177/kube-rbac-proxy-ovn-metrics/0.log" Jul 21 20:39:45.511206 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:39:45.511191 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bpvvl_cd3c0f2a-c76d-4d83-9eeb-1e5dafd81177/northd/0.log" Jul 21 20:39:45.528047 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:39:45.528029 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bpvvl_cd3c0f2a-c76d-4d83-9eeb-1e5dafd81177/nbdb/0.log" Jul 21 20:39:45.548921 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:39:45.548903 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bpvvl_cd3c0f2a-c76d-4d83-9eeb-1e5dafd81177/sbdb/0.log" Jul 21 20:39:45.585646 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:39:45.585623 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bpvvl_cd3c0f2a-c76d-4d83-9eeb-1e5dafd81177/ovnkube-controller/0.log" Jul 21 20:39:46.951675 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:39:46.951655 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-5v767_3abb9e4b-7d06-4635-90a7-a31abc3c38ff/network-check-target-container/0.log" Jul 21 20:39:47.920337 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:39:47.920258 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-6k7l8_bd370f2e-33cc-425d-812a-c063fd02f4c9/iptables-alerter/0.log" Jul 21 20:39:48.497543 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:39:48.497518 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-swn8q_77b4be87-3e69-4f8a-a708-1dd40a4f05cc/tuned/0.log" Jul 21 20:39:51.442365 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:39:51.442331 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-9nr9h_92ab865e-73dc-4b1a-a999-5ad3e40f04f0/csi-driver/0.log" Jul 21 20:39:51.459850 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:39:51.459824 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-9nr9h_92ab865e-73dc-4b1a-a999-5ad3e40f04f0/csi-node-driver-registrar/0.log" Jul 21 20:39:51.476745 ip-10-0-131-27 kubenswrapper[2560]: I0721 20:39:51.476724 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-9nr9h_92ab865e-73dc-4b1a-a999-5ad3e40f04f0/csi-liveness-probe/0.log"