Jul 06 21:12:56.931594 ip-10-0-130-89 systemd[1]: Starting Kubernetes Kubelet... Jul 06 21:12:57.361275 ip-10-0-130-89 kubenswrapper[2573]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 21:12:57.361275 ip-10-0-130-89 kubenswrapper[2573]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 06 21:12:57.361275 ip-10-0-130-89 kubenswrapper[2573]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 21:12:57.361275 ip-10-0-130-89 kubenswrapper[2573]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 06 21:12:57.361275 ip-10-0-130-89 kubenswrapper[2573]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 21:12:57.362353 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.362174 2573 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 06 21:12:57.367491 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.366790 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 21:12:57.367491 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.366815 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 21:12:57.367491 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.366833 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 21:12:57.367491 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.366839 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 21:12:57.367491 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.366847 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 21:12:57.367491 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.366852 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 21:12:57.367491 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.366857 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 21:12:57.367491 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.366861 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 21:12:57.367491 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.366873 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 21:12:57.367491 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.366878 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 21:12:57.367491 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.366883 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 21:12:57.367491 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.366888 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 21:12:57.367491 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.366895 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 21:12:57.367491 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.366902 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 21:12:57.367491 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.366907 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 21:12:57.367491 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.366912 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 21:12:57.367491 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.366917 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 21:12:57.367491 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.366922 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 21:12:57.367491 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.366927 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 21:12:57.367491 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.366932 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 21:12:57.368459 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.366937 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 21:12:57.368459 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.366946 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 21:12:57.368459 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.366951 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 21:12:57.368459 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.366955 2573 feature_gate.go:328] unrecognized feature gate: Example Jul 06 21:12:57.368459 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.366960 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 21:12:57.368459 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.366968 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 21:12:57.368459 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.366975 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 21:12:57.368459 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.366981 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 21:12:57.368459 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.366986 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 21:12:57.368459 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.366991 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 21:12:57.368459 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.366995 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 21:12:57.368459 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.367000 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 21:12:57.368459 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.367011 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 21:12:57.368459 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.367016 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 21:12:57.368459 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.367021 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 21:12:57.368459 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.367032 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 21:12:57.368459 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.367037 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 21:12:57.368459 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.367041 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 21:12:57.368459 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.367045 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 21:12:57.368958 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.367050 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 21:12:57.368958 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.367055 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 21:12:57.368958 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.367059 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 21:12:57.368958 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.367064 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 21:12:57.368958 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.367068 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 21:12:57.368958 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.367073 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 21:12:57.368958 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.367083 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 21:12:57.368958 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.367087 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 21:12:57.368958 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.367092 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 21:12:57.368958 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.367096 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 21:12:57.368958 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.367100 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 21:12:57.368958 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.367105 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 21:12:57.368958 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.367110 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 21:12:57.368958 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.367115 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 21:12:57.368958 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.367119 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 21:12:57.368958 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.367124 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 21:12:57.368958 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.367128 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 21:12:57.368958 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.367133 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 21:12:57.368958 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.367137 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 21:12:57.368958 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.367146 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 21:12:57.369523 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.367152 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 21:12:57.369523 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.367156 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 21:12:57.369523 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.367162 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 21:12:57.369523 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.367167 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 21:12:57.369523 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.367177 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 21:12:57.369523 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.367183 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 21:12:57.369523 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.367191 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 21:12:57.369523 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.367196 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 21:12:57.369523 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.367201 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 21:12:57.369523 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.367217 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 21:12:57.369523 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.367227 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 21:12:57.369523 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.367232 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 21:12:57.369523 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.367237 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 21:12:57.369523 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.367242 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 21:12:57.369523 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.367247 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 21:12:57.369523 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.367251 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 21:12:57.369523 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.367256 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 21:12:57.369523 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.367261 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 21:12:57.369523 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.367266 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 21:12:57.369523 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.367270 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 21:12:57.370032 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.367274 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 21:12:57.370032 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.367279 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 21:12:57.370032 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.367283 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 21:12:57.370032 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.367293 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 21:12:57.370032 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.367297 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 21:12:57.370032 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.367302 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 21:12:57.370032 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.367307 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 21:12:57.370032 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.367328 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 21:12:57.370032 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.367334 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 21:12:57.370032 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.367339 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 21:12:57.370032 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.367343 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 21:12:57.370032 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.367347 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 21:12:57.370032 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.367351 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 21:12:57.370032 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.367356 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 21:12:57.370032 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.367361 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 21:12:57.370032 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.367366 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 21:12:57.370032 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.367376 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 21:12:57.370032 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.367381 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 21:12:57.370032 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.367386 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 21:12:57.370032 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.367390 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 21:12:57.370619 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.368934 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 21:12:57.370619 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.368945 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 21:12:57.370619 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.368950 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 21:12:57.370619 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.368954 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 21:12:57.370619 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.368959 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 21:12:57.370619 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.368962 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 21:12:57.370619 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.368965 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 21:12:57.370619 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.368968 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 21:12:57.370619 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.368971 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 21:12:57.370619 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.368974 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 21:12:57.370619 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.368977 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 21:12:57.370619 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.368980 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 21:12:57.370619 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.368983 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 21:12:57.370619 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.368986 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 21:12:57.370619 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.368988 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 21:12:57.370619 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.368991 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 21:12:57.370619 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.368994 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 21:12:57.370619 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.368999 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 21:12:57.370619 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369002 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 21:12:57.371232 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369005 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 21:12:57.371232 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369009 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 21:12:57.371232 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369012 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 21:12:57.371232 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369014 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 21:12:57.371232 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369017 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 21:12:57.371232 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369020 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 21:12:57.371232 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369023 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 21:12:57.371232 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369027 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 21:12:57.371232 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369029 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 21:12:57.371232 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369032 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 21:12:57.371232 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369036 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 21:12:57.371232 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369039 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 21:12:57.371232 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369042 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 21:12:57.371232 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369044 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 21:12:57.371232 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369047 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 21:12:57.371232 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369050 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 21:12:57.371232 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369053 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 21:12:57.371232 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369056 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 21:12:57.371232 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369059 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 21:12:57.371810 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369061 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 21:12:57.371810 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369065 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 21:12:57.371810 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369068 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 21:12:57.371810 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369071 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 21:12:57.371810 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369073 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 21:12:57.371810 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369077 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 21:12:57.371810 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369079 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 21:12:57.371810 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369082 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 21:12:57.371810 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369085 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 21:12:57.371810 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369088 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 21:12:57.371810 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369091 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 21:12:57.371810 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369094 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 21:12:57.371810 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369098 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 21:12:57.371810 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369100 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 21:12:57.371810 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369103 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 21:12:57.371810 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369106 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 21:12:57.371810 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369109 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 21:12:57.371810 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369111 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 21:12:57.371810 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369114 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 21:12:57.371810 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369117 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 21:12:57.372340 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369119 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 21:12:57.372340 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369123 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 21:12:57.372340 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369126 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 21:12:57.372340 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369128 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 21:12:57.372340 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369131 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 21:12:57.372340 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369134 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 21:12:57.372340 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369136 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 21:12:57.372340 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369139 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 21:12:57.372340 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369142 2573 feature_gate.go:328] unrecognized feature gate: Example Jul 06 21:12:57.372340 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369145 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 21:12:57.372340 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369148 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 21:12:57.372340 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369151 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 21:12:57.372340 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369154 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 21:12:57.372340 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369156 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 21:12:57.372340 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369159 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 21:12:57.372340 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369161 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 21:12:57.372340 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369164 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 21:12:57.372340 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369166 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 21:12:57.372340 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369169 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 21:12:57.372340 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369172 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 21:12:57.372852 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369176 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 21:12:57.372852 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369179 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 21:12:57.372852 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369181 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 21:12:57.372852 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369184 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 21:12:57.372852 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369187 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 21:12:57.372852 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369190 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 21:12:57.372852 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369193 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 21:12:57.372852 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369196 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 21:12:57.372852 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369198 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 21:12:57.372852 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369201 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 21:12:57.372852 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369204 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 21:12:57.372852 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369206 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 21:12:57.372852 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369209 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 21:12:57.372852 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369214 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 21:12:57.372852 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369218 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 21:12:57.372852 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369221 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 21:12:57.372852 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369224 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 21:12:57.372852 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369228 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 21:12:57.372852 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369231 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 21:12:57.373368 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369233 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 21:12:57.373368 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369236 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 21:12:57.373368 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369670 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 21:12:57.373368 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369676 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 21:12:57.373368 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369679 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 21:12:57.373368 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369682 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 21:12:57.373368 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369685 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 21:12:57.373368 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369688 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 21:12:57.373368 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369690 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 21:12:57.373368 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369693 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 21:12:57.373368 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369696 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 21:12:57.373368 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369699 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 21:12:57.373368 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369701 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 21:12:57.373368 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369705 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 21:12:57.373368 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369708 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 21:12:57.373368 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369711 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 21:12:57.373368 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369714 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 21:12:57.373368 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369717 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 21:12:57.373368 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369720 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 21:12:57.373368 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369723 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 21:12:57.373880 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369725 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 21:12:57.373880 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369728 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 21:12:57.373880 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369731 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 21:12:57.373880 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369733 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 21:12:57.373880 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369736 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 21:12:57.373880 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369739 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 21:12:57.373880 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369742 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 21:12:57.373880 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369744 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 21:12:57.373880 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369747 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 21:12:57.373880 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369749 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 21:12:57.373880 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369752 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 21:12:57.373880 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369755 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 21:12:57.373880 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369757 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 21:12:57.373880 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369760 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 21:12:57.373880 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369765 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 21:12:57.373880 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369769 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 21:12:57.373880 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369772 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 21:12:57.373880 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369775 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 21:12:57.373880 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369778 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 21:12:57.373880 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369781 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 21:12:57.374408 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369784 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 21:12:57.374408 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369787 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 21:12:57.374408 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369790 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 21:12:57.374408 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369792 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 21:12:57.374408 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369795 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 21:12:57.374408 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369799 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 21:12:57.374408 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369802 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 21:12:57.374408 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369805 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 21:12:57.374408 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369808 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 21:12:57.374408 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369810 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 21:12:57.374408 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369813 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 21:12:57.374408 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369817 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 21:12:57.374408 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369821 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 21:12:57.374408 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369824 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 21:12:57.374408 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369827 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 21:12:57.374408 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369829 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 21:12:57.374408 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369832 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 21:12:57.374408 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369836 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 21:12:57.374408 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369838 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 21:12:57.374905 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369841 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 21:12:57.374905 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369843 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 21:12:57.374905 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369846 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 21:12:57.374905 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369849 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 21:12:57.374905 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369851 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 21:12:57.374905 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369854 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 21:12:57.374905 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369857 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 21:12:57.374905 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369859 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 21:12:57.374905 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369862 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 21:12:57.374905 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369865 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 21:12:57.374905 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369868 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 21:12:57.374905 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369870 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 21:12:57.374905 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369873 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 21:12:57.374905 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369876 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 21:12:57.374905 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369878 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 21:12:57.374905 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369881 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 21:12:57.374905 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369884 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 21:12:57.374905 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369886 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 21:12:57.374905 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369890 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 21:12:57.374905 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369893 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 21:12:57.375440 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369896 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 21:12:57.375440 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369899 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 21:12:57.375440 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369902 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 21:12:57.375440 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369904 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 21:12:57.375440 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369907 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 21:12:57.375440 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369910 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 21:12:57.375440 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369914 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 21:12:57.375440 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369917 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 21:12:57.375440 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369920 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 21:12:57.375440 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369923 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 21:12:57.375440 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369929 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 21:12:57.375440 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369933 2573 feature_gate.go:328] unrecognized feature gate: Example Jul 06 21:12:57.375440 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369935 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 21:12:57.375440 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369938 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 21:12:57.375440 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369941 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 21:12:57.375440 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369944 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 21:12:57.375440 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369948 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 21:12:57.375440 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369951 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 21:12:57.375440 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369953 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 21:12:57.375934 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369956 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 21:12:57.375934 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369959 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 21:12:57.375934 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.369961 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 21:12:57.375934 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.370040 2573 flags.go:64] FLAG: --address="0.0.0.0" Jul 06 21:12:57.375934 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.370048 2573 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 06 21:12:57.375934 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.370055 2573 flags.go:64] FLAG: --anonymous-auth="true" Jul 06 21:12:57.375934 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.370060 2573 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 06 21:12:57.375934 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.370064 2573 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 06 21:12:57.375934 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.370068 2573 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 06 21:12:57.375934 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.370073 2573 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 06 21:12:57.375934 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.370077 2573 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 06 21:12:57.375934 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.370080 2573 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 06 21:12:57.375934 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.370084 2573 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 06 21:12:57.375934 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.370087 2573 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 06 21:12:57.375934 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.370091 2573 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 06 21:12:57.375934 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.370094 2573 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 06 21:12:57.375934 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.370097 2573 flags.go:64] FLAG: --cgroup-root="" Jul 06 21:12:57.375934 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.370100 2573 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 06 21:12:57.375934 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.370104 2573 flags.go:64] FLAG: --client-ca-file="" Jul 06 21:12:57.375934 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.370108 2573 flags.go:64] FLAG: --cloud-provider="external" Jul 06 21:12:57.375934 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.370111 2573 flags.go:64] FLAG: --cluster-dns="[]" Jul 06 21:12:57.375934 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.370116 2573 flags.go:64] FLAG: --cluster-domain="" Jul 06 21:12:57.375934 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.370119 2573 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 06 21:12:57.375934 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.370124 2573 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 06 21:12:57.376579 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.370127 2573 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 06 21:12:57.376579 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.370131 2573 flags.go:64] FLAG: --container-log-max-files="5" Jul 06 21:12:57.376579 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.370135 2573 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 06 21:12:57.376579 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.370138 2573 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 06 21:12:57.376579 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.370141 2573 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 06 21:12:57.376579 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.370144 2573 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 06 21:12:57.376579 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.370148 2573 flags.go:64] FLAG: --contention-profiling="false" Jul 06 21:12:57.376579 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.370151 2573 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 06 21:12:57.376579 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.370154 2573 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 06 21:12:57.376579 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.370157 2573 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 06 21:12:57.376579 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.370160 2573 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 06 21:12:57.376579 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.370169 2573 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 06 21:12:57.376579 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.370172 2573 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 06 21:12:57.376579 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.370175 2573 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 06 21:12:57.376579 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.370178 2573 flags.go:64] FLAG: --enable-load-reader="false" Jul 06 21:12:57.376579 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.370182 2573 flags.go:64] FLAG: --enable-server="true" Jul 06 21:12:57.376579 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.370187 2573 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 06 21:12:57.376579 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.370192 2573 flags.go:64] FLAG: --event-burst="100" Jul 06 21:12:57.376579 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.370195 2573 flags.go:64] FLAG: --event-qps="50" Jul 06 21:12:57.376579 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.370198 2573 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 06 21:12:57.376579 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.370201 2573 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 06 21:12:57.376579 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.370205 2573 flags.go:64] FLAG: --eviction-hard="" Jul 06 21:12:57.376579 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.370209 2573 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 06 21:12:57.376579 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.370212 2573 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 06 21:12:57.377208 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.370215 2573 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 06 21:12:57.377208 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.370218 2573 flags.go:64] FLAG: --eviction-soft="" Jul 06 21:12:57.377208 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.370221 2573 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 06 21:12:57.377208 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.370224 2573 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 06 21:12:57.377208 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.370231 2573 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 06 21:12:57.377208 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.370234 2573 flags.go:64] FLAG: --experimental-mounter-path="" Jul 06 21:12:57.377208 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.370237 2573 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 06 21:12:57.377208 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.370241 2573 flags.go:64] FLAG: --fail-swap-on="true" Jul 06 21:12:57.377208 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.370244 2573 flags.go:64] FLAG: --feature-gates="" Jul 06 21:12:57.377208 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.370248 2573 flags.go:64] FLAG: --file-check-frequency="20s" Jul 06 21:12:57.377208 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.370251 2573 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 06 21:12:57.377208 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.370255 2573 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 06 21:12:57.377208 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.370258 2573 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 06 21:12:57.377208 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.370261 2573 flags.go:64] FLAG: --healthz-port="10248" Jul 06 21:12:57.377208 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.370264 2573 flags.go:64] FLAG: --help="false" Jul 06 21:12:57.377208 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.370267 2573 flags.go:64] FLAG: --hostname-override="ip-10-0-130-89.ec2.internal" Jul 06 21:12:57.377208 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.370270 2573 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 06 21:12:57.377208 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.370273 2573 flags.go:64] FLAG: --http-check-frequency="20s" Jul 06 21:12:57.377208 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.370276 2573 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 06 21:12:57.377208 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.370289 2573 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 06 21:12:57.377208 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.370293 2573 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 06 21:12:57.377208 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.370297 2573 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 06 21:12:57.377208 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.370300 2573 flags.go:64] FLAG: --image-service-endpoint="" Jul 06 21:12:57.377905 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.370303 2573 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 06 21:12:57.377905 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.370307 2573 flags.go:64] FLAG: --kube-api-burst="100" Jul 06 21:12:57.377905 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.370324 2573 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 06 21:12:57.377905 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.370328 2573 flags.go:64] FLAG: --kube-api-qps="50" Jul 06 21:12:57.377905 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.370331 2573 flags.go:64] FLAG: --kube-reserved="" Jul 06 21:12:57.377905 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.370334 2573 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 06 21:12:57.377905 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.370337 2573 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 06 21:12:57.377905 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.370341 2573 flags.go:64] FLAG: --kubelet-cgroups="" Jul 06 21:12:57.377905 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.370344 2573 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 06 21:12:57.377905 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.370347 2573 flags.go:64] FLAG: --lock-file="" Jul 06 21:12:57.377905 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.370350 2573 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 06 21:12:57.377905 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.370354 2573 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 06 21:12:57.377905 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.370357 2573 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 06 21:12:57.377905 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.370363 2573 flags.go:64] FLAG: --log-json-split-stream="false" Jul 06 21:12:57.377905 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.370367 2573 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 06 21:12:57.377905 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.370370 2573 flags.go:64] FLAG: --log-text-split-stream="false" Jul 06 21:12:57.377905 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.370375 2573 flags.go:64] FLAG: --logging-format="text" Jul 06 21:12:57.377905 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.370378 2573 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 06 21:12:57.377905 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.370381 2573 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 06 21:12:57.377905 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.370384 2573 flags.go:64] FLAG: --manifest-url="" Jul 06 21:12:57.377905 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.370388 2573 flags.go:64] FLAG: --manifest-url-header="" Jul 06 21:12:57.377905 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.370392 2573 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 06 21:12:57.377905 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.370396 2573 flags.go:64] FLAG: --max-open-files="1000000" Jul 06 21:12:57.377905 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.370400 2573 flags.go:64] FLAG: --max-pods="110" Jul 06 21:12:57.377905 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.370403 2573 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 06 21:12:57.378565 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.370407 2573 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 06 21:12:57.378565 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.370410 2573 flags.go:64] FLAG: --memory-manager-policy="None" Jul 06 21:12:57.378565 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.370414 2573 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 06 21:12:57.378565 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.370417 2573 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 06 21:12:57.378565 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.370420 2573 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 06 21:12:57.378565 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.370423 2573 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 06 21:12:57.378565 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.370431 2573 flags.go:64] FLAG: --node-status-max-images="50" Jul 06 21:12:57.378565 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.370434 2573 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 06 21:12:57.378565 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.370439 2573 flags.go:64] FLAG: --oom-score-adj="-999" Jul 06 21:12:57.378565 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.370442 2573 flags.go:64] FLAG: --pod-cidr="" Jul 06 21:12:57.378565 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.370445 2573 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 06 21:12:57.378565 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.370452 2573 flags.go:64] FLAG: --pod-manifest-path="" Jul 06 21:12:57.378565 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.370455 2573 flags.go:64] FLAG: --pod-max-pids="-1" Jul 06 21:12:57.378565 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.370458 2573 flags.go:64] FLAG: --pods-per-core="0" Jul 06 21:12:57.378565 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.370461 2573 flags.go:64] FLAG: --port="10250" Jul 06 21:12:57.378565 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.370465 2573 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 06 21:12:57.378565 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.370468 2573 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0b5d2bb2f431d36fa" Jul 06 21:12:57.378565 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.370471 2573 flags.go:64] FLAG: --qos-reserved="" Jul 06 21:12:57.378565 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.370475 2573 flags.go:64] FLAG: --read-only-port="10255" Jul 06 21:12:57.378565 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.370478 2573 flags.go:64] FLAG: --register-node="true" Jul 06 21:12:57.378565 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.370481 2573 flags.go:64] FLAG: --register-with-taints="" Jul 06 21:12:57.378565 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.370485 2573 flags.go:64] FLAG: --registry-burst="10" Jul 06 21:12:57.378565 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.370488 2573 flags.go:64] FLAG: --registry-qps="5" Jul 06 21:12:57.378565 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.370491 2573 flags.go:64] FLAG: --reserved-cpus="" Jul 06 21:12:57.379210 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.370495 2573 flags.go:64] FLAG: --reserved-memory="" Jul 06 21:12:57.379210 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.370499 2573 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 06 21:12:57.379210 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.370503 2573 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 06 21:12:57.379210 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.370506 2573 flags.go:64] FLAG: --rotate-certificates="false" Jul 06 21:12:57.379210 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.370509 2573 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 06 21:12:57.379210 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.370512 2573 flags.go:64] FLAG: --runonce="false" Jul 06 21:12:57.379210 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.370515 2573 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 06 21:12:57.379210 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.370518 2573 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 06 21:12:57.379210 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.370521 2573 flags.go:64] FLAG: --seccomp-default="false" Jul 06 21:12:57.379210 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.370524 2573 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 06 21:12:57.379210 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.370527 2573 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 06 21:12:57.379210 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.370530 2573 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 06 21:12:57.379210 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.370534 2573 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 06 21:12:57.379210 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.370537 2573 flags.go:64] FLAG: --storage-driver-password="root" Jul 06 21:12:57.379210 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.370540 2573 flags.go:64] FLAG: --storage-driver-secure="false" Jul 06 21:12:57.379210 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.370543 2573 flags.go:64] FLAG: --storage-driver-table="stats" Jul 06 21:12:57.379210 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.370548 2573 flags.go:64] FLAG: --storage-driver-user="root" Jul 06 21:12:57.379210 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.370551 2573 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 06 21:12:57.379210 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.370554 2573 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 06 21:12:57.379210 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.370558 2573 flags.go:64] FLAG: --system-cgroups="" Jul 06 21:12:57.379210 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.370561 2573 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 06 21:12:57.379210 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.370566 2573 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 06 21:12:57.379210 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.370569 2573 flags.go:64] FLAG: --tls-cert-file="" Jul 06 21:12:57.379210 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.370572 2573 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 06 21:12:57.379210 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.370577 2573 flags.go:64] FLAG: --tls-min-version="" Jul 06 21:12:57.379873 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.370580 2573 flags.go:64] FLAG: --tls-private-key-file="" Jul 06 21:12:57.379873 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.370583 2573 flags.go:64] FLAG: --topology-manager-policy="none" Jul 06 21:12:57.379873 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.370586 2573 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 06 21:12:57.379873 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.370589 2573 flags.go:64] FLAG: --topology-manager-scope="container" Jul 06 21:12:57.379873 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.370593 2573 flags.go:64] FLAG: --v="2" Jul 06 21:12:57.379873 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.370597 2573 flags.go:64] FLAG: --version="false" Jul 06 21:12:57.379873 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.370602 2573 flags.go:64] FLAG: --vmodule="" Jul 06 21:12:57.379873 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.370608 2573 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 06 21:12:57.379873 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.370611 2573 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 06 21:12:57.379873 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.370736 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 21:12:57.379873 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.370740 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 21:12:57.379873 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.370744 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 21:12:57.379873 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.370747 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 21:12:57.379873 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.370750 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 21:12:57.379873 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.370753 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 21:12:57.379873 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.370756 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 21:12:57.379873 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.370759 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 21:12:57.379873 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.370762 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 21:12:57.379873 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.370764 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 21:12:57.379873 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.370769 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 21:12:57.379873 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.370773 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 21:12:57.380449 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.370777 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 21:12:57.380449 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.370780 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 21:12:57.380449 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.370785 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 21:12:57.380449 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.370789 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 21:12:57.380449 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.370792 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 21:12:57.380449 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.370795 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 21:12:57.380449 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.370798 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 21:12:57.380449 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.370801 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 21:12:57.380449 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.370804 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 21:12:57.380449 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.370807 2573 feature_gate.go:328] unrecognized feature gate: Example Jul 06 21:12:57.380449 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.370810 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 21:12:57.380449 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.370813 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 21:12:57.380449 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.370817 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 21:12:57.380449 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.370820 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 21:12:57.380449 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.370822 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 21:12:57.380449 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.370825 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 21:12:57.380449 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.370828 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 21:12:57.380449 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.370831 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 21:12:57.380449 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.370837 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 21:12:57.380449 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.370840 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 21:12:57.380968 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.370843 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 21:12:57.380968 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.370845 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 21:12:57.380968 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.370848 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 21:12:57.380968 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.370851 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 21:12:57.380968 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.370854 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 21:12:57.380968 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.370857 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 21:12:57.380968 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.370860 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 21:12:57.380968 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.370862 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 21:12:57.380968 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.370865 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 21:12:57.380968 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.370869 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 21:12:57.380968 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.370871 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 21:12:57.380968 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.370874 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 21:12:57.380968 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.370877 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 21:12:57.380968 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.370881 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 21:12:57.380968 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.370885 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 21:12:57.380968 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.370888 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 21:12:57.380968 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.370890 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 21:12:57.380968 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.370893 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 21:12:57.380968 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.370896 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 21:12:57.380968 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.370898 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 21:12:57.381592 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.370901 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 21:12:57.381592 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.370904 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 21:12:57.381592 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.370906 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 21:12:57.381592 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.370909 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 21:12:57.381592 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.370912 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 21:12:57.381592 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.370915 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 21:12:57.381592 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.370917 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 21:12:57.381592 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.370920 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 21:12:57.381592 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.370923 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 21:12:57.381592 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.370926 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 21:12:57.381592 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.370930 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 21:12:57.381592 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.370934 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 21:12:57.381592 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.370937 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 21:12:57.381592 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.370939 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 21:12:57.381592 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.370942 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 21:12:57.381592 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.370945 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 21:12:57.381592 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.370948 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 21:12:57.381592 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.370950 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 21:12:57.381592 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.370953 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 21:12:57.381592 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.370956 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 21:12:57.382100 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.370959 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 21:12:57.382100 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.370961 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 21:12:57.382100 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.370964 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 21:12:57.382100 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.370967 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 21:12:57.382100 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.370970 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 21:12:57.382100 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.370974 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 21:12:57.382100 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.370979 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 21:12:57.382100 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.370982 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 21:12:57.382100 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.370985 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 21:12:57.382100 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.370988 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 21:12:57.382100 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.370991 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 21:12:57.382100 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.370994 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 21:12:57.382100 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.370996 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 21:12:57.382100 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.371000 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 21:12:57.382100 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.371005 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 21:12:57.382100 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.371008 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 21:12:57.382100 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.371011 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 21:12:57.382100 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.371014 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 21:12:57.382100 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.371017 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 21:12:57.382608 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.371020 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 21:12:57.382608 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.371023 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 21:12:57.382608 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.371026 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 21:12:57.382608 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.371030 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 21:12:57.382608 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.371033 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 21:12:57.382608 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.371036 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 21:12:57.382608 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.371040 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 21:12:57.382608 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.371042 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 21:12:57.382608 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.371935 2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 21:12:57.382608 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.379494 2573 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 06 21:12:57.382608 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.379511 2573 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 06 21:12:57.382608 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.379526 2573 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 06 21:12:57.382608 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.379533 2573 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 06 21:12:57.382608 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.379598 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 21:12:57.382608 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.379605 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 21:12:57.383017 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.379609 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 21:12:57.383017 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.379613 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 21:12:57.383017 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.379617 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 21:12:57.383017 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.379620 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 21:12:57.383017 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.379623 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 21:12:57.383017 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.379627 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 21:12:57.383017 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.379630 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 21:12:57.383017 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.379633 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 21:12:57.383017 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.379637 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 21:12:57.383017 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.379640 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 21:12:57.383017 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.379643 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 21:12:57.383017 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.379646 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 21:12:57.383017 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.379649 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 21:12:57.383017 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.379652 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 21:12:57.383017 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.379655 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 21:12:57.383017 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.379657 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 21:12:57.383017 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.379660 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 21:12:57.383017 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.379663 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 21:12:57.383017 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.379665 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 21:12:57.383017 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.379668 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 21:12:57.383562 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.379671 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 21:12:57.383562 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.379674 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 21:12:57.383562 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.379678 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 21:12:57.383562 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.379682 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 21:12:57.383562 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.379684 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 21:12:57.383562 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.379687 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 21:12:57.383562 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.379691 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 21:12:57.383562 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.379696 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 21:12:57.383562 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.379699 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 21:12:57.383562 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.379702 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 21:12:57.383562 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.379705 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 21:12:57.383562 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.379709 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 21:12:57.383562 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.379711 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 21:12:57.383562 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.379714 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 21:12:57.383562 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.379717 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 21:12:57.383562 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.379720 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 21:12:57.383562 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.379723 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 21:12:57.383562 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.379727 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 21:12:57.383562 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.379730 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 21:12:57.384046 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.379734 2573 feature_gate.go:328] unrecognized feature gate: Example Jul 06 21:12:57.384046 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.379738 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 21:12:57.384046 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.379741 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 21:12:57.384046 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.379743 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 21:12:57.384046 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.379747 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 21:12:57.384046 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.379750 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 21:12:57.384046 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.379752 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 21:12:57.384046 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.379755 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 21:12:57.384046 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.379758 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 21:12:57.384046 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.379761 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 21:12:57.384046 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.379763 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 21:12:57.384046 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.379766 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 21:12:57.384046 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.379770 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 21:12:57.384046 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.379772 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 21:12:57.384046 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.379775 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 21:12:57.384046 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.379778 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 21:12:57.384046 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.379782 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 21:12:57.384046 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.379784 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 21:12:57.384046 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.379787 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 21:12:57.384564 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.379790 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 21:12:57.384564 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.379794 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 21:12:57.384564 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.379797 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 21:12:57.384564 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.379799 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 21:12:57.384564 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.379802 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 21:12:57.384564 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.379805 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 21:12:57.384564 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.379808 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 21:12:57.384564 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.379810 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 21:12:57.384564 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.379813 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 21:12:57.384564 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.379816 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 21:12:57.384564 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.379819 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 21:12:57.384564 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.379822 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 21:12:57.384564 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.379825 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 21:12:57.384564 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.379828 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 21:12:57.384564 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.379831 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 21:12:57.384564 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.379833 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 21:12:57.384564 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.379836 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 21:12:57.384564 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.379839 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 21:12:57.384564 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.379841 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 21:12:57.384564 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.379844 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 21:12:57.385075 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.379847 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 21:12:57.385075 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.379849 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 21:12:57.385075 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.379852 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 21:12:57.385075 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.379854 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 21:12:57.385075 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.379857 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 21:12:57.385075 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.379861 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 21:12:57.385075 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.379863 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 21:12:57.385075 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.379866 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 21:12:57.385075 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.379869 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 21:12:57.385075 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.379871 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 21:12:57.385075 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.379876 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 21:12:57.385075 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.379879 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 21:12:57.385075 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.379882 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 21:12:57.385075 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.379885 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 21:12:57.385075 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.379888 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 21:12:57.385075 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.379891 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 21:12:57.385075 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.379894 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 21:12:57.385075 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.379896 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 21:12:57.385075 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.379899 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 21:12:57.385598 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.379904 2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 21:12:57.385598 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.380030 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 21:12:57.385598 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.380035 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 21:12:57.385598 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.380038 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 21:12:57.385598 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.380041 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 21:12:57.385598 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.380044 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 21:12:57.385598 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.380047 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 21:12:57.385598 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.380050 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 21:12:57.385598 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.380053 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 21:12:57.385598 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.380056 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 21:12:57.385598 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.380059 2573 feature_gate.go:328] unrecognized feature gate: Example Jul 06 21:12:57.385598 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.380061 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 21:12:57.385598 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.380064 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 21:12:57.385598 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.380067 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 21:12:57.385598 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.380070 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 21:12:57.386006 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.380072 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 21:12:57.386006 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.380075 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 21:12:57.386006 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.380078 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 21:12:57.386006 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.380080 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 21:12:57.386006 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.380083 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 21:12:57.386006 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.380086 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 21:12:57.386006 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.380089 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 21:12:57.386006 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.380092 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 21:12:57.386006 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.380095 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 21:12:57.386006 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.380098 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 21:12:57.386006 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.380101 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 21:12:57.386006 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.380105 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 21:12:57.386006 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.380108 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 21:12:57.386006 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.380111 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 21:12:57.386006 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.380113 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 21:12:57.386006 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.380116 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 21:12:57.386006 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.380119 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 21:12:57.386006 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.380122 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 21:12:57.386006 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.380124 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 21:12:57.386006 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.380127 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 21:12:57.386653 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.380130 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 21:12:57.386653 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.380132 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 21:12:57.386653 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.380136 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 21:12:57.386653 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.380138 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 21:12:57.386653 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.380141 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 21:12:57.386653 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.380143 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 21:12:57.386653 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.380146 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 21:12:57.386653 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.380149 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 21:12:57.386653 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.380151 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 21:12:57.386653 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.380154 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 21:12:57.386653 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.380156 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 21:12:57.386653 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.380159 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 21:12:57.386653 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.380162 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 21:12:57.386653 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.380165 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 21:12:57.386653 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.380167 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 21:12:57.386653 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.380170 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 21:12:57.386653 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.380173 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 21:12:57.386653 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.380175 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 21:12:57.386653 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.380179 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 21:12:57.386653 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.380181 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 21:12:57.387170 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.380185 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 21:12:57.387170 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.380189 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 21:12:57.387170 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.380194 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 21:12:57.387170 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.380197 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 21:12:57.387170 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.380200 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 21:12:57.387170 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.380202 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 21:12:57.387170 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.380205 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 21:12:57.387170 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.380208 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 21:12:57.387170 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.380211 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 21:12:57.387170 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.380214 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 21:12:57.387170 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.380216 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 21:12:57.387170 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.380219 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 21:12:57.387170 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.380221 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 21:12:57.387170 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.380224 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 21:12:57.387170 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.380227 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 21:12:57.387170 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.380229 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 21:12:57.387170 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.380232 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 21:12:57.387170 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.380234 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 21:12:57.387170 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.380237 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 21:12:57.387706 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.380241 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 21:12:57.387706 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.380245 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 21:12:57.387706 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.380248 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 21:12:57.387706 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.380251 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 21:12:57.387706 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.380254 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 21:12:57.387706 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.380257 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 21:12:57.387706 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.380259 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 21:12:57.387706 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.380262 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 21:12:57.387706 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.380266 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 21:12:57.387706 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.380270 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 21:12:57.387706 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.380273 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 21:12:57.387706 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.380276 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 21:12:57.387706 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.380279 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 21:12:57.387706 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.380282 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 21:12:57.387706 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.380284 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 21:12:57.387706 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.380287 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 21:12:57.387706 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.380291 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 21:12:57.387706 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.380294 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 21:12:57.387706 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.380296 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 21:12:57.388189 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.380299 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 21:12:57.388189 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.380302 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 21:12:57.388189 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.380304 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 21:12:57.388189 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.380307 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 21:12:57.388189 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.380328 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 21:12:57.388189 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.380332 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 21:12:57.388189 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:57.380335 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 21:12:57.388189 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.380340 2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 21:12:57.388189 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.380475 2573 server.go:962] "Client rotation is on, will bootstrap in background" Jul 06 21:12:57.388189 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.383395 2573 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 06 21:12:57.388189 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.385003 2573 server.go:1019] "Starting client certificate rotation" Jul 06 21:12:57.388189 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.385105 2573 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 06 21:12:57.388189 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.385151 2573 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 06 21:12:57.388549 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.387503 2573 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 06 21:12:57.388825 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.388801 2573 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 06 21:12:57.404618 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.404589 2573 log.go:25] "Validated CRI v1 runtime API" Jul 06 21:12:57.407331 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.407298 2573 log.go:25] "Validated CRI v1 image API" Jul 06 21:12:57.409494 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.409472 2573 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 06 21:12:57.412072 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.412050 2573 fs.go:135] Filesystem UUIDs: map[4788dfaf-1906-4d21-a03c-4bc7f25245dc:/dev/nvme0n1p3 67a21b30-5894-458f-b94c-9287554dd19f:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2] Jul 06 21:12:57.412175 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.412071 2573 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 06 21:12:57.415481 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.415460 2573 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 06 21:12:57.418616 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.418482 2573 manager.go:216] Machine: {Timestamp:2026-07-06 21:12:57.417190256 +0000 UTC m=+0.364568255 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099365 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec26710bb658f179818747d707983e02 SystemUUID:ec26710b-b658-f179-8187-47d707983e02 BootID:491ff10b-681c-404d-96d5-c65688068725 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:72:e7:26:2d:c7 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:72:e7:26:2d:c7 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:46:9a:90:16:b5:ec Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 06 21:12:57.418616 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.418610 2573 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 06 21:12:57.418745 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.418716 2573 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 06 21:12:57.422264 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.422228 2573 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 06 21:12:57.422501 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.422267 2573 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-130-89.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 06 21:12:57.423195 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.423181 2573 topology_manager.go:138] "Creating topology manager with none policy" Jul 06 21:12:57.423267 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.423202 2573 container_manager_linux.go:309] "Creating device plugin manager" Jul 06 21:12:57.423267 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.423216 2573 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 06 21:12:57.423945 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.423931 2573 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 06 21:12:57.425724 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.425709 2573 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 06 21:12:57.429218 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.429199 2573 state_mem.go:36] "Initialized new in-memory state store" Jul 06 21:12:57.429411 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.429399 2573 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 06 21:12:57.429475 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.429445 2573 kubelet.go:486] "Attempting to sync node with API server" Jul 06 21:12:57.429475 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.429463 2573 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 06 21:12:57.429581 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.429486 2573 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 06 21:12:57.429581 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.429502 2573 kubelet.go:398] "Adding apiserver pod source" Jul 06 21:12:57.429581 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.429515 2573 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 06 21:12:57.429953 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.429938 2573 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 06 21:12:57.430027 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.429964 2573 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 06 21:12:57.432265 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.432240 2573 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 06 21:12:57.434644 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.434627 2573 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 06 21:12:57.434701 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.434663 2573 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 06 21:12:57.436096 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.436082 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 06 21:12:57.436148 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.436100 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 06 21:12:57.436148 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.436107 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 06 21:12:57.436148 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.436114 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 06 21:12:57.436148 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.436123 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 06 21:12:57.436148 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.436129 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 06 21:12:57.436148 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.436138 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 06 21:12:57.436148 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.436144 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 06 21:12:57.436148 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.436150 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 06 21:12:57.436419 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.436157 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 06 21:12:57.436419 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.436166 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 06 21:12:57.436419 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.436174 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 06 21:12:57.437480 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.437464 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 06 21:12:57.437528 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.437484 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 06 21:12:57.441035 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.441017 2573 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-5tm2g" Jul 06 21:12:57.441292 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.441278 2573 server.go:1268] "Started kubelet" Jul 06 21:12:57.441420 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.441392 2573 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-130-89.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 06 21:12:57.441482 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.441379 2573 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 06 21:12:57.441574 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.441408 2573 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 06 21:12:57.441648 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.441609 2573 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 06 21:12:57.441828 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:12:57.441797 2573 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 06 21:12:57.441987 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:12:57.441964 2573 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-130-89.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 06 21:12:57.442331 ip-10-0-130-89 systemd[1]: Started Kubernetes Kubelet. Jul 06 21:12:57.445323 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.443348 2573 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 06 21:12:57.446633 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.446610 2573 server.go:310] "Adding debug handlers to kubelet server" Jul 06 21:12:57.448812 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:12:57.448726 2573 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 06 21:12:57.449533 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.449516 2573 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-5tm2g" Jul 06 21:12:57.450041 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:12:57.449067 2573 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-89.ec2.internal.18bfcfba83a11c9d default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-89.ec2.internal,UID:ip-10-0-130-89.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-130-89.ec2.internal,},FirstTimestamp:2026-07-06 21:12:57.441246365 +0000 UTC m=+0.388624361,LastTimestamp:2026-07-06 21:12:57.441246365 +0000 UTC m=+0.388624361,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-89.ec2.internal,}" Jul 06 21:12:57.453754 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.453731 2573 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 06 21:12:57.453754 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.453738 2573 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 06 21:12:57.454241 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:12:57.453965 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-89.ec2.internal\" not found" Jul 06 21:12:57.454621 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.454588 2573 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 06 21:12:57.454704 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.454594 2573 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 06 21:12:57.454704 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.454652 2573 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 06 21:12:57.454812 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.454768 2573 reconstruct.go:97] "Volume reconstruction finished" Jul 06 21:12:57.454812 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.454780 2573 reconciler.go:29] "Reconciler: start to sync state" Jul 06 21:12:57.455283 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.455266 2573 factory.go:55] Registering systemd factory Jul 06 21:12:57.455396 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.455377 2573 factory.go:223] Registration of the systemd container factory successfully Jul 06 21:12:57.455640 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.455626 2573 factory.go:153] Registering CRI-O factory Jul 06 21:12:57.455640 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.455641 2573 factory.go:223] Registration of the crio container factory successfully Jul 06 21:12:57.455755 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.455690 2573 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 06 21:12:57.455755 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.455711 2573 factory.go:103] Registering Raw factory Jul 06 21:12:57.455755 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.455729 2573 manager.go:1196] Started watching for new ooms in manager Jul 06 21:12:57.456520 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.456494 2573 manager.go:349] Starting recovery of all containers Jul 06 21:12:57.459173 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.459057 2573 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 21:12:57.463919 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:12:57.463567 2573 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-130-89.ec2.internal\" not found" node="ip-10-0-130-89.ec2.internal" Jul 06 21:12:57.467226 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.467038 2573 manager.go:354] Recovery completed Jul 06 21:12:57.473145 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.473125 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 21:12:57.475253 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.475232 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-89.ec2.internal" event="NodeHasSufficientMemory" Jul 06 21:12:57.475341 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.475271 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-89.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 21:12:57.475341 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.475287 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-89.ec2.internal" event="NodeHasSufficientPID" Jul 06 21:12:57.475880 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.475852 2573 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 06 21:12:57.475880 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.475867 2573 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 06 21:12:57.476028 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.475890 2573 state_mem.go:36] "Initialized new in-memory state store" Jul 06 21:12:57.476028 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.475893 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 21:12:57.476888 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.476870 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-89.ec2.internal" event="NodeHasSufficientMemory" Jul 06 21:12:57.476969 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.476899 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-89.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 21:12:57.476969 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.476909 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-89.ec2.internal" event="NodeHasSufficientPID" Jul 06 21:12:57.477233 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.477221 2573 policy_none.go:49] "None policy: Start" Jul 06 21:12:57.477300 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.477238 2573 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 06 21:12:57.477300 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.477249 2573 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 06 21:12:57.478264 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.478253 2573 policy_none.go:47] "Start" Jul 06 21:12:57.517174 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.517153 2573 manager.go:337] "Starting Device Plugin manager" Jul 06 21:12:57.517288 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:12:57.517200 2573 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 06 21:12:57.517288 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.517213 2573 server.go:87] "Starting device plugin registration server" Jul 06 21:12:57.517561 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.517546 2573 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 06 21:12:57.517637 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.517566 2573 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 06 21:12:57.517754 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.517733 2573 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 06 21:12:57.517865 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.517835 2573 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 06 21:12:57.517865 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.517846 2573 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 06 21:12:57.518386 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:12:57.518366 2573 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 06 21:12:57.518459 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:12:57.518423 2573 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-130-89.ec2.internal\" not found" Jul 06 21:12:57.618858 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.618753 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 21:12:57.620354 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.620334 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-89.ec2.internal" event="NodeHasSufficientMemory" Jul 06 21:12:57.620473 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.620370 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-89.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 21:12:57.620473 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.620384 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-89.ec2.internal" event="NodeHasSufficientPID" Jul 06 21:12:57.620473 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.620450 2573 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-130-89.ec2.internal" Jul 06 21:12:57.629066 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.629046 2573 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-130-89.ec2.internal" Jul 06 21:12:57.629164 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:12:57.629074 2573 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-130-89.ec2.internal\": node \"ip-10-0-130-89.ec2.internal\" not found" Jul 06 21:12:57.634540 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.634511 2573 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 06 21:12:57.635787 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.635765 2573 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 06 21:12:57.635895 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.635806 2573 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 06 21:12:57.635895 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.635829 2573 kubelet.go:2448] "Starting kubelet main sync loop" Jul 06 21:12:57.635895 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:12:57.635865 2573 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 06 21:12:57.638175 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.638152 2573 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 21:12:57.648529 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:12:57.648505 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-89.ec2.internal\" not found" Jul 06 21:12:57.742548 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.742503 2573 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-89.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-130-89.ec2.internal"] Jul 06 21:12:57.742661 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.742624 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 21:12:57.745303 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.745282 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-89.ec2.internal" event="NodeHasSufficientMemory" Jul 06 21:12:57.745303 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.745321 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-89.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 21:12:57.745484 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.745332 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-89.ec2.internal" event="NodeHasSufficientPID" Jul 06 21:12:57.746716 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.746701 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 21:12:57.746893 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.746876 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-89.ec2.internal" Jul 06 21:12:57.746960 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.746917 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 21:12:57.749198 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:12:57.749183 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-89.ec2.internal\" not found" Jul 06 21:12:57.750290 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.750263 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-89.ec2.internal" event="NodeHasSufficientMemory" Jul 06 21:12:57.750381 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.750298 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-89.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 21:12:57.750381 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.750308 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-89.ec2.internal" event="NodeHasSufficientMemory" Jul 06 21:12:57.750381 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.750330 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-89.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 21:12:57.750381 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.750343 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-89.ec2.internal" event="NodeHasSufficientPID" Jul 06 21:12:57.750381 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.750314 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-89.ec2.internal" event="NodeHasSufficientPID" Jul 06 21:12:57.751737 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.751719 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-89.ec2.internal" Jul 06 21:12:57.751813 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.751750 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 21:12:57.752708 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.752691 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-89.ec2.internal" event="NodeHasSufficientMemory" Jul 06 21:12:57.752767 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.752723 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-89.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 21:12:57.752767 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.752734 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-89.ec2.internal" event="NodeHasSufficientPID" Jul 06 21:12:57.756442 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.756422 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d6de1c22a7dc3a552ccd1cdfa31b202e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-89.ec2.internal\" (UID: \"d6de1c22a7dc3a552ccd1cdfa31b202e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-89.ec2.internal" Jul 06 21:12:57.756500 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.756456 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d6de1c22a7dc3a552ccd1cdfa31b202e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-89.ec2.internal\" (UID: \"d6de1c22a7dc3a552ccd1cdfa31b202e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-89.ec2.internal" Jul 06 21:12:57.756500 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.756481 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4d2cd5ec51313fc648acdd650b240a69-config\") pod \"kube-apiserver-proxy-ip-10-0-130-89.ec2.internal\" (UID: \"4d2cd5ec51313fc648acdd650b240a69\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-89.ec2.internal" Jul 06 21:12:57.768072 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:12:57.768034 2573 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-89.ec2.internal\" not found" node="ip-10-0-130-89.ec2.internal" Jul 06 21:12:57.772903 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:12:57.772884 2573 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-89.ec2.internal\" not found" node="ip-10-0-130-89.ec2.internal" Jul 06 21:12:57.850086 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:12:57.850045 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-89.ec2.internal\" not found" Jul 06 21:12:57.856821 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.856794 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d6de1c22a7dc3a552ccd1cdfa31b202e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-89.ec2.internal\" (UID: \"d6de1c22a7dc3a552ccd1cdfa31b202e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-89.ec2.internal" Jul 06 21:12:57.856916 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.856827 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d6de1c22a7dc3a552ccd1cdfa31b202e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-89.ec2.internal\" (UID: \"d6de1c22a7dc3a552ccd1cdfa31b202e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-89.ec2.internal" Jul 06 21:12:57.856916 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.856850 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4d2cd5ec51313fc648acdd650b240a69-config\") pod \"kube-apiserver-proxy-ip-10-0-130-89.ec2.internal\" (UID: \"4d2cd5ec51313fc648acdd650b240a69\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-89.ec2.internal" Jul 06 21:12:57.856916 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.856907 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d6de1c22a7dc3a552ccd1cdfa31b202e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-89.ec2.internal\" (UID: \"d6de1c22a7dc3a552ccd1cdfa31b202e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-89.ec2.internal" Jul 06 21:12:57.857051 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.856907 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4d2cd5ec51313fc648acdd650b240a69-config\") pod \"kube-apiserver-proxy-ip-10-0-130-89.ec2.internal\" (UID: \"4d2cd5ec51313fc648acdd650b240a69\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-89.ec2.internal" Jul 06 21:12:57.857051 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:57.856954 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d6de1c22a7dc3a552ccd1cdfa31b202e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-89.ec2.internal\" (UID: \"d6de1c22a7dc3a552ccd1cdfa31b202e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-89.ec2.internal" Jul 06 21:12:57.950974 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:12:57.950879 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-89.ec2.internal\" not found" Jul 06 21:12:58.052624 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:12:58.052591 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-89.ec2.internal\" not found" Jul 06 21:12:58.072549 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:58.072513 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-89.ec2.internal" Jul 06 21:12:58.077389 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:58.077124 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-89.ec2.internal" Jul 06 21:12:58.155963 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:12:58.155907 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-89.ec2.internal\" not found" Jul 06 21:12:58.256065 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:12:58.255980 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-89.ec2.internal\" not found" Jul 06 21:12:58.356558 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:12:58.356528 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-89.ec2.internal\" not found" Jul 06 21:12:58.386069 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:58.386041 2573 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 06 21:12:58.386661 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:58.386225 2573 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 06 21:12:58.386661 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:58.386256 2573 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 06 21:12:58.454972 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:58.454928 2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-05 21:07:58 +0000 UTC" deadline="2028-01-17 02:06:26.311236338 +0000 UTC" Jul 06 21:12:58.454972 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:58.454960 2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13420h53m27.856278854s" Jul 06 21:12:58.457013 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:12:58.456992 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-89.ec2.internal\" not found" Jul 06 21:12:58.557210 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:12:58.557169 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-89.ec2.internal\" not found" Jul 06 21:12:58.584112 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:58.584081 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d2cd5ec51313fc648acdd650b240a69.slice/crio-b5e1ab6c74f1a389a9933684efc464aa497df7e5a07434f85aa79d33ca18a60a WatchSource:0}: Error finding container b5e1ab6c74f1a389a9933684efc464aa497df7e5a07434f85aa79d33ca18a60a: Status 404 returned error can't find the container with id b5e1ab6c74f1a389a9933684efc464aa497df7e5a07434f85aa79d33ca18a60a Jul 06 21:12:58.584611 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:12:58.584582 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6de1c22a7dc3a552ccd1cdfa31b202e.slice/crio-fab6042f7c58dfc8021a929ae216c2cc83bde0626b90c5488aaa4fee216ad224 WatchSource:0}: Error finding container fab6042f7c58dfc8021a929ae216c2cc83bde0626b90c5488aaa4fee216ad224: Status 404 returned error can't find the container with id fab6042f7c58dfc8021a929ae216c2cc83bde0626b90c5488aaa4fee216ad224 Jul 06 21:12:58.589832 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:58.589811 2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 21:12:58.640733 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:58.640671 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-89.ec2.internal" event={"ID":"d6de1c22a7dc3a552ccd1cdfa31b202e","Type":"ContainerStarted","Data":"fab6042f7c58dfc8021a929ae216c2cc83bde0626b90c5488aaa4fee216ad224"} Jul 06 21:12:58.641840 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:58.641813 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-89.ec2.internal" event={"ID":"4d2cd5ec51313fc648acdd650b240a69","Type":"ContainerStarted","Data":"b5e1ab6c74f1a389a9933684efc464aa497df7e5a07434f85aa79d33ca18a60a"} Jul 06 21:12:58.658348 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:12:58.658319 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-89.ec2.internal\" not found" Jul 06 21:12:58.758796 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:12:58.758766 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-89.ec2.internal\" not found" Jul 06 21:12:58.859845 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:12:58.859768 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-89.ec2.internal\" not found" Jul 06 21:12:58.924434 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:58.924402 2573 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 21:12:58.959927 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:12:58.959884 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-89.ec2.internal\" not found" Jul 06 21:12:59.020674 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.020641 2573 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 21:12:59.054140 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.054103 2573 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-89.ec2.internal" Jul 06 21:12:59.074792 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.074750 2573 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 06 21:12:59.076312 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.076281 2573 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-89.ec2.internal" Jul 06 21:12:59.083136 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.083108 2573 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 06 21:12:59.433412 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.433375 2573 apiserver.go:52] "Watching apiserver" Jul 06 21:12:59.443223 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.443186 2573 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 06 21:12:59.444567 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.444537 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-sshnw","openshift-image-registry/node-ca-4rqvd","openshift-network-diagnostics/network-check-target-2vbd9","openshift-network-operator/iptables-alerter-vzzd6","openshift-ovn-kubernetes/ovnkube-node-5s6d9","kube-system/global-pull-secret-syncer-xgv7v","kube-system/kube-apiserver-proxy-ip-10-0-130-89.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9fllz","openshift-dns/node-resolver-tdbzc","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-89.ec2.internal","openshift-multus/multus-4hcwd","openshift-multus/multus-additional-cni-plugins-l26xp","openshift-multus/network-metrics-daemon-w5754","kube-system/konnectivity-agent-nkqqw"] Jul 06 21:12:59.447192 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.447168 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w5754" Jul 06 21:12:59.447329 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:12:59.447291 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w5754" podUID="3a3548bd-1472-470c-bda5-a7c611571bea" Jul 06 21:12:59.449461 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.449427 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-4rqvd" Jul 06 21:12:59.451587 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.451560 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2vbd9" Jul 06 21:12:59.451714 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:12:59.451649 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2vbd9" podUID="c5dccb0b-1724-44ec-a683-c8a45526a11a" Jul 06 21:12:59.452677 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.452468 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-gzx4w\"" Jul 06 21:12:59.452677 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.452523 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 06 21:12:59.452677 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.452540 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 06 21:12:59.452895 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.452760 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 06 21:12:59.454113 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.453658 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-vzzd6" Jul 06 21:12:59.454574 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.454557 2573 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 06 21:12:59.456666 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.456628 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 06 21:12:59.456789 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.456665 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 06 21:12:59.456906 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.456888 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 06 21:12:59.456965 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.456946 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-5s6d9" Jul 06 21:12:59.457346 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.457249 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-m22b6\"" Jul 06 21:12:59.459824 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.459797 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 06 21:12:59.459940 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.459829 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 06 21:12:59.459940 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.459900 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 06 21:12:59.460297 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.460161 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xgv7v" Jul 06 21:12:59.460297 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:12:59.460264 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xgv7v" podUID="55e17066-002e-4ebb-a6cb-e4be26f3383d" Jul 06 21:12:59.461691 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.461532 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-dhmc6\"" Jul 06 21:12:59.461691 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.461553 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 06 21:12:59.461691 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.461607 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 06 21:12:59.461915 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.461758 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 06 21:12:59.463211 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.462853 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-sshnw" Jul 06 21:12:59.464880 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.464856 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9fllz" Jul 06 21:12:59.465947 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.465928 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 06 21:12:59.465947 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.465941 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 06 21:12:59.466098 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.466026 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-ggcj7\"" Jul 06 21:12:59.467471 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.467375 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 06 21:12:59.467471 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.467374 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e122448a-d2e4-4fec-a918-3d3eecb175a4-host-slash\") pod \"ovnkube-node-5s6d9\" (UID: \"e122448a-d2e4-4fec-a918-3d3eecb175a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5s6d9" Jul 06 21:12:59.467471 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.467418 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4e3cec7e-a502-4807-9070-4ded3cc4727e-host-slash\") pod \"iptables-alerter-vzzd6\" (UID: \"4e3cec7e-a502-4807-9070-4ded3cc4727e\") " pod="openshift-network-operator/iptables-alerter-vzzd6" Jul 06 21:12:59.467471 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.467431 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-tdbzc" Jul 06 21:12:59.467471 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.467450 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e122448a-d2e4-4fec-a918-3d3eecb175a4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5s6d9\" (UID: \"e122448a-d2e4-4fec-a918-3d3eecb175a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5s6d9" Jul 06 21:12:59.467829 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.467477 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e122448a-d2e4-4fec-a918-3d3eecb175a4-ovnkube-config\") pod \"ovnkube-node-5s6d9\" (UID: \"e122448a-d2e4-4fec-a918-3d3eecb175a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5s6d9" Jul 06 21:12:59.467829 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.467501 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e122448a-d2e4-4fec-a918-3d3eecb175a4-host-run-netns\") pod \"ovnkube-node-5s6d9\" (UID: \"e122448a-d2e4-4fec-a918-3d3eecb175a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5s6d9" Jul 06 21:12:59.467829 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.467524 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e122448a-d2e4-4fec-a918-3d3eecb175a4-run-systemd\") pod \"ovnkube-node-5s6d9\" (UID: \"e122448a-d2e4-4fec-a918-3d3eecb175a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5s6d9" Jul 06 21:12:59.467829 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.467549 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e122448a-d2e4-4fec-a918-3d3eecb175a4-host-run-ovn-kubernetes\") pod \"ovnkube-node-5s6d9\" (UID: \"e122448a-d2e4-4fec-a918-3d3eecb175a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5s6d9" Jul 06 21:12:59.467829 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.467576 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e122448a-d2e4-4fec-a918-3d3eecb175a4-ovn-node-metrics-cert\") pod \"ovnkube-node-5s6d9\" (UID: \"e122448a-d2e4-4fec-a918-3d3eecb175a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5s6d9" Jul 06 21:12:59.467829 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.467601 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e122448a-d2e4-4fec-a918-3d3eecb175a4-host-kubelet\") pod \"ovnkube-node-5s6d9\" (UID: \"e122448a-d2e4-4fec-a918-3d3eecb175a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5s6d9" Jul 06 21:12:59.467829 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.467635 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e122448a-d2e4-4fec-a918-3d3eecb175a4-etc-openvswitch\") pod \"ovnkube-node-5s6d9\" (UID: \"e122448a-d2e4-4fec-a918-3d3eecb175a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5s6d9" Jul 06 21:12:59.467829 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.467661 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e122448a-d2e4-4fec-a918-3d3eecb175a4-node-log\") pod \"ovnkube-node-5s6d9\" (UID: \"e122448a-d2e4-4fec-a918-3d3eecb175a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5s6d9" Jul 06 21:12:59.467829 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.467684 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e122448a-d2e4-4fec-a918-3d3eecb175a4-host-cni-netd\") pod \"ovnkube-node-5s6d9\" (UID: \"e122448a-d2e4-4fec-a918-3d3eecb175a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5s6d9" Jul 06 21:12:59.467829 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.467710 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f4aa139a-9e46-4075-8358-6da2c8f30cec-host\") pod \"node-ca-4rqvd\" (UID: \"f4aa139a-9e46-4075-8358-6da2c8f30cec\") " pod="openshift-image-registry/node-ca-4rqvd" Jul 06 21:12:59.467829 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.467768 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4e3cec7e-a502-4807-9070-4ded3cc4727e-iptables-alerter-script\") pod \"iptables-alerter-vzzd6\" (UID: \"4e3cec7e-a502-4807-9070-4ded3cc4727e\") " pod="openshift-network-operator/iptables-alerter-vzzd6" Jul 06 21:12:59.467829 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.467805 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jp5vs\" (UniqueName: \"kubernetes.io/projected/4e3cec7e-a502-4807-9070-4ded3cc4727e-kube-api-access-jp5vs\") pod \"iptables-alerter-vzzd6\" (UID: \"4e3cec7e-a502-4807-9070-4ded3cc4727e\") " pod="openshift-network-operator/iptables-alerter-vzzd6" Jul 06 21:12:59.468447 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.467834 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e122448a-d2e4-4fec-a918-3d3eecb175a4-run-openvswitch\") pod \"ovnkube-node-5s6d9\" (UID: \"e122448a-d2e4-4fec-a918-3d3eecb175a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5s6d9" Jul 06 21:12:59.468447 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.467864 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e122448a-d2e4-4fec-a918-3d3eecb175a4-run-ovn\") pod \"ovnkube-node-5s6d9\" (UID: \"e122448a-d2e4-4fec-a918-3d3eecb175a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5s6d9" Jul 06 21:12:59.468447 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.467914 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e122448a-d2e4-4fec-a918-3d3eecb175a4-log-socket\") pod \"ovnkube-node-5s6d9\" (UID: \"e122448a-d2e4-4fec-a918-3d3eecb175a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5s6d9" Jul 06 21:12:59.468447 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.467991 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e122448a-d2e4-4fec-a918-3d3eecb175a4-host-cni-bin\") pod \"ovnkube-node-5s6d9\" (UID: \"e122448a-d2e4-4fec-a918-3d3eecb175a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5s6d9" Jul 06 21:12:59.468447 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.468022 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lf6xb\" (UniqueName: \"kubernetes.io/projected/3a3548bd-1472-470c-bda5-a7c611571bea-kube-api-access-lf6xb\") pod \"network-metrics-daemon-w5754\" (UID: \"3a3548bd-1472-470c-bda5-a7c611571bea\") " pod="openshift-multus/network-metrics-daemon-w5754" Jul 06 21:12:59.468447 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.468048 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f4aa139a-9e46-4075-8358-6da2c8f30cec-serviceca\") pod \"node-ca-4rqvd\" (UID: \"f4aa139a-9e46-4075-8358-6da2c8f30cec\") " pod="openshift-image-registry/node-ca-4rqvd" Jul 06 21:12:59.468447 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.468101 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e122448a-d2e4-4fec-a918-3d3eecb175a4-systemd-units\") pod \"ovnkube-node-5s6d9\" (UID: \"e122448a-d2e4-4fec-a918-3d3eecb175a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5s6d9" Jul 06 21:12:59.468447 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.468125 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e122448a-d2e4-4fec-a918-3d3eecb175a4-var-lib-openvswitch\") pod \"ovnkube-node-5s6d9\" (UID: \"e122448a-d2e4-4fec-a918-3d3eecb175a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5s6d9" Jul 06 21:12:59.468447 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.468168 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 06 21:12:59.468447 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.468174 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e122448a-d2e4-4fec-a918-3d3eecb175a4-ovnkube-script-lib\") pod \"ovnkube-node-5s6d9\" (UID: \"e122448a-d2e4-4fec-a918-3d3eecb175a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5s6d9" Jul 06 21:12:59.468447 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.468201 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9979m\" (UniqueName: \"kubernetes.io/projected/e122448a-d2e4-4fec-a918-3d3eecb175a4-kube-api-access-9979m\") pod \"ovnkube-node-5s6d9\" (UID: \"e122448a-d2e4-4fec-a918-3d3eecb175a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5s6d9" Jul 06 21:12:59.468447 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.468226 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-82m7l\" (UniqueName: \"kubernetes.io/projected/f4aa139a-9e46-4075-8358-6da2c8f30cec-kube-api-access-82m7l\") pod \"node-ca-4rqvd\" (UID: \"f4aa139a-9e46-4075-8358-6da2c8f30cec\") " pod="openshift-image-registry/node-ca-4rqvd" Jul 06 21:12:59.468447 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.468250 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e122448a-d2e4-4fec-a918-3d3eecb175a4-env-overrides\") pod \"ovnkube-node-5s6d9\" (UID: \"e122448a-d2e4-4fec-a918-3d3eecb175a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5s6d9" Jul 06 21:12:59.468447 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.468287 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3a3548bd-1472-470c-bda5-a7c611571bea-metrics-certs\") pod \"network-metrics-daemon-w5754\" (UID: \"3a3548bd-1472-470c-bda5-a7c611571bea\") " pod="openshift-multus/network-metrics-daemon-w5754" Jul 06 21:12:59.468447 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.468326 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 06 21:12:59.468447 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.468334 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7kg9q\" (UniqueName: \"kubernetes.io/projected/c5dccb0b-1724-44ec-a683-c8a45526a11a-kube-api-access-7kg9q\") pod \"network-check-target-2vbd9\" (UID: \"c5dccb0b-1724-44ec-a683-c8a45526a11a\") " pod="openshift-network-diagnostics/network-check-target-2vbd9" Jul 06 21:12:59.468447 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.468291 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-47d25\"" Jul 06 21:12:59.470937 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.470912 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 06 21:12:59.471043 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.470950 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-4266f\"" Jul 06 21:12:59.471108 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.471050 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 06 21:12:59.471516 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.471489 2573 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 06 21:12:59.472070 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.472047 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-nkqqw" Jul 06 21:12:59.475703 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.475681 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-4j7rg\"" Jul 06 21:12:59.475973 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.475692 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 06 21:12:59.476440 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.476414 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 06 21:12:59.479042 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.479020 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-4hcwd" Jul 06 21:12:59.481034 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.481014 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-l26xp" Jul 06 21:12:59.481840 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.481818 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 06 21:12:59.481948 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.481890 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-pdmcv\"" Jul 06 21:12:59.482072 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.482026 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 06 21:12:59.482187 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.482171 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 06 21:12:59.482366 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.482346 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 06 21:12:59.483856 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.483835 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 06 21:12:59.483953 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.483880 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-xkcnq\"" Jul 06 21:12:59.484080 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.484057 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 06 21:12:59.495033 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.495012 2573 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-fpq87" Jul 06 21:12:59.500930 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.500901 2573 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-fpq87" Jul 06 21:12:59.556224 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.556194 2573 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 06 21:12:59.569587 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.569547 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e122448a-d2e4-4fec-a918-3d3eecb175a4-host-run-ovn-kubernetes\") pod \"ovnkube-node-5s6d9\" (UID: \"e122448a-d2e4-4fec-a918-3d3eecb175a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5s6d9" Jul 06 21:12:59.569787 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.569595 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d3b41b14-af75-441a-aa29-61d90ead4d44-etc-kubernetes\") pod \"multus-4hcwd\" (UID: \"d3b41b14-af75-441a-aa29-61d90ead4d44\") " pod="openshift-multus/multus-4hcwd" Jul 06 21:12:59.569787 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.569675 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e122448a-d2e4-4fec-a918-3d3eecb175a4-host-run-ovn-kubernetes\") pod \"ovnkube-node-5s6d9\" (UID: \"e122448a-d2e4-4fec-a918-3d3eecb175a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5s6d9" Jul 06 21:12:59.569787 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.569676 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9130a04b-36d5-4e3a-ab77-2c9791b9cdd7-run\") pod \"tuned-sshnw\" (UID: \"9130a04b-36d5-4e3a-ab77-2c9791b9cdd7\") " pod="openshift-cluster-node-tuning-operator/tuned-sshnw" Jul 06 21:12:59.569787 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.569741 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e122448a-d2e4-4fec-a918-3d3eecb175a4-node-log\") pod \"ovnkube-node-5s6d9\" (UID: \"e122448a-d2e4-4fec-a918-3d3eecb175a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5s6d9" Jul 06 21:12:59.570004 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.569805 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f4aa139a-9e46-4075-8358-6da2c8f30cec-host\") pod \"node-ca-4rqvd\" (UID: \"f4aa139a-9e46-4075-8358-6da2c8f30cec\") " pod="openshift-image-registry/node-ca-4rqvd" Jul 06 21:12:59.570004 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.569810 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e122448a-d2e4-4fec-a918-3d3eecb175a4-node-log\") pod \"ovnkube-node-5s6d9\" (UID: \"e122448a-d2e4-4fec-a918-3d3eecb175a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5s6d9" Jul 06 21:12:59.570004 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.569901 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d3b41b14-af75-441a-aa29-61d90ead4d44-multus-conf-dir\") pod \"multus-4hcwd\" (UID: \"d3b41b14-af75-441a-aa29-61d90ead4d44\") " pod="openshift-multus/multus-4hcwd" Jul 06 21:12:59.570004 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.569913 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f4aa139a-9e46-4075-8358-6da2c8f30cec-host\") pod \"node-ca-4rqvd\" (UID: \"f4aa139a-9e46-4075-8358-6da2c8f30cec\") " pod="openshift-image-registry/node-ca-4rqvd" Jul 06 21:12:59.570004 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.569965 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e122448a-d2e4-4fec-a918-3d3eecb175a4-run-ovn\") pod \"ovnkube-node-5s6d9\" (UID: \"e122448a-d2e4-4fec-a918-3d3eecb175a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5s6d9" Jul 06 21:12:59.570004 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.570002 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e122448a-d2e4-4fec-a918-3d3eecb175a4-run-ovn\") pod \"ovnkube-node-5s6d9\" (UID: \"e122448a-d2e4-4fec-a918-3d3eecb175a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5s6d9" Jul 06 21:12:59.570280 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.570034 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lf6xb\" (UniqueName: \"kubernetes.io/projected/3a3548bd-1472-470c-bda5-a7c611571bea-kube-api-access-lf6xb\") pod \"network-metrics-daemon-w5754\" (UID: \"3a3548bd-1472-470c-bda5-a7c611571bea\") " pod="openshift-multus/network-metrics-daemon-w5754" Jul 06 21:12:59.570280 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.570064 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f4aa139a-9e46-4075-8358-6da2c8f30cec-serviceca\") pod \"node-ca-4rqvd\" (UID: \"f4aa139a-9e46-4075-8358-6da2c8f30cec\") " pod="openshift-image-registry/node-ca-4rqvd" Jul 06 21:12:59.570280 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.570095 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d3b41b14-af75-441a-aa29-61d90ead4d44-host-var-lib-cni-multus\") pod \"multus-4hcwd\" (UID: \"d3b41b14-af75-441a-aa29-61d90ead4d44\") " pod="openshift-multus/multus-4hcwd" Jul 06 21:12:59.570280 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.570220 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9130a04b-36d5-4e3a-ab77-2c9791b9cdd7-etc-sysctl-d\") pod \"tuned-sshnw\" (UID: \"9130a04b-36d5-4e3a-ab77-2c9791b9cdd7\") " pod="openshift-cluster-node-tuning-operator/tuned-sshnw" Jul 06 21:12:59.570280 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.570279 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e122448a-d2e4-4fec-a918-3d3eecb175a4-systemd-units\") pod \"ovnkube-node-5s6d9\" (UID: \"e122448a-d2e4-4fec-a918-3d3eecb175a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5s6d9" Jul 06 21:12:59.570549 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.570327 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e122448a-d2e4-4fec-a918-3d3eecb175a4-var-lib-openvswitch\") pod \"ovnkube-node-5s6d9\" (UID: \"e122448a-d2e4-4fec-a918-3d3eecb175a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5s6d9" Jul 06 21:12:59.570549 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.570375 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e122448a-d2e4-4fec-a918-3d3eecb175a4-systemd-units\") pod \"ovnkube-node-5s6d9\" (UID: \"e122448a-d2e4-4fec-a918-3d3eecb175a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5s6d9" Jul 06 21:12:59.570549 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.570378 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e122448a-d2e4-4fec-a918-3d3eecb175a4-var-lib-openvswitch\") pod \"ovnkube-node-5s6d9\" (UID: \"e122448a-d2e4-4fec-a918-3d3eecb175a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5s6d9" Jul 06 21:12:59.570549 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.570416 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d3b41b14-af75-441a-aa29-61d90ead4d44-multus-daemon-config\") pod \"multus-4hcwd\" (UID: \"d3b41b14-af75-441a-aa29-61d90ead4d44\") " pod="openshift-multus/multus-4hcwd" Jul 06 21:12:59.570549 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.570471 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/83297255-f507-48e1-80d6-6c8b9d5e1a81-cni-binary-copy\") pod \"multus-additional-cni-plugins-l26xp\" (UID: \"83297255-f507-48e1-80d6-6c8b9d5e1a81\") " pod="openshift-multus/multus-additional-cni-plugins-l26xp" Jul 06 21:12:59.570822 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.570703 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f4aa139a-9e46-4075-8358-6da2c8f30cec-serviceca\") pod \"node-ca-4rqvd\" (UID: \"f4aa139a-9e46-4075-8358-6da2c8f30cec\") " pod="openshift-image-registry/node-ca-4rqvd" Jul 06 21:12:59.571038 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.570506 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9130a04b-36d5-4e3a-ab77-2c9791b9cdd7-etc-sysctl-conf\") pod \"tuned-sshnw\" (UID: \"9130a04b-36d5-4e3a-ab77-2c9791b9cdd7\") " pod="openshift-cluster-node-tuning-operator/tuned-sshnw" Jul 06 21:12:59.571121 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.571062 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/75526115-8ac3-429e-a883-ed7bf4193923-socket-dir\") pod \"aws-ebs-csi-driver-node-9fllz\" (UID: \"75526115-8ac3-429e-a883-ed7bf4193923\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9fllz" Jul 06 21:12:59.571121 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.571093 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/55e17066-002e-4ebb-a6cb-e4be26f3383d-original-pull-secret\") pod \"global-pull-secret-syncer-xgv7v\" (UID: \"55e17066-002e-4ebb-a6cb-e4be26f3383d\") " pod="kube-system/global-pull-secret-syncer-xgv7v" Jul 06 21:12:59.571220 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.571132 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e122448a-d2e4-4fec-a918-3d3eecb175a4-ovnkube-script-lib\") pod \"ovnkube-node-5s6d9\" (UID: \"e122448a-d2e4-4fec-a918-3d3eecb175a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5s6d9" Jul 06 21:12:59.571220 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.571159 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/83297255-f507-48e1-80d6-6c8b9d5e1a81-system-cni-dir\") pod \"multus-additional-cni-plugins-l26xp\" (UID: \"83297255-f507-48e1-80d6-6c8b9d5e1a81\") " pod="openshift-multus/multus-additional-cni-plugins-l26xp" Jul 06 21:12:59.571220 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.571184 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/75526115-8ac3-429e-a883-ed7bf4193923-sys-fs\") pod \"aws-ebs-csi-driver-node-9fllz\" (UID: \"75526115-8ac3-429e-a883-ed7bf4193923\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9fllz" Jul 06 21:12:59.571468 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.571227 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-82m7l\" (UniqueName: \"kubernetes.io/projected/f4aa139a-9e46-4075-8358-6da2c8f30cec-kube-api-access-82m7l\") pod \"node-ca-4rqvd\" (UID: \"f4aa139a-9e46-4075-8358-6da2c8f30cec\") " pod="openshift-image-registry/node-ca-4rqvd" Jul 06 21:12:59.571468 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.571254 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e122448a-d2e4-4fec-a918-3d3eecb175a4-env-overrides\") pod \"ovnkube-node-5s6d9\" (UID: \"e122448a-d2e4-4fec-a918-3d3eecb175a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5s6d9" Jul 06 21:12:59.571468 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.571280 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/83297255-f507-48e1-80d6-6c8b9d5e1a81-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-l26xp\" (UID: \"83297255-f507-48e1-80d6-6c8b9d5e1a81\") " pod="openshift-multus/multus-additional-cni-plugins-l26xp" Jul 06 21:12:59.571468 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.571318 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9130a04b-36d5-4e3a-ab77-2c9791b9cdd7-etc-systemd\") pod \"tuned-sshnw\" (UID: \"9130a04b-36d5-4e3a-ab77-2c9791b9cdd7\") " pod="openshift-cluster-node-tuning-operator/tuned-sshnw" Jul 06 21:12:59.571468 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.571342 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9130a04b-36d5-4e3a-ab77-2c9791b9cdd7-lib-modules\") pod \"tuned-sshnw\" (UID: \"9130a04b-36d5-4e3a-ab77-2c9791b9cdd7\") " pod="openshift-cluster-node-tuning-operator/tuned-sshnw" Jul 06 21:12:59.571468 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.571372 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e122448a-d2e4-4fec-a918-3d3eecb175a4-host-slash\") pod \"ovnkube-node-5s6d9\" (UID: \"e122448a-d2e4-4fec-a918-3d3eecb175a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5s6d9" Jul 06 21:12:59.571468 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.571414 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/83297255-f507-48e1-80d6-6c8b9d5e1a81-tuning-conf-dir\") pod \"multus-additional-cni-plugins-l26xp\" (UID: \"83297255-f507-48e1-80d6-6c8b9d5e1a81\") " pod="openshift-multus/multus-additional-cni-plugins-l26xp" Jul 06 21:12:59.571468 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.571457 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/83297255-f507-48e1-80d6-6c8b9d5e1a81-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-l26xp\" (UID: \"83297255-f507-48e1-80d6-6c8b9d5e1a81\") " pod="openshift-multus/multus-additional-cni-plugins-l26xp" Jul 06 21:12:59.571928 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.571483 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9130a04b-36d5-4e3a-ab77-2c9791b9cdd7-etc-kubernetes\") pod \"tuned-sshnw\" (UID: \"9130a04b-36d5-4e3a-ab77-2c9791b9cdd7\") " pod="openshift-cluster-node-tuning-operator/tuned-sshnw" Jul 06 21:12:59.571928 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.571510 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whpb8\" (UniqueName: \"kubernetes.io/projected/9130a04b-36d5-4e3a-ab77-2c9791b9cdd7-kube-api-access-whpb8\") pod \"tuned-sshnw\" (UID: \"9130a04b-36d5-4e3a-ab77-2c9791b9cdd7\") " pod="openshift-cluster-node-tuning-operator/tuned-sshnw" Jul 06 21:12:59.571928 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.571537 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e122448a-d2e4-4fec-a918-3d3eecb175a4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5s6d9\" (UID: \"e122448a-d2e4-4fec-a918-3d3eecb175a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5s6d9" Jul 06 21:12:59.571928 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.571563 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d3b41b14-af75-441a-aa29-61d90ead4d44-system-cni-dir\") pod \"multus-4hcwd\" (UID: \"d3b41b14-af75-441a-aa29-61d90ead4d44\") " pod="openshift-multus/multus-4hcwd" Jul 06 21:12:59.571928 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.571588 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d3b41b14-af75-441a-aa29-61d90ead4d44-cni-binary-copy\") pod \"multus-4hcwd\" (UID: \"d3b41b14-af75-441a-aa29-61d90ead4d44\") " pod="openshift-multus/multus-4hcwd" Jul 06 21:12:59.571928 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.571627 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e7ec46bc-523f-4480-9245-42931eac113a-hosts-file\") pod \"node-resolver-tdbzc\" (UID: \"e7ec46bc-523f-4480-9245-42931eac113a\") " pod="openshift-dns/node-resolver-tdbzc" Jul 06 21:12:59.571928 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.571653 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e122448a-d2e4-4fec-a918-3d3eecb175a4-host-run-netns\") pod \"ovnkube-node-5s6d9\" (UID: \"e122448a-d2e4-4fec-a918-3d3eecb175a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5s6d9" Jul 06 21:12:59.571928 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.571700 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e122448a-d2e4-4fec-a918-3d3eecb175a4-run-systemd\") pod \"ovnkube-node-5s6d9\" (UID: \"e122448a-d2e4-4fec-a918-3d3eecb175a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5s6d9" Jul 06 21:12:59.571928 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.571711 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e122448a-d2e4-4fec-a918-3d3eecb175a4-host-slash\") pod \"ovnkube-node-5s6d9\" (UID: \"e122448a-d2e4-4fec-a918-3d3eecb175a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5s6d9" Jul 06 21:12:59.571928 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.571743 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e122448a-d2e4-4fec-a918-3d3eecb175a4-ovn-node-metrics-cert\") pod \"ovnkube-node-5s6d9\" (UID: \"e122448a-d2e4-4fec-a918-3d3eecb175a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5s6d9" Jul 06 21:12:59.571928 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.571768 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d3b41b14-af75-441a-aa29-61d90ead4d44-os-release\") pod \"multus-4hcwd\" (UID: \"d3b41b14-af75-441a-aa29-61d90ead4d44\") " pod="openshift-multus/multus-4hcwd" Jul 06 21:12:59.571928 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.571783 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e122448a-d2e4-4fec-a918-3d3eecb175a4-env-overrides\") pod \"ovnkube-node-5s6d9\" (UID: \"e122448a-d2e4-4fec-a918-3d3eecb175a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5s6d9" Jul 06 21:12:59.571928 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.571798 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e122448a-d2e4-4fec-a918-3d3eecb175a4-ovnkube-script-lib\") pod \"ovnkube-node-5s6d9\" (UID: \"e122448a-d2e4-4fec-a918-3d3eecb175a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5s6d9" Jul 06 21:12:59.571928 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.571807 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/83297255-f507-48e1-80d6-6c8b9d5e1a81-cnibin\") pod \"multus-additional-cni-plugins-l26xp\" (UID: \"83297255-f507-48e1-80d6-6c8b9d5e1a81\") " pod="openshift-multus/multus-additional-cni-plugins-l26xp" Jul 06 21:12:59.571928 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.571857 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e122448a-d2e4-4fec-a918-3d3eecb175a4-run-systemd\") pod \"ovnkube-node-5s6d9\" (UID: \"e122448a-d2e4-4fec-a918-3d3eecb175a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5s6d9" Jul 06 21:12:59.571928 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.571861 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e122448a-d2e4-4fec-a918-3d3eecb175a4-host-run-netns\") pod \"ovnkube-node-5s6d9\" (UID: \"e122448a-d2e4-4fec-a918-3d3eecb175a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5s6d9" Jul 06 21:12:59.571928 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.571875 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mrfgh\" (UniqueName: \"kubernetes.io/projected/75526115-8ac3-429e-a883-ed7bf4193923-kube-api-access-mrfgh\") pod \"aws-ebs-csi-driver-node-9fllz\" (UID: \"75526115-8ac3-429e-a883-ed7bf4193923\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9fllz" Jul 06 21:12:59.572740 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.571908 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e122448a-d2e4-4fec-a918-3d3eecb175a4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5s6d9\" (UID: \"e122448a-d2e4-4fec-a918-3d3eecb175a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5s6d9" Jul 06 21:12:59.572740 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.571909 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/38c684b6-68c3-4edb-84a9-027b8a05f3a7-konnectivity-ca\") pod \"konnectivity-agent-nkqqw\" (UID: \"38c684b6-68c3-4edb-84a9-027b8a05f3a7\") " pod="kube-system/konnectivity-agent-nkqqw" Jul 06 21:12:59.572740 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.571961 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/55e17066-002e-4ebb-a6cb-e4be26f3383d-dbus\") pod \"global-pull-secret-syncer-xgv7v\" (UID: \"55e17066-002e-4ebb-a6cb-e4be26f3383d\") " pod="kube-system/global-pull-secret-syncer-xgv7v" Jul 06 21:12:59.572740 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.571992 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e122448a-d2e4-4fec-a918-3d3eecb175a4-host-kubelet\") pod \"ovnkube-node-5s6d9\" (UID: \"e122448a-d2e4-4fec-a918-3d3eecb175a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5s6d9" Jul 06 21:12:59.572740 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.572022 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e122448a-d2e4-4fec-a918-3d3eecb175a4-etc-openvswitch\") pod \"ovnkube-node-5s6d9\" (UID: \"e122448a-d2e4-4fec-a918-3d3eecb175a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5s6d9" Jul 06 21:12:59.572740 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.572061 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e122448a-d2e4-4fec-a918-3d3eecb175a4-host-cni-netd\") pod \"ovnkube-node-5s6d9\" (UID: \"e122448a-d2e4-4fec-a918-3d3eecb175a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5s6d9" Jul 06 21:12:59.572740 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.572068 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e122448a-d2e4-4fec-a918-3d3eecb175a4-host-kubelet\") pod \"ovnkube-node-5s6d9\" (UID: \"e122448a-d2e4-4fec-a918-3d3eecb175a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5s6d9" Jul 06 21:12:59.572740 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.572097 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e122448a-d2e4-4fec-a918-3d3eecb175a4-etc-openvswitch\") pod \"ovnkube-node-5s6d9\" (UID: \"e122448a-d2e4-4fec-a918-3d3eecb175a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5s6d9" Jul 06 21:12:59.572740 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.572095 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4e3cec7e-a502-4807-9070-4ded3cc4727e-iptables-alerter-script\") pod \"iptables-alerter-vzzd6\" (UID: \"4e3cec7e-a502-4807-9070-4ded3cc4727e\") " pod="openshift-network-operator/iptables-alerter-vzzd6" Jul 06 21:12:59.572740 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.572123 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e122448a-d2e4-4fec-a918-3d3eecb175a4-host-cni-netd\") pod \"ovnkube-node-5s6d9\" (UID: \"e122448a-d2e4-4fec-a918-3d3eecb175a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5s6d9" Jul 06 21:12:59.572740 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.572140 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jp5vs\" (UniqueName: \"kubernetes.io/projected/4e3cec7e-a502-4807-9070-4ded3cc4727e-kube-api-access-jp5vs\") pod \"iptables-alerter-vzzd6\" (UID: \"4e3cec7e-a502-4807-9070-4ded3cc4727e\") " pod="openshift-network-operator/iptables-alerter-vzzd6" Jul 06 21:12:59.572740 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.572169 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d3b41b14-af75-441a-aa29-61d90ead4d44-multus-cni-dir\") pod \"multus-4hcwd\" (UID: \"d3b41b14-af75-441a-aa29-61d90ead4d44\") " pod="openshift-multus/multus-4hcwd" Jul 06 21:12:59.572740 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.572162 2573 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 06 21:12:59.572740 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.572264 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d3b41b14-af75-441a-aa29-61d90ead4d44-host-var-lib-kubelet\") pod \"multus-4hcwd\" (UID: \"d3b41b14-af75-441a-aa29-61d90ead4d44\") " pod="openshift-multus/multus-4hcwd" Jul 06 21:12:59.572740 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.572303 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9130a04b-36d5-4e3a-ab77-2c9791b9cdd7-tmp\") pod \"tuned-sshnw\" (UID: \"9130a04b-36d5-4e3a-ab77-2c9791b9cdd7\") " pod="openshift-cluster-node-tuning-operator/tuned-sshnw" Jul 06 21:12:59.572740 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.572349 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e122448a-d2e4-4fec-a918-3d3eecb175a4-run-openvswitch\") pod \"ovnkube-node-5s6d9\" (UID: \"e122448a-d2e4-4fec-a918-3d3eecb175a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5s6d9" Jul 06 21:12:59.572740 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.572410 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e122448a-d2e4-4fec-a918-3d3eecb175a4-log-socket\") pod \"ovnkube-node-5s6d9\" (UID: \"e122448a-d2e4-4fec-a918-3d3eecb175a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5s6d9" Jul 06 21:12:59.573530 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.572435 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e122448a-d2e4-4fec-a918-3d3eecb175a4-host-cni-bin\") pod \"ovnkube-node-5s6d9\" (UID: \"e122448a-d2e4-4fec-a918-3d3eecb175a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5s6d9" Jul 06 21:12:59.573530 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.572461 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d3b41b14-af75-441a-aa29-61d90ead4d44-multus-socket-dir-parent\") pod \"multus-4hcwd\" (UID: \"d3b41b14-af75-441a-aa29-61d90ead4d44\") " pod="openshift-multus/multus-4hcwd" Jul 06 21:12:59.573530 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.572509 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d3b41b14-af75-441a-aa29-61d90ead4d44-hostroot\") pod \"multus-4hcwd\" (UID: \"d3b41b14-af75-441a-aa29-61d90ead4d44\") " pod="openshift-multus/multus-4hcwd" Jul 06 21:12:59.573530 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.572509 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e122448a-d2e4-4fec-a918-3d3eecb175a4-host-cni-bin\") pod \"ovnkube-node-5s6d9\" (UID: \"e122448a-d2e4-4fec-a918-3d3eecb175a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5s6d9" Jul 06 21:12:59.573530 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.572536 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/83297255-f507-48e1-80d6-6c8b9d5e1a81-os-release\") pod \"multus-additional-cni-plugins-l26xp\" (UID: \"83297255-f507-48e1-80d6-6c8b9d5e1a81\") " pod="openshift-multus/multus-additional-cni-plugins-l26xp" Jul 06 21:12:59.573530 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.572561 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9130a04b-36d5-4e3a-ab77-2c9791b9cdd7-etc-modprobe-d\") pod \"tuned-sshnw\" (UID: \"9130a04b-36d5-4e3a-ab77-2c9791b9cdd7\") " pod="openshift-cluster-node-tuning-operator/tuned-sshnw" Jul 06 21:12:59.573530 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.572580 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e122448a-d2e4-4fec-a918-3d3eecb175a4-log-socket\") pod \"ovnkube-node-5s6d9\" (UID: \"e122448a-d2e4-4fec-a918-3d3eecb175a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5s6d9" Jul 06 21:12:59.573530 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.572586 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9130a04b-36d5-4e3a-ab77-2c9791b9cdd7-etc-sysconfig\") pod \"tuned-sshnw\" (UID: \"9130a04b-36d5-4e3a-ab77-2c9791b9cdd7\") " pod="openshift-cluster-node-tuning-operator/tuned-sshnw" Jul 06 21:12:59.573530 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.572611 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9130a04b-36d5-4e3a-ab77-2c9791b9cdd7-sys\") pod \"tuned-sshnw\" (UID: \"9130a04b-36d5-4e3a-ab77-2c9791b9cdd7\") " pod="openshift-cluster-node-tuning-operator/tuned-sshnw" Jul 06 21:12:59.573530 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.572618 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e122448a-d2e4-4fec-a918-3d3eecb175a4-run-openvswitch\") pod \"ovnkube-node-5s6d9\" (UID: \"e122448a-d2e4-4fec-a918-3d3eecb175a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5s6d9" Jul 06 21:12:59.573530 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.572642 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9130a04b-36d5-4e3a-ab77-2c9791b9cdd7-host\") pod \"tuned-sshnw\" (UID: \"9130a04b-36d5-4e3a-ab77-2c9791b9cdd7\") " pod="openshift-cluster-node-tuning-operator/tuned-sshnw" Jul 06 21:12:59.573530 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.572673 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9130a04b-36d5-4e3a-ab77-2c9791b9cdd7-etc-tuned\") pod \"tuned-sshnw\" (UID: \"9130a04b-36d5-4e3a-ab77-2c9791b9cdd7\") " pod="openshift-cluster-node-tuning-operator/tuned-sshnw" Jul 06 21:12:59.573530 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.572682 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4e3cec7e-a502-4807-9070-4ded3cc4727e-iptables-alerter-script\") pod \"iptables-alerter-vzzd6\" (UID: \"4e3cec7e-a502-4807-9070-4ded3cc4727e\") " pod="openshift-network-operator/iptables-alerter-vzzd6" Jul 06 21:12:59.573530 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.572727 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/75526115-8ac3-429e-a883-ed7bf4193923-device-dir\") pod \"aws-ebs-csi-driver-node-9fllz\" (UID: \"75526115-8ac3-429e-a883-ed7bf4193923\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9fllz" Jul 06 21:12:59.573530 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.572763 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9979m\" (UniqueName: \"kubernetes.io/projected/e122448a-d2e4-4fec-a918-3d3eecb175a4-kube-api-access-9979m\") pod \"ovnkube-node-5s6d9\" (UID: \"e122448a-d2e4-4fec-a918-3d3eecb175a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5s6d9" Jul 06 21:12:59.573530 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.572791 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d3b41b14-af75-441a-aa29-61d90ead4d44-host-run-netns\") pod \"multus-4hcwd\" (UID: \"d3b41b14-af75-441a-aa29-61d90ead4d44\") " pod="openshift-multus/multus-4hcwd" Jul 06 21:12:59.573530 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.572816 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d3b41b14-af75-441a-aa29-61d90ead4d44-host-var-lib-cni-bin\") pod \"multus-4hcwd\" (UID: \"d3b41b14-af75-441a-aa29-61d90ead4d44\") " pod="openshift-multus/multus-4hcwd" Jul 06 21:12:59.574358 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.572839 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/75526115-8ac3-429e-a883-ed7bf4193923-etc-selinux\") pod \"aws-ebs-csi-driver-node-9fllz\" (UID: \"75526115-8ac3-429e-a883-ed7bf4193923\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9fllz" Jul 06 21:12:59.574358 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.572879 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8llf5\" (UniqueName: \"kubernetes.io/projected/e7ec46bc-523f-4480-9245-42931eac113a-kube-api-access-8llf5\") pod \"node-resolver-tdbzc\" (UID: \"e7ec46bc-523f-4480-9245-42931eac113a\") " pod="openshift-dns/node-resolver-tdbzc" Jul 06 21:12:59.574358 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.572901 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/38c684b6-68c3-4edb-84a9-027b8a05f3a7-agent-certs\") pod \"konnectivity-agent-nkqqw\" (UID: \"38c684b6-68c3-4edb-84a9-027b8a05f3a7\") " pod="kube-system/konnectivity-agent-nkqqw" Jul 06 21:12:59.574358 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.572926 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3a3548bd-1472-470c-bda5-a7c611571bea-metrics-certs\") pod \"network-metrics-daemon-w5754\" (UID: \"3a3548bd-1472-470c-bda5-a7c611571bea\") " pod="openshift-multus/network-metrics-daemon-w5754" Jul 06 21:12:59.574358 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.572950 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7kg9q\" (UniqueName: \"kubernetes.io/projected/c5dccb0b-1724-44ec-a683-c8a45526a11a-kube-api-access-7kg9q\") pod \"network-check-target-2vbd9\" (UID: \"c5dccb0b-1724-44ec-a683-c8a45526a11a\") " pod="openshift-network-diagnostics/network-check-target-2vbd9" Jul 06 21:12:59.574358 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.572975 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d3b41b14-af75-441a-aa29-61d90ead4d44-cnibin\") pod \"multus-4hcwd\" (UID: \"d3b41b14-af75-441a-aa29-61d90ead4d44\") " pod="openshift-multus/multus-4hcwd" Jul 06 21:12:59.574358 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.572999 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d3b41b14-af75-441a-aa29-61d90ead4d44-host-run-multus-certs\") pod \"multus-4hcwd\" (UID: \"d3b41b14-af75-441a-aa29-61d90ead4d44\") " pod="openshift-multus/multus-4hcwd" Jul 06 21:12:59.574358 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.573043 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fmzbz\" (UniqueName: \"kubernetes.io/projected/d3b41b14-af75-441a-aa29-61d90ead4d44-kube-api-access-fmzbz\") pod \"multus-4hcwd\" (UID: \"d3b41b14-af75-441a-aa29-61d90ead4d44\") " pod="openshift-multus/multus-4hcwd" Jul 06 21:12:59.574358 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.573068 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9130a04b-36d5-4e3a-ab77-2c9791b9cdd7-var-lib-kubelet\") pod \"tuned-sshnw\" (UID: \"9130a04b-36d5-4e3a-ab77-2c9791b9cdd7\") " pod="openshift-cluster-node-tuning-operator/tuned-sshnw" Jul 06 21:12:59.574358 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.573093 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/75526115-8ac3-429e-a883-ed7bf4193923-registration-dir\") pod \"aws-ebs-csi-driver-node-9fllz\" (UID: \"75526115-8ac3-429e-a883-ed7bf4193923\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9fllz" Jul 06 21:12:59.574358 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:12:59.573116 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 21:12:59.574358 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:12:59.573211 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a3548bd-1472-470c-bda5-a7c611571bea-metrics-certs podName:3a3548bd-1472-470c-bda5-a7c611571bea nodeName:}" failed. No retries permitted until 2026-07-06 21:13:00.073181716 +0000 UTC m=+3.020559713 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3a3548bd-1472-470c-bda5-a7c611571bea-metrics-certs") pod "network-metrics-daemon-w5754" (UID: "3a3548bd-1472-470c-bda5-a7c611571bea") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 21:12:59.574358 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.573117 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/55e17066-002e-4ebb-a6cb-e4be26f3383d-kubelet-config\") pod \"global-pull-secret-syncer-xgv7v\" (UID: \"55e17066-002e-4ebb-a6cb-e4be26f3383d\") " pod="kube-system/global-pull-secret-syncer-xgv7v" Jul 06 21:12:59.574358 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.573399 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4e3cec7e-a502-4807-9070-4ded3cc4727e-host-slash\") pod \"iptables-alerter-vzzd6\" (UID: \"4e3cec7e-a502-4807-9070-4ded3cc4727e\") " pod="openshift-network-operator/iptables-alerter-vzzd6" Jul 06 21:12:59.574358 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.573427 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vtf2b\" (UniqueName: \"kubernetes.io/projected/83297255-f507-48e1-80d6-6c8b9d5e1a81-kube-api-access-vtf2b\") pod \"multus-additional-cni-plugins-l26xp\" (UID: \"83297255-f507-48e1-80d6-6c8b9d5e1a81\") " pod="openshift-multus/multus-additional-cni-plugins-l26xp" Jul 06 21:12:59.574358 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.573450 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/75526115-8ac3-429e-a883-ed7bf4193923-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9fllz\" (UID: \"75526115-8ac3-429e-a883-ed7bf4193923\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9fllz" Jul 06 21:12:59.575109 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.573489 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e122448a-d2e4-4fec-a918-3d3eecb175a4-ovnkube-config\") pod \"ovnkube-node-5s6d9\" (UID: \"e122448a-d2e4-4fec-a918-3d3eecb175a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5s6d9" Jul 06 21:12:59.575109 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.573493 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4e3cec7e-a502-4807-9070-4ded3cc4727e-host-slash\") pod \"iptables-alerter-vzzd6\" (UID: \"4e3cec7e-a502-4807-9070-4ded3cc4727e\") " pod="openshift-network-operator/iptables-alerter-vzzd6" Jul 06 21:12:59.575109 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.573534 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d3b41b14-af75-441a-aa29-61d90ead4d44-host-run-k8s-cni-cncf-io\") pod \"multus-4hcwd\" (UID: \"d3b41b14-af75-441a-aa29-61d90ead4d44\") " pod="openshift-multus/multus-4hcwd" Jul 06 21:12:59.575109 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.573577 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e7ec46bc-523f-4480-9245-42931eac113a-tmp-dir\") pod \"node-resolver-tdbzc\" (UID: \"e7ec46bc-523f-4480-9245-42931eac113a\") " pod="openshift-dns/node-resolver-tdbzc" Jul 06 21:12:59.575109 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.574935 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e122448a-d2e4-4fec-a918-3d3eecb175a4-ovnkube-config\") pod \"ovnkube-node-5s6d9\" (UID: \"e122448a-d2e4-4fec-a918-3d3eecb175a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5s6d9" Jul 06 21:12:59.576505 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.576480 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e122448a-d2e4-4fec-a918-3d3eecb175a4-ovn-node-metrics-cert\") pod \"ovnkube-node-5s6d9\" (UID: \"e122448a-d2e4-4fec-a918-3d3eecb175a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5s6d9" Jul 06 21:12:59.582045 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.582015 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-82m7l\" (UniqueName: \"kubernetes.io/projected/f4aa139a-9e46-4075-8358-6da2c8f30cec-kube-api-access-82m7l\") pod \"node-ca-4rqvd\" (UID: \"f4aa139a-9e46-4075-8358-6da2c8f30cec\") " pod="openshift-image-registry/node-ca-4rqvd" Jul 06 21:12:59.584257 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:12:59.584220 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 21:12:59.584257 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:12:59.584254 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 21:12:59.584514 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:12:59.584269 2573 projected.go:196] Error preparing data for projected volume kube-api-access-7kg9q for pod openshift-network-diagnostics/network-check-target-2vbd9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 21:12:59.584514 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:12:59.584370 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c5dccb0b-1724-44ec-a683-c8a45526a11a-kube-api-access-7kg9q podName:c5dccb0b-1724-44ec-a683-c8a45526a11a nodeName:}" failed. No retries permitted until 2026-07-06 21:13:00.08434546 +0000 UTC m=+3.031723467 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-7kg9q" (UniqueName: "kubernetes.io/projected/c5dccb0b-1724-44ec-a683-c8a45526a11a-kube-api-access-7kg9q") pod "network-check-target-2vbd9" (UID: "c5dccb0b-1724-44ec-a683-c8a45526a11a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 21:12:59.586749 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.586700 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9979m\" (UniqueName: \"kubernetes.io/projected/e122448a-d2e4-4fec-a918-3d3eecb175a4-kube-api-access-9979m\") pod \"ovnkube-node-5s6d9\" (UID: \"e122448a-d2e4-4fec-a918-3d3eecb175a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5s6d9" Jul 06 21:12:59.586749 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.586722 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jp5vs\" (UniqueName: \"kubernetes.io/projected/4e3cec7e-a502-4807-9070-4ded3cc4727e-kube-api-access-jp5vs\") pod \"iptables-alerter-vzzd6\" (UID: \"4e3cec7e-a502-4807-9070-4ded3cc4727e\") " pod="openshift-network-operator/iptables-alerter-vzzd6" Jul 06 21:12:59.587018 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.586957 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lf6xb\" (UniqueName: \"kubernetes.io/projected/3a3548bd-1472-470c-bda5-a7c611571bea-kube-api-access-lf6xb\") pod \"network-metrics-daemon-w5754\" (UID: \"3a3548bd-1472-470c-bda5-a7c611571bea\") " pod="openshift-multus/network-metrics-daemon-w5754" Jul 06 21:12:59.674624 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.674585 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/38c684b6-68c3-4edb-84a9-027b8a05f3a7-agent-certs\") pod \"konnectivity-agent-nkqqw\" (UID: \"38c684b6-68c3-4edb-84a9-027b8a05f3a7\") " pod="kube-system/konnectivity-agent-nkqqw" Jul 06 21:12:59.674825 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.674648 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d3b41b14-af75-441a-aa29-61d90ead4d44-cnibin\") pod \"multus-4hcwd\" (UID: \"d3b41b14-af75-441a-aa29-61d90ead4d44\") " pod="openshift-multus/multus-4hcwd" Jul 06 21:12:59.674825 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.674676 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d3b41b14-af75-441a-aa29-61d90ead4d44-host-run-multus-certs\") pod \"multus-4hcwd\" (UID: \"d3b41b14-af75-441a-aa29-61d90ead4d44\") " pod="openshift-multus/multus-4hcwd" Jul 06 21:12:59.674825 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.674702 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fmzbz\" (UniqueName: \"kubernetes.io/projected/d3b41b14-af75-441a-aa29-61d90ead4d44-kube-api-access-fmzbz\") pod \"multus-4hcwd\" (UID: \"d3b41b14-af75-441a-aa29-61d90ead4d44\") " pod="openshift-multus/multus-4hcwd" Jul 06 21:12:59.674825 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.674725 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9130a04b-36d5-4e3a-ab77-2c9791b9cdd7-var-lib-kubelet\") pod \"tuned-sshnw\" (UID: \"9130a04b-36d5-4e3a-ab77-2c9791b9cdd7\") " pod="openshift-cluster-node-tuning-operator/tuned-sshnw" Jul 06 21:12:59.674825 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.674749 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/75526115-8ac3-429e-a883-ed7bf4193923-registration-dir\") pod \"aws-ebs-csi-driver-node-9fllz\" (UID: \"75526115-8ac3-429e-a883-ed7bf4193923\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9fllz" Jul 06 21:12:59.674825 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.674771 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/55e17066-002e-4ebb-a6cb-e4be26f3383d-kubelet-config\") pod \"global-pull-secret-syncer-xgv7v\" (UID: \"55e17066-002e-4ebb-a6cb-e4be26f3383d\") " pod="kube-system/global-pull-secret-syncer-xgv7v" Jul 06 21:12:59.675130 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.674821 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d3b41b14-af75-441a-aa29-61d90ead4d44-host-run-multus-certs\") pod \"multus-4hcwd\" (UID: \"d3b41b14-af75-441a-aa29-61d90ead4d44\") " pod="openshift-multus/multus-4hcwd" Jul 06 21:12:59.675130 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.674844 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9130a04b-36d5-4e3a-ab77-2c9791b9cdd7-var-lib-kubelet\") pod \"tuned-sshnw\" (UID: \"9130a04b-36d5-4e3a-ab77-2c9791b9cdd7\") " pod="openshift-cluster-node-tuning-operator/tuned-sshnw" Jul 06 21:12:59.675130 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.674832 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/55e17066-002e-4ebb-a6cb-e4be26f3383d-kubelet-config\") pod \"global-pull-secret-syncer-xgv7v\" (UID: \"55e17066-002e-4ebb-a6cb-e4be26f3383d\") " pod="kube-system/global-pull-secret-syncer-xgv7v" Jul 06 21:12:59.675130 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.674882 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/75526115-8ac3-429e-a883-ed7bf4193923-registration-dir\") pod \"aws-ebs-csi-driver-node-9fllz\" (UID: \"75526115-8ac3-429e-a883-ed7bf4193923\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9fllz" Jul 06 21:12:59.675130 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.674901 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vtf2b\" (UniqueName: \"kubernetes.io/projected/83297255-f507-48e1-80d6-6c8b9d5e1a81-kube-api-access-vtf2b\") pod \"multus-additional-cni-plugins-l26xp\" (UID: \"83297255-f507-48e1-80d6-6c8b9d5e1a81\") " pod="openshift-multus/multus-additional-cni-plugins-l26xp" Jul 06 21:12:59.675130 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.674914 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d3b41b14-af75-441a-aa29-61d90ead4d44-cnibin\") pod \"multus-4hcwd\" (UID: \"d3b41b14-af75-441a-aa29-61d90ead4d44\") " pod="openshift-multus/multus-4hcwd" Jul 06 21:12:59.675130 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.674934 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/75526115-8ac3-429e-a883-ed7bf4193923-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9fllz\" (UID: \"75526115-8ac3-429e-a883-ed7bf4193923\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9fllz" Jul 06 21:12:59.675130 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.674963 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d3b41b14-af75-441a-aa29-61d90ead4d44-host-run-k8s-cni-cncf-io\") pod \"multus-4hcwd\" (UID: \"d3b41b14-af75-441a-aa29-61d90ead4d44\") " pod="openshift-multus/multus-4hcwd" Jul 06 21:12:59.675130 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.675005 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d3b41b14-af75-441a-aa29-61d90ead4d44-host-run-k8s-cni-cncf-io\") pod \"multus-4hcwd\" (UID: \"d3b41b14-af75-441a-aa29-61d90ead4d44\") " pod="openshift-multus/multus-4hcwd" Jul 06 21:12:59.675130 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.675006 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e7ec46bc-523f-4480-9245-42931eac113a-tmp-dir\") pod \"node-resolver-tdbzc\" (UID: \"e7ec46bc-523f-4480-9245-42931eac113a\") " pod="openshift-dns/node-resolver-tdbzc" Jul 06 21:12:59.675130 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.675039 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d3b41b14-af75-441a-aa29-61d90ead4d44-etc-kubernetes\") pod \"multus-4hcwd\" (UID: \"d3b41b14-af75-441a-aa29-61d90ead4d44\") " pod="openshift-multus/multus-4hcwd" Jul 06 21:12:59.675130 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.675064 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9130a04b-36d5-4e3a-ab77-2c9791b9cdd7-run\") pod \"tuned-sshnw\" (UID: \"9130a04b-36d5-4e3a-ab77-2c9791b9cdd7\") " pod="openshift-cluster-node-tuning-operator/tuned-sshnw" Jul 06 21:12:59.675130 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.675090 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d3b41b14-af75-441a-aa29-61d90ead4d44-multus-conf-dir\") pod \"multus-4hcwd\" (UID: \"d3b41b14-af75-441a-aa29-61d90ead4d44\") " pod="openshift-multus/multus-4hcwd" Jul 06 21:12:59.675130 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.675102 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/75526115-8ac3-429e-a883-ed7bf4193923-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9fllz\" (UID: \"75526115-8ac3-429e-a883-ed7bf4193923\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9fllz" Jul 06 21:12:59.675130 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.675118 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d3b41b14-af75-441a-aa29-61d90ead4d44-host-var-lib-cni-multus\") pod \"multus-4hcwd\" (UID: \"d3b41b14-af75-441a-aa29-61d90ead4d44\") " pod="openshift-multus/multus-4hcwd" Jul 06 21:12:59.675130 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.675125 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d3b41b14-af75-441a-aa29-61d90ead4d44-etc-kubernetes\") pod \"multus-4hcwd\" (UID: \"d3b41b14-af75-441a-aa29-61d90ead4d44\") " pod="openshift-multus/multus-4hcwd" Jul 06 21:12:59.675945 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.675145 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9130a04b-36d5-4e3a-ab77-2c9791b9cdd7-etc-sysctl-d\") pod \"tuned-sshnw\" (UID: \"9130a04b-36d5-4e3a-ab77-2c9791b9cdd7\") " pod="openshift-cluster-node-tuning-operator/tuned-sshnw" Jul 06 21:12:59.675945 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.675168 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d3b41b14-af75-441a-aa29-61d90ead4d44-multus-conf-dir\") pod \"multus-4hcwd\" (UID: \"d3b41b14-af75-441a-aa29-61d90ead4d44\") " pod="openshift-multus/multus-4hcwd" Jul 06 21:12:59.675945 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.675173 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d3b41b14-af75-441a-aa29-61d90ead4d44-multus-daemon-config\") pod \"multus-4hcwd\" (UID: \"d3b41b14-af75-441a-aa29-61d90ead4d44\") " pod="openshift-multus/multus-4hcwd" Jul 06 21:12:59.675945 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.675173 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9130a04b-36d5-4e3a-ab77-2c9791b9cdd7-run\") pod \"tuned-sshnw\" (UID: \"9130a04b-36d5-4e3a-ab77-2c9791b9cdd7\") " pod="openshift-cluster-node-tuning-operator/tuned-sshnw" Jul 06 21:12:59.675945 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.675218 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d3b41b14-af75-441a-aa29-61d90ead4d44-host-var-lib-cni-multus\") pod \"multus-4hcwd\" (UID: \"d3b41b14-af75-441a-aa29-61d90ead4d44\") " pod="openshift-multus/multus-4hcwd" Jul 06 21:12:59.675945 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.675201 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/83297255-f507-48e1-80d6-6c8b9d5e1a81-cni-binary-copy\") pod \"multus-additional-cni-plugins-l26xp\" (UID: \"83297255-f507-48e1-80d6-6c8b9d5e1a81\") " pod="openshift-multus/multus-additional-cni-plugins-l26xp" Jul 06 21:12:59.675945 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.675250 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9130a04b-36d5-4e3a-ab77-2c9791b9cdd7-etc-sysctl-conf\") pod \"tuned-sshnw\" (UID: \"9130a04b-36d5-4e3a-ab77-2c9791b9cdd7\") " pod="openshift-cluster-node-tuning-operator/tuned-sshnw" Jul 06 21:12:59.675945 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.675290 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/75526115-8ac3-429e-a883-ed7bf4193923-socket-dir\") pod \"aws-ebs-csi-driver-node-9fllz\" (UID: \"75526115-8ac3-429e-a883-ed7bf4193923\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9fllz" Jul 06 21:12:59.675945 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.675303 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e7ec46bc-523f-4480-9245-42931eac113a-tmp-dir\") pod \"node-resolver-tdbzc\" (UID: \"e7ec46bc-523f-4480-9245-42931eac113a\") " pod="openshift-dns/node-resolver-tdbzc" Jul 06 21:12:59.675945 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.675329 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/55e17066-002e-4ebb-a6cb-e4be26f3383d-original-pull-secret\") pod \"global-pull-secret-syncer-xgv7v\" (UID: \"55e17066-002e-4ebb-a6cb-e4be26f3383d\") " pod="kube-system/global-pull-secret-syncer-xgv7v" Jul 06 21:12:59.675945 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.675356 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/83297255-f507-48e1-80d6-6c8b9d5e1a81-system-cni-dir\") pod \"multus-additional-cni-plugins-l26xp\" (UID: \"83297255-f507-48e1-80d6-6c8b9d5e1a81\") " pod="openshift-multus/multus-additional-cni-plugins-l26xp" Jul 06 21:12:59.675945 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.675369 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9130a04b-36d5-4e3a-ab77-2c9791b9cdd7-etc-sysctl-d\") pod \"tuned-sshnw\" (UID: \"9130a04b-36d5-4e3a-ab77-2c9791b9cdd7\") " pod="openshift-cluster-node-tuning-operator/tuned-sshnw" Jul 06 21:12:59.675945 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.675382 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/75526115-8ac3-429e-a883-ed7bf4193923-sys-fs\") pod \"aws-ebs-csi-driver-node-9fllz\" (UID: \"75526115-8ac3-429e-a883-ed7bf4193923\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9fllz" Jul 06 21:12:59.675945 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.675429 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/83297255-f507-48e1-80d6-6c8b9d5e1a81-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-l26xp\" (UID: \"83297255-f507-48e1-80d6-6c8b9d5e1a81\") " pod="openshift-multus/multus-additional-cni-plugins-l26xp" Jul 06 21:12:59.675945 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.675438 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/75526115-8ac3-429e-a883-ed7bf4193923-sys-fs\") pod \"aws-ebs-csi-driver-node-9fllz\" (UID: \"75526115-8ac3-429e-a883-ed7bf4193923\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9fllz" Jul 06 21:12:59.675945 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.675460 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9130a04b-36d5-4e3a-ab77-2c9791b9cdd7-etc-systemd\") pod \"tuned-sshnw\" (UID: \"9130a04b-36d5-4e3a-ab77-2c9791b9cdd7\") " pod="openshift-cluster-node-tuning-operator/tuned-sshnw" Jul 06 21:12:59.675945 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.675479 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9130a04b-36d5-4e3a-ab77-2c9791b9cdd7-etc-sysctl-conf\") pod \"tuned-sshnw\" (UID: \"9130a04b-36d5-4e3a-ab77-2c9791b9cdd7\") " pod="openshift-cluster-node-tuning-operator/tuned-sshnw" Jul 06 21:12:59.676829 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.675487 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9130a04b-36d5-4e3a-ab77-2c9791b9cdd7-lib-modules\") pod \"tuned-sshnw\" (UID: \"9130a04b-36d5-4e3a-ab77-2c9791b9cdd7\") " pod="openshift-cluster-node-tuning-operator/tuned-sshnw" Jul 06 21:12:59.676829 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.675516 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/83297255-f507-48e1-80d6-6c8b9d5e1a81-tuning-conf-dir\") pod \"multus-additional-cni-plugins-l26xp\" (UID: \"83297255-f507-48e1-80d6-6c8b9d5e1a81\") " pod="openshift-multus/multus-additional-cni-plugins-l26xp" Jul 06 21:12:59.676829 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.675537 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/75526115-8ac3-429e-a883-ed7bf4193923-socket-dir\") pod \"aws-ebs-csi-driver-node-9fllz\" (UID: \"75526115-8ac3-429e-a883-ed7bf4193923\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9fllz" Jul 06 21:12:59.676829 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.675544 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/83297255-f507-48e1-80d6-6c8b9d5e1a81-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-l26xp\" (UID: \"83297255-f507-48e1-80d6-6c8b9d5e1a81\") " pod="openshift-multus/multus-additional-cni-plugins-l26xp" Jul 06 21:12:59.676829 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.675577 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9130a04b-36d5-4e3a-ab77-2c9791b9cdd7-etc-kubernetes\") pod \"tuned-sshnw\" (UID: \"9130a04b-36d5-4e3a-ab77-2c9791b9cdd7\") " pod="openshift-cluster-node-tuning-operator/tuned-sshnw" Jul 06 21:12:59.676829 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.675602 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9130a04b-36d5-4e3a-ab77-2c9791b9cdd7-etc-systemd\") pod \"tuned-sshnw\" (UID: \"9130a04b-36d5-4e3a-ab77-2c9791b9cdd7\") " pod="openshift-cluster-node-tuning-operator/tuned-sshnw" Jul 06 21:12:59.676829 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.675606 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-whpb8\" (UniqueName: \"kubernetes.io/projected/9130a04b-36d5-4e3a-ab77-2c9791b9cdd7-kube-api-access-whpb8\") pod \"tuned-sshnw\" (UID: \"9130a04b-36d5-4e3a-ab77-2c9791b9cdd7\") " pod="openshift-cluster-node-tuning-operator/tuned-sshnw" Jul 06 21:12:59.676829 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.675646 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d3b41b14-af75-441a-aa29-61d90ead4d44-system-cni-dir\") pod \"multus-4hcwd\" (UID: \"d3b41b14-af75-441a-aa29-61d90ead4d44\") " pod="openshift-multus/multus-4hcwd" Jul 06 21:12:59.676829 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.675671 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d3b41b14-af75-441a-aa29-61d90ead4d44-cni-binary-copy\") pod \"multus-4hcwd\" (UID: \"d3b41b14-af75-441a-aa29-61d90ead4d44\") " pod="openshift-multus/multus-4hcwd" Jul 06 21:12:59.676829 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.675700 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e7ec46bc-523f-4480-9245-42931eac113a-hosts-file\") pod \"node-resolver-tdbzc\" (UID: \"e7ec46bc-523f-4480-9245-42931eac113a\") " pod="openshift-dns/node-resolver-tdbzc" Jul 06 21:12:59.676829 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.675719 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9130a04b-36d5-4e3a-ab77-2c9791b9cdd7-lib-modules\") pod \"tuned-sshnw\" (UID: \"9130a04b-36d5-4e3a-ab77-2c9791b9cdd7\") " pod="openshift-cluster-node-tuning-operator/tuned-sshnw" Jul 06 21:12:59.676829 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.675733 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d3b41b14-af75-441a-aa29-61d90ead4d44-os-release\") pod \"multus-4hcwd\" (UID: \"d3b41b14-af75-441a-aa29-61d90ead4d44\") " pod="openshift-multus/multus-4hcwd" Jul 06 21:12:59.676829 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.675759 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/83297255-f507-48e1-80d6-6c8b9d5e1a81-cnibin\") pod \"multus-additional-cni-plugins-l26xp\" (UID: \"83297255-f507-48e1-80d6-6c8b9d5e1a81\") " pod="openshift-multus/multus-additional-cni-plugins-l26xp" Jul 06 21:12:59.676829 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.675785 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mrfgh\" (UniqueName: \"kubernetes.io/projected/75526115-8ac3-429e-a883-ed7bf4193923-kube-api-access-mrfgh\") pod \"aws-ebs-csi-driver-node-9fllz\" (UID: \"75526115-8ac3-429e-a883-ed7bf4193923\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9fllz" Jul 06 21:12:59.676829 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.675812 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/38c684b6-68c3-4edb-84a9-027b8a05f3a7-konnectivity-ca\") pod \"konnectivity-agent-nkqqw\" (UID: \"38c684b6-68c3-4edb-84a9-027b8a05f3a7\") " pod="kube-system/konnectivity-agent-nkqqw" Jul 06 21:12:59.676829 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.675839 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/55e17066-002e-4ebb-a6cb-e4be26f3383d-dbus\") pod \"global-pull-secret-syncer-xgv7v\" (UID: \"55e17066-002e-4ebb-a6cb-e4be26f3383d\") " pod="kube-system/global-pull-secret-syncer-xgv7v" Jul 06 21:12:59.676829 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.675872 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/83297255-f507-48e1-80d6-6c8b9d5e1a81-tuning-conf-dir\") pod \"multus-additional-cni-plugins-l26xp\" (UID: \"83297255-f507-48e1-80d6-6c8b9d5e1a81\") " pod="openshift-multus/multus-additional-cni-plugins-l26xp" Jul 06 21:12:59.677652 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.675881 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d3b41b14-af75-441a-aa29-61d90ead4d44-multus-daemon-config\") pod \"multus-4hcwd\" (UID: \"d3b41b14-af75-441a-aa29-61d90ead4d44\") " pod="openshift-multus/multus-4hcwd" Jul 06 21:12:59.677652 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.675874 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d3b41b14-af75-441a-aa29-61d90ead4d44-multus-cni-dir\") pod \"multus-4hcwd\" (UID: \"d3b41b14-af75-441a-aa29-61d90ead4d44\") " pod="openshift-multus/multus-4hcwd" Jul 06 21:12:59.677652 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.675919 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d3b41b14-af75-441a-aa29-61d90ead4d44-host-var-lib-kubelet\") pod \"multus-4hcwd\" (UID: \"d3b41b14-af75-441a-aa29-61d90ead4d44\") " pod="openshift-multus/multus-4hcwd" Jul 06 21:12:59.677652 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.675939 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d3b41b14-af75-441a-aa29-61d90ead4d44-multus-cni-dir\") pod \"multus-4hcwd\" (UID: \"d3b41b14-af75-441a-aa29-61d90ead4d44\") " pod="openshift-multus/multus-4hcwd" Jul 06 21:12:59.677652 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.675944 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9130a04b-36d5-4e3a-ab77-2c9791b9cdd7-tmp\") pod \"tuned-sshnw\" (UID: \"9130a04b-36d5-4e3a-ab77-2c9791b9cdd7\") " pod="openshift-cluster-node-tuning-operator/tuned-sshnw" Jul 06 21:12:59.677652 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.675982 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d3b41b14-af75-441a-aa29-61d90ead4d44-multus-socket-dir-parent\") pod \"multus-4hcwd\" (UID: \"d3b41b14-af75-441a-aa29-61d90ead4d44\") " pod="openshift-multus/multus-4hcwd" Jul 06 21:12:59.677652 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.676010 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d3b41b14-af75-441a-aa29-61d90ead4d44-hostroot\") pod \"multus-4hcwd\" (UID: \"d3b41b14-af75-441a-aa29-61d90ead4d44\") " pod="openshift-multus/multus-4hcwd" Jul 06 21:12:59.677652 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.676037 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/83297255-f507-48e1-80d6-6c8b9d5e1a81-os-release\") pod \"multus-additional-cni-plugins-l26xp\" (UID: \"83297255-f507-48e1-80d6-6c8b9d5e1a81\") " pod="openshift-multus/multus-additional-cni-plugins-l26xp" Jul 06 21:12:59.677652 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.676063 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9130a04b-36d5-4e3a-ab77-2c9791b9cdd7-etc-modprobe-d\") pod \"tuned-sshnw\" (UID: \"9130a04b-36d5-4e3a-ab77-2c9791b9cdd7\") " pod="openshift-cluster-node-tuning-operator/tuned-sshnw" Jul 06 21:12:59.677652 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.676098 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9130a04b-36d5-4e3a-ab77-2c9791b9cdd7-etc-sysconfig\") pod \"tuned-sshnw\" (UID: \"9130a04b-36d5-4e3a-ab77-2c9791b9cdd7\") " pod="openshift-cluster-node-tuning-operator/tuned-sshnw" Jul 06 21:12:59.677652 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.676124 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9130a04b-36d5-4e3a-ab77-2c9791b9cdd7-sys\") pod \"tuned-sshnw\" (UID: \"9130a04b-36d5-4e3a-ab77-2c9791b9cdd7\") " pod="openshift-cluster-node-tuning-operator/tuned-sshnw" Jul 06 21:12:59.677652 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.676157 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9130a04b-36d5-4e3a-ab77-2c9791b9cdd7-host\") pod \"tuned-sshnw\" (UID: \"9130a04b-36d5-4e3a-ab77-2c9791b9cdd7\") " pod="openshift-cluster-node-tuning-operator/tuned-sshnw" Jul 06 21:12:59.677652 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.676181 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9130a04b-36d5-4e3a-ab77-2c9791b9cdd7-etc-tuned\") pod \"tuned-sshnw\" (UID: \"9130a04b-36d5-4e3a-ab77-2c9791b9cdd7\") " pod="openshift-cluster-node-tuning-operator/tuned-sshnw" Jul 06 21:12:59.677652 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.676207 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/75526115-8ac3-429e-a883-ed7bf4193923-device-dir\") pod \"aws-ebs-csi-driver-node-9fllz\" (UID: \"75526115-8ac3-429e-a883-ed7bf4193923\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9fllz" Jul 06 21:12:59.677652 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.676234 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d3b41b14-af75-441a-aa29-61d90ead4d44-host-run-netns\") pod \"multus-4hcwd\" (UID: \"d3b41b14-af75-441a-aa29-61d90ead4d44\") " pod="openshift-multus/multus-4hcwd" Jul 06 21:12:59.677652 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.676262 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d3b41b14-af75-441a-aa29-61d90ead4d44-host-var-lib-cni-bin\") pod \"multus-4hcwd\" (UID: \"d3b41b14-af75-441a-aa29-61d90ead4d44\") " pod="openshift-multus/multus-4hcwd" Jul 06 21:12:59.677652 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.676292 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/75526115-8ac3-429e-a883-ed7bf4193923-etc-selinux\") pod \"aws-ebs-csi-driver-node-9fllz\" (UID: \"75526115-8ac3-429e-a883-ed7bf4193923\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9fllz" Jul 06 21:12:59.677652 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.676364 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8llf5\" (UniqueName: \"kubernetes.io/projected/e7ec46bc-523f-4480-9245-42931eac113a-kube-api-access-8llf5\") pod \"node-resolver-tdbzc\" (UID: \"e7ec46bc-523f-4480-9245-42931eac113a\") " pod="openshift-dns/node-resolver-tdbzc" Jul 06 21:12:59.678297 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.676371 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d3b41b14-af75-441a-aa29-61d90ead4d44-hostroot\") pod \"multus-4hcwd\" (UID: \"d3b41b14-af75-441a-aa29-61d90ead4d44\") " pod="openshift-multus/multus-4hcwd" Jul 06 21:12:59.678297 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.676411 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d3b41b14-af75-441a-aa29-61d90ead4d44-cni-binary-copy\") pod \"multus-4hcwd\" (UID: \"d3b41b14-af75-441a-aa29-61d90ead4d44\") " pod="openshift-multus/multus-4hcwd" Jul 06 21:12:59.678297 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.676482 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/83297255-f507-48e1-80d6-6c8b9d5e1a81-os-release\") pod \"multus-additional-cni-plugins-l26xp\" (UID: \"83297255-f507-48e1-80d6-6c8b9d5e1a81\") " pod="openshift-multus/multus-additional-cni-plugins-l26xp" Jul 06 21:12:59.678297 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.676518 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/55e17066-002e-4ebb-a6cb-e4be26f3383d-dbus\") pod \"global-pull-secret-syncer-xgv7v\" (UID: \"55e17066-002e-4ebb-a6cb-e4be26f3383d\") " pod="kube-system/global-pull-secret-syncer-xgv7v" Jul 06 21:12:59.678297 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.676563 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/83297255-f507-48e1-80d6-6c8b9d5e1a81-cni-binary-copy\") pod \"multus-additional-cni-plugins-l26xp\" (UID: \"83297255-f507-48e1-80d6-6c8b9d5e1a81\") " pod="openshift-multus/multus-additional-cni-plugins-l26xp" Jul 06 21:12:59.678297 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.676587 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9130a04b-36d5-4e3a-ab77-2c9791b9cdd7-etc-modprobe-d\") pod \"tuned-sshnw\" (UID: \"9130a04b-36d5-4e3a-ab77-2c9791b9cdd7\") " pod="openshift-cluster-node-tuning-operator/tuned-sshnw" Jul 06 21:12:59.678297 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.676651 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9130a04b-36d5-4e3a-ab77-2c9791b9cdd7-host\") pod \"tuned-sshnw\" (UID: \"9130a04b-36d5-4e3a-ab77-2c9791b9cdd7\") " pod="openshift-cluster-node-tuning-operator/tuned-sshnw" Jul 06 21:12:59.678297 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.676671 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d3b41b14-af75-441a-aa29-61d90ead4d44-multus-socket-dir-parent\") pod \"multus-4hcwd\" (UID: \"d3b41b14-af75-441a-aa29-61d90ead4d44\") " pod="openshift-multus/multus-4hcwd" Jul 06 21:12:59.678297 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.676721 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e7ec46bc-523f-4480-9245-42931eac113a-hosts-file\") pod \"node-resolver-tdbzc\" (UID: \"e7ec46bc-523f-4480-9245-42931eac113a\") " pod="openshift-dns/node-resolver-tdbzc" Jul 06 21:12:59.678297 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.676773 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d3b41b14-af75-441a-aa29-61d90ead4d44-host-var-lib-kubelet\") pod \"multus-4hcwd\" (UID: \"d3b41b14-af75-441a-aa29-61d90ead4d44\") " pod="openshift-multus/multus-4hcwd" Jul 06 21:12:59.678297 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.676788 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/83297255-f507-48e1-80d6-6c8b9d5e1a81-cnibin\") pod \"multus-additional-cni-plugins-l26xp\" (UID: \"83297255-f507-48e1-80d6-6c8b9d5e1a81\") " pod="openshift-multus/multus-additional-cni-plugins-l26xp" Jul 06 21:12:59.678297 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.676818 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9130a04b-36d5-4e3a-ab77-2c9791b9cdd7-etc-kubernetes\") pod \"tuned-sshnw\" (UID: \"9130a04b-36d5-4e3a-ab77-2c9791b9cdd7\") " pod="openshift-cluster-node-tuning-operator/tuned-sshnw" Jul 06 21:12:59.678297 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.676829 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d3b41b14-af75-441a-aa29-61d90ead4d44-system-cni-dir\") pod \"multus-4hcwd\" (UID: \"d3b41b14-af75-441a-aa29-61d90ead4d44\") " pod="openshift-multus/multus-4hcwd" Jul 06 21:12:59.678297 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.676868 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d3b41b14-af75-441a-aa29-61d90ead4d44-host-run-netns\") pod \"multus-4hcwd\" (UID: \"d3b41b14-af75-441a-aa29-61d90ead4d44\") " pod="openshift-multus/multus-4hcwd" Jul 06 21:12:59.678297 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.676889 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/75526115-8ac3-429e-a883-ed7bf4193923-device-dir\") pod \"aws-ebs-csi-driver-node-9fllz\" (UID: \"75526115-8ac3-429e-a883-ed7bf4193923\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9fllz" Jul 06 21:12:59.678297 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.676958 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9130a04b-36d5-4e3a-ab77-2c9791b9cdd7-etc-sysconfig\") pod \"tuned-sshnw\" (UID: \"9130a04b-36d5-4e3a-ab77-2c9791b9cdd7\") " pod="openshift-cluster-node-tuning-operator/tuned-sshnw" Jul 06 21:12:59.678297 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.676979 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/38c684b6-68c3-4edb-84a9-027b8a05f3a7-konnectivity-ca\") pod \"konnectivity-agent-nkqqw\" (UID: \"38c684b6-68c3-4edb-84a9-027b8a05f3a7\") " pod="kube-system/konnectivity-agent-nkqqw" Jul 06 21:12:59.678297 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.677005 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9130a04b-36d5-4e3a-ab77-2c9791b9cdd7-sys\") pod \"tuned-sshnw\" (UID: \"9130a04b-36d5-4e3a-ab77-2c9791b9cdd7\") " pod="openshift-cluster-node-tuning-operator/tuned-sshnw" Jul 06 21:12:59.679015 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.677033 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d3b41b14-af75-441a-aa29-61d90ead4d44-host-var-lib-cni-bin\") pod \"multus-4hcwd\" (UID: \"d3b41b14-af75-441a-aa29-61d90ead4d44\") " pod="openshift-multus/multus-4hcwd" Jul 06 21:12:59.679015 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.677044 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/75526115-8ac3-429e-a883-ed7bf4193923-etc-selinux\") pod \"aws-ebs-csi-driver-node-9fllz\" (UID: \"75526115-8ac3-429e-a883-ed7bf4193923\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9fllz" Jul 06 21:12:59.679015 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.677101 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/83297255-f507-48e1-80d6-6c8b9d5e1a81-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-l26xp\" (UID: \"83297255-f507-48e1-80d6-6c8b9d5e1a81\") " pod="openshift-multus/multus-additional-cni-plugins-l26xp" Jul 06 21:12:59.679015 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.677175 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/83297255-f507-48e1-80d6-6c8b9d5e1a81-system-cni-dir\") pod \"multus-additional-cni-plugins-l26xp\" (UID: \"83297255-f507-48e1-80d6-6c8b9d5e1a81\") " pod="openshift-multus/multus-additional-cni-plugins-l26xp" Jul 06 21:12:59.679015 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.677192 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d3b41b14-af75-441a-aa29-61d90ead4d44-os-release\") pod \"multus-4hcwd\" (UID: \"d3b41b14-af75-441a-aa29-61d90ead4d44\") " pod="openshift-multus/multus-4hcwd" Jul 06 21:12:59.679015 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:12:59.677261 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 21:12:59.679015 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:12:59.677343 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/55e17066-002e-4ebb-a6cb-e4be26f3383d-original-pull-secret podName:55e17066-002e-4ebb-a6cb-e4be26f3383d nodeName:}" failed. No retries permitted until 2026-07-06 21:13:00.177322281 +0000 UTC m=+3.124700278 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/55e17066-002e-4ebb-a6cb-e4be26f3383d-original-pull-secret") pod "global-pull-secret-syncer-xgv7v" (UID: "55e17066-002e-4ebb-a6cb-e4be26f3383d") : object "kube-system"/"original-pull-secret" not registered Jul 06 21:12:59.679015 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.677502 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/83297255-f507-48e1-80d6-6c8b9d5e1a81-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-l26xp\" (UID: \"83297255-f507-48e1-80d6-6c8b9d5e1a81\") " pod="openshift-multus/multus-additional-cni-plugins-l26xp" Jul 06 21:12:59.679015 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.677557 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/38c684b6-68c3-4edb-84a9-027b8a05f3a7-agent-certs\") pod \"konnectivity-agent-nkqqw\" (UID: \"38c684b6-68c3-4edb-84a9-027b8a05f3a7\") " pod="kube-system/konnectivity-agent-nkqqw" Jul 06 21:12:59.679015 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.678866 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9130a04b-36d5-4e3a-ab77-2c9791b9cdd7-tmp\") pod \"tuned-sshnw\" (UID: \"9130a04b-36d5-4e3a-ab77-2c9791b9cdd7\") " pod="openshift-cluster-node-tuning-operator/tuned-sshnw" Jul 06 21:12:59.679409 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.679096 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9130a04b-36d5-4e3a-ab77-2c9791b9cdd7-etc-tuned\") pod \"tuned-sshnw\" (UID: \"9130a04b-36d5-4e3a-ab77-2c9791b9cdd7\") " pod="openshift-cluster-node-tuning-operator/tuned-sshnw" Jul 06 21:12:59.689635 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.689547 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-whpb8\" (UniqueName: \"kubernetes.io/projected/9130a04b-36d5-4e3a-ab77-2c9791b9cdd7-kube-api-access-whpb8\") pod \"tuned-sshnw\" (UID: \"9130a04b-36d5-4e3a-ab77-2c9791b9cdd7\") " pod="openshift-cluster-node-tuning-operator/tuned-sshnw" Jul 06 21:12:59.689635 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.689574 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fmzbz\" (UniqueName: \"kubernetes.io/projected/d3b41b14-af75-441a-aa29-61d90ead4d44-kube-api-access-fmzbz\") pod \"multus-4hcwd\" (UID: \"d3b41b14-af75-441a-aa29-61d90ead4d44\") " pod="openshift-multus/multus-4hcwd" Jul 06 21:12:59.689635 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.689578 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vtf2b\" (UniqueName: \"kubernetes.io/projected/83297255-f507-48e1-80d6-6c8b9d5e1a81-kube-api-access-vtf2b\") pod \"multus-additional-cni-plugins-l26xp\" (UID: \"83297255-f507-48e1-80d6-6c8b9d5e1a81\") " pod="openshift-multus/multus-additional-cni-plugins-l26xp" Jul 06 21:12:59.689919 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.689791 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8llf5\" (UniqueName: \"kubernetes.io/projected/e7ec46bc-523f-4480-9245-42931eac113a-kube-api-access-8llf5\") pod \"node-resolver-tdbzc\" (UID: \"e7ec46bc-523f-4480-9245-42931eac113a\") " pod="openshift-dns/node-resolver-tdbzc" Jul 06 21:12:59.690504 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.690479 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mrfgh\" (UniqueName: \"kubernetes.io/projected/75526115-8ac3-429e-a883-ed7bf4193923-kube-api-access-mrfgh\") pod \"aws-ebs-csi-driver-node-9fllz\" (UID: \"75526115-8ac3-429e-a883-ed7bf4193923\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9fllz" Jul 06 21:12:59.763517 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.763479 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-4rqvd" Jul 06 21:12:59.784793 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.784756 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-vzzd6" Jul 06 21:12:59.793852 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.793819 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-5s6d9" Jul 06 21:12:59.799782 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.799755 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-sshnw" Jul 06 21:12:59.807841 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.807817 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9fllz" Jul 06 21:12:59.814739 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.814714 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-tdbzc" Jul 06 21:12:59.821789 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.821759 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-nkqqw" Jul 06 21:12:59.828852 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.828825 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-4hcwd" Jul 06 21:12:59.831653 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.831632 2573 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 21:12:59.835024 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.835003 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-l26xp" Jul 06 21:12:59.948767 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:12:59.948672 2573 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 21:13:00.080301 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:00.080244 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3a3548bd-1472-470c-bda5-a7c611571bea-metrics-certs\") pod \"network-metrics-daemon-w5754\" (UID: \"3a3548bd-1472-470c-bda5-a7c611571bea\") " pod="openshift-multus/network-metrics-daemon-w5754" Jul 06 21:13:00.080507 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:13:00.080456 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 21:13:00.080576 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:13:00.080526 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a3548bd-1472-470c-bda5-a7c611571bea-metrics-certs podName:3a3548bd-1472-470c-bda5-a7c611571bea nodeName:}" failed. No retries permitted until 2026-07-06 21:13:01.080506146 +0000 UTC m=+4.027884140 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3a3548bd-1472-470c-bda5-a7c611571bea-metrics-certs") pod "network-metrics-daemon-w5754" (UID: "3a3548bd-1472-470c-bda5-a7c611571bea") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 21:13:00.180827 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:00.180786 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/55e17066-002e-4ebb-a6cb-e4be26f3383d-original-pull-secret\") pod \"global-pull-secret-syncer-xgv7v\" (UID: \"55e17066-002e-4ebb-a6cb-e4be26f3383d\") " pod="kube-system/global-pull-secret-syncer-xgv7v" Jul 06 21:13:00.181039 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:00.180877 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7kg9q\" (UniqueName: \"kubernetes.io/projected/c5dccb0b-1724-44ec-a683-c8a45526a11a-kube-api-access-7kg9q\") pod \"network-check-target-2vbd9\" (UID: \"c5dccb0b-1724-44ec-a683-c8a45526a11a\") " pod="openshift-network-diagnostics/network-check-target-2vbd9" Jul 06 21:13:00.181039 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:13:00.180983 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 21:13:00.181039 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:13:00.181028 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 21:13:00.181224 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:13:00.181046 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 21:13:00.181224 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:13:00.181060 2573 projected.go:196] Error preparing data for projected volume kube-api-access-7kg9q for pod openshift-network-diagnostics/network-check-target-2vbd9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 21:13:00.181224 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:13:00.181067 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/55e17066-002e-4ebb-a6cb-e4be26f3383d-original-pull-secret podName:55e17066-002e-4ebb-a6cb-e4be26f3383d nodeName:}" failed. No retries permitted until 2026-07-06 21:13:01.18104523 +0000 UTC m=+4.128423228 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/55e17066-002e-4ebb-a6cb-e4be26f3383d-original-pull-secret") pod "global-pull-secret-syncer-xgv7v" (UID: "55e17066-002e-4ebb-a6cb-e4be26f3383d") : object "kube-system"/"original-pull-secret" not registered Jul 06 21:13:00.181224 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:13:00.181118 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c5dccb0b-1724-44ec-a683-c8a45526a11a-kube-api-access-7kg9q podName:c5dccb0b-1724-44ec-a683-c8a45526a11a nodeName:}" failed. No retries permitted until 2026-07-06 21:13:01.181099736 +0000 UTC m=+4.128477733 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-7kg9q" (UniqueName: "kubernetes.io/projected/c5dccb0b-1724-44ec-a683-c8a45526a11a-kube-api-access-7kg9q") pod "network-check-target-2vbd9" (UID: "c5dccb0b-1724-44ec-a683-c8a45526a11a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 21:13:00.504838 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:00.504727 2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 21:08:00 +0000 UTC" deadline="2028-02-16 23:37:44.902418914 +0000 UTC" Jul 06 21:13:00.504838 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:00.504773 2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14162h24m44.397651426s" Jul 06 21:13:00.512480 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:13:00.509476 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7ec46bc_523f_4480_9245_42931eac113a.slice/crio-aaa0e7807527b030e055d89913962002b9d01c6d126618b3fd4040515a8a6b6d WatchSource:0}: Error finding container aaa0e7807527b030e055d89913962002b9d01c6d126618b3fd4040515a8a6b6d: Status 404 returned error can't find the container with id aaa0e7807527b030e055d89913962002b9d01c6d126618b3fd4040515a8a6b6d Jul 06 21:13:00.535366 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:13:00.535310 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83297255_f507_48e1_80d6_6c8b9d5e1a81.slice/crio-fdffb95b42ff0a80b53dbb00d988059615b21e4b7b8d16142613096abc74a3fc WatchSource:0}: Error finding container fdffb95b42ff0a80b53dbb00d988059615b21e4b7b8d16142613096abc74a3fc: Status 404 returned error can't find the container with id fdffb95b42ff0a80b53dbb00d988059615b21e4b7b8d16142613096abc74a3fc Jul 06 21:13:00.536958 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:13:00.536929 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode122448a_d2e4_4fec_a918_3d3eecb175a4.slice/crio-73fb820ccf419833f055209bf6982c4715a7310723e37e1808862c20d32936bd WatchSource:0}: Error finding container 73fb820ccf419833f055209bf6982c4715a7310723e37e1808862c20d32936bd: Status 404 returned error can't find the container with id 73fb820ccf419833f055209bf6982c4715a7310723e37e1808862c20d32936bd Jul 06 21:13:00.538312 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:13:00.538286 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9130a04b_36d5_4e3a_ab77_2c9791b9cdd7.slice/crio-68b757952b890a88cbb56f980cbdc10534f78ffa349637380a4a6ab0f5c01743 WatchSource:0}: Error finding container 68b757952b890a88cbb56f980cbdc10534f78ffa349637380a4a6ab0f5c01743: Status 404 returned error can't find the container with id 68b757952b890a88cbb56f980cbdc10534f78ffa349637380a4a6ab0f5c01743 Jul 06 21:13:00.540257 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:13:00.540150 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4aa139a_9e46_4075_8358_6da2c8f30cec.slice/crio-8aa305b1a5972898e471b87940fa559bf5a1071275265c3bcd8289398e268f02 WatchSource:0}: Error finding container 8aa305b1a5972898e471b87940fa559bf5a1071275265c3bcd8289398e268f02: Status 404 returned error can't find the container with id 8aa305b1a5972898e471b87940fa559bf5a1071275265c3bcd8289398e268f02 Jul 06 21:13:00.541220 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:13:00.541181 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75526115_8ac3_429e_a883_ed7bf4193923.slice/crio-abdad6972ef906af3a950e6171266a9afaae947dcbb80811a799bc47b020b291 WatchSource:0}: Error finding container abdad6972ef906af3a950e6171266a9afaae947dcbb80811a799bc47b020b291: Status 404 returned error can't find the container with id abdad6972ef906af3a950e6171266a9afaae947dcbb80811a799bc47b020b291 Jul 06 21:13:00.543389 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:13:00.542985 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e3cec7e_a502_4807_9070_4ded3cc4727e.slice/crio-f18c834f1d737619692a325afa9783be195e38d422a30f9c4b75af5e8184c0c5 WatchSource:0}: Error finding container f18c834f1d737619692a325afa9783be195e38d422a30f9c4b75af5e8184c0c5: Status 404 returned error can't find the container with id f18c834f1d737619692a325afa9783be195e38d422a30f9c4b75af5e8184c0c5 Jul 06 21:13:00.543837 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:13:00.543801 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38c684b6_68c3_4edb_84a9_027b8a05f3a7.slice/crio-694b6414a057a2b6ba6274ed6edcc5bce0853e4a9d93ab33b8c9cf7b967c5245 WatchSource:0}: Error finding container 694b6414a057a2b6ba6274ed6edcc5bce0853e4a9d93ab33b8c9cf7b967c5245: Status 404 returned error can't find the container with id 694b6414a057a2b6ba6274ed6edcc5bce0853e4a9d93ab33b8c9cf7b967c5245 Jul 06 21:13:00.636820 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:00.636605 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xgv7v" Jul 06 21:13:00.636995 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:13:00.636920 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xgv7v" podUID="55e17066-002e-4ebb-a6cb-e4be26f3383d" Jul 06 21:13:00.646223 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:00.646181 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9fllz" event={"ID":"75526115-8ac3-429e-a883-ed7bf4193923","Type":"ContainerStarted","Data":"abdad6972ef906af3a950e6171266a9afaae947dcbb80811a799bc47b020b291"} Jul 06 21:13:00.647213 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:00.647182 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-tdbzc" event={"ID":"e7ec46bc-523f-4480-9245-42931eac113a","Type":"ContainerStarted","Data":"aaa0e7807527b030e055d89913962002b9d01c6d126618b3fd4040515a8a6b6d"} Jul 06 21:13:00.649223 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:00.649194 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-89.ec2.internal" event={"ID":"4d2cd5ec51313fc648acdd650b240a69","Type":"ContainerStarted","Data":"a72f42fc8cf6e0e905714da92d008607b9e30687ee3f5629d5683b3063606128"} Jul 06 21:13:00.650532 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:00.650502 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-vzzd6" event={"ID":"4e3cec7e-a502-4807-9070-4ded3cc4727e","Type":"ContainerStarted","Data":"f18c834f1d737619692a325afa9783be195e38d422a30f9c4b75af5e8184c0c5"} Jul 06 21:13:00.651611 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:00.651580 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-4rqvd" event={"ID":"f4aa139a-9e46-4075-8358-6da2c8f30cec","Type":"ContainerStarted","Data":"8aa305b1a5972898e471b87940fa559bf5a1071275265c3bcd8289398e268f02"} Jul 06 21:13:00.652698 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:00.652678 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-sshnw" event={"ID":"9130a04b-36d5-4e3a-ab77-2c9791b9cdd7","Type":"ContainerStarted","Data":"68b757952b890a88cbb56f980cbdc10534f78ffa349637380a4a6ab0f5c01743"} Jul 06 21:13:00.654037 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:00.654007 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5s6d9" event={"ID":"e122448a-d2e4-4fec-a918-3d3eecb175a4","Type":"ContainerStarted","Data":"73fb820ccf419833f055209bf6982c4715a7310723e37e1808862c20d32936bd"} Jul 06 21:13:00.655300 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:00.655278 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l26xp" event={"ID":"83297255-f507-48e1-80d6-6c8b9d5e1a81","Type":"ContainerStarted","Data":"fdffb95b42ff0a80b53dbb00d988059615b21e4b7b8d16142613096abc74a3fc"} Jul 06 21:13:00.658449 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:00.658420 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-4hcwd" event={"ID":"d3b41b14-af75-441a-aa29-61d90ead4d44","Type":"ContainerStarted","Data":"9e92515754ac02617d9e8a19bde69bde2729062ac1addeeec3e8f498b65e2d67"} Jul 06 21:13:00.659548 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:00.659525 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-nkqqw" event={"ID":"38c684b6-68c3-4edb-84a9-027b8a05f3a7","Type":"ContainerStarted","Data":"694b6414a057a2b6ba6274ed6edcc5bce0853e4a9d93ab33b8c9cf7b967c5245"} Jul 06 21:13:00.665865 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:00.665804 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-89.ec2.internal" podStartSLOduration=1.66579041 podStartE2EDuration="1.66579041s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 21:12:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:13:00.665282778 +0000 UTC m=+3.612660784" watchObservedRunningTime="2026-07-06 21:13:00.66579041 +0000 UTC m=+3.613168412" Jul 06 21:13:01.090733 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:01.090627 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3a3548bd-1472-470c-bda5-a7c611571bea-metrics-certs\") pod \"network-metrics-daemon-w5754\" (UID: \"3a3548bd-1472-470c-bda5-a7c611571bea\") " pod="openshift-multus/network-metrics-daemon-w5754" Jul 06 21:13:01.090899 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:13:01.090802 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 21:13:01.090899 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:13:01.090871 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a3548bd-1472-470c-bda5-a7c611571bea-metrics-certs podName:3a3548bd-1472-470c-bda5-a7c611571bea nodeName:}" failed. No retries permitted until 2026-07-06 21:13:03.090851199 +0000 UTC m=+6.038229191 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3a3548bd-1472-470c-bda5-a7c611571bea-metrics-certs") pod "network-metrics-daemon-w5754" (UID: "3a3548bd-1472-470c-bda5-a7c611571bea") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 21:13:01.192771 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:01.191819 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/55e17066-002e-4ebb-a6cb-e4be26f3383d-original-pull-secret\") pod \"global-pull-secret-syncer-xgv7v\" (UID: \"55e17066-002e-4ebb-a6cb-e4be26f3383d\") " pod="kube-system/global-pull-secret-syncer-xgv7v" Jul 06 21:13:01.192771 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:01.191926 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7kg9q\" (UniqueName: \"kubernetes.io/projected/c5dccb0b-1724-44ec-a683-c8a45526a11a-kube-api-access-7kg9q\") pod \"network-check-target-2vbd9\" (UID: \"c5dccb0b-1724-44ec-a683-c8a45526a11a\") " pod="openshift-network-diagnostics/network-check-target-2vbd9" Jul 06 21:13:01.192771 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:13:01.192109 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 21:13:01.192771 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:13:01.192129 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 21:13:01.192771 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:13:01.192145 2573 projected.go:196] Error preparing data for projected volume kube-api-access-7kg9q for pod openshift-network-diagnostics/network-check-target-2vbd9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 21:13:01.192771 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:13:01.192212 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c5dccb0b-1724-44ec-a683-c8a45526a11a-kube-api-access-7kg9q podName:c5dccb0b-1724-44ec-a683-c8a45526a11a nodeName:}" failed. No retries permitted until 2026-07-06 21:13:03.192188942 +0000 UTC m=+6.139566949 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-7kg9q" (UniqueName: "kubernetes.io/projected/c5dccb0b-1724-44ec-a683-c8a45526a11a-kube-api-access-7kg9q") pod "network-check-target-2vbd9" (UID: "c5dccb0b-1724-44ec-a683-c8a45526a11a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 21:13:01.192771 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:13:01.192671 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 21:13:01.192771 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:13:01.192727 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/55e17066-002e-4ebb-a6cb-e4be26f3383d-original-pull-secret podName:55e17066-002e-4ebb-a6cb-e4be26f3383d nodeName:}" failed. No retries permitted until 2026-07-06 21:13:03.192710405 +0000 UTC m=+6.140088406 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/55e17066-002e-4ebb-a6cb-e4be26f3383d-original-pull-secret") pod "global-pull-secret-syncer-xgv7v" (UID: "55e17066-002e-4ebb-a6cb-e4be26f3383d") : object "kube-system"/"original-pull-secret" not registered Jul 06 21:13:01.505746 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:01.505619 2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 21:08:00 +0000 UTC" deadline="2028-01-21 10:44:55.350401692 +0000 UTC" Jul 06 21:13:01.505746 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:01.505690 2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13525h31m53.844716507s" Jul 06 21:13:01.639532 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:01.639495 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2vbd9" Jul 06 21:13:01.639723 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:13:01.639640 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2vbd9" podUID="c5dccb0b-1724-44ec-a683-c8a45526a11a" Jul 06 21:13:01.640098 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:01.640075 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w5754" Jul 06 21:13:01.640233 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:13:01.640208 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w5754" podUID="3a3548bd-1472-470c-bda5-a7c611571bea" Jul 06 21:13:01.679667 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:01.679624 2573 generic.go:356] "Generic (PLEG): container finished" podID="d6de1c22a7dc3a552ccd1cdfa31b202e" containerID="965172f8f5781dee7030e0a972b68254a79fdf64af98d7f07d508172a15482fa" exitCode=0 Jul 06 21:13:01.680685 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:01.680653 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-89.ec2.internal" event={"ID":"d6de1c22a7dc3a552ccd1cdfa31b202e","Type":"ContainerDied","Data":"965172f8f5781dee7030e0a972b68254a79fdf64af98d7f07d508172a15482fa"} Jul 06 21:13:02.636450 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:02.636096 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xgv7v" Jul 06 21:13:02.636450 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:13:02.636290 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xgv7v" podUID="55e17066-002e-4ebb-a6cb-e4be26f3383d" Jul 06 21:13:02.715167 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:02.715118 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-89.ec2.internal" event={"ID":"d6de1c22a7dc3a552ccd1cdfa31b202e","Type":"ContainerStarted","Data":"4d660e194c6e92bf8a19c7968703d6381986a81a070739c249f1cdb85025cef0"} Jul 06 21:13:02.734638 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:02.734564 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-89.ec2.internal" podStartSLOduration=3.73453748 podStartE2EDuration="3.73453748s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 21:12:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:13:02.733535396 +0000 UTC m=+5.680913406" watchObservedRunningTime="2026-07-06 21:13:02.73453748 +0000 UTC m=+5.681915480" Jul 06 21:13:03.110756 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:03.110685 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3a3548bd-1472-470c-bda5-a7c611571bea-metrics-certs\") pod \"network-metrics-daemon-w5754\" (UID: \"3a3548bd-1472-470c-bda5-a7c611571bea\") " pod="openshift-multus/network-metrics-daemon-w5754" Jul 06 21:13:03.111018 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:13:03.110993 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 21:13:03.111231 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:13:03.111215 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a3548bd-1472-470c-bda5-a7c611571bea-metrics-certs podName:3a3548bd-1472-470c-bda5-a7c611571bea nodeName:}" failed. No retries permitted until 2026-07-06 21:13:07.111191673 +0000 UTC m=+10.058569673 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3a3548bd-1472-470c-bda5-a7c611571bea-metrics-certs") pod "network-metrics-daemon-w5754" (UID: "3a3548bd-1472-470c-bda5-a7c611571bea") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 21:13:03.211759 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:03.211716 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7kg9q\" (UniqueName: \"kubernetes.io/projected/c5dccb0b-1724-44ec-a683-c8a45526a11a-kube-api-access-7kg9q\") pod \"network-check-target-2vbd9\" (UID: \"c5dccb0b-1724-44ec-a683-c8a45526a11a\") " pod="openshift-network-diagnostics/network-check-target-2vbd9" Jul 06 21:13:03.211942 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:03.211796 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/55e17066-002e-4ebb-a6cb-e4be26f3383d-original-pull-secret\") pod \"global-pull-secret-syncer-xgv7v\" (UID: \"55e17066-002e-4ebb-a6cb-e4be26f3383d\") " pod="kube-system/global-pull-secret-syncer-xgv7v" Jul 06 21:13:03.212020 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:13:03.211966 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 21:13:03.212094 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:13:03.212041 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/55e17066-002e-4ebb-a6cb-e4be26f3383d-original-pull-secret podName:55e17066-002e-4ebb-a6cb-e4be26f3383d nodeName:}" failed. No retries permitted until 2026-07-06 21:13:07.212017708 +0000 UTC m=+10.159395715 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/55e17066-002e-4ebb-a6cb-e4be26f3383d-original-pull-secret") pod "global-pull-secret-syncer-xgv7v" (UID: "55e17066-002e-4ebb-a6cb-e4be26f3383d") : object "kube-system"/"original-pull-secret" not registered Jul 06 21:13:03.212542 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:13:03.212519 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 21:13:03.212656 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:13:03.212551 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 21:13:03.212656 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:13:03.212565 2573 projected.go:196] Error preparing data for projected volume kube-api-access-7kg9q for pod openshift-network-diagnostics/network-check-target-2vbd9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 21:13:03.212656 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:13:03.212616 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c5dccb0b-1724-44ec-a683-c8a45526a11a-kube-api-access-7kg9q podName:c5dccb0b-1724-44ec-a683-c8a45526a11a nodeName:}" failed. No retries permitted until 2026-07-06 21:13:07.212599591 +0000 UTC m=+10.159977576 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-7kg9q" (UniqueName: "kubernetes.io/projected/c5dccb0b-1724-44ec-a683-c8a45526a11a-kube-api-access-7kg9q") pod "network-check-target-2vbd9" (UID: "c5dccb0b-1724-44ec-a683-c8a45526a11a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 21:13:03.637523 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:03.637463 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w5754" Jul 06 21:13:03.637523 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:03.637507 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2vbd9" Jul 06 21:13:03.638107 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:13:03.637622 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w5754" podUID="3a3548bd-1472-470c-bda5-a7c611571bea" Jul 06 21:13:03.638107 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:13:03.637738 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2vbd9" podUID="c5dccb0b-1724-44ec-a683-c8a45526a11a" Jul 06 21:13:04.636979 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:04.636942 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xgv7v" Jul 06 21:13:04.637169 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:13:04.637100 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xgv7v" podUID="55e17066-002e-4ebb-a6cb-e4be26f3383d" Jul 06 21:13:05.638938 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:05.638397 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2vbd9" Jul 06 21:13:05.638938 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:13:05.638527 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2vbd9" podUID="c5dccb0b-1724-44ec-a683-c8a45526a11a" Jul 06 21:13:05.639760 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:05.639581 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w5754" Jul 06 21:13:05.639760 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:13:05.639702 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w5754" podUID="3a3548bd-1472-470c-bda5-a7c611571bea" Jul 06 21:13:06.636732 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:06.636689 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xgv7v" Jul 06 21:13:06.637014 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:13:06.636817 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xgv7v" podUID="55e17066-002e-4ebb-a6cb-e4be26f3383d" Jul 06 21:13:07.151752 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:07.151061 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3a3548bd-1472-470c-bda5-a7c611571bea-metrics-certs\") pod \"network-metrics-daemon-w5754\" (UID: \"3a3548bd-1472-470c-bda5-a7c611571bea\") " pod="openshift-multus/network-metrics-daemon-w5754" Jul 06 21:13:07.151752 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:13:07.151291 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 21:13:07.151752 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:13:07.151371 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a3548bd-1472-470c-bda5-a7c611571bea-metrics-certs podName:3a3548bd-1472-470c-bda5-a7c611571bea nodeName:}" failed. No retries permitted until 2026-07-06 21:13:15.15135019 +0000 UTC m=+18.098728174 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3a3548bd-1472-470c-bda5-a7c611571bea-metrics-certs") pod "network-metrics-daemon-w5754" (UID: "3a3548bd-1472-470c-bda5-a7c611571bea") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 21:13:07.252095 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:07.251803 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7kg9q\" (UniqueName: \"kubernetes.io/projected/c5dccb0b-1724-44ec-a683-c8a45526a11a-kube-api-access-7kg9q\") pod \"network-check-target-2vbd9\" (UID: \"c5dccb0b-1724-44ec-a683-c8a45526a11a\") " pod="openshift-network-diagnostics/network-check-target-2vbd9" Jul 06 21:13:07.252095 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:07.251860 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/55e17066-002e-4ebb-a6cb-e4be26f3383d-original-pull-secret\") pod \"global-pull-secret-syncer-xgv7v\" (UID: \"55e17066-002e-4ebb-a6cb-e4be26f3383d\") " pod="kube-system/global-pull-secret-syncer-xgv7v" Jul 06 21:13:07.252095 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:13:07.251963 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 21:13:07.252095 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:13:07.251983 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 21:13:07.252095 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:13:07.252005 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 21:13:07.252095 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:13:07.252018 2573 projected.go:196] Error preparing data for projected volume kube-api-access-7kg9q for pod openshift-network-diagnostics/network-check-target-2vbd9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 21:13:07.252095 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:13:07.252034 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/55e17066-002e-4ebb-a6cb-e4be26f3383d-original-pull-secret podName:55e17066-002e-4ebb-a6cb-e4be26f3383d nodeName:}" failed. No retries permitted until 2026-07-06 21:13:15.252011858 +0000 UTC m=+18.199389861 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/55e17066-002e-4ebb-a6cb-e4be26f3383d-original-pull-secret") pod "global-pull-secret-syncer-xgv7v" (UID: "55e17066-002e-4ebb-a6cb-e4be26f3383d") : object "kube-system"/"original-pull-secret" not registered Jul 06 21:13:07.252095 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:13:07.252056 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c5dccb0b-1724-44ec-a683-c8a45526a11a-kube-api-access-7kg9q podName:c5dccb0b-1724-44ec-a683-c8a45526a11a nodeName:}" failed. No retries permitted until 2026-07-06 21:13:15.252043224 +0000 UTC m=+18.199421217 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-7kg9q" (UniqueName: "kubernetes.io/projected/c5dccb0b-1724-44ec-a683-c8a45526a11a-kube-api-access-7kg9q") pod "network-check-target-2vbd9" (UID: "c5dccb0b-1724-44ec-a683-c8a45526a11a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 21:13:07.636920 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:07.636834 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w5754" Jul 06 21:13:07.638209 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:13:07.638169 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w5754" podUID="3a3548bd-1472-470c-bda5-a7c611571bea" Jul 06 21:13:07.638658 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:07.638634 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2vbd9" Jul 06 21:13:07.638782 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:13:07.638757 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2vbd9" podUID="c5dccb0b-1724-44ec-a683-c8a45526a11a" Jul 06 21:13:08.636120 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:08.636085 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xgv7v" Jul 06 21:13:08.636630 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:13:08.636233 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xgv7v" podUID="55e17066-002e-4ebb-a6cb-e4be26f3383d" Jul 06 21:13:09.636537 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:09.636499 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w5754" Jul 06 21:13:09.637076 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:13:09.636606 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w5754" podUID="3a3548bd-1472-470c-bda5-a7c611571bea" Jul 06 21:13:09.637076 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:09.636499 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2vbd9" Jul 06 21:13:09.637076 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:13:09.636671 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2vbd9" podUID="c5dccb0b-1724-44ec-a683-c8a45526a11a" Jul 06 21:13:10.636652 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:10.636616 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xgv7v" Jul 06 21:13:10.637140 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:13:10.636744 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xgv7v" podUID="55e17066-002e-4ebb-a6cb-e4be26f3383d" Jul 06 21:13:11.636736 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:11.636668 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2vbd9" Jul 06 21:13:11.636736 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:11.636697 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w5754" Jul 06 21:13:11.637268 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:13:11.636795 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2vbd9" podUID="c5dccb0b-1724-44ec-a683-c8a45526a11a" Jul 06 21:13:11.637325 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:13:11.637290 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w5754" podUID="3a3548bd-1472-470c-bda5-a7c611571bea" Jul 06 21:13:12.636346 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:12.636313 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xgv7v" Jul 06 21:13:12.636555 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:13:12.636462 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xgv7v" podUID="55e17066-002e-4ebb-a6cb-e4be26f3383d" Jul 06 21:13:13.636470 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:13.636430 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w5754" Jul 06 21:13:13.636933 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:13.636479 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2vbd9" Jul 06 21:13:13.636933 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:13:13.636583 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w5754" podUID="3a3548bd-1472-470c-bda5-a7c611571bea" Jul 06 21:13:13.636933 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:13:13.636707 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2vbd9" podUID="c5dccb0b-1724-44ec-a683-c8a45526a11a" Jul 06 21:13:14.636034 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:14.635994 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xgv7v" Jul 06 21:13:14.636219 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:13:14.636118 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xgv7v" podUID="55e17066-002e-4ebb-a6cb-e4be26f3383d" Jul 06 21:13:15.211419 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:15.211386 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3a3548bd-1472-470c-bda5-a7c611571bea-metrics-certs\") pod \"network-metrics-daemon-w5754\" (UID: \"3a3548bd-1472-470c-bda5-a7c611571bea\") " pod="openshift-multus/network-metrics-daemon-w5754" Jul 06 21:13:15.211770 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:13:15.211564 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 21:13:15.211770 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:13:15.211650 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a3548bd-1472-470c-bda5-a7c611571bea-metrics-certs podName:3a3548bd-1472-470c-bda5-a7c611571bea nodeName:}" failed. No retries permitted until 2026-07-06 21:13:31.211627645 +0000 UTC m=+34.159005638 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3a3548bd-1472-470c-bda5-a7c611571bea-metrics-certs") pod "network-metrics-daemon-w5754" (UID: "3a3548bd-1472-470c-bda5-a7c611571bea") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 21:13:15.312337 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:15.312290 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7kg9q\" (UniqueName: \"kubernetes.io/projected/c5dccb0b-1724-44ec-a683-c8a45526a11a-kube-api-access-7kg9q\") pod \"network-check-target-2vbd9\" (UID: \"c5dccb0b-1724-44ec-a683-c8a45526a11a\") " pod="openshift-network-diagnostics/network-check-target-2vbd9" Jul 06 21:13:15.312516 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:15.312411 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/55e17066-002e-4ebb-a6cb-e4be26f3383d-original-pull-secret\") pod \"global-pull-secret-syncer-xgv7v\" (UID: \"55e17066-002e-4ebb-a6cb-e4be26f3383d\") " pod="kube-system/global-pull-secret-syncer-xgv7v" Jul 06 21:13:15.312823 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:13:15.312794 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 21:13:15.312823 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:13:15.312825 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 21:13:15.312969 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:13:15.312855 2573 projected.go:196] Error preparing data for projected volume kube-api-access-7kg9q for pod openshift-network-diagnostics/network-check-target-2vbd9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 21:13:15.312969 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:13:15.312910 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c5dccb0b-1724-44ec-a683-c8a45526a11a-kube-api-access-7kg9q podName:c5dccb0b-1724-44ec-a683-c8a45526a11a nodeName:}" failed. No retries permitted until 2026-07-06 21:13:31.312895759 +0000 UTC m=+34.260273738 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-7kg9q" (UniqueName: "kubernetes.io/projected/c5dccb0b-1724-44ec-a683-c8a45526a11a-kube-api-access-7kg9q") pod "network-check-target-2vbd9" (UID: "c5dccb0b-1724-44ec-a683-c8a45526a11a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 21:13:15.312969 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:13:15.312825 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 21:13:15.313156 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:13:15.312991 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/55e17066-002e-4ebb-a6cb-e4be26f3383d-original-pull-secret podName:55e17066-002e-4ebb-a6cb-e4be26f3383d nodeName:}" failed. No retries permitted until 2026-07-06 21:13:31.312972224 +0000 UTC m=+34.260350207 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/55e17066-002e-4ebb-a6cb-e4be26f3383d-original-pull-secret") pod "global-pull-secret-syncer-xgv7v" (UID: "55e17066-002e-4ebb-a6cb-e4be26f3383d") : object "kube-system"/"original-pull-secret" not registered Jul 06 21:13:15.637149 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:15.637118 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2vbd9" Jul 06 21:13:15.637340 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:15.637118 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w5754" Jul 06 21:13:15.637340 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:13:15.637255 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2vbd9" podUID="c5dccb0b-1724-44ec-a683-c8a45526a11a" Jul 06 21:13:15.637488 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:13:15.637363 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w5754" podUID="3a3548bd-1472-470c-bda5-a7c611571bea" Jul 06 21:13:16.636041 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:16.636003 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xgv7v" Jul 06 21:13:16.636530 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:13:16.636140 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xgv7v" podUID="55e17066-002e-4ebb-a6cb-e4be26f3383d" Jul 06 21:13:17.638449 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:17.637912 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w5754" Jul 06 21:13:17.638449 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:17.637963 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2vbd9" Jul 06 21:13:17.638449 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:13:17.638048 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w5754" podUID="3a3548bd-1472-470c-bda5-a7c611571bea" Jul 06 21:13:17.638449 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:13:17.638190 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2vbd9" podUID="c5dccb0b-1724-44ec-a683-c8a45526a11a" Jul 06 21:13:18.636440 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:18.636403 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xgv7v" Jul 06 21:13:18.636592 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:13:18.636544 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xgv7v" podUID="55e17066-002e-4ebb-a6cb-e4be26f3383d" Jul 06 21:13:19.636666 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:19.636626 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w5754" Jul 06 21:13:19.637119 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:13:19.636741 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w5754" podUID="3a3548bd-1472-470c-bda5-a7c611571bea" Jul 06 21:13:19.637119 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:19.636821 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2vbd9" Jul 06 21:13:19.637119 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:13:19.636944 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2vbd9" podUID="c5dccb0b-1724-44ec-a683-c8a45526a11a" Jul 06 21:13:20.637465 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:20.636918 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xgv7v" Jul 06 21:13:20.638191 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:13:20.637517 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xgv7v" podUID="55e17066-002e-4ebb-a6cb-e4be26f3383d" Jul 06 21:13:20.764884 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:20.764846 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-4rqvd" event={"ID":"f4aa139a-9e46-4075-8358-6da2c8f30cec","Type":"ContainerStarted","Data":"7881b3d31bf68d3e1ad22cba02e2a4da9600930156c7269f80c19c65f94ccce8"} Jul 06 21:13:20.766669 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:20.766627 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-sshnw" event={"ID":"9130a04b-36d5-4e3a-ab77-2c9791b9cdd7","Type":"ContainerStarted","Data":"d870c1d44edf8370c58230a9dd7cd9c217dbe44139e31d228c81de751d9f9ecc"} Jul 06 21:13:20.770146 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:20.770120 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5s6d9_e122448a-d2e4-4fec-a918-3d3eecb175a4/ovn-acl-logging/0.log" Jul 06 21:13:20.770551 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:20.770517 2573 generic.go:356] "Generic (PLEG): container finished" podID="e122448a-d2e4-4fec-a918-3d3eecb175a4" containerID="f32dcf2edf31687d6847439da121e662014124d02f052338a5d66a0dd891a7c8" exitCode=1 Jul 06 21:13:20.770678 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:20.770619 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5s6d9" event={"ID":"e122448a-d2e4-4fec-a918-3d3eecb175a4","Type":"ContainerStarted","Data":"a6fa272178888a840835f46eff72d8937e9c829e2e141d9c08a624ea8a93a0a7"} Jul 06 21:13:20.770733 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:20.770698 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5s6d9" event={"ID":"e122448a-d2e4-4fec-a918-3d3eecb175a4","Type":"ContainerStarted","Data":"47eebf500b2e8740297c0e910093d91aaca8138d887ee99553457468c8cb7e6d"} Jul 06 21:13:20.770768 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:20.770750 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5s6d9" event={"ID":"e122448a-d2e4-4fec-a918-3d3eecb175a4","Type":"ContainerStarted","Data":"915ec5723dfedb7f9e66d259f378be2740ba0b256a7a017086344a1cb53531d4"} Jul 06 21:13:20.770828 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:20.770793 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5s6d9" event={"ID":"e122448a-d2e4-4fec-a918-3d3eecb175a4","Type":"ContainerStarted","Data":"dce503b2d3eb428668a31365d88c05d5d018e0ec7ee995cf8a22fa120113edb1"} Jul 06 21:13:20.770944 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:20.770852 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5s6d9" event={"ID":"e122448a-d2e4-4fec-a918-3d3eecb175a4","Type":"ContainerDied","Data":"f32dcf2edf31687d6847439da121e662014124d02f052338a5d66a0dd891a7c8"} Jul 06 21:13:20.770944 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:20.770898 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5s6d9" event={"ID":"e122448a-d2e4-4fec-a918-3d3eecb175a4","Type":"ContainerStarted","Data":"1c611301fc8d7ea31493b0416c32839fa578d2ef849dc2ebce447988bca18a2c"} Jul 06 21:13:20.772278 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:20.772258 2573 generic.go:356] "Generic (PLEG): container finished" podID="83297255-f507-48e1-80d6-6c8b9d5e1a81" containerID="398fad6da30a92dd803042c245f47ae4b38961feca6bdb3efbe135dc47e5ed28" exitCode=0 Jul 06 21:13:20.772372 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:20.772282 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l26xp" event={"ID":"83297255-f507-48e1-80d6-6c8b9d5e1a81","Type":"ContainerDied","Data":"398fad6da30a92dd803042c245f47ae4b38961feca6bdb3efbe135dc47e5ed28"} Jul 06 21:13:20.773984 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:20.773959 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-4hcwd" event={"ID":"d3b41b14-af75-441a-aa29-61d90ead4d44","Type":"ContainerStarted","Data":"02a33b85cec83e42e488a1eb2ec9c8f55cdf3e199dc308a53782a66634a49179"} Jul 06 21:13:20.775694 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:20.775639 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-nkqqw" event={"ID":"38c684b6-68c3-4edb-84a9-027b8a05f3a7","Type":"ContainerStarted","Data":"5741443d6c1b4bf7d4df66aae590de261ea80eace8468b3aebac88ec607e406d"} Jul 06 21:13:20.777293 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:20.777257 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9fllz" event={"ID":"75526115-8ac3-429e-a883-ed7bf4193923","Type":"ContainerStarted","Data":"7d3f3a79b0a71cafefa8226eb16e3d00cd46a3919eb1e5b17eee5572a70909ff"} Jul 06 21:13:20.778689 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:20.778664 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-tdbzc" event={"ID":"e7ec46bc-523f-4480-9245-42931eac113a","Type":"ContainerStarted","Data":"90fd6138f0e247037d872459796bb0b77a746be126954944f0f97abd900547f5"} Jul 06 21:13:20.784554 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:20.784511 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-4rqvd" podStartSLOduration=3.621650797 podStartE2EDuration="22.78449242s" totalImagesPullingTime="19.162841623s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 21:12:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:13:20.783838879 +0000 UTC m=+23.731216885" watchObservedRunningTime="2026-07-06 21:13:20.78449242 +0000 UTC m=+23.731870424" Jul 06 21:13:20.803855 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:20.803795 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-tdbzc" podStartSLOduration=3.6128321039999998 podStartE2EDuration="22.803774178s" totalImagesPullingTime="19.190942074s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 21:12:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:13:20.803338148 +0000 UTC m=+23.750716151" watchObservedRunningTime="2026-07-06 21:13:20.803774178 +0000 UTC m=+23.751152181" Jul 06 21:13:20.822783 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:20.822728 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-nkqqw" podStartSLOduration=3.663049109 podStartE2EDuration="22.822712083s" totalImagesPullingTime="19.159662974s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:12:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:13:20.822071296 +0000 UTC m=+23.769449300" watchObservedRunningTime="2026-07-06 21:13:20.822712083 +0000 UTC m=+23.770090085" Jul 06 21:13:20.840431 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:20.840370 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-4hcwd" podStartSLOduration=3.635755215 podStartE2EDuration="22.84035477s" totalImagesPullingTime="19.204599555s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 21:12:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:13:20.839969589 +0000 UTC m=+23.787347593" watchObservedRunningTime="2026-07-06 21:13:20.84035477 +0000 UTC m=+23.787732772" Jul 06 21:13:20.993185 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:20.993107 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nkqqw_38c684b6-68c3-4edb-84a9-027b8a05f3a7/konnectivity-agent/0.log" limit=1024 Jul 06 21:13:21.060076 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:21.060042 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nkqqw_38c684b6-68c3-4edb-84a9-027b8a05f3a7/konnectivity-agent/0.log" limit=1024 Jul 06 21:13:21.231723 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:21.231694 2573 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 06 21:13:21.530821 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:21.530681 2573 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-06T21:13:21.231716091Z","UUID":"b104f9ad-6c17-41e8-b8fa-7e5e125bc16b","Handler":null,"Name":"","Endpoint":""} Jul 06 21:13:21.532179 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:21.532157 2573 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 06 21:13:21.532348 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:21.532201 2573 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 06 21:13:21.636195 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:21.636164 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w5754" Jul 06 21:13:21.636373 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:21.636160 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2vbd9" Jul 06 21:13:21.636451 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:13:21.636322 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w5754" podUID="3a3548bd-1472-470c-bda5-a7c611571bea" Jul 06 21:13:21.636451 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:13:21.636434 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2vbd9" podUID="c5dccb0b-1724-44ec-a683-c8a45526a11a" Jul 06 21:13:21.784495 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:21.784449 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9fllz" event={"ID":"75526115-8ac3-429e-a883-ed7bf4193923","Type":"ContainerStarted","Data":"9dfa122560f728040c86d0e1883401ace8060d02cbb836f7c78eaad0bbc2d476"} Jul 06 21:13:21.786367 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:21.786334 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-vzzd6" event={"ID":"4e3cec7e-a502-4807-9070-4ded3cc4727e","Type":"ContainerStarted","Data":"39cf62d923150627d0fa98eacb4e4535c79dc4524591bde6ec2decfc63830a11"} Jul 06 21:13:21.801636 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:21.801574 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-sshnw" podStartSLOduration=4.636506192 podStartE2EDuration="23.801551454s" totalImagesPullingTime="19.165045262s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 21:12:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:13:20.910532756 +0000 UTC m=+23.857910758" watchObservedRunningTime="2026-07-06 21:13:21.801551454 +0000 UTC m=+24.748929458" Jul 06 21:13:21.801848 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:21.801817 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-vzzd6" podStartSLOduration=4.619329872 podStartE2EDuration="23.801804864s" totalImagesPullingTime="19.182474992s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 21:12:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:13:21.801130283 +0000 UTC m=+24.748508288" watchObservedRunningTime="2026-07-06 21:13:21.801804864 +0000 UTC m=+24.749182869" Jul 06 21:13:22.245031 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:22.244992 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-nkqqw" Jul 06 21:13:22.245891 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:22.245867 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-nkqqw" Jul 06 21:13:22.636505 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:22.636476 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xgv7v" Jul 06 21:13:22.636685 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:13:22.636592 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xgv7v" podUID="55e17066-002e-4ebb-a6cb-e4be26f3383d" Jul 06 21:13:22.792731 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:22.792697 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5s6d9_e122448a-d2e4-4fec-a918-3d3eecb175a4/ovn-acl-logging/0.log" Jul 06 21:13:22.793699 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:22.793662 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5s6d9" event={"ID":"e122448a-d2e4-4fec-a918-3d3eecb175a4","Type":"ContainerStarted","Data":"310b0c72a0ef936f44325c0c09bcca9fe493681888fab7a91e90535980b86905"} Jul 06 21:13:22.796366 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:22.796339 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9fllz" event={"ID":"75526115-8ac3-429e-a883-ed7bf4193923","Type":"ContainerStarted","Data":"293c62a3cd5f8dca2bf9621eb19a0daff0246a706ca3b7d01966fa8787e56419"} Jul 06 21:13:22.796590 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:22.796574 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-nkqqw" Jul 06 21:13:22.797047 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:22.797031 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-nkqqw" Jul 06 21:13:22.819917 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:22.819851 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9fllz" podStartSLOduration=3.560431377 podStartE2EDuration="24.81983025s" totalImagesPullingTime="21.259398873s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 21:12:58 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:13:22.818893757 +0000 UTC m=+25.766271760" watchObservedRunningTime="2026-07-06 21:13:22.81983025 +0000 UTC m=+25.767208253" Jul 06 21:13:23.636694 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:23.636497 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w5754" Jul 06 21:13:23.636860 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:23.636521 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2vbd9" Jul 06 21:13:23.636860 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:13:23.636806 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w5754" podUID="3a3548bd-1472-470c-bda5-a7c611571bea" Jul 06 21:13:23.636980 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:13:23.636898 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2vbd9" podUID="c5dccb0b-1724-44ec-a683-c8a45526a11a" Jul 06 21:13:24.636060 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:24.636031 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xgv7v" Jul 06 21:13:24.636635 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:13:24.636152 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xgv7v" podUID="55e17066-002e-4ebb-a6cb-e4be26f3383d" Jul 06 21:13:24.805633 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:24.805604 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5s6d9_e122448a-d2e4-4fec-a918-3d3eecb175a4/ovn-acl-logging/0.log" Jul 06 21:13:24.806468 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:24.805985 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5s6d9" event={"ID":"e122448a-d2e4-4fec-a918-3d3eecb175a4","Type":"ContainerStarted","Data":"9f606d5b2fcf97d83df4e9e554852b38fa2f34d216cf55a5829366da99a046f1"} Jul 06 21:13:24.806468 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:24.806262 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5s6d9" Jul 06 21:13:24.806468 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:24.806317 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5s6d9" Jul 06 21:13:24.806725 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:24.806476 2573 scope.go:117] "RemoveContainer" containerID="f32dcf2edf31687d6847439da121e662014124d02f052338a5d66a0dd891a7c8" Jul 06 21:13:24.810019 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:24.809731 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l26xp" event={"ID":"83297255-f507-48e1-80d6-6c8b9d5e1a81","Type":"ContainerStarted","Data":"1958b0d444ca9f91b39223665c0f5f1a3e4617089b6642e9f1d7b0281289072e"} Jul 06 21:13:24.825432 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:24.825402 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5s6d9" Jul 06 21:13:24.826574 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:24.826551 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5s6d9" Jul 06 21:13:25.636544 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:25.636506 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w5754" Jul 06 21:13:25.637123 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:25.636559 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2vbd9" Jul 06 21:13:25.637123 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:13:25.636694 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w5754" podUID="3a3548bd-1472-470c-bda5-a7c611571bea" Jul 06 21:13:25.637123 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:13:25.636794 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2vbd9" podUID="c5dccb0b-1724-44ec-a683-c8a45526a11a" Jul 06 21:13:25.815535 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:25.815507 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5s6d9_e122448a-d2e4-4fec-a918-3d3eecb175a4/ovn-acl-logging/0.log" Jul 06 21:13:25.815916 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:25.815887 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5s6d9" event={"ID":"e122448a-d2e4-4fec-a918-3d3eecb175a4","Type":"ContainerStarted","Data":"59201490e36fa809a92bce545458b34205c862de7836aa7ebff32684e43f7326"} Jul 06 21:13:25.815987 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:25.815952 2573 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 06 21:13:25.817620 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:25.817594 2573 generic.go:356] "Generic (PLEG): container finished" podID="83297255-f507-48e1-80d6-6c8b9d5e1a81" containerID="1958b0d444ca9f91b39223665c0f5f1a3e4617089b6642e9f1d7b0281289072e" exitCode=0 Jul 06 21:13:25.817742 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:25.817656 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l26xp" event={"ID":"83297255-f507-48e1-80d6-6c8b9d5e1a81","Type":"ContainerDied","Data":"1958b0d444ca9f91b39223665c0f5f1a3e4617089b6642e9f1d7b0281289072e"} Jul 06 21:13:25.831933 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:25.831904 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5s6d9" Jul 06 21:13:25.846826 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:25.846772 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-5s6d9" podStartSLOduration=8.625739774 podStartE2EDuration="27.846757069s" totalImagesPullingTime="19.221017295s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 21:12:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:13:25.844953375 +0000 UTC m=+28.792331379" watchObservedRunningTime="2026-07-06 21:13:25.846757069 +0000 UTC m=+28.794135070" Jul 06 21:13:26.636657 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:26.636615 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xgv7v" Jul 06 21:13:26.637040 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:13:26.636756 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xgv7v" podUID="55e17066-002e-4ebb-a6cb-e4be26f3383d" Jul 06 21:13:26.661664 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:26.661626 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-2vbd9"] Jul 06 21:13:26.661819 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:26.661775 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2vbd9" Jul 06 21:13:26.661908 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:13:26.661885 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2vbd9" podUID="c5dccb0b-1724-44ec-a683-c8a45526a11a" Jul 06 21:13:26.665455 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:26.665125 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-w5754"] Jul 06 21:13:26.665455 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:26.665284 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w5754" Jul 06 21:13:26.665455 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:13:26.665399 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w5754" podUID="3a3548bd-1472-470c-bda5-a7c611571bea" Jul 06 21:13:26.665885 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:26.665863 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-xgv7v"] Jul 06 21:13:26.822510 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:26.822474 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l26xp" event={"ID":"83297255-f507-48e1-80d6-6c8b9d5e1a81","Type":"ContainerStarted","Data":"15e0a5119eda1bbc7350480f51c9252e88b5e843c5d73391f62cf2cd36999309"} Jul 06 21:13:26.822636 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:26.822616 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xgv7v" Jul 06 21:13:26.822741 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:13:26.822719 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xgv7v" podUID="55e17066-002e-4ebb-a6cb-e4be26f3383d" Jul 06 21:13:27.826184 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:27.826148 2573 generic.go:356] "Generic (PLEG): container finished" podID="83297255-f507-48e1-80d6-6c8b9d5e1a81" containerID="15e0a5119eda1bbc7350480f51c9252e88b5e843c5d73391f62cf2cd36999309" exitCode=0 Jul 06 21:13:27.826587 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:27.826189 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l26xp" event={"ID":"83297255-f507-48e1-80d6-6c8b9d5e1a81","Type":"ContainerDied","Data":"15e0a5119eda1bbc7350480f51c9252e88b5e843c5d73391f62cf2cd36999309"} Jul 06 21:13:28.637000 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:28.636974 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w5754" Jul 06 21:13:28.637122 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:28.637014 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2vbd9" Jul 06 21:13:28.637122 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:28.637070 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xgv7v" Jul 06 21:13:28.637122 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:13:28.637080 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w5754" podUID="3a3548bd-1472-470c-bda5-a7c611571bea" Jul 06 21:13:28.637281 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:13:28.637166 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xgv7v" podUID="55e17066-002e-4ebb-a6cb-e4be26f3383d" Jul 06 21:13:28.637323 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:13:28.637274 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2vbd9" podUID="c5dccb0b-1724-44ec-a683-c8a45526a11a" Jul 06 21:13:28.831332 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:28.831225 2573 generic.go:356] "Generic (PLEG): container finished" podID="83297255-f507-48e1-80d6-6c8b9d5e1a81" containerID="7819df0caef8094ec5191694d7d0cac7a79ad8f1de6dec87b52a4424fc580579" exitCode=0 Jul 06 21:13:28.831332 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:28.831301 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l26xp" event={"ID":"83297255-f507-48e1-80d6-6c8b9d5e1a81","Type":"ContainerDied","Data":"7819df0caef8094ec5191694d7d0cac7a79ad8f1de6dec87b52a4424fc580579"} Jul 06 21:13:30.636522 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:30.636486 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xgv7v" Jul 06 21:13:30.636522 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:30.636522 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2vbd9" Jul 06 21:13:30.637272 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:30.636490 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w5754" Jul 06 21:13:30.637272 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:13:30.636618 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xgv7v" podUID="55e17066-002e-4ebb-a6cb-e4be26f3383d" Jul 06 21:13:30.637272 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:13:30.636706 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2vbd9" podUID="c5dccb0b-1724-44ec-a683-c8a45526a11a" Jul 06 21:13:30.637272 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:13:30.636798 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w5754" podUID="3a3548bd-1472-470c-bda5-a7c611571bea" Jul 06 21:13:31.223483 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:31.223442 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3a3548bd-1472-470c-bda5-a7c611571bea-metrics-certs\") pod \"network-metrics-daemon-w5754\" (UID: \"3a3548bd-1472-470c-bda5-a7c611571bea\") " pod="openshift-multus/network-metrics-daemon-w5754" Jul 06 21:13:31.223716 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:13:31.223602 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 21:13:31.223716 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:13:31.223673 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a3548bd-1472-470c-bda5-a7c611571bea-metrics-certs podName:3a3548bd-1472-470c-bda5-a7c611571bea nodeName:}" failed. No retries permitted until 2026-07-06 21:14:03.223657195 +0000 UTC m=+66.171035180 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3a3548bd-1472-470c-bda5-a7c611571bea-metrics-certs") pod "network-metrics-daemon-w5754" (UID: "3a3548bd-1472-470c-bda5-a7c611571bea") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 21:13:31.324448 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:31.324414 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7kg9q\" (UniqueName: \"kubernetes.io/projected/c5dccb0b-1724-44ec-a683-c8a45526a11a-kube-api-access-7kg9q\") pod \"network-check-target-2vbd9\" (UID: \"c5dccb0b-1724-44ec-a683-c8a45526a11a\") " pod="openshift-network-diagnostics/network-check-target-2vbd9" Jul 06 21:13:31.324622 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:31.324466 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/55e17066-002e-4ebb-a6cb-e4be26f3383d-original-pull-secret\") pod \"global-pull-secret-syncer-xgv7v\" (UID: \"55e17066-002e-4ebb-a6cb-e4be26f3383d\") " pod="kube-system/global-pull-secret-syncer-xgv7v" Jul 06 21:13:31.324622 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:13:31.324588 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 21:13:31.324622 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:13:31.324602 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 21:13:31.324801 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:13:31.324629 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 21:13:31.324801 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:13:31.324642 2573 projected.go:196] Error preparing data for projected volume kube-api-access-7kg9q for pod openshift-network-diagnostics/network-check-target-2vbd9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 21:13:31.324801 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:13:31.324666 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/55e17066-002e-4ebb-a6cb-e4be26f3383d-original-pull-secret podName:55e17066-002e-4ebb-a6cb-e4be26f3383d nodeName:}" failed. No retries permitted until 2026-07-06 21:14:03.324650195 +0000 UTC m=+66.272028187 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/55e17066-002e-4ebb-a6cb-e4be26f3383d-original-pull-secret") pod "global-pull-secret-syncer-xgv7v" (UID: "55e17066-002e-4ebb-a6cb-e4be26f3383d") : object "kube-system"/"original-pull-secret" not registered Jul 06 21:13:31.324801 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:13:31.324723 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c5dccb0b-1724-44ec-a683-c8a45526a11a-kube-api-access-7kg9q podName:c5dccb0b-1724-44ec-a683-c8a45526a11a nodeName:}" failed. No retries permitted until 2026-07-06 21:14:03.324707737 +0000 UTC m=+66.272085731 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-7kg9q" (UniqueName: "kubernetes.io/projected/c5dccb0b-1724-44ec-a683-c8a45526a11a-kube-api-access-7kg9q") pod "network-check-target-2vbd9" (UID: "c5dccb0b-1724-44ec-a683-c8a45526a11a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 21:13:32.636564 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:32.636523 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xgv7v" Jul 06 21:13:32.636564 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:32.636571 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2vbd9" Jul 06 21:13:32.637229 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:32.636582 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w5754" Jul 06 21:13:32.637229 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:13:32.636672 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xgv7v" podUID="55e17066-002e-4ebb-a6cb-e4be26f3383d" Jul 06 21:13:32.637229 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:13:32.636774 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2vbd9" podUID="c5dccb0b-1724-44ec-a683-c8a45526a11a" Jul 06 21:13:32.637229 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:13:32.636889 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w5754" podUID="3a3548bd-1472-470c-bda5-a7c611571bea" Jul 06 21:13:32.797432 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:32.797407 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-89.ec2.internal" event="NodeReady" Jul 06 21:13:32.797591 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:32.797549 2573 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 06 21:13:32.839701 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:32.839662 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-b9fg2"] Jul 06 21:13:32.859710 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:32.859671 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-5qvhk"] Jul 06 21:13:32.859885 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:32.859811 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-b9fg2" Jul 06 21:13:32.862523 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:32.862495 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 06 21:13:32.862677 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:32.862635 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-45jgn\"" Jul 06 21:13:32.862677 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:32.862641 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 06 21:13:32.878815 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:32.878780 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-b9fg2"] Jul 06 21:13:32.878959 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:32.878835 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-5qvhk"] Jul 06 21:13:32.878959 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:32.878924 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-5qvhk" Jul 06 21:13:32.881632 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:32.881610 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 06 21:13:32.881787 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:32.881652 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 06 21:13:32.881787 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:32.881660 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-4j4jp\"" Jul 06 21:13:32.881787 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:32.881722 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 06 21:13:32.934525 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:32.934484 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f5mrr\" (UniqueName: \"kubernetes.io/projected/c910d322-60b9-4b57-a172-4751e6c8f186-kube-api-access-f5mrr\") pod \"dns-default-b9fg2\" (UID: \"c910d322-60b9-4b57-a172-4751e6c8f186\") " pod="openshift-dns/dns-default-b9fg2" Jul 06 21:13:32.934525 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:32.934528 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c910d322-60b9-4b57-a172-4751e6c8f186-metrics-tls\") pod \"dns-default-b9fg2\" (UID: \"c910d322-60b9-4b57-a172-4751e6c8f186\") " pod="openshift-dns/dns-default-b9fg2" Jul 06 21:13:32.934740 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:32.934564 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c910d322-60b9-4b57-a172-4751e6c8f186-tmp-dir\") pod \"dns-default-b9fg2\" (UID: \"c910d322-60b9-4b57-a172-4751e6c8f186\") " pod="openshift-dns/dns-default-b9fg2" Jul 06 21:13:32.934740 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:32.934608 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c910d322-60b9-4b57-a172-4751e6c8f186-config-volume\") pod \"dns-default-b9fg2\" (UID: \"c910d322-60b9-4b57-a172-4751e6c8f186\") " pod="openshift-dns/dns-default-b9fg2" Jul 06 21:13:33.035795 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:33.035760 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c910d322-60b9-4b57-a172-4751e6c8f186-metrics-tls\") pod \"dns-default-b9fg2\" (UID: \"c910d322-60b9-4b57-a172-4751e6c8f186\") " pod="openshift-dns/dns-default-b9fg2" Jul 06 21:13:33.035963 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:33.035807 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c910d322-60b9-4b57-a172-4751e6c8f186-tmp-dir\") pod \"dns-default-b9fg2\" (UID: \"c910d322-60b9-4b57-a172-4751e6c8f186\") " pod="openshift-dns/dns-default-b9fg2" Jul 06 21:13:33.035963 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:33.035836 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-72426\" (UniqueName: \"kubernetes.io/projected/5ccd93e4-2c62-426c-93af-da45c500e964-kube-api-access-72426\") pod \"ingress-canary-5qvhk\" (UID: \"5ccd93e4-2c62-426c-93af-da45c500e964\") " pod="openshift-ingress-canary/ingress-canary-5qvhk" Jul 06 21:13:33.035963 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:33.035889 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c910d322-60b9-4b57-a172-4751e6c8f186-config-volume\") pod \"dns-default-b9fg2\" (UID: \"c910d322-60b9-4b57-a172-4751e6c8f186\") " pod="openshift-dns/dns-default-b9fg2" Jul 06 21:13:33.035963 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:13:33.035915 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 21:13:33.035963 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:33.035917 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5ccd93e4-2c62-426c-93af-da45c500e964-cert\") pod \"ingress-canary-5qvhk\" (UID: \"5ccd93e4-2c62-426c-93af-da45c500e964\") " pod="openshift-ingress-canary/ingress-canary-5qvhk" Jul 06 21:13:33.036147 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:13:33.035996 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c910d322-60b9-4b57-a172-4751e6c8f186-metrics-tls podName:c910d322-60b9-4b57-a172-4751e6c8f186 nodeName:}" failed. No retries permitted until 2026-07-06 21:13:33.535979458 +0000 UTC m=+36.483357438 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c910d322-60b9-4b57-a172-4751e6c8f186-metrics-tls") pod "dns-default-b9fg2" (UID: "c910d322-60b9-4b57-a172-4751e6c8f186") : secret "dns-default-metrics-tls" not found Jul 06 21:13:33.036147 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:33.036068 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f5mrr\" (UniqueName: \"kubernetes.io/projected/c910d322-60b9-4b57-a172-4751e6c8f186-kube-api-access-f5mrr\") pod \"dns-default-b9fg2\" (UID: \"c910d322-60b9-4b57-a172-4751e6c8f186\") " pod="openshift-dns/dns-default-b9fg2" Jul 06 21:13:33.036226 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:33.036164 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c910d322-60b9-4b57-a172-4751e6c8f186-tmp-dir\") pod \"dns-default-b9fg2\" (UID: \"c910d322-60b9-4b57-a172-4751e6c8f186\") " pod="openshift-dns/dns-default-b9fg2" Jul 06 21:13:33.036484 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:33.036468 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c910d322-60b9-4b57-a172-4751e6c8f186-config-volume\") pod \"dns-default-b9fg2\" (UID: \"c910d322-60b9-4b57-a172-4751e6c8f186\") " pod="openshift-dns/dns-default-b9fg2" Jul 06 21:13:33.046189 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:33.046167 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f5mrr\" (UniqueName: \"kubernetes.io/projected/c910d322-60b9-4b57-a172-4751e6c8f186-kube-api-access-f5mrr\") pod \"dns-default-b9fg2\" (UID: \"c910d322-60b9-4b57-a172-4751e6c8f186\") " pod="openshift-dns/dns-default-b9fg2" Jul 06 21:13:33.136989 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:33.136950 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-72426\" (UniqueName: \"kubernetes.io/projected/5ccd93e4-2c62-426c-93af-da45c500e964-kube-api-access-72426\") pod \"ingress-canary-5qvhk\" (UID: \"5ccd93e4-2c62-426c-93af-da45c500e964\") " pod="openshift-ingress-canary/ingress-canary-5qvhk" Jul 06 21:13:33.137120 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:33.137044 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5ccd93e4-2c62-426c-93af-da45c500e964-cert\") pod \"ingress-canary-5qvhk\" (UID: \"5ccd93e4-2c62-426c-93af-da45c500e964\") " pod="openshift-ingress-canary/ingress-canary-5qvhk" Jul 06 21:13:33.140012 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:33.139983 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5ccd93e4-2c62-426c-93af-da45c500e964-cert\") pod \"ingress-canary-5qvhk\" (UID: \"5ccd93e4-2c62-426c-93af-da45c500e964\") " pod="openshift-ingress-canary/ingress-canary-5qvhk" Jul 06 21:13:33.146481 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:33.146419 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-72426\" (UniqueName: \"kubernetes.io/projected/5ccd93e4-2c62-426c-93af-da45c500e964-kube-api-access-72426\") pod \"ingress-canary-5qvhk\" (UID: \"5ccd93e4-2c62-426c-93af-da45c500e964\") " pod="openshift-ingress-canary/ingress-canary-5qvhk" Jul 06 21:13:33.188056 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:33.188029 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-5qvhk" Jul 06 21:13:33.415863 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:33.415676 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-5qvhk"] Jul 06 21:13:33.420404 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:13:33.420365 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ccd93e4_2c62_426c_93af_da45c500e964.slice/crio-39948c8b16a6f0d25292adca3643ea662b8a341bc28479310875a5ddfa33f9e0 WatchSource:0}: Error finding container 39948c8b16a6f0d25292adca3643ea662b8a341bc28479310875a5ddfa33f9e0: Status 404 returned error can't find the container with id 39948c8b16a6f0d25292adca3643ea662b8a341bc28479310875a5ddfa33f9e0 Jul 06 21:13:33.539775 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:33.539739 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c910d322-60b9-4b57-a172-4751e6c8f186-metrics-tls\") pod \"dns-default-b9fg2\" (UID: \"c910d322-60b9-4b57-a172-4751e6c8f186\") " pod="openshift-dns/dns-default-b9fg2" Jul 06 21:13:33.539951 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:13:33.539885 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 21:13:33.539997 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:13:33.539954 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c910d322-60b9-4b57-a172-4751e6c8f186-metrics-tls podName:c910d322-60b9-4b57-a172-4751e6c8f186 nodeName:}" failed. No retries permitted until 2026-07-06 21:13:34.539935091 +0000 UTC m=+37.487313070 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c910d322-60b9-4b57-a172-4751e6c8f186-metrics-tls") pod "dns-default-b9fg2" (UID: "c910d322-60b9-4b57-a172-4751e6c8f186") : secret "dns-default-metrics-tls" not found Jul 06 21:13:33.845317 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:33.845278 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-5qvhk" event={"ID":"5ccd93e4-2c62-426c-93af-da45c500e964","Type":"ContainerStarted","Data":"39948c8b16a6f0d25292adca3643ea662b8a341bc28479310875a5ddfa33f9e0"} Jul 06 21:13:33.848691 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:33.848658 2573 generic.go:356] "Generic (PLEG): container finished" podID="83297255-f507-48e1-80d6-6c8b9d5e1a81" containerID="7da0a570446e3898cdbf11606c3741bf097666f340fb68fc90ef162ae163dd56" exitCode=0 Jul 06 21:13:33.848854 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:33.848710 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l26xp" event={"ID":"83297255-f507-48e1-80d6-6c8b9d5e1a81","Type":"ContainerDied","Data":"7da0a570446e3898cdbf11606c3741bf097666f340fb68fc90ef162ae163dd56"} Jul 06 21:13:34.545884 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:34.545846 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c910d322-60b9-4b57-a172-4751e6c8f186-metrics-tls\") pod \"dns-default-b9fg2\" (UID: \"c910d322-60b9-4b57-a172-4751e6c8f186\") " pod="openshift-dns/dns-default-b9fg2" Jul 06 21:13:34.546075 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:13:34.546032 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 21:13:34.546134 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:13:34.546101 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c910d322-60b9-4b57-a172-4751e6c8f186-metrics-tls podName:c910d322-60b9-4b57-a172-4751e6c8f186 nodeName:}" failed. No retries permitted until 2026-07-06 21:13:36.546085953 +0000 UTC m=+39.493463938 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c910d322-60b9-4b57-a172-4751e6c8f186-metrics-tls") pod "dns-default-b9fg2" (UID: "c910d322-60b9-4b57-a172-4751e6c8f186") : secret "dns-default-metrics-tls" not found Jul 06 21:13:34.637039 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:34.637001 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xgv7v" Jul 06 21:13:34.637228 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:34.637001 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w5754" Jul 06 21:13:34.637228 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:34.637001 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2vbd9" Jul 06 21:13:34.641145 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:34.641104 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 06 21:13:34.641145 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:34.641111 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-xnr9n\"" Jul 06 21:13:34.641383 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:34.641162 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-qlcwx\"" Jul 06 21:13:34.641383 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:34.641111 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 06 21:13:34.641383 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:34.641308 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 06 21:13:34.641521 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:34.641468 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 06 21:13:34.854633 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:34.854546 2573 generic.go:356] "Generic (PLEG): container finished" podID="83297255-f507-48e1-80d6-6c8b9d5e1a81" containerID="ef22030f50803c2473e6b7c4f88c3389ae47e87b093a9b99d7a130a6c433ada0" exitCode=0 Jul 06 21:13:34.854633 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:34.854596 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l26xp" event={"ID":"83297255-f507-48e1-80d6-6c8b9d5e1a81","Type":"ContainerDied","Data":"ef22030f50803c2473e6b7c4f88c3389ae47e87b093a9b99d7a130a6c433ada0"} Jul 06 21:13:35.861293 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:35.860968 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l26xp" event={"ID":"83297255-f507-48e1-80d6-6c8b9d5e1a81","Type":"ContainerStarted","Data":"08e7e7caf14459e3f819491155d69c7510e4ac5a28a830c2314af24a747c8e3e"} Jul 06 21:13:35.863490 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:35.863454 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-5qvhk" event={"ID":"5ccd93e4-2c62-426c-93af-da45c500e964","Type":"ContainerStarted","Data":"38c2802ba9be08b03d39cace297625edbe2dc18e20165fe0ff1c93c8a47e08a0"} Jul 06 21:13:35.885874 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:35.885814 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-l26xp" podStartSLOduration=8.93297028 podStartE2EDuration="37.885796366s" totalImagesPullingTime="28.952826086s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 21:12:58 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:13:35.884052943 +0000 UTC m=+38.831430973" watchObservedRunningTime="2026-07-06 21:13:35.885796366 +0000 UTC m=+38.833174367" Jul 06 21:13:35.900553 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:35.900503 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-5qvhk" podStartSLOduration=1.611921757 podStartE2EDuration="3.900483956s" totalImagesPullingTime="2.288562199s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:13:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:13:35.899759658 +0000 UTC m=+38.847137665" watchObservedRunningTime="2026-07-06 21:13:35.900483956 +0000 UTC m=+38.847861960" Jul 06 21:13:36.563144 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:36.563106 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c910d322-60b9-4b57-a172-4751e6c8f186-metrics-tls\") pod \"dns-default-b9fg2\" (UID: \"c910d322-60b9-4b57-a172-4751e6c8f186\") " pod="openshift-dns/dns-default-b9fg2" Jul 06 21:13:36.563355 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:13:36.563277 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 21:13:36.563355 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:13:36.563345 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c910d322-60b9-4b57-a172-4751e6c8f186-metrics-tls podName:c910d322-60b9-4b57-a172-4751e6c8f186 nodeName:}" failed. No retries permitted until 2026-07-06 21:13:40.563328726 +0000 UTC m=+43.510706707 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c910d322-60b9-4b57-a172-4751e6c8f186-metrics-tls") pod "dns-default-b9fg2" (UID: "c910d322-60b9-4b57-a172-4751e6c8f186") : secret "dns-default-metrics-tls" not found Jul 06 21:13:40.591254 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:40.591208 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c910d322-60b9-4b57-a172-4751e6c8f186-metrics-tls\") pod \"dns-default-b9fg2\" (UID: \"c910d322-60b9-4b57-a172-4751e6c8f186\") " pod="openshift-dns/dns-default-b9fg2" Jul 06 21:13:40.591797 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:13:40.591364 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 21:13:40.591797 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:13:40.591429 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c910d322-60b9-4b57-a172-4751e6c8f186-metrics-tls podName:c910d322-60b9-4b57-a172-4751e6c8f186 nodeName:}" failed. No retries permitted until 2026-07-06 21:13:48.591413225 +0000 UTC m=+51.538791205 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c910d322-60b9-4b57-a172-4751e6c8f186-metrics-tls") pod "dns-default-b9fg2" (UID: "c910d322-60b9-4b57-a172-4751e6c8f186") : secret "dns-default-metrics-tls" not found Jul 06 21:13:48.644999 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:48.644951 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c910d322-60b9-4b57-a172-4751e6c8f186-metrics-tls\") pod \"dns-default-b9fg2\" (UID: \"c910d322-60b9-4b57-a172-4751e6c8f186\") " pod="openshift-dns/dns-default-b9fg2" Jul 06 21:13:48.645494 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:13:48.645117 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 21:13:48.645494 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:13:48.645184 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c910d322-60b9-4b57-a172-4751e6c8f186-metrics-tls podName:c910d322-60b9-4b57-a172-4751e6c8f186 nodeName:}" failed. No retries permitted until 2026-07-06 21:14:04.645166811 +0000 UTC m=+67.592544791 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c910d322-60b9-4b57-a172-4751e6c8f186-metrics-tls") pod "dns-default-b9fg2" (UID: "c910d322-60b9-4b57-a172-4751e6c8f186") : secret "dns-default-metrics-tls" not found Jul 06 21:13:57.836493 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:13:57.836464 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5s6d9" Jul 06 21:14:03.243549 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:14:03.243499 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3a3548bd-1472-470c-bda5-a7c611571bea-metrics-certs\") pod \"network-metrics-daemon-w5754\" (UID: \"3a3548bd-1472-470c-bda5-a7c611571bea\") " pod="openshift-multus/network-metrics-daemon-w5754" Jul 06 21:14:03.246428 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:14:03.246403 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 06 21:14:03.254686 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:14:03.254656 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 06 21:14:03.254824 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:14:03.254764 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a3548bd-1472-470c-bda5-a7c611571bea-metrics-certs podName:3a3548bd-1472-470c-bda5-a7c611571bea nodeName:}" failed. No retries permitted until 2026-07-06 21:15:07.254739537 +0000 UTC m=+130.202117517 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3a3548bd-1472-470c-bda5-a7c611571bea-metrics-certs") pod "network-metrics-daemon-w5754" (UID: "3a3548bd-1472-470c-bda5-a7c611571bea") : secret "metrics-daemon-secret" not found Jul 06 21:14:03.344858 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:14:03.344821 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7kg9q\" (UniqueName: \"kubernetes.io/projected/c5dccb0b-1724-44ec-a683-c8a45526a11a-kube-api-access-7kg9q\") pod \"network-check-target-2vbd9\" (UID: \"c5dccb0b-1724-44ec-a683-c8a45526a11a\") " pod="openshift-network-diagnostics/network-check-target-2vbd9" Jul 06 21:14:03.344858 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:14:03.344867 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/55e17066-002e-4ebb-a6cb-e4be26f3383d-original-pull-secret\") pod \"global-pull-secret-syncer-xgv7v\" (UID: \"55e17066-002e-4ebb-a6cb-e4be26f3383d\") " pod="kube-system/global-pull-secret-syncer-xgv7v" Jul 06 21:14:03.347627 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:14:03.347601 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 06 21:14:03.347706 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:14:03.347646 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 06 21:14:03.358405 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:14:03.358380 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 06 21:14:03.359660 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:14:03.359633 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/55e17066-002e-4ebb-a6cb-e4be26f3383d-original-pull-secret\") pod \"global-pull-secret-syncer-xgv7v\" (UID: \"55e17066-002e-4ebb-a6cb-e4be26f3383d\") " pod="kube-system/global-pull-secret-syncer-xgv7v" Jul 06 21:14:03.368909 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:14:03.368875 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7kg9q\" (UniqueName: \"kubernetes.io/projected/c5dccb0b-1724-44ec-a683-c8a45526a11a-kube-api-access-7kg9q\") pod \"network-check-target-2vbd9\" (UID: \"c5dccb0b-1724-44ec-a683-c8a45526a11a\") " pod="openshift-network-diagnostics/network-check-target-2vbd9" Jul 06 21:14:03.449308 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:14:03.449270 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xgv7v" Jul 06 21:14:03.464354 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:14:03.464326 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-xnr9n\"" Jul 06 21:14:03.472630 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:14:03.472601 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2vbd9" Jul 06 21:14:03.641850 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:14:03.641817 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-xgv7v"] Jul 06 21:14:03.644793 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:14:03.644759 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55e17066_002e_4ebb_a6cb_e4be26f3383d.slice/crio-791253ca6370b11575792ea921ae03fb952f5356f44fa9fd402c6132e34f88d5 WatchSource:0}: Error finding container 791253ca6370b11575792ea921ae03fb952f5356f44fa9fd402c6132e34f88d5: Status 404 returned error can't find the container with id 791253ca6370b11575792ea921ae03fb952f5356f44fa9fd402c6132e34f88d5 Jul 06 21:14:03.663225 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:14:03.663195 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-2vbd9"] Jul 06 21:14:03.666956 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:14:03.666933 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5dccb0b_1724_44ec_a683_c8a45526a11a.slice/crio-fea6e18307ed2296f52ef375af49793dac126c8f0a33e6474e2084e1354f0229 WatchSource:0}: Error finding container fea6e18307ed2296f52ef375af49793dac126c8f0a33e6474e2084e1354f0229: Status 404 returned error can't find the container with id fea6e18307ed2296f52ef375af49793dac126c8f0a33e6474e2084e1354f0229 Jul 06 21:14:03.931741 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:14:03.931703 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-2vbd9" event={"ID":"c5dccb0b-1724-44ec-a683-c8a45526a11a","Type":"ContainerStarted","Data":"fea6e18307ed2296f52ef375af49793dac126c8f0a33e6474e2084e1354f0229"} Jul 06 21:14:03.932726 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:14:03.932701 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-xgv7v" event={"ID":"55e17066-002e-4ebb-a6cb-e4be26f3383d","Type":"ContainerStarted","Data":"791253ca6370b11575792ea921ae03fb952f5356f44fa9fd402c6132e34f88d5"} Jul 06 21:14:04.654786 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:14:04.654744 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c910d322-60b9-4b57-a172-4751e6c8f186-metrics-tls\") pod \"dns-default-b9fg2\" (UID: \"c910d322-60b9-4b57-a172-4751e6c8f186\") " pod="openshift-dns/dns-default-b9fg2" Jul 06 21:14:04.655371 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:14:04.654931 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 21:14:04.655371 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:14:04.654996 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c910d322-60b9-4b57-a172-4751e6c8f186-metrics-tls podName:c910d322-60b9-4b57-a172-4751e6c8f186 nodeName:}" failed. No retries permitted until 2026-07-06 21:14:36.654978392 +0000 UTC m=+99.602356379 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c910d322-60b9-4b57-a172-4751e6c8f186-metrics-tls") pod "dns-default-b9fg2" (UID: "c910d322-60b9-4b57-a172-4751e6c8f186") : secret "dns-default-metrics-tls" not found Jul 06 21:14:08.949187 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:14:08.949154 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-2vbd9" event={"ID":"c5dccb0b-1724-44ec-a683-c8a45526a11a","Type":"ContainerStarted","Data":"78c31e780b92abc0943b4468a7e78aba67e5c28ffdfb6396dbb39b427936637f"} Jul 06 21:14:08.949690 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:14:08.949283 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-2vbd9" Jul 06 21:14:08.950618 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:14:08.950595 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-xgv7v" event={"ID":"55e17066-002e-4ebb-a6cb-e4be26f3383d","Type":"ContainerStarted","Data":"6d29c75cfa86a4e998f7f94a77dc7a9bc2c7a5ec16a2fd3cfc79e2f74c24221b"} Jul 06 21:14:08.966104 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:14:08.966052 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-2vbd9" podStartSLOduration=66.732710898 podStartE2EDuration="1m10.966033326s" totalImagesPullingTime="4.233322428s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:12:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:14:08.965695603 +0000 UTC m=+71.913073604" watchObservedRunningTime="2026-07-06 21:14:08.966033326 +0000 UTC m=+71.913411329" Jul 06 21:14:08.980938 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:14:08.980887 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-xgv7v" podStartSLOduration=66.720668682 podStartE2EDuration="1m10.980870447s" totalImagesPullingTime="4.260201765s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 21:12:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:14:08.980091881 +0000 UTC m=+71.927469880" watchObservedRunningTime="2026-07-06 21:14:08.980870447 +0000 UTC m=+71.928248448" Jul 06 21:14:36.665080 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:14:36.665021 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c910d322-60b9-4b57-a172-4751e6c8f186-metrics-tls\") pod \"dns-default-b9fg2\" (UID: \"c910d322-60b9-4b57-a172-4751e6c8f186\") " pod="openshift-dns/dns-default-b9fg2" Jul 06 21:14:36.665525 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:14:36.665176 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 21:14:36.665525 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:14:36.665272 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c910d322-60b9-4b57-a172-4751e6c8f186-metrics-tls podName:c910d322-60b9-4b57-a172-4751e6c8f186 nodeName:}" failed. No retries permitted until 2026-07-06 21:15:40.66523029 +0000 UTC m=+163.612608269 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c910d322-60b9-4b57-a172-4751e6c8f186-metrics-tls") pod "dns-default-b9fg2" (UID: "c910d322-60b9-4b57-a172-4751e6c8f186") : secret "dns-default-metrics-tls" not found Jul 06 21:14:39.955458 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:14:39.955429 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-2vbd9" Jul 06 21:15:07.275348 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:15:07.275301 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3a3548bd-1472-470c-bda5-a7c611571bea-metrics-certs\") pod \"network-metrics-daemon-w5754\" (UID: \"3a3548bd-1472-470c-bda5-a7c611571bea\") " pod="openshift-multus/network-metrics-daemon-w5754" Jul 06 21:15:07.275829 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:15:07.275451 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 06 21:15:07.275829 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:15:07.275512 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a3548bd-1472-470c-bda5-a7c611571bea-metrics-certs podName:3a3548bd-1472-470c-bda5-a7c611571bea nodeName:}" failed. No retries permitted until 2026-07-06 21:17:09.275496602 +0000 UTC m=+252.222874585 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3a3548bd-1472-470c-bda5-a7c611571bea-metrics-certs") pod "network-metrics-daemon-w5754" (UID: "3a3548bd-1472-470c-bda5-a7c611571bea") : secret "metrics-daemon-secret" not found Jul 06 21:15:35.869698 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:15:35.869654 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-b9fg2" podUID="c910d322-60b9-4b57-a172-4751e6c8f186" Jul 06 21:15:36.155791 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:15:36.155719 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-b9fg2" Jul 06 21:15:37.656085 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:15:37.656039 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-w5754" podUID="3a3548bd-1472-470c-bda5-a7c611571bea" Jul 06 21:15:40.702312 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:15:40.702259 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c910d322-60b9-4b57-a172-4751e6c8f186-metrics-tls\") pod \"dns-default-b9fg2\" (UID: \"c910d322-60b9-4b57-a172-4751e6c8f186\") " pod="openshift-dns/dns-default-b9fg2" Jul 06 21:15:40.702898 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:15:40.702428 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 21:15:40.702898 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:15:40.702513 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c910d322-60b9-4b57-a172-4751e6c8f186-metrics-tls podName:c910d322-60b9-4b57-a172-4751e6c8f186 nodeName:}" failed. No retries permitted until 2026-07-06 21:17:42.702489404 +0000 UTC m=+285.649867412 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c910d322-60b9-4b57-a172-4751e6c8f186-metrics-tls") pod "dns-default-b9fg2" (UID: "c910d322-60b9-4b57-a172-4751e6c8f186") : secret "dns-default-metrics-tls" not found Jul 06 21:15:51.636804 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:15:51.636761 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w5754" Jul 06 21:16:31.444948 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:31.444916 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-wbjrz"] Jul 06 21:16:31.446646 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:31.446624 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-wbjrz" Jul 06 21:16:31.450253 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:31.450214 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 06 21:16:31.450416 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:31.450368 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-tpgwg\"" Jul 06 21:16:31.451495 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:31.451479 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 06 21:16:31.451591 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:31.451480 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 06 21:16:31.451591 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:31.451506 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 06 21:16:31.471633 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:31.471603 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-wbjrz"] Jul 06 21:16:31.539223 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:31.539189 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-rkz9r"] Jul 06 21:16:31.541269 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:31.541253 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-rkz9r" Jul 06 21:16:31.544836 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:31.544814 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 06 21:16:31.544989 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:31.544921 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 06 21:16:31.544989 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:31.544913 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-bm8kh\"" Jul 06 21:16:31.546105 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:31.546088 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-kv8jl"] Jul 06 21:16:31.547953 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:31.547752 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-wvhfl"] Jul 06 21:16:31.547953 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:31.547880 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-kv8jl" Jul 06 21:16:31.549775 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:31.549758 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-857d447b7f-25xtr"] Jul 06 21:16:31.549860 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:31.549849 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-wvhfl" Jul 06 21:16:31.550912 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:31.550894 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 06 21:16:31.551363 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:31.551342 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-857d447b7f-25xtr" Jul 06 21:16:31.552690 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:31.552651 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 06 21:16:31.552791 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:31.552737 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-6xbjk\"" Jul 06 21:16:31.552897 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:31.552880 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 06 21:16:31.553018 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:31.553003 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 06 21:16:31.553189 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:31.553169 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 06 21:16:31.553529 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:31.553339 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 06 21:16:31.553529 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:31.553343 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 06 21:16:31.553837 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:31.553790 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-rkz9r"] Jul 06 21:16:31.554005 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:31.553984 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-tmzbx\"" Jul 06 21:16:31.554249 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:31.554192 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 06 21:16:31.554330 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:31.554273 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 06 21:16:31.554532 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:31.554415 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 06 21:16:31.554532 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:31.554519 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-xhqw5\"" Jul 06 21:16:31.554656 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:31.554598 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 06 21:16:31.554722 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:31.554706 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 06 21:16:31.554825 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:31.554721 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/27206ad5-a38e-4ee2-9f3f-45c8facd8a25-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-wbjrz\" (UID: \"27206ad5-a38e-4ee2-9f3f-45c8facd8a25\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-wbjrz" Jul 06 21:16:31.554825 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:31.554821 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/27206ad5-a38e-4ee2-9f3f-45c8facd8a25-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-wbjrz\" (UID: \"27206ad5-a38e-4ee2-9f3f-45c8facd8a25\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-wbjrz" Jul 06 21:16:31.554942 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:31.554852 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zghj4\" (UniqueName: \"kubernetes.io/projected/27206ad5-a38e-4ee2-9f3f-45c8facd8a25-kube-api-access-zghj4\") pod \"kube-storage-version-migrator-operator-846bf668f7-wbjrz\" (UID: \"27206ad5-a38e-4ee2-9f3f-45c8facd8a25\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-wbjrz" Jul 06 21:16:31.554942 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:31.554868 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 06 21:16:31.554942 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:31.554930 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 06 21:16:31.561172 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:31.561140 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-kv8jl"] Jul 06 21:16:31.562145 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:31.562128 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-wvhfl"] Jul 06 21:16:31.568788 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:31.568765 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-857d447b7f-25xtr"] Jul 06 21:16:31.655501 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:31.655464 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/3b0e3d2b-e597-46a2-862e-43a336240246-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-kv8jl\" (UID: \"3b0e3d2b-e597-46a2-862e-43a336240246\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-kv8jl" Jul 06 21:16:31.655501 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:31.655503 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d8b64eb8-e2ff-44a0-b9d9-67aba5e93c35-default-certificate\") pod \"router-default-857d447b7f-25xtr\" (UID: \"d8b64eb8-e2ff-44a0-b9d9-67aba5e93c35\") " pod="openshift-ingress/router-default-857d447b7f-25xtr" Jul 06 21:16:31.655706 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:31.655528 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nzvr2\" (UniqueName: \"kubernetes.io/projected/950868d7-21dd-4f44-8f4e-530a33206a74-kube-api-access-nzvr2\") pod \"service-ca-operator-5d46d9ffd4-wvhfl\" (UID: \"950868d7-21dd-4f44-8f4e-530a33206a74\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-wvhfl" Jul 06 21:16:31.655706 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:31.655577 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-79fk8\" (UniqueName: \"kubernetes.io/projected/3b0e3d2b-e597-46a2-862e-43a336240246-kube-api-access-79fk8\") pod \"cluster-monitoring-operator-64786d9cbb-kv8jl\" (UID: \"3b0e3d2b-e597-46a2-862e-43a336240246\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-kv8jl" Jul 06 21:16:31.655706 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:31.655690 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-76mrk\" (UniqueName: \"kubernetes.io/projected/47b5dbc3-1838-427d-bc7a-0f2fd0034d66-kube-api-access-76mrk\") pod \"volume-data-source-validator-5d456fdbcd-rkz9r\" (UID: \"47b5dbc3-1838-427d-bc7a-0f2fd0034d66\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-rkz9r" Jul 06 21:16:31.655803 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:31.655731 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/27206ad5-a38e-4ee2-9f3f-45c8facd8a25-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-wbjrz\" (UID: \"27206ad5-a38e-4ee2-9f3f-45c8facd8a25\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-wbjrz" Jul 06 21:16:31.655803 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:31.655748 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/27206ad5-a38e-4ee2-9f3f-45c8facd8a25-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-wbjrz\" (UID: \"27206ad5-a38e-4ee2-9f3f-45c8facd8a25\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-wbjrz" Jul 06 21:16:31.655803 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:31.655773 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zghj4\" (UniqueName: \"kubernetes.io/projected/27206ad5-a38e-4ee2-9f3f-45c8facd8a25-kube-api-access-zghj4\") pod \"kube-storage-version-migrator-operator-846bf668f7-wbjrz\" (UID: \"27206ad5-a38e-4ee2-9f3f-45c8facd8a25\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-wbjrz" Jul 06 21:16:31.655803 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:31.655800 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/950868d7-21dd-4f44-8f4e-530a33206a74-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-wvhfl\" (UID: \"950868d7-21dd-4f44-8f4e-530a33206a74\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-wvhfl" Jul 06 21:16:31.655962 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:31.655819 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d8b64eb8-e2ff-44a0-b9d9-67aba5e93c35-service-ca-bundle\") pod \"router-default-857d447b7f-25xtr\" (UID: \"d8b64eb8-e2ff-44a0-b9d9-67aba5e93c35\") " pod="openshift-ingress/router-default-857d447b7f-25xtr" Jul 06 21:16:31.655962 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:31.655843 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d8b64eb8-e2ff-44a0-b9d9-67aba5e93c35-metrics-certs\") pod \"router-default-857d447b7f-25xtr\" (UID: \"d8b64eb8-e2ff-44a0-b9d9-67aba5e93c35\") " pod="openshift-ingress/router-default-857d447b7f-25xtr" Jul 06 21:16:31.655962 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:31.655869 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tn9rp\" (UniqueName: \"kubernetes.io/projected/d8b64eb8-e2ff-44a0-b9d9-67aba5e93c35-kube-api-access-tn9rp\") pod \"router-default-857d447b7f-25xtr\" (UID: \"d8b64eb8-e2ff-44a0-b9d9-67aba5e93c35\") " pod="openshift-ingress/router-default-857d447b7f-25xtr" Jul 06 21:16:31.655962 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:31.655913 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/950868d7-21dd-4f44-8f4e-530a33206a74-config\") pod \"service-ca-operator-5d46d9ffd4-wvhfl\" (UID: \"950868d7-21dd-4f44-8f4e-530a33206a74\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-wvhfl" Jul 06 21:16:31.656113 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:31.655957 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d8b64eb8-e2ff-44a0-b9d9-67aba5e93c35-stats-auth\") pod \"router-default-857d447b7f-25xtr\" (UID: \"d8b64eb8-e2ff-44a0-b9d9-67aba5e93c35\") " pod="openshift-ingress/router-default-857d447b7f-25xtr" Jul 06 21:16:31.656113 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:31.655986 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3b0e3d2b-e597-46a2-862e-43a336240246-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-kv8jl\" (UID: \"3b0e3d2b-e597-46a2-862e-43a336240246\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-kv8jl" Jul 06 21:16:31.656338 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:31.656318 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/27206ad5-a38e-4ee2-9f3f-45c8facd8a25-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-wbjrz\" (UID: \"27206ad5-a38e-4ee2-9f3f-45c8facd8a25\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-wbjrz" Jul 06 21:16:31.657998 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:31.657978 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/27206ad5-a38e-4ee2-9f3f-45c8facd8a25-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-wbjrz\" (UID: \"27206ad5-a38e-4ee2-9f3f-45c8facd8a25\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-wbjrz" Jul 06 21:16:31.681576 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:31.681539 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zghj4\" (UniqueName: \"kubernetes.io/projected/27206ad5-a38e-4ee2-9f3f-45c8facd8a25-kube-api-access-zghj4\") pod \"kube-storage-version-migrator-operator-846bf668f7-wbjrz\" (UID: \"27206ad5-a38e-4ee2-9f3f-45c8facd8a25\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-wbjrz" Jul 06 21:16:31.755579 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:31.755482 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-wbjrz" Jul 06 21:16:31.756719 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:31.756691 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/950868d7-21dd-4f44-8f4e-530a33206a74-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-wvhfl\" (UID: \"950868d7-21dd-4f44-8f4e-530a33206a74\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-wvhfl" Jul 06 21:16:31.756800 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:31.756741 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d8b64eb8-e2ff-44a0-b9d9-67aba5e93c35-service-ca-bundle\") pod \"router-default-857d447b7f-25xtr\" (UID: \"d8b64eb8-e2ff-44a0-b9d9-67aba5e93c35\") " pod="openshift-ingress/router-default-857d447b7f-25xtr" Jul 06 21:16:31.756800 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:31.756759 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d8b64eb8-e2ff-44a0-b9d9-67aba5e93c35-metrics-certs\") pod \"router-default-857d447b7f-25xtr\" (UID: \"d8b64eb8-e2ff-44a0-b9d9-67aba5e93c35\") " pod="openshift-ingress/router-default-857d447b7f-25xtr" Jul 06 21:16:31.756800 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:31.756775 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tn9rp\" (UniqueName: \"kubernetes.io/projected/d8b64eb8-e2ff-44a0-b9d9-67aba5e93c35-kube-api-access-tn9rp\") pod \"router-default-857d447b7f-25xtr\" (UID: \"d8b64eb8-e2ff-44a0-b9d9-67aba5e93c35\") " pod="openshift-ingress/router-default-857d447b7f-25xtr" Jul 06 21:16:31.756800 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:31.756797 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/950868d7-21dd-4f44-8f4e-530a33206a74-config\") pod \"service-ca-operator-5d46d9ffd4-wvhfl\" (UID: \"950868d7-21dd-4f44-8f4e-530a33206a74\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-wvhfl" Jul 06 21:16:31.757146 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:31.756813 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d8b64eb8-e2ff-44a0-b9d9-67aba5e93c35-stats-auth\") pod \"router-default-857d447b7f-25xtr\" (UID: \"d8b64eb8-e2ff-44a0-b9d9-67aba5e93c35\") " pod="openshift-ingress/router-default-857d447b7f-25xtr" Jul 06 21:16:31.757146 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:16:31.756884 2573 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 06 21:16:31.757146 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:31.756961 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3b0e3d2b-e597-46a2-862e-43a336240246-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-kv8jl\" (UID: \"3b0e3d2b-e597-46a2-862e-43a336240246\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-kv8jl" Jul 06 21:16:31.757146 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:16:31.756975 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d8b64eb8-e2ff-44a0-b9d9-67aba5e93c35-service-ca-bundle podName:d8b64eb8-e2ff-44a0-b9d9-67aba5e93c35 nodeName:}" failed. No retries permitted until 2026-07-06 21:16:32.256950853 +0000 UTC m=+215.204328851 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d8b64eb8-e2ff-44a0-b9d9-67aba5e93c35-service-ca-bundle") pod "router-default-857d447b7f-25xtr" (UID: "d8b64eb8-e2ff-44a0-b9d9-67aba5e93c35") : configmap references non-existent config key: service-ca.crt Jul 06 21:16:31.757146 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:31.757017 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/3b0e3d2b-e597-46a2-862e-43a336240246-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-kv8jl\" (UID: \"3b0e3d2b-e597-46a2-862e-43a336240246\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-kv8jl" Jul 06 21:16:31.757146 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:16:31.757054 2573 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 06 21:16:31.757146 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:16:31.757088 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8b64eb8-e2ff-44a0-b9d9-67aba5e93c35-metrics-certs podName:d8b64eb8-e2ff-44a0-b9d9-67aba5e93c35 nodeName:}" failed. No retries permitted until 2026-07-06 21:16:32.257062174 +0000 UTC m=+215.204440159 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d8b64eb8-e2ff-44a0-b9d9-67aba5e93c35-metrics-certs") pod "router-default-857d447b7f-25xtr" (UID: "d8b64eb8-e2ff-44a0-b9d9-67aba5e93c35") : secret "router-metrics-certs-default" not found Jul 06 21:16:31.757146 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:31.757111 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d8b64eb8-e2ff-44a0-b9d9-67aba5e93c35-default-certificate\") pod \"router-default-857d447b7f-25xtr\" (UID: \"d8b64eb8-e2ff-44a0-b9d9-67aba5e93c35\") " pod="openshift-ingress/router-default-857d447b7f-25xtr" Jul 06 21:16:31.757146 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:31.757157 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nzvr2\" (UniqueName: \"kubernetes.io/projected/950868d7-21dd-4f44-8f4e-530a33206a74-kube-api-access-nzvr2\") pod \"service-ca-operator-5d46d9ffd4-wvhfl\" (UID: \"950868d7-21dd-4f44-8f4e-530a33206a74\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-wvhfl" Jul 06 21:16:31.757146 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:31.757182 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-79fk8\" (UniqueName: \"kubernetes.io/projected/3b0e3d2b-e597-46a2-862e-43a336240246-kube-api-access-79fk8\") pod \"cluster-monitoring-operator-64786d9cbb-kv8jl\" (UID: \"3b0e3d2b-e597-46a2-862e-43a336240246\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-kv8jl" Jul 06 21:16:31.757739 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:16:31.757220 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b0e3d2b-e597-46a2-862e-43a336240246-cluster-monitoring-operator-tls podName:3b0e3d2b-e597-46a2-862e-43a336240246 nodeName:}" failed. No retries permitted until 2026-07-06 21:16:32.257207285 +0000 UTC m=+215.204585266 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/3b0e3d2b-e597-46a2-862e-43a336240246-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-kv8jl" (UID: "3b0e3d2b-e597-46a2-862e-43a336240246") : secret "cluster-monitoring-operator-tls" not found Jul 06 21:16:31.757739 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:31.757309 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-76mrk\" (UniqueName: \"kubernetes.io/projected/47b5dbc3-1838-427d-bc7a-0f2fd0034d66-kube-api-access-76mrk\") pod \"volume-data-source-validator-5d456fdbcd-rkz9r\" (UID: \"47b5dbc3-1838-427d-bc7a-0f2fd0034d66\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-rkz9r" Jul 06 21:16:31.757739 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:31.757534 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/950868d7-21dd-4f44-8f4e-530a33206a74-config\") pod \"service-ca-operator-5d46d9ffd4-wvhfl\" (UID: \"950868d7-21dd-4f44-8f4e-530a33206a74\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-wvhfl" Jul 06 21:16:31.757965 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:31.757942 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/3b0e3d2b-e597-46a2-862e-43a336240246-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-kv8jl\" (UID: \"3b0e3d2b-e597-46a2-862e-43a336240246\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-kv8jl" Jul 06 21:16:31.759156 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:31.759128 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/950868d7-21dd-4f44-8f4e-530a33206a74-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-wvhfl\" (UID: \"950868d7-21dd-4f44-8f4e-530a33206a74\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-wvhfl" Jul 06 21:16:31.759689 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:31.759670 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d8b64eb8-e2ff-44a0-b9d9-67aba5e93c35-stats-auth\") pod \"router-default-857d447b7f-25xtr\" (UID: \"d8b64eb8-e2ff-44a0-b9d9-67aba5e93c35\") " pod="openshift-ingress/router-default-857d447b7f-25xtr" Jul 06 21:16:31.759737 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:31.759693 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d8b64eb8-e2ff-44a0-b9d9-67aba5e93c35-default-certificate\") pod \"router-default-857d447b7f-25xtr\" (UID: \"d8b64eb8-e2ff-44a0-b9d9-67aba5e93c35\") " pod="openshift-ingress/router-default-857d447b7f-25xtr" Jul 06 21:16:31.768468 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:31.768435 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nzvr2\" (UniqueName: \"kubernetes.io/projected/950868d7-21dd-4f44-8f4e-530a33206a74-kube-api-access-nzvr2\") pod \"service-ca-operator-5d46d9ffd4-wvhfl\" (UID: \"950868d7-21dd-4f44-8f4e-530a33206a74\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-wvhfl" Jul 06 21:16:31.768582 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:31.768561 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tn9rp\" (UniqueName: \"kubernetes.io/projected/d8b64eb8-e2ff-44a0-b9d9-67aba5e93c35-kube-api-access-tn9rp\") pod \"router-default-857d447b7f-25xtr\" (UID: \"d8b64eb8-e2ff-44a0-b9d9-67aba5e93c35\") " pod="openshift-ingress/router-default-857d447b7f-25xtr" Jul 06 21:16:31.769983 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:31.769961 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-79fk8\" (UniqueName: \"kubernetes.io/projected/3b0e3d2b-e597-46a2-862e-43a336240246-kube-api-access-79fk8\") pod \"cluster-monitoring-operator-64786d9cbb-kv8jl\" (UID: \"3b0e3d2b-e597-46a2-862e-43a336240246\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-kv8jl" Jul 06 21:16:31.770362 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:31.770339 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-76mrk\" (UniqueName: \"kubernetes.io/projected/47b5dbc3-1838-427d-bc7a-0f2fd0034d66-kube-api-access-76mrk\") pod \"volume-data-source-validator-5d456fdbcd-rkz9r\" (UID: \"47b5dbc3-1838-427d-bc7a-0f2fd0034d66\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-rkz9r" Jul 06 21:16:31.852296 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:31.852263 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-rkz9r" Jul 06 21:16:31.867324 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:31.867296 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-wvhfl" Jul 06 21:16:31.882135 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:31.882012 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-wbjrz"] Jul 06 21:16:31.884705 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:16:31.884675 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27206ad5_a38e_4ee2_9f3f_45c8facd8a25.slice/crio-2ff919094299395b41eb7941d50fd2037061848fde29685d87b69c003ad62c7b WatchSource:0}: Error finding container 2ff919094299395b41eb7941d50fd2037061848fde29685d87b69c003ad62c7b: Status 404 returned error can't find the container with id 2ff919094299395b41eb7941d50fd2037061848fde29685d87b69c003ad62c7b Jul 06 21:16:31.988966 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:31.988920 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-rkz9r"] Jul 06 21:16:31.991721 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:16:31.991695 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47b5dbc3_1838_427d_bc7a_0f2fd0034d66.slice/crio-151ea375b2e0457f2f487da763a4036d69ba9a46904d797887c30b59d0c4dfc5 WatchSource:0}: Error finding container 151ea375b2e0457f2f487da763a4036d69ba9a46904d797887c30b59d0c4dfc5: Status 404 returned error can't find the container with id 151ea375b2e0457f2f487da763a4036d69ba9a46904d797887c30b59d0c4dfc5 Jul 06 21:16:32.004807 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:32.004781 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-wvhfl"] Jul 06 21:16:32.007587 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:16:32.007562 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod950868d7_21dd_4f44_8f4e_530a33206a74.slice/crio-1a8d71bf8b853a03221df6fae757cec149393c51d9d8325adb0e5899c64f3417 WatchSource:0}: Error finding container 1a8d71bf8b853a03221df6fae757cec149393c51d9d8325adb0e5899c64f3417: Status 404 returned error can't find the container with id 1a8d71bf8b853a03221df6fae757cec149393c51d9d8325adb0e5899c64f3417 Jul 06 21:16:32.260812 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:32.260718 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d8b64eb8-e2ff-44a0-b9d9-67aba5e93c35-service-ca-bundle\") pod \"router-default-857d447b7f-25xtr\" (UID: \"d8b64eb8-e2ff-44a0-b9d9-67aba5e93c35\") " pod="openshift-ingress/router-default-857d447b7f-25xtr" Jul 06 21:16:32.260812 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:32.260759 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d8b64eb8-e2ff-44a0-b9d9-67aba5e93c35-metrics-certs\") pod \"router-default-857d447b7f-25xtr\" (UID: \"d8b64eb8-e2ff-44a0-b9d9-67aba5e93c35\") " pod="openshift-ingress/router-default-857d447b7f-25xtr" Jul 06 21:16:32.260812 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:32.260787 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3b0e3d2b-e597-46a2-862e-43a336240246-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-kv8jl\" (UID: \"3b0e3d2b-e597-46a2-862e-43a336240246\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-kv8jl" Jul 06 21:16:32.261065 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:16:32.260870 2573 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 06 21:16:32.261065 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:16:32.260887 2573 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 06 21:16:32.261065 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:16:32.260900 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d8b64eb8-e2ff-44a0-b9d9-67aba5e93c35-service-ca-bundle podName:d8b64eb8-e2ff-44a0-b9d9-67aba5e93c35 nodeName:}" failed. No retries permitted until 2026-07-06 21:16:33.260884512 +0000 UTC m=+216.208262496 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d8b64eb8-e2ff-44a0-b9d9-67aba5e93c35-service-ca-bundle") pod "router-default-857d447b7f-25xtr" (UID: "d8b64eb8-e2ff-44a0-b9d9-67aba5e93c35") : configmap references non-existent config key: service-ca.crt Jul 06 21:16:32.261065 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:16:32.260921 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8b64eb8-e2ff-44a0-b9d9-67aba5e93c35-metrics-certs podName:d8b64eb8-e2ff-44a0-b9d9-67aba5e93c35 nodeName:}" failed. No retries permitted until 2026-07-06 21:16:33.260914873 +0000 UTC m=+216.208292853 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d8b64eb8-e2ff-44a0-b9d9-67aba5e93c35-metrics-certs") pod "router-default-857d447b7f-25xtr" (UID: "d8b64eb8-e2ff-44a0-b9d9-67aba5e93c35") : secret "router-metrics-certs-default" not found Jul 06 21:16:32.261065 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:16:32.260940 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b0e3d2b-e597-46a2-862e-43a336240246-cluster-monitoring-operator-tls podName:3b0e3d2b-e597-46a2-862e-43a336240246 nodeName:}" failed. No retries permitted until 2026-07-06 21:16:33.260925632 +0000 UTC m=+216.208303612 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/3b0e3d2b-e597-46a2-862e-43a336240246-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-kv8jl" (UID: "3b0e3d2b-e597-46a2-862e-43a336240246") : secret "cluster-monitoring-operator-tls" not found Jul 06 21:16:32.291095 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:32.291062 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-rkz9r" event={"ID":"47b5dbc3-1838-427d-bc7a-0f2fd0034d66","Type":"ContainerStarted","Data":"151ea375b2e0457f2f487da763a4036d69ba9a46904d797887c30b59d0c4dfc5"} Jul 06 21:16:32.292113 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:32.292088 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-wbjrz" event={"ID":"27206ad5-a38e-4ee2-9f3f-45c8facd8a25","Type":"ContainerStarted","Data":"2ff919094299395b41eb7941d50fd2037061848fde29685d87b69c003ad62c7b"} Jul 06 21:16:32.293116 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:32.293097 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-wvhfl" event={"ID":"950868d7-21dd-4f44-8f4e-530a33206a74","Type":"ContainerStarted","Data":"1a8d71bf8b853a03221df6fae757cec149393c51d9d8325adb0e5899c64f3417"} Jul 06 21:16:33.268148 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:33.268114 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d8b64eb8-e2ff-44a0-b9d9-67aba5e93c35-service-ca-bundle\") pod \"router-default-857d447b7f-25xtr\" (UID: \"d8b64eb8-e2ff-44a0-b9d9-67aba5e93c35\") " pod="openshift-ingress/router-default-857d447b7f-25xtr" Jul 06 21:16:33.268148 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:33.268148 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d8b64eb8-e2ff-44a0-b9d9-67aba5e93c35-metrics-certs\") pod \"router-default-857d447b7f-25xtr\" (UID: \"d8b64eb8-e2ff-44a0-b9d9-67aba5e93c35\") " pod="openshift-ingress/router-default-857d447b7f-25xtr" Jul 06 21:16:33.268650 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:33.268179 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3b0e3d2b-e597-46a2-862e-43a336240246-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-kv8jl\" (UID: \"3b0e3d2b-e597-46a2-862e-43a336240246\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-kv8jl" Jul 06 21:16:33.268650 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:16:33.268303 2573 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 06 21:16:33.268650 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:16:33.268312 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d8b64eb8-e2ff-44a0-b9d9-67aba5e93c35-service-ca-bundle podName:d8b64eb8-e2ff-44a0-b9d9-67aba5e93c35 nodeName:}" failed. No retries permitted until 2026-07-06 21:16:35.268294346 +0000 UTC m=+218.215672329 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d8b64eb8-e2ff-44a0-b9d9-67aba5e93c35-service-ca-bundle") pod "router-default-857d447b7f-25xtr" (UID: "d8b64eb8-e2ff-44a0-b9d9-67aba5e93c35") : configmap references non-existent config key: service-ca.crt Jul 06 21:16:33.268650 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:16:33.268321 2573 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 06 21:16:33.268650 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:16:33.268350 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b0e3d2b-e597-46a2-862e-43a336240246-cluster-monitoring-operator-tls podName:3b0e3d2b-e597-46a2-862e-43a336240246 nodeName:}" failed. No retries permitted until 2026-07-06 21:16:35.268333367 +0000 UTC m=+218.215711363 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/3b0e3d2b-e597-46a2-862e-43a336240246-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-kv8jl" (UID: "3b0e3d2b-e597-46a2-862e-43a336240246") : secret "cluster-monitoring-operator-tls" not found Jul 06 21:16:33.268650 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:16:33.268416 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8b64eb8-e2ff-44a0-b9d9-67aba5e93c35-metrics-certs podName:d8b64eb8-e2ff-44a0-b9d9-67aba5e93c35 nodeName:}" failed. No retries permitted until 2026-07-06 21:16:35.268404378 +0000 UTC m=+218.215782363 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d8b64eb8-e2ff-44a0-b9d9-67aba5e93c35-metrics-certs") pod "router-default-857d447b7f-25xtr" (UID: "d8b64eb8-e2ff-44a0-b9d9-67aba5e93c35") : secret "router-metrics-certs-default" not found Jul 06 21:16:33.298693 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:33.298654 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-rkz9r" event={"ID":"47b5dbc3-1838-427d-bc7a-0f2fd0034d66","Type":"ContainerStarted","Data":"5ad7004a8adbb736be3eaa9df8cec12732e124233900655a3f499b7bfd95518e"} Jul 06 21:16:33.316253 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:33.316193 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-rkz9r" podStartSLOduration=1.116168073 podStartE2EDuration="2.316175515s" totalImagesPullingTime="1.200007442s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:16:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:16:33.31484507 +0000 UTC m=+216.262223097" watchObservedRunningTime="2026-07-06 21:16:33.316175515 +0000 UTC m=+216.263553516" Jul 06 21:16:35.283662 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:35.283609 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d8b64eb8-e2ff-44a0-b9d9-67aba5e93c35-service-ca-bundle\") pod \"router-default-857d447b7f-25xtr\" (UID: \"d8b64eb8-e2ff-44a0-b9d9-67aba5e93c35\") " pod="openshift-ingress/router-default-857d447b7f-25xtr" Jul 06 21:16:35.283662 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:35.283661 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d8b64eb8-e2ff-44a0-b9d9-67aba5e93c35-metrics-certs\") pod \"router-default-857d447b7f-25xtr\" (UID: \"d8b64eb8-e2ff-44a0-b9d9-67aba5e93c35\") " pod="openshift-ingress/router-default-857d447b7f-25xtr" Jul 06 21:16:35.284161 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:35.283692 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3b0e3d2b-e597-46a2-862e-43a336240246-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-kv8jl\" (UID: \"3b0e3d2b-e597-46a2-862e-43a336240246\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-kv8jl" Jul 06 21:16:35.284161 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:16:35.283790 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d8b64eb8-e2ff-44a0-b9d9-67aba5e93c35-service-ca-bundle podName:d8b64eb8-e2ff-44a0-b9d9-67aba5e93c35 nodeName:}" failed. No retries permitted until 2026-07-06 21:16:39.283770733 +0000 UTC m=+222.231148728 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d8b64eb8-e2ff-44a0-b9d9-67aba5e93c35-service-ca-bundle") pod "router-default-857d447b7f-25xtr" (UID: "d8b64eb8-e2ff-44a0-b9d9-67aba5e93c35") : configmap references non-existent config key: service-ca.crt Jul 06 21:16:35.284161 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:16:35.283866 2573 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 06 21:16:35.284161 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:16:35.283898 2573 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 06 21:16:35.284161 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:16:35.283943 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8b64eb8-e2ff-44a0-b9d9-67aba5e93c35-metrics-certs podName:d8b64eb8-e2ff-44a0-b9d9-67aba5e93c35 nodeName:}" failed. No retries permitted until 2026-07-06 21:16:39.283916439 +0000 UTC m=+222.231294420 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d8b64eb8-e2ff-44a0-b9d9-67aba5e93c35-metrics-certs") pod "router-default-857d447b7f-25xtr" (UID: "d8b64eb8-e2ff-44a0-b9d9-67aba5e93c35") : secret "router-metrics-certs-default" not found Jul 06 21:16:35.284161 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:16:35.283964 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b0e3d2b-e597-46a2-862e-43a336240246-cluster-monitoring-operator-tls podName:3b0e3d2b-e597-46a2-862e-43a336240246 nodeName:}" failed. No retries permitted until 2026-07-06 21:16:39.283954373 +0000 UTC m=+222.231332353 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/3b0e3d2b-e597-46a2-862e-43a336240246-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-kv8jl" (UID: "3b0e3d2b-e597-46a2-862e-43a336240246") : secret "cluster-monitoring-operator-tls" not found Jul 06 21:16:35.311030 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:35.310993 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-wbjrz" event={"ID":"27206ad5-a38e-4ee2-9f3f-45c8facd8a25","Type":"ContainerStarted","Data":"94cd1d1a7d51730d0bb3978f0bb11d0d08d972b85a94061ddcfbec8e07d9f8b0"} Jul 06 21:16:35.312599 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:35.312563 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-wvhfl" event={"ID":"950868d7-21dd-4f44-8f4e-530a33206a74","Type":"ContainerStarted","Data":"7f0001a1a88100208249d41e745c6c5aea4477803c41af8b1a4f89ba1927068a"} Jul 06 21:16:35.394896 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:35.394841 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-wbjrz" podStartSLOduration=1.6611956650000002 podStartE2EDuration="4.394823307s" totalImagesPullingTime="2.733627642s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:16:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:16:35.344993917 +0000 UTC m=+218.292371920" watchObservedRunningTime="2026-07-06 21:16:35.394823307 +0000 UTC m=+218.342201306" Jul 06 21:16:35.395436 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:35.395406 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-wvhfl" podStartSLOduration=1.785625926 podStartE2EDuration="4.395396314s" totalImagesPullingTime="2.609770388s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:16:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:16:35.394898844 +0000 UTC m=+218.342276847" watchObservedRunningTime="2026-07-06 21:16:35.395396314 +0000 UTC m=+218.342774317" Jul 06 21:16:35.770048 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:35.769962 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-vlfkz"] Jul 06 21:16:35.772148 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:35.772126 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-vlfkz" Jul 06 21:16:35.776733 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:35.776707 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 06 21:16:35.776889 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:35.776874 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 06 21:16:35.777000 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:35.776983 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 06 21:16:35.777663 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:35.777641 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-c69zl\"" Jul 06 21:16:35.784501 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:35.784473 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 06 21:16:35.788619 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:35.788595 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/11b17aab-3d0b-48ee-a3e9-2ba3ee4480cb-crio-socket\") pod \"insights-runtime-extractor-vlfkz\" (UID: \"11b17aab-3d0b-48ee-a3e9-2ba3ee4480cb\") " pod="openshift-insights/insights-runtime-extractor-vlfkz" Jul 06 21:16:35.788619 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:35.788622 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/11b17aab-3d0b-48ee-a3e9-2ba3ee4480cb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vlfkz\" (UID: \"11b17aab-3d0b-48ee-a3e9-2ba3ee4480cb\") " pod="openshift-insights/insights-runtime-extractor-vlfkz" Jul 06 21:16:35.788809 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:35.788642 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/11b17aab-3d0b-48ee-a3e9-2ba3ee4480cb-data-volume\") pod \"insights-runtime-extractor-vlfkz\" (UID: \"11b17aab-3d0b-48ee-a3e9-2ba3ee4480cb\") " pod="openshift-insights/insights-runtime-extractor-vlfkz" Jul 06 21:16:35.788809 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:35.788663 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gwfh5\" (UniqueName: \"kubernetes.io/projected/11b17aab-3d0b-48ee-a3e9-2ba3ee4480cb-kube-api-access-gwfh5\") pod \"insights-runtime-extractor-vlfkz\" (UID: \"11b17aab-3d0b-48ee-a3e9-2ba3ee4480cb\") " pod="openshift-insights/insights-runtime-extractor-vlfkz" Jul 06 21:16:35.788809 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:35.788721 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/11b17aab-3d0b-48ee-a3e9-2ba3ee4480cb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vlfkz\" (UID: \"11b17aab-3d0b-48ee-a3e9-2ba3ee4480cb\") " pod="openshift-insights/insights-runtime-extractor-vlfkz" Jul 06 21:16:35.800840 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:35.800812 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-vlfkz"] Jul 06 21:16:35.889799 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:35.889762 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gwfh5\" (UniqueName: \"kubernetes.io/projected/11b17aab-3d0b-48ee-a3e9-2ba3ee4480cb-kube-api-access-gwfh5\") pod \"insights-runtime-extractor-vlfkz\" (UID: \"11b17aab-3d0b-48ee-a3e9-2ba3ee4480cb\") " pod="openshift-insights/insights-runtime-extractor-vlfkz" Jul 06 21:16:35.889799 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:35.889797 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/11b17aab-3d0b-48ee-a3e9-2ba3ee4480cb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vlfkz\" (UID: \"11b17aab-3d0b-48ee-a3e9-2ba3ee4480cb\") " pod="openshift-insights/insights-runtime-extractor-vlfkz" Jul 06 21:16:35.890032 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:16:35.889909 2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 21:16:35.890032 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:16:35.889965 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11b17aab-3d0b-48ee-a3e9-2ba3ee4480cb-insights-runtime-extractor-tls podName:11b17aab-3d0b-48ee-a3e9-2ba3ee4480cb nodeName:}" failed. No retries permitted until 2026-07-06 21:16:36.389950743 +0000 UTC m=+219.337328723 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/11b17aab-3d0b-48ee-a3e9-2ba3ee4480cb-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vlfkz" (UID: "11b17aab-3d0b-48ee-a3e9-2ba3ee4480cb") : secret "insights-runtime-extractor-tls" not found Jul 06 21:16:35.890105 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:35.890051 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/11b17aab-3d0b-48ee-a3e9-2ba3ee4480cb-crio-socket\") pod \"insights-runtime-extractor-vlfkz\" (UID: \"11b17aab-3d0b-48ee-a3e9-2ba3ee4480cb\") " pod="openshift-insights/insights-runtime-extractor-vlfkz" Jul 06 21:16:35.890105 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:35.890084 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/11b17aab-3d0b-48ee-a3e9-2ba3ee4480cb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vlfkz\" (UID: \"11b17aab-3d0b-48ee-a3e9-2ba3ee4480cb\") " pod="openshift-insights/insights-runtime-extractor-vlfkz" Jul 06 21:16:35.890173 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:35.890112 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/11b17aab-3d0b-48ee-a3e9-2ba3ee4480cb-data-volume\") pod \"insights-runtime-extractor-vlfkz\" (UID: \"11b17aab-3d0b-48ee-a3e9-2ba3ee4480cb\") " pod="openshift-insights/insights-runtime-extractor-vlfkz" Jul 06 21:16:35.890173 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:35.890164 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/11b17aab-3d0b-48ee-a3e9-2ba3ee4480cb-crio-socket\") pod \"insights-runtime-extractor-vlfkz\" (UID: \"11b17aab-3d0b-48ee-a3e9-2ba3ee4480cb\") " pod="openshift-insights/insights-runtime-extractor-vlfkz" Jul 06 21:16:35.890276 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:16:35.890187 2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 21:16:35.890276 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:16:35.890262 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/11b17aab-3d0b-48ee-a3e9-2ba3ee4480cb-kube-rbac-proxy-cm podName:11b17aab-3d0b-48ee-a3e9-2ba3ee4480cb nodeName:}" failed. No retries permitted until 2026-07-06 21:16:36.390231191 +0000 UTC m=+219.337609174 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/11b17aab-3d0b-48ee-a3e9-2ba3ee4480cb-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vlfkz" (UID: "11b17aab-3d0b-48ee-a3e9-2ba3ee4480cb") : configmap "kube-rbac-proxy" not found Jul 06 21:16:35.890443 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:35.890426 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/11b17aab-3d0b-48ee-a3e9-2ba3ee4480cb-data-volume\") pod \"insights-runtime-extractor-vlfkz\" (UID: \"11b17aab-3d0b-48ee-a3e9-2ba3ee4480cb\") " pod="openshift-insights/insights-runtime-extractor-vlfkz" Jul 06 21:16:35.950171 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:35.950137 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gwfh5\" (UniqueName: \"kubernetes.io/projected/11b17aab-3d0b-48ee-a3e9-2ba3ee4480cb-kube-api-access-gwfh5\") pod \"insights-runtime-extractor-vlfkz\" (UID: \"11b17aab-3d0b-48ee-a3e9-2ba3ee4480cb\") " pod="openshift-insights/insights-runtime-extractor-vlfkz" Jul 06 21:16:36.393913 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:36.393871 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/11b17aab-3d0b-48ee-a3e9-2ba3ee4480cb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vlfkz\" (UID: \"11b17aab-3d0b-48ee-a3e9-2ba3ee4480cb\") " pod="openshift-insights/insights-runtime-extractor-vlfkz" Jul 06 21:16:36.393913 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:36.393923 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/11b17aab-3d0b-48ee-a3e9-2ba3ee4480cb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vlfkz\" (UID: \"11b17aab-3d0b-48ee-a3e9-2ba3ee4480cb\") " pod="openshift-insights/insights-runtime-extractor-vlfkz" Jul 06 21:16:36.394507 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:16:36.394057 2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 21:16:36.394507 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:16:36.394120 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/11b17aab-3d0b-48ee-a3e9-2ba3ee4480cb-kube-rbac-proxy-cm podName:11b17aab-3d0b-48ee-a3e9-2ba3ee4480cb nodeName:}" failed. No retries permitted until 2026-07-06 21:16:37.394100518 +0000 UTC m=+220.341478497 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/11b17aab-3d0b-48ee-a3e9-2ba3ee4480cb-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vlfkz" (UID: "11b17aab-3d0b-48ee-a3e9-2ba3ee4480cb") : configmap "kube-rbac-proxy" not found Jul 06 21:16:36.394507 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:16:36.394177 2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 21:16:36.394507 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:16:36.394260 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11b17aab-3d0b-48ee-a3e9-2ba3ee4480cb-insights-runtime-extractor-tls podName:11b17aab-3d0b-48ee-a3e9-2ba3ee4480cb nodeName:}" failed. No retries permitted until 2026-07-06 21:16:37.394217909 +0000 UTC m=+220.341595892 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/11b17aab-3d0b-48ee-a3e9-2ba3ee4480cb-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vlfkz" (UID: "11b17aab-3d0b-48ee-a3e9-2ba3ee4480cb") : secret "insights-runtime-extractor-tls" not found Jul 06 21:16:37.403871 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:37.403829 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/11b17aab-3d0b-48ee-a3e9-2ba3ee4480cb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vlfkz\" (UID: \"11b17aab-3d0b-48ee-a3e9-2ba3ee4480cb\") " pod="openshift-insights/insights-runtime-extractor-vlfkz" Jul 06 21:16:37.403871 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:37.403877 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/11b17aab-3d0b-48ee-a3e9-2ba3ee4480cb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vlfkz\" (UID: \"11b17aab-3d0b-48ee-a3e9-2ba3ee4480cb\") " pod="openshift-insights/insights-runtime-extractor-vlfkz" Jul 06 21:16:37.404539 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:16:37.403952 2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 21:16:37.404539 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:16:37.403973 2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 21:16:37.404539 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:16:37.404023 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/11b17aab-3d0b-48ee-a3e9-2ba3ee4480cb-kube-rbac-proxy-cm podName:11b17aab-3d0b-48ee-a3e9-2ba3ee4480cb nodeName:}" failed. No retries permitted until 2026-07-06 21:16:39.404006924 +0000 UTC m=+222.351384909 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/11b17aab-3d0b-48ee-a3e9-2ba3ee4480cb-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vlfkz" (UID: "11b17aab-3d0b-48ee-a3e9-2ba3ee4480cb") : configmap "kube-rbac-proxy" not found Jul 06 21:16:37.404539 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:16:37.404038 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11b17aab-3d0b-48ee-a3e9-2ba3ee4480cb-insights-runtime-extractor-tls podName:11b17aab-3d0b-48ee-a3e9-2ba3ee4480cb nodeName:}" failed. No retries permitted until 2026-07-06 21:16:39.404032111 +0000 UTC m=+222.351410091 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/11b17aab-3d0b-48ee-a3e9-2ba3ee4480cb-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vlfkz" (UID: "11b17aab-3d0b-48ee-a3e9-2ba3ee4480cb") : secret "insights-runtime-extractor-tls" not found Jul 06 21:16:37.544730 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:37.544700 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-tdbzc_e7ec46bc-523f-4480-9245-42931eac113a/dns-node-resolver/0.log" Jul 06 21:16:38.016929 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:38.016895 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-758f599c5-vf6j7"] Jul 06 21:16:38.018884 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:38.018868 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-vf6j7" Jul 06 21:16:38.022531 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:38.022505 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 06 21:16:38.023331 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:38.023312 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 06 21:16:38.023414 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:38.023320 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-jb27r\"" Jul 06 21:16:38.023500 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:38.023483 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 06 21:16:38.023712 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:38.023697 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 06 21:16:38.030571 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:38.030546 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-vf6j7"] Jul 06 21:16:38.110025 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:38.109988 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/411218e3-0ca5-4d1b-8a14-330c2d9e511b-signing-key\") pod \"service-ca-758f599c5-vf6j7\" (UID: \"411218e3-0ca5-4d1b-8a14-330c2d9e511b\") " pod="openshift-service-ca/service-ca-758f599c5-vf6j7" Jul 06 21:16:38.110213 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:38.110081 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-np9md\" (UniqueName: \"kubernetes.io/projected/411218e3-0ca5-4d1b-8a14-330c2d9e511b-kube-api-access-np9md\") pod \"service-ca-758f599c5-vf6j7\" (UID: \"411218e3-0ca5-4d1b-8a14-330c2d9e511b\") " pod="openshift-service-ca/service-ca-758f599c5-vf6j7" Jul 06 21:16:38.110213 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:38.110118 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/411218e3-0ca5-4d1b-8a14-330c2d9e511b-signing-cabundle\") pod \"service-ca-758f599c5-vf6j7\" (UID: \"411218e3-0ca5-4d1b-8a14-330c2d9e511b\") " pod="openshift-service-ca/service-ca-758f599c5-vf6j7" Jul 06 21:16:38.210982 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:38.210938 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-np9md\" (UniqueName: \"kubernetes.io/projected/411218e3-0ca5-4d1b-8a14-330c2d9e511b-kube-api-access-np9md\") pod \"service-ca-758f599c5-vf6j7\" (UID: \"411218e3-0ca5-4d1b-8a14-330c2d9e511b\") " pod="openshift-service-ca/service-ca-758f599c5-vf6j7" Jul 06 21:16:38.211181 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:38.210999 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/411218e3-0ca5-4d1b-8a14-330c2d9e511b-signing-cabundle\") pod \"service-ca-758f599c5-vf6j7\" (UID: \"411218e3-0ca5-4d1b-8a14-330c2d9e511b\") " pod="openshift-service-ca/service-ca-758f599c5-vf6j7" Jul 06 21:16:38.211289 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:38.211190 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/411218e3-0ca5-4d1b-8a14-330c2d9e511b-signing-key\") pod \"service-ca-758f599c5-vf6j7\" (UID: \"411218e3-0ca5-4d1b-8a14-330c2d9e511b\") " pod="openshift-service-ca/service-ca-758f599c5-vf6j7" Jul 06 21:16:38.211686 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:38.211663 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/411218e3-0ca5-4d1b-8a14-330c2d9e511b-signing-cabundle\") pod \"service-ca-758f599c5-vf6j7\" (UID: \"411218e3-0ca5-4d1b-8a14-330c2d9e511b\") " pod="openshift-service-ca/service-ca-758f599c5-vf6j7" Jul 06 21:16:38.213726 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:38.213703 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/411218e3-0ca5-4d1b-8a14-330c2d9e511b-signing-key\") pod \"service-ca-758f599c5-vf6j7\" (UID: \"411218e3-0ca5-4d1b-8a14-330c2d9e511b\") " pod="openshift-service-ca/service-ca-758f599c5-vf6j7" Jul 06 21:16:38.219179 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:38.219156 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-np9md\" (UniqueName: \"kubernetes.io/projected/411218e3-0ca5-4d1b-8a14-330c2d9e511b-kube-api-access-np9md\") pod \"service-ca-758f599c5-vf6j7\" (UID: \"411218e3-0ca5-4d1b-8a14-330c2d9e511b\") " pod="openshift-service-ca/service-ca-758f599c5-vf6j7" Jul 06 21:16:38.328400 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:38.328353 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-vf6j7" Jul 06 21:16:38.454131 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:38.454096 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-vf6j7"] Jul 06 21:16:38.456795 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:16:38.456767 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod411218e3_0ca5_4d1b_8a14_330c2d9e511b.slice/crio-36e76d29be5d08049b0f608159ba44fba7d1b302fb5fd19530c0487d384c98bf WatchSource:0}: Error finding container 36e76d29be5d08049b0f608159ba44fba7d1b302fb5fd19530c0487d384c98bf: Status 404 returned error can't find the container with id 36e76d29be5d08049b0f608159ba44fba7d1b302fb5fd19530c0487d384c98bf Jul 06 21:16:38.545432 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:38.545410 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-4rqvd_f4aa139a-9e46-4075-8358-6da2c8f30cec/node-ca/0.log" Jul 06 21:16:39.319281 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:39.319211 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d8b64eb8-e2ff-44a0-b9d9-67aba5e93c35-metrics-certs\") pod \"router-default-857d447b7f-25xtr\" (UID: \"d8b64eb8-e2ff-44a0-b9d9-67aba5e93c35\") " pod="openshift-ingress/router-default-857d447b7f-25xtr" Jul 06 21:16:39.319468 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:16:39.319360 2573 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 06 21:16:39.319468 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:39.319379 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d8b64eb8-e2ff-44a0-b9d9-67aba5e93c35-service-ca-bundle\") pod \"router-default-857d447b7f-25xtr\" (UID: \"d8b64eb8-e2ff-44a0-b9d9-67aba5e93c35\") " pod="openshift-ingress/router-default-857d447b7f-25xtr" Jul 06 21:16:39.319468 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:39.319410 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3b0e3d2b-e597-46a2-862e-43a336240246-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-kv8jl\" (UID: \"3b0e3d2b-e597-46a2-862e-43a336240246\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-kv8jl" Jul 06 21:16:39.319468 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:16:39.319421 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8b64eb8-e2ff-44a0-b9d9-67aba5e93c35-metrics-certs podName:d8b64eb8-e2ff-44a0-b9d9-67aba5e93c35 nodeName:}" failed. No retries permitted until 2026-07-06 21:16:47.319405132 +0000 UTC m=+230.266783111 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d8b64eb8-e2ff-44a0-b9d9-67aba5e93c35-metrics-certs") pod "router-default-857d447b7f-25xtr" (UID: "d8b64eb8-e2ff-44a0-b9d9-67aba5e93c35") : secret "router-metrics-certs-default" not found Jul 06 21:16:39.319628 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:16:39.319499 2573 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 06 21:16:39.319628 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:16:39.319551 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d8b64eb8-e2ff-44a0-b9d9-67aba5e93c35-service-ca-bundle podName:d8b64eb8-e2ff-44a0-b9d9-67aba5e93c35 nodeName:}" failed. No retries permitted until 2026-07-06 21:16:47.319528653 +0000 UTC m=+230.266906653 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d8b64eb8-e2ff-44a0-b9d9-67aba5e93c35-service-ca-bundle") pod "router-default-857d447b7f-25xtr" (UID: "d8b64eb8-e2ff-44a0-b9d9-67aba5e93c35") : configmap references non-existent config key: service-ca.crt Jul 06 21:16:39.319628 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:16:39.319572 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b0e3d2b-e597-46a2-862e-43a336240246-cluster-monitoring-operator-tls podName:3b0e3d2b-e597-46a2-862e-43a336240246 nodeName:}" failed. No retries permitted until 2026-07-06 21:16:47.319565417 +0000 UTC m=+230.266943397 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/3b0e3d2b-e597-46a2-862e-43a336240246-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-kv8jl" (UID: "3b0e3d2b-e597-46a2-862e-43a336240246") : secret "cluster-monitoring-operator-tls" not found Jul 06 21:16:39.326164 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:39.326133 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-vf6j7" event={"ID":"411218e3-0ca5-4d1b-8a14-330c2d9e511b","Type":"ContainerStarted","Data":"bbd94db901b7c1266a8bccca0d05a9291f8b244d456c6ffffcb5c8ad0f60be0c"} Jul 06 21:16:39.326328 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:39.326191 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-vf6j7" event={"ID":"411218e3-0ca5-4d1b-8a14-330c2d9e511b","Type":"ContainerStarted","Data":"36e76d29be5d08049b0f608159ba44fba7d1b302fb5fd19530c0487d384c98bf"} Jul 06 21:16:39.345759 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:39.345706 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-758f599c5-vf6j7" podStartSLOduration=1.345690891 podStartE2EDuration="1.345690891s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:16:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:16:39.344790668 +0000 UTC m=+222.292168670" watchObservedRunningTime="2026-07-06 21:16:39.345690891 +0000 UTC m=+222.293068892" Jul 06 21:16:39.348601 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:39.348566 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-5qvhk_5ccd93e4-2c62-426c-93af-da45c500e964/serve-healthcheck-canary/0.log" Jul 06 21:16:39.420396 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:39.420360 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/11b17aab-3d0b-48ee-a3e9-2ba3ee4480cb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vlfkz\" (UID: \"11b17aab-3d0b-48ee-a3e9-2ba3ee4480cb\") " pod="openshift-insights/insights-runtime-extractor-vlfkz" Jul 06 21:16:39.420579 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:39.420431 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/11b17aab-3d0b-48ee-a3e9-2ba3ee4480cb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vlfkz\" (UID: \"11b17aab-3d0b-48ee-a3e9-2ba3ee4480cb\") " pod="openshift-insights/insights-runtime-extractor-vlfkz" Jul 06 21:16:39.420579 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:16:39.420494 2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 21:16:39.420579 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:16:39.420530 2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 21:16:39.420735 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:16:39.420538 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/11b17aab-3d0b-48ee-a3e9-2ba3ee4480cb-kube-rbac-proxy-cm podName:11b17aab-3d0b-48ee-a3e9-2ba3ee4480cb nodeName:}" failed. No retries permitted until 2026-07-06 21:16:43.42052633 +0000 UTC m=+226.367904310 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/11b17aab-3d0b-48ee-a3e9-2ba3ee4480cb-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vlfkz" (UID: "11b17aab-3d0b-48ee-a3e9-2ba3ee4480cb") : configmap "kube-rbac-proxy" not found Jul 06 21:16:39.420735 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:16:39.420727 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11b17aab-3d0b-48ee-a3e9-2ba3ee4480cb-insights-runtime-extractor-tls podName:11b17aab-3d0b-48ee-a3e9-2ba3ee4480cb nodeName:}" failed. No retries permitted until 2026-07-06 21:16:43.420700406 +0000 UTC m=+226.368078402 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/11b17aab-3d0b-48ee-a3e9-2ba3ee4480cb-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vlfkz" (UID: "11b17aab-3d0b-48ee-a3e9-2ba3ee4480cb") : secret "insights-runtime-extractor-tls" not found Jul 06 21:16:43.457320 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:43.457285 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/11b17aab-3d0b-48ee-a3e9-2ba3ee4480cb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vlfkz\" (UID: \"11b17aab-3d0b-48ee-a3e9-2ba3ee4480cb\") " pod="openshift-insights/insights-runtime-extractor-vlfkz" Jul 06 21:16:43.457759 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:43.457343 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/11b17aab-3d0b-48ee-a3e9-2ba3ee4480cb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vlfkz\" (UID: \"11b17aab-3d0b-48ee-a3e9-2ba3ee4480cb\") " pod="openshift-insights/insights-runtime-extractor-vlfkz" Jul 06 21:16:43.457759 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:16:43.457447 2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 21:16:43.457759 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:16:43.457475 2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 21:16:43.457759 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:16:43.457512 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11b17aab-3d0b-48ee-a3e9-2ba3ee4480cb-insights-runtime-extractor-tls podName:11b17aab-3d0b-48ee-a3e9-2ba3ee4480cb nodeName:}" failed. No retries permitted until 2026-07-06 21:16:51.457495871 +0000 UTC m=+234.404873850 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/11b17aab-3d0b-48ee-a3e9-2ba3ee4480cb-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vlfkz" (UID: "11b17aab-3d0b-48ee-a3e9-2ba3ee4480cb") : secret "insights-runtime-extractor-tls" not found Jul 06 21:16:43.457759 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:16:43.457527 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/11b17aab-3d0b-48ee-a3e9-2ba3ee4480cb-kube-rbac-proxy-cm podName:11b17aab-3d0b-48ee-a3e9-2ba3ee4480cb nodeName:}" failed. No retries permitted until 2026-07-06 21:16:51.457520977 +0000 UTC m=+234.404898956 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/11b17aab-3d0b-48ee-a3e9-2ba3ee4480cb-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vlfkz" (UID: "11b17aab-3d0b-48ee-a3e9-2ba3ee4480cb") : configmap "kube-rbac-proxy" not found Jul 06 21:16:47.393701 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:47.393654 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d8b64eb8-e2ff-44a0-b9d9-67aba5e93c35-service-ca-bundle\") pod \"router-default-857d447b7f-25xtr\" (UID: \"d8b64eb8-e2ff-44a0-b9d9-67aba5e93c35\") " pod="openshift-ingress/router-default-857d447b7f-25xtr" Jul 06 21:16:47.393701 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:47.393704 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3b0e3d2b-e597-46a2-862e-43a336240246-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-kv8jl\" (UID: \"3b0e3d2b-e597-46a2-862e-43a336240246\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-kv8jl" Jul 06 21:16:47.394134 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:47.393739 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d8b64eb8-e2ff-44a0-b9d9-67aba5e93c35-metrics-certs\") pod \"router-default-857d447b7f-25xtr\" (UID: \"d8b64eb8-e2ff-44a0-b9d9-67aba5e93c35\") " pod="openshift-ingress/router-default-857d447b7f-25xtr" Jul 06 21:16:47.394391 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:47.394367 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d8b64eb8-e2ff-44a0-b9d9-67aba5e93c35-service-ca-bundle\") pod \"router-default-857d447b7f-25xtr\" (UID: \"d8b64eb8-e2ff-44a0-b9d9-67aba5e93c35\") " pod="openshift-ingress/router-default-857d447b7f-25xtr" Jul 06 21:16:47.396272 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:47.396228 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3b0e3d2b-e597-46a2-862e-43a336240246-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-kv8jl\" (UID: \"3b0e3d2b-e597-46a2-862e-43a336240246\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-kv8jl" Jul 06 21:16:47.396678 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:47.396661 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d8b64eb8-e2ff-44a0-b9d9-67aba5e93c35-metrics-certs\") pod \"router-default-857d447b7f-25xtr\" (UID: \"d8b64eb8-e2ff-44a0-b9d9-67aba5e93c35\") " pod="openshift-ingress/router-default-857d447b7f-25xtr" Jul 06 21:16:47.460381 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:47.460340 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-kv8jl" Jul 06 21:16:47.477142 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:47.477096 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-857d447b7f-25xtr" Jul 06 21:16:47.607350 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:47.607325 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-kv8jl"] Jul 06 21:16:47.609846 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:16:47.609809 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b0e3d2b_e597_46a2_862e_43a336240246.slice/crio-6ec9760040a484a49033a614358b5440b60406df24a095f6b85592c9e2a91309 WatchSource:0}: Error finding container 6ec9760040a484a49033a614358b5440b60406df24a095f6b85592c9e2a91309: Status 404 returned error can't find the container with id 6ec9760040a484a49033a614358b5440b60406df24a095f6b85592c9e2a91309 Jul 06 21:16:47.629803 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:47.629769 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-857d447b7f-25xtr"] Jul 06 21:16:47.632603 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:16:47.632579 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8b64eb8_e2ff_44a0_b9d9_67aba5e93c35.slice/crio-f0218eadd7948b5ec691eba3feb216bb04e5f54c808f9cb223d0f884cdeff7fe WatchSource:0}: Error finding container f0218eadd7948b5ec691eba3feb216bb04e5f54c808f9cb223d0f884cdeff7fe: Status 404 returned error can't find the container with id f0218eadd7948b5ec691eba3feb216bb04e5f54c808f9cb223d0f884cdeff7fe Jul 06 21:16:48.356169 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:48.356129 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-kv8jl" event={"ID":"3b0e3d2b-e597-46a2-862e-43a336240246","Type":"ContainerStarted","Data":"6ec9760040a484a49033a614358b5440b60406df24a095f6b85592c9e2a91309"} Jul 06 21:16:48.357583 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:48.357550 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-857d447b7f-25xtr" event={"ID":"d8b64eb8-e2ff-44a0-b9d9-67aba5e93c35","Type":"ContainerStarted","Data":"1e89657cea81451d1215792562994ba257f3d03647cabff3820c444fba2bea81"} Jul 06 21:16:48.357737 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:48.357596 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-857d447b7f-25xtr" event={"ID":"d8b64eb8-e2ff-44a0-b9d9-67aba5e93c35","Type":"ContainerStarted","Data":"f0218eadd7948b5ec691eba3feb216bb04e5f54c808f9cb223d0f884cdeff7fe"} Jul 06 21:16:48.380097 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:48.380040 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-857d447b7f-25xtr" podStartSLOduration=17.38002216 podStartE2EDuration="17.38002216s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:16:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:16:48.379278923 +0000 UTC m=+231.326656926" watchObservedRunningTime="2026-07-06 21:16:48.38002216 +0000 UTC m=+231.327400162" Jul 06 21:16:48.478342 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:48.478296 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-857d447b7f-25xtr" Jul 06 21:16:48.481521 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:48.481493 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-857d447b7f-25xtr" Jul 06 21:16:49.365672 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:49.363653 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-857d447b7f-25xtr" Jul 06 21:16:49.365672 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:49.365065 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-857d447b7f-25xtr" Jul 06 21:16:50.366485 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:50.366450 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-kv8jl" event={"ID":"3b0e3d2b-e597-46a2-862e-43a336240246","Type":"ContainerStarted","Data":"973d2736b33766f7c881b2b9fdf5f82e9f27c22386ea4afc6cdb548368d3758e"} Jul 06 21:16:50.395174 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:50.395119 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-kv8jl" podStartSLOduration=17.409542344 podStartE2EDuration="19.395100626s" totalImagesPullingTime="1.985558282s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:16:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:16:50.394724426 +0000 UTC m=+233.342102428" watchObservedRunningTime="2026-07-06 21:16:50.395100626 +0000 UTC m=+233.342478628" Jul 06 21:16:51.531697 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:51.531657 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/11b17aab-3d0b-48ee-a3e9-2ba3ee4480cb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vlfkz\" (UID: \"11b17aab-3d0b-48ee-a3e9-2ba3ee4480cb\") " pod="openshift-insights/insights-runtime-extractor-vlfkz" Jul 06 21:16:51.532076 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:51.531713 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/11b17aab-3d0b-48ee-a3e9-2ba3ee4480cb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vlfkz\" (UID: \"11b17aab-3d0b-48ee-a3e9-2ba3ee4480cb\") " pod="openshift-insights/insights-runtime-extractor-vlfkz" Jul 06 21:16:51.532292 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:51.532232 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/11b17aab-3d0b-48ee-a3e9-2ba3ee4480cb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vlfkz\" (UID: \"11b17aab-3d0b-48ee-a3e9-2ba3ee4480cb\") " pod="openshift-insights/insights-runtime-extractor-vlfkz" Jul 06 21:16:51.533928 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:51.533905 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/11b17aab-3d0b-48ee-a3e9-2ba3ee4480cb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vlfkz\" (UID: \"11b17aab-3d0b-48ee-a3e9-2ba3ee4480cb\") " pod="openshift-insights/insights-runtime-extractor-vlfkz" Jul 06 21:16:51.682036 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:51.682002 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-vlfkz" Jul 06 21:16:51.817550 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:51.817517 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-vlfkz"] Jul 06 21:16:51.820411 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:16:51.820379 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11b17aab_3d0b_48ee_a3e9_2ba3ee4480cb.slice/crio-9407512d93844e5cb1d22838d5a88f32813c47f7646444e1e760351c4009ae91 WatchSource:0}: Error finding container 9407512d93844e5cb1d22838d5a88f32813c47f7646444e1e760351c4009ae91: Status 404 returned error can't find the container with id 9407512d93844e5cb1d22838d5a88f32813c47f7646444e1e760351c4009ae91 Jul 06 21:16:52.376810 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:52.376684 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vlfkz" event={"ID":"11b17aab-3d0b-48ee-a3e9-2ba3ee4480cb","Type":"ContainerStarted","Data":"9407512d93844e5cb1d22838d5a88f32813c47f7646444e1e760351c4009ae91"} Jul 06 21:16:56.392356 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:56.392273 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vlfkz" event={"ID":"11b17aab-3d0b-48ee-a3e9-2ba3ee4480cb","Type":"ContainerStarted","Data":"85dce915de933304c0f196648001baa8d4c057712ec515c19eb2febc4b17041c"} Jul 06 21:16:56.392356 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:56.392332 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vlfkz" event={"ID":"11b17aab-3d0b-48ee-a3e9-2ba3ee4480cb","Type":"ContainerStarted","Data":"79619bc6362e327fb2bc8cdf94fa112f541c142a51d8887af24b22189350a218"} Jul 06 21:16:56.928131 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:56.928093 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-cbdt6"] Jul 06 21:16:56.930287 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:56.930265 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-cbdt6" Jul 06 21:16:56.933045 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:56.933018 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 06 21:16:56.934357 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:56.934333 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-l2cpr\"" Jul 06 21:16:56.943589 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:56.943559 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-cbdt6"] Jul 06 21:16:56.961048 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:56.960678 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5d5b8885c7-6zrwj"] Jul 06 21:16:56.963465 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:56.963347 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d5b8885c7-6zrwj" Jul 06 21:16:56.966270 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:56.966222 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 06 21:16:56.966748 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:56.966689 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 06 21:16:56.966953 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:56.966933 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 06 21:16:56.967724 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:56.967706 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-7xhcl\"" Jul 06 21:16:56.974432 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:56.974407 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 06 21:16:56.974672 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:56.974653 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/e1bcd6b2-0fc3-4df4-b9e6-6ab12096dbce-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-cbdt6\" (UID: \"e1bcd6b2-0fc3-4df4-b9e6-6ab12096dbce\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-cbdt6" Jul 06 21:16:56.979439 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:56.979411 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5d5b8885c7-6zrwj"] Jul 06 21:16:57.075485 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:57.075451 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/e1bcd6b2-0fc3-4df4-b9e6-6ab12096dbce-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-cbdt6\" (UID: \"e1bcd6b2-0fc3-4df4-b9e6-6ab12096dbce\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-cbdt6" Jul 06 21:16:57.075645 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:57.075503 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c215fc9a-5c0c-46a8-a0cb-c2e71626b614-trusted-ca\") pod \"image-registry-5d5b8885c7-6zrwj\" (UID: \"c215fc9a-5c0c-46a8-a0cb-c2e71626b614\") " pod="openshift-image-registry/image-registry-5d5b8885c7-6zrwj" Jul 06 21:16:57.075645 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:57.075525 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c215fc9a-5c0c-46a8-a0cb-c2e71626b614-image-registry-private-configuration\") pod \"image-registry-5d5b8885c7-6zrwj\" (UID: \"c215fc9a-5c0c-46a8-a0cb-c2e71626b614\") " pod="openshift-image-registry/image-registry-5d5b8885c7-6zrwj" Jul 06 21:16:57.075645 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:57.075545 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c215fc9a-5c0c-46a8-a0cb-c2e71626b614-registry-tls\") pod \"image-registry-5d5b8885c7-6zrwj\" (UID: \"c215fc9a-5c0c-46a8-a0cb-c2e71626b614\") " pod="openshift-image-registry/image-registry-5d5b8885c7-6zrwj" Jul 06 21:16:57.075645 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:57.075578 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c215fc9a-5c0c-46a8-a0cb-c2e71626b614-installation-pull-secrets\") pod \"image-registry-5d5b8885c7-6zrwj\" (UID: \"c215fc9a-5c0c-46a8-a0cb-c2e71626b614\") " pod="openshift-image-registry/image-registry-5d5b8885c7-6zrwj" Jul 06 21:16:57.075645 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:57.075593 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c215fc9a-5c0c-46a8-a0cb-c2e71626b614-bound-sa-token\") pod \"image-registry-5d5b8885c7-6zrwj\" (UID: \"c215fc9a-5c0c-46a8-a0cb-c2e71626b614\") " pod="openshift-image-registry/image-registry-5d5b8885c7-6zrwj" Jul 06 21:16:57.075895 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:57.075691 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7nxvc\" (UniqueName: \"kubernetes.io/projected/c215fc9a-5c0c-46a8-a0cb-c2e71626b614-kube-api-access-7nxvc\") pod \"image-registry-5d5b8885c7-6zrwj\" (UID: \"c215fc9a-5c0c-46a8-a0cb-c2e71626b614\") " pod="openshift-image-registry/image-registry-5d5b8885c7-6zrwj" Jul 06 21:16:57.075895 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:57.075729 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c215fc9a-5c0c-46a8-a0cb-c2e71626b614-registry-certificates\") pod \"image-registry-5d5b8885c7-6zrwj\" (UID: \"c215fc9a-5c0c-46a8-a0cb-c2e71626b614\") " pod="openshift-image-registry/image-registry-5d5b8885c7-6zrwj" Jul 06 21:16:57.075895 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:57.075774 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c215fc9a-5c0c-46a8-a0cb-c2e71626b614-ca-trust-extracted\") pod \"image-registry-5d5b8885c7-6zrwj\" (UID: \"c215fc9a-5c0c-46a8-a0cb-c2e71626b614\") " pod="openshift-image-registry/image-registry-5d5b8885c7-6zrwj" Jul 06 21:16:57.077804 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:57.077787 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/e1bcd6b2-0fc3-4df4-b9e6-6ab12096dbce-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-cbdt6\" (UID: \"e1bcd6b2-0fc3-4df4-b9e6-6ab12096dbce\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-cbdt6" Jul 06 21:16:57.176968 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:57.176932 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c215fc9a-5c0c-46a8-a0cb-c2e71626b614-trusted-ca\") pod \"image-registry-5d5b8885c7-6zrwj\" (UID: \"c215fc9a-5c0c-46a8-a0cb-c2e71626b614\") " pod="openshift-image-registry/image-registry-5d5b8885c7-6zrwj" Jul 06 21:16:57.176968 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:57.176969 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c215fc9a-5c0c-46a8-a0cb-c2e71626b614-image-registry-private-configuration\") pod \"image-registry-5d5b8885c7-6zrwj\" (UID: \"c215fc9a-5c0c-46a8-a0cb-c2e71626b614\") " pod="openshift-image-registry/image-registry-5d5b8885c7-6zrwj" Jul 06 21:16:57.177277 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:57.176989 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c215fc9a-5c0c-46a8-a0cb-c2e71626b614-registry-tls\") pod \"image-registry-5d5b8885c7-6zrwj\" (UID: \"c215fc9a-5c0c-46a8-a0cb-c2e71626b614\") " pod="openshift-image-registry/image-registry-5d5b8885c7-6zrwj" Jul 06 21:16:57.177277 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:57.177016 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c215fc9a-5c0c-46a8-a0cb-c2e71626b614-installation-pull-secrets\") pod \"image-registry-5d5b8885c7-6zrwj\" (UID: \"c215fc9a-5c0c-46a8-a0cb-c2e71626b614\") " pod="openshift-image-registry/image-registry-5d5b8885c7-6zrwj" Jul 06 21:16:57.177277 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:57.177041 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c215fc9a-5c0c-46a8-a0cb-c2e71626b614-bound-sa-token\") pod \"image-registry-5d5b8885c7-6zrwj\" (UID: \"c215fc9a-5c0c-46a8-a0cb-c2e71626b614\") " pod="openshift-image-registry/image-registry-5d5b8885c7-6zrwj" Jul 06 21:16:57.177277 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:57.177173 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7nxvc\" (UniqueName: \"kubernetes.io/projected/c215fc9a-5c0c-46a8-a0cb-c2e71626b614-kube-api-access-7nxvc\") pod \"image-registry-5d5b8885c7-6zrwj\" (UID: \"c215fc9a-5c0c-46a8-a0cb-c2e71626b614\") " pod="openshift-image-registry/image-registry-5d5b8885c7-6zrwj" Jul 06 21:16:57.177277 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:57.177219 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c215fc9a-5c0c-46a8-a0cb-c2e71626b614-registry-certificates\") pod \"image-registry-5d5b8885c7-6zrwj\" (UID: \"c215fc9a-5c0c-46a8-a0cb-c2e71626b614\") " pod="openshift-image-registry/image-registry-5d5b8885c7-6zrwj" Jul 06 21:16:57.177548 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:57.177380 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c215fc9a-5c0c-46a8-a0cb-c2e71626b614-ca-trust-extracted\") pod \"image-registry-5d5b8885c7-6zrwj\" (UID: \"c215fc9a-5c0c-46a8-a0cb-c2e71626b614\") " pod="openshift-image-registry/image-registry-5d5b8885c7-6zrwj" Jul 06 21:16:57.177783 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:57.177757 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c215fc9a-5c0c-46a8-a0cb-c2e71626b614-ca-trust-extracted\") pod \"image-registry-5d5b8885c7-6zrwj\" (UID: \"c215fc9a-5c0c-46a8-a0cb-c2e71626b614\") " pod="openshift-image-registry/image-registry-5d5b8885c7-6zrwj" Jul 06 21:16:57.177907 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:57.177895 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c215fc9a-5c0c-46a8-a0cb-c2e71626b614-registry-certificates\") pod \"image-registry-5d5b8885c7-6zrwj\" (UID: \"c215fc9a-5c0c-46a8-a0cb-c2e71626b614\") " pod="openshift-image-registry/image-registry-5d5b8885c7-6zrwj" Jul 06 21:16:57.178026 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:57.178007 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c215fc9a-5c0c-46a8-a0cb-c2e71626b614-trusted-ca\") pod \"image-registry-5d5b8885c7-6zrwj\" (UID: \"c215fc9a-5c0c-46a8-a0cb-c2e71626b614\") " pod="openshift-image-registry/image-registry-5d5b8885c7-6zrwj" Jul 06 21:16:57.179746 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:57.179689 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c215fc9a-5c0c-46a8-a0cb-c2e71626b614-installation-pull-secrets\") pod \"image-registry-5d5b8885c7-6zrwj\" (UID: \"c215fc9a-5c0c-46a8-a0cb-c2e71626b614\") " pod="openshift-image-registry/image-registry-5d5b8885c7-6zrwj" Jul 06 21:16:57.179746 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:57.179702 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c215fc9a-5c0c-46a8-a0cb-c2e71626b614-registry-tls\") pod \"image-registry-5d5b8885c7-6zrwj\" (UID: \"c215fc9a-5c0c-46a8-a0cb-c2e71626b614\") " pod="openshift-image-registry/image-registry-5d5b8885c7-6zrwj" Jul 06 21:16:57.179866 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:57.179767 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c215fc9a-5c0c-46a8-a0cb-c2e71626b614-image-registry-private-configuration\") pod \"image-registry-5d5b8885c7-6zrwj\" (UID: \"c215fc9a-5c0c-46a8-a0cb-c2e71626b614\") " pod="openshift-image-registry/image-registry-5d5b8885c7-6zrwj" Jul 06 21:16:57.197328 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:57.197298 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c215fc9a-5c0c-46a8-a0cb-c2e71626b614-bound-sa-token\") pod \"image-registry-5d5b8885c7-6zrwj\" (UID: \"c215fc9a-5c0c-46a8-a0cb-c2e71626b614\") " pod="openshift-image-registry/image-registry-5d5b8885c7-6zrwj" Jul 06 21:16:57.203338 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:57.203310 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7nxvc\" (UniqueName: \"kubernetes.io/projected/c215fc9a-5c0c-46a8-a0cb-c2e71626b614-kube-api-access-7nxvc\") pod \"image-registry-5d5b8885c7-6zrwj\" (UID: \"c215fc9a-5c0c-46a8-a0cb-c2e71626b614\") " pod="openshift-image-registry/image-registry-5d5b8885c7-6zrwj" Jul 06 21:16:57.242442 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:57.242402 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-cbdt6" Jul 06 21:16:57.275307 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:57.275272 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d5b8885c7-6zrwj" Jul 06 21:16:57.420554 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:57.420521 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-cbdt6"] Jul 06 21:16:57.424327 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:16:57.424295 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1bcd6b2_0fc3_4df4_b9e6_6ab12096dbce.slice/crio-f2c177a733245317adb9871fa2354e7cd54b400cb6595ffa7fbf149a617eed0b WatchSource:0}: Error finding container f2c177a733245317adb9871fa2354e7cd54b400cb6595ffa7fbf149a617eed0b: Status 404 returned error can't find the container with id f2c177a733245317adb9871fa2354e7cd54b400cb6595ffa7fbf149a617eed0b Jul 06 21:16:57.462215 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:57.462093 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5d5b8885c7-6zrwj"] Jul 06 21:16:57.465314 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:16:57.465282 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc215fc9a_5c0c_46a8_a0cb_c2e71626b614.slice/crio-5b5cb55cf22592a8a7b395676c3c55c63768968f6577443de2f36ea58aed1a5b WatchSource:0}: Error finding container 5b5cb55cf22592a8a7b395676c3c55c63768968f6577443de2f36ea58aed1a5b: Status 404 returned error can't find the container with id 5b5cb55cf22592a8a7b395676c3c55c63768968f6577443de2f36ea58aed1a5b Jul 06 21:16:58.401373 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:58.401334 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5d5b8885c7-6zrwj" event={"ID":"c215fc9a-5c0c-46a8-a0cb-c2e71626b614","Type":"ContainerStarted","Data":"c66d442c343bf326c8508fb9aab6a84f9c35a73a0c8c83a2d9771e1374a7bf6f"} Jul 06 21:16:58.401550 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:58.401394 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5d5b8885c7-6zrwj" event={"ID":"c215fc9a-5c0c-46a8-a0cb-c2e71626b614","Type":"ContainerStarted","Data":"5b5cb55cf22592a8a7b395676c3c55c63768968f6577443de2f36ea58aed1a5b"} Jul 06 21:16:58.401624 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:58.401572 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5d5b8885c7-6zrwj" Jul 06 21:16:58.402670 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:58.402643 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-cbdt6" event={"ID":"e1bcd6b2-0fc3-4df4-b9e6-6ab12096dbce","Type":"ContainerStarted","Data":"f2c177a733245317adb9871fa2354e7cd54b400cb6595ffa7fbf149a617eed0b"} Jul 06 21:16:58.425268 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:58.425193 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5d5b8885c7-6zrwj" podStartSLOduration=2.425169748 podStartE2EDuration="2.425169748s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:16:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:16:58.422522072 +0000 UTC m=+241.369900078" watchObservedRunningTime="2026-07-06 21:16:58.425169748 +0000 UTC m=+241.372547756" Jul 06 21:16:59.407768 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:59.407732 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vlfkz" event={"ID":"11b17aab-3d0b-48ee-a3e9-2ba3ee4480cb","Type":"ContainerStarted","Data":"a61469a7ebc2c5d40c2a9f9cecb9e73dced3f179b50736e98149f7ed25262f5b"} Jul 06 21:16:59.409279 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:59.409251 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-cbdt6" event={"ID":"e1bcd6b2-0fc3-4df4-b9e6-6ab12096dbce","Type":"ContainerStarted","Data":"7aae8b0d44256e26d4501534730437e751371071edab8fdff78ef5e20d7bd28f"} Jul 06 21:16:59.409404 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:59.409339 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-cbdt6" Jul 06 21:16:59.414117 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:59.414095 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-cbdt6" Jul 06 21:16:59.427194 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:59.427144 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-vlfkz" podStartSLOduration=17.073626378 podStartE2EDuration="24.427129996s" totalImagesPullingTime="7.353503618s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 21:16:35 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:16:59.42579003 +0000 UTC m=+242.373168034" watchObservedRunningTime="2026-07-06 21:16:59.427129996 +0000 UTC m=+242.374507998" Jul 06 21:16:59.441315 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:16:59.441262 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-cbdt6" podStartSLOduration=1.585832484 podStartE2EDuration="3.441229948s" totalImagesPullingTime="1.855397464s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:16:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:16:59.440608569 +0000 UTC m=+242.387986570" watchObservedRunningTime="2026-07-06 21:16:59.441229948 +0000 UTC m=+242.388607949" Jul 06 21:17:04.522795 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:04.522760 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-2g5t9"] Jul 06 21:17:04.527785 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:04.527759 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-2g5t9" Jul 06 21:17:04.530883 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:04.530855 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 06 21:17:04.531035 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:04.530915 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 06 21:17:04.531035 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:04.530863 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 06 21:17:04.531181 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:04.531092 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 06 21:17:04.531181 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:04.531102 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-kmcbx"] Jul 06 21:17:04.531703 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:04.531682 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-brw6k\"" Jul 06 21:17:04.534789 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:04.534767 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-kmcbx" Jul 06 21:17:04.537455 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:04.537434 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 06 21:17:04.537586 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:04.537532 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-4wzd5\"" Jul 06 21:17:04.537586 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:04.537538 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 06 21:17:04.537702 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:04.537640 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 06 21:17:04.544403 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:04.544378 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-kmcbx"] Jul 06 21:17:04.637891 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:04.637846 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d21e8abf-7bce-4616-ac0e-d933f93f01a4-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-kmcbx\" (UID: \"d21e8abf-7bce-4616-ac0e-d933f93f01a4\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-kmcbx" Jul 06 21:17:04.637891 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:04.637891 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f2fbd02b-d01c-45d2-ba0d-2405b282570b-metrics-client-ca\") pod \"node-exporter-2g5t9\" (UID: \"f2fbd02b-d01c-45d2-ba0d-2405b282570b\") " pod="openshift-monitoring/node-exporter-2g5t9" Jul 06 21:17:04.638097 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:04.637925 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f2fbd02b-d01c-45d2-ba0d-2405b282570b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2g5t9\" (UID: \"f2fbd02b-d01c-45d2-ba0d-2405b282570b\") " pod="openshift-monitoring/node-exporter-2g5t9" Jul 06 21:17:04.638097 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:04.637976 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f2fbd02b-d01c-45d2-ba0d-2405b282570b-node-exporter-accelerators-collector-config\") pod \"node-exporter-2g5t9\" (UID: \"f2fbd02b-d01c-45d2-ba0d-2405b282570b\") " pod="openshift-monitoring/node-exporter-2g5t9" Jul 06 21:17:04.638097 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:04.638037 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/d21e8abf-7bce-4616-ac0e-d933f93f01a4-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-kmcbx\" (UID: \"d21e8abf-7bce-4616-ac0e-d933f93f01a4\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-kmcbx" Jul 06 21:17:04.638097 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:04.638064 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/d21e8abf-7bce-4616-ac0e-d933f93f01a4-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-kmcbx\" (UID: \"d21e8abf-7bce-4616-ac0e-d933f93f01a4\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-kmcbx" Jul 06 21:17:04.638097 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:04.638087 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f2fbd02b-d01c-45d2-ba0d-2405b282570b-node-exporter-wtmp\") pod \"node-exporter-2g5t9\" (UID: \"f2fbd02b-d01c-45d2-ba0d-2405b282570b\") " pod="openshift-monitoring/node-exporter-2g5t9" Jul 06 21:17:04.638259 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:04.638110 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d21e8abf-7bce-4616-ac0e-d933f93f01a4-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-kmcbx\" (UID: \"d21e8abf-7bce-4616-ac0e-d933f93f01a4\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-kmcbx" Jul 06 21:17:04.638259 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:04.638165 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f2fbd02b-d01c-45d2-ba0d-2405b282570b-node-exporter-textfile\") pod \"node-exporter-2g5t9\" (UID: \"f2fbd02b-d01c-45d2-ba0d-2405b282570b\") " pod="openshift-monitoring/node-exporter-2g5t9" Jul 06 21:17:04.638259 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:04.638185 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f2fbd02b-d01c-45d2-ba0d-2405b282570b-node-exporter-tls\") pod \"node-exporter-2g5t9\" (UID: \"f2fbd02b-d01c-45d2-ba0d-2405b282570b\") " pod="openshift-monitoring/node-exporter-2g5t9" Jul 06 21:17:04.638351 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:04.638259 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v2vxq\" (UniqueName: \"kubernetes.io/projected/d21e8abf-7bce-4616-ac0e-d933f93f01a4-kube-api-access-v2vxq\") pod \"kube-state-metrics-7c9dbb8b7d-kmcbx\" (UID: \"d21e8abf-7bce-4616-ac0e-d933f93f01a4\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-kmcbx" Jul 06 21:17:04.638351 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:04.638307 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d21e8abf-7bce-4616-ac0e-d933f93f01a4-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-kmcbx\" (UID: \"d21e8abf-7bce-4616-ac0e-d933f93f01a4\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-kmcbx" Jul 06 21:17:04.638351 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:04.638337 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d2s27\" (UniqueName: \"kubernetes.io/projected/f2fbd02b-d01c-45d2-ba0d-2405b282570b-kube-api-access-d2s27\") pod \"node-exporter-2g5t9\" (UID: \"f2fbd02b-d01c-45d2-ba0d-2405b282570b\") " pod="openshift-monitoring/node-exporter-2g5t9" Jul 06 21:17:04.638441 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:04.638398 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f2fbd02b-d01c-45d2-ba0d-2405b282570b-root\") pod \"node-exporter-2g5t9\" (UID: \"f2fbd02b-d01c-45d2-ba0d-2405b282570b\") " pod="openshift-monitoring/node-exporter-2g5t9" Jul 06 21:17:04.638441 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:04.638430 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f2fbd02b-d01c-45d2-ba0d-2405b282570b-sys\") pod \"node-exporter-2g5t9\" (UID: \"f2fbd02b-d01c-45d2-ba0d-2405b282570b\") " pod="openshift-monitoring/node-exporter-2g5t9" Jul 06 21:17:04.739462 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:04.739408 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/d21e8abf-7bce-4616-ac0e-d933f93f01a4-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-kmcbx\" (UID: \"d21e8abf-7bce-4616-ac0e-d933f93f01a4\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-kmcbx" Jul 06 21:17:04.739462 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:04.739462 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/d21e8abf-7bce-4616-ac0e-d933f93f01a4-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-kmcbx\" (UID: \"d21e8abf-7bce-4616-ac0e-d933f93f01a4\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-kmcbx" Jul 06 21:17:04.739687 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:04.739484 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f2fbd02b-d01c-45d2-ba0d-2405b282570b-node-exporter-wtmp\") pod \"node-exporter-2g5t9\" (UID: \"f2fbd02b-d01c-45d2-ba0d-2405b282570b\") " pod="openshift-monitoring/node-exporter-2g5t9" Jul 06 21:17:04.739687 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:04.739506 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d21e8abf-7bce-4616-ac0e-d933f93f01a4-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-kmcbx\" (UID: \"d21e8abf-7bce-4616-ac0e-d933f93f01a4\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-kmcbx" Jul 06 21:17:04.739687 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:04.739533 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f2fbd02b-d01c-45d2-ba0d-2405b282570b-node-exporter-textfile\") pod \"node-exporter-2g5t9\" (UID: \"f2fbd02b-d01c-45d2-ba0d-2405b282570b\") " pod="openshift-monitoring/node-exporter-2g5t9" Jul 06 21:17:04.739687 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:04.739557 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f2fbd02b-d01c-45d2-ba0d-2405b282570b-node-exporter-tls\") pod \"node-exporter-2g5t9\" (UID: \"f2fbd02b-d01c-45d2-ba0d-2405b282570b\") " pod="openshift-monitoring/node-exporter-2g5t9" Jul 06 21:17:04.739687 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:04.739578 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v2vxq\" (UniqueName: \"kubernetes.io/projected/d21e8abf-7bce-4616-ac0e-d933f93f01a4-kube-api-access-v2vxq\") pod \"kube-state-metrics-7c9dbb8b7d-kmcbx\" (UID: \"d21e8abf-7bce-4616-ac0e-d933f93f01a4\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-kmcbx" Jul 06 21:17:04.740020 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:04.739684 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f2fbd02b-d01c-45d2-ba0d-2405b282570b-node-exporter-wtmp\") pod \"node-exporter-2g5t9\" (UID: \"f2fbd02b-d01c-45d2-ba0d-2405b282570b\") " pod="openshift-monitoring/node-exporter-2g5t9" Jul 06 21:17:04.740020 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:04.739727 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d21e8abf-7bce-4616-ac0e-d933f93f01a4-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-kmcbx\" (UID: \"d21e8abf-7bce-4616-ac0e-d933f93f01a4\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-kmcbx" Jul 06 21:17:04.740020 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:04.739778 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d2s27\" (UniqueName: \"kubernetes.io/projected/f2fbd02b-d01c-45d2-ba0d-2405b282570b-kube-api-access-d2s27\") pod \"node-exporter-2g5t9\" (UID: \"f2fbd02b-d01c-45d2-ba0d-2405b282570b\") " pod="openshift-monitoring/node-exporter-2g5t9" Jul 06 21:17:04.740020 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:04.739833 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f2fbd02b-d01c-45d2-ba0d-2405b282570b-root\") pod \"node-exporter-2g5t9\" (UID: \"f2fbd02b-d01c-45d2-ba0d-2405b282570b\") " pod="openshift-monitoring/node-exporter-2g5t9" Jul 06 21:17:04.740020 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:04.739860 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f2fbd02b-d01c-45d2-ba0d-2405b282570b-sys\") pod \"node-exporter-2g5t9\" (UID: \"f2fbd02b-d01c-45d2-ba0d-2405b282570b\") " pod="openshift-monitoring/node-exporter-2g5t9" Jul 06 21:17:04.740020 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:04.739889 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d21e8abf-7bce-4616-ac0e-d933f93f01a4-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-kmcbx\" (UID: \"d21e8abf-7bce-4616-ac0e-d933f93f01a4\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-kmcbx" Jul 06 21:17:04.740020 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:04.739915 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f2fbd02b-d01c-45d2-ba0d-2405b282570b-metrics-client-ca\") pod \"node-exporter-2g5t9\" (UID: \"f2fbd02b-d01c-45d2-ba0d-2405b282570b\") " pod="openshift-monitoring/node-exporter-2g5t9" Jul 06 21:17:04.740020 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:04.739947 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f2fbd02b-d01c-45d2-ba0d-2405b282570b-root\") pod \"node-exporter-2g5t9\" (UID: \"f2fbd02b-d01c-45d2-ba0d-2405b282570b\") " pod="openshift-monitoring/node-exporter-2g5t9" Jul 06 21:17:04.740020 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:04.739951 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f2fbd02b-d01c-45d2-ba0d-2405b282570b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2g5t9\" (UID: \"f2fbd02b-d01c-45d2-ba0d-2405b282570b\") " pod="openshift-monitoring/node-exporter-2g5t9" Jul 06 21:17:04.740020 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:04.739988 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/d21e8abf-7bce-4616-ac0e-d933f93f01a4-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-kmcbx\" (UID: \"d21e8abf-7bce-4616-ac0e-d933f93f01a4\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-kmcbx" Jul 06 21:17:04.740020 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:04.740008 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f2fbd02b-d01c-45d2-ba0d-2405b282570b-node-exporter-accelerators-collector-config\") pod \"node-exporter-2g5t9\" (UID: \"f2fbd02b-d01c-45d2-ba0d-2405b282570b\") " pod="openshift-monitoring/node-exporter-2g5t9" Jul 06 21:17:04.740540 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:04.739953 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f2fbd02b-d01c-45d2-ba0d-2405b282570b-node-exporter-textfile\") pod \"node-exporter-2g5t9\" (UID: \"f2fbd02b-d01c-45d2-ba0d-2405b282570b\") " pod="openshift-monitoring/node-exporter-2g5t9" Jul 06 21:17:04.740540 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:04.740231 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f2fbd02b-d01c-45d2-ba0d-2405b282570b-sys\") pod \"node-exporter-2g5t9\" (UID: \"f2fbd02b-d01c-45d2-ba0d-2405b282570b\") " pod="openshift-monitoring/node-exporter-2g5t9" Jul 06 21:17:04.740540 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:04.740363 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/d21e8abf-7bce-4616-ac0e-d933f93f01a4-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-kmcbx\" (UID: \"d21e8abf-7bce-4616-ac0e-d933f93f01a4\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-kmcbx" Jul 06 21:17:04.740540 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:04.740482 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d21e8abf-7bce-4616-ac0e-d933f93f01a4-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-kmcbx\" (UID: \"d21e8abf-7bce-4616-ac0e-d933f93f01a4\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-kmcbx" Jul 06 21:17:04.740753 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:04.740562 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f2fbd02b-d01c-45d2-ba0d-2405b282570b-metrics-client-ca\") pod \"node-exporter-2g5t9\" (UID: \"f2fbd02b-d01c-45d2-ba0d-2405b282570b\") " pod="openshift-monitoring/node-exporter-2g5t9" Jul 06 21:17:04.740870 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:04.740850 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f2fbd02b-d01c-45d2-ba0d-2405b282570b-node-exporter-accelerators-collector-config\") pod \"node-exporter-2g5t9\" (UID: \"f2fbd02b-d01c-45d2-ba0d-2405b282570b\") " pod="openshift-monitoring/node-exporter-2g5t9" Jul 06 21:17:04.742457 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:04.742433 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d21e8abf-7bce-4616-ac0e-d933f93f01a4-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-kmcbx\" (UID: \"d21e8abf-7bce-4616-ac0e-d933f93f01a4\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-kmcbx" Jul 06 21:17:04.742590 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:04.742509 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d21e8abf-7bce-4616-ac0e-d933f93f01a4-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-kmcbx\" (UID: \"d21e8abf-7bce-4616-ac0e-d933f93f01a4\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-kmcbx" Jul 06 21:17:04.742590 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:04.742576 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f2fbd02b-d01c-45d2-ba0d-2405b282570b-node-exporter-tls\") pod \"node-exporter-2g5t9\" (UID: \"f2fbd02b-d01c-45d2-ba0d-2405b282570b\") " pod="openshift-monitoring/node-exporter-2g5t9" Jul 06 21:17:04.742675 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:04.742608 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f2fbd02b-d01c-45d2-ba0d-2405b282570b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2g5t9\" (UID: \"f2fbd02b-d01c-45d2-ba0d-2405b282570b\") " pod="openshift-monitoring/node-exporter-2g5t9" Jul 06 21:17:04.747512 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:04.747480 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d2s27\" (UniqueName: \"kubernetes.io/projected/f2fbd02b-d01c-45d2-ba0d-2405b282570b-kube-api-access-d2s27\") pod \"node-exporter-2g5t9\" (UID: \"f2fbd02b-d01c-45d2-ba0d-2405b282570b\") " pod="openshift-monitoring/node-exporter-2g5t9" Jul 06 21:17:04.747634 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:04.747587 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v2vxq\" (UniqueName: \"kubernetes.io/projected/d21e8abf-7bce-4616-ac0e-d933f93f01a4-kube-api-access-v2vxq\") pod \"kube-state-metrics-7c9dbb8b7d-kmcbx\" (UID: \"d21e8abf-7bce-4616-ac0e-d933f93f01a4\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-kmcbx" Jul 06 21:17:04.838510 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:04.838475 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-2g5t9" Jul 06 21:17:04.846750 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:04.846700 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-kmcbx" Jul 06 21:17:04.862033 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:17:04.862003 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2fbd02b_d01c_45d2_ba0d_2405b282570b.slice/crio-4b14d46aab63212f47c9665bcaaae0a771d908aa9812bb42300430d6dd72ca13 WatchSource:0}: Error finding container 4b14d46aab63212f47c9665bcaaae0a771d908aa9812bb42300430d6dd72ca13: Status 404 returned error can't find the container with id 4b14d46aab63212f47c9665bcaaae0a771d908aa9812bb42300430d6dd72ca13 Jul 06 21:17:04.997028 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:04.996997 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-kmcbx"] Jul 06 21:17:04.999912 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:17:04.999878 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd21e8abf_7bce_4616_ac0e_d933f93f01a4.slice/crio-4ca603ca4c74ba76a1758d6ad0ed2e4250fb312aaf754a3ed3ac9f290cf8c956 WatchSource:0}: Error finding container 4ca603ca4c74ba76a1758d6ad0ed2e4250fb312aaf754a3ed3ac9f290cf8c956: Status 404 returned error can't find the container with id 4ca603ca4c74ba76a1758d6ad0ed2e4250fb312aaf754a3ed3ac9f290cf8c956 Jul 06 21:17:05.430267 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:05.430211 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2g5t9" event={"ID":"f2fbd02b-d01c-45d2-ba0d-2405b282570b","Type":"ContainerStarted","Data":"4b14d46aab63212f47c9665bcaaae0a771d908aa9812bb42300430d6dd72ca13"} Jul 06 21:17:05.432147 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:05.432119 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-kmcbx" event={"ID":"d21e8abf-7bce-4616-ac0e-d933f93f01a4","Type":"ContainerStarted","Data":"4ca603ca4c74ba76a1758d6ad0ed2e4250fb312aaf754a3ed3ac9f290cf8c956"} Jul 06 21:17:05.593582 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:05.593543 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 21:17:05.597750 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:05.597727 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 06 21:17:05.604362 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:05.604338 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 06 21:17:05.604362 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:05.604338 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 06 21:17:05.604772 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:05.604741 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 06 21:17:05.604907 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:05.604811 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 06 21:17:05.604907 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:05.604818 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 06 21:17:05.604907 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:05.604900 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-smrv5\"" Jul 06 21:17:05.605066 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:05.604751 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 06 21:17:05.605216 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:05.605195 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 06 21:17:05.605378 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:05.605360 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 06 21:17:05.605612 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:05.605585 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 06 21:17:05.614212 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:05.614186 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 21:17:05.748047 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:05.747745 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/15bebbc5-dd43-4780-813f-a81a7918e996-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"15bebbc5-dd43-4780-813f-a81a7918e996\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 21:17:05.748047 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:05.747879 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/15bebbc5-dd43-4780-813f-a81a7918e996-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"15bebbc5-dd43-4780-813f-a81a7918e996\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 21:17:05.748047 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:05.748011 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/15bebbc5-dd43-4780-813f-a81a7918e996-config-volume\") pod \"alertmanager-main-0\" (UID: \"15bebbc5-dd43-4780-813f-a81a7918e996\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 21:17:05.748047 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:05.748039 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/15bebbc5-dd43-4780-813f-a81a7918e996-config-out\") pod \"alertmanager-main-0\" (UID: \"15bebbc5-dd43-4780-813f-a81a7918e996\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 21:17:05.748431 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:05.748115 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/15bebbc5-dd43-4780-813f-a81a7918e996-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"15bebbc5-dd43-4780-813f-a81a7918e996\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 21:17:05.748431 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:05.748174 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/15bebbc5-dd43-4780-813f-a81a7918e996-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"15bebbc5-dd43-4780-813f-a81a7918e996\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 21:17:05.748431 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:05.748203 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w2bb4\" (UniqueName: \"kubernetes.io/projected/15bebbc5-dd43-4780-813f-a81a7918e996-kube-api-access-w2bb4\") pod \"alertmanager-main-0\" (UID: \"15bebbc5-dd43-4780-813f-a81a7918e996\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 21:17:05.748431 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:05.748284 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/15bebbc5-dd43-4780-813f-a81a7918e996-tls-assets\") pod \"alertmanager-main-0\" (UID: \"15bebbc5-dd43-4780-813f-a81a7918e996\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 21:17:05.749940 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:05.749711 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/15bebbc5-dd43-4780-813f-a81a7918e996-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"15bebbc5-dd43-4780-813f-a81a7918e996\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 21:17:05.749940 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:05.749784 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/15bebbc5-dd43-4780-813f-a81a7918e996-web-config\") pod \"alertmanager-main-0\" (UID: \"15bebbc5-dd43-4780-813f-a81a7918e996\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 21:17:05.749940 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:05.749827 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/15bebbc5-dd43-4780-813f-a81a7918e996-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"15bebbc5-dd43-4780-813f-a81a7918e996\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 21:17:05.749940 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:05.749923 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/15bebbc5-dd43-4780-813f-a81a7918e996-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"15bebbc5-dd43-4780-813f-a81a7918e996\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 21:17:05.750203 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:05.749968 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/15bebbc5-dd43-4780-813f-a81a7918e996-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"15bebbc5-dd43-4780-813f-a81a7918e996\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 21:17:05.856546 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:05.850585 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/15bebbc5-dd43-4780-813f-a81a7918e996-web-config\") pod \"alertmanager-main-0\" (UID: \"15bebbc5-dd43-4780-813f-a81a7918e996\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 21:17:05.856546 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:05.850636 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/15bebbc5-dd43-4780-813f-a81a7918e996-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"15bebbc5-dd43-4780-813f-a81a7918e996\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 21:17:05.856546 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:05.850704 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/15bebbc5-dd43-4780-813f-a81a7918e996-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"15bebbc5-dd43-4780-813f-a81a7918e996\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 21:17:05.856546 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:05.850742 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/15bebbc5-dd43-4780-813f-a81a7918e996-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"15bebbc5-dd43-4780-813f-a81a7918e996\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 21:17:05.856546 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:05.850777 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/15bebbc5-dd43-4780-813f-a81a7918e996-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"15bebbc5-dd43-4780-813f-a81a7918e996\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 21:17:05.856546 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:05.850820 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/15bebbc5-dd43-4780-813f-a81a7918e996-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"15bebbc5-dd43-4780-813f-a81a7918e996\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 21:17:05.856546 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:05.850861 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/15bebbc5-dd43-4780-813f-a81a7918e996-config-volume\") pod \"alertmanager-main-0\" (UID: \"15bebbc5-dd43-4780-813f-a81a7918e996\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 21:17:05.856546 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:05.850880 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/15bebbc5-dd43-4780-813f-a81a7918e996-config-out\") pod \"alertmanager-main-0\" (UID: \"15bebbc5-dd43-4780-813f-a81a7918e996\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 21:17:05.856546 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:05.850904 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/15bebbc5-dd43-4780-813f-a81a7918e996-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"15bebbc5-dd43-4780-813f-a81a7918e996\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 21:17:05.856546 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:05.850925 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/15bebbc5-dd43-4780-813f-a81a7918e996-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"15bebbc5-dd43-4780-813f-a81a7918e996\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 21:17:05.856546 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:05.850949 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w2bb4\" (UniqueName: \"kubernetes.io/projected/15bebbc5-dd43-4780-813f-a81a7918e996-kube-api-access-w2bb4\") pod \"alertmanager-main-0\" (UID: \"15bebbc5-dd43-4780-813f-a81a7918e996\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 21:17:05.856546 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:05.850972 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/15bebbc5-dd43-4780-813f-a81a7918e996-tls-assets\") pod \"alertmanager-main-0\" (UID: \"15bebbc5-dd43-4780-813f-a81a7918e996\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 21:17:05.856546 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:05.850995 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/15bebbc5-dd43-4780-813f-a81a7918e996-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"15bebbc5-dd43-4780-813f-a81a7918e996\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 21:17:05.856546 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:05.851931 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/15bebbc5-dd43-4780-813f-a81a7918e996-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"15bebbc5-dd43-4780-813f-a81a7918e996\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 21:17:05.856546 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:05.852208 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/15bebbc5-dd43-4780-813f-a81a7918e996-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"15bebbc5-dd43-4780-813f-a81a7918e996\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 21:17:05.856546 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:17:05.852826 2573 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jul 06 21:17:05.857390 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:17:05.852905 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/15bebbc5-dd43-4780-813f-a81a7918e996-secret-alertmanager-main-tls podName:15bebbc5-dd43-4780-813f-a81a7918e996 nodeName:}" failed. No retries permitted until 2026-07-06 21:17:06.352885965 +0000 UTC m=+249.300263960 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/15bebbc5-dd43-4780-813f-a81a7918e996-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "15bebbc5-dd43-4780-813f-a81a7918e996") : secret "alertmanager-main-tls" not found Jul 06 21:17:05.857390 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:05.853689 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/15bebbc5-dd43-4780-813f-a81a7918e996-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"15bebbc5-dd43-4780-813f-a81a7918e996\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 21:17:05.857390 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:05.856946 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/15bebbc5-dd43-4780-813f-a81a7918e996-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"15bebbc5-dd43-4780-813f-a81a7918e996\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 21:17:05.858960 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:05.858932 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/15bebbc5-dd43-4780-813f-a81a7918e996-tls-assets\") pod \"alertmanager-main-0\" (UID: \"15bebbc5-dd43-4780-813f-a81a7918e996\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 21:17:05.859792 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:05.859749 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/15bebbc5-dd43-4780-813f-a81a7918e996-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"15bebbc5-dd43-4780-813f-a81a7918e996\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 21:17:05.863678 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:05.863617 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w2bb4\" (UniqueName: \"kubernetes.io/projected/15bebbc5-dd43-4780-813f-a81a7918e996-kube-api-access-w2bb4\") pod \"alertmanager-main-0\" (UID: \"15bebbc5-dd43-4780-813f-a81a7918e996\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 21:17:05.863812 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:05.863674 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/15bebbc5-dd43-4780-813f-a81a7918e996-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"15bebbc5-dd43-4780-813f-a81a7918e996\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 21:17:05.863812 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:05.863762 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/15bebbc5-dd43-4780-813f-a81a7918e996-config-volume\") pod \"alertmanager-main-0\" (UID: \"15bebbc5-dd43-4780-813f-a81a7918e996\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 21:17:05.863929 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:05.863896 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/15bebbc5-dd43-4780-813f-a81a7918e996-config-out\") pod \"alertmanager-main-0\" (UID: \"15bebbc5-dd43-4780-813f-a81a7918e996\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 21:17:05.864520 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:05.864477 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/15bebbc5-dd43-4780-813f-a81a7918e996-web-config\") pod \"alertmanager-main-0\" (UID: \"15bebbc5-dd43-4780-813f-a81a7918e996\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 21:17:05.866135 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:05.866073 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/15bebbc5-dd43-4780-813f-a81a7918e996-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"15bebbc5-dd43-4780-813f-a81a7918e996\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 21:17:06.243247 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:06.243202 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-668bbd54b9-6l84g"] Jul 06 21:17:06.246799 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:06.246771 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-668bbd54b9-6l84g" Jul 06 21:17:06.249900 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:06.249871 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 06 21:17:06.250025 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:06.249871 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 06 21:17:06.250025 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:06.249970 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 06 21:17:06.250650 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:06.250454 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-9pglz\"" Jul 06 21:17:06.250650 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:06.250509 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 06 21:17:06.250650 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:06.250521 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 06 21:17:06.250650 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:06.250546 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 06 21:17:06.250650 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:06.250640 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 06 21:17:06.258085 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:06.258060 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-668bbd54b9-6l84g"] Jul 06 21:17:06.356485 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:06.356451 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d6e2498f-743b-40c5-9076-38d722efc3e4-oauth-serving-cert\") pod \"console-668bbd54b9-6l84g\" (UID: \"d6e2498f-743b-40c5-9076-38d722efc3e4\") " pod="openshift-console/console-668bbd54b9-6l84g" Jul 06 21:17:06.356674 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:06.356496 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d6e2498f-743b-40c5-9076-38d722efc3e4-console-config\") pod \"console-668bbd54b9-6l84g\" (UID: \"d6e2498f-743b-40c5-9076-38d722efc3e4\") " pod="openshift-console/console-668bbd54b9-6l84g" Jul 06 21:17:06.356674 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:06.356650 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d6e2498f-743b-40c5-9076-38d722efc3e4-console-serving-cert\") pod \"console-668bbd54b9-6l84g\" (UID: \"d6e2498f-743b-40c5-9076-38d722efc3e4\") " pod="openshift-console/console-668bbd54b9-6l84g" Jul 06 21:17:06.356780 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:06.356693 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d6e2498f-743b-40c5-9076-38d722efc3e4-console-oauth-config\") pod \"console-668bbd54b9-6l84g\" (UID: \"d6e2498f-743b-40c5-9076-38d722efc3e4\") " pod="openshift-console/console-668bbd54b9-6l84g" Jul 06 21:17:06.356780 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:06.356731 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d6e2498f-743b-40c5-9076-38d722efc3e4-service-ca\") pod \"console-668bbd54b9-6l84g\" (UID: \"d6e2498f-743b-40c5-9076-38d722efc3e4\") " pod="openshift-console/console-668bbd54b9-6l84g" Jul 06 21:17:06.356780 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:06.356771 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/15bebbc5-dd43-4780-813f-a81a7918e996-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"15bebbc5-dd43-4780-813f-a81a7918e996\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 21:17:06.356913 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:06.356800 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w2x5j\" (UniqueName: \"kubernetes.io/projected/d6e2498f-743b-40c5-9076-38d722efc3e4-kube-api-access-w2x5j\") pod \"console-668bbd54b9-6l84g\" (UID: \"d6e2498f-743b-40c5-9076-38d722efc3e4\") " pod="openshift-console/console-668bbd54b9-6l84g" Jul 06 21:17:06.360014 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:06.359986 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/15bebbc5-dd43-4780-813f-a81a7918e996-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"15bebbc5-dd43-4780-813f-a81a7918e996\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 21:17:06.438191 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:06.438148 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2g5t9" event={"ID":"f2fbd02b-d01c-45d2-ba0d-2405b282570b","Type":"ContainerStarted","Data":"85dea97193dcaa19b6ee907ebdea72ab811c8783f0be02dacd86af7e32635f44"} Jul 06 21:17:06.457355 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:06.457318 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d6e2498f-743b-40c5-9076-38d722efc3e4-console-config\") pod \"console-668bbd54b9-6l84g\" (UID: \"d6e2498f-743b-40c5-9076-38d722efc3e4\") " pod="openshift-console/console-668bbd54b9-6l84g" Jul 06 21:17:06.457496 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:06.457431 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d6e2498f-743b-40c5-9076-38d722efc3e4-console-serving-cert\") pod \"console-668bbd54b9-6l84g\" (UID: \"d6e2498f-743b-40c5-9076-38d722efc3e4\") " pod="openshift-console/console-668bbd54b9-6l84g" Jul 06 21:17:06.457496 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:06.457455 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d6e2498f-743b-40c5-9076-38d722efc3e4-console-oauth-config\") pod \"console-668bbd54b9-6l84g\" (UID: \"d6e2498f-743b-40c5-9076-38d722efc3e4\") " pod="openshift-console/console-668bbd54b9-6l84g" Jul 06 21:17:06.457496 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:06.457485 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d6e2498f-743b-40c5-9076-38d722efc3e4-service-ca\") pod \"console-668bbd54b9-6l84g\" (UID: \"d6e2498f-743b-40c5-9076-38d722efc3e4\") " pod="openshift-console/console-668bbd54b9-6l84g" Jul 06 21:17:06.457649 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:06.457530 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w2x5j\" (UniqueName: \"kubernetes.io/projected/d6e2498f-743b-40c5-9076-38d722efc3e4-kube-api-access-w2x5j\") pod \"console-668bbd54b9-6l84g\" (UID: \"d6e2498f-743b-40c5-9076-38d722efc3e4\") " pod="openshift-console/console-668bbd54b9-6l84g" Jul 06 21:17:06.457649 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:06.457583 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d6e2498f-743b-40c5-9076-38d722efc3e4-oauth-serving-cert\") pod \"console-668bbd54b9-6l84g\" (UID: \"d6e2498f-743b-40c5-9076-38d722efc3e4\") " pod="openshift-console/console-668bbd54b9-6l84g" Jul 06 21:17:06.458213 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:06.458158 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d6e2498f-743b-40c5-9076-38d722efc3e4-console-config\") pod \"console-668bbd54b9-6l84g\" (UID: \"d6e2498f-743b-40c5-9076-38d722efc3e4\") " pod="openshift-console/console-668bbd54b9-6l84g" Jul 06 21:17:06.458339 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:06.458220 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d6e2498f-743b-40c5-9076-38d722efc3e4-oauth-serving-cert\") pod \"console-668bbd54b9-6l84g\" (UID: \"d6e2498f-743b-40c5-9076-38d722efc3e4\") " pod="openshift-console/console-668bbd54b9-6l84g" Jul 06 21:17:06.458339 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:06.458257 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d6e2498f-743b-40c5-9076-38d722efc3e4-service-ca\") pod \"console-668bbd54b9-6l84g\" (UID: \"d6e2498f-743b-40c5-9076-38d722efc3e4\") " pod="openshift-console/console-668bbd54b9-6l84g" Jul 06 21:17:06.460111 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:06.460087 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d6e2498f-743b-40c5-9076-38d722efc3e4-console-serving-cert\") pod \"console-668bbd54b9-6l84g\" (UID: \"d6e2498f-743b-40c5-9076-38d722efc3e4\") " pod="openshift-console/console-668bbd54b9-6l84g" Jul 06 21:17:06.460219 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:06.460199 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d6e2498f-743b-40c5-9076-38d722efc3e4-console-oauth-config\") pod \"console-668bbd54b9-6l84g\" (UID: \"d6e2498f-743b-40c5-9076-38d722efc3e4\") " pod="openshift-console/console-668bbd54b9-6l84g" Jul 06 21:17:06.471913 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:06.471886 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w2x5j\" (UniqueName: \"kubernetes.io/projected/d6e2498f-743b-40c5-9076-38d722efc3e4-kube-api-access-w2x5j\") pod \"console-668bbd54b9-6l84g\" (UID: \"d6e2498f-743b-40c5-9076-38d722efc3e4\") " pod="openshift-console/console-668bbd54b9-6l84g" Jul 06 21:17:06.510625 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:06.510600 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 06 21:17:06.561407 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:06.561383 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-668bbd54b9-6l84g" Jul 06 21:17:06.696551 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:06.696441 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 21:17:06.712745 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:17:06.712702 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15bebbc5_dd43_4780_813f_a81a7918e996.slice/crio-cd332a8c7124c1be260e23c76888558773372a6672e756dd709099095e48898b WatchSource:0}: Error finding container cd332a8c7124c1be260e23c76888558773372a6672e756dd709099095e48898b: Status 404 returned error can't find the container with id cd332a8c7124c1be260e23c76888558773372a6672e756dd709099095e48898b Jul 06 21:17:06.760721 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:06.760643 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-668bbd54b9-6l84g"] Jul 06 21:17:06.767726 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:17:06.767682 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6e2498f_743b_40c5_9076_38d722efc3e4.slice/crio-7d6ce8b9e4d2a33acde9a9f0001662789b8581146c5110cd54aa4ac6fb3e7567 WatchSource:0}: Error finding container 7d6ce8b9e4d2a33acde9a9f0001662789b8581146c5110cd54aa4ac6fb3e7567: Status 404 returned error can't find the container with id 7d6ce8b9e4d2a33acde9a9f0001662789b8581146c5110cd54aa4ac6fb3e7567 Jul 06 21:17:07.444414 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:07.444376 2573 generic.go:356] "Generic (PLEG): container finished" podID="f2fbd02b-d01c-45d2-ba0d-2405b282570b" containerID="85dea97193dcaa19b6ee907ebdea72ab811c8783f0be02dacd86af7e32635f44" exitCode=0 Jul 06 21:17:07.444603 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:07.444463 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2g5t9" event={"ID":"f2fbd02b-d01c-45d2-ba0d-2405b282570b","Type":"ContainerDied","Data":"85dea97193dcaa19b6ee907ebdea72ab811c8783f0be02dacd86af7e32635f44"} Jul 06 21:17:07.446150 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:07.446108 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-668bbd54b9-6l84g" event={"ID":"d6e2498f-743b-40c5-9076-38d722efc3e4","Type":"ContainerStarted","Data":"7d6ce8b9e4d2a33acde9a9f0001662789b8581146c5110cd54aa4ac6fb3e7567"} Jul 06 21:17:07.448727 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:07.448644 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-kmcbx" event={"ID":"d21e8abf-7bce-4616-ac0e-d933f93f01a4","Type":"ContainerStarted","Data":"9d8953b533f7dc8786856a0fb25af43feb1ba74706b2085eb113ff27807ad0ed"} Jul 06 21:17:07.448727 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:07.448703 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-kmcbx" event={"ID":"d21e8abf-7bce-4616-ac0e-d933f93f01a4","Type":"ContainerStarted","Data":"e1c9a951ae46c97e81a6cb7e4c8285aff75b9b5b5745367610205b10d6673ba6"} Jul 06 21:17:07.448903 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:07.448740 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-kmcbx" event={"ID":"d21e8abf-7bce-4616-ac0e-d933f93f01a4","Type":"ContainerStarted","Data":"5159234145f71e5495f52fc1ede57b5066db7bc18c9c04c6f7bd8903f75dc866"} Jul 06 21:17:07.449936 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:07.449912 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"15bebbc5-dd43-4780-813f-a81a7918e996","Type":"ContainerStarted","Data":"cd332a8c7124c1be260e23c76888558773372a6672e756dd709099095e48898b"} Jul 06 21:17:08.455959 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:08.455869 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2g5t9" event={"ID":"f2fbd02b-d01c-45d2-ba0d-2405b282570b","Type":"ContainerStarted","Data":"471d36f96bc6616191bbbb8b740da04fef1c924a1dd92c8ae81d6140195891d4"} Jul 06 21:17:08.456459 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:08.455978 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2g5t9" event={"ID":"f2fbd02b-d01c-45d2-ba0d-2405b282570b","Type":"ContainerStarted","Data":"558b8b656d011f31f665d1e706c859e0042bb8ff9528c29998ef5872f0af6ec3"} Jul 06 21:17:08.457522 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:08.457494 2573 generic.go:356] "Generic (PLEG): container finished" podID="15bebbc5-dd43-4780-813f-a81a7918e996" containerID="b61602bb8a80782de557eb313450bda55ee60bfd9924f6c91e55792e62e6fdee" exitCode=0 Jul 06 21:17:08.457641 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:08.457579 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"15bebbc5-dd43-4780-813f-a81a7918e996","Type":"ContainerDied","Data":"b61602bb8a80782de557eb313450bda55ee60bfd9924f6c91e55792e62e6fdee"} Jul 06 21:17:08.476705 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:08.476649 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-2g5t9" podStartSLOduration=3.232164974 podStartE2EDuration="4.476631473s" totalImagesPullingTime="1.167114495s" totalInitContainerRuntime="77.352004ms" isStatefulPod=true podCreationTimestamp="2026-07-06 21:17:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:17:08.475092169 +0000 UTC m=+251.422470197" watchObservedRunningTime="2026-07-06 21:17:08.476631473 +0000 UTC m=+251.424009487" Jul 06 21:17:08.477185 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:08.477141 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-kmcbx" podStartSLOduration=2.973826238 podStartE2EDuration="4.477131603s" totalImagesPullingTime="1.503305365s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:17:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:17:07.485095543 +0000 UTC m=+250.432473557" watchObservedRunningTime="2026-07-06 21:17:08.477131603 +0000 UTC m=+251.424509605" Jul 06 21:17:09.286143 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:09.286074 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3a3548bd-1472-470c-bda5-a7c611571bea-metrics-certs\") pod \"network-metrics-daemon-w5754\" (UID: \"3a3548bd-1472-470c-bda5-a7c611571bea\") " pod="openshift-multus/network-metrics-daemon-w5754" Jul 06 21:17:09.289955 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:09.289887 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3a3548bd-1472-470c-bda5-a7c611571bea-metrics-certs\") pod \"network-metrics-daemon-w5754\" (UID: \"3a3548bd-1472-470c-bda5-a7c611571bea\") " pod="openshift-multus/network-metrics-daemon-w5754" Jul 06 21:17:09.340546 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:09.340510 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-qlcwx\"" Jul 06 21:17:09.348774 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:09.348743 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w5754" Jul 06 21:17:09.505544 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:09.505451 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-w5754"] Jul 06 21:17:10.531628 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:17:10.531593 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a3548bd_1472_470c_bda5_a7c611571bea.slice/crio-34173d79905e918b34f67107e94003486260e081dd4a495fcf934609201e2ddc WatchSource:0}: Error finding container 34173d79905e918b34f67107e94003486260e081dd4a495fcf934609201e2ddc: Status 404 returned error can't find the container with id 34173d79905e918b34f67107e94003486260e081dd4a495fcf934609201e2ddc Jul 06 21:17:11.476154 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:11.475958 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-668bbd54b9-6l84g" event={"ID":"d6e2498f-743b-40c5-9076-38d722efc3e4","Type":"ContainerStarted","Data":"0f08986f61241765d16b09bf4b7c45b5250339fef1b466d0795a5b465259cf70"} Jul 06 21:17:11.480576 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:11.480543 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"15bebbc5-dd43-4780-813f-a81a7918e996","Type":"ContainerStarted","Data":"ae20ee4dae64f98057cb50a74d7f7f4ef3d6ed3166887ddfbe1d34ba53a32081"} Jul 06 21:17:11.480738 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:11.480615 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"15bebbc5-dd43-4780-813f-a81a7918e996","Type":"ContainerStarted","Data":"2b40df43b6b35ddbe420bd5873d489fb2cafa1f1d9bdd6cfbcec602432a668c7"} Jul 06 21:17:11.480738 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:11.480656 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"15bebbc5-dd43-4780-813f-a81a7918e996","Type":"ContainerStarted","Data":"35ad55d495b27327240568d1d6ff44c9fc9afb0df62940076257d1f0cdcb2c0e"} Jul 06 21:17:11.480738 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:11.480698 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"15bebbc5-dd43-4780-813f-a81a7918e996","Type":"ContainerStarted","Data":"b9ccb03655469599fc3038878a4e0d1dfe9f79aeafe7acaafa12128912af3317"} Jul 06 21:17:11.480738 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:11.480736 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"15bebbc5-dd43-4780-813f-a81a7918e996","Type":"ContainerStarted","Data":"88d52cf9e633f5fd7c36908108e6df4863719636a5ab2191519eda15ce10d630"} Jul 06 21:17:11.482122 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:11.482082 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-w5754" event={"ID":"3a3548bd-1472-470c-bda5-a7c611571bea","Type":"ContainerStarted","Data":"34173d79905e918b34f67107e94003486260e081dd4a495fcf934609201e2ddc"} Jul 06 21:17:11.496865 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:11.496805 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-668bbd54b9-6l84g" podStartSLOduration=1.371224812 podStartE2EDuration="5.496784401s" totalImagesPullingTime="4.125559589s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:17:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:17:11.494135843 +0000 UTC m=+254.441513857" watchObservedRunningTime="2026-07-06 21:17:11.496784401 +0000 UTC m=+254.444162405" Jul 06 21:17:12.488990 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:12.488952 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"15bebbc5-dd43-4780-813f-a81a7918e996","Type":"ContainerStarted","Data":"b8a94cf81319b115e7c981d398b55164e7cd89b19fff2cb7b23a555389693e23"} Jul 06 21:17:12.490767 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:12.490743 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-w5754" event={"ID":"3a3548bd-1472-470c-bda5-a7c611571bea","Type":"ContainerStarted","Data":"74ba8af397561df5e601bc168849954fe0fa5239a53900ad56ee107af9011b42"} Jul 06 21:17:12.490870 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:12.490792 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-w5754" event={"ID":"3a3548bd-1472-470c-bda5-a7c611571bea","Type":"ContainerStarted","Data":"841189a89cdd4f1d90e7bf79a45572aeaf0c7a659bc8035dd2d44d602ff13d99"} Jul 06 21:17:12.518770 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:12.518711 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.8245868119999997 podStartE2EDuration="7.518693224s" totalImagesPullingTime="4.666283508s" totalInitContainerRuntime="27.822904ms" isStatefulPod=false podCreationTimestamp="2026-07-06 21:17:05 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:17:12.515928941 +0000 UTC m=+255.463306968" watchObservedRunningTime="2026-07-06 21:17:12.518693224 +0000 UTC m=+255.466071259" Jul 06 21:17:12.534578 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:12.534521 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-w5754" podStartSLOduration=253.621739512 podStartE2EDuration="4m14.534502889s" totalImagesPullingTime="912.763377ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:12:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:17:12.533412006 +0000 UTC m=+255.480790008" watchObservedRunningTime="2026-07-06 21:17:12.534502889 +0000 UTC m=+255.481880892" Jul 06 21:17:14.420736 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:14.420701 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6fd78b88f7-gw72c"] Jul 06 21:17:14.424007 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:14.423988 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6fd78b88f7-gw72c" Jul 06 21:17:14.433571 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:14.433544 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 06 21:17:14.434657 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:14.434637 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6fd78b88f7-gw72c"] Jul 06 21:17:14.536616 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:14.536563 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/78bee21b-1013-417a-a2ca-8ea2507854f3-oauth-serving-cert\") pod \"console-6fd78b88f7-gw72c\" (UID: \"78bee21b-1013-417a-a2ca-8ea2507854f3\") " pod="openshift-console/console-6fd78b88f7-gw72c" Jul 06 21:17:14.536616 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:14.536621 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/78bee21b-1013-417a-a2ca-8ea2507854f3-service-ca\") pod \"console-6fd78b88f7-gw72c\" (UID: \"78bee21b-1013-417a-a2ca-8ea2507854f3\") " pod="openshift-console/console-6fd78b88f7-gw72c" Jul 06 21:17:14.536902 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:14.536671 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/78bee21b-1013-417a-a2ca-8ea2507854f3-console-serving-cert\") pod \"console-6fd78b88f7-gw72c\" (UID: \"78bee21b-1013-417a-a2ca-8ea2507854f3\") " pod="openshift-console/console-6fd78b88f7-gw72c" Jul 06 21:17:14.536902 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:14.536686 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/78bee21b-1013-417a-a2ca-8ea2507854f3-console-oauth-config\") pod \"console-6fd78b88f7-gw72c\" (UID: \"78bee21b-1013-417a-a2ca-8ea2507854f3\") " pod="openshift-console/console-6fd78b88f7-gw72c" Jul 06 21:17:14.536902 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:14.536810 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/78bee21b-1013-417a-a2ca-8ea2507854f3-console-config\") pod \"console-6fd78b88f7-gw72c\" (UID: \"78bee21b-1013-417a-a2ca-8ea2507854f3\") " pod="openshift-console/console-6fd78b88f7-gw72c" Jul 06 21:17:14.536902 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:14.536870 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/78bee21b-1013-417a-a2ca-8ea2507854f3-trusted-ca-bundle\") pod \"console-6fd78b88f7-gw72c\" (UID: \"78bee21b-1013-417a-a2ca-8ea2507854f3\") " pod="openshift-console/console-6fd78b88f7-gw72c" Jul 06 21:17:14.536902 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:14.536897 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gwmrd\" (UniqueName: \"kubernetes.io/projected/78bee21b-1013-417a-a2ca-8ea2507854f3-kube-api-access-gwmrd\") pod \"console-6fd78b88f7-gw72c\" (UID: \"78bee21b-1013-417a-a2ca-8ea2507854f3\") " pod="openshift-console/console-6fd78b88f7-gw72c" Jul 06 21:17:14.637618 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:14.637576 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/78bee21b-1013-417a-a2ca-8ea2507854f3-console-config\") pod \"console-6fd78b88f7-gw72c\" (UID: \"78bee21b-1013-417a-a2ca-8ea2507854f3\") " pod="openshift-console/console-6fd78b88f7-gw72c" Jul 06 21:17:14.637618 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:14.637624 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/78bee21b-1013-417a-a2ca-8ea2507854f3-trusted-ca-bundle\") pod \"console-6fd78b88f7-gw72c\" (UID: \"78bee21b-1013-417a-a2ca-8ea2507854f3\") " pod="openshift-console/console-6fd78b88f7-gw72c" Jul 06 21:17:14.637856 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:14.637647 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gwmrd\" (UniqueName: \"kubernetes.io/projected/78bee21b-1013-417a-a2ca-8ea2507854f3-kube-api-access-gwmrd\") pod \"console-6fd78b88f7-gw72c\" (UID: \"78bee21b-1013-417a-a2ca-8ea2507854f3\") " pod="openshift-console/console-6fd78b88f7-gw72c" Jul 06 21:17:14.637856 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:14.637689 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/78bee21b-1013-417a-a2ca-8ea2507854f3-oauth-serving-cert\") pod \"console-6fd78b88f7-gw72c\" (UID: \"78bee21b-1013-417a-a2ca-8ea2507854f3\") " pod="openshift-console/console-6fd78b88f7-gw72c" Jul 06 21:17:14.637856 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:14.637717 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/78bee21b-1013-417a-a2ca-8ea2507854f3-service-ca\") pod \"console-6fd78b88f7-gw72c\" (UID: \"78bee21b-1013-417a-a2ca-8ea2507854f3\") " pod="openshift-console/console-6fd78b88f7-gw72c" Jul 06 21:17:14.637856 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:14.637773 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/78bee21b-1013-417a-a2ca-8ea2507854f3-console-serving-cert\") pod \"console-6fd78b88f7-gw72c\" (UID: \"78bee21b-1013-417a-a2ca-8ea2507854f3\") " pod="openshift-console/console-6fd78b88f7-gw72c" Jul 06 21:17:14.637856 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:14.637796 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/78bee21b-1013-417a-a2ca-8ea2507854f3-console-oauth-config\") pod \"console-6fd78b88f7-gw72c\" (UID: \"78bee21b-1013-417a-a2ca-8ea2507854f3\") " pod="openshift-console/console-6fd78b88f7-gw72c" Jul 06 21:17:14.638473 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:14.638440 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/78bee21b-1013-417a-a2ca-8ea2507854f3-oauth-serving-cert\") pod \"console-6fd78b88f7-gw72c\" (UID: \"78bee21b-1013-417a-a2ca-8ea2507854f3\") " pod="openshift-console/console-6fd78b88f7-gw72c" Jul 06 21:17:14.638473 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:14.638461 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/78bee21b-1013-417a-a2ca-8ea2507854f3-console-config\") pod \"console-6fd78b88f7-gw72c\" (UID: \"78bee21b-1013-417a-a2ca-8ea2507854f3\") " pod="openshift-console/console-6fd78b88f7-gw72c" Jul 06 21:17:14.638630 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:14.638607 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/78bee21b-1013-417a-a2ca-8ea2507854f3-service-ca\") pod \"console-6fd78b88f7-gw72c\" (UID: \"78bee21b-1013-417a-a2ca-8ea2507854f3\") " pod="openshift-console/console-6fd78b88f7-gw72c" Jul 06 21:17:14.638668 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:14.638631 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/78bee21b-1013-417a-a2ca-8ea2507854f3-trusted-ca-bundle\") pod \"console-6fd78b88f7-gw72c\" (UID: \"78bee21b-1013-417a-a2ca-8ea2507854f3\") " pod="openshift-console/console-6fd78b88f7-gw72c" Jul 06 21:17:14.640382 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:14.640345 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/78bee21b-1013-417a-a2ca-8ea2507854f3-console-oauth-config\") pod \"console-6fd78b88f7-gw72c\" (UID: \"78bee21b-1013-417a-a2ca-8ea2507854f3\") " pod="openshift-console/console-6fd78b88f7-gw72c" Jul 06 21:17:14.640478 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:14.640440 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/78bee21b-1013-417a-a2ca-8ea2507854f3-console-serving-cert\") pod \"console-6fd78b88f7-gw72c\" (UID: \"78bee21b-1013-417a-a2ca-8ea2507854f3\") " pod="openshift-console/console-6fd78b88f7-gw72c" Jul 06 21:17:14.645415 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:14.645390 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gwmrd\" (UniqueName: \"kubernetes.io/projected/78bee21b-1013-417a-a2ca-8ea2507854f3-kube-api-access-gwmrd\") pod \"console-6fd78b88f7-gw72c\" (UID: \"78bee21b-1013-417a-a2ca-8ea2507854f3\") " pod="openshift-console/console-6fd78b88f7-gw72c" Jul 06 21:17:14.733798 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:14.733709 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6fd78b88f7-gw72c" Jul 06 21:17:14.869008 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:14.868980 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6fd78b88f7-gw72c"] Jul 06 21:17:14.871091 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:17:14.871063 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78bee21b_1013_417a_a2ca_8ea2507854f3.slice/crio-54a056776504bbe6775ad9afef9236d843dfae6933cadd541ed4d0ce75f003e0 WatchSource:0}: Error finding container 54a056776504bbe6775ad9afef9236d843dfae6933cadd541ed4d0ce75f003e0: Status 404 returned error can't find the container with id 54a056776504bbe6775ad9afef9236d843dfae6933cadd541ed4d0ce75f003e0 Jul 06 21:17:15.503041 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:15.503008 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6fd78b88f7-gw72c" event={"ID":"78bee21b-1013-417a-a2ca-8ea2507854f3","Type":"ContainerStarted","Data":"5c3ed118b2979262e806d657da1d6d142a94c5f73d73293c9e55bdb17d2a045f"} Jul 06 21:17:15.503474 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:15.503059 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6fd78b88f7-gw72c" event={"ID":"78bee21b-1013-417a-a2ca-8ea2507854f3","Type":"ContainerStarted","Data":"54a056776504bbe6775ad9afef9236d843dfae6933cadd541ed4d0ce75f003e0"} Jul 06 21:17:15.521980 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:15.521925 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6fd78b88f7-gw72c" podStartSLOduration=1.5219071830000002 podStartE2EDuration="1.521907183s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:17:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:17:15.51987325 +0000 UTC m=+258.467251283" watchObservedRunningTime="2026-07-06 21:17:15.521907183 +0000 UTC m=+258.469285186" Jul 06 21:17:16.561956 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:16.561911 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-668bbd54b9-6l84g" Jul 06 21:17:16.562383 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:16.561979 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-668bbd54b9-6l84g" Jul 06 21:17:16.563354 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:16.563330 2573 patch_prober.go:28] interesting pod/console-668bbd54b9-6l84g container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.19:8443/health\": dial tcp 10.133.0.19:8443: connect: connection refused" start-of-body= Jul 06 21:17:16.563409 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:16.563374 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-668bbd54b9-6l84g" podUID="d6e2498f-743b-40c5-9076-38d722efc3e4" containerName="console" probeResult="failure" output="Get \"https://10.133.0.19:8443/health\": dial tcp 10.133.0.19:8443: connect: connection refused" Jul 06 21:17:17.280185 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:17.280149 2573 patch_prober.go:28] interesting pod/image-registry-5d5b8885c7-6zrwj container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 06 21:17:17.280379 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:17.280202 2573 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-5d5b8885c7-6zrwj" podUID="c215fc9a-5c0c-46a8-a0cb-c2e71626b614" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 06 21:17:19.413431 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:19.413347 2573 patch_prober.go:28] interesting pod/image-registry-5d5b8885c7-6zrwj container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 06 21:17:19.413431 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:19.413399 2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-5d5b8885c7-6zrwj" podUID="c215fc9a-5c0c-46a8-a0cb-c2e71626b614" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 06 21:17:24.734308 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:24.734267 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6fd78b88f7-gw72c" Jul 06 21:17:24.734723 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:24.734335 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6fd78b88f7-gw72c" Jul 06 21:17:24.735792 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:24.735767 2573 patch_prober.go:28] interesting pod/console-6fd78b88f7-gw72c container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.20:8443/health\": dial tcp 10.133.0.20:8443: connect: connection refused" start-of-body= Jul 06 21:17:24.735891 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:24.735811 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-6fd78b88f7-gw72c" podUID="78bee21b-1013-417a-a2ca-8ea2507854f3" containerName="console" probeResult="failure" output="Get \"https://10.133.0.20:8443/health\": dial tcp 10.133.0.20:8443: connect: connection refused" Jul 06 21:17:26.561847 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:26.561808 2573 patch_prober.go:28] interesting pod/console-668bbd54b9-6l84g container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.19:8443/health\": dial tcp 10.133.0.19:8443: connect: connection refused" start-of-body= Jul 06 21:17:26.562261 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:26.561864 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-668bbd54b9-6l84g" podUID="d6e2498f-743b-40c5-9076-38d722efc3e4" containerName="console" probeResult="failure" output="Get \"https://10.133.0.19:8443/health\": dial tcp 10.133.0.19:8443: connect: connection refused" Jul 06 21:17:27.280412 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:27.280376 2573 patch_prober.go:28] interesting pod/image-registry-5d5b8885c7-6zrwj container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 06 21:17:27.280560 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:27.280430 2573 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-5d5b8885c7-6zrwj" podUID="c215fc9a-5c0c-46a8-a0cb-c2e71626b614" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 06 21:17:29.413392 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:29.413350 2573 patch_prober.go:28] interesting pod/image-registry-5d5b8885c7-6zrwj container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 06 21:17:29.413800 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:29.413425 2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-5d5b8885c7-6zrwj" podUID="c215fc9a-5c0c-46a8-a0cb-c2e71626b614" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 06 21:17:34.734513 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:34.734476 2573 patch_prober.go:28] interesting pod/console-6fd78b88f7-gw72c container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.20:8443/health\": dial tcp 10.133.0.20:8443: connect: connection refused" start-of-body= Jul 06 21:17:34.734900 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:34.734545 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-6fd78b88f7-gw72c" podUID="78bee21b-1013-417a-a2ca-8ea2507854f3" containerName="console" probeResult="failure" output="Get \"https://10.133.0.20:8443/health\": dial tcp 10.133.0.20:8443: connect: connection refused" Jul 06 21:17:36.562023 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:36.561979 2573 patch_prober.go:28] interesting pod/console-668bbd54b9-6l84g container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.19:8443/health\": dial tcp 10.133.0.19:8443: connect: connection refused" start-of-body= Jul 06 21:17:36.562517 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:36.562044 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-668bbd54b9-6l84g" podUID="d6e2498f-743b-40c5-9076-38d722efc3e4" containerName="console" probeResult="failure" output="Get \"https://10.133.0.19:8443/health\": dial tcp 10.133.0.19:8443: connect: connection refused" Jul 06 21:17:37.280061 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:37.280017 2573 patch_prober.go:28] interesting pod/image-registry-5d5b8885c7-6zrwj container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 06 21:17:37.280224 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:37.280068 2573 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-5d5b8885c7-6zrwj" podUID="c215fc9a-5c0c-46a8-a0cb-c2e71626b614" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 06 21:17:37.280224 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:37.280112 2573 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-image-registry/image-registry-5d5b8885c7-6zrwj" Jul 06 21:17:37.280689 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:37.280650 2573 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="registry" containerStatusID={"Type":"cri-o","ID":"c66d442c343bf326c8508fb9aab6a84f9c35a73a0c8c83a2d9771e1374a7bf6f"} pod="openshift-image-registry/image-registry-5d5b8885c7-6zrwj" containerMessage="Container registry failed liveness probe, will be restarted" Jul 06 21:17:37.284060 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:37.284033 2573 patch_prober.go:28] interesting pod/image-registry-5d5b8885c7-6zrwj container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 06 21:17:37.284170 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:37.284076 2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-5d5b8885c7-6zrwj" podUID="c215fc9a-5c0c-46a8-a0cb-c2e71626b614" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 06 21:17:39.156543 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:17:39.156496 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-b9fg2" podUID="c910d322-60b9-4b57-a172-4751e6c8f186" Jul 06 21:17:39.591344 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:39.591316 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-b9fg2" Jul 06 21:17:42.781747 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:42.781711 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c910d322-60b9-4b57-a172-4751e6c8f186-metrics-tls\") pod \"dns-default-b9fg2\" (UID: \"c910d322-60b9-4b57-a172-4751e6c8f186\") " pod="openshift-dns/dns-default-b9fg2" Jul 06 21:17:42.784036 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:42.784010 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c910d322-60b9-4b57-a172-4751e6c8f186-metrics-tls\") pod \"dns-default-b9fg2\" (UID: \"c910d322-60b9-4b57-a172-4751e6c8f186\") " pod="openshift-dns/dns-default-b9fg2" Jul 06 21:17:42.895342 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:42.895308 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-45jgn\"" Jul 06 21:17:42.903459 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:42.903439 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-b9fg2" Jul 06 21:17:43.062028 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:43.061997 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-b9fg2"] Jul 06 21:17:43.065184 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:17:43.065157 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc910d322_60b9_4b57_a172_4751e6c8f186.slice/crio-25b355f278fc37d50284e7ab88cf9b52cd5d9c01af1edfcf2fae1e9e10dba20f WatchSource:0}: Error finding container 25b355f278fc37d50284e7ab88cf9b52cd5d9c01af1edfcf2fae1e9e10dba20f: Status 404 returned error can't find the container with id 25b355f278fc37d50284e7ab88cf9b52cd5d9c01af1edfcf2fae1e9e10dba20f Jul 06 21:17:43.607474 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:43.607440 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-b9fg2" event={"ID":"c910d322-60b9-4b57-a172-4751e6c8f186","Type":"ContainerStarted","Data":"25b355f278fc37d50284e7ab88cf9b52cd5d9c01af1edfcf2fae1e9e10dba20f"} Jul 06 21:17:44.734649 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:44.734608 2573 patch_prober.go:28] interesting pod/console-6fd78b88f7-gw72c container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.20:8443/health\": dial tcp 10.133.0.20:8443: connect: connection refused" start-of-body= Jul 06 21:17:44.735097 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:44.734674 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-6fd78b88f7-gw72c" podUID="78bee21b-1013-417a-a2ca-8ea2507854f3" containerName="console" probeResult="failure" output="Get \"https://10.133.0.20:8443/health\": dial tcp 10.133.0.20:8443: connect: connection refused" Jul 06 21:17:45.618511 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:45.618424 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-b9fg2" event={"ID":"c910d322-60b9-4b57-a172-4751e6c8f186","Type":"ContainerStarted","Data":"5d666b171ad62af80fbd29aa19b6bbb20974070b09b85121e48f8debd6fff2f6"} Jul 06 21:17:45.618511 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:45.618510 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-b9fg2" event={"ID":"c910d322-60b9-4b57-a172-4751e6c8f186","Type":"ContainerStarted","Data":"7ee377b2419c05435ea0b6ae95ac96c963f2497fd805d62f849f97e9658c50b6"} Jul 06 21:17:45.618714 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:45.618533 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-b9fg2" Jul 06 21:17:45.636973 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:45.636915 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-b9fg2" podStartSLOduration=251.371478176 podStartE2EDuration="4m13.636897229s" totalImagesPullingTime="2.265419053s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:13:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:17:45.635766061 +0000 UTC m=+288.583144075" watchObservedRunningTime="2026-07-06 21:17:45.636897229 +0000 UTC m=+288.584275230" Jul 06 21:17:46.566597 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:46.566564 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-668bbd54b9-6l84g" Jul 06 21:17:46.570501 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:46.570475 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-668bbd54b9-6l84g" Jul 06 21:17:47.285336 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:47.285298 2573 patch_prober.go:28] interesting pod/image-registry-5d5b8885c7-6zrwj container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 06 21:17:47.285504 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:47.285349 2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-5d5b8885c7-6zrwj" podUID="c215fc9a-5c0c-46a8-a0cb-c2e71626b614" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 06 21:17:54.738410 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:54.738375 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6fd78b88f7-gw72c" Jul 06 21:17:54.742318 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:54.742288 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6fd78b88f7-gw72c" Jul 06 21:17:54.799277 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:54.799215 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-668bbd54b9-6l84g"] Jul 06 21:17:55.625867 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:55.625838 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-b9fg2" Jul 06 21:17:57.285440 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:57.285412 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5d5b8885c7-6zrwj" Jul 06 21:17:57.473369 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:57.473340 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5s6d9_e122448a-d2e4-4fec-a918-3d3eecb175a4/ovn-acl-logging/0.log" Jul 06 21:17:57.478396 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:57.478361 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5s6d9_e122448a-d2e4-4fec-a918-3d3eecb175a4/ovn-acl-logging/0.log" Jul 06 21:17:57.479435 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:17:57.479404 2573 kubelet.go:1648] "Image garbage collection succeeded" Jul 06 21:18:02.300391 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:02.300344 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5d5b8885c7-6zrwj" podUID="c215fc9a-5c0c-46a8-a0cb-c2e71626b614" containerName="registry" containerID="cri-o://c66d442c343bf326c8508fb9aab6a84f9c35a73a0c8c83a2d9771e1374a7bf6f" gracePeriod=30 Jul 06 21:18:03.689386 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:03.689306 2573 generic.go:356] "Generic (PLEG): container finished" podID="c215fc9a-5c0c-46a8-a0cb-c2e71626b614" containerID="c66d442c343bf326c8508fb9aab6a84f9c35a73a0c8c83a2d9771e1374a7bf6f" exitCode=0 Jul 06 21:18:03.689386 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:03.689378 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5d5b8885c7-6zrwj" event={"ID":"c215fc9a-5c0c-46a8-a0cb-c2e71626b614","Type":"ContainerDied","Data":"c66d442c343bf326c8508fb9aab6a84f9c35a73a0c8c83a2d9771e1374a7bf6f"} Jul 06 21:18:03.689807 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:03.689416 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5d5b8885c7-6zrwj" event={"ID":"c215fc9a-5c0c-46a8-a0cb-c2e71626b614","Type":"ContainerStarted","Data":"9394288ff6f94fe84d8d4410d70cb9bae6f47fae132942e0731097e5984489d5"} Jul 06 21:18:03.689807 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:03.689474 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5d5b8885c7-6zrwj" Jul 06 21:18:05.699180 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:05.699142 2573 generic.go:356] "Generic (PLEG): container finished" podID="950868d7-21dd-4f44-8f4e-530a33206a74" containerID="7f0001a1a88100208249d41e745c6c5aea4477803c41af8b1a4f89ba1927068a" exitCode=0 Jul 06 21:18:05.699632 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:05.699202 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-wvhfl" event={"ID":"950868d7-21dd-4f44-8f4e-530a33206a74","Type":"ContainerDied","Data":"7f0001a1a88100208249d41e745c6c5aea4477803c41af8b1a4f89ba1927068a"} Jul 06 21:18:05.699632 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:05.699564 2573 scope.go:117] "RemoveContainer" containerID="7f0001a1a88100208249d41e745c6c5aea4477803c41af8b1a4f89ba1927068a" Jul 06 21:18:06.704566 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:06.704534 2573 generic.go:356] "Generic (PLEG): container finished" podID="27206ad5-a38e-4ee2-9f3f-45c8facd8a25" containerID="94cd1d1a7d51730d0bb3978f0bb11d0d08d972b85a94061ddcfbec8e07d9f8b0" exitCode=0 Jul 06 21:18:06.705049 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:06.704608 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-wbjrz" event={"ID":"27206ad5-a38e-4ee2-9f3f-45c8facd8a25","Type":"ContainerDied","Data":"94cd1d1a7d51730d0bb3978f0bb11d0d08d972b85a94061ddcfbec8e07d9f8b0"} Jul 06 21:18:06.705049 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:06.705009 2573 scope.go:117] "RemoveContainer" containerID="94cd1d1a7d51730d0bb3978f0bb11d0d08d972b85a94061ddcfbec8e07d9f8b0" Jul 06 21:18:06.706374 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:06.706342 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-wvhfl" event={"ID":"950868d7-21dd-4f44-8f4e-530a33206a74","Type":"ContainerStarted","Data":"2bc49c737ab608602814d9545b7f5da49a4deabda222f3d5c2f77a13228b8e28"} Jul 06 21:18:07.711890 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:07.711855 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-wbjrz" event={"ID":"27206ad5-a38e-4ee2-9f3f-45c8facd8a25","Type":"ContainerStarted","Data":"fcab6f1448dd62a3af056d914b78ba2a434f25a3a844b88d3b904a1afeff5878"} Jul 06 21:18:19.825605 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:19.825558 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-668bbd54b9-6l84g" podUID="d6e2498f-743b-40c5-9076-38d722efc3e4" containerName="console" containerID="cri-o://0f08986f61241765d16b09bf4b7c45b5250339fef1b466d0795a5b465259cf70" gracePeriod=15 Jul 06 21:18:20.064503 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:20.064474 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-668bbd54b9-6l84g" Jul 06 21:18:20.113953 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:20.113860 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w2x5j\" (UniqueName: \"kubernetes.io/projected/d6e2498f-743b-40c5-9076-38d722efc3e4-kube-api-access-w2x5j\") pod \"d6e2498f-743b-40c5-9076-38d722efc3e4\" (UID: \"d6e2498f-743b-40c5-9076-38d722efc3e4\") " Jul 06 21:18:20.113953 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:20.113903 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d6e2498f-743b-40c5-9076-38d722efc3e4-oauth-serving-cert\") pod \"d6e2498f-743b-40c5-9076-38d722efc3e4\" (UID: \"d6e2498f-743b-40c5-9076-38d722efc3e4\") " Jul 06 21:18:20.113953 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:20.113925 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d6e2498f-743b-40c5-9076-38d722efc3e4-console-serving-cert\") pod \"d6e2498f-743b-40c5-9076-38d722efc3e4\" (UID: \"d6e2498f-743b-40c5-9076-38d722efc3e4\") " Jul 06 21:18:20.113953 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:20.113944 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d6e2498f-743b-40c5-9076-38d722efc3e4-service-ca\") pod \"d6e2498f-743b-40c5-9076-38d722efc3e4\" (UID: \"d6e2498f-743b-40c5-9076-38d722efc3e4\") " Jul 06 21:18:20.114324 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:20.113970 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d6e2498f-743b-40c5-9076-38d722efc3e4-console-config\") pod \"d6e2498f-743b-40c5-9076-38d722efc3e4\" (UID: \"d6e2498f-743b-40c5-9076-38d722efc3e4\") " Jul 06 21:18:20.114324 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:20.114044 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d6e2498f-743b-40c5-9076-38d722efc3e4-console-oauth-config\") pod \"d6e2498f-743b-40c5-9076-38d722efc3e4\" (UID: \"d6e2498f-743b-40c5-9076-38d722efc3e4\") " Jul 06 21:18:20.114427 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:20.114344 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d6e2498f-743b-40c5-9076-38d722efc3e4-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "d6e2498f-743b-40c5-9076-38d722efc3e4" (UID: "d6e2498f-743b-40c5-9076-38d722efc3e4"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 21:18:20.114427 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:20.114360 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d6e2498f-743b-40c5-9076-38d722efc3e4-service-ca" (OuterVolumeSpecName: "service-ca") pod "d6e2498f-743b-40c5-9076-38d722efc3e4" (UID: "d6e2498f-743b-40c5-9076-38d722efc3e4"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 21:18:20.114519 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:20.114430 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d6e2498f-743b-40c5-9076-38d722efc3e4-console-config" (OuterVolumeSpecName: "console-config") pod "d6e2498f-743b-40c5-9076-38d722efc3e4" (UID: "d6e2498f-743b-40c5-9076-38d722efc3e4"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 21:18:20.116209 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:20.116183 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d6e2498f-743b-40c5-9076-38d722efc3e4-kube-api-access-w2x5j" (OuterVolumeSpecName: "kube-api-access-w2x5j") pod "d6e2498f-743b-40c5-9076-38d722efc3e4" (UID: "d6e2498f-743b-40c5-9076-38d722efc3e4"). InnerVolumeSpecName "kube-api-access-w2x5j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 21:18:20.116328 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:20.116226 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d6e2498f-743b-40c5-9076-38d722efc3e4-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "d6e2498f-743b-40c5-9076-38d722efc3e4" (UID: "d6e2498f-743b-40c5-9076-38d722efc3e4"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 21:18:20.121427 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:20.116274 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d6e2498f-743b-40c5-9076-38d722efc3e4-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "d6e2498f-743b-40c5-9076-38d722efc3e4" (UID: "d6e2498f-743b-40c5-9076-38d722efc3e4"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 21:18:20.214731 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:20.214687 2573 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d6e2498f-743b-40c5-9076-38d722efc3e4-console-oauth-config\") on node \"ip-10-0-130-89.ec2.internal\" DevicePath \"\"" Jul 06 21:18:20.214731 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:20.214722 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w2x5j\" (UniqueName: \"kubernetes.io/projected/d6e2498f-743b-40c5-9076-38d722efc3e4-kube-api-access-w2x5j\") on node \"ip-10-0-130-89.ec2.internal\" DevicePath \"\"" Jul 06 21:18:20.214731 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:20.214736 2573 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d6e2498f-743b-40c5-9076-38d722efc3e4-oauth-serving-cert\") on node \"ip-10-0-130-89.ec2.internal\" DevicePath \"\"" Jul 06 21:18:20.214964 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:20.214748 2573 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d6e2498f-743b-40c5-9076-38d722efc3e4-console-serving-cert\") on node \"ip-10-0-130-89.ec2.internal\" DevicePath \"\"" Jul 06 21:18:20.214964 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:20.214760 2573 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d6e2498f-743b-40c5-9076-38d722efc3e4-service-ca\") on node \"ip-10-0-130-89.ec2.internal\" DevicePath \"\"" Jul 06 21:18:20.214964 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:20.214772 2573 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d6e2498f-743b-40c5-9076-38d722efc3e4-console-config\") on node \"ip-10-0-130-89.ec2.internal\" DevicePath \"\"" Jul 06 21:18:20.762077 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:20.762042 2573 generic.go:356] "Generic (PLEG): container finished" podID="d6e2498f-743b-40c5-9076-38d722efc3e4" containerID="0f08986f61241765d16b09bf4b7c45b5250339fef1b466d0795a5b465259cf70" exitCode=0 Jul 06 21:18:20.762317 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:20.762095 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-668bbd54b9-6l84g" Jul 06 21:18:20.762317 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:20.762127 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-668bbd54b9-6l84g" event={"ID":"d6e2498f-743b-40c5-9076-38d722efc3e4","Type":"ContainerDied","Data":"0f08986f61241765d16b09bf4b7c45b5250339fef1b466d0795a5b465259cf70"} Jul 06 21:18:20.762317 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:20.762175 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-668bbd54b9-6l84g" event={"ID":"d6e2498f-743b-40c5-9076-38d722efc3e4","Type":"ContainerDied","Data":"7d6ce8b9e4d2a33acde9a9f0001662789b8581146c5110cd54aa4ac6fb3e7567"} Jul 06 21:18:20.762317 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:20.762200 2573 scope.go:117] "RemoveContainer" containerID="0f08986f61241765d16b09bf4b7c45b5250339fef1b466d0795a5b465259cf70" Jul 06 21:18:20.770911 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:20.770894 2573 scope.go:117] "RemoveContainer" containerID="0f08986f61241765d16b09bf4b7c45b5250339fef1b466d0795a5b465259cf70" Jul 06 21:18:20.771220 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:18:20.771201 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0f08986f61241765d16b09bf4b7c45b5250339fef1b466d0795a5b465259cf70\": container with ID starting with 0f08986f61241765d16b09bf4b7c45b5250339fef1b466d0795a5b465259cf70 not found: ID does not exist" containerID="0f08986f61241765d16b09bf4b7c45b5250339fef1b466d0795a5b465259cf70" Jul 06 21:18:20.771282 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:20.771231 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f08986f61241765d16b09bf4b7c45b5250339fef1b466d0795a5b465259cf70"} err="failed to get container status \"0f08986f61241765d16b09bf4b7c45b5250339fef1b466d0795a5b465259cf70\": rpc error: code = NotFound desc = could not find container \"0f08986f61241765d16b09bf4b7c45b5250339fef1b466d0795a5b465259cf70\": container with ID starting with 0f08986f61241765d16b09bf4b7c45b5250339fef1b466d0795a5b465259cf70 not found: ID does not exist" Jul 06 21:18:20.784219 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:20.784185 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-668bbd54b9-6l84g"] Jul 06 21:18:20.789322 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:20.789293 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-668bbd54b9-6l84g"] Jul 06 21:18:21.641107 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:21.641073 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d6e2498f-743b-40c5-9076-38d722efc3e4" path="/var/lib/kubelet/pods/d6e2498f-743b-40c5-9076-38d722efc3e4/volumes" Jul 06 21:18:24.697941 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:24.697914 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5d5b8885c7-6zrwj" Jul 06 21:18:24.908483 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:24.908450 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 21:18:24.908783 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:24.908751 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="15bebbc5-dd43-4780-813f-a81a7918e996" containerName="alertmanager" containerID="cri-o://88d52cf9e633f5fd7c36908108e6df4863719636a5ab2191519eda15ce10d630" gracePeriod=120 Jul 06 21:18:24.908929 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:24.908814 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="15bebbc5-dd43-4780-813f-a81a7918e996" containerName="config-reloader" containerID="cri-o://b9ccb03655469599fc3038878a4e0d1dfe9f79aeafe7acaafa12128912af3317" gracePeriod=120 Jul 06 21:18:24.908929 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:24.908815 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="15bebbc5-dd43-4780-813f-a81a7918e996" containerName="kube-rbac-proxy-web" containerID="cri-o://35ad55d495b27327240568d1d6ff44c9fc9afb0df62940076257d1f0cdcb2c0e" gracePeriod=120 Jul 06 21:18:24.908929 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:24.908864 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="15bebbc5-dd43-4780-813f-a81a7918e996" containerName="prom-label-proxy" containerID="cri-o://b8a94cf81319b115e7c981d398b55164e7cd89b19fff2cb7b23a555389693e23" gracePeriod=120 Jul 06 21:18:24.908929 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:24.908814 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="15bebbc5-dd43-4780-813f-a81a7918e996" containerName="kube-rbac-proxy-metric" containerID="cri-o://ae20ee4dae64f98057cb50a74d7f7f4ef3d6ed3166887ddfbe1d34ba53a32081" gracePeriod=120 Jul 06 21:18:24.908929 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:24.908900 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="15bebbc5-dd43-4780-813f-a81a7918e996" containerName="kube-rbac-proxy" containerID="cri-o://2b40df43b6b35ddbe420bd5873d489fb2cafa1f1d9bdd6cfbcec602432a668c7" gracePeriod=120 Jul 06 21:18:25.171489 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.171462 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 06 21:18:25.256832 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.256803 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/15bebbc5-dd43-4780-813f-a81a7918e996-alertmanager-main-db\") pod \"15bebbc5-dd43-4780-813f-a81a7918e996\" (UID: \"15bebbc5-dd43-4780-813f-a81a7918e996\") " Jul 06 21:18:25.256974 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.256849 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/15bebbc5-dd43-4780-813f-a81a7918e996-config-out\") pod \"15bebbc5-dd43-4780-813f-a81a7918e996\" (UID: \"15bebbc5-dd43-4780-813f-a81a7918e996\") " Jul 06 21:18:25.256974 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.256882 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/15bebbc5-dd43-4780-813f-a81a7918e996-metrics-client-ca\") pod \"15bebbc5-dd43-4780-813f-a81a7918e996\" (UID: \"15bebbc5-dd43-4780-813f-a81a7918e996\") " Jul 06 21:18:25.256974 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.256906 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/15bebbc5-dd43-4780-813f-a81a7918e996-web-config\") pod \"15bebbc5-dd43-4780-813f-a81a7918e996\" (UID: \"15bebbc5-dd43-4780-813f-a81a7918e996\") " Jul 06 21:18:25.256974 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.256933 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/15bebbc5-dd43-4780-813f-a81a7918e996-cluster-tls-config\") pod \"15bebbc5-dd43-4780-813f-a81a7918e996\" (UID: \"15bebbc5-dd43-4780-813f-a81a7918e996\") " Jul 06 21:18:25.257188 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.257053 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/15bebbc5-dd43-4780-813f-a81a7918e996-config-volume\") pod \"15bebbc5-dd43-4780-813f-a81a7918e996\" (UID: \"15bebbc5-dd43-4780-813f-a81a7918e996\") " Jul 06 21:18:25.257188 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.257098 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/15bebbc5-dd43-4780-813f-a81a7918e996-secret-alertmanager-kube-rbac-proxy-web\") pod \"15bebbc5-dd43-4780-813f-a81a7918e996\" (UID: \"15bebbc5-dd43-4780-813f-a81a7918e996\") " Jul 06 21:18:25.257188 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.257155 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w2bb4\" (UniqueName: \"kubernetes.io/projected/15bebbc5-dd43-4780-813f-a81a7918e996-kube-api-access-w2bb4\") pod \"15bebbc5-dd43-4780-813f-a81a7918e996\" (UID: \"15bebbc5-dd43-4780-813f-a81a7918e996\") " Jul 06 21:18:25.257357 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.257187 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/15bebbc5-dd43-4780-813f-a81a7918e996-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "15bebbc5-dd43-4780-813f-a81a7918e996" (UID: "15bebbc5-dd43-4780-813f-a81a7918e996"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 21:18:25.257357 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.257206 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/15bebbc5-dd43-4780-813f-a81a7918e996-alertmanager-trusted-ca-bundle\") pod \"15bebbc5-dd43-4780-813f-a81a7918e996\" (UID: \"15bebbc5-dd43-4780-813f-a81a7918e996\") " Jul 06 21:18:25.257357 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.257258 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/15bebbc5-dd43-4780-813f-a81a7918e996-secret-alertmanager-main-tls\") pod \"15bebbc5-dd43-4780-813f-a81a7918e996\" (UID: \"15bebbc5-dd43-4780-813f-a81a7918e996\") " Jul 06 21:18:25.257357 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.257297 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/15bebbc5-dd43-4780-813f-a81a7918e996-secret-alertmanager-kube-rbac-proxy\") pod \"15bebbc5-dd43-4780-813f-a81a7918e996\" (UID: \"15bebbc5-dd43-4780-813f-a81a7918e996\") " Jul 06 21:18:25.257357 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.257327 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/15bebbc5-dd43-4780-813f-a81a7918e996-tls-assets\") pod \"15bebbc5-dd43-4780-813f-a81a7918e996\" (UID: \"15bebbc5-dd43-4780-813f-a81a7918e996\") " Jul 06 21:18:25.257357 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.257340 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/15bebbc5-dd43-4780-813f-a81a7918e996-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "15bebbc5-dd43-4780-813f-a81a7918e996" (UID: "15bebbc5-dd43-4780-813f-a81a7918e996"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 21:18:25.257657 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.257360 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/15bebbc5-dd43-4780-813f-a81a7918e996-secret-alertmanager-kube-rbac-proxy-metric\") pod \"15bebbc5-dd43-4780-813f-a81a7918e996\" (UID: \"15bebbc5-dd43-4780-813f-a81a7918e996\") " Jul 06 21:18:25.257657 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.257647 2573 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/15bebbc5-dd43-4780-813f-a81a7918e996-metrics-client-ca\") on node \"ip-10-0-130-89.ec2.internal\" DevicePath \"\"" Jul 06 21:18:25.257765 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.257667 2573 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/15bebbc5-dd43-4780-813f-a81a7918e996-alertmanager-main-db\") on node \"ip-10-0-130-89.ec2.internal\" DevicePath \"\"" Jul 06 21:18:25.258678 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.258641 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/15bebbc5-dd43-4780-813f-a81a7918e996-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "15bebbc5-dd43-4780-813f-a81a7918e996" (UID: "15bebbc5-dd43-4780-813f-a81a7918e996"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 21:18:25.260052 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.260005 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/15bebbc5-dd43-4780-813f-a81a7918e996-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "15bebbc5-dd43-4780-813f-a81a7918e996" (UID: "15bebbc5-dd43-4780-813f-a81a7918e996"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 21:18:25.260395 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.260354 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/15bebbc5-dd43-4780-813f-a81a7918e996-config-out" (OuterVolumeSpecName: "config-out") pod "15bebbc5-dd43-4780-813f-a81a7918e996" (UID: "15bebbc5-dd43-4780-813f-a81a7918e996"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 21:18:25.260685 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.260639 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/15bebbc5-dd43-4780-813f-a81a7918e996-kube-api-access-w2bb4" (OuterVolumeSpecName: "kube-api-access-w2bb4") pod "15bebbc5-dd43-4780-813f-a81a7918e996" (UID: "15bebbc5-dd43-4780-813f-a81a7918e996"). InnerVolumeSpecName "kube-api-access-w2bb4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 21:18:25.260776 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.260681 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/15bebbc5-dd43-4780-813f-a81a7918e996-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "15bebbc5-dd43-4780-813f-a81a7918e996" (UID: "15bebbc5-dd43-4780-813f-a81a7918e996"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 21:18:25.260946 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.260922 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/15bebbc5-dd43-4780-813f-a81a7918e996-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "15bebbc5-dd43-4780-813f-a81a7918e996" (UID: "15bebbc5-dd43-4780-813f-a81a7918e996"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 21:18:25.261431 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.261396 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/15bebbc5-dd43-4780-813f-a81a7918e996-config-volume" (OuterVolumeSpecName: "config-volume") pod "15bebbc5-dd43-4780-813f-a81a7918e996" (UID: "15bebbc5-dd43-4780-813f-a81a7918e996"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 21:18:25.261718 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.261699 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/15bebbc5-dd43-4780-813f-a81a7918e996-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "15bebbc5-dd43-4780-813f-a81a7918e996" (UID: "15bebbc5-dd43-4780-813f-a81a7918e996"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 21:18:25.261872 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.261855 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/15bebbc5-dd43-4780-813f-a81a7918e996-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "15bebbc5-dd43-4780-813f-a81a7918e996" (UID: "15bebbc5-dd43-4780-813f-a81a7918e996"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 21:18:25.264490 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.264464 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/15bebbc5-dd43-4780-813f-a81a7918e996-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "15bebbc5-dd43-4780-813f-a81a7918e996" (UID: "15bebbc5-dd43-4780-813f-a81a7918e996"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 21:18:25.270677 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.270646 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/15bebbc5-dd43-4780-813f-a81a7918e996-web-config" (OuterVolumeSpecName: "web-config") pod "15bebbc5-dd43-4780-813f-a81a7918e996" (UID: "15bebbc5-dd43-4780-813f-a81a7918e996"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 21:18:25.358208 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.358155 2573 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/15bebbc5-dd43-4780-813f-a81a7918e996-config-volume\") on node \"ip-10-0-130-89.ec2.internal\" DevicePath \"\"" Jul 06 21:18:25.358208 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.358203 2573 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/15bebbc5-dd43-4780-813f-a81a7918e996-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-130-89.ec2.internal\" DevicePath \"\"" Jul 06 21:18:25.358208 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.358214 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w2bb4\" (UniqueName: \"kubernetes.io/projected/15bebbc5-dd43-4780-813f-a81a7918e996-kube-api-access-w2bb4\") on node \"ip-10-0-130-89.ec2.internal\" DevicePath \"\"" Jul 06 21:18:25.358208 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.358225 2573 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/15bebbc5-dd43-4780-813f-a81a7918e996-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-130-89.ec2.internal\" DevicePath \"\"" Jul 06 21:18:25.358487 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.358254 2573 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/15bebbc5-dd43-4780-813f-a81a7918e996-secret-alertmanager-main-tls\") on node \"ip-10-0-130-89.ec2.internal\" DevicePath \"\"" Jul 06 21:18:25.358487 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.358263 2573 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/15bebbc5-dd43-4780-813f-a81a7918e996-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-130-89.ec2.internal\" DevicePath \"\"" Jul 06 21:18:25.358487 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.358271 2573 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/15bebbc5-dd43-4780-813f-a81a7918e996-tls-assets\") on node \"ip-10-0-130-89.ec2.internal\" DevicePath \"\"" Jul 06 21:18:25.358487 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.358282 2573 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/15bebbc5-dd43-4780-813f-a81a7918e996-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-130-89.ec2.internal\" DevicePath \"\"" Jul 06 21:18:25.358487 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.358292 2573 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/15bebbc5-dd43-4780-813f-a81a7918e996-config-out\") on node \"ip-10-0-130-89.ec2.internal\" DevicePath \"\"" Jul 06 21:18:25.358487 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.358300 2573 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/15bebbc5-dd43-4780-813f-a81a7918e996-web-config\") on node \"ip-10-0-130-89.ec2.internal\" DevicePath \"\"" Jul 06 21:18:25.358487 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.358308 2573 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/15bebbc5-dd43-4780-813f-a81a7918e996-cluster-tls-config\") on node \"ip-10-0-130-89.ec2.internal\" DevicePath \"\"" Jul 06 21:18:25.786562 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.786524 2573 generic.go:356] "Generic (PLEG): container finished" podID="15bebbc5-dd43-4780-813f-a81a7918e996" containerID="b8a94cf81319b115e7c981d398b55164e7cd89b19fff2cb7b23a555389693e23" exitCode=0 Jul 06 21:18:25.786562 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.786556 2573 generic.go:356] "Generic (PLEG): container finished" podID="15bebbc5-dd43-4780-813f-a81a7918e996" containerID="ae20ee4dae64f98057cb50a74d7f7f4ef3d6ed3166887ddfbe1d34ba53a32081" exitCode=0 Jul 06 21:18:25.786562 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.786566 2573 generic.go:356] "Generic (PLEG): container finished" podID="15bebbc5-dd43-4780-813f-a81a7918e996" containerID="2b40df43b6b35ddbe420bd5873d489fb2cafa1f1d9bdd6cfbcec602432a668c7" exitCode=0 Jul 06 21:18:25.786562 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.786574 2573 generic.go:356] "Generic (PLEG): container finished" podID="15bebbc5-dd43-4780-813f-a81a7918e996" containerID="35ad55d495b27327240568d1d6ff44c9fc9afb0df62940076257d1f0cdcb2c0e" exitCode=0 Jul 06 21:18:25.787097 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.786583 2573 generic.go:356] "Generic (PLEG): container finished" podID="15bebbc5-dd43-4780-813f-a81a7918e996" containerID="b9ccb03655469599fc3038878a4e0d1dfe9f79aeafe7acaafa12128912af3317" exitCode=0 Jul 06 21:18:25.787097 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.786591 2573 generic.go:356] "Generic (PLEG): container finished" podID="15bebbc5-dd43-4780-813f-a81a7918e996" containerID="88d52cf9e633f5fd7c36908108e6df4863719636a5ab2191519eda15ce10d630" exitCode=0 Jul 06 21:18:25.787097 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.786598 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"15bebbc5-dd43-4780-813f-a81a7918e996","Type":"ContainerDied","Data":"b8a94cf81319b115e7c981d398b55164e7cd89b19fff2cb7b23a555389693e23"} Jul 06 21:18:25.787097 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.786617 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 06 21:18:25.787097 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.786669 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"15bebbc5-dd43-4780-813f-a81a7918e996","Type":"ContainerDied","Data":"ae20ee4dae64f98057cb50a74d7f7f4ef3d6ed3166887ddfbe1d34ba53a32081"} Jul 06 21:18:25.787097 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.786700 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"15bebbc5-dd43-4780-813f-a81a7918e996","Type":"ContainerDied","Data":"2b40df43b6b35ddbe420bd5873d489fb2cafa1f1d9bdd6cfbcec602432a668c7"} Jul 06 21:18:25.787097 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.786733 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"15bebbc5-dd43-4780-813f-a81a7918e996","Type":"ContainerDied","Data":"35ad55d495b27327240568d1d6ff44c9fc9afb0df62940076257d1f0cdcb2c0e"} Jul 06 21:18:25.787097 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.786744 2573 scope.go:117] "RemoveContainer" containerID="b8a94cf81319b115e7c981d398b55164e7cd89b19fff2cb7b23a555389693e23" Jul 06 21:18:25.787097 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.786772 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"15bebbc5-dd43-4780-813f-a81a7918e996","Type":"ContainerDied","Data":"b9ccb03655469599fc3038878a4e0d1dfe9f79aeafe7acaafa12128912af3317"} Jul 06 21:18:25.787097 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.786810 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"15bebbc5-dd43-4780-813f-a81a7918e996","Type":"ContainerDied","Data":"88d52cf9e633f5fd7c36908108e6df4863719636a5ab2191519eda15ce10d630"} Jul 06 21:18:25.787097 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.786849 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"15bebbc5-dd43-4780-813f-a81a7918e996","Type":"ContainerDied","Data":"cd332a8c7124c1be260e23c76888558773372a6672e756dd709099095e48898b"} Jul 06 21:18:25.794703 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.794676 2573 scope.go:117] "RemoveContainer" containerID="ae20ee4dae64f98057cb50a74d7f7f4ef3d6ed3166887ddfbe1d34ba53a32081" Jul 06 21:18:25.802107 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.802085 2573 scope.go:117] "RemoveContainer" containerID="2b40df43b6b35ddbe420bd5873d489fb2cafa1f1d9bdd6cfbcec602432a668c7" Jul 06 21:18:25.808669 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.808643 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 21:18:25.810921 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.810895 2573 scope.go:117] "RemoveContainer" containerID="35ad55d495b27327240568d1d6ff44c9fc9afb0df62940076257d1f0cdcb2c0e" Jul 06 21:18:25.813203 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.813178 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 21:18:25.819432 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.819413 2573 scope.go:117] "RemoveContainer" containerID="b9ccb03655469599fc3038878a4e0d1dfe9f79aeafe7acaafa12128912af3317" Jul 06 21:18:25.827361 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.827339 2573 scope.go:117] "RemoveContainer" containerID="88d52cf9e633f5fd7c36908108e6df4863719636a5ab2191519eda15ce10d630" Jul 06 21:18:25.835311 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.835291 2573 scope.go:117] "RemoveContainer" containerID="b61602bb8a80782de557eb313450bda55ee60bfd9924f6c91e55792e62e6fdee" Jul 06 21:18:25.838407 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.838384 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 21:18:25.838650 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.838638 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15bebbc5-dd43-4780-813f-a81a7918e996" containerName="kube-rbac-proxy-web" Jul 06 21:18:25.838691 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.838651 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="15bebbc5-dd43-4780-813f-a81a7918e996" containerName="kube-rbac-proxy-web" Jul 06 21:18:25.838691 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.838661 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15bebbc5-dd43-4780-813f-a81a7918e996" containerName="prom-label-proxy" Jul 06 21:18:25.838691 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.838666 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="15bebbc5-dd43-4780-813f-a81a7918e996" containerName="prom-label-proxy" Jul 06 21:18:25.838691 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.838676 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15bebbc5-dd43-4780-813f-a81a7918e996" containerName="config-reloader" Jul 06 21:18:25.838691 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.838681 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="15bebbc5-dd43-4780-813f-a81a7918e996" containerName="config-reloader" Jul 06 21:18:25.838691 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.838690 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15bebbc5-dd43-4780-813f-a81a7918e996" containerName="kube-rbac-proxy" Jul 06 21:18:25.838894 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.838695 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="15bebbc5-dd43-4780-813f-a81a7918e996" containerName="kube-rbac-proxy" Jul 06 21:18:25.838894 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.838700 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15bebbc5-dd43-4780-813f-a81a7918e996" containerName="kube-rbac-proxy-metric" Jul 06 21:18:25.838894 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.838705 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="15bebbc5-dd43-4780-813f-a81a7918e996" containerName="kube-rbac-proxy-metric" Jul 06 21:18:25.838894 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.838712 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15bebbc5-dd43-4780-813f-a81a7918e996" containerName="init-config-reloader" Jul 06 21:18:25.838894 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.838716 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="15bebbc5-dd43-4780-813f-a81a7918e996" containerName="init-config-reloader" Jul 06 21:18:25.838894 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.838721 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d6e2498f-743b-40c5-9076-38d722efc3e4" containerName="console" Jul 06 21:18:25.838894 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.838726 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6e2498f-743b-40c5-9076-38d722efc3e4" containerName="console" Jul 06 21:18:25.838894 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.838734 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15bebbc5-dd43-4780-813f-a81a7918e996" containerName="alertmanager" Jul 06 21:18:25.838894 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.838739 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="15bebbc5-dd43-4780-813f-a81a7918e996" containerName="alertmanager" Jul 06 21:18:25.838894 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.838795 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="15bebbc5-dd43-4780-813f-a81a7918e996" containerName="prom-label-proxy" Jul 06 21:18:25.838894 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.838802 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="15bebbc5-dd43-4780-813f-a81a7918e996" containerName="kube-rbac-proxy-metric" Jul 06 21:18:25.838894 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.838808 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="d6e2498f-743b-40c5-9076-38d722efc3e4" containerName="console" Jul 06 21:18:25.838894 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.838814 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="15bebbc5-dd43-4780-813f-a81a7918e996" containerName="config-reloader" Jul 06 21:18:25.838894 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.838819 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="15bebbc5-dd43-4780-813f-a81a7918e996" containerName="kube-rbac-proxy" Jul 06 21:18:25.838894 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.838825 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="15bebbc5-dd43-4780-813f-a81a7918e996" containerName="alertmanager" Jul 06 21:18:25.838894 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.838829 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="15bebbc5-dd43-4780-813f-a81a7918e996" containerName="kube-rbac-proxy-web" Jul 06 21:18:25.843634 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.843614 2573 scope.go:117] "RemoveContainer" containerID="b8a94cf81319b115e7c981d398b55164e7cd89b19fff2cb7b23a555389693e23" Jul 06 21:18:25.843945 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:18:25.843922 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b8a94cf81319b115e7c981d398b55164e7cd89b19fff2cb7b23a555389693e23\": container with ID starting with b8a94cf81319b115e7c981d398b55164e7cd89b19fff2cb7b23a555389693e23 not found: ID does not exist" containerID="b8a94cf81319b115e7c981d398b55164e7cd89b19fff2cb7b23a555389693e23" Jul 06 21:18:25.844058 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.843957 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b8a94cf81319b115e7c981d398b55164e7cd89b19fff2cb7b23a555389693e23"} err="failed to get container status \"b8a94cf81319b115e7c981d398b55164e7cd89b19fff2cb7b23a555389693e23\": rpc error: code = NotFound desc = could not find container \"b8a94cf81319b115e7c981d398b55164e7cd89b19fff2cb7b23a555389693e23\": container with ID starting with b8a94cf81319b115e7c981d398b55164e7cd89b19fff2cb7b23a555389693e23 not found: ID does not exist" Jul 06 21:18:25.844058 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.843984 2573 scope.go:117] "RemoveContainer" containerID="ae20ee4dae64f98057cb50a74d7f7f4ef3d6ed3166887ddfbe1d34ba53a32081" Jul 06 21:18:25.844058 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.844035 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 06 21:18:25.844409 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:18:25.844383 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ae20ee4dae64f98057cb50a74d7f7f4ef3d6ed3166887ddfbe1d34ba53a32081\": container with ID starting with ae20ee4dae64f98057cb50a74d7f7f4ef3d6ed3166887ddfbe1d34ba53a32081 not found: ID does not exist" containerID="ae20ee4dae64f98057cb50a74d7f7f4ef3d6ed3166887ddfbe1d34ba53a32081" Jul 06 21:18:25.844533 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.844419 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae20ee4dae64f98057cb50a74d7f7f4ef3d6ed3166887ddfbe1d34ba53a32081"} err="failed to get container status \"ae20ee4dae64f98057cb50a74d7f7f4ef3d6ed3166887ddfbe1d34ba53a32081\": rpc error: code = NotFound desc = could not find container \"ae20ee4dae64f98057cb50a74d7f7f4ef3d6ed3166887ddfbe1d34ba53a32081\": container with ID starting with ae20ee4dae64f98057cb50a74d7f7f4ef3d6ed3166887ddfbe1d34ba53a32081 not found: ID does not exist" Jul 06 21:18:25.844533 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.844444 2573 scope.go:117] "RemoveContainer" containerID="2b40df43b6b35ddbe420bd5873d489fb2cafa1f1d9bdd6cfbcec602432a668c7" Jul 06 21:18:25.844742 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:18:25.844724 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2b40df43b6b35ddbe420bd5873d489fb2cafa1f1d9bdd6cfbcec602432a668c7\": container with ID starting with 2b40df43b6b35ddbe420bd5873d489fb2cafa1f1d9bdd6cfbcec602432a668c7 not found: ID does not exist" containerID="2b40df43b6b35ddbe420bd5873d489fb2cafa1f1d9bdd6cfbcec602432a668c7" Jul 06 21:18:25.844814 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.844752 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2b40df43b6b35ddbe420bd5873d489fb2cafa1f1d9bdd6cfbcec602432a668c7"} err="failed to get container status \"2b40df43b6b35ddbe420bd5873d489fb2cafa1f1d9bdd6cfbcec602432a668c7\": rpc error: code = NotFound desc = could not find container \"2b40df43b6b35ddbe420bd5873d489fb2cafa1f1d9bdd6cfbcec602432a668c7\": container with ID starting with 2b40df43b6b35ddbe420bd5873d489fb2cafa1f1d9bdd6cfbcec602432a668c7 not found: ID does not exist" Jul 06 21:18:25.844814 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.844773 2573 scope.go:117] "RemoveContainer" containerID="35ad55d495b27327240568d1d6ff44c9fc9afb0df62940076257d1f0cdcb2c0e" Jul 06 21:18:25.845082 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:18:25.845060 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"35ad55d495b27327240568d1d6ff44c9fc9afb0df62940076257d1f0cdcb2c0e\": container with ID starting with 35ad55d495b27327240568d1d6ff44c9fc9afb0df62940076257d1f0cdcb2c0e not found: ID does not exist" containerID="35ad55d495b27327240568d1d6ff44c9fc9afb0df62940076257d1f0cdcb2c0e" Jul 06 21:18:25.845144 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.845090 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"35ad55d495b27327240568d1d6ff44c9fc9afb0df62940076257d1f0cdcb2c0e"} err="failed to get container status \"35ad55d495b27327240568d1d6ff44c9fc9afb0df62940076257d1f0cdcb2c0e\": rpc error: code = NotFound desc = could not find container \"35ad55d495b27327240568d1d6ff44c9fc9afb0df62940076257d1f0cdcb2c0e\": container with ID starting with 35ad55d495b27327240568d1d6ff44c9fc9afb0df62940076257d1f0cdcb2c0e not found: ID does not exist" Jul 06 21:18:25.845144 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.845113 2573 scope.go:117] "RemoveContainer" containerID="b9ccb03655469599fc3038878a4e0d1dfe9f79aeafe7acaafa12128912af3317" Jul 06 21:18:25.845387 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:18:25.845368 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b9ccb03655469599fc3038878a4e0d1dfe9f79aeafe7acaafa12128912af3317\": container with ID starting with b9ccb03655469599fc3038878a4e0d1dfe9f79aeafe7acaafa12128912af3317 not found: ID does not exist" containerID="b9ccb03655469599fc3038878a4e0d1dfe9f79aeafe7acaafa12128912af3317" Jul 06 21:18:25.845467 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.845393 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b9ccb03655469599fc3038878a4e0d1dfe9f79aeafe7acaafa12128912af3317"} err="failed to get container status \"b9ccb03655469599fc3038878a4e0d1dfe9f79aeafe7acaafa12128912af3317\": rpc error: code = NotFound desc = could not find container \"b9ccb03655469599fc3038878a4e0d1dfe9f79aeafe7acaafa12128912af3317\": container with ID starting with b9ccb03655469599fc3038878a4e0d1dfe9f79aeafe7acaafa12128912af3317 not found: ID does not exist" Jul 06 21:18:25.845467 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.845412 2573 scope.go:117] "RemoveContainer" containerID="88d52cf9e633f5fd7c36908108e6df4863719636a5ab2191519eda15ce10d630" Jul 06 21:18:25.845639 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:18:25.845623 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"88d52cf9e633f5fd7c36908108e6df4863719636a5ab2191519eda15ce10d630\": container with ID starting with 88d52cf9e633f5fd7c36908108e6df4863719636a5ab2191519eda15ce10d630 not found: ID does not exist" containerID="88d52cf9e633f5fd7c36908108e6df4863719636a5ab2191519eda15ce10d630" Jul 06 21:18:25.845678 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.845642 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"88d52cf9e633f5fd7c36908108e6df4863719636a5ab2191519eda15ce10d630"} err="failed to get container status \"88d52cf9e633f5fd7c36908108e6df4863719636a5ab2191519eda15ce10d630\": rpc error: code = NotFound desc = could not find container \"88d52cf9e633f5fd7c36908108e6df4863719636a5ab2191519eda15ce10d630\": container with ID starting with 88d52cf9e633f5fd7c36908108e6df4863719636a5ab2191519eda15ce10d630 not found: ID does not exist" Jul 06 21:18:25.845678 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.845655 2573 scope.go:117] "RemoveContainer" containerID="b61602bb8a80782de557eb313450bda55ee60bfd9924f6c91e55792e62e6fdee" Jul 06 21:18:25.845879 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:18:25.845864 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b61602bb8a80782de557eb313450bda55ee60bfd9924f6c91e55792e62e6fdee\": container with ID starting with b61602bb8a80782de557eb313450bda55ee60bfd9924f6c91e55792e62e6fdee not found: ID does not exist" containerID="b61602bb8a80782de557eb313450bda55ee60bfd9924f6c91e55792e62e6fdee" Jul 06 21:18:25.845922 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.845882 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b61602bb8a80782de557eb313450bda55ee60bfd9924f6c91e55792e62e6fdee"} err="failed to get container status \"b61602bb8a80782de557eb313450bda55ee60bfd9924f6c91e55792e62e6fdee\": rpc error: code = NotFound desc = could not find container \"b61602bb8a80782de557eb313450bda55ee60bfd9924f6c91e55792e62e6fdee\": container with ID starting with b61602bb8a80782de557eb313450bda55ee60bfd9924f6c91e55792e62e6fdee not found: ID does not exist" Jul 06 21:18:25.845922 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.845895 2573 scope.go:117] "RemoveContainer" containerID="b8a94cf81319b115e7c981d398b55164e7cd89b19fff2cb7b23a555389693e23" Jul 06 21:18:25.846084 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.846069 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b8a94cf81319b115e7c981d398b55164e7cd89b19fff2cb7b23a555389693e23"} err="failed to get container status \"b8a94cf81319b115e7c981d398b55164e7cd89b19fff2cb7b23a555389693e23\": rpc error: code = NotFound desc = could not find container \"b8a94cf81319b115e7c981d398b55164e7cd89b19fff2cb7b23a555389693e23\": container with ID starting with b8a94cf81319b115e7c981d398b55164e7cd89b19fff2cb7b23a555389693e23 not found: ID does not exist" Jul 06 21:18:25.846084 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.846083 2573 scope.go:117] "RemoveContainer" containerID="ae20ee4dae64f98057cb50a74d7f7f4ef3d6ed3166887ddfbe1d34ba53a32081" Jul 06 21:18:25.846299 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.846283 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae20ee4dae64f98057cb50a74d7f7f4ef3d6ed3166887ddfbe1d34ba53a32081"} err="failed to get container status \"ae20ee4dae64f98057cb50a74d7f7f4ef3d6ed3166887ddfbe1d34ba53a32081\": rpc error: code = NotFound desc = could not find container \"ae20ee4dae64f98057cb50a74d7f7f4ef3d6ed3166887ddfbe1d34ba53a32081\": container with ID starting with ae20ee4dae64f98057cb50a74d7f7f4ef3d6ed3166887ddfbe1d34ba53a32081 not found: ID does not exist" Jul 06 21:18:25.846347 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.846299 2573 scope.go:117] "RemoveContainer" containerID="2b40df43b6b35ddbe420bd5873d489fb2cafa1f1d9bdd6cfbcec602432a668c7" Jul 06 21:18:25.846510 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.846492 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2b40df43b6b35ddbe420bd5873d489fb2cafa1f1d9bdd6cfbcec602432a668c7"} err="failed to get container status \"2b40df43b6b35ddbe420bd5873d489fb2cafa1f1d9bdd6cfbcec602432a668c7\": rpc error: code = NotFound desc = could not find container \"2b40df43b6b35ddbe420bd5873d489fb2cafa1f1d9bdd6cfbcec602432a668c7\": container with ID starting with 2b40df43b6b35ddbe420bd5873d489fb2cafa1f1d9bdd6cfbcec602432a668c7 not found: ID does not exist" Jul 06 21:18:25.846547 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.846511 2573 scope.go:117] "RemoveContainer" containerID="35ad55d495b27327240568d1d6ff44c9fc9afb0df62940076257d1f0cdcb2c0e" Jul 06 21:18:25.846743 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.846727 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"35ad55d495b27327240568d1d6ff44c9fc9afb0df62940076257d1f0cdcb2c0e"} err="failed to get container status \"35ad55d495b27327240568d1d6ff44c9fc9afb0df62940076257d1f0cdcb2c0e\": rpc error: code = NotFound desc = could not find container \"35ad55d495b27327240568d1d6ff44c9fc9afb0df62940076257d1f0cdcb2c0e\": container with ID starting with 35ad55d495b27327240568d1d6ff44c9fc9afb0df62940076257d1f0cdcb2c0e not found: ID does not exist" Jul 06 21:18:25.846787 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.846744 2573 scope.go:117] "RemoveContainer" containerID="b9ccb03655469599fc3038878a4e0d1dfe9f79aeafe7acaafa12128912af3317" Jul 06 21:18:25.846986 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.846969 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b9ccb03655469599fc3038878a4e0d1dfe9f79aeafe7acaafa12128912af3317"} err="failed to get container status \"b9ccb03655469599fc3038878a4e0d1dfe9f79aeafe7acaafa12128912af3317\": rpc error: code = NotFound desc = could not find container \"b9ccb03655469599fc3038878a4e0d1dfe9f79aeafe7acaafa12128912af3317\": container with ID starting with b9ccb03655469599fc3038878a4e0d1dfe9f79aeafe7acaafa12128912af3317 not found: ID does not exist" Jul 06 21:18:25.846986 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.846987 2573 scope.go:117] "RemoveContainer" containerID="88d52cf9e633f5fd7c36908108e6df4863719636a5ab2191519eda15ce10d630" Jul 06 21:18:25.847385 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.847169 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 06 21:18:25.847385 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.847181 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"88d52cf9e633f5fd7c36908108e6df4863719636a5ab2191519eda15ce10d630"} err="failed to get container status \"88d52cf9e633f5fd7c36908108e6df4863719636a5ab2191519eda15ce10d630\": rpc error: code = NotFound desc = could not find container \"88d52cf9e633f5fd7c36908108e6df4863719636a5ab2191519eda15ce10d630\": container with ID starting with 88d52cf9e633f5fd7c36908108e6df4863719636a5ab2191519eda15ce10d630 not found: ID does not exist" Jul 06 21:18:25.847385 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.847200 2573 scope.go:117] "RemoveContainer" containerID="b61602bb8a80782de557eb313450bda55ee60bfd9924f6c91e55792e62e6fdee" Jul 06 21:18:25.847385 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.847223 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 06 21:18:25.847385 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.847287 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 06 21:18:25.847716 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.847469 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 06 21:18:25.847716 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.847478 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 06 21:18:25.847716 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.847646 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 06 21:18:25.847885 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.847792 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b61602bb8a80782de557eb313450bda55ee60bfd9924f6c91e55792e62e6fdee"} err="failed to get container status \"b61602bb8a80782de557eb313450bda55ee60bfd9924f6c91e55792e62e6fdee\": rpc error: code = NotFound desc = could not find container \"b61602bb8a80782de557eb313450bda55ee60bfd9924f6c91e55792e62e6fdee\": container with ID starting with b61602bb8a80782de557eb313450bda55ee60bfd9924f6c91e55792e62e6fdee not found: ID does not exist" Jul 06 21:18:25.847885 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.847816 2573 scope.go:117] "RemoveContainer" containerID="b8a94cf81319b115e7c981d398b55164e7cd89b19fff2cb7b23a555389693e23" Jul 06 21:18:25.848094 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.848072 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b8a94cf81319b115e7c981d398b55164e7cd89b19fff2cb7b23a555389693e23"} err="failed to get container status \"b8a94cf81319b115e7c981d398b55164e7cd89b19fff2cb7b23a555389693e23\": rpc error: code = NotFound desc = could not find container \"b8a94cf81319b115e7c981d398b55164e7cd89b19fff2cb7b23a555389693e23\": container with ID starting with b8a94cf81319b115e7c981d398b55164e7cd89b19fff2cb7b23a555389693e23 not found: ID does not exist" Jul 06 21:18:25.848094 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.848092 2573 scope.go:117] "RemoveContainer" containerID="ae20ee4dae64f98057cb50a74d7f7f4ef3d6ed3166887ddfbe1d34ba53a32081" Jul 06 21:18:25.848386 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.848167 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 06 21:18:25.848386 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.848225 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-smrv5\"" Jul 06 21:18:25.848386 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.848292 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 06 21:18:25.848386 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.848329 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae20ee4dae64f98057cb50a74d7f7f4ef3d6ed3166887ddfbe1d34ba53a32081"} err="failed to get container status \"ae20ee4dae64f98057cb50a74d7f7f4ef3d6ed3166887ddfbe1d34ba53a32081\": rpc error: code = NotFound desc = could not find container \"ae20ee4dae64f98057cb50a74d7f7f4ef3d6ed3166887ddfbe1d34ba53a32081\": container with ID starting with ae20ee4dae64f98057cb50a74d7f7f4ef3d6ed3166887ddfbe1d34ba53a32081 not found: ID does not exist" Jul 06 21:18:25.848386 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.848352 2573 scope.go:117] "RemoveContainer" containerID="2b40df43b6b35ddbe420bd5873d489fb2cafa1f1d9bdd6cfbcec602432a668c7" Jul 06 21:18:25.848669 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.848618 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2b40df43b6b35ddbe420bd5873d489fb2cafa1f1d9bdd6cfbcec602432a668c7"} err="failed to get container status \"2b40df43b6b35ddbe420bd5873d489fb2cafa1f1d9bdd6cfbcec602432a668c7\": rpc error: code = NotFound desc = could not find container \"2b40df43b6b35ddbe420bd5873d489fb2cafa1f1d9bdd6cfbcec602432a668c7\": container with ID starting with 2b40df43b6b35ddbe420bd5873d489fb2cafa1f1d9bdd6cfbcec602432a668c7 not found: ID does not exist" Jul 06 21:18:25.848669 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.848635 2573 scope.go:117] "RemoveContainer" containerID="35ad55d495b27327240568d1d6ff44c9fc9afb0df62940076257d1f0cdcb2c0e" Jul 06 21:18:25.848883 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.848860 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"35ad55d495b27327240568d1d6ff44c9fc9afb0df62940076257d1f0cdcb2c0e"} err="failed to get container status \"35ad55d495b27327240568d1d6ff44c9fc9afb0df62940076257d1f0cdcb2c0e\": rpc error: code = NotFound desc = could not find container \"35ad55d495b27327240568d1d6ff44c9fc9afb0df62940076257d1f0cdcb2c0e\": container with ID starting with 35ad55d495b27327240568d1d6ff44c9fc9afb0df62940076257d1f0cdcb2c0e not found: ID does not exist" Jul 06 21:18:25.848947 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.848887 2573 scope.go:117] "RemoveContainer" containerID="b9ccb03655469599fc3038878a4e0d1dfe9f79aeafe7acaafa12128912af3317" Jul 06 21:18:25.849157 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.849138 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b9ccb03655469599fc3038878a4e0d1dfe9f79aeafe7acaafa12128912af3317"} err="failed to get container status \"b9ccb03655469599fc3038878a4e0d1dfe9f79aeafe7acaafa12128912af3317\": rpc error: code = NotFound desc = could not find container \"b9ccb03655469599fc3038878a4e0d1dfe9f79aeafe7acaafa12128912af3317\": container with ID starting with b9ccb03655469599fc3038878a4e0d1dfe9f79aeafe7acaafa12128912af3317 not found: ID does not exist" Jul 06 21:18:25.849257 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.849157 2573 scope.go:117] "RemoveContainer" containerID="88d52cf9e633f5fd7c36908108e6df4863719636a5ab2191519eda15ce10d630" Jul 06 21:18:25.849425 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.849403 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"88d52cf9e633f5fd7c36908108e6df4863719636a5ab2191519eda15ce10d630"} err="failed to get container status \"88d52cf9e633f5fd7c36908108e6df4863719636a5ab2191519eda15ce10d630\": rpc error: code = NotFound desc = could not find container \"88d52cf9e633f5fd7c36908108e6df4863719636a5ab2191519eda15ce10d630\": container with ID starting with 88d52cf9e633f5fd7c36908108e6df4863719636a5ab2191519eda15ce10d630 not found: ID does not exist" Jul 06 21:18:25.849497 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.849428 2573 scope.go:117] "RemoveContainer" containerID="b61602bb8a80782de557eb313450bda55ee60bfd9924f6c91e55792e62e6fdee" Jul 06 21:18:25.849683 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.849660 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b61602bb8a80782de557eb313450bda55ee60bfd9924f6c91e55792e62e6fdee"} err="failed to get container status \"b61602bb8a80782de557eb313450bda55ee60bfd9924f6c91e55792e62e6fdee\": rpc error: code = NotFound desc = could not find container \"b61602bb8a80782de557eb313450bda55ee60bfd9924f6c91e55792e62e6fdee\": container with ID starting with b61602bb8a80782de557eb313450bda55ee60bfd9924f6c91e55792e62e6fdee not found: ID does not exist" Jul 06 21:18:25.849683 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.849678 2573 scope.go:117] "RemoveContainer" containerID="b8a94cf81319b115e7c981d398b55164e7cd89b19fff2cb7b23a555389693e23" Jul 06 21:18:25.849946 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.849917 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b8a94cf81319b115e7c981d398b55164e7cd89b19fff2cb7b23a555389693e23"} err="failed to get container status \"b8a94cf81319b115e7c981d398b55164e7cd89b19fff2cb7b23a555389693e23\": rpc error: code = NotFound desc = could not find container \"b8a94cf81319b115e7c981d398b55164e7cd89b19fff2cb7b23a555389693e23\": container with ID starting with b8a94cf81319b115e7c981d398b55164e7cd89b19fff2cb7b23a555389693e23 not found: ID does not exist" Jul 06 21:18:25.849946 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.849937 2573 scope.go:117] "RemoveContainer" containerID="ae20ee4dae64f98057cb50a74d7f7f4ef3d6ed3166887ddfbe1d34ba53a32081" Jul 06 21:18:25.850251 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.850213 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae20ee4dae64f98057cb50a74d7f7f4ef3d6ed3166887ddfbe1d34ba53a32081"} err="failed to get container status \"ae20ee4dae64f98057cb50a74d7f7f4ef3d6ed3166887ddfbe1d34ba53a32081\": rpc error: code = NotFound desc = could not find container \"ae20ee4dae64f98057cb50a74d7f7f4ef3d6ed3166887ddfbe1d34ba53a32081\": container with ID starting with ae20ee4dae64f98057cb50a74d7f7f4ef3d6ed3166887ddfbe1d34ba53a32081 not found: ID does not exist" Jul 06 21:18:25.850330 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.850251 2573 scope.go:117] "RemoveContainer" containerID="2b40df43b6b35ddbe420bd5873d489fb2cafa1f1d9bdd6cfbcec602432a668c7" Jul 06 21:18:25.850564 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.850538 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2b40df43b6b35ddbe420bd5873d489fb2cafa1f1d9bdd6cfbcec602432a668c7"} err="failed to get container status \"2b40df43b6b35ddbe420bd5873d489fb2cafa1f1d9bdd6cfbcec602432a668c7\": rpc error: code = NotFound desc = could not find container \"2b40df43b6b35ddbe420bd5873d489fb2cafa1f1d9bdd6cfbcec602432a668c7\": container with ID starting with 2b40df43b6b35ddbe420bd5873d489fb2cafa1f1d9bdd6cfbcec602432a668c7 not found: ID does not exist" Jul 06 21:18:25.850651 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.850565 2573 scope.go:117] "RemoveContainer" containerID="35ad55d495b27327240568d1d6ff44c9fc9afb0df62940076257d1f0cdcb2c0e" Jul 06 21:18:25.850926 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.850810 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"35ad55d495b27327240568d1d6ff44c9fc9afb0df62940076257d1f0cdcb2c0e"} err="failed to get container status \"35ad55d495b27327240568d1d6ff44c9fc9afb0df62940076257d1f0cdcb2c0e\": rpc error: code = NotFound desc = could not find container \"35ad55d495b27327240568d1d6ff44c9fc9afb0df62940076257d1f0cdcb2c0e\": container with ID starting with 35ad55d495b27327240568d1d6ff44c9fc9afb0df62940076257d1f0cdcb2c0e not found: ID does not exist" Jul 06 21:18:25.850926 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.850837 2573 scope.go:117] "RemoveContainer" containerID="b9ccb03655469599fc3038878a4e0d1dfe9f79aeafe7acaafa12128912af3317" Jul 06 21:18:25.851139 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.851116 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b9ccb03655469599fc3038878a4e0d1dfe9f79aeafe7acaafa12128912af3317"} err="failed to get container status \"b9ccb03655469599fc3038878a4e0d1dfe9f79aeafe7acaafa12128912af3317\": rpc error: code = NotFound desc = could not find container \"b9ccb03655469599fc3038878a4e0d1dfe9f79aeafe7acaafa12128912af3317\": container with ID starting with b9ccb03655469599fc3038878a4e0d1dfe9f79aeafe7acaafa12128912af3317 not found: ID does not exist" Jul 06 21:18:25.851215 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.851141 2573 scope.go:117] "RemoveContainer" containerID="88d52cf9e633f5fd7c36908108e6df4863719636a5ab2191519eda15ce10d630" Jul 06 21:18:25.851495 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.851467 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"88d52cf9e633f5fd7c36908108e6df4863719636a5ab2191519eda15ce10d630"} err="failed to get container status \"88d52cf9e633f5fd7c36908108e6df4863719636a5ab2191519eda15ce10d630\": rpc error: code = NotFound desc = could not find container \"88d52cf9e633f5fd7c36908108e6df4863719636a5ab2191519eda15ce10d630\": container with ID starting with 88d52cf9e633f5fd7c36908108e6df4863719636a5ab2191519eda15ce10d630 not found: ID does not exist" Jul 06 21:18:25.851598 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.851496 2573 scope.go:117] "RemoveContainer" containerID="b61602bb8a80782de557eb313450bda55ee60bfd9924f6c91e55792e62e6fdee" Jul 06 21:18:25.851796 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.851757 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b61602bb8a80782de557eb313450bda55ee60bfd9924f6c91e55792e62e6fdee"} err="failed to get container status \"b61602bb8a80782de557eb313450bda55ee60bfd9924f6c91e55792e62e6fdee\": rpc error: code = NotFound desc = could not find container \"b61602bb8a80782de557eb313450bda55ee60bfd9924f6c91e55792e62e6fdee\": container with ID starting with b61602bb8a80782de557eb313450bda55ee60bfd9924f6c91e55792e62e6fdee not found: ID does not exist" Jul 06 21:18:25.851796 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.851780 2573 scope.go:117] "RemoveContainer" containerID="b8a94cf81319b115e7c981d398b55164e7cd89b19fff2cb7b23a555389693e23" Jul 06 21:18:25.852109 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.852084 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b8a94cf81319b115e7c981d398b55164e7cd89b19fff2cb7b23a555389693e23"} err="failed to get container status \"b8a94cf81319b115e7c981d398b55164e7cd89b19fff2cb7b23a555389693e23\": rpc error: code = NotFound desc = could not find container \"b8a94cf81319b115e7c981d398b55164e7cd89b19fff2cb7b23a555389693e23\": container with ID starting with b8a94cf81319b115e7c981d398b55164e7cd89b19fff2cb7b23a555389693e23 not found: ID does not exist" Jul 06 21:18:25.852189 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.852106 2573 scope.go:117] "RemoveContainer" containerID="ae20ee4dae64f98057cb50a74d7f7f4ef3d6ed3166887ddfbe1d34ba53a32081" Jul 06 21:18:25.852741 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.852702 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae20ee4dae64f98057cb50a74d7f7f4ef3d6ed3166887ddfbe1d34ba53a32081"} err="failed to get container status \"ae20ee4dae64f98057cb50a74d7f7f4ef3d6ed3166887ddfbe1d34ba53a32081\": rpc error: code = NotFound desc = could not find container \"ae20ee4dae64f98057cb50a74d7f7f4ef3d6ed3166887ddfbe1d34ba53a32081\": container with ID starting with ae20ee4dae64f98057cb50a74d7f7f4ef3d6ed3166887ddfbe1d34ba53a32081 not found: ID does not exist" Jul 06 21:18:25.852811 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.852744 2573 scope.go:117] "RemoveContainer" containerID="2b40df43b6b35ddbe420bd5873d489fb2cafa1f1d9bdd6cfbcec602432a668c7" Jul 06 21:18:25.853025 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.853006 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2b40df43b6b35ddbe420bd5873d489fb2cafa1f1d9bdd6cfbcec602432a668c7"} err="failed to get container status \"2b40df43b6b35ddbe420bd5873d489fb2cafa1f1d9bdd6cfbcec602432a668c7\": rpc error: code = NotFound desc = could not find container \"2b40df43b6b35ddbe420bd5873d489fb2cafa1f1d9bdd6cfbcec602432a668c7\": container with ID starting with 2b40df43b6b35ddbe420bd5873d489fb2cafa1f1d9bdd6cfbcec602432a668c7 not found: ID does not exist" Jul 06 21:18:25.853025 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.853024 2573 scope.go:117] "RemoveContainer" containerID="35ad55d495b27327240568d1d6ff44c9fc9afb0df62940076257d1f0cdcb2c0e" Jul 06 21:18:25.853189 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.853141 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 06 21:18:25.853312 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.853278 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"35ad55d495b27327240568d1d6ff44c9fc9afb0df62940076257d1f0cdcb2c0e"} err="failed to get container status \"35ad55d495b27327240568d1d6ff44c9fc9afb0df62940076257d1f0cdcb2c0e\": rpc error: code = NotFound desc = could not find container \"35ad55d495b27327240568d1d6ff44c9fc9afb0df62940076257d1f0cdcb2c0e\": container with ID starting with 35ad55d495b27327240568d1d6ff44c9fc9afb0df62940076257d1f0cdcb2c0e not found: ID does not exist" Jul 06 21:18:25.853312 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.853296 2573 scope.go:117] "RemoveContainer" containerID="b9ccb03655469599fc3038878a4e0d1dfe9f79aeafe7acaafa12128912af3317" Jul 06 21:18:25.853532 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.853514 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b9ccb03655469599fc3038878a4e0d1dfe9f79aeafe7acaafa12128912af3317"} err="failed to get container status \"b9ccb03655469599fc3038878a4e0d1dfe9f79aeafe7acaafa12128912af3317\": rpc error: code = NotFound desc = could not find container \"b9ccb03655469599fc3038878a4e0d1dfe9f79aeafe7acaafa12128912af3317\": container with ID starting with b9ccb03655469599fc3038878a4e0d1dfe9f79aeafe7acaafa12128912af3317 not found: ID does not exist" Jul 06 21:18:25.853588 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.853533 2573 scope.go:117] "RemoveContainer" containerID="88d52cf9e633f5fd7c36908108e6df4863719636a5ab2191519eda15ce10d630" Jul 06 21:18:25.853768 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.853750 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"88d52cf9e633f5fd7c36908108e6df4863719636a5ab2191519eda15ce10d630"} err="failed to get container status \"88d52cf9e633f5fd7c36908108e6df4863719636a5ab2191519eda15ce10d630\": rpc error: code = NotFound desc = could not find container \"88d52cf9e633f5fd7c36908108e6df4863719636a5ab2191519eda15ce10d630\": container with ID starting with 88d52cf9e633f5fd7c36908108e6df4863719636a5ab2191519eda15ce10d630 not found: ID does not exist" Jul 06 21:18:25.853768 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.853768 2573 scope.go:117] "RemoveContainer" containerID="b61602bb8a80782de557eb313450bda55ee60bfd9924f6c91e55792e62e6fdee" Jul 06 21:18:25.854111 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.854085 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b61602bb8a80782de557eb313450bda55ee60bfd9924f6c91e55792e62e6fdee"} err="failed to get container status \"b61602bb8a80782de557eb313450bda55ee60bfd9924f6c91e55792e62e6fdee\": rpc error: code = NotFound desc = could not find container \"b61602bb8a80782de557eb313450bda55ee60bfd9924f6c91e55792e62e6fdee\": container with ID starting with b61602bb8a80782de557eb313450bda55ee60bfd9924f6c91e55792e62e6fdee not found: ID does not exist" Jul 06 21:18:25.854111 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.854113 2573 scope.go:117] "RemoveContainer" containerID="b8a94cf81319b115e7c981d398b55164e7cd89b19fff2cb7b23a555389693e23" Jul 06 21:18:25.854526 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.854503 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b8a94cf81319b115e7c981d398b55164e7cd89b19fff2cb7b23a555389693e23"} err="failed to get container status \"b8a94cf81319b115e7c981d398b55164e7cd89b19fff2cb7b23a555389693e23\": rpc error: code = NotFound desc = could not find container \"b8a94cf81319b115e7c981d398b55164e7cd89b19fff2cb7b23a555389693e23\": container with ID starting with b8a94cf81319b115e7c981d398b55164e7cd89b19fff2cb7b23a555389693e23 not found: ID does not exist" Jul 06 21:18:25.854638 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.854527 2573 scope.go:117] "RemoveContainer" containerID="ae20ee4dae64f98057cb50a74d7f7f4ef3d6ed3166887ddfbe1d34ba53a32081" Jul 06 21:18:25.854878 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.854829 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae20ee4dae64f98057cb50a74d7f7f4ef3d6ed3166887ddfbe1d34ba53a32081"} err="failed to get container status \"ae20ee4dae64f98057cb50a74d7f7f4ef3d6ed3166887ddfbe1d34ba53a32081\": rpc error: code = NotFound desc = could not find container \"ae20ee4dae64f98057cb50a74d7f7f4ef3d6ed3166887ddfbe1d34ba53a32081\": container with ID starting with ae20ee4dae64f98057cb50a74d7f7f4ef3d6ed3166887ddfbe1d34ba53a32081 not found: ID does not exist" Jul 06 21:18:25.854986 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.854879 2573 scope.go:117] "RemoveContainer" containerID="2b40df43b6b35ddbe420bd5873d489fb2cafa1f1d9bdd6cfbcec602432a668c7" Jul 06 21:18:25.855406 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.855371 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2b40df43b6b35ddbe420bd5873d489fb2cafa1f1d9bdd6cfbcec602432a668c7"} err="failed to get container status \"2b40df43b6b35ddbe420bd5873d489fb2cafa1f1d9bdd6cfbcec602432a668c7\": rpc error: code = NotFound desc = could not find container \"2b40df43b6b35ddbe420bd5873d489fb2cafa1f1d9bdd6cfbcec602432a668c7\": container with ID starting with 2b40df43b6b35ddbe420bd5873d489fb2cafa1f1d9bdd6cfbcec602432a668c7 not found: ID does not exist" Jul 06 21:18:25.855406 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.855406 2573 scope.go:117] "RemoveContainer" containerID="35ad55d495b27327240568d1d6ff44c9fc9afb0df62940076257d1f0cdcb2c0e" Jul 06 21:18:25.855703 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.855685 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"35ad55d495b27327240568d1d6ff44c9fc9afb0df62940076257d1f0cdcb2c0e"} err="failed to get container status \"35ad55d495b27327240568d1d6ff44c9fc9afb0df62940076257d1f0cdcb2c0e\": rpc error: code = NotFound desc = could not find container \"35ad55d495b27327240568d1d6ff44c9fc9afb0df62940076257d1f0cdcb2c0e\": container with ID starting with 35ad55d495b27327240568d1d6ff44c9fc9afb0df62940076257d1f0cdcb2c0e not found: ID does not exist" Jul 06 21:18:25.855703 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.855703 2573 scope.go:117] "RemoveContainer" containerID="b9ccb03655469599fc3038878a4e0d1dfe9f79aeafe7acaafa12128912af3317" Jul 06 21:18:25.855957 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.855936 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b9ccb03655469599fc3038878a4e0d1dfe9f79aeafe7acaafa12128912af3317"} err="failed to get container status \"b9ccb03655469599fc3038878a4e0d1dfe9f79aeafe7acaafa12128912af3317\": rpc error: code = NotFound desc = could not find container \"b9ccb03655469599fc3038878a4e0d1dfe9f79aeafe7acaafa12128912af3317\": container with ID starting with b9ccb03655469599fc3038878a4e0d1dfe9f79aeafe7acaafa12128912af3317 not found: ID does not exist" Jul 06 21:18:25.856033 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.855960 2573 scope.go:117] "RemoveContainer" containerID="88d52cf9e633f5fd7c36908108e6df4863719636a5ab2191519eda15ce10d630" Jul 06 21:18:25.856210 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.856185 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"88d52cf9e633f5fd7c36908108e6df4863719636a5ab2191519eda15ce10d630"} err="failed to get container status \"88d52cf9e633f5fd7c36908108e6df4863719636a5ab2191519eda15ce10d630\": rpc error: code = NotFound desc = could not find container \"88d52cf9e633f5fd7c36908108e6df4863719636a5ab2191519eda15ce10d630\": container with ID starting with 88d52cf9e633f5fd7c36908108e6df4863719636a5ab2191519eda15ce10d630 not found: ID does not exist" Jul 06 21:18:25.856328 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.856211 2573 scope.go:117] "RemoveContainer" containerID="b61602bb8a80782de557eb313450bda55ee60bfd9924f6c91e55792e62e6fdee" Jul 06 21:18:25.856478 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.856446 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b61602bb8a80782de557eb313450bda55ee60bfd9924f6c91e55792e62e6fdee"} err="failed to get container status \"b61602bb8a80782de557eb313450bda55ee60bfd9924f6c91e55792e62e6fdee\": rpc error: code = NotFound desc = could not find container \"b61602bb8a80782de557eb313450bda55ee60bfd9924f6c91e55792e62e6fdee\": container with ID starting with b61602bb8a80782de557eb313450bda55ee60bfd9924f6c91e55792e62e6fdee not found: ID does not exist" Jul 06 21:18:25.857420 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.857403 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 21:18:25.963568 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.963533 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/dd6e4070-ac28-4be7-8ea1-3e892cf7e6f2-config-volume\") pod \"alertmanager-main-0\" (UID: \"dd6e4070-ac28-4be7-8ea1-3e892cf7e6f2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 21:18:25.963736 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.963577 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd6e4070-ac28-4be7-8ea1-3e892cf7e6f2-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"dd6e4070-ac28-4be7-8ea1-3e892cf7e6f2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 21:18:25.963736 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.963618 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dd6e4070-ac28-4be7-8ea1-3e892cf7e6f2-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"dd6e4070-ac28-4be7-8ea1-3e892cf7e6f2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 21:18:25.963736 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.963639 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z8rl2\" (UniqueName: \"kubernetes.io/projected/dd6e4070-ac28-4be7-8ea1-3e892cf7e6f2-kube-api-access-z8rl2\") pod \"alertmanager-main-0\" (UID: \"dd6e4070-ac28-4be7-8ea1-3e892cf7e6f2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 21:18:25.963736 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.963659 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dd6e4070-ac28-4be7-8ea1-3e892cf7e6f2-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"dd6e4070-ac28-4be7-8ea1-3e892cf7e6f2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 21:18:25.963736 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.963717 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/dd6e4070-ac28-4be7-8ea1-3e892cf7e6f2-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"dd6e4070-ac28-4be7-8ea1-3e892cf7e6f2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 21:18:25.963932 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.963790 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/dd6e4070-ac28-4be7-8ea1-3e892cf7e6f2-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"dd6e4070-ac28-4be7-8ea1-3e892cf7e6f2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 21:18:25.963932 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.963849 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dd6e4070-ac28-4be7-8ea1-3e892cf7e6f2-web-config\") pod \"alertmanager-main-0\" (UID: \"dd6e4070-ac28-4be7-8ea1-3e892cf7e6f2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 21:18:25.963932 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.963873 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dd6e4070-ac28-4be7-8ea1-3e892cf7e6f2-tls-assets\") pod \"alertmanager-main-0\" (UID: \"dd6e4070-ac28-4be7-8ea1-3e892cf7e6f2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 21:18:25.963932 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.963889 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/dd6e4070-ac28-4be7-8ea1-3e892cf7e6f2-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"dd6e4070-ac28-4be7-8ea1-3e892cf7e6f2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 21:18:25.963932 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.963917 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dd6e4070-ac28-4be7-8ea1-3e892cf7e6f2-config-out\") pod \"alertmanager-main-0\" (UID: \"dd6e4070-ac28-4be7-8ea1-3e892cf7e6f2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 21:18:25.964096 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.963939 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dd6e4070-ac28-4be7-8ea1-3e892cf7e6f2-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"dd6e4070-ac28-4be7-8ea1-3e892cf7e6f2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 21:18:25.964096 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:25.963961 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/dd6e4070-ac28-4be7-8ea1-3e892cf7e6f2-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"dd6e4070-ac28-4be7-8ea1-3e892cf7e6f2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 21:18:26.064574 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:26.064534 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/dd6e4070-ac28-4be7-8ea1-3e892cf7e6f2-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"dd6e4070-ac28-4be7-8ea1-3e892cf7e6f2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 21:18:26.064574 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:26.064581 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dd6e4070-ac28-4be7-8ea1-3e892cf7e6f2-web-config\") pod \"alertmanager-main-0\" (UID: \"dd6e4070-ac28-4be7-8ea1-3e892cf7e6f2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 21:18:26.064811 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:26.064609 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dd6e4070-ac28-4be7-8ea1-3e892cf7e6f2-tls-assets\") pod \"alertmanager-main-0\" (UID: \"dd6e4070-ac28-4be7-8ea1-3e892cf7e6f2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 21:18:26.064811 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:26.064631 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/dd6e4070-ac28-4be7-8ea1-3e892cf7e6f2-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"dd6e4070-ac28-4be7-8ea1-3e892cf7e6f2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 21:18:26.064811 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:26.064658 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dd6e4070-ac28-4be7-8ea1-3e892cf7e6f2-config-out\") pod \"alertmanager-main-0\" (UID: \"dd6e4070-ac28-4be7-8ea1-3e892cf7e6f2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 21:18:26.064811 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:26.064681 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dd6e4070-ac28-4be7-8ea1-3e892cf7e6f2-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"dd6e4070-ac28-4be7-8ea1-3e892cf7e6f2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 21:18:26.064811 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:26.064703 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/dd6e4070-ac28-4be7-8ea1-3e892cf7e6f2-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"dd6e4070-ac28-4be7-8ea1-3e892cf7e6f2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 21:18:26.064811 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:26.064747 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/dd6e4070-ac28-4be7-8ea1-3e892cf7e6f2-config-volume\") pod \"alertmanager-main-0\" (UID: \"dd6e4070-ac28-4be7-8ea1-3e892cf7e6f2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 21:18:26.064811 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:26.064777 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd6e4070-ac28-4be7-8ea1-3e892cf7e6f2-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"dd6e4070-ac28-4be7-8ea1-3e892cf7e6f2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 21:18:26.064811 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:26.064809 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dd6e4070-ac28-4be7-8ea1-3e892cf7e6f2-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"dd6e4070-ac28-4be7-8ea1-3e892cf7e6f2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 21:18:26.065188 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:26.064844 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z8rl2\" (UniqueName: \"kubernetes.io/projected/dd6e4070-ac28-4be7-8ea1-3e892cf7e6f2-kube-api-access-z8rl2\") pod \"alertmanager-main-0\" (UID: \"dd6e4070-ac28-4be7-8ea1-3e892cf7e6f2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 21:18:26.065188 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:26.064876 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dd6e4070-ac28-4be7-8ea1-3e892cf7e6f2-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"dd6e4070-ac28-4be7-8ea1-3e892cf7e6f2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 21:18:26.065188 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:26.064915 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/dd6e4070-ac28-4be7-8ea1-3e892cf7e6f2-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"dd6e4070-ac28-4be7-8ea1-3e892cf7e6f2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 21:18:26.065188 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:26.065083 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/dd6e4070-ac28-4be7-8ea1-3e892cf7e6f2-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"dd6e4070-ac28-4be7-8ea1-3e892cf7e6f2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 21:18:26.066116 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:26.065778 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dd6e4070-ac28-4be7-8ea1-3e892cf7e6f2-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"dd6e4070-ac28-4be7-8ea1-3e892cf7e6f2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 21:18:26.067834 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:26.067701 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/dd6e4070-ac28-4be7-8ea1-3e892cf7e6f2-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"dd6e4070-ac28-4be7-8ea1-3e892cf7e6f2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 21:18:26.067834 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:26.067713 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dd6e4070-ac28-4be7-8ea1-3e892cf7e6f2-tls-assets\") pod \"alertmanager-main-0\" (UID: \"dd6e4070-ac28-4be7-8ea1-3e892cf7e6f2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 21:18:26.067834 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:26.067738 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dd6e4070-ac28-4be7-8ea1-3e892cf7e6f2-config-out\") pod \"alertmanager-main-0\" (UID: \"dd6e4070-ac28-4be7-8ea1-3e892cf7e6f2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 21:18:26.068029 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:26.067850 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/dd6e4070-ac28-4be7-8ea1-3e892cf7e6f2-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"dd6e4070-ac28-4be7-8ea1-3e892cf7e6f2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 21:18:26.068029 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:26.067886 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/dd6e4070-ac28-4be7-8ea1-3e892cf7e6f2-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"dd6e4070-ac28-4be7-8ea1-3e892cf7e6f2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 21:18:26.068217 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:26.068195 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dd6e4070-ac28-4be7-8ea1-3e892cf7e6f2-web-config\") pod \"alertmanager-main-0\" (UID: \"dd6e4070-ac28-4be7-8ea1-3e892cf7e6f2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 21:18:26.068424 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:26.068407 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dd6e4070-ac28-4be7-8ea1-3e892cf7e6f2-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"dd6e4070-ac28-4be7-8ea1-3e892cf7e6f2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 21:18:26.068512 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:26.068492 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/dd6e4070-ac28-4be7-8ea1-3e892cf7e6f2-config-volume\") pod \"alertmanager-main-0\" (UID: \"dd6e4070-ac28-4be7-8ea1-3e892cf7e6f2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 21:18:26.068613 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:26.068597 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd6e4070-ac28-4be7-8ea1-3e892cf7e6f2-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"dd6e4070-ac28-4be7-8ea1-3e892cf7e6f2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 21:18:26.069550 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:26.069534 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dd6e4070-ac28-4be7-8ea1-3e892cf7e6f2-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"dd6e4070-ac28-4be7-8ea1-3e892cf7e6f2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 21:18:26.075822 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:26.075804 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z8rl2\" (UniqueName: \"kubernetes.io/projected/dd6e4070-ac28-4be7-8ea1-3e892cf7e6f2-kube-api-access-z8rl2\") pod \"alertmanager-main-0\" (UID: \"dd6e4070-ac28-4be7-8ea1-3e892cf7e6f2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 21:18:26.155965 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:26.155930 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 06 21:18:26.308474 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:26.308452 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 21:18:26.310291 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:18:26.310264 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd6e4070_ac28_4be7_8ea1_3e892cf7e6f2.slice/crio-e401ffe5f153010780759c15494a9c20678cf55b0e457da6db07d4f6082582aa WatchSource:0}: Error finding container e401ffe5f153010780759c15494a9c20678cf55b0e457da6db07d4f6082582aa: Status 404 returned error can't find the container with id e401ffe5f153010780759c15494a9c20678cf55b0e457da6db07d4f6082582aa Jul 06 21:18:26.792532 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:26.792497 2573 generic.go:356] "Generic (PLEG): container finished" podID="dd6e4070-ac28-4be7-8ea1-3e892cf7e6f2" containerID="62940c6fc8c5bff247b5ee37c623bd6f8d09a5e3efebc6502f6e1f57303520c5" exitCode=0 Jul 06 21:18:26.792904 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:26.792565 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dd6e4070-ac28-4be7-8ea1-3e892cf7e6f2","Type":"ContainerDied","Data":"62940c6fc8c5bff247b5ee37c623bd6f8d09a5e3efebc6502f6e1f57303520c5"} Jul 06 21:18:26.792904 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:26.792618 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dd6e4070-ac28-4be7-8ea1-3e892cf7e6f2","Type":"ContainerStarted","Data":"e401ffe5f153010780759c15494a9c20678cf55b0e457da6db07d4f6082582aa"} Jul 06 21:18:27.642285 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:27.642251 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="15bebbc5-dd43-4780-813f-a81a7918e996" path="/var/lib/kubelet/pods/15bebbc5-dd43-4780-813f-a81a7918e996/volumes" Jul 06 21:18:27.799536 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:27.799504 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dd6e4070-ac28-4be7-8ea1-3e892cf7e6f2","Type":"ContainerStarted","Data":"59eebd904df9d1c6b1790a61f20742e918832f1dde18693bc67177670aa7d3fd"} Jul 06 21:18:27.799932 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:27.799570 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dd6e4070-ac28-4be7-8ea1-3e892cf7e6f2","Type":"ContainerStarted","Data":"9e2e35c5e6d71a36247727560c66389b0e1bdb2c8fe77ee3f78864dcc307b7a5"} Jul 06 21:18:27.799932 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:27.799608 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dd6e4070-ac28-4be7-8ea1-3e892cf7e6f2","Type":"ContainerStarted","Data":"7577df47b7172e6030f7a867d78320908cfb1d96f7e3672ee0eac58477cb45a7"} Jul 06 21:18:27.799932 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:27.799637 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dd6e4070-ac28-4be7-8ea1-3e892cf7e6f2","Type":"ContainerStarted","Data":"54b7549e3feed5b070afa4f392f363d9fb545dd0b7a300e11254502127e5ee32"} Jul 06 21:18:27.799932 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:27.799664 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dd6e4070-ac28-4be7-8ea1-3e892cf7e6f2","Type":"ContainerStarted","Data":"429dc7c872a7ad3dd50a7faa87c5f88f48c397a4c04aef8bea041fd59f5faa19"} Jul 06 21:18:27.799932 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:27.799688 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dd6e4070-ac28-4be7-8ea1-3e892cf7e6f2","Type":"ContainerStarted","Data":"9833424f373213f66198553c6e6eae086c27e35c663315247414a160068913af"} Jul 06 21:18:27.832841 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:27.832785 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.81606592 podStartE2EDuration="2.832770625s" totalImagesPullingTime="0s" totalInitContainerRuntime="16.704705ms" isStatefulPod=false podCreationTimestamp="2026-07-06 21:18:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:18:27.829975556 +0000 UTC m=+330.777353586" watchObservedRunningTime="2026-07-06 21:18:27.832770625 +0000 UTC m=+330.780148627" Jul 06 21:18:28.942629 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:28.942589 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-64c9b55c7-v8tb4"] Jul 06 21:18:28.949905 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:28.949869 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-64c9b55c7-v8tb4" Jul 06 21:18:28.952780 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:28.952753 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 06 21:18:28.952939 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:28.952754 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 06 21:18:28.953041 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:28.953024 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 06 21:18:28.953190 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:28.953166 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 06 21:18:28.953338 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:28.953197 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-tb2rr\"" Jul 06 21:18:28.953338 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:28.953220 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 06 21:18:28.957836 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:28.957813 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 06 21:18:28.959659 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:28.959640 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-64c9b55c7-v8tb4"] Jul 06 21:18:29.094013 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:29.093957 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/cb77f7ed-2634-482c-8d25-3dae0e359422-secret-telemeter-client\") pod \"telemeter-client-64c9b55c7-v8tb4\" (UID: \"cb77f7ed-2634-482c-8d25-3dae0e359422\") " pod="openshift-monitoring/telemeter-client-64c9b55c7-v8tb4" Jul 06 21:18:29.094013 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:29.094014 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cb77f7ed-2634-482c-8d25-3dae0e359422-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-64c9b55c7-v8tb4\" (UID: \"cb77f7ed-2634-482c-8d25-3dae0e359422\") " pod="openshift-monitoring/telemeter-client-64c9b55c7-v8tb4" Jul 06 21:18:29.094336 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:29.094035 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb77f7ed-2634-482c-8d25-3dae0e359422-telemeter-trusted-ca-bundle\") pod \"telemeter-client-64c9b55c7-v8tb4\" (UID: \"cb77f7ed-2634-482c-8d25-3dae0e359422\") " pod="openshift-monitoring/telemeter-client-64c9b55c7-v8tb4" Jul 06 21:18:29.094336 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:29.094170 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pffvx\" (UniqueName: \"kubernetes.io/projected/cb77f7ed-2634-482c-8d25-3dae0e359422-kube-api-access-pffvx\") pod \"telemeter-client-64c9b55c7-v8tb4\" (UID: \"cb77f7ed-2634-482c-8d25-3dae0e359422\") " pod="openshift-monitoring/telemeter-client-64c9b55c7-v8tb4" Jul 06 21:18:29.094336 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:29.094220 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/cb77f7ed-2634-482c-8d25-3dae0e359422-telemeter-client-tls\") pod \"telemeter-client-64c9b55c7-v8tb4\" (UID: \"cb77f7ed-2634-482c-8d25-3dae0e359422\") " pod="openshift-monitoring/telemeter-client-64c9b55c7-v8tb4" Jul 06 21:18:29.094336 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:29.094289 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/cb77f7ed-2634-482c-8d25-3dae0e359422-federate-client-tls\") pod \"telemeter-client-64c9b55c7-v8tb4\" (UID: \"cb77f7ed-2634-482c-8d25-3dae0e359422\") " pod="openshift-monitoring/telemeter-client-64c9b55c7-v8tb4" Jul 06 21:18:29.094336 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:29.094314 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cb77f7ed-2634-482c-8d25-3dae0e359422-metrics-client-ca\") pod \"telemeter-client-64c9b55c7-v8tb4\" (UID: \"cb77f7ed-2634-482c-8d25-3dae0e359422\") " pod="openshift-monitoring/telemeter-client-64c9b55c7-v8tb4" Jul 06 21:18:29.094512 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:29.094390 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb77f7ed-2634-482c-8d25-3dae0e359422-serving-certs-ca-bundle\") pod \"telemeter-client-64c9b55c7-v8tb4\" (UID: \"cb77f7ed-2634-482c-8d25-3dae0e359422\") " pod="openshift-monitoring/telemeter-client-64c9b55c7-v8tb4" Jul 06 21:18:29.195350 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:29.195231 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pffvx\" (UniqueName: \"kubernetes.io/projected/cb77f7ed-2634-482c-8d25-3dae0e359422-kube-api-access-pffvx\") pod \"telemeter-client-64c9b55c7-v8tb4\" (UID: \"cb77f7ed-2634-482c-8d25-3dae0e359422\") " pod="openshift-monitoring/telemeter-client-64c9b55c7-v8tb4" Jul 06 21:18:29.195350 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:29.195323 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/cb77f7ed-2634-482c-8d25-3dae0e359422-telemeter-client-tls\") pod \"telemeter-client-64c9b55c7-v8tb4\" (UID: \"cb77f7ed-2634-482c-8d25-3dae0e359422\") " pod="openshift-monitoring/telemeter-client-64c9b55c7-v8tb4" Jul 06 21:18:29.195350 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:29.195342 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/cb77f7ed-2634-482c-8d25-3dae0e359422-federate-client-tls\") pod \"telemeter-client-64c9b55c7-v8tb4\" (UID: \"cb77f7ed-2634-482c-8d25-3dae0e359422\") " pod="openshift-monitoring/telemeter-client-64c9b55c7-v8tb4" Jul 06 21:18:29.195350 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:29.195357 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cb77f7ed-2634-482c-8d25-3dae0e359422-metrics-client-ca\") pod \"telemeter-client-64c9b55c7-v8tb4\" (UID: \"cb77f7ed-2634-482c-8d25-3dae0e359422\") " pod="openshift-monitoring/telemeter-client-64c9b55c7-v8tb4" Jul 06 21:18:29.195622 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:29.195386 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb77f7ed-2634-482c-8d25-3dae0e359422-serving-certs-ca-bundle\") pod \"telemeter-client-64c9b55c7-v8tb4\" (UID: \"cb77f7ed-2634-482c-8d25-3dae0e359422\") " pod="openshift-monitoring/telemeter-client-64c9b55c7-v8tb4" Jul 06 21:18:29.195622 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:29.195407 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/cb77f7ed-2634-482c-8d25-3dae0e359422-secret-telemeter-client\") pod \"telemeter-client-64c9b55c7-v8tb4\" (UID: \"cb77f7ed-2634-482c-8d25-3dae0e359422\") " pod="openshift-monitoring/telemeter-client-64c9b55c7-v8tb4" Jul 06 21:18:29.195622 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:29.195437 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cb77f7ed-2634-482c-8d25-3dae0e359422-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-64c9b55c7-v8tb4\" (UID: \"cb77f7ed-2634-482c-8d25-3dae0e359422\") " pod="openshift-monitoring/telemeter-client-64c9b55c7-v8tb4" Jul 06 21:18:29.195622 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:29.195465 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb77f7ed-2634-482c-8d25-3dae0e359422-telemeter-trusted-ca-bundle\") pod \"telemeter-client-64c9b55c7-v8tb4\" (UID: \"cb77f7ed-2634-482c-8d25-3dae0e359422\") " pod="openshift-monitoring/telemeter-client-64c9b55c7-v8tb4" Jul 06 21:18:29.196315 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:29.196286 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cb77f7ed-2634-482c-8d25-3dae0e359422-metrics-client-ca\") pod \"telemeter-client-64c9b55c7-v8tb4\" (UID: \"cb77f7ed-2634-482c-8d25-3dae0e359422\") " pod="openshift-monitoring/telemeter-client-64c9b55c7-v8tb4" Jul 06 21:18:29.196430 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:29.196407 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb77f7ed-2634-482c-8d25-3dae0e359422-serving-certs-ca-bundle\") pod \"telemeter-client-64c9b55c7-v8tb4\" (UID: \"cb77f7ed-2634-482c-8d25-3dae0e359422\") " pod="openshift-monitoring/telemeter-client-64c9b55c7-v8tb4" Jul 06 21:18:29.196430 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:29.196419 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb77f7ed-2634-482c-8d25-3dae0e359422-telemeter-trusted-ca-bundle\") pod \"telemeter-client-64c9b55c7-v8tb4\" (UID: \"cb77f7ed-2634-482c-8d25-3dae0e359422\") " pod="openshift-monitoring/telemeter-client-64c9b55c7-v8tb4" Jul 06 21:18:29.197939 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:29.197918 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/cb77f7ed-2634-482c-8d25-3dae0e359422-federate-client-tls\") pod \"telemeter-client-64c9b55c7-v8tb4\" (UID: \"cb77f7ed-2634-482c-8d25-3dae0e359422\") " pod="openshift-monitoring/telemeter-client-64c9b55c7-v8tb4" Jul 06 21:18:29.198047 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:29.198011 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/cb77f7ed-2634-482c-8d25-3dae0e359422-telemeter-client-tls\") pod \"telemeter-client-64c9b55c7-v8tb4\" (UID: \"cb77f7ed-2634-482c-8d25-3dae0e359422\") " pod="openshift-monitoring/telemeter-client-64c9b55c7-v8tb4" Jul 06 21:18:29.198098 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:29.198073 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cb77f7ed-2634-482c-8d25-3dae0e359422-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-64c9b55c7-v8tb4\" (UID: \"cb77f7ed-2634-482c-8d25-3dae0e359422\") " pod="openshift-monitoring/telemeter-client-64c9b55c7-v8tb4" Jul 06 21:18:29.198159 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:29.198136 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/cb77f7ed-2634-482c-8d25-3dae0e359422-secret-telemeter-client\") pod \"telemeter-client-64c9b55c7-v8tb4\" (UID: \"cb77f7ed-2634-482c-8d25-3dae0e359422\") " pod="openshift-monitoring/telemeter-client-64c9b55c7-v8tb4" Jul 06 21:18:29.209098 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:29.209052 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pffvx\" (UniqueName: \"kubernetes.io/projected/cb77f7ed-2634-482c-8d25-3dae0e359422-kube-api-access-pffvx\") pod \"telemeter-client-64c9b55c7-v8tb4\" (UID: \"cb77f7ed-2634-482c-8d25-3dae0e359422\") " pod="openshift-monitoring/telemeter-client-64c9b55c7-v8tb4" Jul 06 21:18:29.261026 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:29.260988 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-64c9b55c7-v8tb4" Jul 06 21:18:29.404293 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:29.404263 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-64c9b55c7-v8tb4"] Jul 06 21:18:29.406675 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:18:29.406647 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb77f7ed_2634_482c_8d25_3dae0e359422.slice/crio-909dc484d13258140088096e0d306dc9517e98a3f77bee29f81a5e96eeb90eb5 WatchSource:0}: Error finding container 909dc484d13258140088096e0d306dc9517e98a3f77bee29f81a5e96eeb90eb5: Status 404 returned error can't find the container with id 909dc484d13258140088096e0d306dc9517e98a3f77bee29f81a5e96eeb90eb5 Jul 06 21:18:29.408668 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:29.408653 2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 21:18:29.809674 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:29.809633 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-64c9b55c7-v8tb4" event={"ID":"cb77f7ed-2634-482c-8d25-3dae0e359422","Type":"ContainerStarted","Data":"909dc484d13258140088096e0d306dc9517e98a3f77bee29f81a5e96eeb90eb5"} Jul 06 21:18:32.824614 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:32.824572 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-64c9b55c7-v8tb4" event={"ID":"cb77f7ed-2634-482c-8d25-3dae0e359422","Type":"ContainerStarted","Data":"e07cc404c81bede7609e546ad045f27fac19de0340403c99418d53ba7d4ff228"} Jul 06 21:18:32.825017 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:32.824664 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-64c9b55c7-v8tb4" event={"ID":"cb77f7ed-2634-482c-8d25-3dae0e359422","Type":"ContainerStarted","Data":"6a0daa8d22cf2cd7d73c996c76b907449c029fc9423cb8053345082e0af0242f"} Jul 06 21:18:32.825017 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:32.824684 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-64c9b55c7-v8tb4" event={"ID":"cb77f7ed-2634-482c-8d25-3dae0e359422","Type":"ContainerStarted","Data":"41c6a2dfeac3c55d5f00d04ce52f95626999c4b7dbcc8e1f7adbd09835f4f3d9"} Jul 06 21:18:32.849625 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:32.849529 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-64c9b55c7-v8tb4" podStartSLOduration=2.471372027 podStartE2EDuration="4.84950731s" totalImagesPullingTime="2.378135283s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:18:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:18:32.848713687 +0000 UTC m=+335.796091688" watchObservedRunningTime="2026-07-06 21:18:32.84950731 +0000 UTC m=+335.796885312" Jul 06 21:18:33.630927 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:33.630890 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-c9899d9b-dckz7"] Jul 06 21:18:33.634323 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:33.634302 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c9899d9b-dckz7" Jul 06 21:18:33.645905 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:33.645877 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-c9899d9b-dckz7"] Jul 06 21:18:33.733996 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:33.733957 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/10d68577-1d14-42ba-8ae7-dc5c3d823712-console-config\") pod \"console-c9899d9b-dckz7\" (UID: \"10d68577-1d14-42ba-8ae7-dc5c3d823712\") " pod="openshift-console/console-c9899d9b-dckz7" Jul 06 21:18:33.733996 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:33.733992 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/10d68577-1d14-42ba-8ae7-dc5c3d823712-console-serving-cert\") pod \"console-c9899d9b-dckz7\" (UID: \"10d68577-1d14-42ba-8ae7-dc5c3d823712\") " pod="openshift-console/console-c9899d9b-dckz7" Jul 06 21:18:33.734198 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:33.734011 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/10d68577-1d14-42ba-8ae7-dc5c3d823712-console-oauth-config\") pod \"console-c9899d9b-dckz7\" (UID: \"10d68577-1d14-42ba-8ae7-dc5c3d823712\") " pod="openshift-console/console-c9899d9b-dckz7" Jul 06 21:18:33.734198 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:33.734025 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/10d68577-1d14-42ba-8ae7-dc5c3d823712-service-ca\") pod \"console-c9899d9b-dckz7\" (UID: \"10d68577-1d14-42ba-8ae7-dc5c3d823712\") " pod="openshift-console/console-c9899d9b-dckz7" Jul 06 21:18:33.734198 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:33.734096 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10d68577-1d14-42ba-8ae7-dc5c3d823712-trusted-ca-bundle\") pod \"console-c9899d9b-dckz7\" (UID: \"10d68577-1d14-42ba-8ae7-dc5c3d823712\") " pod="openshift-console/console-c9899d9b-dckz7" Jul 06 21:18:33.734198 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:33.734137 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4lqfx\" (UniqueName: \"kubernetes.io/projected/10d68577-1d14-42ba-8ae7-dc5c3d823712-kube-api-access-4lqfx\") pod \"console-c9899d9b-dckz7\" (UID: \"10d68577-1d14-42ba-8ae7-dc5c3d823712\") " pod="openshift-console/console-c9899d9b-dckz7" Jul 06 21:18:33.734340 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:33.734216 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/10d68577-1d14-42ba-8ae7-dc5c3d823712-oauth-serving-cert\") pod \"console-c9899d9b-dckz7\" (UID: \"10d68577-1d14-42ba-8ae7-dc5c3d823712\") " pod="openshift-console/console-c9899d9b-dckz7" Jul 06 21:18:33.835266 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:33.835209 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4lqfx\" (UniqueName: \"kubernetes.io/projected/10d68577-1d14-42ba-8ae7-dc5c3d823712-kube-api-access-4lqfx\") pod \"console-c9899d9b-dckz7\" (UID: \"10d68577-1d14-42ba-8ae7-dc5c3d823712\") " pod="openshift-console/console-c9899d9b-dckz7" Jul 06 21:18:33.835733 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:33.835283 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/10d68577-1d14-42ba-8ae7-dc5c3d823712-oauth-serving-cert\") pod \"console-c9899d9b-dckz7\" (UID: \"10d68577-1d14-42ba-8ae7-dc5c3d823712\") " pod="openshift-console/console-c9899d9b-dckz7" Jul 06 21:18:33.835733 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:33.835317 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/10d68577-1d14-42ba-8ae7-dc5c3d823712-console-config\") pod \"console-c9899d9b-dckz7\" (UID: \"10d68577-1d14-42ba-8ae7-dc5c3d823712\") " pod="openshift-console/console-c9899d9b-dckz7" Jul 06 21:18:33.835733 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:33.835332 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/10d68577-1d14-42ba-8ae7-dc5c3d823712-console-serving-cert\") pod \"console-c9899d9b-dckz7\" (UID: \"10d68577-1d14-42ba-8ae7-dc5c3d823712\") " pod="openshift-console/console-c9899d9b-dckz7" Jul 06 21:18:33.835733 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:33.835346 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/10d68577-1d14-42ba-8ae7-dc5c3d823712-console-oauth-config\") pod \"console-c9899d9b-dckz7\" (UID: \"10d68577-1d14-42ba-8ae7-dc5c3d823712\") " pod="openshift-console/console-c9899d9b-dckz7" Jul 06 21:18:33.835733 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:33.835360 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/10d68577-1d14-42ba-8ae7-dc5c3d823712-service-ca\") pod \"console-c9899d9b-dckz7\" (UID: \"10d68577-1d14-42ba-8ae7-dc5c3d823712\") " pod="openshift-console/console-c9899d9b-dckz7" Jul 06 21:18:33.835733 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:33.835389 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10d68577-1d14-42ba-8ae7-dc5c3d823712-trusted-ca-bundle\") pod \"console-c9899d9b-dckz7\" (UID: \"10d68577-1d14-42ba-8ae7-dc5c3d823712\") " pod="openshift-console/console-c9899d9b-dckz7" Jul 06 21:18:33.836182 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:33.836157 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/10d68577-1d14-42ba-8ae7-dc5c3d823712-console-config\") pod \"console-c9899d9b-dckz7\" (UID: \"10d68577-1d14-42ba-8ae7-dc5c3d823712\") " pod="openshift-console/console-c9899d9b-dckz7" Jul 06 21:18:33.836265 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:33.836157 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/10d68577-1d14-42ba-8ae7-dc5c3d823712-service-ca\") pod \"console-c9899d9b-dckz7\" (UID: \"10d68577-1d14-42ba-8ae7-dc5c3d823712\") " pod="openshift-console/console-c9899d9b-dckz7" Jul 06 21:18:33.836317 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:33.836278 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/10d68577-1d14-42ba-8ae7-dc5c3d823712-oauth-serving-cert\") pod \"console-c9899d9b-dckz7\" (UID: \"10d68577-1d14-42ba-8ae7-dc5c3d823712\") " pod="openshift-console/console-c9899d9b-dckz7" Jul 06 21:18:33.836408 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:33.836393 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10d68577-1d14-42ba-8ae7-dc5c3d823712-trusted-ca-bundle\") pod \"console-c9899d9b-dckz7\" (UID: \"10d68577-1d14-42ba-8ae7-dc5c3d823712\") " pod="openshift-console/console-c9899d9b-dckz7" Jul 06 21:18:33.838250 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:33.838209 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/10d68577-1d14-42ba-8ae7-dc5c3d823712-console-oauth-config\") pod \"console-c9899d9b-dckz7\" (UID: \"10d68577-1d14-42ba-8ae7-dc5c3d823712\") " pod="openshift-console/console-c9899d9b-dckz7" Jul 06 21:18:33.838439 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:33.838420 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/10d68577-1d14-42ba-8ae7-dc5c3d823712-console-serving-cert\") pod \"console-c9899d9b-dckz7\" (UID: \"10d68577-1d14-42ba-8ae7-dc5c3d823712\") " pod="openshift-console/console-c9899d9b-dckz7" Jul 06 21:18:33.843420 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:33.843401 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4lqfx\" (UniqueName: \"kubernetes.io/projected/10d68577-1d14-42ba-8ae7-dc5c3d823712-kube-api-access-4lqfx\") pod \"console-c9899d9b-dckz7\" (UID: \"10d68577-1d14-42ba-8ae7-dc5c3d823712\") " pod="openshift-console/console-c9899d9b-dckz7" Jul 06 21:18:33.945193 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:33.945113 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c9899d9b-dckz7" Jul 06 21:18:34.079766 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:34.079733 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-c9899d9b-dckz7"] Jul 06 21:18:34.082693 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:18:34.082663 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10d68577_1d14_42ba_8ae7_dc5c3d823712.slice/crio-d6f509c7540cc7d7da2d8889acab1d02e86d8d42af239d45a2d9c043ad6ba245 WatchSource:0}: Error finding container d6f509c7540cc7d7da2d8889acab1d02e86d8d42af239d45a2d9c043ad6ba245: Status 404 returned error can't find the container with id d6f509c7540cc7d7da2d8889acab1d02e86d8d42af239d45a2d9c043ad6ba245 Jul 06 21:18:34.833825 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:34.833785 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c9899d9b-dckz7" event={"ID":"10d68577-1d14-42ba-8ae7-dc5c3d823712","Type":"ContainerStarted","Data":"ed7775c2d04415029355b3e76082ddfed71c208e9ec035cfa5e48eb08cd67912"} Jul 06 21:18:34.833981 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:34.833851 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c9899d9b-dckz7" event={"ID":"10d68577-1d14-42ba-8ae7-dc5c3d823712","Type":"ContainerStarted","Data":"d6f509c7540cc7d7da2d8889acab1d02e86d8d42af239d45a2d9c043ad6ba245"} Jul 06 21:18:34.853756 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:34.853260 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-c9899d9b-dckz7" podStartSLOduration=1.853215886 podStartE2EDuration="1.853215886s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:18:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:18:34.852802975 +0000 UTC m=+337.800180979" watchObservedRunningTime="2026-07-06 21:18:34.853215886 +0000 UTC m=+337.800593890" Jul 06 21:18:43.945465 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:43.945418 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-c9899d9b-dckz7" Jul 06 21:18:43.945867 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:43.945495 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-c9899d9b-dckz7" Jul 06 21:18:43.950358 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:43.950333 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-c9899d9b-dckz7" Jul 06 21:18:44.883354 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:44.883326 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-c9899d9b-dckz7" Jul 06 21:18:44.929288 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:18:44.929253 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6fd78b88f7-gw72c"] Jul 06 21:19:09.954159 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:19:09.954089 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-6fd78b88f7-gw72c" podUID="78bee21b-1013-417a-a2ca-8ea2507854f3" containerName="console" containerID="cri-o://5c3ed118b2979262e806d657da1d6d142a94c5f73d73293c9e55bdb17d2a045f" gracePeriod=15 Jul 06 21:19:10.190634 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:19:10.190606 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6fd78b88f7-gw72c" Jul 06 21:19:10.241599 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:19:10.241501 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/78bee21b-1013-417a-a2ca-8ea2507854f3-oauth-serving-cert\") pod \"78bee21b-1013-417a-a2ca-8ea2507854f3\" (UID: \"78bee21b-1013-417a-a2ca-8ea2507854f3\") " Jul 06 21:19:10.241599 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:19:10.241540 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/78bee21b-1013-417a-a2ca-8ea2507854f3-service-ca\") pod \"78bee21b-1013-417a-a2ca-8ea2507854f3\" (UID: \"78bee21b-1013-417a-a2ca-8ea2507854f3\") " Jul 06 21:19:10.241599 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:19:10.241560 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/78bee21b-1013-417a-a2ca-8ea2507854f3-console-serving-cert\") pod \"78bee21b-1013-417a-a2ca-8ea2507854f3\" (UID: \"78bee21b-1013-417a-a2ca-8ea2507854f3\") " Jul 06 21:19:10.241599 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:19:10.241594 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gwmrd\" (UniqueName: \"kubernetes.io/projected/78bee21b-1013-417a-a2ca-8ea2507854f3-kube-api-access-gwmrd\") pod \"78bee21b-1013-417a-a2ca-8ea2507854f3\" (UID: \"78bee21b-1013-417a-a2ca-8ea2507854f3\") " Jul 06 21:19:10.241923 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:19:10.241615 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/78bee21b-1013-417a-a2ca-8ea2507854f3-console-config\") pod \"78bee21b-1013-417a-a2ca-8ea2507854f3\" (UID: \"78bee21b-1013-417a-a2ca-8ea2507854f3\") " Jul 06 21:19:10.241923 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:19:10.241653 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/78bee21b-1013-417a-a2ca-8ea2507854f3-trusted-ca-bundle\") pod \"78bee21b-1013-417a-a2ca-8ea2507854f3\" (UID: \"78bee21b-1013-417a-a2ca-8ea2507854f3\") " Jul 06 21:19:10.241923 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:19:10.241683 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/78bee21b-1013-417a-a2ca-8ea2507854f3-console-oauth-config\") pod \"78bee21b-1013-417a-a2ca-8ea2507854f3\" (UID: \"78bee21b-1013-417a-a2ca-8ea2507854f3\") " Jul 06 21:19:10.242070 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:19:10.241923 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/78bee21b-1013-417a-a2ca-8ea2507854f3-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "78bee21b-1013-417a-a2ca-8ea2507854f3" (UID: "78bee21b-1013-417a-a2ca-8ea2507854f3"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 21:19:10.242070 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:19:10.242044 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/78bee21b-1013-417a-a2ca-8ea2507854f3-service-ca" (OuterVolumeSpecName: "service-ca") pod "78bee21b-1013-417a-a2ca-8ea2507854f3" (UID: "78bee21b-1013-417a-a2ca-8ea2507854f3"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 21:19:10.242185 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:19:10.242096 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/78bee21b-1013-417a-a2ca-8ea2507854f3-console-config" (OuterVolumeSpecName: "console-config") pod "78bee21b-1013-417a-a2ca-8ea2507854f3" (UID: "78bee21b-1013-417a-a2ca-8ea2507854f3"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 21:19:10.242185 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:19:10.242123 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/78bee21b-1013-417a-a2ca-8ea2507854f3-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "78bee21b-1013-417a-a2ca-8ea2507854f3" (UID: "78bee21b-1013-417a-a2ca-8ea2507854f3"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 21:19:10.243960 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:19:10.243935 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/78bee21b-1013-417a-a2ca-8ea2507854f3-kube-api-access-gwmrd" (OuterVolumeSpecName: "kube-api-access-gwmrd") pod "78bee21b-1013-417a-a2ca-8ea2507854f3" (UID: "78bee21b-1013-417a-a2ca-8ea2507854f3"). InnerVolumeSpecName "kube-api-access-gwmrd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 21:19:10.244050 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:19:10.243938 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/78bee21b-1013-417a-a2ca-8ea2507854f3-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "78bee21b-1013-417a-a2ca-8ea2507854f3" (UID: "78bee21b-1013-417a-a2ca-8ea2507854f3"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 21:19:10.244050 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:19:10.243960 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/78bee21b-1013-417a-a2ca-8ea2507854f3-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "78bee21b-1013-417a-a2ca-8ea2507854f3" (UID: "78bee21b-1013-417a-a2ca-8ea2507854f3"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 21:19:10.342840 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:19:10.342797 2573 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/78bee21b-1013-417a-a2ca-8ea2507854f3-oauth-serving-cert\") on node \"ip-10-0-130-89.ec2.internal\" DevicePath \"\"" Jul 06 21:19:10.342840 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:19:10.342841 2573 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/78bee21b-1013-417a-a2ca-8ea2507854f3-service-ca\") on node \"ip-10-0-130-89.ec2.internal\" DevicePath \"\"" Jul 06 21:19:10.343037 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:19:10.342856 2573 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/78bee21b-1013-417a-a2ca-8ea2507854f3-console-serving-cert\") on node \"ip-10-0-130-89.ec2.internal\" DevicePath \"\"" Jul 06 21:19:10.343037 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:19:10.342870 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gwmrd\" (UniqueName: \"kubernetes.io/projected/78bee21b-1013-417a-a2ca-8ea2507854f3-kube-api-access-gwmrd\") on node \"ip-10-0-130-89.ec2.internal\" DevicePath \"\"" Jul 06 21:19:10.343037 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:19:10.342883 2573 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/78bee21b-1013-417a-a2ca-8ea2507854f3-console-config\") on node \"ip-10-0-130-89.ec2.internal\" DevicePath \"\"" Jul 06 21:19:10.343037 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:19:10.342895 2573 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/78bee21b-1013-417a-a2ca-8ea2507854f3-trusted-ca-bundle\") on node \"ip-10-0-130-89.ec2.internal\" DevicePath \"\"" Jul 06 21:19:10.343037 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:19:10.342909 2573 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/78bee21b-1013-417a-a2ca-8ea2507854f3-console-oauth-config\") on node \"ip-10-0-130-89.ec2.internal\" DevicePath \"\"" Jul 06 21:19:10.982711 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:19:10.982679 2573 generic.go:356] "Generic (PLEG): container finished" podID="78bee21b-1013-417a-a2ca-8ea2507854f3" containerID="5c3ed118b2979262e806d657da1d6d142a94c5f73d73293c9e55bdb17d2a045f" exitCode=0 Jul 06 21:19:10.983145 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:19:10.982722 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6fd78b88f7-gw72c" Jul 06 21:19:10.983145 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:19:10.982765 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6fd78b88f7-gw72c" event={"ID":"78bee21b-1013-417a-a2ca-8ea2507854f3","Type":"ContainerDied","Data":"5c3ed118b2979262e806d657da1d6d142a94c5f73d73293c9e55bdb17d2a045f"} Jul 06 21:19:10.983145 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:19:10.982825 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6fd78b88f7-gw72c" event={"ID":"78bee21b-1013-417a-a2ca-8ea2507854f3","Type":"ContainerDied","Data":"54a056776504bbe6775ad9afef9236d843dfae6933cadd541ed4d0ce75f003e0"} Jul 06 21:19:10.983145 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:19:10.982855 2573 scope.go:117] "RemoveContainer" containerID="5c3ed118b2979262e806d657da1d6d142a94c5f73d73293c9e55bdb17d2a045f" Jul 06 21:19:10.996906 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:19:10.996882 2573 scope.go:117] "RemoveContainer" containerID="5c3ed118b2979262e806d657da1d6d142a94c5f73d73293c9e55bdb17d2a045f" Jul 06 21:19:10.997205 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:19:10.997184 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5c3ed118b2979262e806d657da1d6d142a94c5f73d73293c9e55bdb17d2a045f\": container with ID starting with 5c3ed118b2979262e806d657da1d6d142a94c5f73d73293c9e55bdb17d2a045f not found: ID does not exist" containerID="5c3ed118b2979262e806d657da1d6d142a94c5f73d73293c9e55bdb17d2a045f" Jul 06 21:19:10.997264 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:19:10.997214 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c3ed118b2979262e806d657da1d6d142a94c5f73d73293c9e55bdb17d2a045f"} err="failed to get container status \"5c3ed118b2979262e806d657da1d6d142a94c5f73d73293c9e55bdb17d2a045f\": rpc error: code = NotFound desc = could not find container \"5c3ed118b2979262e806d657da1d6d142a94c5f73d73293c9e55bdb17d2a045f\": container with ID starting with 5c3ed118b2979262e806d657da1d6d142a94c5f73d73293c9e55bdb17d2a045f not found: ID does not exist" Jul 06 21:19:11.007754 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:19:11.007727 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6fd78b88f7-gw72c"] Jul 06 21:19:11.013448 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:19:11.013422 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6fd78b88f7-gw72c"] Jul 06 21:19:11.641537 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:19:11.641503 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="78bee21b-1013-417a-a2ca-8ea2507854f3" path="/var/lib/kubelet/pods/78bee21b-1013-417a-a2ca-8ea2507854f3/volumes" Jul 06 21:19:57.328937 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:19:57.328903 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5d6c5ff689-lqchh"] Jul 06 21:19:57.329414 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:19:57.329202 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="78bee21b-1013-417a-a2ca-8ea2507854f3" containerName="console" Jul 06 21:19:57.329414 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:19:57.329214 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="78bee21b-1013-417a-a2ca-8ea2507854f3" containerName="console" Jul 06 21:19:57.329414 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:19:57.329282 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="78bee21b-1013-417a-a2ca-8ea2507854f3" containerName="console" Jul 06 21:19:57.332152 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:19:57.332129 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d6c5ff689-lqchh" Jul 06 21:19:57.342630 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:19:57.342600 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5d6c5ff689-lqchh"] Jul 06 21:19:57.431393 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:19:57.431356 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2988d357-68d1-46f0-b714-f624f87d12b0-service-ca\") pod \"console-5d6c5ff689-lqchh\" (UID: \"2988d357-68d1-46f0-b714-f624f87d12b0\") " pod="openshift-console/console-5d6c5ff689-lqchh" Jul 06 21:19:57.431393 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:19:57.431391 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2988d357-68d1-46f0-b714-f624f87d12b0-console-serving-cert\") pod \"console-5d6c5ff689-lqchh\" (UID: \"2988d357-68d1-46f0-b714-f624f87d12b0\") " pod="openshift-console/console-5d6c5ff689-lqchh" Jul 06 21:19:57.431604 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:19:57.431415 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2988d357-68d1-46f0-b714-f624f87d12b0-console-oauth-config\") pod \"console-5d6c5ff689-lqchh\" (UID: \"2988d357-68d1-46f0-b714-f624f87d12b0\") " pod="openshift-console/console-5d6c5ff689-lqchh" Jul 06 21:19:57.431604 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:19:57.431460 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qq7hh\" (UniqueName: \"kubernetes.io/projected/2988d357-68d1-46f0-b714-f624f87d12b0-kube-api-access-qq7hh\") pod \"console-5d6c5ff689-lqchh\" (UID: \"2988d357-68d1-46f0-b714-f624f87d12b0\") " pod="openshift-console/console-5d6c5ff689-lqchh" Jul 06 21:19:57.431604 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:19:57.431499 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2988d357-68d1-46f0-b714-f624f87d12b0-trusted-ca-bundle\") pod \"console-5d6c5ff689-lqchh\" (UID: \"2988d357-68d1-46f0-b714-f624f87d12b0\") " pod="openshift-console/console-5d6c5ff689-lqchh" Jul 06 21:19:57.431604 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:19:57.431580 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2988d357-68d1-46f0-b714-f624f87d12b0-oauth-serving-cert\") pod \"console-5d6c5ff689-lqchh\" (UID: \"2988d357-68d1-46f0-b714-f624f87d12b0\") " pod="openshift-console/console-5d6c5ff689-lqchh" Jul 06 21:19:57.431604 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:19:57.431597 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2988d357-68d1-46f0-b714-f624f87d12b0-console-config\") pod \"console-5d6c5ff689-lqchh\" (UID: \"2988d357-68d1-46f0-b714-f624f87d12b0\") " pod="openshift-console/console-5d6c5ff689-lqchh" Jul 06 21:19:57.531976 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:19:57.531943 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2988d357-68d1-46f0-b714-f624f87d12b0-oauth-serving-cert\") pod \"console-5d6c5ff689-lqchh\" (UID: \"2988d357-68d1-46f0-b714-f624f87d12b0\") " pod="openshift-console/console-5d6c5ff689-lqchh" Jul 06 21:19:57.532096 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:19:57.531983 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2988d357-68d1-46f0-b714-f624f87d12b0-console-config\") pod \"console-5d6c5ff689-lqchh\" (UID: \"2988d357-68d1-46f0-b714-f624f87d12b0\") " pod="openshift-console/console-5d6c5ff689-lqchh" Jul 06 21:19:57.532096 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:19:57.532006 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2988d357-68d1-46f0-b714-f624f87d12b0-service-ca\") pod \"console-5d6c5ff689-lqchh\" (UID: \"2988d357-68d1-46f0-b714-f624f87d12b0\") " pod="openshift-console/console-5d6c5ff689-lqchh" Jul 06 21:19:57.532096 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:19:57.532024 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2988d357-68d1-46f0-b714-f624f87d12b0-console-serving-cert\") pod \"console-5d6c5ff689-lqchh\" (UID: \"2988d357-68d1-46f0-b714-f624f87d12b0\") " pod="openshift-console/console-5d6c5ff689-lqchh" Jul 06 21:19:57.532096 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:19:57.532042 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2988d357-68d1-46f0-b714-f624f87d12b0-console-oauth-config\") pod \"console-5d6c5ff689-lqchh\" (UID: \"2988d357-68d1-46f0-b714-f624f87d12b0\") " pod="openshift-console/console-5d6c5ff689-lqchh" Jul 06 21:19:57.532331 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:19:57.532161 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qq7hh\" (UniqueName: \"kubernetes.io/projected/2988d357-68d1-46f0-b714-f624f87d12b0-kube-api-access-qq7hh\") pod \"console-5d6c5ff689-lqchh\" (UID: \"2988d357-68d1-46f0-b714-f624f87d12b0\") " pod="openshift-console/console-5d6c5ff689-lqchh" Jul 06 21:19:57.532331 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:19:57.532232 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2988d357-68d1-46f0-b714-f624f87d12b0-trusted-ca-bundle\") pod \"console-5d6c5ff689-lqchh\" (UID: \"2988d357-68d1-46f0-b714-f624f87d12b0\") " pod="openshift-console/console-5d6c5ff689-lqchh" Jul 06 21:19:57.532762 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:19:57.532736 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2988d357-68d1-46f0-b714-f624f87d12b0-oauth-serving-cert\") pod \"console-5d6c5ff689-lqchh\" (UID: \"2988d357-68d1-46f0-b714-f624f87d12b0\") " pod="openshift-console/console-5d6c5ff689-lqchh" Jul 06 21:19:57.532942 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:19:57.532823 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2988d357-68d1-46f0-b714-f624f87d12b0-console-config\") pod \"console-5d6c5ff689-lqchh\" (UID: \"2988d357-68d1-46f0-b714-f624f87d12b0\") " pod="openshift-console/console-5d6c5ff689-lqchh" Jul 06 21:19:57.533126 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:19:57.533109 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2988d357-68d1-46f0-b714-f624f87d12b0-service-ca\") pod \"console-5d6c5ff689-lqchh\" (UID: \"2988d357-68d1-46f0-b714-f624f87d12b0\") " pod="openshift-console/console-5d6c5ff689-lqchh" Jul 06 21:19:57.533221 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:19:57.533199 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2988d357-68d1-46f0-b714-f624f87d12b0-trusted-ca-bundle\") pod \"console-5d6c5ff689-lqchh\" (UID: \"2988d357-68d1-46f0-b714-f624f87d12b0\") " pod="openshift-console/console-5d6c5ff689-lqchh" Jul 06 21:19:57.534644 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:19:57.534618 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2988d357-68d1-46f0-b714-f624f87d12b0-console-serving-cert\") pod \"console-5d6c5ff689-lqchh\" (UID: \"2988d357-68d1-46f0-b714-f624f87d12b0\") " pod="openshift-console/console-5d6c5ff689-lqchh" Jul 06 21:19:57.534725 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:19:57.534692 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2988d357-68d1-46f0-b714-f624f87d12b0-console-oauth-config\") pod \"console-5d6c5ff689-lqchh\" (UID: \"2988d357-68d1-46f0-b714-f624f87d12b0\") " pod="openshift-console/console-5d6c5ff689-lqchh" Jul 06 21:19:57.540053 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:19:57.540025 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qq7hh\" (UniqueName: \"kubernetes.io/projected/2988d357-68d1-46f0-b714-f624f87d12b0-kube-api-access-qq7hh\") pod \"console-5d6c5ff689-lqchh\" (UID: \"2988d357-68d1-46f0-b714-f624f87d12b0\") " pod="openshift-console/console-5d6c5ff689-lqchh" Jul 06 21:19:57.641139 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:19:57.641060 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d6c5ff689-lqchh" Jul 06 21:19:57.777506 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:19:57.777474 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5d6c5ff689-lqchh"] Jul 06 21:19:57.780833 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:19:57.780802 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2988d357_68d1_46f0_b714_f624f87d12b0.slice/crio-acb1a4a853304344922ee1da41607bd7f5ad9635b870bcde801d1449bbbd31b2 WatchSource:0}: Error finding container acb1a4a853304344922ee1da41607bd7f5ad9635b870bcde801d1449bbbd31b2: Status 404 returned error can't find the container with id acb1a4a853304344922ee1da41607bd7f5ad9635b870bcde801d1449bbbd31b2 Jul 06 21:19:58.169592 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:19:58.169560 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d6c5ff689-lqchh" event={"ID":"2988d357-68d1-46f0-b714-f624f87d12b0","Type":"ContainerStarted","Data":"d6ee3211691da6f19d52b6b54dc6aa2307ea929fa138bf3d01f0060bd32120cf"} Jul 06 21:19:58.169766 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:19:58.169607 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d6c5ff689-lqchh" event={"ID":"2988d357-68d1-46f0-b714-f624f87d12b0","Type":"ContainerStarted","Data":"acb1a4a853304344922ee1da41607bd7f5ad9635b870bcde801d1449bbbd31b2"} Jul 06 21:19:58.192512 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:19:58.192456 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5d6c5ff689-lqchh" podStartSLOduration=1.192439785 podStartE2EDuration="1.192439785s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:19:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:19:58.191258643 +0000 UTC m=+421.138636644" watchObservedRunningTime="2026-07-06 21:19:58.192439785 +0000 UTC m=+421.139817787" Jul 06 21:20:07.641677 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:20:07.641637 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5d6c5ff689-lqchh" Jul 06 21:20:07.641677 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:20:07.641676 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5d6c5ff689-lqchh" Jul 06 21:20:07.646541 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:20:07.646516 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5d6c5ff689-lqchh" Jul 06 21:20:08.213809 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:20:08.213784 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5d6c5ff689-lqchh" Jul 06 21:20:08.258378 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:20:08.258345 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-c9899d9b-dckz7"] Jul 06 21:20:33.286688 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:20:33.286576 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-c9899d9b-dckz7" podUID="10d68577-1d14-42ba-8ae7-dc5c3d823712" containerName="console" containerID="cri-o://ed7775c2d04415029355b3e76082ddfed71c208e9ec035cfa5e48eb08cd67912" gracePeriod=15 Jul 06 21:20:33.530048 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:20:33.530022 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c9899d9b-dckz7" Jul 06 21:20:33.637016 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:20:33.636917 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/10d68577-1d14-42ba-8ae7-dc5c3d823712-oauth-serving-cert\") pod \"10d68577-1d14-42ba-8ae7-dc5c3d823712\" (UID: \"10d68577-1d14-42ba-8ae7-dc5c3d823712\") " Jul 06 21:20:33.637016 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:20:33.636993 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/10d68577-1d14-42ba-8ae7-dc5c3d823712-console-oauth-config\") pod \"10d68577-1d14-42ba-8ae7-dc5c3d823712\" (UID: \"10d68577-1d14-42ba-8ae7-dc5c3d823712\") " Jul 06 21:20:33.637350 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:20:33.637051 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4lqfx\" (UniqueName: \"kubernetes.io/projected/10d68577-1d14-42ba-8ae7-dc5c3d823712-kube-api-access-4lqfx\") pod \"10d68577-1d14-42ba-8ae7-dc5c3d823712\" (UID: \"10d68577-1d14-42ba-8ae7-dc5c3d823712\") " Jul 06 21:20:33.637350 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:20:33.637103 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/10d68577-1d14-42ba-8ae7-dc5c3d823712-service-ca\") pod \"10d68577-1d14-42ba-8ae7-dc5c3d823712\" (UID: \"10d68577-1d14-42ba-8ae7-dc5c3d823712\") " Jul 06 21:20:33.637350 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:20:33.637131 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/10d68577-1d14-42ba-8ae7-dc5c3d823712-console-config\") pod \"10d68577-1d14-42ba-8ae7-dc5c3d823712\" (UID: \"10d68577-1d14-42ba-8ae7-dc5c3d823712\") " Jul 06 21:20:33.637350 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:20:33.637167 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/10d68577-1d14-42ba-8ae7-dc5c3d823712-console-serving-cert\") pod \"10d68577-1d14-42ba-8ae7-dc5c3d823712\" (UID: \"10d68577-1d14-42ba-8ae7-dc5c3d823712\") " Jul 06 21:20:33.637350 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:20:33.637210 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10d68577-1d14-42ba-8ae7-dc5c3d823712-trusted-ca-bundle\") pod \"10d68577-1d14-42ba-8ae7-dc5c3d823712\" (UID: \"10d68577-1d14-42ba-8ae7-dc5c3d823712\") " Jul 06 21:20:33.637609 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:20:33.637416 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/10d68577-1d14-42ba-8ae7-dc5c3d823712-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "10d68577-1d14-42ba-8ae7-dc5c3d823712" (UID: "10d68577-1d14-42ba-8ae7-dc5c3d823712"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 21:20:33.637679 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:20:33.637659 2573 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/10d68577-1d14-42ba-8ae7-dc5c3d823712-oauth-serving-cert\") on node \"ip-10-0-130-89.ec2.internal\" DevicePath \"\"" Jul 06 21:20:33.637738 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:20:33.637691 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/10d68577-1d14-42ba-8ae7-dc5c3d823712-console-config" (OuterVolumeSpecName: "console-config") pod "10d68577-1d14-42ba-8ae7-dc5c3d823712" (UID: "10d68577-1d14-42ba-8ae7-dc5c3d823712"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 21:20:33.637914 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:20:33.637804 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/10d68577-1d14-42ba-8ae7-dc5c3d823712-service-ca" (OuterVolumeSpecName: "service-ca") pod "10d68577-1d14-42ba-8ae7-dc5c3d823712" (UID: "10d68577-1d14-42ba-8ae7-dc5c3d823712"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 21:20:33.637989 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:20:33.637960 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/10d68577-1d14-42ba-8ae7-dc5c3d823712-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "10d68577-1d14-42ba-8ae7-dc5c3d823712" (UID: "10d68577-1d14-42ba-8ae7-dc5c3d823712"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 21:20:33.639425 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:20:33.639387 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/10d68577-1d14-42ba-8ae7-dc5c3d823712-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "10d68577-1d14-42ba-8ae7-dc5c3d823712" (UID: "10d68577-1d14-42ba-8ae7-dc5c3d823712"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 21:20:33.639786 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:20:33.639761 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/10d68577-1d14-42ba-8ae7-dc5c3d823712-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "10d68577-1d14-42ba-8ae7-dc5c3d823712" (UID: "10d68577-1d14-42ba-8ae7-dc5c3d823712"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 21:20:33.639864 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:20:33.639776 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/10d68577-1d14-42ba-8ae7-dc5c3d823712-kube-api-access-4lqfx" (OuterVolumeSpecName: "kube-api-access-4lqfx") pod "10d68577-1d14-42ba-8ae7-dc5c3d823712" (UID: "10d68577-1d14-42ba-8ae7-dc5c3d823712"). InnerVolumeSpecName "kube-api-access-4lqfx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 21:20:33.738695 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:20:33.738657 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4lqfx\" (UniqueName: \"kubernetes.io/projected/10d68577-1d14-42ba-8ae7-dc5c3d823712-kube-api-access-4lqfx\") on node \"ip-10-0-130-89.ec2.internal\" DevicePath \"\"" Jul 06 21:20:33.738695 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:20:33.738692 2573 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/10d68577-1d14-42ba-8ae7-dc5c3d823712-service-ca\") on node \"ip-10-0-130-89.ec2.internal\" DevicePath \"\"" Jul 06 21:20:33.738695 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:20:33.738702 2573 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/10d68577-1d14-42ba-8ae7-dc5c3d823712-console-config\") on node \"ip-10-0-130-89.ec2.internal\" DevicePath \"\"" Jul 06 21:20:33.738980 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:20:33.738711 2573 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/10d68577-1d14-42ba-8ae7-dc5c3d823712-console-serving-cert\") on node \"ip-10-0-130-89.ec2.internal\" DevicePath \"\"" Jul 06 21:20:33.738980 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:20:33.738721 2573 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10d68577-1d14-42ba-8ae7-dc5c3d823712-trusted-ca-bundle\") on node \"ip-10-0-130-89.ec2.internal\" DevicePath \"\"" Jul 06 21:20:33.738980 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:20:33.738729 2573 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/10d68577-1d14-42ba-8ae7-dc5c3d823712-console-oauth-config\") on node \"ip-10-0-130-89.ec2.internal\" DevicePath \"\"" Jul 06 21:20:34.310699 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:20:34.310664 2573 generic.go:356] "Generic (PLEG): container finished" podID="10d68577-1d14-42ba-8ae7-dc5c3d823712" containerID="ed7775c2d04415029355b3e76082ddfed71c208e9ec035cfa5e48eb08cd67912" exitCode=0 Jul 06 21:20:34.311129 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:20:34.310721 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c9899d9b-dckz7" event={"ID":"10d68577-1d14-42ba-8ae7-dc5c3d823712","Type":"ContainerDied","Data":"ed7775c2d04415029355b3e76082ddfed71c208e9ec035cfa5e48eb08cd67912"} Jul 06 21:20:34.311129 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:20:34.310727 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c9899d9b-dckz7" Jul 06 21:20:34.311129 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:20:34.310792 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c9899d9b-dckz7" event={"ID":"10d68577-1d14-42ba-8ae7-dc5c3d823712","Type":"ContainerDied","Data":"d6f509c7540cc7d7da2d8889acab1d02e86d8d42af239d45a2d9c043ad6ba245"} Jul 06 21:20:34.311129 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:20:34.310812 2573 scope.go:117] "RemoveContainer" containerID="ed7775c2d04415029355b3e76082ddfed71c208e9ec035cfa5e48eb08cd67912" Jul 06 21:20:34.319675 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:20:34.319654 2573 scope.go:117] "RemoveContainer" containerID="ed7775c2d04415029355b3e76082ddfed71c208e9ec035cfa5e48eb08cd67912" Jul 06 21:20:34.319989 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:20:34.319969 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ed7775c2d04415029355b3e76082ddfed71c208e9ec035cfa5e48eb08cd67912\": container with ID starting with ed7775c2d04415029355b3e76082ddfed71c208e9ec035cfa5e48eb08cd67912 not found: ID does not exist" containerID="ed7775c2d04415029355b3e76082ddfed71c208e9ec035cfa5e48eb08cd67912" Jul 06 21:20:34.320054 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:20:34.320004 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ed7775c2d04415029355b3e76082ddfed71c208e9ec035cfa5e48eb08cd67912"} err="failed to get container status \"ed7775c2d04415029355b3e76082ddfed71c208e9ec035cfa5e48eb08cd67912\": rpc error: code = NotFound desc = could not find container \"ed7775c2d04415029355b3e76082ddfed71c208e9ec035cfa5e48eb08cd67912\": container with ID starting with ed7775c2d04415029355b3e76082ddfed71c208e9ec035cfa5e48eb08cd67912 not found: ID does not exist" Jul 06 21:20:34.327546 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:20:34.327515 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-c9899d9b-dckz7"] Jul 06 21:20:34.331384 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:20:34.331355 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-c9899d9b-dckz7"] Jul 06 21:20:35.642458 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:20:35.642426 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="10d68577-1d14-42ba-8ae7-dc5c3d823712" path="/var/lib/kubelet/pods/10d68577-1d14-42ba-8ae7-dc5c3d823712/volumes" Jul 06 21:20:50.548273 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:20:50.548218 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589jfrjt"] Jul 06 21:20:50.548811 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:20:50.548660 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="10d68577-1d14-42ba-8ae7-dc5c3d823712" containerName="console" Jul 06 21:20:50.548811 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:20:50.548679 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="10d68577-1d14-42ba-8ae7-dc5c3d823712" containerName="console" Jul 06 21:20:50.548811 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:20:50.548786 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="10d68577-1d14-42ba-8ae7-dc5c3d823712" containerName="console" Jul 06 21:20:50.551956 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:20:50.551931 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589jfrjt" Jul 06 21:20:50.554869 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:20:50.554838 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 06 21:20:50.556033 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:20:50.556009 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-7lwkg\"" Jul 06 21:20:50.556033 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:20:50.556029 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 06 21:20:50.561219 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:20:50.561193 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589jfrjt"] Jul 06 21:20:50.582582 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:20:50.582551 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d74tw\" (UniqueName: \"kubernetes.io/projected/e3197ca8-5e35-414f-8f9d-a5adc9955512-kube-api-access-d74tw\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589jfrjt\" (UID: \"e3197ca8-5e35-414f-8f9d-a5adc9955512\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589jfrjt" Jul 06 21:20:50.582766 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:20:50.582605 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e3197ca8-5e35-414f-8f9d-a5adc9955512-bundle\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589jfrjt\" (UID: \"e3197ca8-5e35-414f-8f9d-a5adc9955512\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589jfrjt" Jul 06 21:20:50.582766 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:20:50.582638 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e3197ca8-5e35-414f-8f9d-a5adc9955512-util\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589jfrjt\" (UID: \"e3197ca8-5e35-414f-8f9d-a5adc9955512\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589jfrjt" Jul 06 21:20:50.683327 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:20:50.683288 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d74tw\" (UniqueName: \"kubernetes.io/projected/e3197ca8-5e35-414f-8f9d-a5adc9955512-kube-api-access-d74tw\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589jfrjt\" (UID: \"e3197ca8-5e35-414f-8f9d-a5adc9955512\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589jfrjt" Jul 06 21:20:50.683560 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:20:50.683353 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e3197ca8-5e35-414f-8f9d-a5adc9955512-bundle\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589jfrjt\" (UID: \"e3197ca8-5e35-414f-8f9d-a5adc9955512\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589jfrjt" Jul 06 21:20:50.683560 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:20:50.683378 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e3197ca8-5e35-414f-8f9d-a5adc9955512-util\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589jfrjt\" (UID: \"e3197ca8-5e35-414f-8f9d-a5adc9955512\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589jfrjt" Jul 06 21:20:50.683744 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:20:50.683729 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e3197ca8-5e35-414f-8f9d-a5adc9955512-util\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589jfrjt\" (UID: \"e3197ca8-5e35-414f-8f9d-a5adc9955512\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589jfrjt" Jul 06 21:20:50.683784 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:20:50.683770 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e3197ca8-5e35-414f-8f9d-a5adc9955512-bundle\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589jfrjt\" (UID: \"e3197ca8-5e35-414f-8f9d-a5adc9955512\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589jfrjt" Jul 06 21:20:50.693379 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:20:50.693350 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d74tw\" (UniqueName: \"kubernetes.io/projected/e3197ca8-5e35-414f-8f9d-a5adc9955512-kube-api-access-d74tw\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589jfrjt\" (UID: \"e3197ca8-5e35-414f-8f9d-a5adc9955512\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589jfrjt" Jul 06 21:20:50.862145 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:20:50.862044 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589jfrjt" Jul 06 21:20:50.996785 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:20:50.996758 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589jfrjt"] Jul 06 21:20:50.999193 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:20:50.999165 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3197ca8_5e35_414f_8f9d_a5adc9955512.slice/crio-ffc94eb9171a7606cfa1e9a0094f5be188c5ac30ef6f8f2c40b4c80ffac92f3d WatchSource:0}: Error finding container ffc94eb9171a7606cfa1e9a0094f5be188c5ac30ef6f8f2c40b4c80ffac92f3d: Status 404 returned error can't find the container with id ffc94eb9171a7606cfa1e9a0094f5be188c5ac30ef6f8f2c40b4c80ffac92f3d Jul 06 21:20:51.378134 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:20:51.378092 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589jfrjt" event={"ID":"e3197ca8-5e35-414f-8f9d-a5adc9955512","Type":"ContainerStarted","Data":"ffc94eb9171a7606cfa1e9a0094f5be188c5ac30ef6f8f2c40b4c80ffac92f3d"} Jul 06 21:20:59.412815 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:20:59.412776 2573 generic.go:356] "Generic (PLEG): container finished" podID="e3197ca8-5e35-414f-8f9d-a5adc9955512" containerID="5a7ff2c453fbd3eed5aa4ad274484f9afcf42e667789e5b681677066b7105905" exitCode=0 Jul 06 21:20:59.413298 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:20:59.412855 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589jfrjt" event={"ID":"e3197ca8-5e35-414f-8f9d-a5adc9955512","Type":"ContainerDied","Data":"5a7ff2c453fbd3eed5aa4ad274484f9afcf42e667789e5b681677066b7105905"} Jul 06 21:21:02.426874 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:21:02.426785 2573 generic.go:356] "Generic (PLEG): container finished" podID="e3197ca8-5e35-414f-8f9d-a5adc9955512" containerID="cd9a154be775b94b6d4abe87f29d4e4f2120c56311496f620710b352167cbae3" exitCode=0 Jul 06 21:21:02.427251 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:21:02.426873 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589jfrjt" event={"ID":"e3197ca8-5e35-414f-8f9d-a5adc9955512","Type":"ContainerDied","Data":"cd9a154be775b94b6d4abe87f29d4e4f2120c56311496f620710b352167cbae3"} Jul 06 21:21:10.468092 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:21:10.468057 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589jfrjt" event={"ID":"e3197ca8-5e35-414f-8f9d-a5adc9955512","Type":"ContainerStarted","Data":"b119a0512865715377b825e0c9e1e905e7d7326f54174a9feb5faed7d35946f1"} Jul 06 21:21:10.499139 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:21:10.499086 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589jfrjt" podStartSLOduration=2.581014128 podStartE2EDuration="20.499068309s" totalImagesPullingTime="17.918054181s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:20:50 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:21:10.49703346 +0000 UTC m=+493.444411483" watchObservedRunningTime="2026-07-06 21:21:10.499068309 +0000 UTC m=+493.446446311" Jul 06 21:21:11.474365 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:21:11.474325 2573 generic.go:356] "Generic (PLEG): container finished" podID="e3197ca8-5e35-414f-8f9d-a5adc9955512" containerID="b119a0512865715377b825e0c9e1e905e7d7326f54174a9feb5faed7d35946f1" exitCode=0 Jul 06 21:21:11.474743 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:21:11.474371 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589jfrjt" event={"ID":"e3197ca8-5e35-414f-8f9d-a5adc9955512","Type":"ContainerDied","Data":"b119a0512865715377b825e0c9e1e905e7d7326f54174a9feb5faed7d35946f1"} Jul 06 21:21:12.623467 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:21:12.623426 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589jfrjt" Jul 06 21:21:12.788064 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:21:12.788031 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e3197ca8-5e35-414f-8f9d-a5adc9955512-util\") pod \"e3197ca8-5e35-414f-8f9d-a5adc9955512\" (UID: \"e3197ca8-5e35-414f-8f9d-a5adc9955512\") " Jul 06 21:21:12.788291 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:21:12.788109 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d74tw\" (UniqueName: \"kubernetes.io/projected/e3197ca8-5e35-414f-8f9d-a5adc9955512-kube-api-access-d74tw\") pod \"e3197ca8-5e35-414f-8f9d-a5adc9955512\" (UID: \"e3197ca8-5e35-414f-8f9d-a5adc9955512\") " Jul 06 21:21:12.788291 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:21:12.788149 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e3197ca8-5e35-414f-8f9d-a5adc9955512-bundle\") pod \"e3197ca8-5e35-414f-8f9d-a5adc9955512\" (UID: \"e3197ca8-5e35-414f-8f9d-a5adc9955512\") " Jul 06 21:21:12.788998 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:21:12.788970 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e3197ca8-5e35-414f-8f9d-a5adc9955512-bundle" (OuterVolumeSpecName: "bundle") pod "e3197ca8-5e35-414f-8f9d-a5adc9955512" (UID: "e3197ca8-5e35-414f-8f9d-a5adc9955512"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 21:21:12.790365 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:21:12.790337 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e3197ca8-5e35-414f-8f9d-a5adc9955512-kube-api-access-d74tw" (OuterVolumeSpecName: "kube-api-access-d74tw") pod "e3197ca8-5e35-414f-8f9d-a5adc9955512" (UID: "e3197ca8-5e35-414f-8f9d-a5adc9955512"). InnerVolumeSpecName "kube-api-access-d74tw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 21:21:12.793205 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:21:12.793178 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e3197ca8-5e35-414f-8f9d-a5adc9955512-util" (OuterVolumeSpecName: "util") pod "e3197ca8-5e35-414f-8f9d-a5adc9955512" (UID: "e3197ca8-5e35-414f-8f9d-a5adc9955512"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 21:21:12.889149 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:21:12.889111 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d74tw\" (UniqueName: \"kubernetes.io/projected/e3197ca8-5e35-414f-8f9d-a5adc9955512-kube-api-access-d74tw\") on node \"ip-10-0-130-89.ec2.internal\" DevicePath \"\"" Jul 06 21:21:12.889149 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:21:12.889142 2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e3197ca8-5e35-414f-8f9d-a5adc9955512-bundle\") on node \"ip-10-0-130-89.ec2.internal\" DevicePath \"\"" Jul 06 21:21:12.889149 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:21:12.889154 2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e3197ca8-5e35-414f-8f9d-a5adc9955512-util\") on node \"ip-10-0-130-89.ec2.internal\" DevicePath \"\"" Jul 06 21:21:13.483922 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:21:13.483892 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589jfrjt" Jul 06 21:21:13.484167 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:21:13.483891 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589jfrjt" event={"ID":"e3197ca8-5e35-414f-8f9d-a5adc9955512","Type":"ContainerDied","Data":"ffc94eb9171a7606cfa1e9a0094f5be188c5ac30ef6f8f2c40b4c80ffac92f3d"} Jul 06 21:21:13.484167 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:21:13.484016 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ffc94eb9171a7606cfa1e9a0094f5be188c5ac30ef6f8f2c40b4c80ffac92f3d" Jul 06 21:21:17.815730 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:21:17.815695 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-7sx7h"] Jul 06 21:21:17.816132 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:21:17.815987 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3197ca8-5e35-414f-8f9d-a5adc9955512" containerName="util" Jul 06 21:21:17.816132 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:21:17.815997 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3197ca8-5e35-414f-8f9d-a5adc9955512" containerName="util" Jul 06 21:21:17.816132 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:21:17.816018 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3197ca8-5e35-414f-8f9d-a5adc9955512" containerName="pull" Jul 06 21:21:17.816132 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:21:17.816023 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3197ca8-5e35-414f-8f9d-a5adc9955512" containerName="pull" Jul 06 21:21:17.816132 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:21:17.816035 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3197ca8-5e35-414f-8f9d-a5adc9955512" containerName="extract" Jul 06 21:21:17.816132 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:21:17.816041 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3197ca8-5e35-414f-8f9d-a5adc9955512" containerName="extract" Jul 06 21:21:17.816132 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:21:17.816093 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="e3197ca8-5e35-414f-8f9d-a5adc9955512" containerName="extract" Jul 06 21:21:17.818989 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:21:17.818962 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-7sx7h" Jul 06 21:21:17.822812 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:21:17.822787 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"kedaorg-certs\"" Jul 06 21:21:17.823075 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:21:17.822861 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"custom-metrics-autoscaler-operator-dockercfg-xhvbz\"" Jul 06 21:21:17.823202 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:21:17.823108 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"kube-root-ca.crt\"" Jul 06 21:21:17.823202 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:21:17.823123 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"openshift-service-ca.crt\"" Jul 06 21:21:17.835137 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:21:17.835106 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-7sx7h"] Jul 06 21:21:17.930811 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:21:17.930769 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/a08532d7-a705-4351-8b62-a120fd3742a2-certificates\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-7sx7h\" (UID: \"a08532d7-a705-4351-8b62-a120fd3742a2\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-7sx7h" Jul 06 21:21:17.931005 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:21:17.930828 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dnpdv\" (UniqueName: \"kubernetes.io/projected/a08532d7-a705-4351-8b62-a120fd3742a2-kube-api-access-dnpdv\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-7sx7h\" (UID: \"a08532d7-a705-4351-8b62-a120fd3742a2\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-7sx7h" Jul 06 21:21:18.031691 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:21:18.031637 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dnpdv\" (UniqueName: \"kubernetes.io/projected/a08532d7-a705-4351-8b62-a120fd3742a2-kube-api-access-dnpdv\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-7sx7h\" (UID: \"a08532d7-a705-4351-8b62-a120fd3742a2\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-7sx7h" Jul 06 21:21:18.031867 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:21:18.031733 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/a08532d7-a705-4351-8b62-a120fd3742a2-certificates\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-7sx7h\" (UID: \"a08532d7-a705-4351-8b62-a120fd3742a2\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-7sx7h" Jul 06 21:21:18.034001 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:21:18.033972 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/a08532d7-a705-4351-8b62-a120fd3742a2-certificates\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-7sx7h\" (UID: \"a08532d7-a705-4351-8b62-a120fd3742a2\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-7sx7h" Jul 06 21:21:18.040140 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:21:18.040112 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dnpdv\" (UniqueName: \"kubernetes.io/projected/a08532d7-a705-4351-8b62-a120fd3742a2-kube-api-access-dnpdv\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-7sx7h\" (UID: \"a08532d7-a705-4351-8b62-a120fd3742a2\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-7sx7h" Jul 06 21:21:18.132527 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:21:18.132393 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-7sx7h" Jul 06 21:21:18.276226 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:21:18.276199 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-7sx7h"] Jul 06 21:21:18.278722 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:21:18.278691 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda08532d7_a705_4351_8b62_a120fd3742a2.slice/crio-0034fdb5cd98fce897d34feb2e6d849cbc51574985582861b3cf33664a5a0994 WatchSource:0}: Error finding container 0034fdb5cd98fce897d34feb2e6d849cbc51574985582861b3cf33664a5a0994: Status 404 returned error can't find the container with id 0034fdb5cd98fce897d34feb2e6d849cbc51574985582861b3cf33664a5a0994 Jul 06 21:21:18.505071 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:21:18.504983 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-7sx7h" event={"ID":"a08532d7-a705-4351-8b62-a120fd3742a2","Type":"ContainerStarted","Data":"0034fdb5cd98fce897d34feb2e6d849cbc51574985582861b3cf33664a5a0994"} Jul 06 21:21:22.341863 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:21:22.341817 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-operator-68bff59c-ph2xk"] Jul 06 21:21:22.345255 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:21:22.345211 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-68bff59c-ph2xk" Jul 06 21:21:22.347879 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:21:22.347850 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-certs\"" Jul 06 21:21:22.348013 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:21:22.347884 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"keda-ocp-cabundle\"" Jul 06 21:21:22.348013 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:21:22.347906 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-dockercfg-dxtrq\"" Jul 06 21:21:22.355283 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:21:22.355256 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-68bff59c-ph2xk"] Jul 06 21:21:22.368349 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:21:22.368312 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/16c3664b-b150-4947-9c6b-fb8d6527679d-certificates\") pod \"keda-operator-68bff59c-ph2xk\" (UID: \"16c3664b-b150-4947-9c6b-fb8d6527679d\") " pod="openshift-keda/keda-operator-68bff59c-ph2xk" Jul 06 21:21:22.368539 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:21:22.368370 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/16c3664b-b150-4947-9c6b-fb8d6527679d-cabundle0\") pod \"keda-operator-68bff59c-ph2xk\" (UID: \"16c3664b-b150-4947-9c6b-fb8d6527679d\") " pod="openshift-keda/keda-operator-68bff59c-ph2xk" Jul 06 21:21:22.368539 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:21:22.368445 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qhg4s\" (UniqueName: \"kubernetes.io/projected/16c3664b-b150-4947-9c6b-fb8d6527679d-kube-api-access-qhg4s\") pod \"keda-operator-68bff59c-ph2xk\" (UID: \"16c3664b-b150-4947-9c6b-fb8d6527679d\") " pod="openshift-keda/keda-operator-68bff59c-ph2xk" Jul 06 21:21:22.469435 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:21:22.469393 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/16c3664b-b150-4947-9c6b-fb8d6527679d-cabundle0\") pod \"keda-operator-68bff59c-ph2xk\" (UID: \"16c3664b-b150-4947-9c6b-fb8d6527679d\") " pod="openshift-keda/keda-operator-68bff59c-ph2xk" Jul 06 21:21:22.469614 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:21:22.469452 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qhg4s\" (UniqueName: \"kubernetes.io/projected/16c3664b-b150-4947-9c6b-fb8d6527679d-kube-api-access-qhg4s\") pod \"keda-operator-68bff59c-ph2xk\" (UID: \"16c3664b-b150-4947-9c6b-fb8d6527679d\") " pod="openshift-keda/keda-operator-68bff59c-ph2xk" Jul 06 21:21:22.469614 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:21:22.469490 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/16c3664b-b150-4947-9c6b-fb8d6527679d-certificates\") pod \"keda-operator-68bff59c-ph2xk\" (UID: \"16c3664b-b150-4947-9c6b-fb8d6527679d\") " pod="openshift-keda/keda-operator-68bff59c-ph2xk" Jul 06 21:21:22.469614 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:21:22.469589 2573 projected.go:266] Couldn't get secret openshift-keda/keda-operator-certs: secret "keda-operator-certs" not found Jul 06 21:21:22.469614 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:21:22.469603 2573 secret.go:281] references non-existent secret key: ca.crt Jul 06 21:21:22.469614 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:21:22.469611 2573 projected.go:279] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: ca.crt Jul 06 21:21:22.469798 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:21:22.469622 2573 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-operator-68bff59c-ph2xk: [secret "keda-operator-certs" not found, references non-existent secret key: ca.crt] Jul 06 21:21:22.469798 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:21:22.469676 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/16c3664b-b150-4947-9c6b-fb8d6527679d-certificates podName:16c3664b-b150-4947-9c6b-fb8d6527679d nodeName:}" failed. No retries permitted until 2026-07-06 21:21:22.969657034 +0000 UTC m=+505.917035037 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/16c3664b-b150-4947-9c6b-fb8d6527679d-certificates") pod "keda-operator-68bff59c-ph2xk" (UID: "16c3664b-b150-4947-9c6b-fb8d6527679d") : [secret "keda-operator-certs" not found, references non-existent secret key: ca.crt] Jul 06 21:21:22.470038 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:21:22.470017 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/16c3664b-b150-4947-9c6b-fb8d6527679d-cabundle0\") pod \"keda-operator-68bff59c-ph2xk\" (UID: \"16c3664b-b150-4947-9c6b-fb8d6527679d\") " pod="openshift-keda/keda-operator-68bff59c-ph2xk" Jul 06 21:21:22.480294 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:21:22.480232 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qhg4s\" (UniqueName: \"kubernetes.io/projected/16c3664b-b150-4947-9c6b-fb8d6527679d-kube-api-access-qhg4s\") pod \"keda-operator-68bff59c-ph2xk\" (UID: \"16c3664b-b150-4947-9c6b-fb8d6527679d\") " pod="openshift-keda/keda-operator-68bff59c-ph2xk" Jul 06 21:21:22.526133 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:21:22.526099 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-7sx7h" event={"ID":"a08532d7-a705-4351-8b62-a120fd3742a2","Type":"ContainerStarted","Data":"b877a8fdbd1931144bbcb76e0f040862e48fc50f3cd82b04492141ff526053a0"} Jul 06 21:21:22.526353 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:21:22.526230 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-7sx7h" Jul 06 21:21:22.552011 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:21:22.551935 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-7sx7h" podStartSLOduration=2.263903875 podStartE2EDuration="5.551911591s" totalImagesPullingTime="3.288007716s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:21:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:21:22.549343899 +0000 UTC m=+505.496721905" watchObservedRunningTime="2026-07-06 21:21:22.551911591 +0000 UTC m=+505.499289621" Jul 06 21:21:22.973299 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:21:22.973219 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/16c3664b-b150-4947-9c6b-fb8d6527679d-certificates\") pod \"keda-operator-68bff59c-ph2xk\" (UID: \"16c3664b-b150-4947-9c6b-fb8d6527679d\") " pod="openshift-keda/keda-operator-68bff59c-ph2xk" Jul 06 21:21:22.973495 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:21:22.973380 2573 secret.go:281] references non-existent secret key: ca.crt Jul 06 21:21:22.973495 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:21:22.973401 2573 projected.go:279] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: ca.crt Jul 06 21:21:22.973495 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:21:22.973411 2573 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-operator-68bff59c-ph2xk: references non-existent secret key: ca.crt Jul 06 21:21:22.973495 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:21:22.973473 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/16c3664b-b150-4947-9c6b-fb8d6527679d-certificates podName:16c3664b-b150-4947-9c6b-fb8d6527679d nodeName:}" failed. No retries permitted until 2026-07-06 21:21:23.973459731 +0000 UTC m=+506.920837717 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/16c3664b-b150-4947-9c6b-fb8d6527679d-certificates") pod "keda-operator-68bff59c-ph2xk" (UID: "16c3664b-b150-4947-9c6b-fb8d6527679d") : references non-existent secret key: ca.crt Jul 06 21:21:23.090199 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:21:23.090161 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-metrics-apiserver-559f75f947-5x54f"] Jul 06 21:21:23.093797 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:21:23.093772 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-559f75f947-5x54f" Jul 06 21:21:23.096392 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:21:23.096369 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-metrics-apiserver-certs\"" Jul 06 21:21:23.103320 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:21:23.103288 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-559f75f947-5x54f"] Jul 06 21:21:23.175003 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:21:23.174958 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pdpnc\" (UniqueName: \"kubernetes.io/projected/34175b85-1911-498e-ada3-26f7d67acbf5-kube-api-access-pdpnc\") pod \"keda-metrics-apiserver-559f75f947-5x54f\" (UID: \"34175b85-1911-498e-ada3-26f7d67acbf5\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-5x54f" Jul 06 21:21:23.175003 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:21:23.175005 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/34175b85-1911-498e-ada3-26f7d67acbf5-certificates\") pod \"keda-metrics-apiserver-559f75f947-5x54f\" (UID: \"34175b85-1911-498e-ada3-26f7d67acbf5\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-5x54f" Jul 06 21:21:23.175217 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:21:23.175091 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/34175b85-1911-498e-ada3-26f7d67acbf5-temp-vol\") pod \"keda-metrics-apiserver-559f75f947-5x54f\" (UID: \"34175b85-1911-498e-ada3-26f7d67acbf5\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-5x54f" Jul 06 21:21:23.276011 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:21:23.275907 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/34175b85-1911-498e-ada3-26f7d67acbf5-temp-vol\") pod \"keda-metrics-apiserver-559f75f947-5x54f\" (UID: \"34175b85-1911-498e-ada3-26f7d67acbf5\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-5x54f" Jul 06 21:21:23.276194 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:21:23.276094 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pdpnc\" (UniqueName: \"kubernetes.io/projected/34175b85-1911-498e-ada3-26f7d67acbf5-kube-api-access-pdpnc\") pod \"keda-metrics-apiserver-559f75f947-5x54f\" (UID: \"34175b85-1911-498e-ada3-26f7d67acbf5\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-5x54f" Jul 06 21:21:23.276194 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:21:23.276127 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/34175b85-1911-498e-ada3-26f7d67acbf5-certificates\") pod \"keda-metrics-apiserver-559f75f947-5x54f\" (UID: \"34175b85-1911-498e-ada3-26f7d67acbf5\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-5x54f" Jul 06 21:21:23.276349 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:21:23.276272 2573 secret.go:281] references non-existent secret key: tls.crt Jul 06 21:21:23.276349 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:21:23.276290 2573 projected.go:279] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: tls.crt Jul 06 21:21:23.276349 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:21:23.276303 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/34175b85-1911-498e-ada3-26f7d67acbf5-temp-vol\") pod \"keda-metrics-apiserver-559f75f947-5x54f\" (UID: \"34175b85-1911-498e-ada3-26f7d67acbf5\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-5x54f" Jul 06 21:21:23.276349 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:21:23.276315 2573 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-metrics-apiserver-559f75f947-5x54f: references non-existent secret key: tls.crt Jul 06 21:21:23.276543 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:21:23.276376 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/34175b85-1911-498e-ada3-26f7d67acbf5-certificates podName:34175b85-1911-498e-ada3-26f7d67acbf5 nodeName:}" failed. No retries permitted until 2026-07-06 21:21:23.776360463 +0000 UTC m=+506.723738446 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/34175b85-1911-498e-ada3-26f7d67acbf5-certificates") pod "keda-metrics-apiserver-559f75f947-5x54f" (UID: "34175b85-1911-498e-ada3-26f7d67acbf5") : references non-existent secret key: tls.crt Jul 06 21:21:23.287326 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:21:23.287297 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pdpnc\" (UniqueName: \"kubernetes.io/projected/34175b85-1911-498e-ada3-26f7d67acbf5-kube-api-access-pdpnc\") pod \"keda-metrics-apiserver-559f75f947-5x54f\" (UID: \"34175b85-1911-498e-ada3-26f7d67acbf5\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-5x54f" Jul 06 21:21:23.695614 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:21:23.695573 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-admission-5fbd5c4644-v2gz4"] Jul 06 21:21:23.699358 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:21:23.699334 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-5fbd5c4644-v2gz4" Jul 06 21:21:23.702055 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:21:23.702032 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-admission-webhooks-certs\"" Jul 06 21:21:23.710955 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:21:23.710922 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-5fbd5c4644-v2gz4"] Jul 06 21:21:23.780230 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:21:23.780189 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rmdbt\" (UniqueName: \"kubernetes.io/projected/99ce2cd8-c25a-4e7a-a626-83da50905942-kube-api-access-rmdbt\") pod \"keda-admission-5fbd5c4644-v2gz4\" (UID: \"99ce2cd8-c25a-4e7a-a626-83da50905942\") " pod="openshift-keda/keda-admission-5fbd5c4644-v2gz4" Jul 06 21:21:23.780436 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:21:23.780368 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/99ce2cd8-c25a-4e7a-a626-83da50905942-certificates\") pod \"keda-admission-5fbd5c4644-v2gz4\" (UID: \"99ce2cd8-c25a-4e7a-a626-83da50905942\") " pod="openshift-keda/keda-admission-5fbd5c4644-v2gz4" Jul 06 21:21:23.780436 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:21:23.780403 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/34175b85-1911-498e-ada3-26f7d67acbf5-certificates\") pod \"keda-metrics-apiserver-559f75f947-5x54f\" (UID: \"34175b85-1911-498e-ada3-26f7d67acbf5\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-5x54f" Jul 06 21:21:23.783088 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:21:23.783064 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/34175b85-1911-498e-ada3-26f7d67acbf5-certificates\") pod \"keda-metrics-apiserver-559f75f947-5x54f\" (UID: \"34175b85-1911-498e-ada3-26f7d67acbf5\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-5x54f" Jul 06 21:21:23.881335 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:21:23.881295 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rmdbt\" (UniqueName: \"kubernetes.io/projected/99ce2cd8-c25a-4e7a-a626-83da50905942-kube-api-access-rmdbt\") pod \"keda-admission-5fbd5c4644-v2gz4\" (UID: \"99ce2cd8-c25a-4e7a-a626-83da50905942\") " pod="openshift-keda/keda-admission-5fbd5c4644-v2gz4" Jul 06 21:21:23.881518 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:21:23.881392 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/99ce2cd8-c25a-4e7a-a626-83da50905942-certificates\") pod \"keda-admission-5fbd5c4644-v2gz4\" (UID: \"99ce2cd8-c25a-4e7a-a626-83da50905942\") " pod="openshift-keda/keda-admission-5fbd5c4644-v2gz4" Jul 06 21:21:23.883904 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:21:23.883869 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/99ce2cd8-c25a-4e7a-a626-83da50905942-certificates\") pod \"keda-admission-5fbd5c4644-v2gz4\" (UID: \"99ce2cd8-c25a-4e7a-a626-83da50905942\") " pod="openshift-keda/keda-admission-5fbd5c4644-v2gz4" Jul 06 21:21:23.895967 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:21:23.895934 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rmdbt\" (UniqueName: \"kubernetes.io/projected/99ce2cd8-c25a-4e7a-a626-83da50905942-kube-api-access-rmdbt\") pod \"keda-admission-5fbd5c4644-v2gz4\" (UID: \"99ce2cd8-c25a-4e7a-a626-83da50905942\") " pod="openshift-keda/keda-admission-5fbd5c4644-v2gz4" Jul 06 21:21:23.982017 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:21:23.981920 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/16c3664b-b150-4947-9c6b-fb8d6527679d-certificates\") pod \"keda-operator-68bff59c-ph2xk\" (UID: \"16c3664b-b150-4947-9c6b-fb8d6527679d\") " pod="openshift-keda/keda-operator-68bff59c-ph2xk" Jul 06 21:21:23.984583 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:21:23.984547 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/16c3664b-b150-4947-9c6b-fb8d6527679d-certificates\") pod \"keda-operator-68bff59c-ph2xk\" (UID: \"16c3664b-b150-4947-9c6b-fb8d6527679d\") " pod="openshift-keda/keda-operator-68bff59c-ph2xk" Jul 06 21:21:24.006314 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:21:24.006281 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-559f75f947-5x54f" Jul 06 21:21:24.011680 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:21:24.011641 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-5fbd5c4644-v2gz4" Jul 06 21:21:24.157879 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:21:24.157847 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-68bff59c-ph2xk" Jul 06 21:21:24.160064 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:21:24.160040 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-559f75f947-5x54f"] Jul 06 21:21:24.162308 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:21:24.162278 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34175b85_1911_498e_ada3_26f7d67acbf5.slice/crio-75e5fea8e554d96b719173aae77f530ed2af1600c884db70306db820bcf7ed8d WatchSource:0}: Error finding container 75e5fea8e554d96b719173aae77f530ed2af1600c884db70306db820bcf7ed8d: Status 404 returned error can't find the container with id 75e5fea8e554d96b719173aae77f530ed2af1600c884db70306db820bcf7ed8d Jul 06 21:21:24.191442 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:21:24.191416 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-5fbd5c4644-v2gz4"] Jul 06 21:21:24.194230 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:21:24.194196 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99ce2cd8_c25a_4e7a_a626_83da50905942.slice/crio-694db166b0054ff9cb3fc56a5612d45e09dab2112cc91b006690e926cf3031ad WatchSource:0}: Error finding container 694db166b0054ff9cb3fc56a5612d45e09dab2112cc91b006690e926cf3031ad: Status 404 returned error can't find the container with id 694db166b0054ff9cb3fc56a5612d45e09dab2112cc91b006690e926cf3031ad Jul 06 21:21:24.310795 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:21:24.310715 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-68bff59c-ph2xk"] Jul 06 21:21:24.315030 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:21:24.314993 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16c3664b_b150_4947_9c6b_fb8d6527679d.slice/crio-87e108998742da0f7d550d50083aa98b78f0b4d5b81352afba82c26f1b185d05 WatchSource:0}: Error finding container 87e108998742da0f7d550d50083aa98b78f0b4d5b81352afba82c26f1b185d05: Status 404 returned error can't find the container with id 87e108998742da0f7d550d50083aa98b78f0b4d5b81352afba82c26f1b185d05 Jul 06 21:21:24.536954 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:21:24.536893 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-559f75f947-5x54f" event={"ID":"34175b85-1911-498e-ada3-26f7d67acbf5","Type":"ContainerStarted","Data":"75e5fea8e554d96b719173aae77f530ed2af1600c884db70306db820bcf7ed8d"} Jul 06 21:21:24.538140 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:21:24.538112 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-68bff59c-ph2xk" event={"ID":"16c3664b-b150-4947-9c6b-fb8d6527679d","Type":"ContainerStarted","Data":"87e108998742da0f7d550d50083aa98b78f0b4d5b81352afba82c26f1b185d05"} Jul 06 21:21:24.539172 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:21:24.539148 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-5fbd5c4644-v2gz4" event={"ID":"99ce2cd8-c25a-4e7a-a626-83da50905942","Type":"ContainerStarted","Data":"694db166b0054ff9cb3fc56a5612d45e09dab2112cc91b006690e926cf3031ad"} Jul 06 21:21:28.563827 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:21:28.563793 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-5fbd5c4644-v2gz4" event={"ID":"99ce2cd8-c25a-4e7a-a626-83da50905942","Type":"ContainerStarted","Data":"7c3eef1805dad0c941c5ef145ef1a43c4eead40867316b96f803e720d53a2784"} Jul 06 21:21:28.564298 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:21:28.563892 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-admission-5fbd5c4644-v2gz4" Jul 06 21:21:28.565482 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:21:28.565456 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-559f75f947-5x54f" event={"ID":"34175b85-1911-498e-ada3-26f7d67acbf5","Type":"ContainerStarted","Data":"a4ebb933825cc2a9054f00282a1861bf8ed9338d15681014066f881934056c23"} Jul 06 21:21:28.565583 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:21:28.565511 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-metrics-apiserver-559f75f947-5x54f" Jul 06 21:21:28.567001 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:21:28.566974 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-68bff59c-ph2xk" event={"ID":"16c3664b-b150-4947-9c6b-fb8d6527679d","Type":"ContainerStarted","Data":"983cbcb6cfe543690146d47ed7f7f5c35c5c224f34d8b9a43f7ffac4f928d501"} Jul 06 21:21:28.567115 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:21:28.567024 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-operator-68bff59c-ph2xk" Jul 06 21:21:28.581667 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:21:28.581615 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-admission-5fbd5c4644-v2gz4" podStartSLOduration=1.775984211 podStartE2EDuration="5.581598348s" totalImagesPullingTime="3.805614137s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:21:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:21:28.580879469 +0000 UTC m=+511.528257472" watchObservedRunningTime="2026-07-06 21:21:28.581598348 +0000 UTC m=+511.528976327" Jul 06 21:21:28.641972 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:21:28.641910 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-operator-68bff59c-ph2xk" podStartSLOduration=2.945502772 podStartE2EDuration="6.641891861s" totalImagesPullingTime="3.696389089s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:21:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:21:28.641019003 +0000 UTC m=+511.588397006" watchObservedRunningTime="2026-07-06 21:21:28.641891861 +0000 UTC m=+511.589269862" Jul 06 21:21:28.643009 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:21:28.642978 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-metrics-apiserver-559f75f947-5x54f" podStartSLOduration=1.802052421 podStartE2EDuration="5.642967878s" totalImagesPullingTime="3.840915457s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:21:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:21:28.609608159 +0000 UTC m=+511.556986162" watchObservedRunningTime="2026-07-06 21:21:28.642967878 +0000 UTC m=+511.590345880" Jul 06 21:21:39.576156 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:21:39.576118 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-metrics-apiserver-559f75f947-5x54f" Jul 06 21:21:43.533111 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:21:43.533083 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-7sx7h" Jul 06 21:21:49.573716 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:21:49.573638 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-operator-68bff59c-ph2xk" Jul 06 21:21:49.573716 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:21:49.573709 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-admission-5fbd5c4644-v2gz4" Jul 06 21:22:33.932852 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:22:33.932817 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/llmisvc-controller-manager-67d95fdc48-nvs2v"] Jul 06 21:22:33.935025 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:22:33.935007 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-67d95fdc48-nvs2v" Jul 06 21:22:33.938089 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:22:33.938066 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\"" Jul 06 21:22:33.939249 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:22:33.939215 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-webhook-server-cert\"" Jul 06 21:22:33.939365 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:22:33.939270 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-controller-manager-dockercfg-zpn5d\"" Jul 06 21:22:33.939365 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:22:33.939327 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\"" Jul 06 21:22:33.955176 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:22:33.955146 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-67d95fdc48-nvs2v"] Jul 06 21:22:33.981086 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:22:33.981057 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/257556c9-60e7-4d84-a1c5-6d04fce3f8e9-cert\") pod \"llmisvc-controller-manager-67d95fdc48-nvs2v\" (UID: \"257556c9-60e7-4d84-a1c5-6d04fce3f8e9\") " pod="kserve/llmisvc-controller-manager-67d95fdc48-nvs2v" Jul 06 21:22:33.981256 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:22:33.981137 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bfvb7\" (UniqueName: \"kubernetes.io/projected/257556c9-60e7-4d84-a1c5-6d04fce3f8e9-kube-api-access-bfvb7\") pod \"llmisvc-controller-manager-67d95fdc48-nvs2v\" (UID: \"257556c9-60e7-4d84-a1c5-6d04fce3f8e9\") " pod="kserve/llmisvc-controller-manager-67d95fdc48-nvs2v" Jul 06 21:22:34.082448 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:22:34.082409 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/257556c9-60e7-4d84-a1c5-6d04fce3f8e9-cert\") pod \"llmisvc-controller-manager-67d95fdc48-nvs2v\" (UID: \"257556c9-60e7-4d84-a1c5-6d04fce3f8e9\") " pod="kserve/llmisvc-controller-manager-67d95fdc48-nvs2v" Jul 06 21:22:34.082661 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:22:34.082510 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bfvb7\" (UniqueName: \"kubernetes.io/projected/257556c9-60e7-4d84-a1c5-6d04fce3f8e9-kube-api-access-bfvb7\") pod \"llmisvc-controller-manager-67d95fdc48-nvs2v\" (UID: \"257556c9-60e7-4d84-a1c5-6d04fce3f8e9\") " pod="kserve/llmisvc-controller-manager-67d95fdc48-nvs2v" Jul 06 21:22:34.082661 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:22:34.082575 2573 secret.go:189] Couldn't get secret kserve/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found Jul 06 21:22:34.082661 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:22:34.082653 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/257556c9-60e7-4d84-a1c5-6d04fce3f8e9-cert podName:257556c9-60e7-4d84-a1c5-6d04fce3f8e9 nodeName:}" failed. No retries permitted until 2026-07-06 21:22:34.582634885 +0000 UTC m=+577.530012884 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/257556c9-60e7-4d84-a1c5-6d04fce3f8e9-cert") pod "llmisvc-controller-manager-67d95fdc48-nvs2v" (UID: "257556c9-60e7-4d84-a1c5-6d04fce3f8e9") : secret "llmisvc-webhook-server-cert" not found Jul 06 21:22:34.092689 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:22:34.092663 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bfvb7\" (UniqueName: \"kubernetes.io/projected/257556c9-60e7-4d84-a1c5-6d04fce3f8e9-kube-api-access-bfvb7\") pod \"llmisvc-controller-manager-67d95fdc48-nvs2v\" (UID: \"257556c9-60e7-4d84-a1c5-6d04fce3f8e9\") " pod="kserve/llmisvc-controller-manager-67d95fdc48-nvs2v" Jul 06 21:22:34.587113 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:22:34.587080 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/257556c9-60e7-4d84-a1c5-6d04fce3f8e9-cert\") pod \"llmisvc-controller-manager-67d95fdc48-nvs2v\" (UID: \"257556c9-60e7-4d84-a1c5-6d04fce3f8e9\") " pod="kserve/llmisvc-controller-manager-67d95fdc48-nvs2v" Jul 06 21:22:34.589512 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:22:34.589490 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/257556c9-60e7-4d84-a1c5-6d04fce3f8e9-cert\") pod \"llmisvc-controller-manager-67d95fdc48-nvs2v\" (UID: \"257556c9-60e7-4d84-a1c5-6d04fce3f8e9\") " pod="kserve/llmisvc-controller-manager-67d95fdc48-nvs2v" Jul 06 21:22:34.846642 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:22:34.846556 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-67d95fdc48-nvs2v" Jul 06 21:22:34.981660 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:22:34.981638 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-67d95fdc48-nvs2v"] Jul 06 21:22:34.984151 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:22:34.984123 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod257556c9_60e7_4d84_a1c5_6d04fce3f8e9.slice/crio-07dbda56be6e149ce6d8433db6947b0407f71cb858a5f83d16ce76f296816e7b WatchSource:0}: Error finding container 07dbda56be6e149ce6d8433db6947b0407f71cb858a5f83d16ce76f296816e7b: Status 404 returned error can't find the container with id 07dbda56be6e149ce6d8433db6947b0407f71cb858a5f83d16ce76f296816e7b Jul 06 21:22:35.873283 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:22:35.873246 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-67d95fdc48-nvs2v" event={"ID":"257556c9-60e7-4d84-a1c5-6d04fce3f8e9","Type":"ContainerStarted","Data":"07dbda56be6e149ce6d8433db6947b0407f71cb858a5f83d16ce76f296816e7b"} Jul 06 21:22:36.879336 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:22:36.879297 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-67d95fdc48-nvs2v" event={"ID":"257556c9-60e7-4d84-a1c5-6d04fce3f8e9","Type":"ContainerStarted","Data":"8adfb0d8233a15a3b88dd7033a4d935c51fa9fb751edb719199a129da9e52d10"} Jul 06 21:22:36.879761 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:22:36.879453 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-67d95fdc48-nvs2v" Jul 06 21:22:36.902174 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:22:36.902116 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/llmisvc-controller-manager-67d95fdc48-nvs2v" podStartSLOduration=2.171588481 podStartE2EDuration="3.902099861s" totalImagesPullingTime="1.73051138s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:22:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:22:36.900393864 +0000 UTC m=+579.847771863" watchObservedRunningTime="2026-07-06 21:22:36.902099861 +0000 UTC m=+579.849477863" Jul 06 21:22:57.506579 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:22:57.506549 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5s6d9_e122448a-d2e4-4fec-a918-3d3eecb175a4/ovn-acl-logging/0.log" Jul 06 21:22:57.508105 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:22:57.508082 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5s6d9_e122448a-d2e4-4fec-a918-3d3eecb175a4/ovn-acl-logging/0.log" Jul 06 21:23:07.885519 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:23:07.885486 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/llmisvc-controller-manager-67d95fdc48-nvs2v" Jul 06 21:23:37.991819 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:23:37.991740 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-f7dc6ddc-hhgt7"] Jul 06 21:23:37.995051 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:23:37.995030 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f7dc6ddc-hhgt7" Jul 06 21:23:38.004900 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:23:38.004874 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-f7dc6ddc-hhgt7"] Jul 06 21:23:38.046396 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:23:38.046355 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dad9c782-eea3-44e2-9b59-cfc29e499055-console-config\") pod \"console-f7dc6ddc-hhgt7\" (UID: \"dad9c782-eea3-44e2-9b59-cfc29e499055\") " pod="openshift-console/console-f7dc6ddc-hhgt7" Jul 06 21:23:38.046396 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:23:38.046393 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dad9c782-eea3-44e2-9b59-cfc29e499055-service-ca\") pod \"console-f7dc6ddc-hhgt7\" (UID: \"dad9c782-eea3-44e2-9b59-cfc29e499055\") " pod="openshift-console/console-f7dc6ddc-hhgt7" Jul 06 21:23:38.046617 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:23:38.046491 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dad9c782-eea3-44e2-9b59-cfc29e499055-trusted-ca-bundle\") pod \"console-f7dc6ddc-hhgt7\" (UID: \"dad9c782-eea3-44e2-9b59-cfc29e499055\") " pod="openshift-console/console-f7dc6ddc-hhgt7" Jul 06 21:23:38.046617 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:23:38.046522 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dad9c782-eea3-44e2-9b59-cfc29e499055-console-serving-cert\") pod \"console-f7dc6ddc-hhgt7\" (UID: \"dad9c782-eea3-44e2-9b59-cfc29e499055\") " pod="openshift-console/console-f7dc6ddc-hhgt7" Jul 06 21:23:38.046617 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:23:38.046563 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dad9c782-eea3-44e2-9b59-cfc29e499055-console-oauth-config\") pod \"console-f7dc6ddc-hhgt7\" (UID: \"dad9c782-eea3-44e2-9b59-cfc29e499055\") " pod="openshift-console/console-f7dc6ddc-hhgt7" Jul 06 21:23:38.046617 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:23:38.046577 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x95g6\" (UniqueName: \"kubernetes.io/projected/dad9c782-eea3-44e2-9b59-cfc29e499055-kube-api-access-x95g6\") pod \"console-f7dc6ddc-hhgt7\" (UID: \"dad9c782-eea3-44e2-9b59-cfc29e499055\") " pod="openshift-console/console-f7dc6ddc-hhgt7" Jul 06 21:23:38.046617 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:23:38.046599 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dad9c782-eea3-44e2-9b59-cfc29e499055-oauth-serving-cert\") pod \"console-f7dc6ddc-hhgt7\" (UID: \"dad9c782-eea3-44e2-9b59-cfc29e499055\") " pod="openshift-console/console-f7dc6ddc-hhgt7" Jul 06 21:23:38.148032 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:23:38.147994 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dad9c782-eea3-44e2-9b59-cfc29e499055-trusted-ca-bundle\") pod \"console-f7dc6ddc-hhgt7\" (UID: \"dad9c782-eea3-44e2-9b59-cfc29e499055\") " pod="openshift-console/console-f7dc6ddc-hhgt7" Jul 06 21:23:38.148226 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:23:38.148043 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dad9c782-eea3-44e2-9b59-cfc29e499055-console-serving-cert\") pod \"console-f7dc6ddc-hhgt7\" (UID: \"dad9c782-eea3-44e2-9b59-cfc29e499055\") " pod="openshift-console/console-f7dc6ddc-hhgt7" Jul 06 21:23:38.148226 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:23:38.148171 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dad9c782-eea3-44e2-9b59-cfc29e499055-console-oauth-config\") pod \"console-f7dc6ddc-hhgt7\" (UID: \"dad9c782-eea3-44e2-9b59-cfc29e499055\") " pod="openshift-console/console-f7dc6ddc-hhgt7" Jul 06 21:23:38.148226 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:23:38.148209 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x95g6\" (UniqueName: \"kubernetes.io/projected/dad9c782-eea3-44e2-9b59-cfc29e499055-kube-api-access-x95g6\") pod \"console-f7dc6ddc-hhgt7\" (UID: \"dad9c782-eea3-44e2-9b59-cfc29e499055\") " pod="openshift-console/console-f7dc6ddc-hhgt7" Jul 06 21:23:38.148445 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:23:38.148271 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dad9c782-eea3-44e2-9b59-cfc29e499055-oauth-serving-cert\") pod \"console-f7dc6ddc-hhgt7\" (UID: \"dad9c782-eea3-44e2-9b59-cfc29e499055\") " pod="openshift-console/console-f7dc6ddc-hhgt7" Jul 06 21:23:38.148445 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:23:38.148348 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dad9c782-eea3-44e2-9b59-cfc29e499055-console-config\") pod \"console-f7dc6ddc-hhgt7\" (UID: \"dad9c782-eea3-44e2-9b59-cfc29e499055\") " pod="openshift-console/console-f7dc6ddc-hhgt7" Jul 06 21:23:38.148445 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:23:38.148382 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dad9c782-eea3-44e2-9b59-cfc29e499055-service-ca\") pod \"console-f7dc6ddc-hhgt7\" (UID: \"dad9c782-eea3-44e2-9b59-cfc29e499055\") " pod="openshift-console/console-f7dc6ddc-hhgt7" Jul 06 21:23:38.148987 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:23:38.148955 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dad9c782-eea3-44e2-9b59-cfc29e499055-trusted-ca-bundle\") pod \"console-f7dc6ddc-hhgt7\" (UID: \"dad9c782-eea3-44e2-9b59-cfc29e499055\") " pod="openshift-console/console-f7dc6ddc-hhgt7" Jul 06 21:23:38.149104 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:23:38.149087 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dad9c782-eea3-44e2-9b59-cfc29e499055-console-config\") pod \"console-f7dc6ddc-hhgt7\" (UID: \"dad9c782-eea3-44e2-9b59-cfc29e499055\") " pod="openshift-console/console-f7dc6ddc-hhgt7" Jul 06 21:23:38.149169 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:23:38.149119 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dad9c782-eea3-44e2-9b59-cfc29e499055-oauth-serving-cert\") pod \"console-f7dc6ddc-hhgt7\" (UID: \"dad9c782-eea3-44e2-9b59-cfc29e499055\") " pod="openshift-console/console-f7dc6ddc-hhgt7" Jul 06 21:23:38.149679 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:23:38.149655 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dad9c782-eea3-44e2-9b59-cfc29e499055-service-ca\") pod \"console-f7dc6ddc-hhgt7\" (UID: \"dad9c782-eea3-44e2-9b59-cfc29e499055\") " pod="openshift-console/console-f7dc6ddc-hhgt7" Jul 06 21:23:38.150792 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:23:38.150770 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dad9c782-eea3-44e2-9b59-cfc29e499055-console-oauth-config\") pod \"console-f7dc6ddc-hhgt7\" (UID: \"dad9c782-eea3-44e2-9b59-cfc29e499055\") " pod="openshift-console/console-f7dc6ddc-hhgt7" Jul 06 21:23:38.150933 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:23:38.150913 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dad9c782-eea3-44e2-9b59-cfc29e499055-console-serving-cert\") pod \"console-f7dc6ddc-hhgt7\" (UID: \"dad9c782-eea3-44e2-9b59-cfc29e499055\") " pod="openshift-console/console-f7dc6ddc-hhgt7" Jul 06 21:23:38.155826 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:23:38.155806 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x95g6\" (UniqueName: \"kubernetes.io/projected/dad9c782-eea3-44e2-9b59-cfc29e499055-kube-api-access-x95g6\") pod \"console-f7dc6ddc-hhgt7\" (UID: \"dad9c782-eea3-44e2-9b59-cfc29e499055\") " pod="openshift-console/console-f7dc6ddc-hhgt7" Jul 06 21:23:38.305456 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:23:38.305425 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f7dc6ddc-hhgt7" Jul 06 21:23:38.460193 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:23:38.460166 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-f7dc6ddc-hhgt7"] Jul 06 21:23:38.462628 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:23:38.462596 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddad9c782_eea3_44e2_9b59_cfc29e499055.slice/crio-aeed47ed67737eeef895dd30cd039482ff92c8f8bf03151a4f495afa34f18bfb WatchSource:0}: Error finding container aeed47ed67737eeef895dd30cd039482ff92c8f8bf03151a4f495afa34f18bfb: Status 404 returned error can't find the container with id aeed47ed67737eeef895dd30cd039482ff92c8f8bf03151a4f495afa34f18bfb Jul 06 21:23:39.159759 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:23:39.159723 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f7dc6ddc-hhgt7" event={"ID":"dad9c782-eea3-44e2-9b59-cfc29e499055","Type":"ContainerStarted","Data":"aea0cecdebae3ee4027befd3b7dcaf1d4bb75f7dbc0ba9dc7531ba9964471367"} Jul 06 21:23:39.160324 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:23:39.159782 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f7dc6ddc-hhgt7" event={"ID":"dad9c782-eea3-44e2-9b59-cfc29e499055","Type":"ContainerStarted","Data":"aeed47ed67737eeef895dd30cd039482ff92c8f8bf03151a4f495afa34f18bfb"} Jul 06 21:23:39.178870 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:23:39.178817 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-f7dc6ddc-hhgt7" podStartSLOduration=2.178801322 podStartE2EDuration="2.178801322s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:23:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:23:39.177155454 +0000 UTC m=+642.124533467" watchObservedRunningTime="2026-07-06 21:23:39.178801322 +0000 UTC m=+642.126179323" Jul 06 21:23:48.306273 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:23:48.306205 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-f7dc6ddc-hhgt7" Jul 06 21:23:48.306693 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:23:48.306294 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-f7dc6ddc-hhgt7" Jul 06 21:23:48.311224 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:23:48.311200 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-f7dc6ddc-hhgt7" Jul 06 21:23:49.215221 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:23:49.215195 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-f7dc6ddc-hhgt7" Jul 06 21:23:49.262832 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:23:49.262799 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5d6c5ff689-lqchh"] Jul 06 21:24:14.289934 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:24:14.289876 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-5d6c5ff689-lqchh" podUID="2988d357-68d1-46f0-b714-f624f87d12b0" containerName="console" containerID="cri-o://d6ee3211691da6f19d52b6b54dc6aa2307ea929fa138bf3d01f0060bd32120cf" gracePeriod=15 Jul 06 21:24:14.535999 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:24:14.535969 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d6c5ff689-lqchh" Jul 06 21:24:14.558744 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:24:14.558665 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2988d357-68d1-46f0-b714-f624f87d12b0-oauth-serving-cert\") pod \"2988d357-68d1-46f0-b714-f624f87d12b0\" (UID: \"2988d357-68d1-46f0-b714-f624f87d12b0\") " Jul 06 21:24:14.558744 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:24:14.558732 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2988d357-68d1-46f0-b714-f624f87d12b0-console-oauth-config\") pod \"2988d357-68d1-46f0-b714-f624f87d12b0\" (UID: \"2988d357-68d1-46f0-b714-f624f87d12b0\") " Jul 06 21:24:14.558971 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:24:14.558771 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2988d357-68d1-46f0-b714-f624f87d12b0-service-ca\") pod \"2988d357-68d1-46f0-b714-f624f87d12b0\" (UID: \"2988d357-68d1-46f0-b714-f624f87d12b0\") " Jul 06 21:24:14.558971 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:24:14.558801 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2988d357-68d1-46f0-b714-f624f87d12b0-trusted-ca-bundle\") pod \"2988d357-68d1-46f0-b714-f624f87d12b0\" (UID: \"2988d357-68d1-46f0-b714-f624f87d12b0\") " Jul 06 21:24:14.558971 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:24:14.558830 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qq7hh\" (UniqueName: \"kubernetes.io/projected/2988d357-68d1-46f0-b714-f624f87d12b0-kube-api-access-qq7hh\") pod \"2988d357-68d1-46f0-b714-f624f87d12b0\" (UID: \"2988d357-68d1-46f0-b714-f624f87d12b0\") " Jul 06 21:24:14.558971 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:24:14.558883 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2988d357-68d1-46f0-b714-f624f87d12b0-console-serving-cert\") pod \"2988d357-68d1-46f0-b714-f624f87d12b0\" (UID: \"2988d357-68d1-46f0-b714-f624f87d12b0\") " Jul 06 21:24:14.558971 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:24:14.558924 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2988d357-68d1-46f0-b714-f624f87d12b0-console-config\") pod \"2988d357-68d1-46f0-b714-f624f87d12b0\" (UID: \"2988d357-68d1-46f0-b714-f624f87d12b0\") " Jul 06 21:24:14.559251 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:24:14.559102 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2988d357-68d1-46f0-b714-f624f87d12b0-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "2988d357-68d1-46f0-b714-f624f87d12b0" (UID: "2988d357-68d1-46f0-b714-f624f87d12b0"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 21:24:14.559251 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:24:14.559194 2573 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2988d357-68d1-46f0-b714-f624f87d12b0-oauth-serving-cert\") on node \"ip-10-0-130-89.ec2.internal\" DevicePath \"\"" Jul 06 21:24:14.559596 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:24:14.559544 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2988d357-68d1-46f0-b714-f624f87d12b0-console-config" (OuterVolumeSpecName: "console-config") pod "2988d357-68d1-46f0-b714-f624f87d12b0" (UID: "2988d357-68d1-46f0-b714-f624f87d12b0"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 21:24:14.559596 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:24:14.559566 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2988d357-68d1-46f0-b714-f624f87d12b0-service-ca" (OuterVolumeSpecName: "service-ca") pod "2988d357-68d1-46f0-b714-f624f87d12b0" (UID: "2988d357-68d1-46f0-b714-f624f87d12b0"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 21:24:14.559780 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:24:14.559760 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2988d357-68d1-46f0-b714-f624f87d12b0-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "2988d357-68d1-46f0-b714-f624f87d12b0" (UID: "2988d357-68d1-46f0-b714-f624f87d12b0"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 21:24:14.561382 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:24:14.561350 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2988d357-68d1-46f0-b714-f624f87d12b0-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "2988d357-68d1-46f0-b714-f624f87d12b0" (UID: "2988d357-68d1-46f0-b714-f624f87d12b0"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 21:24:14.561471 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:24:14.561420 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2988d357-68d1-46f0-b714-f624f87d12b0-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "2988d357-68d1-46f0-b714-f624f87d12b0" (UID: "2988d357-68d1-46f0-b714-f624f87d12b0"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 21:24:14.561700 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:24:14.561674 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2988d357-68d1-46f0-b714-f624f87d12b0-kube-api-access-qq7hh" (OuterVolumeSpecName: "kube-api-access-qq7hh") pod "2988d357-68d1-46f0-b714-f624f87d12b0" (UID: "2988d357-68d1-46f0-b714-f624f87d12b0"). InnerVolumeSpecName "kube-api-access-qq7hh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 21:24:14.659732 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:24:14.659703 2573 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2988d357-68d1-46f0-b714-f624f87d12b0-console-oauth-config\") on node \"ip-10-0-130-89.ec2.internal\" DevicePath \"\"" Jul 06 21:24:14.659732 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:24:14.659730 2573 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2988d357-68d1-46f0-b714-f624f87d12b0-service-ca\") on node \"ip-10-0-130-89.ec2.internal\" DevicePath \"\"" Jul 06 21:24:14.659732 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:24:14.659741 2573 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2988d357-68d1-46f0-b714-f624f87d12b0-trusted-ca-bundle\") on node \"ip-10-0-130-89.ec2.internal\" DevicePath \"\"" Jul 06 21:24:14.659732 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:24:14.659751 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qq7hh\" (UniqueName: \"kubernetes.io/projected/2988d357-68d1-46f0-b714-f624f87d12b0-kube-api-access-qq7hh\") on node \"ip-10-0-130-89.ec2.internal\" DevicePath \"\"" Jul 06 21:24:14.660010 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:24:14.659761 2573 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2988d357-68d1-46f0-b714-f624f87d12b0-console-serving-cert\") on node \"ip-10-0-130-89.ec2.internal\" DevicePath \"\"" Jul 06 21:24:14.660010 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:24:14.659769 2573 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2988d357-68d1-46f0-b714-f624f87d12b0-console-config\") on node \"ip-10-0-130-89.ec2.internal\" DevicePath \"\"" Jul 06 21:24:15.332318 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:24:15.332281 2573 generic.go:356] "Generic (PLEG): container finished" podID="2988d357-68d1-46f0-b714-f624f87d12b0" containerID="d6ee3211691da6f19d52b6b54dc6aa2307ea929fa138bf3d01f0060bd32120cf" exitCode=0 Jul 06 21:24:15.332723 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:24:15.332327 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d6c5ff689-lqchh" Jul 06 21:24:15.332723 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:24:15.332363 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d6c5ff689-lqchh" event={"ID":"2988d357-68d1-46f0-b714-f624f87d12b0","Type":"ContainerDied","Data":"d6ee3211691da6f19d52b6b54dc6aa2307ea929fa138bf3d01f0060bd32120cf"} Jul 06 21:24:15.332723 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:24:15.332424 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d6c5ff689-lqchh" event={"ID":"2988d357-68d1-46f0-b714-f624f87d12b0","Type":"ContainerDied","Data":"acb1a4a853304344922ee1da41607bd7f5ad9635b870bcde801d1449bbbd31b2"} Jul 06 21:24:15.332723 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:24:15.332447 2573 scope.go:117] "RemoveContainer" containerID="d6ee3211691da6f19d52b6b54dc6aa2307ea929fa138bf3d01f0060bd32120cf" Jul 06 21:24:15.341724 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:24:15.341705 2573 scope.go:117] "RemoveContainer" containerID="d6ee3211691da6f19d52b6b54dc6aa2307ea929fa138bf3d01f0060bd32120cf" Jul 06 21:24:15.342031 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:24:15.342012 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d6ee3211691da6f19d52b6b54dc6aa2307ea929fa138bf3d01f0060bd32120cf\": container with ID starting with d6ee3211691da6f19d52b6b54dc6aa2307ea929fa138bf3d01f0060bd32120cf not found: ID does not exist" containerID="d6ee3211691da6f19d52b6b54dc6aa2307ea929fa138bf3d01f0060bd32120cf" Jul 06 21:24:15.342076 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:24:15.342041 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d6ee3211691da6f19d52b6b54dc6aa2307ea929fa138bf3d01f0060bd32120cf"} err="failed to get container status \"d6ee3211691da6f19d52b6b54dc6aa2307ea929fa138bf3d01f0060bd32120cf\": rpc error: code = NotFound desc = could not find container \"d6ee3211691da6f19d52b6b54dc6aa2307ea929fa138bf3d01f0060bd32120cf\": container with ID starting with d6ee3211691da6f19d52b6b54dc6aa2307ea929fa138bf3d01f0060bd32120cf not found: ID does not exist" Jul 06 21:24:15.354359 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:24:15.354331 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5d6c5ff689-lqchh"] Jul 06 21:24:15.357381 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:24:15.357353 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5d6c5ff689-lqchh"] Jul 06 21:24:15.642357 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:24:15.642275 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2988d357-68d1-46f0-b714-f624f87d12b0" path="/var/lib/kubelet/pods/2988d357-68d1-46f0-b714-f624f87d12b0/volumes" Jul 06 21:25:21.391604 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:25:21.391563 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/seaweedfs-tls-custom-6644bf5d6c-q56kp"] Jul 06 21:25:21.394840 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:25:21.392622 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2988d357-68d1-46f0-b714-f624f87d12b0" containerName="console" Jul 06 21:25:21.394840 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:25:21.392649 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="2988d357-68d1-46f0-b714-f624f87d12b0" containerName="console" Jul 06 21:25:21.394840 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:25:21.392872 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="2988d357-68d1-46f0-b714-f624f87d12b0" containerName="console" Jul 06 21:25:21.397028 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:25:21.397002 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-tls-custom-6644bf5d6c-q56kp" Jul 06 21:25:21.400320 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:25:21.400290 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"seaweedfs-tls-custom-artifact\"" Jul 06 21:25:21.400479 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:25:21.400303 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-6g67l\"" Jul 06 21:25:21.401725 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:25:21.401701 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-tls-custom-6644bf5d6c-q56kp"] Jul 06 21:25:21.428481 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:25:21.428438 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qh2wr\" (UniqueName: \"kubernetes.io/projected/899887d2-bb49-4df4-b877-de961f0fd19e-kube-api-access-qh2wr\") pod \"seaweedfs-tls-custom-6644bf5d6c-q56kp\" (UID: \"899887d2-bb49-4df4-b877-de961f0fd19e\") " pod="kserve/seaweedfs-tls-custom-6644bf5d6c-q56kp" Jul 06 21:25:21.428683 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:25:21.428570 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/899887d2-bb49-4df4-b877-de961f0fd19e-data\") pod \"seaweedfs-tls-custom-6644bf5d6c-q56kp\" (UID: \"899887d2-bb49-4df4-b877-de961f0fd19e\") " pod="kserve/seaweedfs-tls-custom-6644bf5d6c-q56kp" Jul 06 21:25:21.530022 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:25:21.529981 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/899887d2-bb49-4df4-b877-de961f0fd19e-data\") pod \"seaweedfs-tls-custom-6644bf5d6c-q56kp\" (UID: \"899887d2-bb49-4df4-b877-de961f0fd19e\") " pod="kserve/seaweedfs-tls-custom-6644bf5d6c-q56kp" Jul 06 21:25:21.530224 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:25:21.530052 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qh2wr\" (UniqueName: \"kubernetes.io/projected/899887d2-bb49-4df4-b877-de961f0fd19e-kube-api-access-qh2wr\") pod \"seaweedfs-tls-custom-6644bf5d6c-q56kp\" (UID: \"899887d2-bb49-4df4-b877-de961f0fd19e\") " pod="kserve/seaweedfs-tls-custom-6644bf5d6c-q56kp" Jul 06 21:25:21.530459 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:25:21.530436 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/899887d2-bb49-4df4-b877-de961f0fd19e-data\") pod \"seaweedfs-tls-custom-6644bf5d6c-q56kp\" (UID: \"899887d2-bb49-4df4-b877-de961f0fd19e\") " pod="kserve/seaweedfs-tls-custom-6644bf5d6c-q56kp" Jul 06 21:25:21.538490 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:25:21.538469 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qh2wr\" (UniqueName: \"kubernetes.io/projected/899887d2-bb49-4df4-b877-de961f0fd19e-kube-api-access-qh2wr\") pod \"seaweedfs-tls-custom-6644bf5d6c-q56kp\" (UID: \"899887d2-bb49-4df4-b877-de961f0fd19e\") " pod="kserve/seaweedfs-tls-custom-6644bf5d6c-q56kp" Jul 06 21:25:21.709276 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:25:21.709157 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-tls-custom-6644bf5d6c-q56kp" Jul 06 21:25:21.846859 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:25:21.846829 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-tls-custom-6644bf5d6c-q56kp"] Jul 06 21:25:21.849421 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:25:21.849390 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod899887d2_bb49_4df4_b877_de961f0fd19e.slice/crio-8bd074ea641d560170cc26d616bff0f7265c13c8de2d2118f270a27b259bd9c0 WatchSource:0}: Error finding container 8bd074ea641d560170cc26d616bff0f7265c13c8de2d2118f270a27b259bd9c0: Status 404 returned error can't find the container with id 8bd074ea641d560170cc26d616bff0f7265c13c8de2d2118f270a27b259bd9c0 Jul 06 21:25:21.850642 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:25:21.850624 2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 21:25:22.640631 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:25:22.640596 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-tls-custom-6644bf5d6c-q56kp" event={"ID":"899887d2-bb49-4df4-b877-de961f0fd19e","Type":"ContainerStarted","Data":"8bd074ea641d560170cc26d616bff0f7265c13c8de2d2118f270a27b259bd9c0"} Jul 06 21:25:25.656652 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:25:25.656617 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-tls-custom-6644bf5d6c-q56kp" event={"ID":"899887d2-bb49-4df4-b877-de961f0fd19e","Type":"ContainerStarted","Data":"0b7a235c1080e1ccf199da7915055ea8b387ffc70be94cff932c92bf653e3af1"} Jul 06 21:25:25.673826 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:25:25.673776 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/seaweedfs-tls-custom-6644bf5d6c-q56kp" podStartSLOduration=1.485636153 podStartE2EDuration="4.673760389s" totalImagesPullingTime="3.188124236s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:25:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:25:25.672450385 +0000 UTC m=+748.619828388" watchObservedRunningTime="2026-07-06 21:25:25.673760389 +0000 UTC m=+748.621138414" Jul 06 21:25:26.611698 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:25:26.611654 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve/seaweedfs-tls-custom-6644bf5d6c-q56kp"] Jul 06 21:25:27.665825 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:25:27.665754 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve/seaweedfs-tls-custom-6644bf5d6c-q56kp" podUID="899887d2-bb49-4df4-b877-de961f0fd19e" containerName="seaweedfs-tls-custom" containerID="cri-o://0b7a235c1080e1ccf199da7915055ea8b387ffc70be94cff932c92bf653e3af1" gracePeriod=30 Jul 06 21:25:28.904641 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:25:28.904616 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-tls-custom-6644bf5d6c-q56kp" Jul 06 21:25:28.997989 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:25:28.997900 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/899887d2-bb49-4df4-b877-de961f0fd19e-data\") pod \"899887d2-bb49-4df4-b877-de961f0fd19e\" (UID: \"899887d2-bb49-4df4-b877-de961f0fd19e\") " Jul 06 21:25:28.997989 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:25:28.997950 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qh2wr\" (UniqueName: \"kubernetes.io/projected/899887d2-bb49-4df4-b877-de961f0fd19e-kube-api-access-qh2wr\") pod \"899887d2-bb49-4df4-b877-de961f0fd19e\" (UID: \"899887d2-bb49-4df4-b877-de961f0fd19e\") " Jul 06 21:25:28.998860 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:25:28.998832 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/899887d2-bb49-4df4-b877-de961f0fd19e-data" (OuterVolumeSpecName: "data") pod "899887d2-bb49-4df4-b877-de961f0fd19e" (UID: "899887d2-bb49-4df4-b877-de961f0fd19e"). InnerVolumeSpecName "data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 21:25:29.000200 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:25:29.000171 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/899887d2-bb49-4df4-b877-de961f0fd19e-kube-api-access-qh2wr" (OuterVolumeSpecName: "kube-api-access-qh2wr") pod "899887d2-bb49-4df4-b877-de961f0fd19e" (UID: "899887d2-bb49-4df4-b877-de961f0fd19e"). InnerVolumeSpecName "kube-api-access-qh2wr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 21:25:29.099331 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:25:29.099285 2573 reconciler_common.go:299] "Volume detached for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/899887d2-bb49-4df4-b877-de961f0fd19e-data\") on node \"ip-10-0-130-89.ec2.internal\" DevicePath \"\"" Jul 06 21:25:29.099331 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:25:29.099317 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qh2wr\" (UniqueName: \"kubernetes.io/projected/899887d2-bb49-4df4-b877-de961f0fd19e-kube-api-access-qh2wr\") on node \"ip-10-0-130-89.ec2.internal\" DevicePath \"\"" Jul 06 21:25:29.677053 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:25:29.677017 2573 generic.go:356] "Generic (PLEG): container finished" podID="899887d2-bb49-4df4-b877-de961f0fd19e" containerID="0b7a235c1080e1ccf199da7915055ea8b387ffc70be94cff932c92bf653e3af1" exitCode=0 Jul 06 21:25:29.677053 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:25:29.677065 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-tls-custom-6644bf5d6c-q56kp" Jul 06 21:25:29.677335 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:25:29.677104 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-tls-custom-6644bf5d6c-q56kp" event={"ID":"899887d2-bb49-4df4-b877-de961f0fd19e","Type":"ContainerDied","Data":"0b7a235c1080e1ccf199da7915055ea8b387ffc70be94cff932c92bf653e3af1"} Jul 06 21:25:29.677335 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:25:29.677157 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-tls-custom-6644bf5d6c-q56kp" event={"ID":"899887d2-bb49-4df4-b877-de961f0fd19e","Type":"ContainerDied","Data":"8bd074ea641d560170cc26d616bff0f7265c13c8de2d2118f270a27b259bd9c0"} Jul 06 21:25:29.677335 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:25:29.677181 2573 scope.go:117] "RemoveContainer" containerID="0b7a235c1080e1ccf199da7915055ea8b387ffc70be94cff932c92bf653e3af1" Jul 06 21:25:29.687215 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:25:29.687192 2573 scope.go:117] "RemoveContainer" containerID="0b7a235c1080e1ccf199da7915055ea8b387ffc70be94cff932c92bf653e3af1" Jul 06 21:25:29.687538 ip-10-0-130-89 kubenswrapper[2573]: E0706 21:25:29.687515 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0b7a235c1080e1ccf199da7915055ea8b387ffc70be94cff932c92bf653e3af1\": container with ID starting with 0b7a235c1080e1ccf199da7915055ea8b387ffc70be94cff932c92bf653e3af1 not found: ID does not exist" containerID="0b7a235c1080e1ccf199da7915055ea8b387ffc70be94cff932c92bf653e3af1" Jul 06 21:25:29.687601 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:25:29.687543 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b7a235c1080e1ccf199da7915055ea8b387ffc70be94cff932c92bf653e3af1"} err="failed to get container status \"0b7a235c1080e1ccf199da7915055ea8b387ffc70be94cff932c92bf653e3af1\": rpc error: code = NotFound desc = could not find container \"0b7a235c1080e1ccf199da7915055ea8b387ffc70be94cff932c92bf653e3af1\": container with ID starting with 0b7a235c1080e1ccf199da7915055ea8b387ffc70be94cff932c92bf653e3af1 not found: ID does not exist" Jul 06 21:25:29.693624 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:25:29.693592 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve/seaweedfs-tls-custom-6644bf5d6c-q56kp"] Jul 06 21:25:29.697201 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:25:29.697174 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve/seaweedfs-tls-custom-6644bf5d6c-q56kp"] Jul 06 21:25:31.641769 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:25:31.641731 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="899887d2-bb49-4df4-b877-de961f0fd19e" path="/var/lib/kubelet/pods/899887d2-bb49-4df4-b877-de961f0fd19e/volumes" Jul 06 21:27:57.535658 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:27:57.535618 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5s6d9_e122448a-d2e4-4fec-a918-3d3eecb175a4/ovn-acl-logging/0.log" Jul 06 21:27:57.536186 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:27:57.535671 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5s6d9_e122448a-d2e4-4fec-a918-3d3eecb175a4/ovn-acl-logging/0.log" Jul 06 21:32:57.562141 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:32:57.562112 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5s6d9_e122448a-d2e4-4fec-a918-3d3eecb175a4/ovn-acl-logging/0.log" Jul 06 21:32:57.563374 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:32:57.563353 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5s6d9_e122448a-d2e4-4fec-a918-3d3eecb175a4/ovn-acl-logging/0.log" Jul 06 21:37:57.588868 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:37:57.588841 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5s6d9_e122448a-d2e4-4fec-a918-3d3eecb175a4/ovn-acl-logging/0.log" Jul 06 21:37:57.590520 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:37:57.590499 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5s6d9_e122448a-d2e4-4fec-a918-3d3eecb175a4/ovn-acl-logging/0.log" Jul 06 21:42:17.192567 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:42:17.192534 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-xgv7v_55e17066-002e-4ebb-a6cb-e4be26f3383d/global-pull-secret-syncer/0.log" Jul 06 21:42:17.196962 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:42:17.196938 2573 ???:1] "http: TLS handshake error from 10.0.132.134:41482: EOF" Jul 06 21:42:17.274067 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:42:17.274037 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-nkqqw_38c684b6-68c3-4edb-84a9-027b8a05f3a7/konnectivity-agent/0.log" Jul 06 21:42:17.331508 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:42:17.331479 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-130-89.ec2.internal_4d2cd5ec51313fc648acdd650b240a69/haproxy/0.log" Jul 06 21:42:21.694416 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:42:21.694387 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_dd6e4070-ac28-4be7-8ea1-3e892cf7e6f2/alertmanager/0.log" Jul 06 21:42:21.724574 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:42:21.724546 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_dd6e4070-ac28-4be7-8ea1-3e892cf7e6f2/config-reloader/0.log" Jul 06 21:42:21.750981 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:42:21.750953 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_dd6e4070-ac28-4be7-8ea1-3e892cf7e6f2/kube-rbac-proxy-web/0.log" Jul 06 21:42:21.779099 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:42:21.779072 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_dd6e4070-ac28-4be7-8ea1-3e892cf7e6f2/kube-rbac-proxy/0.log" Jul 06 21:42:21.807354 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:42:21.807323 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_dd6e4070-ac28-4be7-8ea1-3e892cf7e6f2/kube-rbac-proxy-metric/0.log" Jul 06 21:42:21.838009 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:42:21.837979 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_dd6e4070-ac28-4be7-8ea1-3e892cf7e6f2/prom-label-proxy/0.log" Jul 06 21:42:21.869929 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:42:21.869903 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_dd6e4070-ac28-4be7-8ea1-3e892cf7e6f2/init-config-reloader/0.log" Jul 06 21:42:21.913511 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:42:21.913479 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-kv8jl_3b0e3d2b-e597-46a2-862e-43a336240246/cluster-monitoring-operator/0.log" Jul 06 21:42:21.942509 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:42:21.942475 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-kmcbx_d21e8abf-7bce-4616-ac0e-d933f93f01a4/kube-state-metrics/0.log" Jul 06 21:42:21.973274 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:42:21.973176 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-kmcbx_d21e8abf-7bce-4616-ac0e-d933f93f01a4/kube-rbac-proxy-main/0.log" Jul 06 21:42:22.022301 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:42:22.022273 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-kmcbx_d21e8abf-7bce-4616-ac0e-d933f93f01a4/kube-rbac-proxy-self/0.log" Jul 06 21:42:22.320886 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:42:22.320859 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2g5t9_f2fbd02b-d01c-45d2-ba0d-2405b282570b/node-exporter/0.log" Jul 06 21:42:22.344944 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:42:22.344906 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2g5t9_f2fbd02b-d01c-45d2-ba0d-2405b282570b/kube-rbac-proxy/0.log" Jul 06 21:42:22.377258 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:42:22.377210 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2g5t9_f2fbd02b-d01c-45d2-ba0d-2405b282570b/init-textfile/0.log" Jul 06 21:42:22.959292 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:42:22.959265 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-d559d66d5-cbdt6_e1bcd6b2-0fc3-4df4-b9e6-6ab12096dbce/prometheus-operator-admission-webhook/0.log" Jul 06 21:42:23.000421 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:42:23.000390 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-64c9b55c7-v8tb4_cb77f7ed-2634-482c-8d25-3dae0e359422/telemeter-client/0.log" Jul 06 21:42:23.036465 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:42:23.036437 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-64c9b55c7-v8tb4_cb77f7ed-2634-482c-8d25-3dae0e359422/reload/0.log" Jul 06 21:42:23.065575 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:42:23.065545 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-64c9b55c7-v8tb4_cb77f7ed-2634-482c-8d25-3dae0e359422/kube-rbac-proxy/0.log" Jul 06 21:42:25.461291 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:42:25.461260 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-f7dc6ddc-hhgt7_dad9c782-eea3-44e2-9b59-cfc29e499055/console/0.log" Jul 06 21:42:25.545679 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:42:25.545642 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-5rcx5/perf-node-gather-daemonset-xtlwr"] Jul 06 21:42:25.545994 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:42:25.545982 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="899887d2-bb49-4df4-b877-de961f0fd19e" containerName="seaweedfs-tls-custom" Jul 06 21:42:25.546039 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:42:25.545996 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="899887d2-bb49-4df4-b877-de961f0fd19e" containerName="seaweedfs-tls-custom" Jul 06 21:42:25.546076 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:42:25.546057 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="899887d2-bb49-4df4-b877-de961f0fd19e" containerName="seaweedfs-tls-custom" Jul 06 21:42:25.548949 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:42:25.548931 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5rcx5/perf-node-gather-daemonset-xtlwr" Jul 06 21:42:25.553955 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:42:25.553925 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-5rcx5\"/\"openshift-service-ca.crt\"" Jul 06 21:42:25.557436 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:42:25.557412 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-5rcx5\"/\"default-dockercfg-9b8k8\"" Jul 06 21:42:25.557706 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:42:25.557690 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-5rcx5\"/\"kube-root-ca.crt\"" Jul 06 21:42:25.559828 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:42:25.559805 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-5rcx5/perf-node-gather-daemonset-xtlwr"] Jul 06 21:42:25.730956 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:42:25.730868 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d8jp6\" (UniqueName: \"kubernetes.io/projected/f4df0732-c708-4967-a83f-22bccc99f44e-kube-api-access-d8jp6\") pod \"perf-node-gather-daemonset-xtlwr\" (UID: \"f4df0732-c708-4967-a83f-22bccc99f44e\") " pod="openshift-must-gather-5rcx5/perf-node-gather-daemonset-xtlwr" Jul 06 21:42:25.730956 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:42:25.730909 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f4df0732-c708-4967-a83f-22bccc99f44e-podres\") pod \"perf-node-gather-daemonset-xtlwr\" (UID: \"f4df0732-c708-4967-a83f-22bccc99f44e\") " pod="openshift-must-gather-5rcx5/perf-node-gather-daemonset-xtlwr" Jul 06 21:42:25.731142 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:42:25.730992 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f4df0732-c708-4967-a83f-22bccc99f44e-proc\") pod \"perf-node-gather-daemonset-xtlwr\" (UID: \"f4df0732-c708-4967-a83f-22bccc99f44e\") " pod="openshift-must-gather-5rcx5/perf-node-gather-daemonset-xtlwr" Jul 06 21:42:25.731142 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:42:25.731033 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f4df0732-c708-4967-a83f-22bccc99f44e-lib-modules\") pod \"perf-node-gather-daemonset-xtlwr\" (UID: \"f4df0732-c708-4967-a83f-22bccc99f44e\") " pod="openshift-must-gather-5rcx5/perf-node-gather-daemonset-xtlwr" Jul 06 21:42:25.731142 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:42:25.731079 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f4df0732-c708-4967-a83f-22bccc99f44e-sys\") pod \"perf-node-gather-daemonset-xtlwr\" (UID: \"f4df0732-c708-4967-a83f-22bccc99f44e\") " pod="openshift-must-gather-5rcx5/perf-node-gather-daemonset-xtlwr" Jul 06 21:42:25.832574 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:42:25.832533 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f4df0732-c708-4967-a83f-22bccc99f44e-proc\") pod \"perf-node-gather-daemonset-xtlwr\" (UID: \"f4df0732-c708-4967-a83f-22bccc99f44e\") " pod="openshift-must-gather-5rcx5/perf-node-gather-daemonset-xtlwr" Jul 06 21:42:25.832574 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:42:25.832576 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f4df0732-c708-4967-a83f-22bccc99f44e-lib-modules\") pod \"perf-node-gather-daemonset-xtlwr\" (UID: \"f4df0732-c708-4967-a83f-22bccc99f44e\") " pod="openshift-must-gather-5rcx5/perf-node-gather-daemonset-xtlwr" Jul 06 21:42:25.832817 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:42:25.832620 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f4df0732-c708-4967-a83f-22bccc99f44e-sys\") pod \"perf-node-gather-daemonset-xtlwr\" (UID: \"f4df0732-c708-4967-a83f-22bccc99f44e\") " pod="openshift-must-gather-5rcx5/perf-node-gather-daemonset-xtlwr" Jul 06 21:42:25.832817 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:42:25.832666 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f4df0732-c708-4967-a83f-22bccc99f44e-proc\") pod \"perf-node-gather-daemonset-xtlwr\" (UID: \"f4df0732-c708-4967-a83f-22bccc99f44e\") " pod="openshift-must-gather-5rcx5/perf-node-gather-daemonset-xtlwr" Jul 06 21:42:25.832817 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:42:25.832696 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d8jp6\" (UniqueName: \"kubernetes.io/projected/f4df0732-c708-4967-a83f-22bccc99f44e-kube-api-access-d8jp6\") pod \"perf-node-gather-daemonset-xtlwr\" (UID: \"f4df0732-c708-4967-a83f-22bccc99f44e\") " pod="openshift-must-gather-5rcx5/perf-node-gather-daemonset-xtlwr" Jul 06 21:42:25.832817 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:42:25.832726 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f4df0732-c708-4967-a83f-22bccc99f44e-podres\") pod \"perf-node-gather-daemonset-xtlwr\" (UID: \"f4df0732-c708-4967-a83f-22bccc99f44e\") " pod="openshift-must-gather-5rcx5/perf-node-gather-daemonset-xtlwr" Jul 06 21:42:25.832817 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:42:25.832733 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f4df0732-c708-4967-a83f-22bccc99f44e-sys\") pod \"perf-node-gather-daemonset-xtlwr\" (UID: \"f4df0732-c708-4967-a83f-22bccc99f44e\") " pod="openshift-must-gather-5rcx5/perf-node-gather-daemonset-xtlwr" Jul 06 21:42:25.832817 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:42:25.832781 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f4df0732-c708-4967-a83f-22bccc99f44e-lib-modules\") pod \"perf-node-gather-daemonset-xtlwr\" (UID: \"f4df0732-c708-4967-a83f-22bccc99f44e\") " pod="openshift-must-gather-5rcx5/perf-node-gather-daemonset-xtlwr" Jul 06 21:42:25.833046 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:42:25.832862 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f4df0732-c708-4967-a83f-22bccc99f44e-podres\") pod \"perf-node-gather-daemonset-xtlwr\" (UID: \"f4df0732-c708-4967-a83f-22bccc99f44e\") " pod="openshift-must-gather-5rcx5/perf-node-gather-daemonset-xtlwr" Jul 06 21:42:25.841587 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:42:25.841559 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d8jp6\" (UniqueName: \"kubernetes.io/projected/f4df0732-c708-4967-a83f-22bccc99f44e-kube-api-access-d8jp6\") pod \"perf-node-gather-daemonset-xtlwr\" (UID: \"f4df0732-c708-4967-a83f-22bccc99f44e\") " pod="openshift-must-gather-5rcx5/perf-node-gather-daemonset-xtlwr" Jul 06 21:42:25.860016 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:42:25.859979 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5rcx5/perf-node-gather-daemonset-xtlwr" Jul 06 21:42:25.996973 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:42:25.996948 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-5rcx5/perf-node-gather-daemonset-xtlwr"] Jul 06 21:42:25.999476 ip-10-0-130-89 kubenswrapper[2573]: W0706 21:42:25.999443 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podf4df0732_c708_4967_a83f_22bccc99f44e.slice/crio-4a0f4e1e64bdb32376cccee665af49aac3abef4d4e50ed24b926a3af02b014b9 WatchSource:0}: Error finding container 4a0f4e1e64bdb32376cccee665af49aac3abef4d4e50ed24b926a3af02b014b9: Status 404 returned error can't find the container with id 4a0f4e1e64bdb32376cccee665af49aac3abef4d4e50ed24b926a3af02b014b9 Jul 06 21:42:26.129549 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:42:26.129521 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5d456fdbcd-rkz9r_47b5dbc3-1838-427d-bc7a-0f2fd0034d66/volume-data-source-validator/0.log" Jul 06 21:42:26.241621 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:42:26.241583 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5rcx5/perf-node-gather-daemonset-xtlwr" event={"ID":"f4df0732-c708-4967-a83f-22bccc99f44e","Type":"ContainerStarted","Data":"cce70feb6746eaeda9435e0faa6c500dbf2ae0f389a2271dc37d03208b51057b"} Jul 06 21:42:26.241801 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:42:26.241642 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5rcx5/perf-node-gather-daemonset-xtlwr" event={"ID":"f4df0732-c708-4967-a83f-22bccc99f44e","Type":"ContainerStarted","Data":"4a0f4e1e64bdb32376cccee665af49aac3abef4d4e50ed24b926a3af02b014b9"} Jul 06 21:42:26.241801 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:42:26.241707 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-5rcx5/perf-node-gather-daemonset-xtlwr" Jul 06 21:42:26.261397 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:42:26.261290 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-5rcx5/perf-node-gather-daemonset-xtlwr" podStartSLOduration=1.26127179 podStartE2EDuration="1.26127179s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 21:42:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:42:26.259675939 +0000 UTC m=+1769.207053944" watchObservedRunningTime="2026-07-06 21:42:26.26127179 +0000 UTC m=+1769.208649789" Jul 06 21:42:27.094746 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:42:27.094711 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-b9fg2_c910d322-60b9-4b57-a172-4751e6c8f186/dns/0.log" Jul 06 21:42:27.118262 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:42:27.118225 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-b9fg2_c910d322-60b9-4b57-a172-4751e6c8f186/kube-rbac-proxy/0.log" Jul 06 21:42:27.202906 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:42:27.202880 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-tdbzc_e7ec46bc-523f-4480-9245-42931eac113a/dns-node-resolver/0.log" Jul 06 21:42:27.714166 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:42:27.714135 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-5d5b8885c7-6zrwj_c215fc9a-5c0c-46a8-a0cb-c2e71626b614/registry/0.log" Jul 06 21:42:27.719798 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:42:27.719777 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-5d5b8885c7-6zrwj_c215fc9a-5c0c-46a8-a0cb-c2e71626b614/registry/1.log" Jul 06 21:42:27.742465 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:42:27.742429 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-4rqvd_f4aa139a-9e46-4075-8358-6da2c8f30cec/node-ca/0.log" Jul 06 21:42:28.626506 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:42:28.626472 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-857d447b7f-25xtr_d8b64eb8-e2ff-44a0-b9d9-67aba5e93c35/router/0.log" Jul 06 21:42:29.000749 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:42:29.000671 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-5qvhk_5ccd93e4-2c62-426c-93af-da45c500e964/serve-healthcheck-canary/0.log" Jul 06 21:42:29.603973 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:42:29.603945 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vlfkz_11b17aab-3d0b-48ee-a3e9-2ba3ee4480cb/kube-rbac-proxy/0.log" Jul 06 21:42:29.625960 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:42:29.625933 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vlfkz_11b17aab-3d0b-48ee-a3e9-2ba3ee4480cb/exporter/0.log" Jul 06 21:42:29.648426 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:42:29.648398 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vlfkz_11b17aab-3d0b-48ee-a3e9-2ba3ee4480cb/extractor/0.log" Jul 06 21:42:31.806361 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:42:31.806306 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_llmisvc-controller-manager-67d95fdc48-nvs2v_257556c9-60e7-4d84-a1c5-6d04fce3f8e9/manager/0.log" Jul 06 21:42:32.256306 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:42:32.256223 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-5rcx5/perf-node-gather-daemonset-xtlwr" Jul 06 21:42:36.943489 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:42:36.943440 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-wbjrz_27206ad5-a38e-4ee2-9f3f-45c8facd8a25/kube-storage-version-migrator-operator/1.log" Jul 06 21:42:36.944257 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:42:36.944219 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-wbjrz_27206ad5-a38e-4ee2-9f3f-45c8facd8a25/kube-storage-version-migrator-operator/0.log" Jul 06 21:42:37.866329 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:42:37.866295 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-4hcwd_d3b41b14-af75-441a-aa29-61d90ead4d44/kube-multus/0.log" Jul 06 21:42:37.955845 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:42:37.955813 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-l26xp_83297255-f507-48e1-80d6-6c8b9d5e1a81/kube-multus-additional-cni-plugins/0.log" Jul 06 21:42:37.978022 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:42:37.977990 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-l26xp_83297255-f507-48e1-80d6-6c8b9d5e1a81/egress-router-binary-copy/0.log" Jul 06 21:42:38.000523 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:42:38.000496 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-l26xp_83297255-f507-48e1-80d6-6c8b9d5e1a81/cni-plugins/0.log" Jul 06 21:42:38.023293 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:42:38.023248 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-l26xp_83297255-f507-48e1-80d6-6c8b9d5e1a81/bond-cni-plugin/0.log" Jul 06 21:42:38.047719 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:42:38.047691 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-l26xp_83297255-f507-48e1-80d6-6c8b9d5e1a81/routeoverride-cni/0.log" Jul 06 21:42:38.070450 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:42:38.070417 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-l26xp_83297255-f507-48e1-80d6-6c8b9d5e1a81/whereabouts-cni-bincopy/0.log" Jul 06 21:42:38.094604 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:42:38.094569 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-l26xp_83297255-f507-48e1-80d6-6c8b9d5e1a81/whereabouts-cni/0.log" Jul 06 21:42:38.589822 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:42:38.589796 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-w5754_3a3548bd-1472-470c-bda5-a7c611571bea/network-metrics-daemon/0.log" Jul 06 21:42:38.613001 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:42:38.612976 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-w5754_3a3548bd-1472-470c-bda5-a7c611571bea/kube-rbac-proxy/0.log" Jul 06 21:42:39.386747 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:42:39.386717 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5s6d9_e122448a-d2e4-4fec-a918-3d3eecb175a4/ovn-controller/0.log" Jul 06 21:42:39.409959 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:42:39.409933 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5s6d9_e122448a-d2e4-4fec-a918-3d3eecb175a4/ovn-acl-logging/1.log" Jul 06 21:42:39.409959 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:42:39.409952 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5s6d9_e122448a-d2e4-4fec-a918-3d3eecb175a4/ovn-acl-logging/0.log" Jul 06 21:42:39.435031 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:42:39.435000 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5s6d9_e122448a-d2e4-4fec-a918-3d3eecb175a4/kube-rbac-proxy-node/0.log" Jul 06 21:42:39.457956 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:42:39.457928 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5s6d9_e122448a-d2e4-4fec-a918-3d3eecb175a4/kube-rbac-proxy-ovn-metrics/0.log" Jul 06 21:42:39.480765 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:42:39.480739 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5s6d9_e122448a-d2e4-4fec-a918-3d3eecb175a4/northd/0.log" Jul 06 21:42:39.506864 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:42:39.506835 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5s6d9_e122448a-d2e4-4fec-a918-3d3eecb175a4/nbdb/0.log" Jul 06 21:42:39.532912 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:42:39.532886 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5s6d9_e122448a-d2e4-4fec-a918-3d3eecb175a4/sbdb/0.log" Jul 06 21:42:39.581337 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:42:39.581303 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5s6d9_e122448a-d2e4-4fec-a918-3d3eecb175a4/ovnkube-controller/0.log" Jul 06 21:42:41.129099 ip-10-0-130-89 kubenswrapper[2573]: I0706 21:42:41.129032 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-2vbd9_c5dccb0b-1724-44ec-a683-c8a45526a11a/network-check-target-container/0.log"